2024-09-17T02:05:52.967 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T02:05:52.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T02:05:53.065 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908093 branch: squid description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-distros/ubuntu_latest tasks/admin_socket_objecter_requests thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7908093' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi no_nested_subset: false os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: client.0: admin socket: /var/run/ceph/ceph-$name.asok mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: zstd bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: e20bff7d16f5b09c58ead9548e8cf98cf87ee227 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 4845 sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f sleep_before_teardown: 0 subset: 2/4 suite: powercycle suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: e20bff7d16f5b09c58ead9548e8cf98cf87ee227 targets: smithi001.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDcyL+7MyPMqFhtXtNLT1zjWOyWS+cKVlTASvYluRv0A4rWGsP6GbEy22y82DzIx0Zz45oM6MLOEsGbV/umQzYM= smithi032.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIY9NLKYDF2EH/P0V9X8MrY/fHCQGjdtN+GVOau1HFFuZ96DLQ6OoG2suntoYE0MkUqmlNtNtOG/z3mA616sFGw= smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK6nCyI4RjPVpj6QY8MuyjcL8W0GdswXtR64BWvOR03QaLirhy3l7MPrgqW0GS7LtJJ5KcYtvqbn8coTF2xvhdk= smithi164.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJx9Isemf1elOibihOXkHLuaqD36e2lHzfDmT8gb3rI1lZOuYSQ2xoJGcQOXVFoiak9trvqFoHafV6OIGyvrnDE= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - radosbench: clients: - client.0 time: 60 - admin_socket: client.0: objecter_requests: test: http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch} teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-16_21:32:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-17T02:05:53.065 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa; will attempt to use it 2024-09-17T02:05:53.066 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa/tasks 2024-09-17T02:05:53.066 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T02:05:53.067 INFO:teuthology.task.internal:Checking packages... 2024-09-17T02:05:53.089 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'c2ddf9721ef254645201cdbabd9c8f49c30a586f' 2024-09-17T02:05:53.089 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T02:05:53.089 INFO:teuthology.packaging:ref: None 2024-09-17T02:05:53.090 INFO:teuthology.packaging:tag: None 2024-09-17T02:05:53.090 INFO:teuthology.packaging:branch: squid 2024-09-17T02:05:53.090 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T02:05:53.090 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-09-17T02:05:53.320 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-336-ge20bff7d-1jammy 2024-09-17T02:05:53.322 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T02:05:53.328 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T02:05:53.328 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T02:05:53.345 INFO:teuthology.task.internal:Saving configuration 2024-09-17T02:05:53.358 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T02:05:53.441 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T02:05:53.467 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi001.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908093', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 01:59:53.551509', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAID3ISStxxUSf0CAFN6wa39yC7izxsXEku8zhioX6Z5TH'} 2024-09-17T02:05:53.490 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908093', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 01:59:53.552598', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBmBaXfZbSuH0pwgfGhVoa3J6YWZMRou3sE9rGXt8xx4'} 2024-09-17T02:05:53.514 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908093', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 01:59:53.548009', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPEtpkMJMjcZUdfsaHmWO3nbU/dOXmIVCIp94ZlkzSDo'} 2024-09-17T02:05:53.533 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908093', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 01:59:53.550007', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKmew9K7dhAs3wNBAmE+2C/JScFSnFV1VGaLyFiZUL/C'} 2024-09-17T02:05:53.534 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T02:05:53.541 INFO:teuthology.task.internal:roles: ubuntu@smithi001.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-09-17T02:05:53.541 INFO:teuthology.task.internal:roles: ubuntu@smithi032.front.sepia.ceph.com - ['osd.0'] 2024-09-17T02:05:53.541 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['osd.1'] 2024-09-17T02:05:53.541 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['osd.2'] 2024-09-17T02:05:53.541 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T02:05:53.661 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f623130eef0>, signals=[15]) 2024-09-17T02:05:53.661 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T02:05:53.668 INFO:teuthology.task.internal:Opening connections... 2024-09-17T02:05:53.668 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi001.front.sepia.ceph.com 2024-09-17T02:05:53.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:05:53.752 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi032.front.sepia.ceph.com 2024-09-17T02:05:53.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:05:53.846 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2024-09-17T02:05:53.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:05:53.926 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi164.front.sepia.ceph.com 2024-09-17T02:05:53.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:05:54.029 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T02:05:54.037 DEBUG:teuthology.orchestra.run.smithi001:> uname -m 2024-09-17T02:05:54.043 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64 2024-09-17T02:05:54.043 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release 2024-09-17T02:05:54.089 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-17T02:05:54.090 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="Ubuntu" 2024-09-17T02:05:54.090 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="22.04" 2024-09-17T02:05:54.090 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-17T02:05:54.090 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_CODENAME=jammy 2024-09-17T02:05:54.090 INFO:teuthology.orchestra.run.smithi001.stdout:ID=ubuntu 2024-09-17T02:05:54.090 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE=debian 2024-09-17T02:05:54.090 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-17T02:05:54.090 INFO:teuthology.orchestra.run.smithi001.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-17T02:05:54.090 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-17T02:05:54.090 INFO:teuthology.orchestra.run.smithi001.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-17T02:05:54.090 INFO:teuthology.orchestra.run.smithi001.stdout:UBUNTU_CODENAME=jammy 2024-09-17T02:05:54.091 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2024-09-17T02:05:54.116 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2024-09-17T02:05:54.122 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2024-09-17T02:05:54.122 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2024-09-17T02:05:54.168 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-17T02:05:54.169 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Ubuntu" 2024-09-17T02:05:54.169 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="22.04" 2024-09-17T02:05:54.169 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-17T02:05:54.169 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_CODENAME=jammy 2024-09-17T02:05:54.169 INFO:teuthology.orchestra.run.smithi032.stdout:ID=ubuntu 2024-09-17T02:05:54.169 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE=debian 2024-09-17T02:05:54.169 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-17T02:05:54.169 INFO:teuthology.orchestra.run.smithi032.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-17T02:05:54.169 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-17T02:05:54.169 INFO:teuthology.orchestra.run.smithi032.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-17T02:05:54.169 INFO:teuthology.orchestra.run.smithi032.stdout:UBUNTU_CODENAME=jammy 2024-09-17T02:05:54.170 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2024-09-17T02:05:54.191 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2024-09-17T02:05:54.197 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2024-09-17T02:05:54.197 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2024-09-17T02:05:54.244 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-17T02:05:54.244 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu" 2024-09-17T02:05:54.244 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="22.04" 2024-09-17T02:05:54.244 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-17T02:05:54.244 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=jammy 2024-09-17T02:05:54.244 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu 2024-09-17T02:05:54.244 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian 2024-09-17T02:05:54.244 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-17T02:05:54.245 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-17T02:05:54.245 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-17T02:05:54.245 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-17T02:05:54.245 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=jammy 2024-09-17T02:05:54.245 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2024-09-17T02:05:54.266 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2024-09-17T02:05:54.272 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2024-09-17T02:05:54.272 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2024-09-17T02:05:54.322 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-17T02:05:54.322 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Ubuntu" 2024-09-17T02:05:54.322 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="22.04" 2024-09-17T02:05:54.322 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-17T02:05:54.322 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_CODENAME=jammy 2024-09-17T02:05:54.323 INFO:teuthology.orchestra.run.smithi164.stdout:ID=ubuntu 2024-09-17T02:05:54.323 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE=debian 2024-09-17T02:05:54.323 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-17T02:05:54.323 INFO:teuthology.orchestra.run.smithi164.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-17T02:05:54.323 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-17T02:05:54.323 INFO:teuthology.orchestra.run.smithi164.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-17T02:05:54.323 INFO:teuthology.orchestra.run.smithi164.stdout:UBUNTU_CODENAME=jammy 2024-09-17T02:05:54.323 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2024-09-17T02:05:54.349 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T02:05:54.359 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T02:05:54.376 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T02:05:54.377 DEBUG:teuthology.orchestra.run.smithi001:> test '!' -e /home/ubuntu/cephtest 2024-09-17T02:05:54.379 DEBUG:teuthology.orchestra.run.smithi032:> test '!' -e /home/ubuntu/cephtest 2024-09-17T02:05:54.382 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2024-09-17T02:05:54.385 DEBUG:teuthology.orchestra.run.smithi164:> test '!' -e /home/ubuntu/cephtest 2024-09-17T02:05:54.389 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T02:05:54.397 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T02:05:54.397 DEBUG:teuthology.orchestra.run.smithi001:> test -z $(ls -A /var/lib/ceph) 2024-09-17T02:05:54.426 DEBUG:teuthology.orchestra.run.smithi032:> test -z $(ls -A /var/lib/ceph) 2024-09-17T02:05:54.431 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2024-09-17T02:05:54.434 DEBUG:teuthology.orchestra.run.smithi164:> test -z $(ls -A /var/lib/ceph) 2024-09-17T02:05:54.455 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T02:05:54.545 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T02:05:54.565 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-17T02:05:54.565 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-17T02:05:54.566 DEBUG:teuthology.orchestra.run.smithi001:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T02:05:54.566 DEBUG:teuthology.orchestra.run.smithi032:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T02:05:54.567 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T02:05:54.567 DEBUG:teuthology.orchestra.run.smithi164:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T02:05:54.572 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:05:54.572 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-09-17T02:05:54.573 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:05:54.573 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:05:54.574 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:05:54.574 DEBUG:teuthology.orchestra.run.smithi001:> uname -r 2024-09-17T02:05:54.575 DEBUG:teuthology.orchestra.run.smithi032:> uname -r 2024-09-17T02:05:54.575 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-09-17T02:05:54.619 INFO:teuthology.orchestra.run.smithi153.stdout:5.15.0-56-generic 2024-09-17T02:05:54.620 INFO:teuthology.task.kernel:Running kernel on smithi153: 5.15.0-56-generic 2024-09-17T02:05:54.620 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get clean 2024-09-17T02:05:54.622 INFO:teuthology.orchestra.run.smithi001.stdout:5.15.0-56-generic 2024-09-17T02:05:54.622 INFO:teuthology.task.kernel:Running kernel on smithi001: 5.15.0-56-generic 2024-09-17T02:05:54.622 DEBUG:teuthology.orchestra.run.smithi001:> sudo apt-get clean 2024-09-17T02:05:54.624 INFO:teuthology.orchestra.run.smithi164.stdout:5.15.0-56-generic 2024-09-17T02:05:54.624 INFO:teuthology.task.kernel:Running kernel on smithi164: 5.15.0-56-generic 2024-09-17T02:05:54.624 DEBUG:teuthology.orchestra.run.smithi164:> sudo apt-get clean 2024-09-17T02:05:54.625 INFO:teuthology.orchestra.run.smithi032.stdout:5.15.0-56-generic 2024-09-17T02:05:54.625 INFO:teuthology.task.kernel:Running kernel on smithi032: 5.15.0-56-generic 2024-09-17T02:05:54.627 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get clean 2024-09-17T02:05:54.744 DEBUG:teuthology.orchestra.run.smithi001:> sudo apt-get update 2024-09-17T02:05:54.746 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get update 2024-09-17T02:05:54.764 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get update 2024-09-17T02:05:54.766 DEBUG:teuthology.orchestra.run.smithi164:> sudo apt-get update 2024-09-17T02:05:54.897 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T02:05:54.908 INFO:teuthology.orchestra.run.smithi001.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T02:05:54.908 INFO:teuthology.orchestra.run.smithi001.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-17T02:05:54.908 INFO:teuthology.orchestra.run.smithi001.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-17T02:05:54.928 INFO:teuthology.orchestra.run.smithi164.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-17T02:05:54.976 INFO:teuthology.orchestra.run.smithi001.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-17T02:05:54.990 INFO:teuthology.orchestra.run.smithi164.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-17T02:05:55.010 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T02:05:55.010 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-17T02:05:55.014 INFO:teuthology.orchestra.run.smithi164.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-17T02:05:55.063 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T02:05:55.065 INFO:teuthology.orchestra.run.smithi032.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-17T02:05:55.074 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-17T02:05:55.114 INFO:teuthology.orchestra.run.smithi032.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-17T02:05:55.120 INFO:teuthology.orchestra.run.smithi164.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-17T02:05:55.150 INFO:teuthology.orchestra.run.smithi001.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-17T02:05:55.239 INFO:teuthology.orchestra.run.smithi164.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-17T02:05:55.244 INFO:teuthology.orchestra.run.smithi164.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-17T02:05:55.247 INFO:teuthology.orchestra.run.smithi164.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-17T02:05:55.247 INFO:teuthology.orchestra.run.smithi164.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-17T02:05:55.258 INFO:teuthology.orchestra.run.smithi001.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-17T02:05:55.270 INFO:teuthology.orchestra.run.smithi164.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-17T02:05:55.270 INFO:teuthology.orchestra.run.smithi164.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-17T02:05:55.274 INFO:teuthology.orchestra.run.smithi164.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-17T02:05:55.274 INFO:teuthology.orchestra.run.smithi164.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-17T02:05:55.276 INFO:teuthology.orchestra.run.smithi001.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-17T02:05:55.279 INFO:teuthology.orchestra.run.smithi164.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-17T02:05:55.280 INFO:teuthology.orchestra.run.smithi001.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-17T02:05:55.283 INFO:teuthology.orchestra.run.smithi001.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-17T02:05:55.283 INFO:teuthology.orchestra.run.smithi001.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-17T02:05:55.283 INFO:teuthology.orchestra.run.smithi001.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-17T02:05:55.287 INFO:teuthology.orchestra.run.smithi164.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-17T02:05:55.289 INFO:teuthology.orchestra.run.smithi164.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-17T02:05:55.289 INFO:teuthology.orchestra.run.smithi164.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-17T02:05:55.290 INFO:teuthology.orchestra.run.smithi164.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-17T02:05:55.294 INFO:teuthology.orchestra.run.smithi001.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-17T02:05:55.304 INFO:teuthology.orchestra.run.smithi001.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-17T02:05:55.307 INFO:teuthology.orchestra.run.smithi001.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-17T02:05:55.307 INFO:teuthology.orchestra.run.smithi001.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-17T02:05:55.313 INFO:teuthology.orchestra.run.smithi001.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-17T02:05:55.319 INFO:teuthology.orchestra.run.smithi001.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-17T02:05:55.321 INFO:teuthology.orchestra.run.smithi001.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-17T02:05:55.330 INFO:teuthology.orchestra.run.smithi164.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-17T02:05:55.331 INFO:teuthology.orchestra.run.smithi164.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-17T02:05:55.331 INFO:teuthology.orchestra.run.smithi164.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-17T02:05:55.335 INFO:teuthology.orchestra.run.smithi164.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-17T02:05:55.336 INFO:teuthology.orchestra.run.smithi164.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-17T02:05:55.337 INFO:teuthology.orchestra.run.smithi164.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-17T02:05:55.337 INFO:teuthology.orchestra.run.smithi164.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-17T02:05:55.337 INFO:teuthology.orchestra.run.smithi164.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-17T02:05:55.337 INFO:teuthology.orchestra.run.smithi164.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-17T02:05:55.338 INFO:teuthology.orchestra.run.smithi164.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-17T02:05:55.342 INFO:teuthology.orchestra.run.smithi001.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-17T02:05:55.342 INFO:teuthology.orchestra.run.smithi001.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-17T02:05:55.349 INFO:teuthology.orchestra.run.smithi001.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-17T02:05:55.350 INFO:teuthology.orchestra.run.smithi001.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-17T02:05:55.351 INFO:teuthology.orchestra.run.smithi001.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-17T02:05:55.351 INFO:teuthology.orchestra.run.smithi001.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-17T02:05:55.352 INFO:teuthology.orchestra.run.smithi001.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-17T02:05:55.397 INFO:teuthology.orchestra.run.smithi001.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-17T02:05:55.399 INFO:teuthology.orchestra.run.smithi001.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-17T02:05:55.403 INFO:teuthology.orchestra.run.smithi001.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-17T02:05:55.404 INFO:teuthology.orchestra.run.smithi001.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-17T02:05:55.414 INFO:teuthology.orchestra.run.smithi001.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-17T02:05:55.421 INFO:teuthology.orchestra.run.smithi001.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-17T02:05:55.423 INFO:teuthology.orchestra.run.smithi001.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-17T02:05:55.424 INFO:teuthology.orchestra.run.smithi001.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-17T02:05:55.424 INFO:teuthology.orchestra.run.smithi001.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-17T02:05:55.425 INFO:teuthology.orchestra.run.smithi001.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-17T02:05:55.430 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-17T02:05:55.434 INFO:teuthology.orchestra.run.smithi001.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-17T02:05:55.435 INFO:teuthology.orchestra.run.smithi001.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-17T02:05:55.435 INFO:teuthology.orchestra.run.smithi001.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-17T02:05:55.436 INFO:teuthology.orchestra.run.smithi001.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-17T02:05:55.452 INFO:teuthology.orchestra.run.smithi001.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-17T02:05:55.452 INFO:teuthology.orchestra.run.smithi001.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-17T02:05:55.452 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-17T02:05:55.453 INFO:teuthology.orchestra.run.smithi001.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-17T02:05:55.453 INFO:teuthology.orchestra.run.smithi001.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-17T02:05:55.453 INFO:teuthology.orchestra.run.smithi001.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-17T02:05:55.469 INFO:teuthology.orchestra.run.smithi032.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-17T02:05:55.487 INFO:teuthology.orchestra.run.smithi164.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-17T02:05:55.494 INFO:teuthology.orchestra.run.smithi032.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-17T02:05:55.569 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-17T02:05:55.607 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-17T02:05:55.770 INFO:teuthology.orchestra.run.smithi164.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-17T02:05:55.775 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-17T02:05:55.787 INFO:teuthology.orchestra.run.smithi032.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-17T02:05:55.803 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-17T02:05:55.873 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-17T02:05:55.889 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-17T02:05:55.898 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-17T02:05:55.898 INFO:teuthology.orchestra.run.smithi153.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-17T02:05:55.900 INFO:teuthology.orchestra.run.smithi153.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-17T02:05:55.924 INFO:teuthology.orchestra.run.smithi153.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-17T02:05:55.938 INFO:teuthology.orchestra.run.smithi153.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-17T02:05:55.938 INFO:teuthology.orchestra.run.smithi153.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-17T02:05:55.940 INFO:teuthology.orchestra.run.smithi153.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-17T02:05:55.944 INFO:teuthology.orchestra.run.smithi164.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-17T02:05:55.956 INFO:teuthology.orchestra.run.smithi164.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-17T02:05:55.957 INFO:teuthology.orchestra.run.smithi164.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-17T02:05:55.961 INFO:teuthology.orchestra.run.smithi032.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-17T02:05:55.965 INFO:teuthology.orchestra.run.smithi032.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-17T02:05:55.974 INFO:teuthology.orchestra.run.smithi032.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-17T02:05:55.975 INFO:teuthology.orchestra.run.smithi032.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-17T02:05:55.979 INFO:teuthology.orchestra.run.smithi032.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-17T02:05:55.980 INFO:teuthology.orchestra.run.smithi032.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-17T02:05:55.981 INFO:teuthology.orchestra.run.smithi032.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-17T02:05:55.996 INFO:teuthology.orchestra.run.smithi153.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-17T02:05:56.007 INFO:teuthology.orchestra.run.smithi153.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-17T02:05:56.051 INFO:teuthology.orchestra.run.smithi032.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-17T02:05:56.055 INFO:teuthology.orchestra.run.smithi164.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-17T02:05:56.057 INFO:teuthology.orchestra.run.smithi164.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-17T02:05:56.060 INFO:teuthology.orchestra.run.smithi032.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-17T02:05:56.060 INFO:teuthology.orchestra.run.smithi153.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-17T02:05:56.060 INFO:teuthology.orchestra.run.smithi153.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-17T02:05:56.061 INFO:teuthology.orchestra.run.smithi032.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-17T02:05:56.066 INFO:teuthology.orchestra.run.smithi153.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-17T02:05:56.067 INFO:teuthology.orchestra.run.smithi153.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-17T02:05:56.067 INFO:teuthology.orchestra.run.smithi153.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-17T02:05:56.075 INFO:teuthology.orchestra.run.smithi164.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-17T02:05:56.075 INFO:teuthology.orchestra.run.smithi164.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-17T02:05:56.076 INFO:teuthology.orchestra.run.smithi153.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-17T02:05:56.078 INFO:teuthology.orchestra.run.smithi153.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-17T02:05:56.078 INFO:teuthology.orchestra.run.smithi153.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-17T02:05:56.078 INFO:teuthology.orchestra.run.smithi153.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-17T02:05:56.079 INFO:teuthology.orchestra.run.smithi153.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-17T02:05:56.079 INFO:teuthology.orchestra.run.smithi153.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-17T02:05:56.095 INFO:teuthology.orchestra.run.smithi153.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-17T02:05:56.098 INFO:teuthology.orchestra.run.smithi032.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-17T02:05:56.098 INFO:teuthology.orchestra.run.smithi032.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-17T02:05:56.098 INFO:teuthology.orchestra.run.smithi153.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-17T02:05:56.099 INFO:teuthology.orchestra.run.smithi164.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-17T02:05:56.099 INFO:teuthology.orchestra.run.smithi032.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-17T02:05:56.099 INFO:teuthology.orchestra.run.smithi032.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-17T02:05:56.100 INFO:teuthology.orchestra.run.smithi153.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-17T02:05:56.100 INFO:teuthology.orchestra.run.smithi153.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-17T02:05:56.100 INFO:teuthology.orchestra.run.smithi153.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-17T02:05:56.110 INFO:teuthology.orchestra.run.smithi032.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-17T02:05:56.112 INFO:teuthology.orchestra.run.smithi032.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-17T02:05:56.117 INFO:teuthology.orchestra.run.smithi164.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-17T02:05:56.120 INFO:teuthology.orchestra.run.smithi164.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-17T02:05:56.121 INFO:teuthology.orchestra.run.smithi164.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-17T02:05:56.121 INFO:teuthology.orchestra.run.smithi164.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-17T02:05:56.126 INFO:teuthology.orchestra.run.smithi032.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-17T02:05:56.130 INFO:teuthology.orchestra.run.smithi032.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-17T02:05:56.130 INFO:teuthology.orchestra.run.smithi032.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-17T02:05:56.131 INFO:teuthology.orchestra.run.smithi032.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-17T02:05:56.132 INFO:teuthology.orchestra.run.smithi032.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-17T02:05:56.133 INFO:teuthology.orchestra.run.smithi153.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-17T02:05:56.136 INFO:teuthology.orchestra.run.smithi032.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-17T02:05:56.137 INFO:teuthology.orchestra.run.smithi032.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-17T02:05:56.137 INFO:teuthology.orchestra.run.smithi032.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-17T02:05:56.138 INFO:teuthology.orchestra.run.smithi032.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-17T02:05:56.177 INFO:teuthology.orchestra.run.smithi153.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-17T02:05:56.178 INFO:teuthology.orchestra.run.smithi153.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-17T02:05:56.179 INFO:teuthology.orchestra.run.smithi153.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-17T02:05:56.180 INFO:teuthology.orchestra.run.smithi153.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-17T02:05:56.189 INFO:teuthology.orchestra.run.smithi164.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-17T02:05:56.190 INFO:teuthology.orchestra.run.smithi164.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-17T02:05:56.207 INFO:teuthology.orchestra.run.smithi032.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-17T02:05:56.207 INFO:teuthology.orchestra.run.smithi032.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-17T02:05:56.211 INFO:teuthology.orchestra.run.smithi032.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-17T02:05:56.211 INFO:teuthology.orchestra.run.smithi032.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-17T02:05:56.212 INFO:teuthology.orchestra.run.smithi032.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-17T02:05:56.213 INFO:teuthology.orchestra.run.smithi032.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-17T02:05:56.259 INFO:teuthology.orchestra.run.smithi153.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-17T02:05:56.259 INFO:teuthology.orchestra.run.smithi153.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-17T02:05:56.260 INFO:teuthology.orchestra.run.smithi153.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-17T02:05:56.261 INFO:teuthology.orchestra.run.smithi153.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-17T02:05:56.261 INFO:teuthology.orchestra.run.smithi153.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-17T02:05:56.293 INFO:teuthology.orchestra.run.smithi032.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-17T02:05:56.297 INFO:teuthology.orchestra.run.smithi032.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-17T02:05:56.297 INFO:teuthology.orchestra.run.smithi032.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-17T02:05:56.298 INFO:teuthology.orchestra.run.smithi032.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-17T02:05:56.298 INFO:teuthology.orchestra.run.smithi032.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-17T02:06:01.843 INFO:teuthology.orchestra.run.smithi164.stdout:Fetched 16.1 MB in 2s (7,375 kB/s) 2024-09-17T02:06:01.952 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 16.1 MB in 3s (5,906 kB/s) 2024-09-17T02:06:01.967 INFO:teuthology.orchestra.run.smithi001.stdout:Fetched 16.1 MB in 2s (7,026 kB/s) 2024-09-17T02:06:02.601 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 16.1 MB in 3s (5,694 kB/s) 2024-09-17T02:06:03.231 INFO:teuthology.orchestra.run.smithi164.stdout:Reading package lists... 2024-09-17T02:06:03.249 DEBUG:teuthology.orchestra.run.smithi164:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T02:06:03.303 INFO:teuthology.orchestra.run.smithi164.stdout:Reading package lists... 2024-09-17T02:06:03.364 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-17T02:06:03.381 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T02:06:03.428 INFO:teuthology.orchestra.run.smithi001.stdout:Reading package lists... 2024-09-17T02:06:03.437 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-17T02:06:03.445 DEBUG:teuthology.orchestra.run.smithi001:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T02:06:03.499 INFO:teuthology.orchestra.run.smithi164.stdout:Building dependency tree... 2024-09-17T02:06:03.499 INFO:teuthology.orchestra.run.smithi164.stdout:Reading state information... 2024-09-17T02:06:03.503 INFO:teuthology.orchestra.run.smithi001.stdout:Reading package lists... 2024-09-17T02:06:03.624 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-09-17T02:06:03.625 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-09-17T02:06:03.676 INFO:teuthology.orchestra.run.smithi164.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T02:06:03.676 INFO:teuthology.orchestra.run.smithi164.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T02:06:03.676 INFO:teuthology.orchestra.run.smithi164.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T02:06:03.677 INFO:teuthology.orchestra.run.smithi164.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T02:06:03.677 INFO:teuthology.orchestra.run.smithi164.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-17T02:06:03.677 INFO:teuthology.orchestra.run.smithi164.stdout: python2.7-minimal 2024-09-17T02:06:03.677 INFO:teuthology.orchestra.run.smithi164.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T02:06:03.679 INFO:teuthology.orchestra.run.smithi164.stdout:The following additional packages will be installed: 2024-09-17T02:06:03.679 INFO:teuthology.orchestra.run.smithi164.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T02:06:03.679 INFO:teuthology.orchestra.run.smithi164.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-17T02:06:03.679 INFO:teuthology.orchestra.run.smithi164.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-17T02:06:03.681 INFO:teuthology.orchestra.run.smithi164.stdout:Suggested packages: 2024-09-17T02:06:03.681 INFO:teuthology.orchestra.run.smithi164.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-17T02:06:03.681 INFO:teuthology.orchestra.run.smithi164.stdout:Recommended packages: 2024-09-17T02:06:03.681 INFO:teuthology.orchestra.run.smithi164.stdout: thermald 2024-09-17T02:06:03.694 INFO:teuthology.orchestra.run.smithi001.stdout:Building dependency tree... 2024-09-17T02:06:03.694 INFO:teuthology.orchestra.run.smithi001.stdout:Reading state information... 2024-09-17T02:06:03.723 INFO:teuthology.orchestra.run.smithi164.stdout:The following NEW packages will be installed: 2024-09-17T02:06:03.723 INFO:teuthology.orchestra.run.smithi164.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T02:06:03.723 INFO:teuthology.orchestra.run.smithi164.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-17T02:06:03.724 INFO:teuthology.orchestra.run.smithi164.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-17T02:06:03.725 INFO:teuthology.orchestra.run.smithi164.stdout:The following packages will be upgraded: 2024-09-17T02:06:03.725 INFO:teuthology.orchestra.run.smithi164.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-17T02:06:03.777 INFO:teuthology.orchestra.run.smithi164.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T02:06:03.777 INFO:teuthology.orchestra.run.smithi164.stdout:Need to get 113 MB of archives. 2024-09-17T02:06:03.777 INFO:teuthology.orchestra.run.smithi164.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-17T02:06:03.777 INFO:teuthology.orchestra.run.smithi164.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-17T02:06:03.790 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T02:06:03.791 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T02:06:03.791 INFO:teuthology.orchestra.run.smithi153.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T02:06:03.791 INFO:teuthology.orchestra.run.smithi153.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T02:06:03.791 INFO:teuthology.orchestra.run.smithi153.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-17T02:06:03.791 INFO:teuthology.orchestra.run.smithi153.stdout: python2.7-minimal 2024-09-17T02:06:03.792 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T02:06:03.793 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2024-09-17T02:06:03.793 INFO:teuthology.orchestra.run.smithi153.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T02:06:03.793 INFO:teuthology.orchestra.run.smithi153.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-17T02:06:03.793 INFO:teuthology.orchestra.run.smithi153.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-17T02:06:03.795 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2024-09-17T02:06:03.795 INFO:teuthology.orchestra.run.smithi153.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-17T02:06:03.795 INFO:teuthology.orchestra.run.smithi153.stdout:Recommended packages: 2024-09-17T02:06:03.795 INFO:teuthology.orchestra.run.smithi153.stdout: thermald 2024-09-17T02:06:03.836 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2024-09-17T02:06:03.836 INFO:teuthology.orchestra.run.smithi153.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T02:06:03.836 INFO:teuthology.orchestra.run.smithi153.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-17T02:06:03.836 INFO:teuthology.orchestra.run.smithi153.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-17T02:06:03.836 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages will be upgraded: 2024-09-17T02:06:03.837 INFO:teuthology.orchestra.run.smithi153.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-17T02:06:03.870 INFO:teuthology.orchestra.run.smithi001.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T02:06:03.870 INFO:teuthology.orchestra.run.smithi001.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T02:06:03.870 INFO:teuthology.orchestra.run.smithi001.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T02:06:03.871 INFO:teuthology.orchestra.run.smithi001.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T02:06:03.871 INFO:teuthology.orchestra.run.smithi001.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-17T02:06:03.871 INFO:teuthology.orchestra.run.smithi001.stdout: python2.7-minimal 2024-09-17T02:06:03.871 INFO:teuthology.orchestra.run.smithi001.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T02:06:03.872 INFO:teuthology.orchestra.run.smithi001.stdout:The following additional packages will be installed: 2024-09-17T02:06:03.872 INFO:teuthology.orchestra.run.smithi001.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T02:06:03.872 INFO:teuthology.orchestra.run.smithi001.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-17T02:06:03.873 INFO:teuthology.orchestra.run.smithi001.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-17T02:06:03.874 INFO:teuthology.orchestra.run.smithi001.stdout:Suggested packages: 2024-09-17T02:06:03.874 INFO:teuthology.orchestra.run.smithi001.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-17T02:06:03.874 INFO:teuthology.orchestra.run.smithi001.stdout:Recommended packages: 2024-09-17T02:06:03.874 INFO:teuthology.orchestra.run.smithi001.stdout: thermald 2024-09-17T02:06:03.920 INFO:teuthology.orchestra.run.smithi001.stdout:The following NEW packages will be installed: 2024-09-17T02:06:03.920 INFO:teuthology.orchestra.run.smithi001.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T02:06:03.920 INFO:teuthology.orchestra.run.smithi001.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-17T02:06:03.921 INFO:teuthology.orchestra.run.smithi001.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-17T02:06:03.922 INFO:teuthology.orchestra.run.smithi001.stdout:The following packages will be upgraded: 2024-09-17T02:06:03.922 INFO:teuthology.orchestra.run.smithi001.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-17T02:06:03.973 INFO:teuthology.orchestra.run.smithi001.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T02:06:03.973 INFO:teuthology.orchestra.run.smithi001.stdout:Need to get 113 MB of archives. 2024-09-17T02:06:03.973 INFO:teuthology.orchestra.run.smithi001.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-17T02:06:03.974 INFO:teuthology.orchestra.run.smithi001.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-17T02:06:04.017 INFO:teuthology.orchestra.run.smithi153.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T02:06:04.017 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 113 MB of archives. 2024-09-17T02:06:04.017 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-17T02:06:04.017 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-17T02:06:04.059 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-09-17T02:06:04.078 DEBUG:teuthology.orchestra.run.smithi032:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T02:06:04.135 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-09-17T02:06:04.214 INFO:teuthology.orchestra.run.smithi164.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-17T02:06:04.322 INFO:teuthology.orchestra.run.smithi164.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-17T02:06:04.352 INFO:teuthology.orchestra.run.smithi032.stdout:Building dependency tree... 2024-09-17T02:06:04.353 INFO:teuthology.orchestra.run.smithi032.stdout:Reading state information... 2024-09-17T02:06:04.400 INFO:teuthology.orchestra.run.smithi001.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-17T02:06:04.497 INFO:teuthology.orchestra.run.smithi001.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-17T02:06:04.547 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T02:06:04.547 INFO:teuthology.orchestra.run.smithi032.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T02:06:04.547 INFO:teuthology.orchestra.run.smithi032.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T02:06:04.548 INFO:teuthology.orchestra.run.smithi032.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T02:06:04.548 INFO:teuthology.orchestra.run.smithi032.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-17T02:06:04.548 INFO:teuthology.orchestra.run.smithi032.stdout: python2.7-minimal 2024-09-17T02:06:04.548 INFO:teuthology.orchestra.run.smithi032.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T02:06:04.549 INFO:teuthology.orchestra.run.smithi032.stdout:The following additional packages will be installed: 2024-09-17T02:06:04.549 INFO:teuthology.orchestra.run.smithi032.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T02:06:04.549 INFO:teuthology.orchestra.run.smithi032.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-17T02:06:04.550 INFO:teuthology.orchestra.run.smithi032.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-17T02:06:04.551 INFO:teuthology.orchestra.run.smithi032.stdout:Suggested packages: 2024-09-17T02:06:04.551 INFO:teuthology.orchestra.run.smithi032.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-17T02:06:04.551 INFO:teuthology.orchestra.run.smithi032.stdout:Recommended packages: 2024-09-17T02:06:04.551 INFO:teuthology.orchestra.run.smithi032.stdout: thermald 2024-09-17T02:06:04.588 INFO:teuthology.orchestra.run.smithi032.stdout:The following NEW packages will be installed: 2024-09-17T02:06:04.588 INFO:teuthology.orchestra.run.smithi032.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T02:06:04.588 INFO:teuthology.orchestra.run.smithi032.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-17T02:06:04.589 INFO:teuthology.orchestra.run.smithi032.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-17T02:06:04.590 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages will be upgraded: 2024-09-17T02:06:04.590 INFO:teuthology.orchestra.run.smithi032.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-17T02:06:04.642 INFO:teuthology.orchestra.run.smithi032.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T02:06:04.643 INFO:teuthology.orchestra.run.smithi032.stdout:Need to get 113 MB of archives. 2024-09-17T02:06:04.643 INFO:teuthology.orchestra.run.smithi032.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-17T02:06:04.643 INFO:teuthology.orchestra.run.smithi032.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-17T02:06:05.085 INFO:teuthology.orchestra.run.smithi032.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-17T02:06:05.122 INFO:teuthology.orchestra.run.smithi164.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-17T02:06:05.122 INFO:teuthology.orchestra.run.smithi164.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-17T02:06:05.122 INFO:teuthology.orchestra.run.smithi164.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-17T02:06:05.184 INFO:teuthology.orchestra.run.smithi032.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-17T02:06:05.241 INFO:teuthology.orchestra.run.smithi164.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-17T02:06:05.263 INFO:teuthology.orchestra.run.smithi164.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-17T02:06:05.350 INFO:teuthology.orchestra.run.smithi001.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-17T02:06:05.350 INFO:teuthology.orchestra.run.smithi001.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-17T02:06:05.350 INFO:teuthology.orchestra.run.smithi001.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-17T02:06:05.425 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-17T02:06:05.490 INFO:teuthology.orchestra.run.smithi001.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-17T02:06:05.512 INFO:teuthology.orchestra.run.smithi001.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-17T02:06:05.660 INFO:teuthology.orchestra.run.smithi164.stdout:Fetched 113 MB in 2s (74.0 MB/s) 2024-09-17T02:06:05.792 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-17T02:06:05.870 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-17T02:06:06.000 INFO:teuthology.orchestra.run.smithi001.stdout:Fetched 113 MB in 2s (68.8 MB/s) 2024-09-17T02:06:06.051 INFO:teuthology.orchestra.run.smithi032.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-17T02:06:06.051 INFO:teuthology.orchestra.run.smithi032.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-17T02:06:06.051 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-17T02:06:06.149 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-17T02:06:06.190 INFO:teuthology.orchestra.run.smithi032.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-17T02:06:06.213 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-17T02:06:06.717 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 113 MB in 2s (67.2 MB/s) 2024-09-17T02:06:06.896 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-17T02:06:07.810 INFO:teuthology.orchestra.run.smithi164.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-17T02:06:07.814 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T02:06:07.900 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:08.048 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-17T02:06:08.049 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-17T02:06:08.049 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-17T02:06:08.161 INFO:teuthology.orchestra.run.smithi001.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-17T02:06:08.166 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T02:06:08.321 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:08.393 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-17T02:06:08.477 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-17T02:06:08.884 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 113 MB in 5s (24.4 MB/s) 2024-09-17T02:06:08.905 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-17T02:06:08.910 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T02:06:09.011 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:09.057 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-17T02:06:10.026 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-17T02:06:10.047 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T02:06:10.134 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:10.414 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-17T02:06:10.436 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T02:06:10.529 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:10.595 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-17T02:06:10.616 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T02:06:10.653 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:11.038 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-17T02:06:11.042 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-17T02:06:11.045 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T02:06:11.063 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T02:06:11.100 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:11.205 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:11.230 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-17T02:06:11.251 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T02:06:11.327 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:11.808 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-17T02:06:11.829 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T02:06:11.866 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:13.723 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-17T02:06:13.744 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T02:06:13.830 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:14.301 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-17T02:06:14.321 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T02:06:14.359 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:17.678 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T02:06:17.814 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T02:06:18.111 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T02:06:18.146 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T02:06:18.260 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T02:06:18.275 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T02:06:18.562 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-17T02:06:18.584 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-17T02:06:18.609 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T02:06:18.620 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T02:06:18.722 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T02:06:18.731 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T02:06:18.857 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T02:06:19.024 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-17T02:06:19.047 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-17T02:06:19.091 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T02:06:19.173 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T02:06:19.303 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T02:06:19.623 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-17T02:06:19.645 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-17T02:06:19.681 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T02:06:20.534 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T02:06:20.661 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T02:06:20.970 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T02:06:21.091 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T02:06:21.411 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-17T02:06:21.433 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-17T02:06:21.477 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T02:06:24.508 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-17T02:06:24.545 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T02:06:24.583 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:25.081 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-17T02:06:25.118 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T02:06:25.156 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:25.710 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-17T02:06:25.748 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T02:06:25.785 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:27.077 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-17T02:06:27.114 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T02:06:27.143 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:27.229 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T02:06:27.335 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T02:06:27.668 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T02:06:27.798 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:27.920 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T02:06:27.924 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-17T02:06:28.061 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:28.066 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T02:06:28.409 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T02:06:28.513 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T02:06:28.538 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:28.638 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T02:06:28.664 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-17T02:06:28.818 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:28.971 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T02:06:29.117 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:29.243 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-17T02:06:29.364 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:29.392 INFO:teuthology.orchestra.run.smithi164.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-17T02:06:29.392 INFO:teuthology.orchestra.run.smithi164.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-17T02:06:29.392 INFO:teuthology.orchestra.run.smithi164.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-17T02:06:29.392 INFO:teuthology.orchestra.run.smithi164.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-17T02:06:29.565 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:29.798 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T02:06:29.920 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T02:06:30.167 INFO:teuthology.orchestra.run.smithi001.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-17T02:06:30.167 INFO:teuthology.orchestra.run.smithi001.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-17T02:06:30.168 INFO:teuthology.orchestra.run.smithi001.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-17T02:06:30.168 INFO:teuthology.orchestra.run.smithi001.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-17T02:06:30.245 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T02:06:30.352 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:30.822 INFO:teuthology.orchestra.run.smithi032.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-17T02:06:30.822 INFO:teuthology.orchestra.run.smithi032.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-17T02:06:30.822 INFO:teuthology.orchestra.run.smithi032.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-17T02:06:30.822 INFO:teuthology.orchestra.run.smithi032.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-17T02:06:31.241 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-17T02:06:31.258 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:31.374 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:31.375 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-17T02:06:31.384 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-17T02:06:31.502 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:31.522 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:32.321 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-17T02:06:32.464 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-17T02:06:32.589 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:32.842 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-17T02:06:32.857 INFO:teuthology.orchestra.run.smithi153.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-17T02:06:32.857 INFO:teuthology.orchestra.run.smithi153.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-17T02:06:32.857 INFO:teuthology.orchestra.run.smithi153.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-17T02:06:32.857 INFO:teuthology.orchestra.run.smithi153.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-17T02:06:32.886 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:32.952 INFO:teuthology.orchestra.run.smithi164.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-17T02:06:32.952 INFO:teuthology.orchestra.run.smithi164.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-17T02:06:32.976 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-17T02:06:32.999 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:33.119 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:34.016 INFO:teuthology.orchestra.run.smithi001.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:34.083 INFO:teuthology.orchestra.run.smithi001.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-17T02:06:34.083 INFO:teuthology.orchestra.run.smithi001.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-17T02:06:34.392 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-17T02:06:34.501 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-17T02:06:34.538 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:34.592 INFO:teuthology.orchestra.run.smithi032.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-17T02:06:34.592 INFO:teuthology.orchestra.run.smithi032.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-17T02:06:34.627 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:36.054 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T02:06:36.121 INFO:teuthology.orchestra.run.smithi153.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-17T02:06:36.121 INFO:teuthology.orchestra.run.smithi153.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-17T02:06:47.576 INFO:teuthology.orchestra.run.smithi164.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-17T02:06:47.576 INFO:teuthology.orchestra.run.smithi164.stdout:Sourcing file `/etc/default/grub' 2024-09-17T02:06:47.588 INFO:teuthology.orchestra.run.smithi164.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T02:06:47.613 INFO:teuthology.orchestra.run.smithi164.stdout:Generating grub configuration file ... 2024-09-17T02:06:47.947 INFO:teuthology.orchestra.run.smithi164.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T02:06:47.968 INFO:teuthology.orchestra.run.smithi164.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T02:06:48.331 INFO:teuthology.orchestra.run.smithi164.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T02:06:48.338 INFO:teuthology.orchestra.run.smithi164.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T02:06:48.402 INFO:teuthology.orchestra.run.smithi164.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T02:06:48.408 INFO:teuthology.orchestra.run.smithi164.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T02:06:48.421 INFO:teuthology.orchestra.run.smithi001.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-17T02:06:48.421 INFO:teuthology.orchestra.run.smithi001.stdout:Sourcing file `/etc/default/grub' 2024-09-17T02:06:48.445 INFO:teuthology.orchestra.run.smithi001.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T02:06:48.485 INFO:teuthology.orchestra.run.smithi001.stdout:Generating grub configuration file ... 2024-09-17T02:06:48.556 INFO:teuthology.orchestra.run.smithi164.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T02:06:48.556 INFO:teuthology.orchestra.run.smithi164.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T02:06:48.556 INFO:teuthology.orchestra.run.smithi164.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T02:06:48.608 INFO:teuthology.orchestra.run.smithi164.stdout:done 2024-09-17T02:06:48.777 INFO:teuthology.orchestra.run.smithi001.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T02:06:48.798 INFO:teuthology.orchestra.run.smithi001.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T02:06:49.119 INFO:teuthology.orchestra.run.smithi001.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T02:06:49.125 INFO:teuthology.orchestra.run.smithi001.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T02:06:49.131 DEBUG:teuthology.orchestra.run.smithi164:> dpkg -s linux-image-generic 2024-09-17T02:06:49.157 INFO:teuthology.orchestra.run.smithi164.stdout:Package: linux-image-generic 2024-09-17T02:06:49.158 INFO:teuthology.orchestra.run.smithi164.stdout:Status: install ok installed 2024-09-17T02:06:49.158 INFO:teuthology.orchestra.run.smithi164.stdout:Priority: optional 2024-09-17T02:06:49.158 INFO:teuthology.orchestra.run.smithi164.stdout:Section: kernel 2024-09-17T02:06:49.158 INFO:teuthology.orchestra.run.smithi164.stdout:Installed-Size: 21 2024-09-17T02:06:49.158 INFO:teuthology.orchestra.run.smithi164.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T02:06:49.158 INFO:teuthology.orchestra.run.smithi164.stdout:Architecture: amd64 2024-09-17T02:06:49.158 INFO:teuthology.orchestra.run.smithi164.stdout:Source: linux-meta 2024-09-17T02:06:49.158 INFO:teuthology.orchestra.run.smithi164.stdout:Version: 5.15.0.122.122 2024-09-17T02:06:49.158 INFO:teuthology.orchestra.run.smithi164.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T02:06:49.158 INFO:teuthology.orchestra.run.smithi164.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T02:06:49.158 INFO:teuthology.orchestra.run.smithi164.stdout:Recommends: thermald 2024-09-17T02:06:49.159 INFO:teuthology.orchestra.run.smithi164.stdout:Description: Generic Linux kernel image 2024-09-17T02:06:49.159 INFO:teuthology.orchestra.run.smithi164.stdout: This package will always depend on the latest generic kernel image 2024-09-17T02:06:49.159 INFO:teuthology.orchestra.run.smithi164.stdout: available. 2024-09-17T02:06:49.159 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-17T02:06:49.159 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T02:06:49.159 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T02:06:49.159 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-09-17T02:06:49.159 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi164.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T02:06:49.159 DEBUG:teuthology.orchestra.run.smithi164:> sudo apt-get clean 2024-09-17T02:06:49.205 INFO:teuthology.orchestra.run.smithi001.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T02:06:49.211 INFO:teuthology.orchestra.run.smithi001.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T02:06:49.274 INFO:teuthology.orchestra.run.smithi032.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-17T02:06:49.274 INFO:teuthology.orchestra.run.smithi032.stdout:Sourcing file `/etc/default/grub' 2024-09-17T02:06:49.288 INFO:teuthology.orchestra.run.smithi032.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T02:06:49.304 INFO:teuthology.orchestra.run.smithi032.stdout:Generating grub configuration file ... 2024-09-17T02:06:49.358 DEBUG:teuthology.orchestra.run.smithi164:> sudo apt-get update 2024-09-17T02:06:49.382 INFO:teuthology.orchestra.run.smithi001.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T02:06:49.382 INFO:teuthology.orchestra.run.smithi001.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T02:06:49.383 INFO:teuthology.orchestra.run.smithi001.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T02:06:49.433 INFO:teuthology.orchestra.run.smithi001.stdout:done 2024-09-17T02:06:49.602 INFO:teuthology.orchestra.run.smithi032.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T02:06:49.613 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T02:06:49.614 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T02:06:49.624 INFO:teuthology.orchestra.run.smithi032.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T02:06:49.680 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T02:06:49.746 INFO:teuthology.orchestra.run.smithi153.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-17T02:06:49.746 INFO:teuthology.orchestra.run.smithi153.stdout:Sourcing file `/etc/default/grub' 2024-09-17T02:06:49.757 INFO:teuthology.orchestra.run.smithi153.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T02:06:49.762 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T02:06:49.779 INFO:teuthology.orchestra.run.smithi153.stdout:Generating grub configuration file ... 2024-09-17T02:06:49.922 INFO:teuthology.orchestra.run.smithi032.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T02:06:49.928 INFO:teuthology.orchestra.run.smithi032.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T02:06:49.947 DEBUG:teuthology.orchestra.run.smithi001:> dpkg -s linux-image-generic 2024-09-17T02:06:50.000 INFO:teuthology.orchestra.run.smithi032.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T02:06:50.006 INFO:teuthology.orchestra.run.smithi032.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T02:06:50.019 INFO:teuthology.orchestra.run.smithi001.stdout:Package: linux-image-generic 2024-09-17T02:06:50.019 INFO:teuthology.orchestra.run.smithi001.stdout:Status: install ok installed 2024-09-17T02:06:50.019 INFO:teuthology.orchestra.run.smithi001.stdout:Priority: optional 2024-09-17T02:06:50.019 INFO:teuthology.orchestra.run.smithi001.stdout:Section: kernel 2024-09-17T02:06:50.019 INFO:teuthology.orchestra.run.smithi001.stdout:Installed-Size: 21 2024-09-17T02:06:50.019 INFO:teuthology.orchestra.run.smithi001.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T02:06:50.019 INFO:teuthology.orchestra.run.smithi001.stdout:Architecture: amd64 2024-09-17T02:06:50.019 INFO:teuthology.orchestra.run.smithi001.stdout:Source: linux-meta 2024-09-17T02:06:50.019 INFO:teuthology.orchestra.run.smithi001.stdout:Version: 5.15.0.122.122 2024-09-17T02:06:50.020 INFO:teuthology.orchestra.run.smithi001.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T02:06:50.020 INFO:teuthology.orchestra.run.smithi001.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T02:06:50.020 INFO:teuthology.orchestra.run.smithi001.stdout:Recommends: thermald 2024-09-17T02:06:50.020 INFO:teuthology.orchestra.run.smithi001.stdout:Description: Generic Linux kernel image 2024-09-17T02:06:50.020 INFO:teuthology.orchestra.run.smithi001.stdout: This package will always depend on the latest generic kernel image 2024-09-17T02:06:50.020 INFO:teuthology.orchestra.run.smithi001.stdout: available. 2024-09-17T02:06:50.020 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-17T02:06:50.020 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T02:06:50.020 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T02:06:50.020 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-17T02:06:50.021 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi001.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T02:06:50.021 DEBUG:teuthology.orchestra.run.smithi001:> sudo apt-get clean 2024-09-17T02:06:50.031 INFO:teuthology.orchestra.run.smithi153.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T02:06:50.055 INFO:teuthology.orchestra.run.smithi153.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T02:06:50.174 INFO:teuthology.orchestra.run.smithi032.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T02:06:50.175 INFO:teuthology.orchestra.run.smithi032.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T02:06:50.175 INFO:teuthology.orchestra.run.smithi032.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T02:06:50.202 DEBUG:teuthology.orchestra.run.smithi001:> sudo apt-get update 2024-09-17T02:06:50.211 INFO:teuthology.orchestra.run.smithi032.stdout:done 2024-09-17T02:06:50.327 INFO:teuthology.orchestra.run.smithi001.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T02:06:50.327 INFO:teuthology.orchestra.run.smithi001.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T02:06:50.335 INFO:teuthology.orchestra.run.smithi001.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T02:06:50.342 INFO:teuthology.orchestra.run.smithi153.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T02:06:50.348 INFO:teuthology.orchestra.run.smithi153.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T02:06:50.352 INFO:teuthology.orchestra.run.smithi001.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T02:06:50.426 INFO:teuthology.orchestra.run.smithi153.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T02:06:50.432 INFO:teuthology.orchestra.run.smithi153.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T02:06:50.575 INFO:teuthology.orchestra.run.smithi153.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T02:06:50.575 INFO:teuthology.orchestra.run.smithi153.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T02:06:50.575 INFO:teuthology.orchestra.run.smithi153.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T02:06:50.620 INFO:teuthology.orchestra.run.smithi153.stdout:done 2024-09-17T02:06:50.724 DEBUG:teuthology.orchestra.run.smithi032:> dpkg -s linux-image-generic 2024-09-17T02:06:50.755 INFO:teuthology.orchestra.run.smithi032.stdout:Package: linux-image-generic 2024-09-17T02:06:50.755 INFO:teuthology.orchestra.run.smithi032.stdout:Status: install ok installed 2024-09-17T02:06:50.755 INFO:teuthology.orchestra.run.smithi032.stdout:Priority: optional 2024-09-17T02:06:50.755 INFO:teuthology.orchestra.run.smithi032.stdout:Section: kernel 2024-09-17T02:06:50.755 INFO:teuthology.orchestra.run.smithi032.stdout:Installed-Size: 21 2024-09-17T02:06:50.755 INFO:teuthology.orchestra.run.smithi032.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T02:06:50.755 INFO:teuthology.orchestra.run.smithi032.stdout:Architecture: amd64 2024-09-17T02:06:50.755 INFO:teuthology.orchestra.run.smithi032.stdout:Source: linux-meta 2024-09-17T02:06:50.755 INFO:teuthology.orchestra.run.smithi032.stdout:Version: 5.15.0.122.122 2024-09-17T02:06:50.755 INFO:teuthology.orchestra.run.smithi032.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T02:06:50.755 INFO:teuthology.orchestra.run.smithi032.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T02:06:50.756 INFO:teuthology.orchestra.run.smithi032.stdout:Recommends: thermald 2024-09-17T02:06:50.756 INFO:teuthology.orchestra.run.smithi032.stdout:Description: Generic Linux kernel image 2024-09-17T02:06:50.756 INFO:teuthology.orchestra.run.smithi032.stdout: This package will always depend on the latest generic kernel image 2024-09-17T02:06:50.756 INFO:teuthology.orchestra.run.smithi032.stdout: available. 2024-09-17T02:06:50.756 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-17T02:06:50.756 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T02:06:50.756 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T02:06:50.756 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-09-17T02:06:50.756 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi032.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T02:06:50.757 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get clean 2024-09-17T02:06:50.930 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get update 2024-09-17T02:06:51.033 INFO:teuthology.orchestra.run.smithi164.stdout:Reading package lists... 2024-09-17T02:06:51.042 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T02:06:51.042 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T02:06:51.051 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T02:06:51.053 DEBUG:teuthology.orchestra.run.smithi164:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T02:06:51.069 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T02:06:51.106 INFO:teuthology.orchestra.run.smithi164.stdout:Reading package lists... 2024-09-17T02:06:51.121 DEBUG:teuthology.orchestra.run.smithi153:> dpkg -s linux-image-generic 2024-09-17T02:06:51.137 INFO:teuthology.orchestra.run.smithi153.stdout:Package: linux-image-generic 2024-09-17T02:06:51.138 INFO:teuthology.orchestra.run.smithi153.stdout:Status: install ok installed 2024-09-17T02:06:51.138 INFO:teuthology.orchestra.run.smithi153.stdout:Priority: optional 2024-09-17T02:06:51.138 INFO:teuthology.orchestra.run.smithi153.stdout:Section: kernel 2024-09-17T02:06:51.138 INFO:teuthology.orchestra.run.smithi153.stdout:Installed-Size: 21 2024-09-17T02:06:51.138 INFO:teuthology.orchestra.run.smithi153.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T02:06:51.138 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: amd64 2024-09-17T02:06:51.138 INFO:teuthology.orchestra.run.smithi153.stdout:Source: linux-meta 2024-09-17T02:06:51.138 INFO:teuthology.orchestra.run.smithi153.stdout:Version: 5.15.0.122.122 2024-09-17T02:06:51.138 INFO:teuthology.orchestra.run.smithi153.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T02:06:51.138 INFO:teuthology.orchestra.run.smithi153.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T02:06:51.138 INFO:teuthology.orchestra.run.smithi153.stdout:Recommends: thermald 2024-09-17T02:06:51.139 INFO:teuthology.orchestra.run.smithi153.stdout:Description: Generic Linux kernel image 2024-09-17T02:06:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: This package will always depend on the latest generic kernel image 2024-09-17T02:06:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: available. 2024-09-17T02:06:51.139 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-17T02:06:51.139 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T02:06:51.139 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T02:06:51.139 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-09-17T02:06:51.139 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi153.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T02:06:51.139 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get clean 2024-09-17T02:06:51.293 INFO:teuthology.orchestra.run.smithi164.stdout:Building dependency tree... 2024-09-17T02:06:51.293 INFO:teuthology.orchestra.run.smithi164.stdout:Reading state information... 2024-09-17T02:06:51.323 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get update 2024-09-17T02:06:51.464 INFO:teuthology.orchestra.run.smithi164.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-17T02:06:51.464 INFO:teuthology.orchestra.run.smithi164.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T02:06:51.464 INFO:teuthology.orchestra.run.smithi164.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T02:06:51.464 INFO:teuthology.orchestra.run.smithi164.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T02:06:51.465 INFO:teuthology.orchestra.run.smithi164.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T02:06:51.465 INFO:teuthology.orchestra.run.smithi164.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T02:06:51.465 INFO:teuthology.orchestra.run.smithi164.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T02:06:51.465 INFO:teuthology.orchestra.run.smithi164.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T02:06:51.506 INFO:teuthology.orchestra.run.smithi164.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T02:06:51.508 DEBUG:teuthology.orchestra.run.smithi164:> dpkg -s linux-image-generic 2024-09-17T02:06:51.561 INFO:teuthology.orchestra.run.smithi164.stdout:Package: linux-image-generic 2024-09-17T02:06:51.561 INFO:teuthology.orchestra.run.smithi164.stdout:Status: install ok installed 2024-09-17T02:06:51.561 INFO:teuthology.orchestra.run.smithi164.stdout:Priority: optional 2024-09-17T02:06:51.561 INFO:teuthology.orchestra.run.smithi164.stdout:Section: kernel 2024-09-17T02:06:51.561 INFO:teuthology.orchestra.run.smithi164.stdout:Installed-Size: 21 2024-09-17T02:06:51.561 INFO:teuthology.orchestra.run.smithi164.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T02:06:51.561 INFO:teuthology.orchestra.run.smithi164.stdout:Architecture: amd64 2024-09-17T02:06:51.561 INFO:teuthology.orchestra.run.smithi164.stdout:Source: linux-meta 2024-09-17T02:06:51.561 INFO:teuthology.orchestra.run.smithi164.stdout:Version: 5.15.0.122.122 2024-09-17T02:06:51.561 INFO:teuthology.orchestra.run.smithi164.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T02:06:51.562 INFO:teuthology.orchestra.run.smithi164.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T02:06:51.562 INFO:teuthology.orchestra.run.smithi164.stdout:Recommends: thermald 2024-09-17T02:06:51.562 INFO:teuthology.orchestra.run.smithi164.stdout:Description: Generic Linux kernel image 2024-09-17T02:06:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: This package will always depend on the latest generic kernel image 2024-09-17T02:06:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: available. 2024-09-17T02:06:51.562 DEBUG:teuthology.orchestra.run.smithi164:> mktemp 2024-09-17T02:06:51.581 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T02:06:51.581 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T02:06:51.606 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.piXkY2nvHR 2024-09-17T02:06:51.606 DEBUG:teuthology.orchestra.run.smithi164:> sudo cp /boot/grub/grub.cfg /tmp/tmp.piXkY2nvHR 2024-09-17T02:06:51.647 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T02:06:51.660 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.piXkY2nvHR 2024-09-17T02:06:51.729 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T02:06:51.775 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.piXkY2nvHR is 10KB 2024-09-17T02:06:51.788 DEBUG:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.piXkY2nvHR 2024-09-17T02:06:51.793 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-17T02:06:51.845 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T02:06:51.845 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-17T02:06:51.846 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-17T02:06:51.848 INFO:teuthology.orchestra.run.smithi001.stdout:Reading package lists... 2024-09-17T02:06:51.867 DEBUG:teuthology.orchestra.run.smithi001:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T02:06:51.917 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-17T02:06:51.917 DEBUG:teuthology.orchestra.run.smithi164:> sudo update-grub 2024-09-17T02:06:51.934 INFO:teuthology.orchestra.run.smithi001.stdout:Reading package lists... 2024-09-17T02:06:52.150 INFO:teuthology.orchestra.run.smithi001.stdout:Building dependency tree... 2024-09-17T02:06:52.150 INFO:teuthology.orchestra.run.smithi001.stdout:Reading state information... 2024-09-17T02:06:52.350 INFO:teuthology.orchestra.run.smithi001.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-17T02:06:52.350 INFO:teuthology.orchestra.run.smithi001.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T02:06:52.350 INFO:teuthology.orchestra.run.smithi001.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T02:06:52.350 INFO:teuthology.orchestra.run.smithi001.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T02:06:52.350 INFO:teuthology.orchestra.run.smithi001.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T02:06:52.351 INFO:teuthology.orchestra.run.smithi001.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T02:06:52.351 INFO:teuthology.orchestra.run.smithi001.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T02:06:52.351 INFO:teuthology.orchestra.run.smithi001.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T02:06:52.396 INFO:teuthology.orchestra.run.smithi001.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T02:06:52.398 DEBUG:teuthology.orchestra.run.smithi001:> dpkg -s linux-image-generic 2024-09-17T02:06:52.414 INFO:teuthology.orchestra.run.smithi001.stdout:Package: linux-image-generic 2024-09-17T02:06:52.414 INFO:teuthology.orchestra.run.smithi001.stdout:Status: install ok installed 2024-09-17T02:06:52.414 INFO:teuthology.orchestra.run.smithi001.stdout:Priority: optional 2024-09-17T02:06:52.414 INFO:teuthology.orchestra.run.smithi001.stdout:Section: kernel 2024-09-17T02:06:52.414 INFO:teuthology.orchestra.run.smithi001.stdout:Installed-Size: 21 2024-09-17T02:06:52.414 INFO:teuthology.orchestra.run.smithi001.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T02:06:52.414 INFO:teuthology.orchestra.run.smithi001.stdout:Architecture: amd64 2024-09-17T02:06:52.414 INFO:teuthology.orchestra.run.smithi001.stdout:Source: linux-meta 2024-09-17T02:06:52.415 INFO:teuthology.orchestra.run.smithi001.stdout:Version: 5.15.0.122.122 2024-09-17T02:06:52.415 INFO:teuthology.orchestra.run.smithi001.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T02:06:52.415 INFO:teuthology.orchestra.run.smithi001.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T02:06:52.415 INFO:teuthology.orchestra.run.smithi001.stdout:Recommends: thermald 2024-09-17T02:06:52.415 INFO:teuthology.orchestra.run.smithi001.stdout:Description: Generic Linux kernel image 2024-09-17T02:06:52.415 INFO:teuthology.orchestra.run.smithi001.stdout: This package will always depend on the latest generic kernel image 2024-09-17T02:06:52.415 INFO:teuthology.orchestra.run.smithi001.stdout: available. 2024-09-17T02:06:52.416 DEBUG:teuthology.orchestra.run.smithi001:> mktemp 2024-09-17T02:06:52.464 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/tmp.pIDAbtqvTl 2024-09-17T02:06:52.465 DEBUG:teuthology.orchestra.run.smithi001:> sudo cp /boot/grub/grub.cfg /tmp/tmp.pIDAbtqvTl 2024-09-17T02:06:52.501 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-09-17T02:06:52.519 DEBUG:teuthology.orchestra.run.smithi032:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T02:06:52.520 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0666 /tmp/tmp.pIDAbtqvTl 2024-09-17T02:06:52.576 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-09-17T02:06:52.632 DEBUG:teuthology.orchestra.remote:smithi001:/tmp/tmp.pIDAbtqvTl is 10KB 2024-09-17T02:06:52.645 DEBUG:teuthology.orchestra.run.smithi001:> rm -fr /tmp/tmp.pIDAbtqvTl 2024-09-17T02:06:52.650 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-17T02:06:52.704 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-17T02:06:52.705 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-17T02:06:52.705 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-17T02:06:52.767 INFO:teuthology.orchestra.run.smithi032.stdout:Building dependency tree... 2024-09-17T02:06:52.768 INFO:teuthology.orchestra.run.smithi032.stdout:Reading state information... 2024-09-17T02:06:52.775 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-17T02:06:52.775 DEBUG:teuthology.orchestra.run.smithi001:> sudo update-grub 2024-09-17T02:06:52.946 INFO:teuthology.orchestra.run.smithi032.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-17T02:06:52.946 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T02:06:52.946 INFO:teuthology.orchestra.run.smithi032.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T02:06:52.946 INFO:teuthology.orchestra.run.smithi032.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T02:06:52.946 INFO:teuthology.orchestra.run.smithi032.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T02:06:52.947 INFO:teuthology.orchestra.run.smithi032.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T02:06:52.947 INFO:teuthology.orchestra.run.smithi032.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T02:06:52.947 INFO:teuthology.orchestra.run.smithi032.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T02:06:52.987 INFO:teuthology.orchestra.run.smithi032.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T02:06:52.989 DEBUG:teuthology.orchestra.run.smithi032:> dpkg -s linux-image-generic 2024-09-17T02:06:53.001 INFO:teuthology.orchestra.run.smithi032.stdout:Package: linux-image-generic 2024-09-17T02:06:53.001 INFO:teuthology.orchestra.run.smithi032.stdout:Status: install ok installed 2024-09-17T02:06:53.002 INFO:teuthology.orchestra.run.smithi032.stdout:Priority: optional 2024-09-17T02:06:53.002 INFO:teuthology.orchestra.run.smithi032.stdout:Section: kernel 2024-09-17T02:06:53.002 INFO:teuthology.orchestra.run.smithi032.stdout:Installed-Size: 21 2024-09-17T02:06:53.002 INFO:teuthology.orchestra.run.smithi032.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T02:06:53.002 INFO:teuthology.orchestra.run.smithi032.stdout:Architecture: amd64 2024-09-17T02:06:53.002 INFO:teuthology.orchestra.run.smithi032.stdout:Source: linux-meta 2024-09-17T02:06:53.002 INFO:teuthology.orchestra.run.smithi032.stdout:Version: 5.15.0.122.122 2024-09-17T02:06:53.002 INFO:teuthology.orchestra.run.smithi032.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T02:06:53.002 INFO:teuthology.orchestra.run.smithi032.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T02:06:53.002 INFO:teuthology.orchestra.run.smithi032.stdout:Recommends: thermald 2024-09-17T02:06:53.002 INFO:teuthology.orchestra.run.smithi032.stdout:Description: Generic Linux kernel image 2024-09-17T02:06:53.002 INFO:teuthology.orchestra.run.smithi032.stdout: This package will always depend on the latest generic kernel image 2024-09-17T02:06:53.002 INFO:teuthology.orchestra.run.smithi032.stdout: available. 2024-09-17T02:06:53.003 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2024-09-17T02:06:53.047 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.uoVvZAuK13 2024-09-17T02:06:53.047 DEBUG:teuthology.orchestra.run.smithi032:> sudo cp /boot/grub/grub.cfg /tmp/tmp.uoVvZAuK13 2024-09-17T02:06:53.054 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-17T02:06:53.073 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T02:06:53.103 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0666 /tmp/tmp.uoVvZAuK13 2024-09-17T02:06:53.125 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-17T02:06:53.159 INFO:teuthology.orchestra.run.smithi164.stderr:Sourcing file `/etc/default/grub' 2024-09-17T02:06:53.161 INFO:teuthology.orchestra.run.smithi164.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T02:06:53.163 INFO:teuthology.orchestra.run.smithi164.stderr:Generating grub configuration file ... 2024-09-17T02:06:53.221 DEBUG:teuthology.orchestra.remote:smithi032:/tmp/tmp.uoVvZAuK13 is 10KB 2024-09-17T02:06:53.234 DEBUG:teuthology.orchestra.run.smithi032:> rm -fr /tmp/tmp.uoVvZAuK13 2024-09-17T02:06:53.239 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-17T02:06:53.291 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-17T02:06:53.291 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-17T02:06:53.291 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-17T02:06:53.314 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-09-17T02:06:53.314 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-09-17T02:06:53.362 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-17T02:06:53.362 DEBUG:teuthology.orchestra.run.smithi032:> sudo update-grub 2024-09-17T02:06:53.391 INFO:teuthology.orchestra.run.smithi164.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T02:06:53.397 INFO:teuthology.orchestra.run.smithi164.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T02:06:53.482 INFO:teuthology.orchestra.run.smithi153.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-17T02:06:53.482 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T02:06:53.482 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T02:06:53.482 INFO:teuthology.orchestra.run.smithi153.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T02:06:53.482 INFO:teuthology.orchestra.run.smithi153.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T02:06:53.482 INFO:teuthology.orchestra.run.smithi153.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T02:06:53.483 INFO:teuthology.orchestra.run.smithi153.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T02:06:53.483 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T02:06:53.524 INFO:teuthology.orchestra.run.smithi153.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T02:06:53.526 DEBUG:teuthology.orchestra.run.smithi153:> dpkg -s linux-image-generic 2024-09-17T02:06:53.585 INFO:teuthology.orchestra.run.smithi153.stdout:Package: linux-image-generic 2024-09-17T02:06:53.585 INFO:teuthology.orchestra.run.smithi153.stdout:Status: install ok installed 2024-09-17T02:06:53.585 INFO:teuthology.orchestra.run.smithi153.stdout:Priority: optional 2024-09-17T02:06:53.585 INFO:teuthology.orchestra.run.smithi153.stdout:Section: kernel 2024-09-17T02:06:53.585 INFO:teuthology.orchestra.run.smithi153.stdout:Installed-Size: 21 2024-09-17T02:06:53.585 INFO:teuthology.orchestra.run.smithi153.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T02:06:53.585 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: amd64 2024-09-17T02:06:53.585 INFO:teuthology.orchestra.run.smithi153.stdout:Source: linux-meta 2024-09-17T02:06:53.585 INFO:teuthology.orchestra.run.smithi153.stdout:Version: 5.15.0.122.122 2024-09-17T02:06:53.586 INFO:teuthology.orchestra.run.smithi153.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T02:06:53.586 INFO:teuthology.orchestra.run.smithi153.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T02:06:53.586 INFO:teuthology.orchestra.run.smithi153.stdout:Recommends: thermald 2024-09-17T02:06:53.586 INFO:teuthology.orchestra.run.smithi153.stdout:Description: Generic Linux kernel image 2024-09-17T02:06:53.586 INFO:teuthology.orchestra.run.smithi153.stdout: This package will always depend on the latest generic kernel image 2024-09-17T02:06:53.586 INFO:teuthology.orchestra.run.smithi153.stdout: available. 2024-09-17T02:06:53.586 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-09-17T02:06:53.630 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.kgKBMFcegG 2024-09-17T02:06:53.630 DEBUG:teuthology.orchestra.run.smithi153:> sudo cp /boot/grub/grub.cfg /tmp/tmp.kgKBMFcegG 2024-09-17T02:06:53.673 INFO:teuthology.orchestra.run.smithi164.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T02:06:53.678 INFO:teuthology.orchestra.run.smithi164.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T02:06:53.687 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.kgKBMFcegG 2024-09-17T02:06:53.720 INFO:teuthology.orchestra.run.smithi164.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T02:06:53.725 INFO:teuthology.orchestra.run.smithi164.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T02:06:53.815 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.kgKBMFcegG is 10KB 2024-09-17T02:06:53.849 INFO:teuthology.orchestra.run.smithi164.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T02:06:53.849 INFO:teuthology.orchestra.run.smithi164.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T02:06:53.849 INFO:teuthology.orchestra.run.smithi164.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T02:06:53.867 INFO:teuthology.orchestra.run.smithi164.stderr:done 2024-09-17T02:06:53.868 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.kgKBMFcegG 2024-09-17T02:06:53.874 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-17T02:06:53.875 DEBUG:teuthology.orchestra.run.smithi164:> sudo shutdown -r now 2024-09-17T02:06:53.926 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T02:06:53.926 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-17T02:06:53.926 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-17T02:06:53.994 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-17T02:06:53.995 DEBUG:teuthology.orchestra.run.smithi153:> sudo update-grub 2024-09-17T02:06:54.026 INFO:teuthology.orchestra.run.smithi001.stderr:Sourcing file `/etc/default/grub' 2024-09-17T02:06:54.028 INFO:teuthology.orchestra.run.smithi001.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T02:06:54.030 INFO:teuthology.orchestra.run.smithi001.stderr:Generating grub configuration file ... 2024-09-17T02:06:54.181 INFO:teuthology.orchestra.run.smithi001.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T02:06:54.187 INFO:teuthology.orchestra.run.smithi001.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T02:06:54.419 INFO:teuthology.orchestra.run.smithi001.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T02:06:54.424 INFO:teuthology.orchestra.run.smithi001.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T02:06:54.466 INFO:teuthology.orchestra.run.smithi001.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T02:06:54.472 INFO:teuthology.orchestra.run.smithi001.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T02:06:54.623 INFO:teuthology.orchestra.run.smithi001.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T02:06:54.623 INFO:teuthology.orchestra.run.smithi001.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T02:06:54.623 INFO:teuthology.orchestra.run.smithi001.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T02:06:54.633 INFO:teuthology.orchestra.run.smithi001.stderr:done 2024-09-17T02:06:54.646 DEBUG:teuthology.orchestra.run.smithi001:> sudo shutdown -r now 2024-09-17T02:06:54.653 INFO:teuthology.orchestra.run.smithi032.stderr:Sourcing file `/etc/default/grub' 2024-09-17T02:06:54.654 INFO:teuthology.orchestra.run.smithi032.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T02:06:54.656 INFO:teuthology.orchestra.run.smithi032.stderr:Generating grub configuration file ... 2024-09-17T02:06:54.845 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T02:06:54.851 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T02:06:55.073 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T02:06:55.078 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T02:06:55.117 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T02:06:55.122 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T02:06:55.226 INFO:teuthology.orchestra.run.smithi153.stderr:Sourcing file `/etc/default/grub' 2024-09-17T02:06:55.228 INFO:teuthology.orchestra.run.smithi153.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T02:06:55.230 INFO:teuthology.orchestra.run.smithi032.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T02:06:55.230 INFO:teuthology.orchestra.run.smithi032.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T02:06:55.230 INFO:teuthology.orchestra.run.smithi032.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T02:06:55.230 INFO:teuthology.orchestra.run.smithi153.stderr:Generating grub configuration file ... 2024-09-17T02:06:55.246 INFO:teuthology.orchestra.run.smithi032.stderr:done 2024-09-17T02:06:55.255 DEBUG:teuthology.orchestra.run.smithi032:> sudo shutdown -r now 2024-09-17T02:06:55.407 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T02:06:55.413 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T02:06:55.650 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T02:06:55.655 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T02:06:55.696 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T02:06:55.702 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T02:06:55.823 INFO:teuthology.orchestra.run.smithi153.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T02:06:55.823 INFO:teuthology.orchestra.run.smithi153.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T02:06:55.823 INFO:teuthology.orchestra.run.smithi153.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T02:06:55.834 INFO:teuthology.orchestra.run.smithi153.stderr:done 2024-09-17T02:06:55.838 DEBUG:teuthology.orchestra.run.smithi153:> sudo shutdown -r now 2024-09-17T02:07:23.905 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-09-17T02:07:23.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-17T02:07:23.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:07:24.649 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-17T02:07:24.649 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-17T02:07:24.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:07:25.259 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-09-17T02:07:25.259 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-17T02:07:25.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:07:25.841 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-09-17T02:07:25.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-17T02:07:25.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:07:42.401 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-09-17T02:07:43.165 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.1 2024-09-17T02:07:43.681 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-09-17T02:07:44.189 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-09-17T02:07:51.409 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-17T02:07:51.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:07:52.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-17T02:07:52.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:07:52.682 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-17T02:07:52.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:07:53.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-17T02:07:53.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:07:54.461 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-09-17T02:07:56.253 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-09-17T02:08:06.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-17T02:08:06.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:08:08.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-17T02:08:08.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:08:09.533 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-09-17T02:08:11.069 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-09-17T02:08:23.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-17T02:08:23.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:08:24.535 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-17T02:08:24.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:08:25.117 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-09-17T02:08:40.129 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-17T02:08:40.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:08:40.327 DEBUG:teuthology.orchestra.run.smithi032:> true 2024-09-17T02:08:41.021 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-17T02:08:41.022 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "5.15.0-122-generic"... 2024-09-17T02:08:41.022 DEBUG:teuthology.orchestra.run.smithi032:> uname -r 2024-09-17T02:08:41.067 INFO:teuthology.orchestra.run.smithi032.stdout:5.15.0-122-generic 2024-09-17T02:08:41.067 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-17T02:08:41.067 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T02:08:41.067 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-17T02:08:42.068 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-09-17T02:08:42.068 DEBUG:teuthology.orchestra.run.smithi032:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T02:08:42.144 INFO:teuthology.orchestra.run.smithi032.stdout:ttyS1 2024-09-17T02:08:42.176 DEBUG:teuthology.parallel:result is None 2024-09-17T02:08:52.169 DEBUG:teuthology.orchestra.remote:timed out 2024-09-17T02:08:56.524 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-09-17T02:08:57.160 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-17T02:08:57.160 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.15.0-122-generic"... 2024-09-17T02:08:57.160 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-09-17T02:08:57.209 INFO:teuthology.orchestra.run.smithi164.stdout:5.15.0-122-generic 2024-09-17T02:08:57.209 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-17T02:08:57.209 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T02:08:57.209 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-17T02:08:58.212 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-09-17T02:08:58.212 DEBUG:teuthology.orchestra.run.smithi164:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T02:08:58.607 INFO:teuthology.orchestra.run.smithi164.stdout:ttyS1 2024-09-17T02:08:58.631 DEBUG:teuthology.parallel:result is None 2024-09-17T02:09:04.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-17T02:09:04.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:09:04.406 DEBUG:teuthology.orchestra.run.smithi001:> true 2024-09-17T02:09:05.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-17T02:09:05.014 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-122-generic"... 2024-09-17T02:09:05.015 DEBUG:teuthology.orchestra.run.smithi001:> uname -r 2024-09-17T02:09:05.063 INFO:teuthology.orchestra.run.smithi001.stdout:5.15.0-122-generic 2024-09-17T02:09:05.064 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-17T02:09:05.064 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T02:09:05.064 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-17T02:09:06.065 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-17T02:09:06.065 DEBUG:teuthology.orchestra.run.smithi001:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T02:09:06.139 INFO:teuthology.orchestra.run.smithi001.stdout:ttyS1 2024-09-17T02:09:06.164 DEBUG:teuthology.parallel:result is None 2024-09-17T02:09:08.258 DEBUG:teuthology.orchestra.remote:timed out 2024-09-17T02:09:23.260 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-17T02:09:23.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:09:23.576 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-09-17T02:09:24.127 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-17T02:09:24.127 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "5.15.0-122-generic"... 2024-09-17T02:09:24.127 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-09-17T02:09:24.173 INFO:teuthology.orchestra.run.smithi153.stdout:5.15.0-122-generic 2024-09-17T02:09:24.174 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-17T02:09:24.174 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T02:09:24.174 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-17T02:09:25.175 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-09-17T02:09:25.175 DEBUG:teuthology.orchestra.run.smithi153:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T02:09:25.234 INFO:teuthology.orchestra.run.smithi153.stdout:ttyS1 2024-09-17T02:09:25.263 DEBUG:teuthology.parallel:result is None 2024-09-17T02:09:25.264 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T02:09:25.270 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T02:09:25.270 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T02:09:25.273 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T02:09:25.276 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T02:09:25.279 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T02:09:25.285 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T02:09:25.291 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T02:09:25.303 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T02:09:25.303 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T02:09:25.319 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T02:09:25.327 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T02:09:25.329 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T02:09:25.439 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T02:09:25.445 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T02:09:25.445 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T02:09:25.448 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T02:09:25.450 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T02:09:25.452 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T02:09:25.464 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T02:09:25.473 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T02:09:25.473 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T02:09:25.475 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T02:09:25.481 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T02:09:25.482 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T02:09:25.500 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T02:09:25.511 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T02:09:25.512 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T02:09:25.519 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T02:09:25.519 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T02:09:25.521 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T02:09:25.524 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T02:09:25.526 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T02:09:25.560 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T02:09:25.569 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T02:09:25.570 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T02:09:25.575 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T02:09:25.578 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T02:09:25.583 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T02:09:25.609 DEBUG:teuthology.orchestra.run.smithi001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T02:09:25.630 DEBUG:teuthology.orchestra.run.smithi001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T02:09:25.679 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-17T02:09:25.679 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T02:09:25.738 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T02:09:25.744 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T02:09:25.790 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-17T02:09:25.791 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T02:09:25.862 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T02:09:25.868 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T02:09:25.914 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T02:09:25.914 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T02:09:25.981 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T02:09:25.987 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T02:09:26.033 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T02:09:26.033 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T02:09:26.108 DEBUG:teuthology.orchestra.run.smithi001:> sudo service rsyslog restart 2024-09-17T02:09:26.111 DEBUG:teuthology.orchestra.run.smithi032:> sudo service rsyslog restart 2024-09-17T02:09:26.113 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2024-09-17T02:09:26.115 DEBUG:teuthology.orchestra.run.smithi164:> sudo service rsyslog restart 2024-09-17T02:09:26.188 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T02:09:26.195 INFO:teuthology.task.internal:Starting timer... 2024-09-17T02:09:26.195 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T02:09:26.205 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T02:09:26.213 DEBUG:teuthology.task.selinux:Excluding smithi001: OS 'ubuntu' does not support SELinux 2024-09-17T02:09:26.213 DEBUG:teuthology.task.selinux:Excluding smithi032: OS 'ubuntu' does not support SELinux 2024-09-17T02:09:26.214 DEBUG:teuthology.task.selinux:Excluding smithi153: OS 'ubuntu' does not support SELinux 2024-09-17T02:09:26.214 DEBUG:teuthology.task.selinux:Excluding smithi164: OS 'ubuntu' does not support SELinux 2024-09-17T02:09:26.214 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T02:09:26.214 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-17T02:09:26.214 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T02:09:26.214 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T02:09:26.222 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T02:09:26.234 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T02:09:26.235 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi001.front.sepia.ceph.com,smithi032.front.sepia.ceph.com,smithi153.front.sepia.ceph.com,smithi164.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T02:17:08.915 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi001.front.sepia.ceph.com'), Remote(name='ubuntu@smithi032.front.sepia.ceph.com'), Remote(name='ubuntu@smithi153.front.sepia.ceph.com'), Remote(name='ubuntu@smithi164.front.sepia.ceph.com')] 2024-09-17T02:17:08.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-17T02:17:08.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:17:09.005 DEBUG:teuthology.orchestra.run.smithi001:> true 2024-09-17T02:17:09.089 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-17T02:17:09.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-17T02:17:09.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:17:09.170 DEBUG:teuthology.orchestra.run.smithi032:> true 2024-09-17T02:17:09.245 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-17T02:17:09.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-17T02:17:09.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:17:09.325 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-09-17T02:17:09.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-17T02:17:09.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-17T02:17:09.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:17:09.480 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-09-17T02:17:09.557 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-17T02:17:09.558 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T02:17:09.568 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T02:17:09.568 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T02:17:09.568 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T02:17:09.571 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T02:17:09.571 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T02:17:09.573 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T02:17:09.573 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T02:17:09.576 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T02:17:09.576 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T02:17:09.597 INFO:teuthology.orchestra.run.smithi001.stdout:17 Sep 02:17:09 ntpd[18371]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-17T02:17:09.597 INFO:teuthology.orchestra.run.smithi001.stdout:17 Sep 02:17:09 ntpd[18371]: Command line: ntpd -gq 2024-09-17T02:17:09.597 INFO:teuthology.orchestra.run.smithi001.stdout:17 Sep 02:17:09 ntpd[18371]: ---------------------------------------------------- 2024-09-17T02:17:09.597 INFO:teuthology.orchestra.run.smithi001.stdout:17 Sep 02:17:09 ntpd[18371]: ntp-4 is maintained by Network Time Foundation, 2024-09-17T02:17:09.597 INFO:teuthology.orchestra.run.smithi001.stdout:17 Sep 02:17:09 ntpd[18371]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-17T02:17:09.597 INFO:teuthology.orchestra.run.smithi001.stdout:17 Sep 02:17:09 ntpd[18371]: corporation. Support and training for ntp-4 are 2024-09-17T02:17:09.597 INFO:teuthology.orchestra.run.smithi001.stdout:17 Sep 02:17:09 ntpd[18371]: available at https://www.nwtime.org/support 2024-09-17T02:17:09.597 INFO:teuthology.orchestra.run.smithi001.stdout:17 Sep 02:17:09 ntpd[18371]: ---------------------------------------------------- 2024-09-17T02:17:09.598 INFO:teuthology.orchestra.run.smithi001.stdout:17 Sep 02:17:09 ntpd[18371]: proto: precision = 0.067 usec (-24) 2024-09-17T02:17:09.598 INFO:teuthology.orchestra.run.smithi001.stdout:17 Sep 02:17:09 ntpd[18371]: basedate set to 2022-02-04 2024-09-17T02:17:09.598 INFO:teuthology.orchestra.run.smithi001.stdout:17 Sep 02:17:09 ntpd[18371]: gps base set to 2022-02-06 (week 2196) 2024-09-17T02:17:09.598 INFO:teuthology.orchestra.run.smithi001.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T02:17:09.599 INFO:teuthology.orchestra.run.smithi001.stdout:17 Sep 02:17:09 ntpd[18371]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T02:17:09.599 INFO:teuthology.orchestra.run.smithi001.stdout:17 Sep 02:17:09 ntpd[18371]: restrict ::: KOD does nothing without LIMITED. 2024-09-17T02:17:09.600 INFO:teuthology.orchestra.run.smithi001.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-17T02:17:09.600 INFO:teuthology.orchestra.run.smithi001.stdout:17 Sep 02:17:09 ntpd[18371]: Listen and drop on 0 v6wildcard [::]:123 2024-09-17T02:17:09.600 INFO:teuthology.orchestra.run.smithi001.stdout:17 Sep 02:17:09 ntpd[18371]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-17T02:17:09.601 INFO:teuthology.orchestra.run.smithi001.stdout:17 Sep 02:17:09 ntpd[18371]: Listen normally on 2 lo 127.0.0.1:123 2024-09-17T02:17:09.601 INFO:teuthology.orchestra.run.smithi001.stdout:17 Sep 02:17:09 ntpd[18371]: Listen normally on 3 ens1f0 172.21.15.1:123 2024-09-17T02:17:09.601 INFO:teuthology.orchestra.run.smithi001.stdout:17 Sep 02:17:09 ntpd[18371]: Listen normally on 4 lo [::1]:123 2024-09-17T02:17:09.601 INFO:teuthology.orchestra.run.smithi001.stdout:17 Sep 02:17:09 ntpd[18371]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:15e8%4]:123 2024-09-17T02:17:09.601 INFO:teuthology.orchestra.run.smithi001.stdout:17 Sep 02:17:09 ntpd[18371]: Listening on routing socket on fd #22 for interface updates 2024-09-17T02:17:09.603 INFO:teuthology.orchestra.run.smithi032.stdout:17 Sep 02:17:09 ntpd[18387]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-17T02:17:09.603 INFO:teuthology.orchestra.run.smithi032.stdout:17 Sep 02:17:09 ntpd[18387]: Command line: ntpd -gq 2024-09-17T02:17:09.603 INFO:teuthology.orchestra.run.smithi032.stdout:17 Sep 02:17:09 ntpd[18387]: ---------------------------------------------------- 2024-09-17T02:17:09.603 INFO:teuthology.orchestra.run.smithi032.stdout:17 Sep 02:17:09 ntpd[18387]: ntp-4 is maintained by Network Time Foundation, 2024-09-17T02:17:09.603 INFO:teuthology.orchestra.run.smithi032.stdout:17 Sep 02:17:09 ntpd[18387]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-17T02:17:09.603 INFO:teuthology.orchestra.run.smithi032.stdout:17 Sep 02:17:09 ntpd[18387]: corporation. Support and training for ntp-4 are 2024-09-17T02:17:09.603 INFO:teuthology.orchestra.run.smithi032.stdout:17 Sep 02:17:09 ntpd[18387]: available at https://www.nwtime.org/support 2024-09-17T02:17:09.603 INFO:teuthology.orchestra.run.smithi032.stdout:17 Sep 02:17:09 ntpd[18387]: ---------------------------------------------------- 2024-09-17T02:17:09.605 INFO:teuthology.orchestra.run.smithi032.stdout:17 Sep 02:17:09 ntpd[18387]: proto: precision = 0.061 usec (-24) 2024-09-17T02:17:09.605 INFO:teuthology.orchestra.run.smithi032.stdout:17 Sep 02:17:09 ntpd[18387]: basedate set to 2022-02-04 2024-09-17T02:17:09.605 INFO:teuthology.orchestra.run.smithi032.stdout:17 Sep 02:17:09 ntpd[18387]: gps base set to 2022-02-06 (week 2196) 2024-09-17T02:17:09.605 INFO:teuthology.orchestra.run.smithi032.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T02:17:09.605 INFO:teuthology.orchestra.run.smithi153.stdout:17 Sep 02:17:09 ntpd[18460]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-17T02:17:09.606 INFO:teuthology.orchestra.run.smithi153.stdout:17 Sep 02:17:09 ntpd[18460]: Command line: ntpd -gq 2024-09-17T02:17:09.606 INFO:teuthology.orchestra.run.smithi153.stdout:17 Sep 02:17:09 ntpd[18460]: ---------------------------------------------------- 2024-09-17T02:17:09.606 INFO:teuthology.orchestra.run.smithi153.stdout:17 Sep 02:17:09 ntpd[18460]: ntp-4 is maintained by Network Time Foundation, 2024-09-17T02:17:09.606 INFO:teuthology.orchestra.run.smithi153.stdout:17 Sep 02:17:09 ntpd[18460]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-17T02:17:09.606 INFO:teuthology.orchestra.run.smithi153.stdout:17 Sep 02:17:09 ntpd[18460]: corporation. Support and training for ntp-4 are 2024-09-17T02:17:09.606 INFO:teuthology.orchestra.run.smithi153.stdout:17 Sep 02:17:09 ntpd[18460]: available at https://www.nwtime.org/support 2024-09-17T02:17:09.606 INFO:teuthology.orchestra.run.smithi153.stdout:17 Sep 02:17:09 ntpd[18460]: ---------------------------------------------------- 2024-09-17T02:17:09.606 INFO:teuthology.orchestra.run.smithi153.stdout:17 Sep 02:17:09 ntpd[18460]: proto: precision = 0.045 usec (-24) 2024-09-17T02:17:09.606 INFO:teuthology.orchestra.run.smithi153.stdout:17 Sep 02:17:09 ntpd[18460]: basedate set to 2022-02-04 2024-09-17T02:17:09.606 INFO:teuthology.orchestra.run.smithi153.stdout:17 Sep 02:17:09 ntpd[18460]: gps base set to 2022-02-06 (week 2196) 2024-09-17T02:17:09.606 INFO:teuthology.orchestra.run.smithi153.stdout:17 Sep 02:17:09 ntpd[18460]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T02:17:09.607 INFO:teuthology.orchestra.run.smithi153.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T02:17:09.607 INFO:teuthology.orchestra.run.smithi153.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-17T02:17:09.607 INFO:teuthology.orchestra.run.smithi032.stdout:17 Sep 02:17:09 ntpd[18387]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T02:17:09.607 INFO:teuthology.orchestra.run.smithi032.stdout:17 Sep 02:17:09 ntpd[18387]: restrict ::: KOD does nothing without LIMITED. 2024-09-17T02:17:09.607 INFO:teuthology.orchestra.run.smithi032.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-17T02:17:09.609 INFO:teuthology.orchestra.run.smithi153.stdout:17 Sep 02:17:09 ntpd[18460]: restrict ::: KOD does nothing without LIMITED. 2024-09-17T02:17:09.609 INFO:teuthology.orchestra.run.smithi153.stdout:17 Sep 02:17:09 ntpd[18460]: Listen and drop on 0 v6wildcard [::]:123 2024-09-17T02:17:09.609 INFO:teuthology.orchestra.run.smithi153.stdout:17 Sep 02:17:09 ntpd[18460]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-17T02:17:09.609 INFO:teuthology.orchestra.run.smithi153.stdout:17 Sep 02:17:09 ntpd[18460]: Listen normally on 2 lo 127.0.0.1:123 2024-09-17T02:17:09.609 INFO:teuthology.orchestra.run.smithi153.stdout:17 Sep 02:17:09 ntpd[18460]: Listen normally on 3 enp3s0f1 172.21.15.153:123 2024-09-17T02:17:09.609 INFO:teuthology.orchestra.run.smithi153.stdout:17 Sep 02:17:09 ntpd[18460]: Listen normally on 4 lo [::1]:123 2024-09-17T02:17:09.609 INFO:teuthology.orchestra.run.smithi153.stdout:17 Sep 02:17:09 ntpd[18460]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6deb%5]:123 2024-09-17T02:17:09.609 INFO:teuthology.orchestra.run.smithi153.stdout:17 Sep 02:17:09 ntpd[18460]: Listening on routing socket on fd #22 for interface updates 2024-09-17T02:17:09.610 INFO:teuthology.orchestra.run.smithi032.stdout:17 Sep 02:17:09 ntpd[18387]: Listen and drop on 0 v6wildcard [::]:123 2024-09-17T02:17:09.610 INFO:teuthology.orchestra.run.smithi032.stdout:17 Sep 02:17:09 ntpd[18387]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-17T02:17:09.610 INFO:teuthology.orchestra.run.smithi032.stdout:17 Sep 02:17:09 ntpd[18387]: Listen normally on 2 lo 127.0.0.1:123 2024-09-17T02:17:09.610 INFO:teuthology.orchestra.run.smithi032.stdout:17 Sep 02:17:09 ntpd[18387]: Listen normally on 3 ens1f0 172.21.15.32:123 2024-09-17T02:17:09.610 INFO:teuthology.orchestra.run.smithi032.stdout:17 Sep 02:17:09 ntpd[18387]: Listen normally on 4 lo [::1]:123 2024-09-17T02:17:09.610 INFO:teuthology.orchestra.run.smithi032.stdout:17 Sep 02:17:09 ntpd[18387]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:2602%4]:123 2024-09-17T02:17:09.610 INFO:teuthology.orchestra.run.smithi032.stdout:17 Sep 02:17:09 ntpd[18387]: Listening on routing socket on fd #22 for interface updates 2024-09-17T02:17:09.632 INFO:teuthology.orchestra.run.smithi164.stdout:17 Sep 02:17:09 ntpd[18502]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-17T02:17:09.632 INFO:teuthology.orchestra.run.smithi164.stdout:17 Sep 02:17:09 ntpd[18502]: Command line: ntpd -gq 2024-09-17T02:17:09.632 INFO:teuthology.orchestra.run.smithi164.stdout:17 Sep 02:17:09 ntpd[18502]: ---------------------------------------------------- 2024-09-17T02:17:09.632 INFO:teuthology.orchestra.run.smithi164.stdout:17 Sep 02:17:09 ntpd[18502]: ntp-4 is maintained by Network Time Foundation, 2024-09-17T02:17:09.632 INFO:teuthology.orchestra.run.smithi164.stdout:17 Sep 02:17:09 ntpd[18502]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-17T02:17:09.632 INFO:teuthology.orchestra.run.smithi164.stdout:17 Sep 02:17:09 ntpd[18502]: corporation. Support and training for ntp-4 are 2024-09-17T02:17:09.632 INFO:teuthology.orchestra.run.smithi164.stdout:17 Sep 02:17:09 ntpd[18502]: available at https://www.nwtime.org/support 2024-09-17T02:17:09.632 INFO:teuthology.orchestra.run.smithi164.stdout:17 Sep 02:17:09 ntpd[18502]: ---------------------------------------------------- 2024-09-17T02:17:09.633 INFO:teuthology.orchestra.run.smithi164.stdout:17 Sep 02:17:09 ntpd[18502]: proto: precision = 0.043 usec (-24) 2024-09-17T02:17:09.633 INFO:teuthology.orchestra.run.smithi164.stdout:17 Sep 02:17:09 ntpd[18502]: basedate set to 2022-02-04 2024-09-17T02:17:09.633 INFO:teuthology.orchestra.run.smithi164.stdout:17 Sep 02:17:09 ntpd[18502]: gps base set to 2022-02-06 (week 2196) 2024-09-17T02:17:09.633 INFO:teuthology.orchestra.run.smithi164.stdout:17 Sep 02:17:09 ntpd[18502]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T02:17:09.633 INFO:teuthology.orchestra.run.smithi164.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T02:17:09.633 INFO:teuthology.orchestra.run.smithi164.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-17T02:17:09.634 INFO:teuthology.orchestra.run.smithi164.stdout:17 Sep 02:17:09 ntpd[18502]: restrict ::: KOD does nothing without LIMITED. 2024-09-17T02:17:09.635 INFO:teuthology.orchestra.run.smithi164.stdout:17 Sep 02:17:09 ntpd[18502]: Listen and drop on 0 v6wildcard [::]:123 2024-09-17T02:17:09.635 INFO:teuthology.orchestra.run.smithi164.stdout:17 Sep 02:17:09 ntpd[18502]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-17T02:17:09.635 INFO:teuthology.orchestra.run.smithi164.stdout:17 Sep 02:17:09 ntpd[18502]: Listen normally on 2 lo 127.0.0.1:123 2024-09-17T02:17:09.635 INFO:teuthology.orchestra.run.smithi164.stdout:17 Sep 02:17:09 ntpd[18502]: Listen normally on 3 enp3s0f1 172.21.15.164:123 2024-09-17T02:17:09.635 INFO:teuthology.orchestra.run.smithi164.stdout:17 Sep 02:17:09 ntpd[18502]: Listen normally on 4 lo [::1]:123 2024-09-17T02:17:09.635 INFO:teuthology.orchestra.run.smithi164.stdout:17 Sep 02:17:09 ntpd[18502]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:73f3%5]:123 2024-09-17T02:17:09.635 INFO:teuthology.orchestra.run.smithi164.stdout:17 Sep 02:17:09 ntpd[18502]: Listening on routing socket on fd #22 for interface updates 2024-09-17T02:17:10.598 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:10 ntpd[18371]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:10.598 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:10 ntpd[18371]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:10.598 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:10 ntpd[18371]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:10.598 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:10 ntpd[18371]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:10.598 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:10 ntpd[18371]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:10.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:10 ntpd[18371]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:10.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:10 ntpd[18371]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:10.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:10 ntpd[18371]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:10.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:10 ntpd[18371]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:10.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:10 ntpd[18371]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:10.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:10 ntpd[18371]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:10.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:10 ntpd[18371]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:11.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:11 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:11.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:11 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:11.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:11 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:11.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:11 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:11.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:11 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:11.608 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:11 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:11.608 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:11 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:11.608 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:11 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:11.608 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:11 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:11.608 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:11 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:11.608 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:11 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:11.609 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:11 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:12.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:12 ntpd[18371]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:12.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:12 ntpd[18371]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:12.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:12 ntpd[18371]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:12.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:12 ntpd[18371]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:12.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:12 ntpd[18371]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:12.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:12 ntpd[18371]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:12.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:12 ntpd[18371]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:12.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:12 ntpd[18371]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:12.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:12 ntpd[18371]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:12.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:12 ntpd[18371]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:12.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:12 ntpd[18371]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:12.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:12 ntpd[18371]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:12.600 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:12 ntpd[18371]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:12.600 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:12 ntpd[18371]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:12.603 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:12 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:12.603 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:12 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:12.604 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:12 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:12.604 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:12 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:13.597 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:13 ntpd[18371]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:13.598 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:13 ntpd[18371]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:13.598 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:13 ntpd[18371]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:13.598 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:13 ntpd[18371]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:13.598 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:13 ntpd[18371]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:13.598 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:13 ntpd[18371]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:13.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:13 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:13.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:13 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:13.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:13 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:13.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:13 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:13.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:13 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:13.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:13 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:13.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:13 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:13.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:13 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:13.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:13 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:13.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:13 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:13.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:13 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:13.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:13 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:13.606 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:13 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:13.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:13 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:13.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:13 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:13.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:13 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:13.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:13 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:13.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:13 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:13.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:13 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:13.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:13 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:13.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:13 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:13.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:13 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:13.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:13 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:13.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:13 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:14.598 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:14 ntpd[18371]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:14.598 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:14 ntpd[18371]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:14.598 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:14 ntpd[18371]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:14.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:14 ntpd[18371]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:14.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:14 ntpd[18371]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:14.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:14 ntpd[18371]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:14.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:14 ntpd[18371]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:14.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:14 ntpd[18371]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:14.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:14 ntpd[18371]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:14.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:14 ntpd[18371]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:14.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:14 ntpd[18371]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:14.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:14 ntpd[18371]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:14.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:14 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:14.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:14 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:14.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:14 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:14.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:14 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:14.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:14 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:14.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:14 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:14.605 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:14 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:14.606 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:14 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:14.606 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:14 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:14.606 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:14 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:14.606 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:14 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:14.606 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:14 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:14.634 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:14 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:14.635 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:14 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:14.635 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:14 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:14.635 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:14 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:14.635 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:14 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:14.635 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:14 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:14.635 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:14 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:14.635 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:14 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:14.635 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:14 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:14.635 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:14 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:14.635 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:14 ntpd[18502]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:14.635 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:14 ntpd[18502]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:14.635 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:14 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:14.636 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:14 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:14.636 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:14 ntpd[18502]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:14.636 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:14 ntpd[18502]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:14.636 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:14 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:14.636 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:14 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:14.636 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:14 ntpd[18502]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:14.636 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:14 ntpd[18502]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:15.598 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:15 ntpd[18371]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:15.598 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:15 ntpd[18371]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:15.598 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:15 ntpd[18371]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:15.598 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:15 ntpd[18371]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:15.598 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:15 ntpd[18371]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:15.598 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:15 ntpd[18371]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:15.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:15 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:15.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:15 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:15.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:15 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:15.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:15 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:15.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:15 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:15.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:15 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:15.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:15 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:15.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:15 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:15.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:15 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:15.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:15 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:15.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:15 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:15.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:15 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:15.606 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:15 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:15.606 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:15 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:15.606 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:15 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:15.606 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:15 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:15.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:15 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:15.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:15 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:15.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:15 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:15.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:15 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:15.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:15 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:15.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:15 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:15.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:15 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:15.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:15 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:16.598 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:16 ntpd[18371]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:16.598 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:16 ntpd[18371]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:16.598 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:16 ntpd[18371]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:16.598 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:16 ntpd[18371]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:16.598 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:16 ntpd[18371]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:16.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:16 ntpd[18371]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:16.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:16 ntpd[18371]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:16.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:16 ntpd[18371]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:16.599 INFO:teuthology.orchestra.run.smithi001.stdout:17 Sep 02:17:16 ntpd[18371]: ntpd: time slew +0.002326 s 2024-09-17T02:17:16.599 INFO:teuthology.orchestra.run.smithi001.stdout:ntpd: time slew +0.002326s 2024-09-17T02:17:16.599 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:16 ntpd[18371]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-17T02:17:16.600 INFO:teuthology.orchestra.run.smithi001.stderr:17 Sep 02:17:16 ntpd[18371]: can't open /var/log/ntpstats/loopstats.20240917: Permission denied 2024-09-17T02:17:16.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:16 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:16.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:16 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:16.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:16 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:16.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:16 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:16.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:16 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:16.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:16 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:16.605 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:16 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:16.605 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:16 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:16.605 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:16 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:16.605 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:16 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:16.605 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:16 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:16.605 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:16 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:16.633 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:16 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:16.634 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:16 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:16.634 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:16 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:16.634 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:16 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:16.634 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:16 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:16.634 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:16 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:16.634 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:16 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:16.634 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:16 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:16.634 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:16 ntpd[18502]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:16.634 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:16 ntpd[18502]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:16.634 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:16 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:16.634 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:16 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:16.634 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:16 ntpd[18502]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:16.635 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:16 ntpd[18502]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:16.635 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:16 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:16.635 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:16 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:16.635 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:16 ntpd[18502]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:16.635 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:16 ntpd[18502]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:16.657 INFO:teuthology.orchestra.run.smithi001.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T02:17:16.657 INFO:teuthology.orchestra.run.smithi001.stdout:============================================================================== 2024-09-17T02:17:16.657 INFO:teuthology.orchestra.run.smithi001.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T02:17:16.657 INFO:teuthology.orchestra.run.smithi001.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T02:17:16.657 INFO:teuthology.orchestra.run.smithi001.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T02:17:16.657 INFO:teuthology.orchestra.run.smithi001.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T02:17:17.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:17 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:17.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:17 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:17.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:17 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:17.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:17 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:17.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:17 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:17.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:17 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:17.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:17 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:17.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:17 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:17.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:17 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:17.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:17 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:17.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:17 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:17.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:17 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:17.606 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:17 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:17.606 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:17 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:17.606 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:17 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:17.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:17 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:17.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:17 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:17.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:17 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:17.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:17 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:17.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:17 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:17.607 INFO:teuthology.orchestra.run.smithi153.stdout:17 Sep 02:17:17 ntpd[18460]: ntpd: time slew +0.002233 s 2024-09-17T02:17:17.607 INFO:teuthology.orchestra.run.smithi153.stdout:ntpd: time slew +0.002233s 2024-09-17T02:17:17.607 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:17 ntpd[18460]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-17T02:17:17.608 INFO:teuthology.orchestra.run.smithi153.stderr:17 Sep 02:17:17 ntpd[18460]: can't open /var/log/ntpstats/loopstats.20240917: Permission denied 2024-09-17T02:17:17.655 INFO:teuthology.orchestra.run.smithi153.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T02:17:17.655 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================== 2024-09-17T02:17:17.655 INFO:teuthology.orchestra.run.smithi153.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T02:17:17.655 INFO:teuthology.orchestra.run.smithi153.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T02:17:17.655 INFO:teuthology.orchestra.run.smithi153.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T02:17:17.655 INFO:teuthology.orchestra.run.smithi153.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T02:17:18.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:18 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:18.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:18 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:18.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:18 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:18.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:18 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:18.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:18 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:18.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:18 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:18.633 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:18 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:18.634 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:18 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:18.634 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:18 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:18.634 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:18 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:18.634 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:18 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:18.634 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:18 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:18.634 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:18 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:18.634 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:18 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:18.634 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:18 ntpd[18502]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:18.634 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:18 ntpd[18502]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:18.634 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:18 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:18.634 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:18 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:18.635 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:18 ntpd[18502]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:18.635 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:18 ntpd[18502]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:18.635 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:18 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:18.635 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:18 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:18.635 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:18 ntpd[18502]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:18.635 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:18 ntpd[18502]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:19.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:19 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:19.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:19 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:19.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:19 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:19.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:19 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:19.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:19 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:19.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:19 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:19.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:19 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:19.604 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:19 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:19.605 INFO:teuthology.orchestra.run.smithi032.stdout:17 Sep 02:17:19 ntpd[18387]: ntpd: time slew +0.002311 s 2024-09-17T02:17:19.605 INFO:teuthology.orchestra.run.smithi032.stdout:ntpd: time slew +0.002311s 2024-09-17T02:17:19.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:19 ntpd[18387]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-17T02:17:19.605 INFO:teuthology.orchestra.run.smithi032.stderr:17 Sep 02:17:19 ntpd[18387]: can't open /var/log/ntpstats/loopstats.20240917: Permission denied 2024-09-17T02:17:19.657 INFO:teuthology.orchestra.run.smithi032.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T02:17:19.657 INFO:teuthology.orchestra.run.smithi032.stdout:============================================================================== 2024-09-17T02:17:19.657 INFO:teuthology.orchestra.run.smithi032.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T02:17:19.657 INFO:teuthology.orchestra.run.smithi032.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T02:17:19.657 INFO:teuthology.orchestra.run.smithi032.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T02:17:19.657 INFO:teuthology.orchestra.run.smithi032.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T02:17:20.633 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:20 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:20.633 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:20 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:20.633 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:20 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:20.633 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:20 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:20.633 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:20 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:20.633 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:20 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:20.633 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:20 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T02:17:20.633 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:20 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T02:17:20.634 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:20 ntpd[18502]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T02:17:20.634 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:20 ntpd[18502]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T02:17:20.634 INFO:teuthology.orchestra.run.smithi164.stdout:17 Sep 02:17:20 ntpd[18502]: ntpd: time slew +0.003102 s 2024-09-17T02:17:20.634 INFO:teuthology.orchestra.run.smithi164.stdout:ntpd: time slew +0.003102s 2024-09-17T02:17:20.634 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:20 ntpd[18502]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-17T02:17:20.635 INFO:teuthology.orchestra.run.smithi164.stderr:17 Sep 02:17:20 ntpd[18502]: can't open /var/log/ntpstats/loopstats.20240917: Permission denied 2024-09-17T02:17:20.697 INFO:teuthology.orchestra.run.smithi164.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T02:17:20.698 INFO:teuthology.orchestra.run.smithi164.stdout:============================================================================== 2024-09-17T02:17:20.698 INFO:teuthology.orchestra.run.smithi164.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T02:17:20.698 INFO:teuthology.orchestra.run.smithi164.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T02:17:20.698 INFO:teuthology.orchestra.run.smithi164.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T02:17:20.698 INFO:teuthology.orchestra.run.smithi164.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T02:17:20.698 INFO:teuthology.run_tasks:Running task install... 2024-09-17T02:17:20.708 DEBUG:teuthology.task.install:project ceph 2024-09-17T02:17:20.708 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}} 2024-09-17T02:17:20.708 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'} 2024-09-17T02:17:20.708 INFO:teuthology.task.install:Using flavor: default 2024-09-17T02:17:20.714 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T02:17:20.714 INFO:teuthology.task.install:extra packages: [] 2024-09-17T02:17:20.715 DEBUG:teuthology.orchestra.run.smithi001:> sudo apt-key list | grep Ceph 2024-09-17T02:17:20.716 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-key list | grep Ceph 2024-09-17T02:17:20.716 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-key list | grep Ceph 2024-09-17T02:17:20.717 DEBUG:teuthology.orchestra.run.smithi164:> sudo apt-key list | grep Ceph 2024-09-17T02:17:20.781 INFO:teuthology.orchestra.run.smithi001.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-17T02:17:20.781 INFO:teuthology.orchestra.run.smithi153.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-17T02:17:20.782 INFO:teuthology.orchestra.run.smithi032.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-17T02:17:20.801 INFO:teuthology.orchestra.run.smithi164.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-17T02:17:20.811 INFO:teuthology.orchestra.run.smithi153.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-17T02:17:20.811 INFO:teuthology.orchestra.run.smithi153.stdout:uid [ unknown] Ceph.com (release key) 2024-09-17T02:17:20.812 INFO:teuthology.orchestra.run.smithi001.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-17T02:17:20.812 INFO:teuthology.orchestra.run.smithi001.stdout:uid [ unknown] Ceph.com (release key) 2024-09-17T02:17:20.812 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-17T02:17:20.813 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-17T02:17:20.813 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T02:17:20.815 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-17T02:17:20.815 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-17T02:17:20.815 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T02:17:20.821 INFO:teuthology.orchestra.run.smithi032.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-17T02:17:20.821 INFO:teuthology.orchestra.run.smithi032.stdout:uid [ unknown] Ceph.com (release key) 2024-09-17T02:17:20.821 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-17T02:17:20.821 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-17T02:17:20.821 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T02:17:20.828 INFO:teuthology.orchestra.run.smithi164.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-17T02:17:20.828 INFO:teuthology.orchestra.run.smithi164.stdout:uid [ unknown] Ceph.com (release key) 2024-09-17T02:17:20.829 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-17T02:17:20.829 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-17T02:17:20.829 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T02:17:20.963 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default/ 2024-09-17T02:17:20.963 INFO:teuthology.task.install.deb:Package version is 19.1.1-330-gc2ddf972-1jammy 2024-09-17T02:17:20.968 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default/ 2024-09-17T02:17:20.968 INFO:teuthology.task.install.deb:Package version is 19.1.1-330-gc2ddf972-1jammy 2024-09-17T02:17:20.973 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default/ 2024-09-17T02:17:20.973 INFO:teuthology.task.install.deb:Package version is 19.1.1-330-gc2ddf972-1jammy 2024-09-17T02:17:20.976 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default/ 2024-09-17T02:17:20.976 INFO:teuthology.task.install.deb:Package version is 19.1.1-330-gc2ddf972-1jammy 2024-09-17T02:17:21.078 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T02:17:21.078 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-17T02:17:21.085 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-17T02:17:21.086 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-17T02:17:21.090 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-17T02:17:21.091 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-17T02:17:21.092 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get update 2024-09-17T02:17:21.100 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T02:17:21.101 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-17T02:17:21.102 DEBUG:teuthology.orchestra.run.smithi001:> sudo apt-get update 2024-09-17T02:17:21.105 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get update 2024-09-17T02:17:21.152 DEBUG:teuthology.orchestra.run.smithi164:> sudo apt-get update 2024-09-17T02:17:21.262 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T02:17:21.317 INFO:teuthology.orchestra.run.smithi153.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-17T02:17:21.332 INFO:teuthology.orchestra.run.smithi032.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-17T02:17:21.334 INFO:teuthology.orchestra.run.smithi001.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-17T02:17:21.338 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-17T02:17:21.354 INFO:teuthology.orchestra.run.smithi032.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-17T02:17:21.355 INFO:teuthology.orchestra.run.smithi001.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-17T02:17:21.360 INFO:teuthology.orchestra.run.smithi153.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-17T02:17:21.377 INFO:teuthology.orchestra.run.smithi032.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-17T02:17:21.378 INFO:teuthology.orchestra.run.smithi001.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-17T02:17:21.378 INFO:teuthology.orchestra.run.smithi164.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-17T02:17:21.381 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-17T02:17:21.388 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T02:17:21.400 INFO:teuthology.orchestra.run.smithi164.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-17T02:17:21.405 INFO:teuthology.orchestra.run.smithi001.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T02:17:21.405 INFO:teuthology.orchestra.run.smithi001.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-17T02:17:21.405 INFO:teuthology.orchestra.run.smithi001.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-17T02:17:21.405 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T02:17:21.406 INFO:teuthology.orchestra.run.smithi032.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-17T02:17:21.406 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-17T02:17:21.409 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,409 B] 2024-09-17T02:17:21.423 INFO:teuthology.orchestra.run.smithi164.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-17T02:17:21.434 INFO:teuthology.orchestra.run.smithi001.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,409 B] 2024-09-17T02:17:21.435 INFO:teuthology.orchestra.run.smithi032.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,409 B] 2024-09-17T02:17:21.444 INFO:teuthology.orchestra.run.smithi164.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-17T02:17:21.444 INFO:teuthology.orchestra.run.smithi164.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,409 B] 2024-09-17T02:17:21.462 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T02:17:21.464 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-17T02:17:21.476 INFO:teuthology.orchestra.run.smithi001.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-17T02:17:21.478 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-17T02:17:21.484 INFO:teuthology.orchestra.run.smithi164.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-17T02:17:21.526 INFO:teuthology.orchestra.run.smithi164.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-17T02:17:21.822 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T02:17:21.831 INFO:teuthology.orchestra.run.smithi001.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T02:17:21.836 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T02:17:21.861 INFO:teuthology.orchestra.run.smithi001.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-17T02:17:21.869 INFO:teuthology.orchestra.run.smithi032.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-17T02:17:21.882 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T02:17:21.902 INFO:teuthology.orchestra.run.smithi164.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-17T02:17:21.912 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-17T02:17:21.943 INFO:teuthology.orchestra.run.smithi001.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-17T02:17:21.950 INFO:teuthology.orchestra.run.smithi032.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-17T02:17:21.980 INFO:teuthology.orchestra.run.smithi164.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-17T02:17:22.279 INFO:teuthology.orchestra.run.smithi001.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-17T02:17:22.285 INFO:teuthology.orchestra.run.smithi032.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-17T02:17:22.296 INFO:teuthology.orchestra.run.smithi164.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-17T02:17:22.323 INFO:teuthology.orchestra.run.smithi164.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-17T02:17:22.350 INFO:teuthology.orchestra.run.smithi153.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-17T02:17:22.369 INFO:teuthology.orchestra.run.smithi153.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-17T02:17:22.378 INFO:teuthology.orchestra.run.smithi153.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-17T02:17:22.379 INFO:teuthology.orchestra.run.smithi001.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-17T02:17:22.385 INFO:teuthology.orchestra.run.smithi032.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-17T02:17:22.398 INFO:teuthology.orchestra.run.smithi001.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-17T02:17:22.403 INFO:teuthology.orchestra.run.smithi032.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-17T02:17:22.408 INFO:teuthology.orchestra.run.smithi001.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-17T02:17:22.413 INFO:teuthology.orchestra.run.smithi032.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-17T02:17:22.427 INFO:teuthology.orchestra.run.smithi001.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-17T02:17:22.433 INFO:teuthology.orchestra.run.smithi153.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-17T02:17:22.452 INFO:teuthology.orchestra.run.smithi153.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-17T02:17:22.461 INFO:teuthology.orchestra.run.smithi164.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-17T02:17:22.467 INFO:teuthology.orchestra.run.smithi032.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-17T02:17:22.473 INFO:teuthology.orchestra.run.smithi164.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-17T02:17:22.481 INFO:teuthology.orchestra.run.smithi001.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-17T02:17:22.487 INFO:teuthology.orchestra.run.smithi032.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-17T02:17:22.499 INFO:teuthology.orchestra.run.smithi164.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-17T02:17:22.537 INFO:teuthology.orchestra.run.smithi164.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-17T02:17:26.996 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 5,154 kB in 2s (3,105 kB/s) 2024-09-17T02:17:27.235 INFO:teuthology.orchestra.run.smithi164.stdout:Fetched 7,384 kB in 2s (4,083 kB/s) 2024-09-17T02:17:27.541 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 7,384 kB in 2s (3,957 kB/s) 2024-09-17T02:17:27.604 INFO:teuthology.orchestra.run.smithi001.stdout:Fetched 7,384 kB in 2s (3,937 kB/s) 2024-09-17T02:17:28.062 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-17T02:17:28.078 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-330-gc2ddf972-1jammy cephadm=19.1.1-330-gc2ddf972-1jammy ceph-mds=19.1.1-330-gc2ddf972-1jammy ceph-mgr=19.1.1-330-gc2ddf972-1jammy ceph-common=19.1.1-330-gc2ddf972-1jammy ceph-fuse=19.1.1-330-gc2ddf972-1jammy ceph-test=19.1.1-330-gc2ddf972-1jammy ceph-volume=19.1.1-330-gc2ddf972-1jammy radosgw=19.1.1-330-gc2ddf972-1jammy python3-rados=19.1.1-330-gc2ddf972-1jammy python3-rgw=19.1.1-330-gc2ddf972-1jammy python3-cephfs=19.1.1-330-gc2ddf972-1jammy python3-rbd=19.1.1-330-gc2ddf972-1jammy libcephfs2=19.1.1-330-gc2ddf972-1jammy libcephfs-dev=19.1.1-330-gc2ddf972-1jammy librados2=19.1.1-330-gc2ddf972-1jammy librbd1=19.1.1-330-gc2ddf972-1jammy rbd-fuse=19.1.1-330-gc2ddf972-1jammy 2024-09-17T02:17:28.140 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-17T02:17:28.279 INFO:teuthology.orchestra.run.smithi164.stdout:Reading package lists... 2024-09-17T02:17:28.296 DEBUG:teuthology.orchestra.run.smithi164:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-330-gc2ddf972-1jammy cephadm=19.1.1-330-gc2ddf972-1jammy ceph-mds=19.1.1-330-gc2ddf972-1jammy ceph-mgr=19.1.1-330-gc2ddf972-1jammy ceph-common=19.1.1-330-gc2ddf972-1jammy ceph-fuse=19.1.1-330-gc2ddf972-1jammy ceph-test=19.1.1-330-gc2ddf972-1jammy ceph-volume=19.1.1-330-gc2ddf972-1jammy radosgw=19.1.1-330-gc2ddf972-1jammy python3-rados=19.1.1-330-gc2ddf972-1jammy python3-rgw=19.1.1-330-gc2ddf972-1jammy python3-cephfs=19.1.1-330-gc2ddf972-1jammy python3-rbd=19.1.1-330-gc2ddf972-1jammy libcephfs2=19.1.1-330-gc2ddf972-1jammy libcephfs-dev=19.1.1-330-gc2ddf972-1jammy librados2=19.1.1-330-gc2ddf972-1jammy librbd1=19.1.1-330-gc2ddf972-1jammy rbd-fuse=19.1.1-330-gc2ddf972-1jammy 2024-09-17T02:17:28.351 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-09-17T02:17:28.352 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-09-17T02:17:28.362 INFO:teuthology.orchestra.run.smithi164.stdout:Reading package lists... 2024-09-17T02:17:28.548 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T02:17:28.548 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T02:17:28.548 INFO:teuthology.orchestra.run.smithi153.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T02:17:28.548 INFO:teuthology.orchestra.run.smithi153.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T02:17:28.549 INFO:teuthology.orchestra.run.smithi153.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T02:17:28.549 INFO:teuthology.orchestra.run.smithi153.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T02:17:28.549 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T02:17:28.550 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2024-09-17T02:17:28.551 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-17T02:17:28.551 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-17T02:17:28.551 INFO:teuthology.orchestra.run.smithi153.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-17T02:17:28.551 INFO:teuthology.orchestra.run.smithi153.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-17T02:17:28.551 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-17T02:17:28.551 INFO:teuthology.orchestra.run.smithi153.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-17T02:17:28.551 INFO:teuthology.orchestra.run.smithi153.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-17T02:17:28.551 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-17T02:17:28.551 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-17T02:17:28.551 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-17T02:17:28.551 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T02:17:28.551 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T02:17:28.551 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T02:17:28.552 INFO:teuthology.orchestra.run.smithi153.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T02:17:28.552 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T02:17:28.552 INFO:teuthology.orchestra.run.smithi153.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T02:17:28.552 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-17T02:17:28.552 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-17T02:17:28.552 INFO:teuthology.orchestra.run.smithi153.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-17T02:17:28.552 INFO:teuthology.orchestra.run.smithi153.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-17T02:17:28.552 INFO:teuthology.orchestra.run.smithi153.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-17T02:17:28.552 INFO:teuthology.orchestra.run.smithi153.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-17T02:17:28.552 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-17T02:17:28.552 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet zip 2024-09-17T02:17:28.553 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2024-09-17T02:17:28.553 INFO:teuthology.orchestra.run.smithi153.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-17T02:17:28.553 INFO:teuthology.orchestra.run.smithi153.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-17T02:17:28.553 INFO:teuthology.orchestra.run.smithi153.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-17T02:17:28.553 INFO:teuthology.orchestra.run.smithi153.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-17T02:17:28.553 INFO:teuthology.orchestra.run.smithi153.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-17T02:17:28.553 INFO:teuthology.orchestra.run.smithi153.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-17T02:17:28.554 INFO:teuthology.orchestra.run.smithi153.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-17T02:17:28.554 INFO:teuthology.orchestra.run.smithi153.stdout:Recommended packages: 2024-09-17T02:17:28.554 INFO:teuthology.orchestra.run.smithi153.stdout: btrfs-tools 2024-09-17T02:17:28.584 INFO:teuthology.orchestra.run.smithi164.stdout:Building dependency tree... 2024-09-17T02:17:28.585 INFO:teuthology.orchestra.run.smithi164.stdout:Reading state information... 2024-09-17T02:17:28.627 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-09-17T02:17:28.643 DEBUG:teuthology.orchestra.run.smithi032:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-330-gc2ddf972-1jammy cephadm=19.1.1-330-gc2ddf972-1jammy ceph-mds=19.1.1-330-gc2ddf972-1jammy ceph-mgr=19.1.1-330-gc2ddf972-1jammy ceph-common=19.1.1-330-gc2ddf972-1jammy ceph-fuse=19.1.1-330-gc2ddf972-1jammy ceph-test=19.1.1-330-gc2ddf972-1jammy ceph-volume=19.1.1-330-gc2ddf972-1jammy radosgw=19.1.1-330-gc2ddf972-1jammy python3-rados=19.1.1-330-gc2ddf972-1jammy python3-rgw=19.1.1-330-gc2ddf972-1jammy python3-cephfs=19.1.1-330-gc2ddf972-1jammy python3-rbd=19.1.1-330-gc2ddf972-1jammy libcephfs2=19.1.1-330-gc2ddf972-1jammy libcephfs-dev=19.1.1-330-gc2ddf972-1jammy librados2=19.1.1-330-gc2ddf972-1jammy librbd1=19.1.1-330-gc2ddf972-1jammy rbd-fuse=19.1.1-330-gc2ddf972-1jammy 2024-09-17T02:17:28.655 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2024-09-17T02:17:28.655 INFO:teuthology.orchestra.run.smithi153.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-17T02:17:28.655 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-17T02:17:28.656 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-17T02:17:28.656 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-17T02:17:28.657 INFO:teuthology.orchestra.run.smithi153.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-17T02:17:28.657 INFO:teuthology.orchestra.run.smithi153.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-17T02:17:28.657 INFO:teuthology.orchestra.run.smithi153.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-17T02:17:28.657 INFO:teuthology.orchestra.run.smithi153.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-17T02:17:28.657 INFO:teuthology.orchestra.run.smithi153.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-17T02:17:28.657 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-17T02:17:28.657 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-17T02:17:28.657 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-17T02:17:28.657 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T02:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T02:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T02:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T02:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T02:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T02:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-17T02:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-17T02:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-17T02:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-17T02:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-17T02:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-17T02:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-17T02:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-17T02:17:28.681 INFO:teuthology.orchestra.run.smithi001.stdout:Reading package lists... 2024-09-17T02:17:28.698 DEBUG:teuthology.orchestra.run.smithi001:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-330-gc2ddf972-1jammy cephadm=19.1.1-330-gc2ddf972-1jammy ceph-mds=19.1.1-330-gc2ddf972-1jammy ceph-mgr=19.1.1-330-gc2ddf972-1jammy ceph-common=19.1.1-330-gc2ddf972-1jammy ceph-fuse=19.1.1-330-gc2ddf972-1jammy ceph-test=19.1.1-330-gc2ddf972-1jammy ceph-volume=19.1.1-330-gc2ddf972-1jammy radosgw=19.1.1-330-gc2ddf972-1jammy python3-rados=19.1.1-330-gc2ddf972-1jammy python3-rgw=19.1.1-330-gc2ddf972-1jammy python3-cephfs=19.1.1-330-gc2ddf972-1jammy python3-rbd=19.1.1-330-gc2ddf972-1jammy libcephfs2=19.1.1-330-gc2ddf972-1jammy libcephfs-dev=19.1.1-330-gc2ddf972-1jammy librados2=19.1.1-330-gc2ddf972-1jammy librbd1=19.1.1-330-gc2ddf972-1jammy rbd-fuse=19.1.1-330-gc2ddf972-1jammy 2024-09-17T02:17:28.712 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-09-17T02:17:28.716 INFO:teuthology.orchestra.run.smithi153.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-17T02:17:28.716 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 181 MB of archives. 2024-09-17T02:17:28.717 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-17T02:17:28.717 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-17T02:17:28.767 INFO:teuthology.orchestra.run.smithi001.stdout:Reading package lists... 2024-09-17T02:17:28.797 INFO:teuthology.orchestra.run.smithi164.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T02:17:28.797 INFO:teuthology.orchestra.run.smithi164.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T02:17:28.797 INFO:teuthology.orchestra.run.smithi164.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T02:17:28.797 INFO:teuthology.orchestra.run.smithi164.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T02:17:28.798 INFO:teuthology.orchestra.run.smithi164.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T02:17:28.798 INFO:teuthology.orchestra.run.smithi164.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T02:17:28.798 INFO:teuthology.orchestra.run.smithi164.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T02:17:28.798 INFO:teuthology.orchestra.run.smithi164.stdout:The following additional packages will be installed: 2024-09-17T02:17:28.798 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-17T02:17:28.799 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-17T02:17:28.799 INFO:teuthology.orchestra.run.smithi164.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-17T02:17:28.799 INFO:teuthology.orchestra.run.smithi164.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-17T02:17:28.800 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-17T02:17:28.800 INFO:teuthology.orchestra.run.smithi164.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-17T02:17:28.800 INFO:teuthology.orchestra.run.smithi164.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-17T02:17:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-17T02:17:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-17T02:17:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-17T02:17:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T02:17:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T02:17:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T02:17:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T02:17:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T02:17:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T02:17:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-17T02:17:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-17T02:17:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-17T02:17:28.801 INFO:teuthology.orchestra.run.smithi164.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-17T02:17:28.802 INFO:teuthology.orchestra.run.smithi164.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-17T02:17:28.802 INFO:teuthology.orchestra.run.smithi164.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-17T02:17:28.802 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-17T02:17:28.802 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet zip 2024-09-17T02:17:28.802 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-330-gc2ddf972-1jammy [3,591 kB] 2024-09-17T02:17:28.802 INFO:teuthology.orchestra.run.smithi164.stdout:Suggested packages: 2024-09-17T02:17:28.803 INFO:teuthology.orchestra.run.smithi164.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-17T02:17:28.803 INFO:teuthology.orchestra.run.smithi164.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-17T02:17:28.803 INFO:teuthology.orchestra.run.smithi164.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-17T02:17:28.803 INFO:teuthology.orchestra.run.smithi164.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-17T02:17:28.803 INFO:teuthology.orchestra.run.smithi164.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-17T02:17:28.803 INFO:teuthology.orchestra.run.smithi164.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-17T02:17:28.803 INFO:teuthology.orchestra.run.smithi164.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-17T02:17:28.803 INFO:teuthology.orchestra.run.smithi164.stdout:Recommended packages: 2024-09-17T02:17:28.803 INFO:teuthology.orchestra.run.smithi164.stdout: btrfs-tools 2024-09-17T02:17:28.805 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-17T02:17:28.807 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-17T02:17:28.824 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-17T02:17:28.882 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-17T02:17:28.887 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-17T02:17:28.899 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-17T02:17:28.903 INFO:teuthology.orchestra.run.smithi164.stdout:The following NEW packages will be installed: 2024-09-17T02:17:28.903 INFO:teuthology.orchestra.run.smithi164.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-17T02:17:28.903 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-17T02:17:28.903 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-17T02:17:28.904 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-17T02:17:28.904 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-17T02:17:28.905 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-17T02:17:28.905 INFO:teuthology.orchestra.run.smithi164.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-17T02:17:28.905 INFO:teuthology.orchestra.run.smithi164.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-17T02:17:28.905 INFO:teuthology.orchestra.run.smithi164.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-17T02:17:28.905 INFO:teuthology.orchestra.run.smithi164.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-17T02:17:28.905 INFO:teuthology.orchestra.run.smithi164.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-17T02:17:28.905 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-17T02:17:28.906 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-17T02:17:28.906 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-17T02:17:28.906 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T02:17:28.906 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T02:17:28.906 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T02:17:28.906 INFO:teuthology.orchestra.run.smithi164.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T02:17:28.906 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T02:17:28.906 INFO:teuthology.orchestra.run.smithi164.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T02:17:28.906 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-17T02:17:28.906 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-17T02:17:28.906 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-17T02:17:28.906 INFO:teuthology.orchestra.run.smithi164.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-17T02:17:28.906 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-17T02:17:28.906 INFO:teuthology.orchestra.run.smithi164.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-17T02:17:28.907 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-17T02:17:28.907 INFO:teuthology.orchestra.run.smithi164.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-17T02:17:28.907 INFO:teuthology.orchestra.run.smithi153.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-17T02:17:28.913 INFO:teuthology.orchestra.run.smithi153.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-17T02:17:28.915 INFO:teuthology.orchestra.run.smithi153.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-17T02:17:28.917 INFO:teuthology.orchestra.run.smithi153.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-17T02:17:28.919 INFO:teuthology.orchestra.run.smithi153.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-17T02:17:28.920 INFO:teuthology.orchestra.run.smithi153.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-17T02:17:28.922 INFO:teuthology.orchestra.run.smithi153.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-17T02:17:28.926 INFO:teuthology.orchestra.run.smithi032.stdout:Building dependency tree... 2024-09-17T02:17:28.927 INFO:teuthology.orchestra.run.smithi032.stdout:Reading state information... 2024-09-17T02:17:28.936 INFO:teuthology.orchestra.run.smithi153.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-17T02:17:28.938 INFO:teuthology.orchestra.run.smithi153.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-17T02:17:28.938 INFO:teuthology.orchestra.run.smithi153.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-17T02:17:28.939 INFO:teuthology.orchestra.run.smithi153.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-17T02:17:28.940 INFO:teuthology.orchestra.run.smithi153.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-17T02:17:28.940 INFO:teuthology.orchestra.run.smithi153.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-17T02:17:28.940 INFO:teuthology.orchestra.run.smithi153.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-17T02:17:28.941 INFO:teuthology.orchestra.run.smithi153.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-17T02:17:28.954 INFO:teuthology.orchestra.run.smithi153.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-17T02:17:28.954 INFO:teuthology.orchestra.run.smithi153.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-17T02:17:28.970 INFO:teuthology.orchestra.run.smithi001.stdout:Building dependency tree... 2024-09-17T02:17:28.970 INFO:teuthology.orchestra.run.smithi153.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-17T02:17:28.971 INFO:teuthology.orchestra.run.smithi001.stdout:Reading state information... 2024-09-17T02:17:28.973 INFO:teuthology.orchestra.run.smithi153.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-17T02:17:28.974 INFO:teuthology.orchestra.run.smithi153.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-17T02:17:28.974 INFO:teuthology.orchestra.run.smithi153.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-17T02:17:28.975 INFO:teuthology.orchestra.run.smithi153.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-17T02:17:28.975 INFO:teuthology.orchestra.run.smithi153.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-17T02:17:28.976 INFO:teuthology.orchestra.run.smithi153.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-17T02:17:28.976 INFO:teuthology.orchestra.run.smithi153.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-17T02:17:28.987 INFO:teuthology.orchestra.run.smithi153.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-17T02:17:28.988 INFO:teuthology.orchestra.run.smithi153.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-17T02:17:29.004 INFO:teuthology.orchestra.run.smithi153.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-17T02:17:29.009 INFO:teuthology.orchestra.run.smithi153.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-17T02:17:29.010 INFO:teuthology.orchestra.run.smithi153.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-17T02:17:29.010 INFO:teuthology.orchestra.run.smithi153.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-17T02:17:29.011 INFO:teuthology.orchestra.run.smithi153.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-17T02:17:29.012 INFO:teuthology.orchestra.run.smithi153.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-17T02:17:29.014 INFO:teuthology.orchestra.run.smithi153.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-17T02:17:29.015 INFO:teuthology.orchestra.run.smithi153.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-17T02:17:29.021 INFO:teuthology.orchestra.run.smithi153.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-17T02:17:29.022 INFO:teuthology.orchestra.run.smithi153.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-17T02:17:29.037 INFO:teuthology.orchestra.run.smithi153.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-17T02:17:29.038 INFO:teuthology.orchestra.run.smithi153.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-17T02:17:29.039 INFO:teuthology.orchestra.run.smithi153.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-17T02:17:29.041 INFO:teuthology.orchestra.run.smithi153.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-17T02:17:29.044 INFO:teuthology.orchestra.run.smithi164.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-17T02:17:29.044 INFO:teuthology.orchestra.run.smithi164.stdout:Need to get 181 MB of archives. 2024-09-17T02:17:29.044 INFO:teuthology.orchestra.run.smithi164.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-17T02:17:29.044 INFO:teuthology.orchestra.run.smithi164.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-330-gc2ddf972-1jammy [3,591 kB] 2024-09-17T02:17:29.079 INFO:teuthology.orchestra.run.smithi153.stdout:Get:52 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-330-gc2ddf972-1jammy [3,242 kB] 2024-09-17T02:17:29.090 INFO:teuthology.orchestra.run.smithi164.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-17T02:17:29.094 INFO:teuthology.orchestra.run.smithi153.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-17T02:17:29.095 INFO:teuthology.orchestra.run.smithi153.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-17T02:17:29.096 INFO:teuthology.orchestra.run.smithi153.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-17T02:17:29.096 INFO:teuthology.orchestra.run.smithi153.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-17T02:17:29.097 INFO:teuthology.orchestra.run.smithi153.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-17T02:17:29.114 INFO:teuthology.orchestra.run.smithi153.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-17T02:17:29.116 INFO:teuthology.orchestra.run.smithi153.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-17T02:17:29.116 INFO:teuthology.orchestra.run.smithi153.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-17T02:17:29.131 INFO:teuthology.orchestra.run.smithi153.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-17T02:17:29.131 INFO:teuthology.orchestra.run.smithi153.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-17T02:17:29.131 INFO:teuthology.orchestra.run.smithi153.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-17T02:17:29.132 INFO:teuthology.orchestra.run.smithi153.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-17T02:17:29.132 INFO:teuthology.orchestra.run.smithi153.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-17T02:17:29.133 INFO:teuthology.orchestra.run.smithi153.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-17T02:17:29.143 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T02:17:29.143 INFO:teuthology.orchestra.run.smithi032.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T02:17:29.143 INFO:teuthology.orchestra.run.smithi032.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T02:17:29.144 INFO:teuthology.orchestra.run.smithi032.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T02:17:29.144 INFO:teuthology.orchestra.run.smithi032.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T02:17:29.144 INFO:teuthology.orchestra.run.smithi032.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T02:17:29.145 INFO:teuthology.orchestra.run.smithi032.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T02:17:29.145 INFO:teuthology.orchestra.run.smithi032.stdout:The following additional packages will be installed: 2024-09-17T02:17:29.145 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-17T02:17:29.145 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-17T02:17:29.146 INFO:teuthology.orchestra.run.smithi153.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-17T02:17:29.147 INFO:teuthology.orchestra.run.smithi032.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-17T02:17:29.147 INFO:teuthology.orchestra.run.smithi032.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-17T02:17:29.147 INFO:teuthology.orchestra.run.smithi032.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-17T02:17:29.147 INFO:teuthology.orchestra.run.smithi032.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-17T02:17:29.147 INFO:teuthology.orchestra.run.smithi032.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-17T02:17:29.147 INFO:teuthology.orchestra.run.smithi032.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-17T02:17:29.148 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-17T02:17:29.148 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-17T02:17:29.148 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T02:17:29.148 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T02:17:29.148 INFO:teuthology.orchestra.run.smithi032.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T02:17:29.148 INFO:teuthology.orchestra.run.smithi032.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T02:17:29.148 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T02:17:29.148 INFO:teuthology.orchestra.run.smithi032.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T02:17:29.148 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-17T02:17:29.148 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-17T02:17:29.148 INFO:teuthology.orchestra.run.smithi032.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-17T02:17:29.148 INFO:teuthology.orchestra.run.smithi032.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-17T02:17:29.148 INFO:teuthology.orchestra.run.smithi032.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-17T02:17:29.148 INFO:teuthology.orchestra.run.smithi032.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-17T02:17:29.149 INFO:teuthology.orchestra.run.smithi032.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-17T02:17:29.149 INFO:teuthology.orchestra.run.smithi032.stdout: xmlstarlet zip 2024-09-17T02:17:29.149 INFO:teuthology.orchestra.run.smithi032.stdout:Suggested packages: 2024-09-17T02:17:29.149 INFO:teuthology.orchestra.run.smithi032.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-17T02:17:29.150 INFO:teuthology.orchestra.run.smithi032.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-17T02:17:29.150 INFO:teuthology.orchestra.run.smithi032.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-17T02:17:29.150 INFO:teuthology.orchestra.run.smithi032.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-17T02:17:29.150 INFO:teuthology.orchestra.run.smithi032.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-17T02:17:29.150 INFO:teuthology.orchestra.run.smithi032.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-17T02:17:29.150 INFO:teuthology.orchestra.run.smithi032.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-17T02:17:29.150 INFO:teuthology.orchestra.run.smithi032.stdout:Recommended packages: 2024-09-17T02:17:29.150 INFO:teuthology.orchestra.run.smithi032.stdout: btrfs-tools 2024-09-17T02:17:29.150 INFO:teuthology.orchestra.run.smithi153.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-17T02:17:29.150 INFO:teuthology.orchestra.run.smithi153.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-17T02:17:29.163 INFO:teuthology.orchestra.run.smithi153.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-17T02:17:29.164 INFO:teuthology.orchestra.run.smithi153.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-17T02:17:29.165 INFO:teuthology.orchestra.run.smithi153.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-17T02:17:29.168 INFO:teuthology.orchestra.run.smithi153.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-17T02:17:29.170 INFO:teuthology.orchestra.run.smithi153.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-17T02:17:29.171 INFO:teuthology.orchestra.run.smithi153.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-17T02:17:29.171 INFO:teuthology.orchestra.run.smithi153.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-17T02:17:29.180 INFO:teuthology.orchestra.run.smithi153.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-17T02:17:29.180 INFO:teuthology.orchestra.run.smithi153.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-17T02:17:29.183 INFO:teuthology.orchestra.run.smithi153.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-17T02:17:29.190 INFO:teuthology.orchestra.run.smithi001.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T02:17:29.191 INFO:teuthology.orchestra.run.smithi001.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T02:17:29.191 INFO:teuthology.orchestra.run.smithi001.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T02:17:29.191 INFO:teuthology.orchestra.run.smithi001.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T02:17:29.192 INFO:teuthology.orchestra.run.smithi001.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T02:17:29.192 INFO:teuthology.orchestra.run.smithi001.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T02:17:29.192 INFO:teuthology.orchestra.run.smithi001.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T02:17:29.192 INFO:teuthology.orchestra.run.smithi001.stdout:The following additional packages will be installed: 2024-09-17T02:17:29.192 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-17T02:17:29.193 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-17T02:17:29.193 INFO:teuthology.orchestra.run.smithi001.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-17T02:17:29.193 INFO:teuthology.orchestra.run.smithi001.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-17T02:17:29.195 INFO:teuthology.orchestra.run.smithi001.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-17T02:17:29.195 INFO:teuthology.orchestra.run.smithi001.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-17T02:17:29.195 INFO:teuthology.orchestra.run.smithi001.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-17T02:17:29.195 INFO:teuthology.orchestra.run.smithi001.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-17T02:17:29.195 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-17T02:17:29.195 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-17T02:17:29.195 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T02:17:29.195 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T02:17:29.196 INFO:teuthology.orchestra.run.smithi001.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T02:17:29.196 INFO:teuthology.orchestra.run.smithi001.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T02:17:29.196 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T02:17:29.196 INFO:teuthology.orchestra.run.smithi001.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T02:17:29.196 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-17T02:17:29.196 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-17T02:17:29.196 INFO:teuthology.orchestra.run.smithi001.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-17T02:17:29.196 INFO:teuthology.orchestra.run.smithi001.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-17T02:17:29.196 INFO:teuthology.orchestra.run.smithi001.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-17T02:17:29.196 INFO:teuthology.orchestra.run.smithi001.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-17T02:17:29.196 INFO:teuthology.orchestra.run.smithi001.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-17T02:17:29.197 INFO:teuthology.orchestra.run.smithi001.stdout: xmlstarlet zip 2024-09-17T02:17:29.197 INFO:teuthology.orchestra.run.smithi001.stdout:Suggested packages: 2024-09-17T02:17:29.197 INFO:teuthology.orchestra.run.smithi001.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-17T02:17:29.198 INFO:teuthology.orchestra.run.smithi001.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-17T02:17:29.198 INFO:teuthology.orchestra.run.smithi001.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-17T02:17:29.198 INFO:teuthology.orchestra.run.smithi001.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-17T02:17:29.198 INFO:teuthology.orchestra.run.smithi001.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-17T02:17:29.198 INFO:teuthology.orchestra.run.smithi001.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-17T02:17:29.198 INFO:teuthology.orchestra.run.smithi001.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-17T02:17:29.198 INFO:teuthology.orchestra.run.smithi001.stdout:Recommended packages: 2024-09-17T02:17:29.198 INFO:teuthology.orchestra.run.smithi001.stdout: btrfs-tools 2024-09-17T02:17:29.199 INFO:teuthology.orchestra.run.smithi153.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-17T02:17:29.199 INFO:teuthology.orchestra.run.smithi153.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-17T02:17:29.199 INFO:teuthology.orchestra.run.smithi153.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-17T02:17:29.199 INFO:teuthology.orchestra.run.smithi153.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-17T02:17:29.199 INFO:teuthology.orchestra.run.smithi153.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-17T02:17:29.206 INFO:teuthology.orchestra.run.smithi153.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-17T02:17:29.206 INFO:teuthology.orchestra.run.smithi153.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-330-gc2ddf972-1jammy [719 kB] 2024-09-17T02:17:29.206 INFO:teuthology.orchestra.run.smithi153.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-17T02:17:29.214 INFO:teuthology.orchestra.run.smithi153.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-17T02:17:29.215 INFO:teuthology.orchestra.run.smithi153.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-17T02:17:29.216 INFO:teuthology.orchestra.run.smithi153.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-17T02:17:29.229 INFO:teuthology.orchestra.run.smithi153.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-330-gc2ddf972-1jammy [356 kB] 2024-09-17T02:17:29.236 INFO:teuthology.orchestra.run.smithi153.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-330-gc2ddf972-1jammy [32.8 kB] 2024-09-17T02:17:29.237 INFO:teuthology.orchestra.run.smithi153.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-330-gc2ddf972-1jammy [180 kB] 2024-09-17T02:17:29.248 INFO:teuthology.orchestra.run.smithi153.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-330-gc2ddf972-1jammy [67.8 kB] 2024-09-17T02:17:29.250 INFO:teuthology.orchestra.run.smithi153.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-330-gc2ddf972-1jammy [333 kB] 2024-09-17T02:17:29.257 INFO:teuthology.orchestra.run.smithi153.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-330-gc2ddf972-1jammy [6,875 kB] 2024-09-17T02:17:29.259 INFO:teuthology.orchestra.run.smithi032.stdout:The following NEW packages will be installed: 2024-09-17T02:17:29.259 INFO:teuthology.orchestra.run.smithi032.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-17T02:17:29.259 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-17T02:17:29.259 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-17T02:17:29.260 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-17T02:17:29.260 INFO:teuthology.orchestra.run.smithi032.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-17T02:17:29.261 INFO:teuthology.orchestra.run.smithi032.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-17T02:17:29.261 INFO:teuthology.orchestra.run.smithi032.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-17T02:17:29.261 INFO:teuthology.orchestra.run.smithi032.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-17T02:17:29.261 INFO:teuthology.orchestra.run.smithi032.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-17T02:17:29.261 INFO:teuthology.orchestra.run.smithi032.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-17T02:17:29.261 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-17T02:17:29.261 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-17T02:17:29.261 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T02:17:29.261 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T02:17:29.261 INFO:teuthology.orchestra.run.smithi032.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T02:17:29.261 INFO:teuthology.orchestra.run.smithi032.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T02:17:29.261 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T02:17:29.261 INFO:teuthology.orchestra.run.smithi032.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T02:17:29.262 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-17T02:17:29.262 INFO:teuthology.orchestra.run.smithi032.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-17T02:17:29.262 INFO:teuthology.orchestra.run.smithi032.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-17T02:17:29.262 INFO:teuthology.orchestra.run.smithi032.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-17T02:17:29.262 INFO:teuthology.orchestra.run.smithi032.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-17T02:17:29.262 INFO:teuthology.orchestra.run.smithi032.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-17T02:17:29.262 INFO:teuthology.orchestra.run.smithi032.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-17T02:17:29.262 INFO:teuthology.orchestra.run.smithi032.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-17T02:17:29.305 INFO:teuthology.orchestra.run.smithi001.stdout:The following NEW packages will be installed: 2024-09-17T02:17:29.305 INFO:teuthology.orchestra.run.smithi001.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-17T02:17:29.305 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-17T02:17:29.305 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-17T02:17:29.307 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-17T02:17:29.307 INFO:teuthology.orchestra.run.smithi001.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-17T02:17:29.308 INFO:teuthology.orchestra.run.smithi001.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-17T02:17:29.309 INFO:teuthology.orchestra.run.smithi001.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-17T02:17:29.309 INFO:teuthology.orchestra.run.smithi001.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-17T02:17:29.309 INFO:teuthology.orchestra.run.smithi001.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-17T02:17:29.309 INFO:teuthology.orchestra.run.smithi001.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-17T02:17:29.309 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-17T02:17:29.309 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-17T02:17:29.309 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T02:17:29.309 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T02:17:29.309 INFO:teuthology.orchestra.run.smithi001.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T02:17:29.309 INFO:teuthology.orchestra.run.smithi001.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T02:17:29.309 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T02:17:29.310 INFO:teuthology.orchestra.run.smithi001.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T02:17:29.310 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-17T02:17:29.310 INFO:teuthology.orchestra.run.smithi001.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-17T02:17:29.310 INFO:teuthology.orchestra.run.smithi001.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-17T02:17:29.310 INFO:teuthology.orchestra.run.smithi001.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-17T02:17:29.310 INFO:teuthology.orchestra.run.smithi001.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-17T02:17:29.310 INFO:teuthology.orchestra.run.smithi001.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-17T02:17:29.310 INFO:teuthology.orchestra.run.smithi001.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-17T02:17:29.310 INFO:teuthology.orchestra.run.smithi001.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-17T02:17:29.319 INFO:teuthology.orchestra.run.smithi164.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-330-gc2ddf972-1jammy [3,242 kB] 2024-09-17T02:17:29.321 INFO:teuthology.orchestra.run.smithi032.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-17T02:17:29.321 INFO:teuthology.orchestra.run.smithi032.stdout:Need to get 181 MB of archives. 2024-09-17T02:17:29.322 INFO:teuthology.orchestra.run.smithi032.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-17T02:17:29.322 INFO:teuthology.orchestra.run.smithi032.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-17T02:17:29.367 INFO:teuthology.orchestra.run.smithi001.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-17T02:17:29.367 INFO:teuthology.orchestra.run.smithi001.stdout:Need to get 181 MB of archives. 2024-09-17T02:17:29.367 INFO:teuthology.orchestra.run.smithi001.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-17T02:17:29.367 INFO:teuthology.orchestra.run.smithi001.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-17T02:17:29.409 INFO:teuthology.orchestra.run.smithi032.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-17T02:17:29.412 INFO:teuthology.orchestra.run.smithi032.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-17T02:17:29.415 INFO:teuthology.orchestra.run.smithi032.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-330-gc2ddf972-1jammy [3,591 kB] 2024-09-17T02:17:29.428 INFO:teuthology.orchestra.run.smithi032.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-17T02:17:29.433 INFO:teuthology.orchestra.run.smithi153.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-330-gc2ddf972-1jammy [112 kB] 2024-09-17T02:17:29.435 INFO:teuthology.orchestra.run.smithi153.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-330-gc2ddf972-1jammy [472 kB] 2024-09-17T02:17:29.449 INFO:teuthology.orchestra.run.smithi153.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-330-gc2ddf972-1jammy [25.9 MB] 2024-09-17T02:17:29.455 INFO:teuthology.orchestra.run.smithi001.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-17T02:17:29.456 INFO:teuthology.orchestra.run.smithi164.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-330-gc2ddf972-1jammy [719 kB] 2024-09-17T02:17:29.457 INFO:teuthology.orchestra.run.smithi001.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-17T02:17:29.472 INFO:teuthology.orchestra.run.smithi001.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-330-gc2ddf972-1jammy [3,591 kB] 2024-09-17T02:17:29.474 INFO:teuthology.orchestra.run.smithi001.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-17T02:17:29.485 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-17T02:17:29.489 INFO:teuthology.orchestra.run.smithi032.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-17T02:17:29.492 INFO:teuthology.orchestra.run.smithi164.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-330-gc2ddf972-1jammy [356 kB] 2024-09-17T02:17:29.500 INFO:teuthology.orchestra.run.smithi164.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-330-gc2ddf972-1jammy [32.8 kB] 2024-09-17T02:17:29.501 INFO:teuthology.orchestra.run.smithi164.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-330-gc2ddf972-1jammy [180 kB] 2024-09-17T02:17:29.502 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-17T02:17:29.506 INFO:teuthology.orchestra.run.smithi032.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-17T02:17:29.507 INFO:teuthology.orchestra.run.smithi032.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-17T02:17:29.508 INFO:teuthology.orchestra.run.smithi032.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-17T02:17:29.510 INFO:teuthology.orchestra.run.smithi164.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-17T02:17:29.517 INFO:teuthology.orchestra.run.smithi032.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-17T02:17:29.519 INFO:teuthology.orchestra.run.smithi032.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-17T02:17:29.521 INFO:teuthology.orchestra.run.smithi164.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-330-gc2ddf972-1jammy [67.8 kB] 2024-09-17T02:17:29.521 INFO:teuthology.orchestra.run.smithi032.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-17T02:17:29.522 INFO:teuthology.orchestra.run.smithi164.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-17T02:17:29.523 INFO:teuthology.orchestra.run.smithi032.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-17T02:17:29.523 INFO:teuthology.orchestra.run.smithi164.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-330-gc2ddf972-1jammy [333 kB] 2024-09-17T02:17:29.524 INFO:teuthology.orchestra.run.smithi032.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-17T02:17:29.526 INFO:teuthology.orchestra.run.smithi032.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-17T02:17:29.532 INFO:teuthology.orchestra.run.smithi164.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-330-gc2ddf972-1jammy [6,875 kB] 2024-09-17T02:17:29.533 INFO:teuthology.orchestra.run.smithi001.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-17T02:17:29.539 INFO:teuthology.orchestra.run.smithi001.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-17T02:17:29.539 INFO:teuthology.orchestra.run.smithi032.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-17T02:17:29.541 INFO:teuthology.orchestra.run.smithi032.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-17T02:17:29.542 INFO:teuthology.orchestra.run.smithi032.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-17T02:17:29.542 INFO:teuthology.orchestra.run.smithi032.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-17T02:17:29.544 INFO:teuthology.orchestra.run.smithi032.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-17T02:17:29.551 INFO:teuthology.orchestra.run.smithi001.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-17T02:17:29.555 INFO:teuthology.orchestra.run.smithi001.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-17T02:17:29.556 INFO:teuthology.orchestra.run.smithi001.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-17T02:17:29.557 INFO:teuthology.orchestra.run.smithi001.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-17T02:17:29.560 INFO:teuthology.orchestra.run.smithi032.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-17T02:17:29.560 INFO:teuthology.orchestra.run.smithi032.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-17T02:17:29.560 INFO:teuthology.orchestra.run.smithi032.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-17T02:17:29.561 INFO:teuthology.orchestra.run.smithi032.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-17T02:17:29.561 INFO:teuthology.orchestra.run.smithi032.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-17T02:17:29.565 INFO:teuthology.orchestra.run.smithi001.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-17T02:17:29.568 INFO:teuthology.orchestra.run.smithi001.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-17T02:17:29.571 INFO:teuthology.orchestra.run.smithi001.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-17T02:17:29.572 INFO:teuthology.orchestra.run.smithi001.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-17T02:17:29.572 INFO:teuthology.orchestra.run.smithi001.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-17T02:17:29.574 INFO:teuthology.orchestra.run.smithi001.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-17T02:17:29.578 INFO:teuthology.orchestra.run.smithi032.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-17T02:17:29.580 INFO:teuthology.orchestra.run.smithi032.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-17T02:17:29.581 INFO:teuthology.orchestra.run.smithi032.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-17T02:17:29.582 INFO:teuthology.orchestra.run.smithi032.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-17T02:17:29.582 INFO:teuthology.orchestra.run.smithi032.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-17T02:17:29.589 INFO:teuthology.orchestra.run.smithi001.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-17T02:17:29.591 INFO:teuthology.orchestra.run.smithi001.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-17T02:17:29.592 INFO:teuthology.orchestra.run.smithi001.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-17T02:17:29.592 INFO:teuthology.orchestra.run.smithi001.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-17T02:17:29.593 INFO:teuthology.orchestra.run.smithi001.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-17T02:17:29.593 INFO:teuthology.orchestra.run.smithi001.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-17T02:17:29.594 INFO:teuthology.orchestra.run.smithi032.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-17T02:17:29.595 INFO:teuthology.orchestra.run.smithi032.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-17T02:17:29.595 INFO:teuthology.orchestra.run.smithi032.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-17T02:17:29.597 INFO:teuthology.orchestra.run.smithi032.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-17T02:17:29.597 INFO:teuthology.orchestra.run.smithi032.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-17T02:17:29.603 INFO:teuthology.orchestra.run.smithi164.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-17T02:17:29.606 INFO:teuthology.orchestra.run.smithi001.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-17T02:17:29.607 INFO:teuthology.orchestra.run.smithi001.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-17T02:17:29.607 INFO:teuthology.orchestra.run.smithi001.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-17T02:17:29.607 INFO:teuthology.orchestra.run.smithi001.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-17T02:17:29.611 INFO:teuthology.orchestra.run.smithi032.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-17T02:17:29.616 INFO:teuthology.orchestra.run.smithi032.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-17T02:17:29.617 INFO:teuthology.orchestra.run.smithi032.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-17T02:17:29.617 INFO:teuthology.orchestra.run.smithi032.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-17T02:17:29.618 INFO:teuthology.orchestra.run.smithi032.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-17T02:17:29.623 INFO:teuthology.orchestra.run.smithi001.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-17T02:17:29.625 INFO:teuthology.orchestra.run.smithi001.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-17T02:17:29.626 INFO:teuthology.orchestra.run.smithi001.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-17T02:17:29.626 INFO:teuthology.orchestra.run.smithi001.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-17T02:17:29.627 INFO:teuthology.orchestra.run.smithi001.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-17T02:17:29.628 INFO:teuthology.orchestra.run.smithi001.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-17T02:17:29.629 INFO:teuthology.orchestra.run.smithi032.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-17T02:17:29.630 INFO:teuthology.orchestra.run.smithi032.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-17T02:17:29.631 INFO:teuthology.orchestra.run.smithi032.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-17T02:17:29.633 INFO:teuthology.orchestra.run.smithi032.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-17T02:17:29.633 INFO:teuthology.orchestra.run.smithi032.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-17T02:17:29.640 INFO:teuthology.orchestra.run.smithi001.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-17T02:17:29.640 INFO:teuthology.orchestra.run.smithi001.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-17T02:17:29.642 INFO:teuthology.orchestra.run.smithi001.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-17T02:17:29.642 INFO:teuthology.orchestra.run.smithi001.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-17T02:17:29.645 INFO:teuthology.orchestra.run.smithi032.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-17T02:17:29.646 INFO:teuthology.orchestra.run.smithi032.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-17T02:17:29.646 INFO:teuthology.orchestra.run.smithi032.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-17T02:17:29.649 INFO:teuthology.orchestra.run.smithi032.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-17T02:17:29.657 INFO:teuthology.orchestra.run.smithi001.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-17T02:17:29.662 INFO:teuthology.orchestra.run.smithi001.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-17T02:17:29.662 INFO:teuthology.orchestra.run.smithi001.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-17T02:17:29.663 INFO:teuthology.orchestra.run.smithi001.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-17T02:17:29.664 INFO:teuthology.orchestra.run.smithi001.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-17T02:17:29.665 INFO:teuthology.orchestra.run.smithi001.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-17T02:17:29.674 INFO:teuthology.orchestra.run.smithi001.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-17T02:17:29.675 INFO:teuthology.orchestra.run.smithi001.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-17T02:17:29.676 INFO:teuthology.orchestra.run.smithi001.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-17T02:17:29.677 INFO:teuthology.orchestra.run.smithi001.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-17T02:17:29.691 INFO:teuthology.orchestra.run.smithi001.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-17T02:17:29.692 INFO:teuthology.orchestra.run.smithi001.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-17T02:17:29.692 INFO:teuthology.orchestra.run.smithi001.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-17T02:17:29.695 INFO:teuthology.orchestra.run.smithi001.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-17T02:17:29.700 INFO:teuthology.orchestra.run.smithi032.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-17T02:17:29.701 INFO:teuthology.orchestra.run.smithi032.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-17T02:17:29.703 INFO:teuthology.orchestra.run.smithi032.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-17T02:17:29.703 INFO:teuthology.orchestra.run.smithi032.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-17T02:17:29.704 INFO:teuthology.orchestra.run.smithi032.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-17T02:17:29.722 INFO:teuthology.orchestra.run.smithi032.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-17T02:17:29.724 INFO:teuthology.orchestra.run.smithi032.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-17T02:17:29.724 INFO:teuthology.orchestra.run.smithi032.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-17T02:17:29.739 INFO:teuthology.orchestra.run.smithi032.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-17T02:17:29.739 INFO:teuthology.orchestra.run.smithi032.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-17T02:17:29.739 INFO:teuthology.orchestra.run.smithi032.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-17T02:17:29.740 INFO:teuthology.orchestra.run.smithi032.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-17T02:17:29.741 INFO:teuthology.orchestra.run.smithi032.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-17T02:17:29.741 INFO:teuthology.orchestra.run.smithi032.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-17T02:17:29.748 INFO:teuthology.orchestra.run.smithi001.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-17T02:17:29.749 INFO:teuthology.orchestra.run.smithi001.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-17T02:17:29.750 INFO:teuthology.orchestra.run.smithi001.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-17T02:17:29.751 INFO:teuthology.orchestra.run.smithi001.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-17T02:17:29.752 INFO:teuthology.orchestra.run.smithi001.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-17T02:17:29.753 INFO:teuthology.orchestra.run.smithi032.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-17T02:17:29.753 INFO:teuthology.orchestra.run.smithi032.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-17T02:17:29.756 INFO:teuthology.orchestra.run.smithi032.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-17T02:17:29.770 INFO:teuthology.orchestra.run.smithi001.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-17T02:17:29.770 INFO:teuthology.orchestra.run.smithi032.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-17T02:17:29.771 INFO:teuthology.orchestra.run.smithi032.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-17T02:17:29.771 INFO:teuthology.orchestra.run.smithi001.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-17T02:17:29.772 INFO:teuthology.orchestra.run.smithi032.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-17T02:17:29.772 INFO:teuthology.orchestra.run.smithi001.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-17T02:17:29.775 INFO:teuthology.orchestra.run.smithi032.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-17T02:17:29.777 INFO:teuthology.orchestra.run.smithi032.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-17T02:17:29.778 INFO:teuthology.orchestra.run.smithi032.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-17T02:17:29.778 INFO:teuthology.orchestra.run.smithi032.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-17T02:17:29.786 INFO:teuthology.orchestra.run.smithi001.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-17T02:17:29.786 INFO:teuthology.orchestra.run.smithi001.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-17T02:17:29.787 INFO:teuthology.orchestra.run.smithi032.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-17T02:17:29.787 INFO:teuthology.orchestra.run.smithi032.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-17T02:17:29.787 INFO:teuthology.orchestra.run.smithi001.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-17T02:17:29.788 INFO:teuthology.orchestra.run.smithi001.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-17T02:17:29.788 INFO:teuthology.orchestra.run.smithi001.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-17T02:17:29.788 INFO:teuthology.orchestra.run.smithi001.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-17T02:17:29.790 INFO:teuthology.orchestra.run.smithi032.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-17T02:17:29.802 INFO:teuthology.orchestra.run.smithi001.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-17T02:17:29.803 INFO:teuthology.orchestra.run.smithi001.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-17T02:17:29.804 INFO:teuthology.orchestra.run.smithi032.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-17T02:17:29.804 INFO:teuthology.orchestra.run.smithi032.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-17T02:17:29.805 INFO:teuthology.orchestra.run.smithi032.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-17T02:17:29.806 INFO:teuthology.orchestra.run.smithi001.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-17T02:17:29.806 INFO:teuthology.orchestra.run.smithi032.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-17T02:17:29.807 INFO:teuthology.orchestra.run.smithi032.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-17T02:17:29.813 INFO:teuthology.orchestra.run.smithi032.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-17T02:17:29.813 INFO:teuthology.orchestra.run.smithi032.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-17T02:17:29.819 INFO:teuthology.orchestra.run.smithi001.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-17T02:17:29.820 INFO:teuthology.orchestra.run.smithi001.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-17T02:17:29.821 INFO:teuthology.orchestra.run.smithi032.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-17T02:17:29.821 INFO:teuthology.orchestra.run.smithi001.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-17T02:17:29.823 INFO:teuthology.orchestra.run.smithi032.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-17T02:17:29.823 INFO:teuthology.orchestra.run.smithi032.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-17T02:17:29.824 INFO:teuthology.orchestra.run.smithi001.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-17T02:17:29.826 INFO:teuthology.orchestra.run.smithi001.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-17T02:17:29.827 INFO:teuthology.orchestra.run.smithi001.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-17T02:17:29.827 INFO:teuthology.orchestra.run.smithi001.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-17T02:17:29.833 INFO:teuthology.orchestra.run.smithi164.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-17T02:17:29.836 INFO:teuthology.orchestra.run.smithi001.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-17T02:17:29.837 INFO:teuthology.orchestra.run.smithi001.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-17T02:17:29.839 INFO:teuthology.orchestra.run.smithi001.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-17T02:17:29.844 INFO:teuthology.orchestra.run.smithi164.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-17T02:17:29.853 INFO:teuthology.orchestra.run.smithi001.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-17T02:17:29.854 INFO:teuthology.orchestra.run.smithi001.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-17T02:17:29.854 INFO:teuthology.orchestra.run.smithi001.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-17T02:17:29.855 INFO:teuthology.orchestra.run.smithi001.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-17T02:17:29.856 INFO:teuthology.orchestra.run.smithi001.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-17T02:17:29.862 INFO:teuthology.orchestra.run.smithi001.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-17T02:17:29.862 INFO:teuthology.orchestra.run.smithi001.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-17T02:17:29.864 INFO:teuthology.orchestra.run.smithi164.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-330-gc2ddf972-1jammy [112 kB] 2024-09-17T02:17:29.870 INFO:teuthology.orchestra.run.smithi001.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-17T02:17:29.872 INFO:teuthology.orchestra.run.smithi001.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-17T02:17:29.872 INFO:teuthology.orchestra.run.smithi001.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-17T02:17:29.873 INFO:teuthology.orchestra.run.smithi164.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-17T02:17:29.881 INFO:teuthology.orchestra.run.smithi164.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-330-gc2ddf972-1jammy [472 kB] 2024-09-17T02:17:29.882 INFO:teuthology.orchestra.run.smithi164.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-17T02:17:29.883 INFO:teuthology.orchestra.run.smithi164.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-17T02:17:29.884 INFO:teuthology.orchestra.run.smithi164.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-17T02:17:29.902 INFO:teuthology.orchestra.run.smithi164.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-17T02:17:29.904 INFO:teuthology.orchestra.run.smithi164.stdout:Get:23 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-330-gc2ddf972-1jammy [25.9 MB] 2024-09-17T02:17:29.907 INFO:teuthology.orchestra.run.smithi164.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-17T02:17:29.911 INFO:teuthology.orchestra.run.smithi164.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-17T02:17:29.915 INFO:teuthology.orchestra.run.smithi164.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-17T02:17:29.996 INFO:teuthology.orchestra.run.smithi164.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-17T02:17:30.000 INFO:teuthology.orchestra.run.smithi164.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-17T02:17:30.004 INFO:teuthology.orchestra.run.smithi164.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-17T02:17:30.007 INFO:teuthology.orchestra.run.smithi164.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-17T02:17:30.008 INFO:teuthology.orchestra.run.smithi164.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-17T02:17:30.009 INFO:teuthology.orchestra.run.smithi164.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-17T02:17:30.011 INFO:teuthology.orchestra.run.smithi164.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-17T02:17:30.012 INFO:teuthology.orchestra.run.smithi164.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-17T02:17:30.012 INFO:teuthology.orchestra.run.smithi164.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-17T02:17:30.078 INFO:teuthology.orchestra.run.smithi164.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-17T02:17:30.095 INFO:teuthology.orchestra.run.smithi164.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-17T02:17:30.095 INFO:teuthology.orchestra.run.smithi164.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-17T02:17:30.096 INFO:teuthology.orchestra.run.smithi164.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-17T02:17:30.101 INFO:teuthology.orchestra.run.smithi164.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-17T02:17:30.103 INFO:teuthology.orchestra.run.smithi164.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-17T02:17:30.159 INFO:teuthology.orchestra.run.smithi164.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-17T02:17:30.160 INFO:teuthology.orchestra.run.smithi164.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-17T02:17:30.162 INFO:teuthology.orchestra.run.smithi164.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-17T02:17:30.163 INFO:teuthology.orchestra.run.smithi164.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-17T02:17:30.240 INFO:teuthology.orchestra.run.smithi164.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-17T02:17:30.243 INFO:teuthology.orchestra.run.smithi164.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-17T02:17:30.244 INFO:teuthology.orchestra.run.smithi164.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-17T02:17:30.245 INFO:teuthology.orchestra.run.smithi164.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-17T02:17:30.257 INFO:teuthology.orchestra.run.smithi164.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-17T02:17:30.267 INFO:teuthology.orchestra.run.smithi153.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-330-gc2ddf972-1jammy [5,145 kB] 2024-09-17T02:17:30.322 INFO:teuthology.orchestra.run.smithi164.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-17T02:17:30.323 INFO:teuthology.orchestra.run.smithi164.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-17T02:17:30.324 INFO:teuthology.orchestra.run.smithi164.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-17T02:17:30.327 INFO:teuthology.orchestra.run.smithi164.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-17T02:17:30.330 INFO:teuthology.orchestra.run.smithi164.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-17T02:17:30.365 INFO:teuthology.orchestra.run.smithi153.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-330-gc2ddf972-1jammy [245 kB] 2024-09-17T02:17:30.369 INFO:teuthology.orchestra.run.smithi153.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-330-gc2ddf972-1jammy [124 kB] 2024-09-17T02:17:30.372 INFO:teuthology.orchestra.run.smithi153.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-330-gc2ddf972-1jammy [1,555 kB] 2024-09-17T02:17:30.404 INFO:teuthology.orchestra.run.smithi164.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-17T02:17:30.406 INFO:teuthology.orchestra.run.smithi164.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-17T02:17:30.407 INFO:teuthology.orchestra.run.smithi153.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-330-gc2ddf972-1jammy [6,143 kB] 2024-09-17T02:17:30.407 INFO:teuthology.orchestra.run.smithi164.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-17T02:17:30.412 INFO:teuthology.orchestra.run.smithi164.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-17T02:17:30.414 INFO:teuthology.orchestra.run.smithi164.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-17T02:17:30.485 INFO:teuthology.orchestra.run.smithi164.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-17T02:17:30.490 INFO:teuthology.orchestra.run.smithi164.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-17T02:17:30.654 INFO:teuthology.orchestra.run.smithi164.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-17T02:17:30.655 INFO:teuthology.orchestra.run.smithi164.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-17T02:17:30.657 INFO:teuthology.orchestra.run.smithi153.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-330-gc2ddf972-1jammy [22.8 MB] 2024-09-17T02:17:30.658 INFO:teuthology.orchestra.run.smithi164.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-17T02:17:30.714 INFO:teuthology.orchestra.run.smithi032.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-330-gc2ddf972-1jammy [3,242 kB] 2024-09-17T02:17:30.819 INFO:teuthology.orchestra.run.smithi001.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-330-gc2ddf972-1jammy [3,242 kB] 2024-09-17T02:17:30.823 INFO:teuthology.orchestra.run.smithi164.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-17T02:17:31.073 INFO:teuthology.orchestra.run.smithi164.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-17T02:17:31.188 INFO:teuthology.orchestra.run.smithi164.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-330-gc2ddf972-1jammy [5,145 kB] 2024-09-17T02:17:31.366 INFO:teuthology.orchestra.run.smithi164.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-330-gc2ddf972-1jammy [245 kB] 2024-09-17T02:17:31.367 INFO:teuthology.orchestra.run.smithi153.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-330-gc2ddf972-1jammy [14.1 kB] 2024-09-17T02:17:31.367 INFO:teuthology.orchestra.run.smithi153.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-330-gc2ddf972-1jammy [877 kB] 2024-09-17T02:17:31.384 INFO:teuthology.orchestra.run.smithi153.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-330-gc2ddf972-1jammy [2,462 kB] 2024-09-17T02:17:31.389 INFO:teuthology.orchestra.run.smithi164.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-330-gc2ddf972-1jammy [124 kB] 2024-09-17T02:17:31.392 INFO:teuthology.orchestra.run.smithi164.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-330-gc2ddf972-1jammy [1,555 kB] 2024-09-17T02:17:31.425 INFO:teuthology.orchestra.run.smithi153.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-330-gc2ddf972-1jammy [794 kB] 2024-09-17T02:17:31.435 INFO:teuthology.orchestra.run.smithi153.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-330-gc2ddf972-1jammy [152 kB] 2024-09-17T02:17:31.437 INFO:teuthology.orchestra.run.smithi153.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-330-gc2ddf972-1jammy [2,275 kB] 2024-09-17T02:17:31.450 INFO:teuthology.orchestra.run.smithi164.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-17T02:17:31.460 INFO:teuthology.orchestra.run.smithi164.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-17T02:17:31.461 INFO:teuthology.orchestra.run.smithi164.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-17T02:17:31.468 INFO:teuthology.orchestra.run.smithi164.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-330-gc2ddf972-1jammy [6,143 kB] 2024-09-17T02:17:31.475 INFO:teuthology.orchestra.run.smithi032.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-330-gc2ddf972-1jammy [719 kB] 2024-09-17T02:17:31.497 INFO:teuthology.orchestra.run.smithi153.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-330-gc2ddf972-1jammy [8,625 kB] 2024-09-17T02:17:31.530 INFO:teuthology.orchestra.run.smithi164.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-17T02:17:31.530 INFO:teuthology.orchestra.run.smithi164.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-17T02:17:31.532 INFO:teuthology.orchestra.run.smithi164.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-17T02:17:31.534 INFO:teuthology.orchestra.run.smithi164.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-17T02:17:31.535 INFO:teuthology.orchestra.run.smithi164.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-17T02:17:31.536 INFO:teuthology.orchestra.run.smithi164.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-17T02:17:31.537 INFO:teuthology.orchestra.run.smithi164.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-17T02:17:31.615 INFO:teuthology.orchestra.run.smithi164.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-17T02:17:31.621 INFO:teuthology.orchestra.run.smithi001.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-330-gc2ddf972-1jammy [719 kB] 2024-09-17T02:17:31.623 INFO:teuthology.orchestra.run.smithi164.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-17T02:17:31.627 INFO:teuthology.orchestra.run.smithi164.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-17T02:17:31.671 INFO:teuthology.orchestra.run.smithi032.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-330-gc2ddf972-1jammy [356 kB] 2024-09-17T02:17:31.696 INFO:teuthology.orchestra.run.smithi164.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-17T02:17:31.698 INFO:teuthology.orchestra.run.smithi164.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-17T02:17:31.706 INFO:teuthology.orchestra.run.smithi164.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-17T02:17:31.713 INFO:teuthology.orchestra.run.smithi164.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-17T02:17:31.715 INFO:teuthology.orchestra.run.smithi164.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-17T02:17:31.716 INFO:teuthology.orchestra.run.smithi164.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-17T02:17:31.726 INFO:teuthology.orchestra.run.smithi032.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-330-gc2ddf972-1jammy [32.8 kB] 2024-09-17T02:17:31.727 INFO:teuthology.orchestra.run.smithi164.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-17T02:17:31.753 INFO:teuthology.orchestra.run.smithi153.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-330-gc2ddf972-1jammy [14.2 kB] 2024-09-17T02:17:31.753 INFO:teuthology.orchestra.run.smithi153.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-330-gc2ddf972-1jammy [51.4 MB] 2024-09-17T02:17:31.773 INFO:teuthology.orchestra.run.smithi032.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-330-gc2ddf972-1jammy [180 kB] 2024-09-17T02:17:31.777 INFO:teuthology.orchestra.run.smithi032.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-330-gc2ddf972-1jammy [67.8 kB] 2024-09-17T02:17:31.778 INFO:teuthology.orchestra.run.smithi164.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-17T02:17:31.784 INFO:teuthology.orchestra.run.smithi164.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-330-gc2ddf972-1jammy [22.8 MB] 2024-09-17T02:17:31.786 INFO:teuthology.orchestra.run.smithi164.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-17T02:17:31.786 INFO:teuthology.orchestra.run.smithi164.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-17T02:17:31.823 INFO:teuthology.orchestra.run.smithi001.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-330-gc2ddf972-1jammy [356 kB] 2024-09-17T02:17:31.825 INFO:teuthology.orchestra.run.smithi032.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-330-gc2ddf972-1jammy [333 kB] 2024-09-17T02:17:31.859 INFO:teuthology.orchestra.run.smithi164.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-17T02:17:31.860 INFO:teuthology.orchestra.run.smithi164.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-17T02:17:31.864 INFO:teuthology.orchestra.run.smithi164.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-17T02:17:31.866 INFO:teuthology.orchestra.run.smithi164.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-17T02:17:31.881 INFO:teuthology.orchestra.run.smithi032.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-330-gc2ddf972-1jammy [6,875 kB] 2024-09-17T02:17:31.883 INFO:teuthology.orchestra.run.smithi164.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-17T02:17:31.884 INFO:teuthology.orchestra.run.smithi164.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-17T02:17:31.885 INFO:teuthology.orchestra.run.smithi164.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-17T02:17:31.927 INFO:teuthology.orchestra.run.smithi001.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-330-gc2ddf972-1jammy [32.8 kB] 2024-09-17T02:17:31.929 INFO:teuthology.orchestra.run.smithi001.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-330-gc2ddf972-1jammy [180 kB] 2024-09-17T02:17:31.941 INFO:teuthology.orchestra.run.smithi164.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-17T02:17:31.942 INFO:teuthology.orchestra.run.smithi164.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-17T02:17:31.981 INFO:teuthology.orchestra.run.smithi001.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-330-gc2ddf972-1jammy [67.8 kB] 2024-09-17T02:17:31.983 INFO:teuthology.orchestra.run.smithi001.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-330-gc2ddf972-1jammy [333 kB] 2024-09-17T02:17:32.088 INFO:teuthology.orchestra.run.smithi001.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-330-gc2ddf972-1jammy [6,875 kB] 2024-09-17T02:17:33.016 INFO:teuthology.orchestra.run.smithi164.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-330-gc2ddf972-1jammy [14.1 kB] 2024-09-17T02:17:33.016 INFO:teuthology.orchestra.run.smithi164.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-330-gc2ddf972-1jammy [877 kB] 2024-09-17T02:17:33.033 INFO:teuthology.orchestra.run.smithi164.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-330-gc2ddf972-1jammy [2,462 kB] 2024-09-17T02:17:33.117 INFO:teuthology.orchestra.run.smithi164.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-330-gc2ddf972-1jammy [794 kB] 2024-09-17T02:17:33.141 INFO:teuthology.orchestra.run.smithi164.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-330-gc2ddf972-1jammy [152 kB] 2024-09-17T02:17:33.172 INFO:teuthology.orchestra.run.smithi164.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-330-gc2ddf972-1jammy [2,275 kB] 2024-09-17T02:17:33.264 INFO:teuthology.orchestra.run.smithi164.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-330-gc2ddf972-1jammy [8,625 kB] 2024-09-17T02:17:33.513 INFO:teuthology.orchestra.run.smithi153.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-330-gc2ddf972-1jammy [130 kB] 2024-09-17T02:17:33.516 INFO:teuthology.orchestra.run.smithi153.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-330-gc2ddf972-1jammy [39.0 kB] 2024-09-17T02:17:33.517 INFO:teuthology.orchestra.run.smithi153.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-330-gc2ddf972-1jammy [13.6 MB] 2024-09-17T02:17:33.520 INFO:teuthology.orchestra.run.smithi164.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-330-gc2ddf972-1jammy [14.2 kB] 2024-09-17T02:17:33.520 INFO:teuthology.orchestra.run.smithi164.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-330-gc2ddf972-1jammy [51.4 MB] 2024-09-17T02:17:33.563 INFO:teuthology.orchestra.run.smithi032.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-330-gc2ddf972-1jammy [112 kB] 2024-09-17T02:17:33.576 INFO:teuthology.orchestra.run.smithi032.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-330-gc2ddf972-1jammy [472 kB] 2024-09-17T02:17:33.704 INFO:teuthology.orchestra.run.smithi032.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-330-gc2ddf972-1jammy [25.9 MB] 2024-09-17T02:17:33.816 INFO:teuthology.orchestra.run.smithi001.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-330-gc2ddf972-1jammy [112 kB] 2024-09-17T02:17:33.855 INFO:teuthology.orchestra.run.smithi153.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-330-gc2ddf972-1jammy [91.4 kB] 2024-09-17T02:17:33.860 INFO:teuthology.orchestra.run.smithi001.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-330-gc2ddf972-1jammy [472 kB] 2024-09-17T02:17:33.921 INFO:teuthology.orchestra.run.smithi001.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-330-gc2ddf972-1jammy [25.9 MB] 2024-09-17T02:17:34.433 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 181 MB in 5s (34.9 MB/s) 2024-09-17T02:17:34.566 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-17T02:17:34.652 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-17T02:17:34.657 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-17T02:17:34.740 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T02:17:35.027 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-17T02:17:35.053 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-17T02:17:35.071 INFO:teuthology.orchestra.run.smithi164.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-330-gc2ddf972-1jammy [130 kB] 2024-09-17T02:17:35.079 INFO:teuthology.orchestra.run.smithi164.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-330-gc2ddf972-1jammy [39.0 kB] 2024-09-17T02:17:35.082 INFO:teuthology.orchestra.run.smithi164.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-330-gc2ddf972-1jammy [13.6 MB] 2024-09-17T02:17:35.085 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T02:17:35.314 INFO:teuthology.orchestra.run.smithi164.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-330-gc2ddf972-1jammy [91.4 kB] 2024-09-17T02:17:35.421 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-17T02:17:35.447 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-17T02:17:35.488 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T02:17:35.868 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-17T02:17:35.889 INFO:teuthology.orchestra.run.smithi164.stdout:Fetched 181 MB in 6s (28.3 MB/s) 2024-09-17T02:17:35.894 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T02:17:35.936 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T02:17:36.055 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-17T02:17:36.152 INFO:teuthology.orchestra.run.smithi164.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-17T02:17:36.157 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-17T02:17:36.237 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T02:17:36.355 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-17T02:17:36.381 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T02:17:36.421 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T02:17:36.453 INFO:teuthology.orchestra.run.smithi032.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-330-gc2ddf972-1jammy [5,145 kB] 2024-09-17T02:17:36.591 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-17T02:17:36.617 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-17T02:17:36.618 INFO:teuthology.orchestra.run.smithi001.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-330-gc2ddf972-1jammy [5,145 kB] 2024-09-17T02:17:36.658 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T02:17:36.791 INFO:teuthology.orchestra.run.smithi032.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-330-gc2ddf972-1jammy [245 kB] 2024-09-17T02:17:36.808 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-17T02:17:36.809 INFO:teuthology.orchestra.run.smithi032.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-330-gc2ddf972-1jammy [124 kB] 2024-09-17T02:17:36.813 INFO:teuthology.orchestra.run.smithi032.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-330-gc2ddf972-1jammy [1,555 kB] 2024-09-17T02:17:36.834 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T02:17:36.874 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T02:17:36.918 INFO:teuthology.orchestra.run.smithi032.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-330-gc2ddf972-1jammy [6,143 kB] 2024-09-17T02:17:36.957 INFO:teuthology.orchestra.run.smithi001.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-330-gc2ddf972-1jammy [245 kB] 2024-09-17T02:17:36.976 INFO:teuthology.orchestra.run.smithi001.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-330-gc2ddf972-1jammy [124 kB] 2024-09-17T02:17:36.979 INFO:teuthology.orchestra.run.smithi001.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-330-gc2ddf972-1jammy [1,555 kB] 2024-09-17T02:17:36.994 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-17T02:17:37.020 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-17T02:17:37.077 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T02:17:37.098 INFO:teuthology.orchestra.run.smithi001.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-330-gc2ddf972-1jammy [6,143 kB] 2024-09-17T02:17:37.331 INFO:teuthology.orchestra.run.smithi032.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-330-gc2ddf972-1jammy [22.8 MB] 2024-09-17T02:17:37.357 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-17T02:17:37.383 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-17T02:17:37.460 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T02:17:37.464 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-17T02:17:37.490 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T02:17:37.515 INFO:teuthology.orchestra.run.smithi001.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-330-gc2ddf972-1jammy [22.8 MB] 2024-09-17T02:17:37.538 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T02:17:37.772 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librados2. 2024-09-17T02:17:37.798 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../007-librados2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:37.838 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librados2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:37.959 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-17T02:17:37.985 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T02:17:38.025 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T02:17:38.308 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librbd1. 2024-09-17T02:17:38.334 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../008-librbd1_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:38.374 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librbd1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:38.378 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-17T02:17:38.404 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T02:17:38.445 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T02:17:38.781 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-17T02:17:38.807 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-17T02:17:38.819 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcephfs2. 2024-09-17T02:17:38.836 INFO:teuthology.orchestra.run.smithi032.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-330-gc2ddf972-1jammy [14.1 kB] 2024-09-17T02:17:38.837 INFO:teuthology.orchestra.run.smithi032.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-330-gc2ddf972-1jammy [877 kB] 2024-09-17T02:17:38.845 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:38.848 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T02:17:38.860 INFO:teuthology.orchestra.run.smithi032.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-330-gc2ddf972-1jammy [2,462 kB] 2024-09-17T02:17:38.877 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcephfs2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:39.004 INFO:teuthology.orchestra.run.smithi032.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-330-gc2ddf972-1jammy [794 kB] 2024-09-17T02:17:39.038 INFO:teuthology.orchestra.run.smithi001.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-330-gc2ddf972-1jammy [14.1 kB] 2024-09-17T02:17:39.039 INFO:teuthology.orchestra.run.smithi001.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-330-gc2ddf972-1jammy [877 kB] 2024-09-17T02:17:39.045 INFO:teuthology.orchestra.run.smithi032.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-330-gc2ddf972-1jammy [152 kB] 2024-09-17T02:17:39.049 INFO:teuthology.orchestra.run.smithi032.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-330-gc2ddf972-1jammy [2,275 kB] 2024-09-17T02:17:39.062 INFO:teuthology.orchestra.run.smithi001.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-330-gc2ddf972-1jammy [2,462 kB] 2024-09-17T02:17:39.168 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package librados2. 2024-09-17T02:17:39.171 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rados. 2024-09-17T02:17:39.175 INFO:teuthology.orchestra.run.smithi032.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-330-gc2ddf972-1jammy [8,625 kB] 2024-09-17T02:17:39.194 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../007-librados2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:39.197 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../010-python3-rados_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:39.206 INFO:teuthology.orchestra.run.smithi001.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-330-gc2ddf972-1jammy [794 kB] 2024-09-17T02:17:39.234 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking librados2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:39.237 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rados (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:39.249 INFO:teuthology.orchestra.run.smithi001.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-330-gc2ddf972-1jammy [152 kB] 2024-09-17T02:17:39.253 INFO:teuthology.orchestra.run.smithi001.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-330-gc2ddf972-1jammy [2,275 kB] 2024-09-17T02:17:39.379 INFO:teuthology.orchestra.run.smithi001.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-330-gc2ddf972-1jammy [8,625 kB] 2024-09-17T02:17:39.598 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-17T02:17:39.625 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:17:39.650 INFO:teuthology.orchestra.run.smithi032.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-330-gc2ddf972-1jammy [14.2 kB] 2024-09-17T02:17:39.650 INFO:teuthology.orchestra.run.smithi032.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-330-gc2ddf972-1jammy [51.4 MB] 2024-09-17T02:17:39.673 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-ceph-argparse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:39.687 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package librbd1. 2024-09-17T02:17:39.713 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../008-librbd1_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:39.753 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking librbd1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:39.858 INFO:teuthology.orchestra.run.smithi001.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-330-gc2ddf972-1jammy [14.2 kB] 2024-09-17T02:17:39.858 INFO:teuthology.orchestra.run.smithi001.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-330-gc2ddf972-1jammy [51.4 MB] 2024-09-17T02:17:39.918 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cephfs. 2024-09-17T02:17:39.933 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:39.967 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cephfs (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:40.262 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-17T02:17:40.288 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:17:40.328 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:40.490 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libcephfs2. 2024-09-17T02:17:40.516 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:40.556 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libcephfs2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:40.656 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-17T02:17:40.682 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-17T02:17:40.723 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T02:17:40.842 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-rados. 2024-09-17T02:17:40.869 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../010-python3-rados_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:40.908 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-rados (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:41.017 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-prettytable. 2024-09-17T02:17:41.043 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-17T02:17:41.075 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-17T02:17:41.236 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-17T02:17:41.262 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:17:41.303 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-ceph-argparse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:41.328 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rbd. 2024-09-17T02:17:41.343 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:41.386 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rbd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:41.530 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-cephfs. 2024-09-17T02:17:41.545 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:41.597 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-cephfs (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:41.739 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-17T02:17:41.765 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-17T02:17:41.805 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T02:17:41.925 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-17T02:17:41.951 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:17:41.991 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:42.092 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-17T02:17:42.118 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-17T02:17:42.158 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T02:17:42.319 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-17T02:17:42.346 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-17T02:17:42.386 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T02:17:42.391 INFO:teuthology.orchestra.run.smithi032.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-330-gc2ddf972-1jammy [130 kB] 2024-09-17T02:17:42.393 INFO:teuthology.orchestra.run.smithi032.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-330-gc2ddf972-1jammy [39.0 kB] 2024-09-17T02:17:42.395 INFO:teuthology.orchestra.run.smithi032.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-330-gc2ddf972-1jammy [13.6 MB] 2024-09-17T02:17:42.461 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-17T02:17:42.476 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-17T02:17:42.519 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T02:17:42.574 INFO:teuthology.orchestra.run.smithi001.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-330-gc2ddf972-1jammy [130 kB] 2024-09-17T02:17:42.577 INFO:teuthology.orchestra.run.smithi001.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-330-gc2ddf972-1jammy [39.0 kB] 2024-09-17T02:17:42.578 INFO:teuthology.orchestra.run.smithi001.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-330-gc2ddf972-1jammy [13.6 MB] 2024-09-17T02:17:42.714 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-prettytable. 2024-09-17T02:17:42.741 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-17T02:17:42.789 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-17T02:17:42.881 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package lua5.1. 2024-09-17T02:17:42.886 INFO:teuthology.orchestra.run.smithi032.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-330-gc2ddf972-1jammy [91.4 kB] 2024-09-17T02:17:42.907 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-17T02:17:42.947 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-17T02:17:43.033 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-rbd. 2024-09-17T02:17:43.056 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:43.089 INFO:teuthology.orchestra.run.smithi001.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-330-gc2ddf972-1jammy [91.4 kB] 2024-09-17T02:17:43.091 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-rbd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:43.276 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package lua-any. 2024-09-17T02:17:43.301 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-17T02:17:43.342 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-17T02:17:43.419 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-17T02:17:43.445 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-17T02:17:43.449 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 181 MB in 14s (13.3 MB/s) 2024-09-17T02:17:43.485 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T02:17:43.544 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package zip. 2024-09-17T02:17:43.559 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-17T02:17:43.602 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking zip (3.0-12build2) ... 2024-09-17T02:17:43.610 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-17T02:17:43.699 INFO:teuthology.orchestra.run.smithi001.stdout:Fetched 181 MB in 14s (13.1 MB/s) 2024-09-17T02:17:43.713 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-17T02:17:43.718 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-17T02:17:43.763 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-17T02:17:43.778 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-17T02:17:43.800 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T02:17:43.821 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T02:17:43.899 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-17T02:17:43.922 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package unzip. 2024-09-17T02:17:43.948 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-17T02:17:43.988 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-17T02:17:43.999 INFO:teuthology.orchestra.run.smithi001.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-17T02:17:44.005 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-17T02:17:44.089 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T02:17:44.091 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-17T02:17:44.106 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-17T02:17:44.141 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T02:17:44.145 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-17T02:17:44.172 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-17T02:17:44.212 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T02:17:44.376 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package luarocks. 2024-09-17T02:17:44.402 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-17T02:17:44.434 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-17T02:17:44.434 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-17T02:17:44.461 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-17T02:17:44.473 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-17T02:17:44.477 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package lua5.1. 2024-09-17T02:17:44.497 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-17T02:17:44.501 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T02:17:44.504 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-17T02:17:44.531 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T02:17:44.544 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-17T02:17:44.783 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librgw2. 2024-09-17T02:17:44.809 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../025-librgw2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:44.841 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librgw2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:44.846 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-17T02:17:44.863 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package lua-any. 2024-09-17T02:17:44.873 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-17T02:17:44.889 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-17T02:17:44.912 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T02:17:44.930 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-17T02:17:44.968 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-17T02:17:44.995 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T02:17:45.043 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T02:17:45.166 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package zip. 2024-09-17T02:17:45.181 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-17T02:17:45.216 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking zip (3.0-12build2) ... 2024-09-17T02:17:45.283 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-17T02:17:45.310 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T02:17:45.344 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rgw. 2024-09-17T02:17:45.358 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T02:17:45.359 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:45.402 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:45.452 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package unzip. 2024-09-17T02:17:45.467 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-17T02:17:45.471 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-17T02:17:45.498 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T02:17:45.540 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T02:17:45.582 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-17T02:17:45.763 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-17T02:17:45.777 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-17T02:17:45.789 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-17T02:17:45.804 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T02:17:45.830 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T02:17:45.840 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-17T02:17:45.844 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T02:17:45.867 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T02:17:45.898 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T02:17:45.998 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package luarocks. 2024-09-17T02:17:46.024 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-17T02:17:46.056 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-17T02:17:46.141 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libradosstriper1. 2024-09-17T02:17:46.167 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:46.197 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-17T02:17:46.216 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libradosstriper1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:46.224 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T02:17:46.226 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-17T02:17:46.253 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-17T02:17:46.263 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T02:17:46.293 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T02:17:46.413 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package librgw2. 2024-09-17T02:17:46.440 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../025-librgw2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:46.480 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking librgw2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:46.569 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-common. 2024-09-17T02:17:46.591 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-17T02:17:46.595 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../029-ceph-common_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:46.619 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-17T02:17:46.627 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:46.629 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librados2. 2024-09-17T02:17:46.656 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../007-librados2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:46.658 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T02:17:46.696 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librados2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:46.978 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package librados2. 2024-09-17T02:17:47.005 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../007-librados2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:47.041 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-rgw. 2024-09-17T02:17:47.044 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking librados2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:47.067 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:47.107 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-rgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:47.148 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librbd1. 2024-09-17T02:17:47.175 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../008-librbd1_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:47.215 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librbd1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:47.444 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-17T02:17:47.470 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-17T02:17:47.510 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T02:17:47.514 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package librbd1. 2024-09-17T02:17:47.540 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../008-librbd1_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:47.580 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking librbd1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:47.584 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libcephfs2. 2024-09-17T02:17:47.600 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:47.634 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libcephfs2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:47.771 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libradosstriper1. 2024-09-17T02:17:47.786 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:47.821 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libradosstriper1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:47.912 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rados. 2024-09-17T02:17:47.928 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../010-python3-rados_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:47.970 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rados (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:48.016 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libcephfs2. 2024-09-17T02:17:48.043 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:48.083 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libcephfs2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:48.190 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-base. 2024-09-17T02:17:48.217 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../030-ceph-base_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:48.250 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-common. 2024-09-17T02:17:48.266 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-base (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:48.276 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../029-ceph-common_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:48.297 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-17T02:17:48.316 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:48.324 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:17:48.352 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-rados. 2024-09-17T02:17:48.364 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-ceph-argparse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:48.368 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../010-python3-rados_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:48.402 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-rados (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:48.600 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cephfs. 2024-09-17T02:17:48.616 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:48.658 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cephfs (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:48.853 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-17T02:17:48.855 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-17T02:17:48.879 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-17T02:17:48.882 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:17:48.919 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-17T02:17:48.922 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-ceph-argparse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:48.935 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-17T02:17:48.962 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:17:49.002 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:49.174 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-cephfs. 2024-09-17T02:17:49.190 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:49.214 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cheroot. 2024-09-17T02:17:49.232 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-cephfs (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:49.240 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-17T02:17:49.280 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T02:17:49.313 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-17T02:17:49.340 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-17T02:17:49.380 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T02:17:49.552 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-17T02:17:49.578 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:17:49.618 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:49.625 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-17T02:17:49.651 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-17T02:17:49.663 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-base. 2024-09-17T02:17:49.689 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../030-ceph-base_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:49.691 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-17T02:17:49.708 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-prettytable. 2024-09-17T02:17:49.734 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-17T02:17:49.739 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-base (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:49.774 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-17T02:17:49.882 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-17T02:17:49.908 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-17T02:17:49.940 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T02:17:49.994 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-17T02:17:50.021 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-17T02:17:50.035 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rbd. 2024-09-17T02:17:50.051 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:50.061 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-17T02:17:50.085 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rbd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:50.268 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-prettytable. 2024-09-17T02:17:50.294 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-17T02:17:50.334 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-17T02:17:50.334 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-17T02:17:50.338 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-17T02:17:50.361 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-17T02:17:50.365 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-17T02:17:50.379 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-17T02:17:50.395 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-17T02:17:50.400 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-17T02:17:50.405 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-17T02:17:50.438 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T02:17:50.637 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-rbd. 2024-09-17T02:17:50.658 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-tempora. 2024-09-17T02:17:50.663 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:50.684 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-17T02:17:50.703 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-cheroot. 2024-09-17T02:17:50.703 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-rbd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:50.715 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-17T02:17:50.724 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-17T02:17:50.730 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-17T02:17:50.731 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-17T02:17:50.770 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T02:17:50.773 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T02:17:51.023 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-17T02:17:51.027 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-portend. 2024-09-17T02:17:51.050 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-17T02:17:51.053 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-17T02:17:51.056 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-17T02:17:51.082 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-17T02:17:51.084 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-17T02:17:51.089 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T02:17:51.094 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-17T02:17:51.112 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-17T02:17:51.122 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-17T02:17:51.151 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T02:17:51.342 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-17T02:17:51.358 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-17T02:17:51.396 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-17T02:17:51.400 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T02:17:51.423 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-17T02:17:51.442 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-17T02:17:51.446 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package lua5.1. 2024-09-17T02:17:51.463 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-17T02:17:51.469 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-17T02:17:51.473 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-17T02:17:51.508 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-17T02:17:51.512 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-17T02:17:51.703 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-17T02:17:51.719 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-17T02:17:51.724 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-17T02:17:51.739 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-17T02:17:51.761 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T02:17:51.782 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-17T02:17:51.807 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package lua-any. 2024-09-17T02:17:51.811 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-17T02:17:51.834 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-17T02:17:51.838 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-17T02:17:51.873 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-17T02:17:51.878 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-17T02:17:52.106 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package lua5.1. 2024-09-17T02:17:52.117 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package zip. 2024-09-17T02:17:52.119 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-natsort. 2024-09-17T02:17:52.130 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-tempora. 2024-09-17T02:17:52.133 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-17T02:17:52.134 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-17T02:17:52.145 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-17T02:17:52.157 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-17T02:17:52.173 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-17T02:17:52.176 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking zip (3.0-12build2) ... 2024-09-17T02:17:52.186 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-17T02:17:52.189 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-17T02:17:52.497 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-logutils. 2024-09-17T02:17:52.500 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-portend. 2024-09-17T02:17:52.513 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package unzip. 2024-09-17T02:17:52.523 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-17T02:17:52.527 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-17T02:17:52.540 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-17T02:17:52.563 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-17T02:17:52.566 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-17T02:17:52.579 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-17T02:17:52.693 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package lua-any. 2024-09-17T02:17:52.720 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-17T02:17:52.768 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-17T02:17:52.869 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-17T02:17:52.892 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-17T02:17:52.896 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-17T02:17:52.918 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-17T02:17:52.941 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package luarocks. 2024-09-17T02:17:52.944 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-17T02:17:52.957 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-17T02:17:52.958 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-17T02:17:52.991 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-17T02:17:53.012 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package zip. 2024-09-17T02:17:53.039 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-17T02:17:53.078 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking zip (3.0-12build2) ... 2024-09-17T02:17:53.219 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-mako. 2024-09-17T02:17:53.222 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-17T02:17:53.234 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-17T02:17:53.248 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-17T02:17:53.269 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T02:17:53.288 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-17T02:17:53.348 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librgw2. 2024-09-17T02:17:53.375 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../025-librgw2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:53.399 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package unzip. 2024-09-17T02:17:53.414 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librgw2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:53.426 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-17T02:17:53.465 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-17T02:17:53.530 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-17T02:17:53.557 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-17T02:17:53.634 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-natsort. 2024-09-17T02:17:53.660 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-17T02:17:53.700 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-17T02:17:53.797 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-17T02:17:53.967 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rgw. 2024-09-17T02:17:53.983 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:53.986 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package luarocks. 2024-09-17T02:17:54.013 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-17T02:17:54.025 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:54.037 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-logutils. 2024-09-17T02:17:54.052 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-17T02:17:54.064 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-17T02:17:54.103 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-17T02:17:54.242 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-17T02:17:54.268 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-17T02:17:54.309 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-17T02:17:54.370 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-17T02:17:54.373 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-17T02:17:54.376 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package librgw2. 2024-09-17T02:17:54.397 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-17T02:17:54.400 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-17T02:17:54.404 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../025-librgw2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:54.431 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-17T02:17:54.436 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T02:17:54.443 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking librgw2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:54.611 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-webob. 2024-09-17T02:17:54.637 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-17T02:17:54.678 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T02:17:54.714 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libradosstriper1. 2024-09-17T02:17:54.717 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-mako. 2024-09-17T02:17:54.740 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:54.744 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-17T02:17:54.772 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libradosstriper1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:54.784 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T02:17:54.995 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-rgw. 2024-09-17T02:17:55.014 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-waitress. 2024-09-17T02:17:55.022 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:55.040 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-17T02:17:55.062 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-rgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:55.084 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T02:17:55.112 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-17T02:17:55.138 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-17T02:17:55.178 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-17T02:17:55.209 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-common. 2024-09-17T02:17:55.236 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../029-ceph-common_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:55.275 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:55.342 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-tempita. 2024-09-17T02:17:55.368 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-17T02:17:55.400 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T02:17:55.406 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-17T02:17:55.434 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-17T02:17:55.473 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T02:17:55.498 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-17T02:17:55.519 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-17T02:17:55.556 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-17T02:17:55.678 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-paste. 2024-09-17T02:17:55.704 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-17T02:17:55.744 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T02:17:55.768 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libradosstriper1. 2024-09-17T02:17:55.790 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:55.834 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libradosstriper1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:56.034 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-webob. 2024-09-17T02:17:56.047 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-17T02:17:56.060 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-17T02:17:56.062 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-17T02:17:56.092 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T02:17:56.097 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T02:17:56.221 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-common. 2024-09-17T02:17:56.247 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../029-ceph-common_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:56.287 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:56.387 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-waitress. 2024-09-17T02:17:56.408 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-17T02:17:56.413 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-17T02:17:56.434 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-17T02:17:56.448 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T02:17:56.475 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-17T02:17:56.778 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-webtest. 2024-09-17T02:17:56.804 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-17T02:17:56.844 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-17T02:17:56.964 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-base. 2024-09-17T02:17:56.991 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../030-ceph-base_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:57.040 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-base (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:57.156 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pecan. 2024-09-17T02:17:57.182 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-17T02:17:57.222 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T02:17:57.316 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-tempita. 2024-09-17T02:17:57.342 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-17T02:17:57.382 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T02:17:57.593 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-certifi. 2024-09-17T02:17:57.620 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-17T02:17:57.651 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-17T02:17:57.660 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-17T02:17:57.667 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-base. 2024-09-17T02:17:57.678 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-17T02:17:57.685 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-paste. 2024-09-17T02:17:57.694 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../030-ceph-base_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:17:57.712 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-17T02:17:57.718 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-17T02:17:57.735 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-base (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:17:57.751 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T02:17:57.962 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-idna. 2024-09-17T02:17:57.978 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-17T02:17:58.012 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T02:17:58.020 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cheroot. 2024-09-17T02:17:58.048 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-17T02:17:58.062 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-17T02:17:58.089 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-17T02:17:58.095 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T02:17:58.129 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T02:17:58.290 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-urllib3. 2024-09-17T02:17:58.316 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-17T02:17:58.356 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T02:17:58.432 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-17T02:17:58.455 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-17T02:17:58.459 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-17T02:17:58.483 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-17T02:17:58.498 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-17T02:17:58.522 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-17T02:17:58.615 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-17T02:17:58.642 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-17T02:17:58.651 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-requests. 2024-09-17T02:17:58.678 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-17T02:17:58.681 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-17T02:17:58.718 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T02:17:58.802 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-webtest. 2024-09-17T02:17:58.828 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-17T02:17:58.850 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-cheroot. 2024-09-17T02:17:58.868 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-17T02:17:58.879 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-17T02:17:58.984 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-17T02:17:59.011 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-17T02:17:59.051 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-17T02:17:59.083 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T02:17:59.137 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pecan. 2024-09-17T02:17:59.153 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-17T02:17:59.187 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T02:17:59.370 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-17T02:17:59.397 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-17T02:17:59.437 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-17T02:17:59.492 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-certifi. 2024-09-17T02:17:59.507 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-17T02:17:59.542 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-17T02:17:59.569 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-17T02:17:59.597 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-17T02:17:59.636 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-17T02:17:59.706 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-tempora. 2024-09-17T02:17:59.733 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-17T02:17:59.764 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-17T02:17:59.780 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-17T02:17:59.807 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-17T02:17:59.895 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-idna. 2024-09-17T02:17:59.897 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-17T02:17:59.921 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-17T02:17:59.924 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-17T02:17:59.954 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T02:17:59.955 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-17T02:17:59.961 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T02:18:00.034 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-portend. 2024-09-17T02:18:00.061 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-17T02:18:00.092 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-17T02:18:00.256 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-urllib3. 2024-09-17T02:18:00.258 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-17T02:18:00.274 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-17T02:18:00.283 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-17T02:18:00.285 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-17T02:18:00.289 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:18:00.322 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T02:18:00.332 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-modules-core (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:00.341 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-17T02:18:00.395 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-17T02:18:00.421 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-17T02:18:00.461 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-17T02:18:00.625 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-requests. 2024-09-17T02:18:00.641 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-17T02:18:00.644 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-tempora. 2024-09-17T02:18:00.671 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-17T02:18:00.676 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T02:18:00.687 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-17T02:18:00.711 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-17T02:18:00.713 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:00.753 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:00.764 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-17T02:18:00.791 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-17T02:18:00.831 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-17T02:18:00.945 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-17T02:18:00.972 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-17T02:18:00.997 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-portend. 2024-09-17T02:18:01.003 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T02:18:01.024 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-17T02:18:01.039 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-17T02:18:01.055 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-17T02:18:01.066 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-17T02:18:01.106 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-17T02:18:01.289 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-17T02:18:01.305 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:18:01.316 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-17T02:18:01.344 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-17T02:18:01.347 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr-modules-core (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:01.383 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-17T02:18:01.409 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-openssl. 2024-09-17T02:18:01.435 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-17T02:18:01.475 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-17T02:18:01.686 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-17T02:18:01.713 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-17T02:18:01.719 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-17T02:18:01.746 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:01.752 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-17T02:18:01.786 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:01.820 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr. 2024-09-17T02:18:01.846 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:01.886 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:02.010 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-natsort. 2024-09-17T02:18:02.037 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-17T02:18:02.038 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-17T02:18:02.048 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-natsort. 2024-09-17T02:18:02.054 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-17T02:18:02.064 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-17T02:18:02.076 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-17T02:18:02.088 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-17T02:18:02.106 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-17T02:18:02.256 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mon. 2024-09-17T02:18:02.271 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:02.306 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mon (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:02.320 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-logutils. 2024-09-17T02:18:02.347 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-17T02:18:02.379 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-17T02:18:02.409 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-logutils. 2024-09-17T02:18:02.436 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-17T02:18:02.475 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-17T02:18:02.657 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-17T02:18:02.684 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-17T02:18:02.723 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-17T02:18:02.812 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-17T02:18:02.839 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-17T02:18:02.878 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-17T02:18:02.926 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-osd. 2024-09-17T02:18:02.953 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:02.993 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-osd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:03.026 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-mako. 2024-09-17T02:18:03.053 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-17T02:18:03.092 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T02:18:03.226 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-openssl. 2024-09-17T02:18:03.252 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-17T02:18:03.292 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-17T02:18:03.437 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-17T02:18:03.464 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-17T02:18:03.504 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-17T02:18:03.637 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr. 2024-09-17T02:18:03.663 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:03.703 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:03.832 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-17T02:18:03.859 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-17T02:18:03.882 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-mako. 2024-09-17T02:18:03.898 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-17T02:18:03.909 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-17T02:18:03.939 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T02:18:04.104 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph. 2024-09-17T02:18:04.106 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mon. 2024-09-17T02:18:04.119 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../066-ceph_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:04.132 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:04.162 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:04.172 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mon (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:04.184 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-webob. 2024-09-17T02:18:04.212 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-17T02:18:04.234 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-17T02:18:04.251 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T02:18:04.251 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-17T02:18:04.284 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-17T02:18:04.490 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-fuse. 2024-09-17T02:18:04.516 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:04.556 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:04.570 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-waitress. 2024-09-17T02:18:04.579 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-17T02:18:04.597 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-17T02:18:04.606 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-17T02:18:04.632 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T02:18:04.645 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-17T02:18:04.718 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-osd. 2024-09-17T02:18:04.744 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:04.776 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-osd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:04.876 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mds. 2024-09-17T02:18:04.903 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:04.940 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-tempita. 2024-09-17T02:18:04.942 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mds (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:04.948 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-webob. 2024-09-17T02:18:04.967 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-17T02:18:04.976 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-17T02:18:05.006 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T02:18:05.015 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T02:18:05.267 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-paste. 2024-09-17T02:18:05.283 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-17T02:18:05.317 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T02:18:05.371 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephadm. 2024-09-17T02:18:05.376 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-waitress. 2024-09-17T02:18:05.397 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../069-cephadm_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:05.403 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-17T02:18:05.437 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:05.446 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T02:18:05.580 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-17T02:18:05.594 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-17T02:18:05.628 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T02:18:05.737 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-tempita. 2024-09-17T02:18:05.756 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-17T02:18:05.765 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-17T02:18:05.783 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-17T02:18:05.795 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T02:18:05.823 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-17T02:18:05.845 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph. 2024-09-17T02:18:05.861 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../066-ceph_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:05.904 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:05.931 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-17T02:18:05.959 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-17T02:18:05.998 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-17T02:18:06.090 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-paste. 2024-09-17T02:18:06.117 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-17T02:18:06.157 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T02:18:06.159 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-17T02:18:06.174 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T02:18:06.217 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T02:18:06.223 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-fuse. 2024-09-17T02:18:06.249 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:06.301 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-webtest. 2024-09-17T02:18:06.328 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-17T02:18:06.367 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-17T02:18:06.485 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-17T02:18:06.512 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-17T02:18:06.551 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T02:18:06.556 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:06.678 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pecan. 2024-09-17T02:18:06.705 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-17T02:18:06.745 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T02:18:06.846 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-17T02:18:06.873 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-17T02:18:06.893 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mds. 2024-09-17T02:18:06.904 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-17T02:18:06.919 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:06.951 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mds (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:07.108 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-certifi. 2024-09-17T02:18:07.135 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-17T02:18:07.174 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-17T02:18:07.188 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-babel. 2024-09-17T02:18:07.215 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-webtest. 2024-09-17T02:18:07.216 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T02:18:07.242 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-17T02:18:07.255 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T02:18:07.282 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-17T02:18:07.320 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package cephadm. 2024-09-17T02:18:07.347 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../069-cephadm_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:07.387 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:07.477 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-idna. 2024-09-17T02:18:07.504 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-17T02:18:07.535 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T02:18:07.566 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jinja2. 2024-09-17T02:18:07.593 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-17T02:18:07.593 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-pecan. 2024-09-17T02:18:07.620 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-17T02:18:07.633 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T02:18:07.659 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T02:18:07.689 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-17T02:18:07.716 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-17T02:18:07.756 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-17T02:18:07.863 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-urllib3. 2024-09-17T02:18:07.890 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-17T02:18:07.930 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T02:18:07.986 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-17T02:18:08.013 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:18:08.031 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-certifi. 2024-09-17T02:18:08.052 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:08.058 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-17T02:18:08.098 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-17T02:18:08.117 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-17T02:18:08.144 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T02:18:08.183 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T02:18:08.199 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-requests. 2024-09-17T02:18:08.215 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-17T02:18:08.249 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T02:18:08.389 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-17T02:18:08.416 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-17T02:18:08.425 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-idna. 2024-09-17T02:18:08.454 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-17T02:18:08.455 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-17T02:18:08.492 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T02:18:08.527 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-17T02:18:08.543 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-17T02:18:08.585 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T02:18:08.717 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-routes. 2024-09-17T02:18:08.743 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-17T02:18:08.761 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-urllib3. 2024-09-17T02:18:08.789 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-17T02:18:08.791 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T02:18:08.828 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T02:18:09.030 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-17T02:18:09.044 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-17T02:18:09.046 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:18:09.060 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:18:09.088 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-modules-core (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:09.094 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-dashboard (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:09.205 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-babel. 2024-09-17T02:18:09.232 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T02:18:09.271 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T02:18:09.298 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-requests. 2024-09-17T02:18:09.325 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-17T02:18:09.365 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T02:18:09.460 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-17T02:18:09.487 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:09.526 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:09.600 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-jinja2. 2024-09-17T02:18:09.627 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-17T02:18:09.659 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-17T02:18:09.668 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T02:18:09.686 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-17T02:18:09.726 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T02:18:09.804 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-17T02:18:09.820 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-17T02:18:09.853 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-17T02:18:10.019 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-17T02:18:10.029 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-17T02:18:10.045 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:18:10.046 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:18:10.079 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-mgr-modules-core (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:10.086 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr-cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:10.090 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-openssl. 2024-09-17T02:18:10.117 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-17T02:18:10.156 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-17T02:18:10.366 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-17T02:18:10.393 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-17T02:18:10.432 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T02:18:10.439 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-17T02:18:10.459 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-17T02:18:10.466 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-17T02:18:10.486 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:10.501 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr. 2024-09-17T02:18:10.505 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-17T02:18:10.525 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:10.528 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:10.567 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:10.817 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-routes. 2024-09-17T02:18:10.836 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-17T02:18:10.843 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-17T02:18:10.863 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-17T02:18:10.883 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T02:18:10.919 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-17T02:18:10.935 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-joblib. 2024-09-17T02:18:10.951 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-17T02:18:10.970 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mon. 2024-09-17T02:18:10.994 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T02:18:10.997 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:11.036 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mon (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:11.180 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-openssl. 2024-09-17T02:18:11.208 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-17T02:18:11.219 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-17T02:18:11.238 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-17T02:18:11.246 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:18:11.286 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr-dashboard (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:11.331 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-17T02:18:11.358 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-17T02:18:11.389 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-17T02:18:11.575 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-mgr. 2024-09-17T02:18:11.602 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:11.641 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-mgr (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:11.675 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-sklearn. 2024-09-17T02:18:11.690 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-osd. 2024-09-17T02:18:11.702 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-17T02:18:11.717 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:11.741 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T02:18:11.757 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-osd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:12.028 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-mon. 2024-09-17T02:18:12.055 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:12.094 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-mon (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:12.433 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-17T02:18:12.461 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:18:12.560 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-17T02:18:12.576 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-17T02:18:12.587 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:12.609 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T02:18:12.690 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-osd. 2024-09-17T02:18:12.717 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:12.756 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-osd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:12.818 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph. 2024-09-17T02:18:12.845 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../066-ceph_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:12.876 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:13.080 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-joblib. 2024-09-17T02:18:13.107 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-17T02:18:13.146 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T02:18:13.170 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-fuse. 2024-09-17T02:18:13.198 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:13.237 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:13.466 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-17T02:18:13.482 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-17T02:18:13.516 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-17T02:18:13.532 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cachetools. 2024-09-17T02:18:13.559 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-17T02:18:13.776 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph. 2024-09-17T02:18:13.792 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../066-ceph_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:13.799 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mds. 2024-09-17T02:18:13.826 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:13.834 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:13.865 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mds (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:13.906 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-17T02:18:13.977 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-sklearn. 2024-09-17T02:18:14.004 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-17T02:18:14.043 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T02:18:14.170 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-fuse. 2024-09-17T02:18:14.197 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:14.234 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-17T02:18:14.236 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:14.259 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package cephadm. 2024-09-17T02:18:14.262 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-17T02:18:14.287 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../069-cephadm_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:14.301 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-17T02:18:14.326 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:14.596 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-17T02:18:14.604 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-17T02:18:14.606 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-mds. 2024-09-17T02:18:14.623 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-17T02:18:14.631 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-17T02:18:14.634 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:14.654 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T02:18:14.662 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-17T02:18:14.681 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-mds (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:14.769 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-17T02:18:14.796 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:18:14.915 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rsa. 2024-09-17T02:18:14.920 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:14.932 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-17T02:18:14.973 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-17T02:18:14.990 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-17T02:18:15.017 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T02:18:15.056 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T02:18:15.059 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package cephadm. 2024-09-17T02:18:15.086 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../069-cephadm_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:15.125 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:15.302 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-google-auth. 2024-09-17T02:18:15.329 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-17T02:18:15.369 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-17T02:18:15.403 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-17T02:18:15.431 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-17T02:18:15.470 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-17T02:18:15.689 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-17T02:18:15.716 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-17T02:18:15.755 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T02:18:15.755 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-17T02:18:15.772 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T02:18:15.805 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T02:18:15.849 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-cachetools. 2024-09-17T02:18:15.876 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-17T02:18:15.915 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-17T02:18:16.041 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-websocket. 2024-09-17T02:18:16.068 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-17T02:18:16.108 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-17T02:18:16.111 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-babel. 2024-09-17T02:18:16.128 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T02:18:16.161 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T02:18:16.185 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-17T02:18:16.212 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-17T02:18:16.251 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-17T02:18:16.420 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-17T02:18:16.446 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-17T02:18:16.474 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jinja2. 2024-09-17T02:18:16.477 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T02:18:16.502 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-17T02:18:16.541 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T02:18:16.580 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-17T02:18:16.607 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-17T02:18:16.646 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T02:18:16.852 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-babel. 2024-09-17T02:18:16.869 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-17T02:18:16.880 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T02:18:16.896 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:18:16.919 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T02:18:16.935 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:17.174 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-17T02:18:17.190 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:18:17.191 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-rsa. 2024-09-17T02:18:17.218 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-17T02:18:17.232 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:17.247 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-jinja2. 2024-09-17T02:18:17.257 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-17T02:18:17.272 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-17T02:18:17.274 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-17T02:18:17.300 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-17T02:18:17.313 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T02:18:17.338 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-17T02:18:17.536 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-17T02:18:17.562 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-17T02:18:17.578 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-google-auth. 2024-09-17T02:18:17.605 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-17T02:18:17.610 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T02:18:17.641 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-routes. 2024-09-17T02:18:17.644 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-17T02:18:17.669 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-17T02:18:17.675 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-17T02:18:17.702 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:18:17.707 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T02:18:17.741 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-mgr-cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:17.947 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-17T02:18:17.955 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-17T02:18:17.974 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-17T02:18:17.982 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T02:18:18.013 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T02:18:18.021 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T02:18:18.061 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-17T02:18:18.078 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-17T02:18:18.089 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:18:18.105 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-17T02:18:18.127 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-dashboard (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:18.144 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-17T02:18:18.249 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package jq. 2024-09-17T02:18:18.266 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T02:18:18.275 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-websocket. 2024-09-17T02:18:18.290 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-17T02:18:18.307 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-17T02:18:18.333 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-17T02:18:18.405 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-routes. 2024-09-17T02:18:18.421 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-17T02:18:18.455 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T02:18:18.509 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package socat. 2024-09-17T02:18:18.525 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-17T02:18:18.567 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-17T02:18:18.653 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-17T02:18:18.680 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-17T02:18:18.719 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T02:18:18.742 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-17T02:18:18.769 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:18:18.808 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-mgr-dashboard (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:18.871 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package xmlstarlet. 2024-09-17T02:18:18.887 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-17T02:18:18.929 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-17T02:18:19.258 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-test. 2024-09-17T02:18:19.274 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../097-ceph-test_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:19.308 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-test (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:19.391 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-17T02:18:19.407 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-17T02:18:19.408 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-17T02:18:19.423 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:18:19.449 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T02:18:19.466 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:19.811 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-17T02:18:19.838 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-17T02:18:19.885 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T02:18:19.944 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-joblib. 2024-09-17T02:18:19.969 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-17T02:18:20.002 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T02:18:20.222 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-17T02:18:20.249 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T02:18:20.280 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-17T02:18:20.288 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T02:18:20.296 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-17T02:18:20.338 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T02:18:20.372 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-17T02:18:20.400 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-17T02:18:20.439 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-17T02:18:20.532 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package jq. 2024-09-17T02:18:20.556 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T02:18:20.590 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-17T02:18:20.742 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-sklearn. 2024-09-17T02:18:20.769 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-17T02:18:20.808 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T02:18:20.818 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package socat. 2024-09-17T02:18:20.834 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-17T02:18:20.858 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-joblib. 2024-09-17T02:18:20.876 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-17T02:18:20.885 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-17T02:18:20.924 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T02:18:21.196 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package xmlstarlet. 2024-09-17T02:18:21.220 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-17T02:18:21.263 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-17T02:18:21.303 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-17T02:18:21.321 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-17T02:18:21.361 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-17T02:18:21.508 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-17T02:18:21.536 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:18:21.600 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-test. 2024-09-17T02:18:21.616 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../097-ceph-test_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:21.629 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-volume. 2024-09-17T02:18:21.653 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-sklearn. 2024-09-17T02:18:21.710 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:21.710 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-test (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:21.710 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-17T02:18:21.711 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:18:21.711 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-volume (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:21.713 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T02:18:22.008 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-17T02:18:22.024 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:22.065 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcephfs-dev (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:22.377 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-17T02:18:22.404 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-17T02:18:22.443 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T02:18:22.464 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-17T02:18:22.492 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:18:22.614 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cachetools. 2024-09-17T02:18:22.616 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:22.641 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-17T02:18:22.680 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-17T02:18:22.748 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-17T02:18:22.763 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-17T02:18:22.822 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-17T02:18:22.924 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-17T02:18:22.950 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-17T02:18:22.983 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-17T02:18:23.202 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package nvme-cli. 2024-09-17T02:18:23.228 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-17T02:18:23.268 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T02:18:23.328 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-17T02:18:23.355 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-17T02:18:23.394 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T02:18:23.528 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-cachetools. 2024-09-17T02:18:23.544 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-17T02:18:23.577 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-17T02:18:23.697 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rsa. 2024-09-17T02:18:23.698 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package pkg-config. 2024-09-17T02:18:23.725 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-17T02:18:23.725 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-17T02:18:23.763 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-17T02:18:23.764 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T02:18:23.821 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-volume. 2024-09-17T02:18:23.849 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:18:23.887 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-volume (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:23.992 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-17T02:18:24.008 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-17T02:18:24.039 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-17T02:18:24.042 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-17T02:18:24.066 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-17T02:18:24.097 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-17T02:18:24.183 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-17T02:18:24.210 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:24.249 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libcephfs-dev (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:24.368 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-google-auth. 2024-09-17T02:18:24.395 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-17T02:18:24.420 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-17T02:18:24.425 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-17T02:18:24.434 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-17T02:18:24.436 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-17T02:18:24.453 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-17T02:18:24.470 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-17T02:18:24.492 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T02:18:24.569 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-17T02:18:24.596 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-17T02:18:24.635 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T02:18:24.712 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-17T02:18:24.729 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-17T02:18:24.747 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pastescript. 2024-09-17T02:18:24.770 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T02:18:24.775 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-17T02:18:24.795 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-rsa. 2024-09-17T02:18:24.814 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-17T02:18:24.822 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-17T02:18:24.861 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-17T02:18:24.964 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-17T02:18:24.992 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-17T02:18:25.015 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-websocket. 2024-09-17T02:18:25.031 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-17T02:18:25.043 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-17T02:18:25.081 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-17T02:18:25.117 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pluggy. 2024-09-17T02:18:25.144 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-17T02:18:25.183 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-17T02:18:25.190 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-google-auth. 2024-09-17T02:18:25.218 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-17T02:18:25.256 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-17T02:18:25.360 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package nvme-cli. 2024-09-17T02:18:25.387 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-17T02:18:25.412 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-17T02:18:25.418 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T02:18:25.437 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-17T02:18:25.470 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-psutil. 2024-09-17T02:18:25.476 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T02:18:25.497 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-17T02:18:25.536 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-17T02:18:25.577 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-17T02:18:25.604 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-17T02:18:25.643 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T02:18:25.798 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package pkg-config. 2024-09-17T02:18:25.825 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-17T02:18:25.864 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T02:18:25.873 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-py. 2024-09-17T02:18:25.900 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-17T02:18:25.912 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-websocket. 2024-09-17T02:18:25.929 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-17T02:18:25.939 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-17T02:18:25.962 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-17T02:18:26.115 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-17T02:18:26.117 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-17T02:18:26.132 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:18:26.145 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-17T02:18:26.173 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:26.183 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-17T02:18:26.266 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-17T02:18:26.284 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pygments. 2024-09-17T02:18:26.293 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-17T02:18:26.311 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-17T02:18:26.332 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T02:18:26.350 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T02:18:26.501 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-17T02:18:26.529 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-17T02:18:26.567 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T02:18:26.612 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-17T02:18:26.640 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-17T02:18:26.678 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-17T02:18:26.779 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-17T02:18:26.807 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-17T02:18:26.846 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-17T02:18:26.912 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-17T02:18:26.940 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T02:18:26.978 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T02:18:26.981 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pastescript. 2024-09-17T02:18:27.008 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-17T02:18:27.038 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-17T02:18:27.047 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-17T02:18:27.055 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:18:27.090 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-toml. 2024-09-17T02:18:27.096 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:27.103 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-17T02:18:27.140 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-17T02:18:27.189 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package jq. 2024-09-17T02:18:27.206 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T02:18:27.239 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-17T02:18:27.390 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-17T02:18:27.418 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-17T02:18:27.443 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pytest. 2024-09-17T02:18:27.448 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T02:18:27.470 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-17T02:18:27.476 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package socat. 2024-09-17T02:18:27.504 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-17T02:18:27.509 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T02:18:27.542 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-17T02:18:27.567 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pluggy. 2024-09-17T02:18:27.595 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-17T02:18:27.633 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-17T02:18:27.795 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-17T02:18:27.823 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T02:18:27.846 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-simplejson. 2024-09-17T02:18:27.861 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T02:18:27.862 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package xmlstarlet. 2024-09-17T02:18:27.874 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-17T02:18:27.879 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-17T02:18:27.912 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-17T02:18:27.945 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-psutil. 2024-09-17T02:18:27.953 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-17T02:18:27.973 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-17T02:18:28.011 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-17T02:18:28.131 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package jq. 2024-09-17T02:18:28.148 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T02:18:28.156 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-17T02:18:28.173 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-17T02:18:28.189 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-17T02:18:28.206 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-17T02:18:28.283 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-test. 2024-09-17T02:18:28.299 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../097-ceph-test_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:28.332 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-test (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:28.398 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-py. 2024-09-17T02:18:28.425 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package socat. 2024-09-17T02:18:28.425 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-17T02:18:28.441 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-17T02:18:28.464 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-17T02:18:28.483 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-17T02:18:28.770 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package xmlstarlet. 2024-09-17T02:18:28.786 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-17T02:18:28.792 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pygments. 2024-09-17T02:18:28.820 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-17T02:18:28.820 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-17T02:18:28.859 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T02:18:28.961 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package radosgw. 2024-09-17T02:18:28.989 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../116-radosgw_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:29.027 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking radosgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:29.141 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-test. 2024-09-17T02:18:29.169 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../097-ceph-test_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:29.207 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-test (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:29.321 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-17T02:18:29.349 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-17T02:18:29.387 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-17T02:18:29.699 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-toml. 2024-09-17T02:18:29.726 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-17T02:18:29.765 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-17T02:18:29.955 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package rbd-fuse. 2024-09-17T02:18:29.971 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:30.013 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking rbd-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:30.068 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pytest. 2024-09-17T02:18:30.095 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-17T02:18:30.134 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T02:18:30.309 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-17T02:18:30.480 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-simplejson. 2024-09-17T02:18:30.507 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-17T02:18:30.546 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-17T02:18:30.568 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T02:18:30.620 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-volume. 2024-09-17T02:18:30.636 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:18:30.678 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-volume (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:30.694 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T02:18:30.823 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-17T02:18:30.839 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-17T02:18:30.881 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-17T02:18:30.957 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-17T02:18:30.965 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-17T02:18:30.993 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:31.032 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libcephfs-dev (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:31.319 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-17T02:18:31.360 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-17T02:18:31.388 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-17T02:18:31.426 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T02:18:31.619 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package radosgw. 2024-09-17T02:18:31.647 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../116-radosgw_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:31.685 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking radosgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:31.687 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-volume. 2024-09-17T02:18:31.715 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T02:18:31.742 INFO:teuthology.orchestra.run.smithi153.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-17T02:18:31.744 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-volume (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:31.756 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-17T02:18:31.784 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-17T02:18:31.822 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-17T02:18:32.038 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:32.040 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-17T02:18:32.057 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:32.098 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libcephfs-dev (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:32.168 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package nvme-cli. 2024-09-17T02:18:32.196 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-17T02:18:32.226 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T02:18:32.351 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-17T02:18:32.379 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-17T02:18:32.426 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T02:18:32.471 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package rbd-fuse. 2024-09-17T02:18:32.487 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:32.513 INFO:teuthology.orchestra.run.smithi153.stdout:Adding system user cephadm....done 2024-09-17T02:18:32.529 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking rbd-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:32.648 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package pkg-config. 2024-09-17T02:18:32.669 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T02:18:32.675 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-17T02:18:32.714 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T02:18:32.764 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-17T02:18:32.792 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-17T02:18:32.830 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-17T02:18:32.859 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-17T02:18:32.937 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-17T02:18:32.992 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-17T02:18:33.013 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-17T02:18:33.050 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-17T02:18:33.109 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T02:18:33.172 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-17T02:18:33.201 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package nvme-cli. 2024-09-17T02:18:33.229 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-17T02:18:33.235 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T02:18:33.267 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T02:18:33.298 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-17T02:18:33.495 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-17T02:18:33.512 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-17T02:18:33.540 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-17T02:18:33.557 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-17T02:18:33.578 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-17T02:18:33.664 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package pkg-config. 2024-09-17T02:18:33.692 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-17T02:18:33.730 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T02:18:33.817 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T02:18:33.819 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-17T02:18:33.939 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pastescript. 2024-09-17T02:18:33.942 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-17T02:18:33.958 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-17T02:18:33.967 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-17T02:18:33.975 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-17T02:18:34.005 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-17T02:18:34.008 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-17T02:18:34.252 INFO:teuthology.orchestra.run.smithi164.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-17T02:18:34.253 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T02:18:34.318 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pluggy. 2024-09-17T02:18:34.320 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:34.346 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-17T02:18:34.361 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-17T02:18:34.384 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-17T02:18:34.390 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-17T02:18:34.419 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-17T02:18:34.605 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-17T02:18:34.653 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-psutil. 2024-09-17T02:18:34.670 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-17T02:18:34.703 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-17T02:18:34.705 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-pastescript. 2024-09-17T02:18:34.734 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-17T02:18:34.761 INFO:teuthology.orchestra.run.smithi164.stdout:Adding system user cephadm....done 2024-09-17T02:18:34.772 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-17T02:18:34.831 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-17T02:18:34.918 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T02:18:35.023 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-py. 2024-09-17T02:18:35.051 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-17T02:18:35.075 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-pluggy. 2024-09-17T02:18:35.081 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-17T02:18:35.089 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-17T02:18:35.104 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-17T02:18:35.141 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-17T02:18:35.194 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-17T02:18:35.342 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-17T02:18:35.385 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pygments. 2024-09-17T02:18:35.413 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-17T02:18:35.429 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-17T02:18:35.442 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T02:18:35.453 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-psutil. 2024-09-17T02:18:35.482 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-17T02:18:35.528 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-17T02:18:35.555 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-17T02:18:35.601 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-17T02:18:35.797 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-17T02:18:35.839 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-py. 2024-09-17T02:18:35.860 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-17T02:18:35.868 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-17T02:18:35.872 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-17T02:18:35.901 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-17T02:18:35.905 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-17T02:18:35.938 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-17T02:18:36.049 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T02:18:36.166 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-17T02:18:36.234 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-pygments. 2024-09-17T02:18:36.253 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-ceph-argparse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:36.262 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-17T02:18:36.274 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-toml. 2024-09-17T02:18:36.300 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T02:18:36.303 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-17T02:18:36.340 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-17T02:18:36.493 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T02:18:36.546 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T02:18:36.652 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pytest. 2024-09-17T02:18:36.655 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T02:18:36.680 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-17T02:18:36.718 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T02:18:36.756 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T02:18:36.763 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-17T02:18:36.791 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-17T02:18:36.829 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-17T02:18:36.861 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-17T02:18:36.865 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-17T02:18:37.047 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-simplejson. 2024-09-17T02:18:37.075 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-17T02:18:37.113 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-17T02:18:37.133 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-17T02:18:37.146 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-17T02:18:37.149 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-toml. 2024-09-17T02:18:37.177 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-17T02:18:37.215 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-17T02:18:37.366 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-17T02:18:37.379 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-17T02:18:37.405 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-17T02:18:37.416 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-17T02:18:37.484 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-pytest. 2024-09-17T02:18:37.501 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-17T02:18:37.517 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-17T02:18:37.534 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T02:18:37.548 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-17T02:18:37.628 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T02:18:37.657 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-17T02:18:37.754 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-17T02:18:37.864 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-simplejson. 2024-09-17T02:18:37.892 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-17T02:18:37.929 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-17T02:18:38.070 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package radosgw. 2024-09-17T02:18:38.083 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-17T02:18:38.096 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T02:18:38.098 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../116-radosgw_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:38.136 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking radosgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:38.207 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-17T02:18:38.222 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-17T02:18:38.223 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-17T02:18:38.265 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-17T02:18:38.342 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-17T02:18:38.482 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T02:18:38.610 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-ceph-argparse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:38.741 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-17T02:18:38.853 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T02:18:38.931 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package rbd-fuse. 2024-09-17T02:18:38.947 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:38.979 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T02:18:38.989 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking rbd-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:39.019 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package radosgw. 2024-09-17T02:18:39.042 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up zip (3.0-12build2) ... 2024-09-17T02:18:39.048 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../116-radosgw_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:39.105 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T02:18:39.111 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking radosgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:39.185 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T02:18:39.214 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-17T02:18:39.327 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-17T02:18:39.498 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-17T02:18:39.569 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T02:18:39.679 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T02:18:39.903 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T02:18:39.917 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-17T02:18:39.927 INFO:teuthology.orchestra.run.smithi164.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-17T02:18:39.939 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package rbd-fuse. 2024-09-17T02:18:39.956 INFO:teuthology.orchestra.run.smithi164.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-17T02:18:39.967 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T02:18:40.005 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking rbd-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:40.018 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T02:18:40.127 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-17T02:18:40.163 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T02:18:40.264 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-17T02:18:40.284 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-17T02:18:40.303 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-17T02:18:40.365 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T02:18:40.470 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T02:18:40.569 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T02:18:40.596 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-17T02:18:40.657 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-17T02:18:40.690 INFO:teuthology.orchestra.run.smithi032.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-17T02:18:40.695 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T02:18:40.764 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:40.847 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T02:18:40.968 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-17T02:18:41.042 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-17T02:18:41.107 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-17T02:18:41.280 INFO:teuthology.orchestra.run.smithi032.stdout:Adding system user cephadm....done 2024-09-17T02:18:41.301 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T02:18:41.325 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-17T02:18:41.395 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T02:18:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up zip (3.0-12build2) ... 2024-09-17T02:18:41.525 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T02:18:41.661 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T02:18:41.663 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-17T02:18:41.757 INFO:teuthology.orchestra.run.smithi001.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-17T02:18:41.830 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:41.922 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-17T02:18:41.946 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T02:18:42.048 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-17T02:18:42.194 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T02:18:42.279 INFO:teuthology.orchestra.run.smithi001.stdout:Adding system user cephadm....done 2024-09-17T02:18:42.281 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-17T02:18:42.299 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-17T02:18:42.403 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T02:18:42.437 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T02:18:42.523 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-17T02:18:42.538 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-17T02:18:42.551 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T02:18:42.641 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:42.664 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T02:18:42.677 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-17T02:18:42.687 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-17T02:18:42.939 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-17T02:18:42.942 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T02:18:42.947 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-17T02:18:42.987 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T02:18:43.073 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-17T02:18:43.259 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T02:18:43.316 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-17T02:18:43.324 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-17T02:18:43.347 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-17T02:18:43.567 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T02:18:43.592 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T02:18:43.606 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-17T02:18:43.743 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-17T02:18:43.883 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-17T02:18:43.935 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T02:18:44.095 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T02:18:44.126 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-17T02:18:44.219 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T02:18:44.385 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-17T02:18:44.440 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T02:18:44.488 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-17T02:18:44.554 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-17T02:18:44.653 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-17T02:18:44.683 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T02:18:44.756 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-17T02:18:44.805 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-17T02:18:44.817 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-17T02:18:44.912 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-ceph-argparse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:44.931 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:45.032 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-17T02:18:45.094 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T02:18:45.163 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T02:18:45.195 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-17T02:18:45.232 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T02:18:45.267 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-17T02:18:45.281 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T02:18:45.312 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T02:18:45.407 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T02:18:45.533 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-17T02:18:45.550 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T02:18:45.614 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-17T02:18:45.744 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-17T02:18:45.801 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-17T02:18:45.865 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-17T02:18:46.011 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-17T02:18:46.132 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T02:18:46.181 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-17T02:18:46.216 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-17T02:18:46.258 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-17T02:18:46.271 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-ceph-argparse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:46.279 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T02:18:46.538 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T02:18:46.539 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-17T02:18:46.559 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-17T02:18:46.664 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T02:18:46.689 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T02:18:46.773 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T02:18:46.802 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-17T02:18:46.874 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-17T02:18:46.914 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T02:18:46.932 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T02:18:47.041 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-17T02:18:47.045 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-17T02:18:47.066 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-17T02:18:47.125 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-17T02:18:47.297 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-17T02:18:47.379 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T02:18:47.379 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T02:18:47.443 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-17T02:18:47.520 INFO:teuthology.orchestra.run.smithi001.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-17T02:18:47.549 INFO:teuthology.orchestra.run.smithi001.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-17T02:18:47.555 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-17T02:18:47.569 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T02:18:47.576 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-17T02:18:47.612 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T02:18:47.738 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-17T02:18:47.823 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T02:18:47.862 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-17T02:18:47.877 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up zip (3.0-12build2) ... 2024-09-17T02:18:47.949 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-17T02:18:48.003 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T02:18:48.122 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-17T02:18:48.123 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T02:18:48.224 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-17T02:18:48.250 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T02:18:48.356 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T02:18:48.376 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T02:18:48.474 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-17T02:18:48.483 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T02:18:48.672 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T02:18:48.686 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T02:18:48.751 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-17T02:18:48.775 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-17T02:18:48.923 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T02:18:49.003 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-17T02:18:49.026 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-17T02:18:49.049 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-17T02:18:49.111 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up zip (3.0-12build2) ... 2024-09-17T02:18:49.175 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T02:18:49.237 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T02:18:49.263 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T02:18:49.277 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-17T02:18:49.431 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-17T02:18:49.485 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-17T02:18:49.528 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-17T02:18:49.573 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T02:18:49.662 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-17T02:18:49.779 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-17T02:18:49.891 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T02:18:49.911 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-17T02:18:49.930 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T02:18:50.017 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T02:18:50.038 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T02:18:50.165 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-17T02:18:50.170 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T02:18:50.197 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T02:18:50.324 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-17T02:18:50.411 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-17T02:18:50.449 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T02:18:50.450 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T02:18:50.546 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T02:18:50.575 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T02:18:50.695 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-17T02:18:50.751 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-17T02:18:50.813 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-17T02:18:50.822 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T02:18:50.868 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T02:18:51.064 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T02:18:51.152 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-17T02:18:51.161 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-17T02:18:51.165 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T02:18:51.182 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-17T02:18:51.403 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T02:18:51.420 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T02:18:51.441 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-17T02:18:51.474 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T02:18:51.529 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-17T02:18:51.568 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:51.638 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T02:18:51.712 INFO:teuthology.orchestra.run.smithi164.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-17T02:18:51.783 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T02:18:51.797 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T02:18:51.877 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T02:18:51.957 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T02:18:52.068 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-17T02:18:52.082 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T02:18:52.106 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T02:18:52.195 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T02:18:52.219 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-17T02:18:52.441 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-17T02:18:52.468 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-17T02:18:52.512 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-17T02:18:52.692 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-17T02:18:52.727 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-17T02:18:52.788 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T02:18:52.818 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:52.853 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-17T02:18:53.124 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-17T02:18:53.128 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T02:18:53.129 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T02:18:53.255 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T02:18:53.417 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T02:18:53.462 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T02:18:53.517 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-17T02:18:53.656 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T02:18:53.669 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T02:18:53.795 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-17T02:18:53.819 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T02:18:53.932 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T02:18:54.038 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T02:18:54.139 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-17T02:18:54.163 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T02:18:54.208 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-17T02:18:54.264 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librados2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:54.265 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T02:18:54.334 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-17T02:18:54.374 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libsqlite3-mod-ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:54.499 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-17T02:18:54.557 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-17T02:18:54.601 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-17T02:18:54.709 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T02:18:54.825 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-17T02:18:54.836 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcephfs2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:54.869 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T02:18:54.962 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libradosstriper1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:54.977 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T02:18:55.088 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-17T02:18:55.095 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-17T02:18:55.214 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-17T02:18:55.347 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librbd1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:55.355 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T02:18:55.363 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T02:18:55.449 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-modules-core (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:55.464 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-17T02:18:55.519 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-17T02:18:55.574 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-17T02:18:55.574 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:55.590 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T02:18:55.785 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T02:18:55.786 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T02:18:55.829 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-17T02:18:55.851 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T02:18:55.899 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-17T02:18:56.063 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-17T02:18:56.170 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T02:18:56.192 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-17T02:18:56.267 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcephfs-dev (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:56.296 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up librados2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:56.314 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-17T02:18:56.443 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libsqlite3-mod-ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:56.444 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rados (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:56.460 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T02:18:56.573 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-17T02:18:56.586 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-17T02:18:56.594 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librgw2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:56.599 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-17T02:18:56.746 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T02:18:56.850 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-17T02:18:56.886 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libcephfs2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:56.904 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-17T02:18:57.012 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libradosstriper1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:57.126 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T02:18:57.138 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-17T02:18:57.147 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-17T02:18:57.252 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-17T02:18:57.414 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up librbd1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:57.415 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-17T02:18:57.532 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr-modules-core (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:57.553 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T02:18:57.654 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T02:18:57.658 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:57.674 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-17T02:18:57.869 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T02:18:57.869 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T02:18:57.908 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-17T02:18:57.931 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T02:18:57.949 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rbd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:58.075 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up rbd-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:58.193 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T02:18:58.209 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:58.248 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-17T02:18:58.327 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-17T02:18:58.334 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libcephfs-dev (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:58.362 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cephfs (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:58.435 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-rados (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:58.499 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T02:18:58.514 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:58.570 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up librgw2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:58.612 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T02:18:58.625 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-17T02:18:58.696 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T02:18:58.734 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T02:18:58.737 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T02:18:58.816 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-17T02:18:59.030 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T02:18:59.061 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T02:18:59.082 INFO:teuthology.orchestra.run.smithi153.stdout:Adding group ceph....done 2024-09-17T02:18:59.170 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T02:18:59.331 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-17T02:18:59.483 INFO:teuthology.orchestra.run.smithi153.stdout:Adding system user ceph....done 2024-09-17T02:18:59.555 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-17T02:18:59.574 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T02:18:59.694 INFO:teuthology.orchestra.run.smithi153.stdout:Setting system user ceph properties....done 2024-09-17T02:18:59.700 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-17T02:18:59.709 INFO:teuthology.orchestra.run.smithi153.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-17T02:18:59.823 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-17T02:18:59.826 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T02:18:59.841 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-17T02:18:59.891 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-rbd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:18:59.915 INFO:teuthology.orchestra.run.smithi001.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-17T02:18:59.949 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-17T02:19:00.017 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up rbd-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:00.118 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-rgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:00.145 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-17T02:19:00.161 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T02:19:00.216 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T02:19:00.219 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-cephfs (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:00.270 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T02:19:00.351 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T02:19:00.353 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:00.613 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-test (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:00.655 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-17T02:19:00.710 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T02:19:00.741 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up radosgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:00.923 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-17T02:19:00.929 INFO:teuthology.orchestra.run.smithi164.stdout:Adding group ceph....done 2024-09-17T02:19:01.036 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T02:19:01.049 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-17T02:19:01.235 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T02:19:01.235 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T02:19:01.272 INFO:teuthology.orchestra.run.smithi164.stdout:Adding system user ceph....done 2024-09-17T02:19:01.300 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T02:19:01.304 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-17T02:19:01.426 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T02:19:01.430 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-17T02:19:01.432 INFO:teuthology.orchestra.run.smithi164.stdout:Setting system user ceph properties....done 2024-09-17T02:19:01.444 INFO:teuthology.orchestra.run.smithi164.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-17T02:19:01.579 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-17T02:19:01.710 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-base (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:01.714 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-17T02:19:01.752 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T02:19:01.906 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-17T02:19:01.999 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T02:19:02.053 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T02:19:02.059 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-17T02:19:02.336 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-17T02:19:02.346 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-17T02:19:02.379 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-test (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:02.447 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-17T02:19:02.480 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up radosgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:02.520 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mds (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:02.723 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-17T02:19:02.737 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-17T02:19:02.747 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T02:19:02.747 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T02:19:02.898 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T02:19:02.898 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T02:19:02.991 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T02:19:03.022 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T02:19:03.222 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:03.353 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-17T02:19:03.381 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-base (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:03.391 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T02:19:03.419 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T02:19:03.419 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T02:19:03.494 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librados2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:03.621 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libsqlite3-mod-ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:03.730 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-17T02:19:03.737 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-17T02:19:03.746 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-17T02:19:03.906 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-osd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:04.022 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T02:19:04.083 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libcephfs2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:04.181 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T02:19:04.181 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T02:19:04.184 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libradosstriper1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:04.191 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mds (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:04.285 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-17T02:19:04.366 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T02:19:04.404 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T02:19:04.404 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T02:19:04.492 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up librados2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:04.570 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librbd1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:04.618 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libsqlite3-mod-ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:04.633 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-k8sevents (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:04.696 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-modules-core (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:04.753 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-17T02:19:04.784 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:04.839 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:04.851 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:04.960 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mon (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:05.061 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T02:19:05.062 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T02:19:05.093 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T02:19:05.093 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T02:19:05.097 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libcephfs2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:05.188 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T02:19:05.188 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T02:19:05.240 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libradosstriper1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:05.366 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-17T02:19:05.570 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-osd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:05.642 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up librbd1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:05.671 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:05.744 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-mgr-modules-core (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:05.839 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:05.844 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T02:19:05.844 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T02:19:05.853 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:05.901 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libcephfs-dev (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:05.948 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-dashboard (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:06.026 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rados (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:06.075 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T02:19:06.075 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T02:19:06.124 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-volume (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:06.152 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librgw2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:06.278 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T02:19:06.305 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr-k8sevents (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:06.430 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:06.477 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-17T02:19:06.565 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libcephfs-dev (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:06.573 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mon (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:06.577 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T02:19:06.689 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-rados (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:06.738 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T02:19:06.784 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T02:19:06.785 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T02:19:06.789 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up librgw2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:06.890 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T02:19:07.249 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr-cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:07.392 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:07.474 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rbd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:07.518 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr-dashboard (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:07.599 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up rbd-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:07.669 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-volume (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:07.700 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:07.765 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T02:19:07.801 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cephfs (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:07.919 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:08.055 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-17T02:19:08.136 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-rbd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:08.164 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T02:19:08.287 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up rbd-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:08.333 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T02:19:08.413 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-rgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:08.419 INFO:teuthology.orchestra.run.smithi153.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T02:19:08.422 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-17T02:19:08.463 INFO:teuthology.orchestra.run.smithi032.stdout:Adding group ceph....done 2024-09-17T02:19:08.479 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-17T02:19:08.539 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-cephfs (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:08.665 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:08.691 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-09-17T02:19:08.692 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-09-17T02:19:08.839 INFO:teuthology.orchestra.run.smithi032.stdout:Adding system user ceph....done 2024-09-17T02:19:08.882 INFO:teuthology.orchestra.run.smithi153.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-17T02:19:08.883 INFO:teuthology.orchestra.run.smithi153.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-17T02:19:08.883 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T02:19:08.883 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T02:19:08.883 INFO:teuthology.orchestra.run.smithi153.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T02:19:08.883 INFO:teuthology.orchestra.run.smithi153.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T02:19:08.884 INFO:teuthology.orchestra.run.smithi153.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T02:19:08.884 INFO:teuthology.orchestra.run.smithi153.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T02:19:08.884 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T02:19:08.884 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2024-09-17T02:19:08.885 INFO:teuthology.orchestra.run.smithi153.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-17T02:19:08.886 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2024-09-17T02:19:08.887 INFO:teuthology.orchestra.run.smithi153.stdout: bison-doc flex-doc libssl-doc 2024-09-17T02:19:08.916 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2024-09-17T02:19:08.918 INFO:teuthology.orchestra.run.smithi153.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-17T02:19:08.919 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages will be upgraded: 2024-09-17T02:19:08.920 INFO:teuthology.orchestra.run.smithi153.stdout: libssl3 libuuid1 uuid-dev 2024-09-17T02:19:09.007 INFO:teuthology.orchestra.run.smithi032.stdout:Setting system user ceph properties....done 2024-09-17T02:19:09.024 INFO:teuthology.orchestra.run.smithi032.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-17T02:19:09.100 INFO:teuthology.orchestra.run.smithi153.stdout:3 upgraded, 7 newly installed, 0 to remove and 328 not upgraded. 2024-09-17T02:19:09.100 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 5,494 kB of archives. 2024-09-17T02:19:09.100 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-17T02:19:09.100 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-17T02:19:09.169 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-17T02:19:09.175 INFO:teuthology.orchestra.run.smithi001.stdout:Adding group ceph....done 2024-09-17T02:19:09.543 INFO:teuthology.orchestra.run.smithi001.stdout:Adding system user ceph....done 2024-09-17T02:19:09.550 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-17T02:19:09.567 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T02:19:09.576 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-17T02:19:09.669 INFO:teuthology.orchestra.run.smithi001.stdout:Setting system user ceph properties....done 2024-09-17T02:19:09.688 INFO:teuthology.orchestra.run.smithi001.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-17T02:19:09.830 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-17T02:19:09.830 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-17T02:19:09.831 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-17T02:19:09.832 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-17T02:19:09.866 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-17T02:19:09.867 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-17T02:19:09.869 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-17T02:19:09.869 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-17T02:19:09.870 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-17T02:19:10.038 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-test (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:10.164 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-17T02:19:10.164 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up radosgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:10.203 INFO:teuthology.orchestra.run.smithi164.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T02:19:10.206 DEBUG:teuthology.orchestra.run.smithi164:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-17T02:19:10.262 INFO:teuthology.orchestra.run.smithi164.stdout:Reading package lists... 2024-09-17T02:19:10.284 INFO:teuthology.orchestra.run.smithi153.stdout:Preconfiguring packages ... 2024-09-17T02:19:10.387 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 5,494 kB in 1s (5,419 kB/s) 2024-09-17T02:19:10.464 INFO:teuthology.orchestra.run.smithi164.stdout:Building dependency tree... 2024-09-17T02:19:10.465 INFO:teuthology.orchestra.run.smithi164.stdout:Reading state information... 2024-09-17T02:19:10.546 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package flex. 2024-09-17T02:19:10.622 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173894 files and directories currently installed.) 2024-09-17T02:19:10.628 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-17T02:19:10.641 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-test (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:10.646 INFO:teuthology.orchestra.run.smithi164.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-17T02:19:10.646 INFO:teuthology.orchestra.run.smithi164.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-17T02:19:10.646 INFO:teuthology.orchestra.run.smithi164.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T02:19:10.646 INFO:teuthology.orchestra.run.smithi164.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T02:19:10.646 INFO:teuthology.orchestra.run.smithi164.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T02:19:10.646 INFO:teuthology.orchestra.run.smithi164.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T02:19:10.647 INFO:teuthology.orchestra.run.smithi164.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T02:19:10.647 INFO:teuthology.orchestra.run.smithi164.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T02:19:10.647 INFO:teuthology.orchestra.run.smithi164.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T02:19:10.648 INFO:teuthology.orchestra.run.smithi164.stdout:The following additional packages will be installed: 2024-09-17T02:19:10.649 INFO:teuthology.orchestra.run.smithi164.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-17T02:19:10.650 INFO:teuthology.orchestra.run.smithi164.stdout:Suggested packages: 2024-09-17T02:19:10.650 INFO:teuthology.orchestra.run.smithi164.stdout: bison-doc flex-doc libssl-doc 2024-09-17T02:19:10.661 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T02:19:10.661 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T02:19:10.669 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-17T02:19:10.679 INFO:teuthology.orchestra.run.smithi164.stdout:The following NEW packages will be installed: 2024-09-17T02:19:10.681 INFO:teuthology.orchestra.run.smithi164.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-17T02:19:10.682 INFO:teuthology.orchestra.run.smithi164.stdout:The following packages will be upgraded: 2024-09-17T02:19:10.683 INFO:teuthology.orchestra.run.smithi164.stdout: libssl3 libuuid1 uuid-dev 2024-09-17T02:19:10.733 INFO:teuthology.orchestra.run.smithi164.stdout:3 upgraded, 7 newly installed, 0 to remove and 328 not upgraded. 2024-09-17T02:19:10.733 INFO:teuthology.orchestra.run.smithi164.stdout:Need to get 5,494 kB of archives. 2024-09-17T02:19:10.733 INFO:teuthology.orchestra.run.smithi164.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-17T02:19:10.733 INFO:teuthology.orchestra.run.smithi164.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-17T02:19:10.751 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up radosgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:10.833 INFO:teuthology.orchestra.run.smithi164.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-17T02:19:10.893 INFO:teuthology.orchestra.run.smithi164.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-17T02:19:10.894 INFO:teuthology.orchestra.run.smithi164.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-17T02:19:10.895 INFO:teuthology.orchestra.run.smithi164.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-17T02:19:10.908 INFO:teuthology.orchestra.run.smithi164.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-17T02:19:10.909 INFO:teuthology.orchestra.run.smithi164.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-17T02:19:10.910 INFO:teuthology.orchestra.run.smithi164.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-17T02:19:10.910 INFO:teuthology.orchestra.run.smithi164.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-17T02:19:10.911 INFO:teuthology.orchestra.run.smithi164.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-17T02:19:11.153 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-base (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:11.204 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T02:19:11.204 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T02:19:11.277 INFO:teuthology.orchestra.run.smithi164.stdout:Preconfiguring packages ... 2024-09-17T02:19:11.277 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T02:19:11.379 INFO:teuthology.orchestra.run.smithi164.stdout:Fetched 5,494 kB in 0s (21.9 MB/s) 2024-09-17T02:19:11.450 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-17T02:19:11.515 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package flex. 2024-09-17T02:19:11.615 INFO:teuthology.orchestra.run.smithi164.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173894 files and directories currently installed.) 2024-09-17T02:19:11.621 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-17T02:19:11.636 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-17T02:19:11.671 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-17T02:19:11.703 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-base (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:11.861 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T02:19:12.094 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mds (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:12.238 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T02:19:12.337 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T02:19:12.337 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T02:19:12.372 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-17T02:19:12.378 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T02:19:12.384 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-17T02:19:12.394 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-17T02:19:12.524 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T02:19:12.779 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T02:19:12.805 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:12.831 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-mds (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:12.950 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T02:19:13.028 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T02:19:13.028 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T02:19:13.071 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T02:19:13.071 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T02:19:13.081 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T02:19:13.290 INFO:teuthology.orchestra.run.smithi164.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-17T02:19:13.295 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T02:19:13.408 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T02:19:13.451 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T02:19:13.473 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-osd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:13.550 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-mgr (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:13.758 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T02:19:13.758 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T02:19:13.772 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T02:19:13.772 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T02:19:13.781 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package bison. 2024-09-17T02:19:13.828 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T02:19:13.883 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-17T02:19:13.888 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-17T02:19:13.942 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T02:19:14.041 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T02:19:14.218 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-osd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:14.291 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-k8sevents (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:14.292 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-17T02:19:14.308 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-17T02:19:14.350 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T02:19:14.369 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T02:19:14.417 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:14.504 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T02:19:14.504 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T02:19:14.568 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mon (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:14.579 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-17T02:19:14.596 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-17T02:19:14.629 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T02:19:14.700 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package bison. 2024-09-17T02:19:14.789 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T02:19:14.789 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T02:19:14.802 INFO:teuthology.orchestra.run.smithi164.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-17T02:19:14.807 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-17T02:19:14.853 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T02:19:14.958 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-17T02:19:14.985 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-17T02:19:15.003 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-mgr-k8sevents (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:15.024 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T02:19:15.129 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:15.185 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-17T02:19:15.202 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-17T02:19:15.252 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T02:19:15.277 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-17T02:19:15.277 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:15.280 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-mon (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:15.304 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-17T02:19:15.343 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T02:19:15.429 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:15.500 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T02:19:15.500 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T02:19:15.506 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-17T02:19:15.534 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-17T02:19:15.572 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-dashboard (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:15.572 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T02:19:15.596 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-17T02:19:15.615 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T02:19:15.654 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T02:19:15.723 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-volume (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:15.909 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-17T02:19:15.931 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-mgr-cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:15.937 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-17T02:19:15.975 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T02:19:16.074 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:16.191 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-mgr-dashboard (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:16.219 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-17T02:19:16.236 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-17T02:19:16.243 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-17T02:19:16.270 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T02:19:16.288 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-17T02:19:16.326 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-volume (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T02:19:16.368 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T02:19:16.389 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T02:19:16.494 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T02:19:16.541 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T02:19:16.597 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-17T02:19:16.621 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T02:19:16.625 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T02:19:16.664 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T02:19:16.747 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T02:19:16.873 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T02:19:16.952 INFO:teuthology.orchestra.run.smithi001.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-17T02:19:16.982 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T02:19:17.053 INFO:teuthology.orchestra.run.smithi001.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T02:19:17.054 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-17T02:19:17.108 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T02:19:17.149 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-17T02:19:17.180 INFO:teuthology.orchestra.run.smithi001.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T02:19:17.227 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T02:19:17.276 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T02:19:17.350 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T02:19:17.378 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T02:19:17.403 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T02:19:17.529 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T02:19:17.655 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T02:19:17.772 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T02:19:17.898 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T02:19:17.955 INFO:teuthology.orchestra.run.smithi001.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T02:19:17.994 INFO:teuthology.orchestra.run.smithi164.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-17T02:19:18.043 INFO:teuthology.orchestra.run.smithi032.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T02:19:18.047 DEBUG:teuthology.orchestra.run.smithi032:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-17T02:19:18.058 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T02:19:18.107 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-09-17T02:19:18.209 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T02:19:18.323 INFO:teuthology.orchestra.run.smithi032.stdout:Building dependency tree... 2024-09-17T02:19:18.323 INFO:teuthology.orchestra.run.smithi032.stdout:Reading state information... 2024-09-17T02:19:18.361 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T02:19:18.539 INFO:teuthology.orchestra.run.smithi032.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-17T02:19:18.539 INFO:teuthology.orchestra.run.smithi032.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-17T02:19:18.539 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T02:19:18.539 INFO:teuthology.orchestra.run.smithi032.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T02:19:18.539 INFO:teuthology.orchestra.run.smithi032.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T02:19:18.540 INFO:teuthology.orchestra.run.smithi032.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T02:19:18.540 INFO:teuthology.orchestra.run.smithi032.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T02:19:18.540 INFO:teuthology.orchestra.run.smithi032.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T02:19:18.540 INFO:teuthology.orchestra.run.smithi032.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T02:19:18.541 INFO:teuthology.orchestra.run.smithi032.stdout:The following additional packages will be installed: 2024-09-17T02:19:18.543 INFO:teuthology.orchestra.run.smithi032.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-17T02:19:18.544 INFO:teuthology.orchestra.run.smithi032.stdout:Suggested packages: 2024-09-17T02:19:18.544 INFO:teuthology.orchestra.run.smithi032.stdout: bison-doc flex-doc libssl-doc 2024-09-17T02:19:18.554 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T02:19:18.575 INFO:teuthology.orchestra.run.smithi032.stdout:The following NEW packages will be installed: 2024-09-17T02:19:18.577 INFO:teuthology.orchestra.run.smithi032.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-17T02:19:18.579 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages will be upgraded: 2024-09-17T02:19:18.580 INFO:teuthology.orchestra.run.smithi032.stdout: libssl3 libuuid1 uuid-dev 2024-09-17T02:19:18.619 INFO:teuthology.orchestra.run.smithi001.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T02:19:18.622 DEBUG:teuthology.orchestra.run.smithi001:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-17T02:19:18.685 INFO:teuthology.orchestra.run.smithi001.stdout:Reading package lists... 2024-09-17T02:19:18.762 INFO:teuthology.orchestra.run.smithi032.stdout:3 upgraded, 7 newly installed, 0 to remove and 328 not upgraded. 2024-09-17T02:19:18.762 INFO:teuthology.orchestra.run.smithi032.stdout:Need to get 5,494 kB of archives. 2024-09-17T02:19:18.762 INFO:teuthology.orchestra.run.smithi032.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-17T02:19:18.762 INFO:teuthology.orchestra.run.smithi032.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-17T02:19:18.901 INFO:teuthology.orchestra.run.smithi001.stdout:Building dependency tree... 2024-09-17T02:19:18.902 INFO:teuthology.orchestra.run.smithi001.stdout:Reading state information... 2024-09-17T02:19:19.083 INFO:teuthology.orchestra.run.smithi153.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T02:19:19.087 DEBUG:teuthology.parallel:result is None 2024-09-17T02:19:19.114 INFO:teuthology.orchestra.run.smithi001.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-17T02:19:19.114 INFO:teuthology.orchestra.run.smithi001.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-17T02:19:19.114 INFO:teuthology.orchestra.run.smithi001.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T02:19:19.114 INFO:teuthology.orchestra.run.smithi001.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T02:19:19.114 INFO:teuthology.orchestra.run.smithi001.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T02:19:19.114 INFO:teuthology.orchestra.run.smithi001.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T02:19:19.115 INFO:teuthology.orchestra.run.smithi001.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T02:19:19.115 INFO:teuthology.orchestra.run.smithi001.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T02:19:19.115 INFO:teuthology.orchestra.run.smithi001.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T02:19:19.116 INFO:teuthology.orchestra.run.smithi001.stdout:The following additional packages will be installed: 2024-09-17T02:19:19.117 INFO:teuthology.orchestra.run.smithi001.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-17T02:19:19.118 INFO:teuthology.orchestra.run.smithi001.stdout:Suggested packages: 2024-09-17T02:19:19.118 INFO:teuthology.orchestra.run.smithi001.stdout: bison-doc flex-doc libssl-doc 2024-09-17T02:19:19.149 INFO:teuthology.orchestra.run.smithi001.stdout:The following NEW packages will be installed: 2024-09-17T02:19:19.151 INFO:teuthology.orchestra.run.smithi001.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-17T02:19:19.152 INFO:teuthology.orchestra.run.smithi001.stdout:The following packages will be upgraded: 2024-09-17T02:19:19.153 INFO:teuthology.orchestra.run.smithi001.stdout: libssl3 libuuid1 uuid-dev 2024-09-17T02:19:19.205 INFO:teuthology.orchestra.run.smithi001.stdout:3 upgraded, 7 newly installed, 0 to remove and 328 not upgraded. 2024-09-17T02:19:19.206 INFO:teuthology.orchestra.run.smithi001.stdout:Need to get 5,494 kB of archives. 2024-09-17T02:19:19.206 INFO:teuthology.orchestra.run.smithi001.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-17T02:19:19.206 INFO:teuthology.orchestra.run.smithi001.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-17T02:19:19.236 INFO:teuthology.orchestra.run.smithi032.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-17T02:19:19.308 INFO:teuthology.orchestra.run.smithi001.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-17T02:19:19.370 INFO:teuthology.orchestra.run.smithi001.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-17T02:19:19.370 INFO:teuthology.orchestra.run.smithi001.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-17T02:19:19.372 INFO:teuthology.orchestra.run.smithi001.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-17T02:19:19.385 INFO:teuthology.orchestra.run.smithi001.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-17T02:19:19.386 INFO:teuthology.orchestra.run.smithi001.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-17T02:19:19.387 INFO:teuthology.orchestra.run.smithi001.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-17T02:19:19.387 INFO:teuthology.orchestra.run.smithi001.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-17T02:19:19.388 INFO:teuthology.orchestra.run.smithi001.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-17T02:19:19.490 INFO:teuthology.orchestra.run.smithi032.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-17T02:19:19.492 INFO:teuthology.orchestra.run.smithi032.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-17T02:19:19.493 INFO:teuthology.orchestra.run.smithi032.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-17T02:19:19.530 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-17T02:19:19.530 INFO:teuthology.orchestra.run.smithi032.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-17T02:19:19.532 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-17T02:19:19.533 INFO:teuthology.orchestra.run.smithi032.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-17T02:19:19.533 INFO:teuthology.orchestra.run.smithi032.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-17T02:19:19.730 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T02:19:19.774 INFO:teuthology.orchestra.run.smithi001.stdout:Preconfiguring packages ... 2024-09-17T02:19:19.877 INFO:teuthology.orchestra.run.smithi001.stdout:Fetched 5,494 kB in 0s (21.3 MB/s) 2024-09-17T02:19:19.960 INFO:teuthology.orchestra.run.smithi032.stdout:Preconfiguring packages ... 2024-09-17T02:19:20.002 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package flex. 2024-09-17T02:19:20.067 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 5,494 kB in 1s (5,424 kB/s) 2024-09-17T02:19:20.099 INFO:teuthology.orchestra.run.smithi001.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173894 files and directories currently installed.) 2024-09-17T02:19:20.104 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-17T02:19:20.142 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-17T02:19:20.207 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package flex. 2024-09-17T02:19:20.233 INFO:teuthology.orchestra.run.smithi164.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T02:19:20.239 DEBUG:teuthology.parallel:result is None 2024-09-17T02:19:20.313 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173894 files and directories currently installed.) 2024-09-17T02:19:20.319 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-17T02:19:20.371 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-17T02:19:20.752 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T02:19:20.948 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-17T02:19:20.955 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T02:19:21.128 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-17T02:19:21.385 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T02:19:21.958 INFO:teuthology.orchestra.run.smithi001.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-17T02:19:21.963 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T02:19:22.077 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T02:19:22.098 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T02:19:22.498 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T02:19:22.572 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-17T02:19:22.577 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T02:19:22.629 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T02:19:22.689 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T02:19:22.974 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T02:19:23.115 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T02:19:23.246 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T02:19:23.338 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package bison. 2024-09-17T02:19:23.444 INFO:teuthology.orchestra.run.smithi001.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-17T02:19:23.450 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-17T02:19:23.499 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T02:19:23.549 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T02:19:23.832 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-17T02:19:23.861 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-17T02:19:23.899 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T02:19:23.905 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package bison. 2024-09-17T02:19:24.012 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-17T02:19:24.018 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-17T02:19:24.065 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T02:19:24.153 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-17T02:19:24.181 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-17T02:19:24.219 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T02:19:24.391 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-17T02:19:24.419 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-17T02:19:24.457 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T02:19:24.581 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-17T02:19:24.610 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-17T02:19:24.664 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T02:19:24.678 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-17T02:19:24.695 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-17T02:19:24.736 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T02:19:24.917 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-17T02:19:24.945 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-17T02:19:24.983 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T02:19:25.065 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-17T02:19:25.093 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-17T02:19:25.132 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T02:19:25.236 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-17T02:19:25.264 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T02:19:25.302 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T02:19:25.418 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-17T02:19:25.446 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-17T02:19:25.484 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T02:19:25.712 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-17T02:19:25.728 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T02:19:25.762 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T02:19:25.815 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-17T02:19:25.941 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T02:19:26.083 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T02:19:26.209 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T02:19:26.315 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-17T02:19:26.335 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T02:19:26.417 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T02:19:26.461 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T02:19:26.543 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T02:19:26.562 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T02:19:26.634 INFO:teuthology.orchestra.run.smithi001.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-17T02:19:26.669 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T02:19:26.689 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T02:19:26.795 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T02:19:26.815 INFO:teuthology.orchestra.run.smithi001.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T02:19:26.921 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T02:19:26.976 INFO:teuthology.orchestra.run.smithi001.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T02:19:27.047 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T02:19:27.136 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-17T02:19:27.199 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T02:19:27.301 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T02:19:27.435 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T02:19:28.168 INFO:teuthology.orchestra.run.smithi001.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T02:19:28.661 INFO:teuthology.orchestra.run.smithi001.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T02:19:28.666 DEBUG:teuthology.parallel:result is None 2024-09-17T02:19:28.787 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T02:19:29.296 INFO:teuthology.orchestra.run.smithi032.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T02:19:29.301 DEBUG:teuthology.parallel:result is None 2024-09-17T02:19:29.301 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T02:19:29.448 DEBUG:teuthology.orchestra.run.smithi001:> dpkg-query -W -f '${Version}' ceph 2024-09-17T02:19:29.468 INFO:teuthology.orchestra.run.smithi001.stdout:19.1.1-330-gc2ddf972-1jammy 2024-09-17T02:19:29.469 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-330-gc2ddf972-1jammy 2024-09-17T02:19:29.469 INFO:teuthology.task.install:The correct ceph version 19.1.1-330-gc2ddf972-1jammy is installed. 2024-09-17T02:19:29.470 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T02:19:29.615 DEBUG:teuthology.orchestra.run.smithi032:> dpkg-query -W -f '${Version}' ceph 2024-09-17T02:19:29.635 INFO:teuthology.orchestra.run.smithi032.stdout:19.1.1-330-gc2ddf972-1jammy 2024-09-17T02:19:29.636 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-330-gc2ddf972-1jammy 2024-09-17T02:19:29.636 INFO:teuthology.task.install:The correct ceph version 19.1.1-330-gc2ddf972-1jammy is installed. 2024-09-17T02:19:29.638 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T02:19:29.775 DEBUG:teuthology.orchestra.run.smithi153:> dpkg-query -W -f '${Version}' ceph 2024-09-17T02:19:29.794 INFO:teuthology.orchestra.run.smithi153.stdout:19.1.1-330-gc2ddf972-1jammy 2024-09-17T02:19:29.794 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-330-gc2ddf972-1jammy 2024-09-17T02:19:29.794 INFO:teuthology.task.install:The correct ceph version 19.1.1-330-gc2ddf972-1jammy is installed. 2024-09-17T02:19:29.796 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T02:19:29.943 DEBUG:teuthology.orchestra.run.smithi164:> dpkg-query -W -f '${Version}' ceph 2024-09-17T02:19:29.962 INFO:teuthology.orchestra.run.smithi164.stdout:19.1.1-330-gc2ddf972-1jammy 2024-09-17T02:19:29.962 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-330-gc2ddf972-1jammy 2024-09-17T02:19:29.962 INFO:teuthology.task.install:The correct ceph version 19.1.1-330-gc2ddf972-1jammy is installed. 2024-09-17T02:19:29.964 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T02:19:29.964 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-17T02:19:29.965 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T02:19:29.979 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-17T02:19:29.979 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T02:19:29.993 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T02:19:29.993 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T02:19:30.007 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T02:19:30.007 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T02:19:30.021 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T02:19:30.021 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-17T02:19:30.021 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T02:19:30.035 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T02:19:30.089 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-17T02:19:30.089 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T02:19:30.103 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T02:19:30.158 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T02:19:30.158 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T02:19:30.172 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T02:19:30.226 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T02:19:30.226 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T02:19:30.240 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T02:19:30.294 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T02:19:30.294 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-17T02:19:30.294 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T02:19:30.308 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T02:19:30.361 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-17T02:19:30.361 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T02:19:30.375 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T02:19:30.431 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T02:19:30.431 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T02:19:30.444 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T02:19:30.498 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T02:19:30.498 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T02:19:30.511 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T02:19:30.565 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T02:19:30.566 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-17T02:19:30.566 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T02:19:30.579 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T02:19:30.633 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-17T02:19:30.633 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T02:19:30.648 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T02:19:30.702 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T02:19:30.702 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T02:19:30.715 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T02:19:30.770 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T02:19:30.770 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T02:19:30.783 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T02:19:30.838 INFO:teuthology.run_tasks:Running task ceph... 2024-09-17T02:19:30.918 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-17T02:19:30.918 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 777 /var/log/ceph 2024-09-17T02:19:30.921 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 777 /var/log/ceph 2024-09-17T02:19:30.923 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /var/log/ceph 2024-09-17T02:19:30.925 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 777 /var/log/ceph 2024-09-17T02:19:30.938 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-17T02:19:30.938 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T02:19:30.975 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T02:19:30.980 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T02:19:30.982 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T02:19:30.994 INFO:tasks.ceph:Creating extra log directories... 2024-09-17T02:19:30.994 DEBUG:teuthology.orchestra.run.smithi001:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T02:19:31.031 DEBUG:teuthology.orchestra.run.smithi032:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T02:19:31.036 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T02:19:31.040 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T02:19:31.062 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-17T02:19:31.062 INFO:tasks.ceph:config {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-17T02:19:31.063 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908093', 'branch': 'squid', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-distros/ubuntu_latest tasks/admin_socket_objecter_requests thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7908093', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi', 'no_nested_subset': False, 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'e20bff7d16f5b09c58ead9548e8cf98cf87ee227'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 4845, 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f', 'sleep_before_teardown': 0, 'subset': '2/4', 'suite': 'powercycle', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'e20bff7d16f5b09c58ead9548e8cf98cf87ee227', 'targets': {'smithi001.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDcyL+7MyPMqFhtXtNLT1zjWOyWS+cKVlTASvYluRv0A4rWGsP6GbEy22y82DzIx0Zz45oM6MLOEsGbV/umQzYM=', 'smithi032.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIY9NLKYDF2EH/P0V9X8MrY/fHCQGjdtN+GVOau1HFFuZ96DLQ6OoG2suntoYE0MkUqmlNtNtOG/z3mA616sFGw=', 'smithi153.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK6nCyI4RjPVpj6QY8MuyjcL8W0GdswXtR64BWvOR03QaLirhy3l7MPrgqW0GS7LtJJ5KcYtvqbn8coTF2xvhdk=', 'smithi164.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJx9Isemf1elOibihOXkHLuaqD36e2lHzfDmT8gb3rI1lZOuYSQ2xoJGcQOXVFoiak9trvqFoHafV6OIGyvrnDE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'radosbench': {'clients': ['client.0'], 'time': 60}}, {'admin_socket': {'client.0': {'objecter_requests': {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}'}}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-16_21:32:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-17T02:19:31.063 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T02:19:31.086 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T02:19:31.092 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T02:19:31.097 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T02:19:31.102 DEBUG:teuthology.orchestra.run.smithi001:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T02:19:31.135 DEBUG:teuthology.orchestra.run.smithi032:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T02:19:31.140 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T02:19:31.144 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T02:19:31.157 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-17T02:19:31.157 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T02:19:31.199 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T02:19:31.199 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_1 2024-09-17T02:19:31.247 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T02:19:31.247 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T02:19:31.247 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 875 Links: 1 2024-09-17T02:19:31.247 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T02:19:31.247 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-09-17 02:13:32.536909432 +0000 2024-09-17T02:19:31.247 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-09-17 02:13:32.296911564 +0000 2024-09-17T02:19:31.248 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-09-17 02:13:32.296911564 +0000 2024-09-17T02:19:31.248 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2024-09-17T02:19:31.248 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T02:19:31.301 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-09-17T02:19:31.301 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-09-17T02:19:31.301 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000314511 s, 1.6 MB/s 2024-09-17T02:19:31.303 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T02:19:31.353 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_2 2024-09-17T02:19:31.399 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T02:19:31.399 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T02:19:31.399 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 896 Links: 1 2024-09-17T02:19:31.399 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T02:19:31.399 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-09-17 02:13:32.788907191 +0000 2024-09-17T02:19:31.400 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-09-17 02:13:32.784907227 +0000 2024-09-17T02:19:31.400 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-09-17 02:13:32.784907227 +0000 2024-09-17T02:19:31.400 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2024-09-17T02:19:31.400 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T02:19:31.453 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-09-17T02:19:31.453 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-09-17T02:19:31.453 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.00020948 s, 2.4 MB/s 2024-09-17T02:19:31.455 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T02:19:31.504 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_3 2024-09-17T02:19:31.551 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T02:19:31.551 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T02:19:31.551 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 910 Links: 1 2024-09-17T02:19:31.551 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T02:19:31.551 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-09-17 02:13:33.288902746 +0000 2024-09-17T02:19:31.551 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-09-17 02:13:33.284902782 +0000 2024-09-17T02:19:31.552 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-09-17 02:13:33.284902782 +0000 2024-09-17T02:19:31.552 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2024-09-17T02:19:31.552 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T02:19:31.605 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-09-17T02:19:31.606 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-09-17T02:19:31.606 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000320517 s, 1.6 MB/s 2024-09-17T02:19:31.607 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T02:19:31.656 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_4 2024-09-17T02:19:31.703 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T02:19:31.703 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T02:19:31.704 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 930 Links: 1 2024-09-17T02:19:31.704 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T02:19:31.704 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-09-17 02:13:34.016896275 +0000 2024-09-17T02:19:31.704 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-09-17 02:13:33.776898409 +0000 2024-09-17T02:19:31.704 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-09-17 02:13:33.776898409 +0000 2024-09-17T02:19:31.704 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2024-09-17T02:19:31.704 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T02:19:31.758 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-09-17T02:19:31.758 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-09-17T02:19:31.758 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000290752 s, 1.8 MB/s 2024-09-17T02:19:31.760 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T02:19:31.808 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-17T02:19:31.809 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T02:19:31.809 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T02:19:31.815 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T02:19:31.815 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_1 2024-09-17T02:19:31.864 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T02:19:31.864 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T02:19:31.864 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 873 Links: 1 2024-09-17T02:19:31.864 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T02:19:31.864 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-17 02:13:27.370913661 +0000 2024-09-17T02:19:31.864 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-17 02:13:27.106916018 +0000 2024-09-17T02:19:31.864 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-17 02:13:27.106916018 +0000 2024-09-17T02:19:31.864 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-09-17T02:19:31.864 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T02:19:31.918 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-17T02:19:31.919 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-17T02:19:31.919 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000440583 s, 1.2 MB/s 2024-09-17T02:19:31.920 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T02:19:31.968 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_2 2024-09-17T02:19:32.015 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T02:19:32.015 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T02:19:32.015 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-09-17T02:19:32.015 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T02:19:32.015 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-17 02:13:27.850909373 +0000 2024-09-17T02:19:32.015 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-17 02:13:27.614911481 +0000 2024-09-17T02:19:32.015 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-17 02:13:27.614911481 +0000 2024-09-17T02:19:32.016 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-09-17T02:19:32.016 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T02:19:32.070 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-17T02:19:32.070 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-17T02:19:32.070 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000441463 s, 1.2 MB/s 2024-09-17T02:19:32.071 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T02:19:32.120 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_3 2024-09-17T02:19:32.171 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T02:19:32.171 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T02:19:32.172 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-09-17T02:19:32.172 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T02:19:32.172 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-17 02:13:28.362904799 +0000 2024-09-17T02:19:32.172 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-17 02:13:28.086907265 +0000 2024-09-17T02:19:32.172 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-17 02:13:28.086907265 +0000 2024-09-17T02:19:32.172 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-09-17T02:19:32.172 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T02:19:32.226 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-17T02:19:32.226 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-17T02:19:32.226 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000417159 s, 1.2 MB/s 2024-09-17T02:19:32.227 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T02:19:32.276 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_4 2024-09-17T02:19:32.323 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T02:19:32.323 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T02:19:32.323 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 925 Links: 1 2024-09-17T02:19:32.323 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T02:19:32.323 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-17 02:13:28.834900584 +0000 2024-09-17T02:19:32.324 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-17 02:13:28.598902692 +0000 2024-09-17T02:19:32.324 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-17 02:13:28.598902692 +0000 2024-09-17T02:19:32.324 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-09-17T02:19:32.324 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T02:19:32.377 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-17T02:19:32.377 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-17T02:19:32.377 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000276894 s, 1.8 MB/s 2024-09-17T02:19:32.378 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T02:19:32.428 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-09-17T02:19:32.428 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T02:19:32.428 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T02:19:32.434 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T02:19:32.434 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_1 2024-09-17T02:19:32.480 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T02:19:32.480 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T02:19:32.480 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 874 Links: 1 2024-09-17T02:19:32.480 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T02:19:32.480 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-17 02:13:32.361049270 +0000 2024-09-17T02:19:32.480 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-17 02:13:32.109051519 +0000 2024-09-17T02:19:32.480 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-17 02:13:32.109051519 +0000 2024-09-17T02:19:32.480 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: - 2024-09-17T02:19:32.481 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T02:19:32.534 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-17T02:19:32.534 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-17T02:19:32.535 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000437793 s, 1.2 MB/s 2024-09-17T02:19:32.536 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T02:19:32.589 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_2 2024-09-17T02:19:32.639 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T02:19:32.640 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T02:19:32.640 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-09-17T02:19:32.640 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T02:19:32.640 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-17 02:13:32.877044660 +0000 2024-09-17T02:19:32.640 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-17 02:13:32.637046804 +0000 2024-09-17T02:19:32.640 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-17 02:13:32.637046804 +0000 2024-09-17T02:19:32.640 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: - 2024-09-17T02:19:32.640 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T02:19:32.694 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-17T02:19:32.694 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-17T02:19:32.694 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000412453 s, 1.2 MB/s 2024-09-17T02:19:32.695 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T02:19:32.745 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_3 2024-09-17T02:19:32.791 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T02:19:32.791 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T02:19:32.791 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 907 Links: 1 2024-09-17T02:19:32.792 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T02:19:32.792 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-17 02:13:33.381040157 +0000 2024-09-17T02:19:32.792 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-17 02:13:33.113042552 +0000 2024-09-17T02:19:32.792 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-17 02:13:33.113042552 +0000 2024-09-17T02:19:32.792 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: - 2024-09-17T02:19:32.792 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T02:19:32.845 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-17T02:19:32.846 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-17T02:19:32.846 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000344809 s, 1.5 MB/s 2024-09-17T02:19:32.847 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T02:19:32.897 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_4 2024-09-17T02:19:32.943 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T02:19:32.943 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T02:19:32.943 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 922 Links: 1 2024-09-17T02:19:32.943 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T02:19:32.943 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-17 02:13:33.889035620 +0000 2024-09-17T02:19:32.944 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-17 02:13:33.617038051 +0000 2024-09-17T02:19:32.944 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-17 02:13:33.617038051 +0000 2024-09-17T02:19:32.944 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: - 2024-09-17T02:19:32.944 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T02:19:32.997 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-17T02:19:32.998 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-17T02:19:32.998 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.00038937 s, 1.3 MB/s 2024-09-17T02:19:32.999 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T02:19:33.048 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-09-17T02:19:33.048 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi032.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-09-17T02:19:33.049 INFO:tasks.ceph:Generating config... 2024-09-17T02:19:33.050 INFO:tasks.ceph:[client.0] admin socket = /var/run/ceph/ceph-$name.asok 2024-09-17T02:19:33.050 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-17T02:19:33.050 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-17T02:19:33.050 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-17T02:19:33.050 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-17T02:19:33.050 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-17T02:19:33.050 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-17T02:19:33.050 INFO:tasks.ceph:[osd] bluestore compression algorithm = zstd 2024-09-17T02:19:33.050 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-17T02:19:33.050 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-17T02:19:33.050 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-17T02:19:33.051 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-17T02:19:33.051 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-17T02:19:33.051 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-17T02:19:33.051 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-17T02:19:33.051 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-17T02:19:33.051 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-17T02:19:33.051 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-17T02:19:33.051 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-17T02:19:33.051 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-17T02:19:33.051 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-17T02:19:33.051 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-17T02:19:33.051 INFO:tasks.ceph:Setting up mon.a... 2024-09-17T02:19:33.052 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-17T02:19:33.087 INFO:teuthology.orchestra.run.smithi001.stdout:creating /etc/ceph/ceph.keyring 2024-09-17T02:19:33.096 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-17T02:19:33.177 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T02:19:33.233 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.1'), ('mon.b', '[v2:172.21.15.1:3301,v1:172.21.15.1:6790]'), ('mon.c', '[v2:172.21.15.1:3302,v1:172.21.15.1:6791]')] 2024-09-17T02:19:33.234 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.1,[v2:172.21.15.1:3301,v1:172.21.15.1:6790],[v2:172.21.15.1:3302,v1:172.21.15.1:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}} 2024-09-17T02:19:33.234 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-17T02:19:33.234 DEBUG:teuthology.orchestra.run.smithi001:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T02:19:33.282 DEBUG:teuthology.orchestra.run.smithi001:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.1 --addv b '[v2:172.21.15.1:3301,v1:172.21.15.1:6790]' --addv c '[v2:172.21.15.1:3302,v1:172.21.15.1:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-17T02:19:33.368 INFO:teuthology.orchestra.run.smithi001.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-17T02:19:33.369 INFO:teuthology.orchestra.run.smithi001.stdout:monmaptool: generated fsid 37cd4495-4915-41f4-bad2-2394cbe235f3 2024-09-17T02:19:33.369 INFO:teuthology.orchestra.run.smithi001.stdout:setting min_mon_release = quincy 2024-09-17T02:19:33.369 INFO:teuthology.orchestra.run.smithi001.stdout:epoch 0 2024-09-17T02:19:33.369 INFO:teuthology.orchestra.run.smithi001.stdout:fsid 37cd4495-4915-41f4-bad2-2394cbe235f3 2024-09-17T02:19:33.369 INFO:teuthology.orchestra.run.smithi001.stdout:last_changed 2024-09-17T02:19:33.373856+0000 2024-09-17T02:19:33.369 INFO:teuthology.orchestra.run.smithi001.stdout:created 2024-09-17T02:19:33.373856+0000 2024-09-17T02:19:33.369 INFO:teuthology.orchestra.run.smithi001.stdout:min_mon_release 17 (quincy) 2024-09-17T02:19:33.369 INFO:teuthology.orchestra.run.smithi001.stdout:election_strategy: 1 2024-09-17T02:19:33.369 INFO:teuthology.orchestra.run.smithi001.stdout:0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-17T02:19:33.369 INFO:teuthology.orchestra.run.smithi001.stdout:1: [v2:172.21.15.1:3301/0,v1:172.21.15.1:6790/0] mon.b 2024-09-17T02:19:33.369 INFO:teuthology.orchestra.run.smithi001.stdout:2: [v2:172.21.15.1:3302/0,v1:172.21.15.1:6791/0] mon.c 2024-09-17T02:19:33.369 INFO:teuthology.orchestra.run.smithi001.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-17T02:19:33.371 DEBUG:teuthology.orchestra.run.smithi001:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T02:19:33.422 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 37cd4495-4915-41f4-bad2-2394cbe235f3... 2024-09-17T02:19:33.423 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T02:19:33.466 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T02:19:33.469 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T02:19:33.471 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T02:19:33.495 INFO:teuthology.orchestra.run.smithi001.stdout:[global] 2024-09-17T02:19:33.496 INFO:teuthology.orchestra.run.smithi001.stdout: chdir = "" 2024-09-17T02:19:33.496 INFO:teuthology.orchestra.run.smithi001.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T02:19:33.496 INFO:teuthology.orchestra.run.smithi001.stdout: auth supported = cephx 2024-09-17T02:19:33.496 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.496 INFO:teuthology.orchestra.run.smithi001.stdout: filestore xattr use omap = true 2024-09-17T02:19:33.496 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.496 INFO:teuthology.orchestra.run.smithi001.stdout: mon clock drift allowed = 1.000 2024-09-17T02:19:33.496 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.496 INFO:teuthology.orchestra.run.smithi001.stdout: osd crush chooseleaf type = 0 2024-09-17T02:19:33.496 INFO:teuthology.orchestra.run.smithi001.stdout: auth debug = true 2024-09-17T02:19:33.496 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.496 INFO:teuthology.orchestra.run.smithi001.stdout: ms die on old message = true 2024-09-17T02:19:33.496 INFO:teuthology.orchestra.run.smithi001.stdout: ms die on bug = true 2024-09-17T02:19:33.497 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.497 INFO:teuthology.orchestra.run.smithi001.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T02:19:33.497 INFO:teuthology.orchestra.run.smithi001.stdout: mon pg warn max object skew = 0 2024-09-17T02:19:33.497 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.497 INFO:teuthology.orchestra.run.smithi001.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T02:19:33.497 INFO:teuthology.orchestra.run.smithi001.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T02:19:33.497 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.497 INFO:teuthology.orchestra.run.smithi001.stdout: osd pool default size = 2 2024-09-17T02:19:33.497 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.497 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd allow primary affinity = true 2024-09-17T02:19:33.497 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd allow pg remap = true 2024-09-17T02:19:33.497 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on legacy crush tunables = false 2024-09-17T02:19:33.497 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on crush straw calc version zero = false 2024-09-17T02:19:33.498 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on no sortbitwise = false 2024-09-17T02:19:33.498 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on osd down out interval zero = false 2024-09-17T02:19:33.498 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on too few osds = false 2024-09-17T02:19:33.498 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T02:19:33.498 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T02:19:33.498 INFO:teuthology.orchestra.run.smithi001.stdout: mon_allow_pool_size_one = true 2024-09-17T02:19:33.498 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.498 INFO:teuthology.orchestra.run.smithi001.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T02:19:33.498 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.499 INFO:teuthology.orchestra.run.smithi001.stdout: osd default data pool replay window = 5 2024-09-17T02:19:33.499 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.499 INFO:teuthology.orchestra.run.smithi001.stdout: mon allow pool delete = true 2024-09-17T02:19:33.499 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.499 INFO:teuthology.orchestra.run.smithi001.stdout: mon cluster log file level = debug 2024-09-17T02:19:33.499 INFO:teuthology.orchestra.run.smithi001.stdout: debug asserts on shutdown = true 2024-09-17T02:19:33.499 INFO:teuthology.orchestra.run.smithi001.stdout: mon health detail to clog = false 2024-09-17T02:19:33.499 INFO:teuthology.orchestra.run.smithi001.stdout: mon host = "172.21.15.1,[v2:172.21.15.1:3301,v1:172.21.15.1:6790],[v2:172.21.15.1:3302,v1:172.21.15.1:6791]" 2024-09-17T02:19:33.499 INFO:teuthology.orchestra.run.smithi001.stdout: fsid = 37cd4495-4915-41f4-bad2-2394cbe235f3 2024-09-17T02:19:33.499 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.499 INFO:teuthology.orchestra.run.smithi001.stdout:[osd] 2024-09-17T02:19:33.499 INFO:teuthology.orchestra.run.smithi001.stdout: osd journal size = 100 2024-09-17T02:19:33.499 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.500 INFO:teuthology.orchestra.run.smithi001.stdout: osd scrub load threshold = 5.0 2024-09-17T02:19:33.500 INFO:teuthology.orchestra.run.smithi001.stdout: osd scrub max interval = 600 2024-09-17T02:19:33.500 INFO:teuthology.orchestra.run.smithi001.stdout: osd mclock profile = high_recovery_ops 2024-09-17T02:19:33.500 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.500 INFO:teuthology.orchestra.run.smithi001.stdout: osd recover clone overlap = true 2024-09-17T02:19:33.500 INFO:teuthology.orchestra.run.smithi001.stdout: osd recovery max chunk = 1048576 2024-09-17T02:19:33.500 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.500 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug shutdown = true 2024-09-17T02:19:33.500 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug op order = true 2024-09-17T02:19:33.500 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug verify stray on activate = true 2024-09-17T02:19:33.500 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug trim objects = true 2024-09-17T02:19:33.500 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.500 INFO:teuthology.orchestra.run.smithi001.stdout: osd open classes on start = true 2024-09-17T02:19:33.501 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug pg log writeout = true 2024-09-17T02:19:33.501 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.501 INFO:teuthology.orchestra.run.smithi001.stdout: osd deep scrub update digest min age = 30 2024-09-17T02:19:33.501 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.501 INFO:teuthology.orchestra.run.smithi001.stdout: osd map max advance = 10 2024-09-17T02:19:33.501 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.501 INFO:teuthology.orchestra.run.smithi001.stdout: journal zero on create = true 2024-09-17T02:19:33.501 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.501 INFO:teuthology.orchestra.run.smithi001.stdout: filestore ondisk finisher threads = 3 2024-09-17T02:19:33.501 INFO:teuthology.orchestra.run.smithi001.stdout: filestore apply finisher threads = 3 2024-09-17T02:19:33.501 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.501 INFO:teuthology.orchestra.run.smithi001.stdout: bdev debug aio = true 2024-09-17T02:19:33.502 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug misdirected ops = true 2024-09-17T02:19:33.502 INFO:teuthology.orchestra.run.smithi001.stdout: bluestore block size = 96636764160 2024-09-17T02:19:33.502 INFO:teuthology.orchestra.run.smithi001.stdout: bluestore compression algorithm = zstd 2024-09-17T02:19:33.502 INFO:teuthology.orchestra.run.smithi001.stdout: bluestore compression mode = aggressive 2024-09-17T02:19:33.502 INFO:teuthology.orchestra.run.smithi001.stdout: bluestore fsck on mount = True 2024-09-17T02:19:33.502 INFO:teuthology.orchestra.run.smithi001.stdout: debug bluefs = 1/20 2024-09-17T02:19:33.502 INFO:teuthology.orchestra.run.smithi001.stdout: debug bluestore = 1/20 2024-09-17T02:19:33.502 INFO:teuthology.orchestra.run.smithi001.stdout: debug ms = 1 2024-09-17T02:19:33.502 INFO:teuthology.orchestra.run.smithi001.stdout: debug osd = 20 2024-09-17T02:19:33.502 INFO:teuthology.orchestra.run.smithi001.stdout: debug rocksdb = 4/10 2024-09-17T02:19:33.502 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T02:19:33.502 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd full ratio = 0.9 2024-09-17T02:19:33.503 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd nearfull ratio = 0.8 2024-09-17T02:19:33.503 INFO:teuthology.orchestra.run.smithi001.stdout: osd blocked scrub grace period = 3600 2024-09-17T02:19:33.503 INFO:teuthology.orchestra.run.smithi001.stdout: osd failsafe full ratio = 0.95 2024-09-17T02:19:33.503 INFO:teuthology.orchestra.run.smithi001.stdout: osd max markdown count = 1000 2024-09-17T02:19:33.503 INFO:teuthology.orchestra.run.smithi001.stdout: osd objectstore = bluestore 2024-09-17T02:19:33.503 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.503 INFO:teuthology.orchestra.run.smithi001.stdout:[mgr] 2024-09-17T02:19:33.503 INFO:teuthology.orchestra.run.smithi001.stdout: debug ms = 1 2024-09-17T02:19:33.503 INFO:teuthology.orchestra.run.smithi001.stdout: debug mgr = 20 2024-09-17T02:19:33.503 INFO:teuthology.orchestra.run.smithi001.stdout: debug mon = 20 2024-09-17T02:19:33.503 INFO:teuthology.orchestra.run.smithi001.stdout: debug auth = 20 2024-09-17T02:19:33.503 INFO:teuthology.orchestra.run.smithi001.stdout: mon reweight min pgs per osd = 4 2024-09-17T02:19:33.503 INFO:teuthology.orchestra.run.smithi001.stdout: mon reweight min bytes per osd = 10 2024-09-17T02:19:33.504 INFO:teuthology.orchestra.run.smithi001.stdout: mgr/telemetry/nag = false 2024-09-17T02:19:33.504 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.504 INFO:teuthology.orchestra.run.smithi001.stdout:[mon] 2024-09-17T02:19:33.504 INFO:teuthology.orchestra.run.smithi001.stdout: debug ms = 1 2024-09-17T02:19:33.504 INFO:teuthology.orchestra.run.smithi001.stdout: debug mon = 20 2024-09-17T02:19:33.504 INFO:teuthology.orchestra.run.smithi001.stdout: debug paxos = 20 2024-09-17T02:19:33.504 INFO:teuthology.orchestra.run.smithi001.stdout: debug auth = 20 2024-09-17T02:19:33.504 INFO:teuthology.orchestra.run.smithi001.stdout: mon data avail warn = 5 2024-09-17T02:19:33.504 INFO:teuthology.orchestra.run.smithi001.stdout: mon mgr mkfs grace = 240 2024-09-17T02:19:33.504 INFO:teuthology.orchestra.run.smithi001.stdout: mon reweight min pgs per osd = 4 2024-09-17T02:19:33.504 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd reporter subtree level = osd 2024-09-17T02:19:33.504 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd prime pg temp = true 2024-09-17T02:19:33.504 INFO:teuthology.orchestra.run.smithi001.stdout: mon reweight min bytes per osd = 10 2024-09-17T02:19:33.504 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.505 INFO:teuthology.orchestra.run.smithi001.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T02:19:33.505 INFO:teuthology.orchestra.run.smithi001.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T02:19:33.505 INFO:teuthology.orchestra.run.smithi001.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T02:19:33.505 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.505 INFO:teuthology.orchestra.run.smithi001.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T02:19:33.505 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T02:19:33.505 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T02:19:33.505 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.505 INFO:teuthology.orchestra.run.smithi001.stdout: # 1m isn't quite enough 2024-09-17T02:19:33.505 INFO:teuthology.orchestra.run.smithi001.stdout: mon_down_mkfs_grace = 2m 2024-09-17T02:19:33.505 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.505 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_filestore_osds = false 2024-09-17T02:19:33.505 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:33.506 INFO:teuthology.orchestra.run.smithi001.stdout:[client] 2024-09-17T02:19:33.506 INFO:teuthology.orchestra.run.smithi001.stdout: rgw cache enabled = true 2024-09-17T02:19:33.506 INFO:teuthology.orchestra.run.smithi001.stdout: rgw enable ops log = true 2024-09-17T02:19:33.506 INFO:teuthology.orchestra.run.smithi001.stdout: rgw enable usage log = true 2024-09-17T02:19:33.506 INFO:teuthology.orchestra.run.smithi001.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T02:19:33.506 INFO:teuthology.orchestra.run.smithi001.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T02:19:33.506 INFO:teuthology.orchestra.run.smithi001.stdout:[mon.a] 2024-09-17T02:19:33.506 INFO:teuthology.orchestra.run.smithi001.stdout:[mon.b] 2024-09-17T02:19:33.506 INFO:teuthology.orchestra.run.smithi001.stdout:[mon.c] 2024-09-17T02:19:33.506 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.a] 2024-09-17T02:19:33.506 INFO:teuthology.orchestra.run.smithi001.stdout:[client.0] 2024-09-17T02:19:33.506 INFO:teuthology.orchestra.run.smithi001.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-09-17T02:19:33.507 INFO:teuthology.orchestra.run.smithi164.stdout:[global] 2024-09-17T02:19:33.507 INFO:teuthology.orchestra.run.smithi164.stdout: chdir = "" 2024-09-17T02:19:33.507 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T02:19:33.508 INFO:teuthology.orchestra.run.smithi164.stdout: auth supported = cephx 2024-09-17T02:19:33.508 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.508 INFO:teuthology.orchestra.run.smithi164.stdout: filestore xattr use omap = true 2024-09-17T02:19:33.508 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.508 INFO:teuthology.orchestra.run.smithi164.stdout: mon clock drift allowed = 1.000 2024-09-17T02:19:33.508 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.508 INFO:teuthology.orchestra.run.smithi164.stdout: osd crush chooseleaf type = 0 2024-09-17T02:19:33.508 INFO:teuthology.orchestra.run.smithi164.stdout: auth debug = true 2024-09-17T02:19:33.508 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.508 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on old message = true 2024-09-17T02:19:33.508 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on bug = true 2024-09-17T02:19:33.508 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T02:19:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: mon pg warn max object skew = 0 2024-09-17T02:19:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T02:19:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T02:19:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default size = 2 2024-09-17T02:19:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow primary affinity = true 2024-09-17T02:19:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow pg remap = true 2024-09-17T02:19:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on legacy crush tunables = false 2024-09-17T02:19:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on crush straw calc version zero = false 2024-09-17T02:19:33.509 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on no sortbitwise = false 2024-09-17T02:19:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on osd down out interval zero = false 2024-09-17T02:19:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on too few osds = false 2024-09-17T02:19:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T02:19:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T02:19:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: mon_allow_pool_size_one = true 2024-09-17T02:19:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T02:19:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: osd default data pool replay window = 5 2024-09-17T02:19:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: mon allow pool delete = true 2024-09-17T02:19:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.510 INFO:teuthology.orchestra.run.smithi164.stdout: mon cluster log file level = debug 2024-09-17T02:19:33.511 INFO:teuthology.orchestra.run.smithi164.stdout: debug asserts on shutdown = true 2024-09-17T02:19:33.511 INFO:teuthology.orchestra.run.smithi164.stdout: mon health detail to clog = false 2024-09-17T02:19:33.511 INFO:teuthology.orchestra.run.smithi164.stdout: mon host = "172.21.15.1,[v2:172.21.15.1:3301,v1:172.21.15.1:6790],[v2:172.21.15.1:3302,v1:172.21.15.1:6791]" 2024-09-17T02:19:33.511 INFO:teuthology.orchestra.run.smithi164.stdout: fsid = 37cd4495-4915-41f4-bad2-2394cbe235f3 2024-09-17T02:19:33.511 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.511 INFO:teuthology.orchestra.run.smithi164.stdout:[osd] 2024-09-17T02:19:33.511 INFO:teuthology.orchestra.run.smithi164.stdout: osd journal size = 100 2024-09-17T02:19:33.511 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.511 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub load threshold = 5.0 2024-09-17T02:19:33.511 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub max interval = 600 2024-09-17T02:19:33.511 INFO:teuthology.orchestra.run.smithi164.stdout: osd mclock profile = high_recovery_ops 2024-09-17T02:19:33.511 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.511 INFO:teuthology.orchestra.run.smithi164.stdout: osd recover clone overlap = true 2024-09-17T02:19:33.512 INFO:teuthology.orchestra.run.smithi164.stdout: osd recovery max chunk = 1048576 2024-09-17T02:19:33.512 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.512 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug shutdown = true 2024-09-17T02:19:33.512 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug op order = true 2024-09-17T02:19:33.512 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug verify stray on activate = true 2024-09-17T02:19:33.512 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug trim objects = true 2024-09-17T02:19:33.512 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.512 INFO:teuthology.orchestra.run.smithi164.stdout: osd open classes on start = true 2024-09-17T02:19:33.512 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug pg log writeout = true 2024-09-17T02:19:33.512 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.512 INFO:teuthology.orchestra.run.smithi164.stdout: osd deep scrub update digest min age = 30 2024-09-17T02:19:33.512 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.512 INFO:teuthology.orchestra.run.smithi164.stdout: osd map max advance = 10 2024-09-17T02:19:33.512 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.513 INFO:teuthology.orchestra.run.smithi164.stdout: journal zero on create = true 2024-09-17T02:19:33.513 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.513 INFO:teuthology.orchestra.run.smithi164.stdout: filestore ondisk finisher threads = 3 2024-09-17T02:19:33.513 INFO:teuthology.orchestra.run.smithi164.stdout: filestore apply finisher threads = 3 2024-09-17T02:19:33.513 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.513 INFO:teuthology.orchestra.run.smithi164.stdout: bdev debug aio = true 2024-09-17T02:19:33.513 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug misdirected ops = true 2024-09-17T02:19:33.513 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore block size = 96636764160 2024-09-17T02:19:33.513 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore compression algorithm = zstd 2024-09-17T02:19:33.513 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore compression mode = aggressive 2024-09-17T02:19:33.513 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore fsck on mount = True 2024-09-17T02:19:33.513 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluefs = 1/20 2024-09-17T02:19:33.513 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluestore = 1/20 2024-09-17T02:19:33.514 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-17T02:19:33.514 INFO:teuthology.orchestra.run.smithi164.stdout: debug osd = 20 2024-09-17T02:19:33.514 INFO:teuthology.orchestra.run.smithi164.stdout: debug rocksdb = 4/10 2024-09-17T02:19:33.514 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T02:19:33.514 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd full ratio = 0.9 2024-09-17T02:19:33.514 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd nearfull ratio = 0.8 2024-09-17T02:19:33.514 INFO:teuthology.orchestra.run.smithi164.stdout: osd blocked scrub grace period = 3600 2024-09-17T02:19:33.514 INFO:teuthology.orchestra.run.smithi164.stdout: osd failsafe full ratio = 0.95 2024-09-17T02:19:33.514 INFO:teuthology.orchestra.run.smithi164.stdout: osd max markdown count = 1000 2024-09-17T02:19:33.514 INFO:teuthology.orchestra.run.smithi164.stdout: osd objectstore = bluestore 2024-09-17T02:19:33.514 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.514 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr] 2024-09-17T02:19:33.514 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-17T02:19:33.515 INFO:teuthology.orchestra.run.smithi164.stdout: debug mgr = 20 2024-09-17T02:19:33.515 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-09-17T02:19:33.515 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-09-17T02:19:33.515 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-09-17T02:19:33.515 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-09-17T02:19:33.515 INFO:teuthology.orchestra.run.smithi164.stdout: mgr/telemetry/nag = false 2024-09-17T02:19:33.515 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.515 INFO:teuthology.orchestra.run.smithi164.stdout:[mon] 2024-09-17T02:19:33.515 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-17T02:19:33.515 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-09-17T02:19:33.515 INFO:teuthology.orchestra.run.smithi164.stdout: debug paxos = 20 2024-09-17T02:19:33.515 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-09-17T02:19:33.515 INFO:teuthology.orchestra.run.smithi164.stdout: mon data avail warn = 5 2024-09-17T02:19:33.515 INFO:teuthology.orchestra.run.smithi164.stdout: mon mgr mkfs grace = 240 2024-09-17T02:19:33.516 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-09-17T02:19:33.516 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd reporter subtree level = osd 2024-09-17T02:19:33.516 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd prime pg temp = true 2024-09-17T02:19:33.516 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-09-17T02:19:33.516 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.516 INFO:teuthology.orchestra.run.smithi164.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T02:19:33.516 INFO:teuthology.orchestra.run.smithi164.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T02:19:33.516 INFO:teuthology.orchestra.run.smithi164.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T02:19:33.516 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.516 INFO:teuthology.orchestra.run.smithi164.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T02:19:33.516 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T02:19:33.516 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T02:19:33.516 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.517 INFO:teuthology.orchestra.run.smithi164.stdout: # 1m isn't quite enough 2024-09-17T02:19:33.517 INFO:teuthology.orchestra.run.smithi164.stdout: mon_down_mkfs_grace = 2m 2024-09-17T02:19:33.517 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.517 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_filestore_osds = false 2024-09-17T02:19:33.517 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T02:19:33.517 INFO:teuthology.orchestra.run.smithi164.stdout:[client] 2024-09-17T02:19:33.517 INFO:teuthology.orchestra.run.smithi164.stdout: rgw cache enabled = true 2024-09-17T02:19:33.517 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable ops log = true 2024-09-17T02:19:33.517 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable usage log = true 2024-09-17T02:19:33.517 INFO:teuthology.orchestra.run.smithi164.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T02:19:33.517 INFO:teuthology.orchestra.run.smithi164.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T02:19:33.517 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.a] 2024-09-17T02:19:33.517 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.b] 2024-09-17T02:19:33.517 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.c] 2024-09-17T02:19:33.518 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2024-09-17T02:19:33.518 INFO:teuthology.orchestra.run.smithi164.stdout:[client.0] 2024-09-17T02:19:33.518 INFO:teuthology.orchestra.run.smithi164.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-09-17T02:19:33.518 INFO:teuthology.orchestra.run.smithi032.stdout:[global] 2024-09-17T02:19:33.518 INFO:teuthology.orchestra.run.smithi032.stdout: chdir = "" 2024-09-17T02:19:33.518 INFO:teuthology.orchestra.run.smithi032.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T02:19:33.518 INFO:teuthology.orchestra.run.smithi032.stdout: auth supported = cephx 2024-09-17T02:19:33.518 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.518 INFO:teuthology.orchestra.run.smithi032.stdout: filestore xattr use omap = true 2024-09-17T02:19:33.518 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.518 INFO:teuthology.orchestra.run.smithi032.stdout: mon clock drift allowed = 1.000 2024-09-17T02:19:33.518 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.519 INFO:teuthology.orchestra.run.smithi032.stdout: osd crush chooseleaf type = 0 2024-09-17T02:19:33.519 INFO:teuthology.orchestra.run.smithi032.stdout: auth debug = true 2024-09-17T02:19:33.519 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.519 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on old message = true 2024-09-17T02:19:33.519 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on bug = true 2024-09-17T02:19:33.519 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.519 INFO:teuthology.orchestra.run.smithi032.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T02:19:33.519 INFO:teuthology.orchestra.run.smithi032.stdout: mon pg warn max object skew = 0 2024-09-17T02:19:33.519 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.519 INFO:teuthology.orchestra.run.smithi032.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T02:19:33.519 INFO:teuthology.orchestra.run.smithi032.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T02:19:33.519 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.520 INFO:teuthology.orchestra.run.smithi032.stdout: osd pool default size = 2 2024-09-17T02:19:33.520 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.520 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd allow primary affinity = true 2024-09-17T02:19:33.520 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd allow pg remap = true 2024-09-17T02:19:33.520 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on legacy crush tunables = false 2024-09-17T02:19:33.520 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on crush straw calc version zero = false 2024-09-17T02:19:33.520 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on no sortbitwise = false 2024-09-17T02:19:33.520 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on osd down out interval zero = false 2024-09-17T02:19:33.520 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on too few osds = false 2024-09-17T02:19:33.520 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T02:19:33.520 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T02:19:33.520 INFO:teuthology.orchestra.run.smithi032.stdout: mon_allow_pool_size_one = true 2024-09-17T02:19:33.520 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.521 INFO:teuthology.orchestra.run.smithi032.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T02:19:33.521 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.521 INFO:teuthology.orchestra.run.smithi032.stdout: osd default data pool replay window = 5 2024-09-17T02:19:33.521 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.521 INFO:teuthology.orchestra.run.smithi032.stdout: mon allow pool delete = true 2024-09-17T02:19:33.521 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.521 INFO:teuthology.orchestra.run.smithi032.stdout: mon cluster log file level = debug 2024-09-17T02:19:33.521 INFO:teuthology.orchestra.run.smithi032.stdout: debug asserts on shutdown = true 2024-09-17T02:19:33.521 INFO:teuthology.orchestra.run.smithi032.stdout: mon health detail to clog = false 2024-09-17T02:19:33.521 INFO:teuthology.orchestra.run.smithi032.stdout: mon host = "172.21.15.1,[v2:172.21.15.1:3301,v1:172.21.15.1:6790],[v2:172.21.15.1:3302,v1:172.21.15.1:6791]" 2024-09-17T02:19:33.521 INFO:teuthology.orchestra.run.smithi032.stdout: fsid = 37cd4495-4915-41f4-bad2-2394cbe235f3 2024-09-17T02:19:33.521 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.521 INFO:teuthology.orchestra.run.smithi032.stdout:[osd] 2024-09-17T02:19:33.522 INFO:teuthology.orchestra.run.smithi032.stdout: osd journal size = 100 2024-09-17T02:19:33.522 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.522 INFO:teuthology.orchestra.run.smithi032.stdout: osd scrub load threshold = 5.0 2024-09-17T02:19:33.522 INFO:teuthology.orchestra.run.smithi032.stdout: osd scrub max interval = 600 2024-09-17T02:19:33.522 INFO:teuthology.orchestra.run.smithi032.stdout: osd mclock profile = high_recovery_ops 2024-09-17T02:19:33.522 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.522 INFO:teuthology.orchestra.run.smithi032.stdout: osd recover clone overlap = true 2024-09-17T02:19:33.522 INFO:teuthology.orchestra.run.smithi032.stdout: osd recovery max chunk = 1048576 2024-09-17T02:19:33.522 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.522 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug shutdown = true 2024-09-17T02:19:33.522 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug op order = true 2024-09-17T02:19:33.522 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug verify stray on activate = true 2024-09-17T02:19:33.522 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug trim objects = true 2024-09-17T02:19:33.522 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.523 INFO:teuthology.orchestra.run.smithi032.stdout: osd open classes on start = true 2024-09-17T02:19:33.523 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug pg log writeout = true 2024-09-17T02:19:33.523 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.523 INFO:teuthology.orchestra.run.smithi032.stdout: osd deep scrub update digest min age = 30 2024-09-17T02:19:33.523 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.523 INFO:teuthology.orchestra.run.smithi032.stdout: osd map max advance = 10 2024-09-17T02:19:33.523 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.523 INFO:teuthology.orchestra.run.smithi032.stdout: journal zero on create = true 2024-09-17T02:19:33.523 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.523 INFO:teuthology.orchestra.run.smithi032.stdout: filestore ondisk finisher threads = 3 2024-09-17T02:19:33.523 INFO:teuthology.orchestra.run.smithi032.stdout: filestore apply finisher threads = 3 2024-09-17T02:19:33.523 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.523 INFO:teuthology.orchestra.run.smithi032.stdout: bdev debug aio = true 2024-09-17T02:19:33.524 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug misdirected ops = true 2024-09-17T02:19:33.524 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore block size = 96636764160 2024-09-17T02:19:33.524 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore compression algorithm = zstd 2024-09-17T02:19:33.524 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore compression mode = aggressive 2024-09-17T02:19:33.524 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore fsck on mount = True 2024-09-17T02:19:33.524 INFO:teuthology.orchestra.run.smithi032.stdout: debug bluefs = 1/20 2024-09-17T02:19:33.524 INFO:teuthology.orchestra.run.smithi032.stdout: debug bluestore = 1/20 2024-09-17T02:19:33.524 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-09-17T02:19:33.524 INFO:teuthology.orchestra.run.smithi032.stdout: debug osd = 20 2024-09-17T02:19:33.524 INFO:teuthology.orchestra.run.smithi032.stdout: debug rocksdb = 4/10 2024-09-17T02:19:33.524 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T02:19:33.524 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd full ratio = 0.9 2024-09-17T02:19:33.524 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd nearfull ratio = 0.8 2024-09-17T02:19:33.525 INFO:teuthology.orchestra.run.smithi032.stdout: osd blocked scrub grace period = 3600 2024-09-17T02:19:33.525 INFO:teuthology.orchestra.run.smithi032.stdout: osd failsafe full ratio = 0.95 2024-09-17T02:19:33.525 INFO:teuthology.orchestra.run.smithi032.stdout: osd max markdown count = 1000 2024-09-17T02:19:33.525 INFO:teuthology.orchestra.run.smithi032.stdout: osd objectstore = bluestore 2024-09-17T02:19:33.525 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.525 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr] 2024-09-17T02:19:33.525 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-09-17T02:19:33.525 INFO:teuthology.orchestra.run.smithi032.stdout: debug mgr = 20 2024-09-17T02:19:33.525 INFO:teuthology.orchestra.run.smithi032.stdout: debug mon = 20 2024-09-17T02:19:33.525 INFO:teuthology.orchestra.run.smithi032.stdout: debug auth = 20 2024-09-17T02:19:33.525 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min pgs per osd = 4 2024-09-17T02:19:33.525 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min bytes per osd = 10 2024-09-17T02:19:33.525 INFO:teuthology.orchestra.run.smithi032.stdout: mgr/telemetry/nag = false 2024-09-17T02:19:33.526 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.526 INFO:teuthology.orchestra.run.smithi032.stdout:[mon] 2024-09-17T02:19:33.526 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-09-17T02:19:33.526 INFO:teuthology.orchestra.run.smithi032.stdout: debug mon = 20 2024-09-17T02:19:33.526 INFO:teuthology.orchestra.run.smithi032.stdout: debug paxos = 20 2024-09-17T02:19:33.526 INFO:teuthology.orchestra.run.smithi032.stdout: debug auth = 20 2024-09-17T02:19:33.526 INFO:teuthology.orchestra.run.smithi032.stdout: mon data avail warn = 5 2024-09-17T02:19:33.526 INFO:teuthology.orchestra.run.smithi032.stdout: mon mgr mkfs grace = 240 2024-09-17T02:19:33.526 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min pgs per osd = 4 2024-09-17T02:19:33.526 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd reporter subtree level = osd 2024-09-17T02:19:33.526 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd prime pg temp = true 2024-09-17T02:19:33.526 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min bytes per osd = 10 2024-09-17T02:19:33.526 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.526 INFO:teuthology.orchestra.run.smithi032.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T02:19:33.526 INFO:teuthology.orchestra.run.smithi032.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T02:19:33.527 INFO:teuthology.orchestra.run.smithi032.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T02:19:33.527 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.527 INFO:teuthology.orchestra.run.smithi032.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T02:19:33.527 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T02:19:33.527 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T02:19:33.527 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.527 INFO:teuthology.orchestra.run.smithi032.stdout: # 1m isn't quite enough 2024-09-17T02:19:33.527 INFO:teuthology.orchestra.run.smithi032.stdout: mon_down_mkfs_grace = 2m 2024-09-17T02:19:33.527 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.527 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_filestore_osds = false 2024-09-17T02:19:33.527 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-17T02:19:33.527 INFO:teuthology.orchestra.run.smithi032.stdout:[client] 2024-09-17T02:19:33.527 INFO:teuthology.orchestra.run.smithi032.stdout: rgw cache enabled = true 2024-09-17T02:19:33.528 INFO:teuthology.orchestra.run.smithi032.stdout: rgw enable ops log = true 2024-09-17T02:19:33.528 INFO:teuthology.orchestra.run.smithi032.stdout: rgw enable usage log = true 2024-09-17T02:19:33.528 INFO:teuthology.orchestra.run.smithi032.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T02:19:33.528 INFO:teuthology.orchestra.run.smithi032.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T02:19:33.528 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.a] 2024-09-17T02:19:33.528 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.b] 2024-09-17T02:19:33.528 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.c] 2024-09-17T02:19:33.528 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.a] 2024-09-17T02:19:33.528 INFO:teuthology.orchestra.run.smithi032.stdout:[client.0] 2024-09-17T02:19:33.528 INFO:teuthology.orchestra.run.smithi032.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-09-17T02:19:33.528 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2024-09-17T02:19:33.528 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2024-09-17T02:19:33.529 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T02:19:33.529 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2024-09-17T02:19:33.529 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.529 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2024-09-17T02:19:33.529 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.529 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2024-09-17T02:19:33.529 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.529 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2024-09-17T02:19:33.529 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2024-09-17T02:19:33.529 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.529 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2024-09-17T02:19:33.529 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2024-09-17T02:19:33.529 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.530 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T02:19:33.530 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2024-09-17T02:19:33.530 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.530 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T02:19:33.530 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T02:19:33.530 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.530 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2024-09-17T02:19:33.530 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.530 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2024-09-17T02:19:33.530 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2024-09-17T02:19:33.530 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2024-09-17T02:19:33.530 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2024-09-17T02:19:33.530 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2024-09-17T02:19:33.531 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2024-09-17T02:19:33.531 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2024-09-17T02:19:33.531 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T02:19:33.531 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T02:19:33.531 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2024-09-17T02:19:33.531 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.531 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T02:19:33.531 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.531 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2024-09-17T02:19:33.531 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.531 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2024-09-17T02:19:33.531 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.531 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2024-09-17T02:19:33.531 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2024-09-17T02:19:33.532 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2024-09-17T02:19:33.532 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.1,[v2:172.21.15.1:3301,v1:172.21.15.1:6790],[v2:172.21.15.1:3302,v1:172.21.15.1:6791]" 2024-09-17T02:19:33.532 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = 37cd4495-4915-41f4-bad2-2394cbe235f3 2024-09-17T02:19:33.532 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.532 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2024-09-17T02:19:33.532 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2024-09-17T02:19:33.532 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.532 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2024-09-17T02:19:33.532 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2024-09-17T02:19:33.532 INFO:teuthology.orchestra.run.smithi153.stdout: osd mclock profile = high_recovery_ops 2024-09-17T02:19:33.532 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.532 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2024-09-17T02:19:33.533 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2024-09-17T02:19:33.533 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.533 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2024-09-17T02:19:33.533 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2024-09-17T02:19:33.533 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2024-09-17T02:19:33.533 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug trim objects = true 2024-09-17T02:19:33.533 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.533 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2024-09-17T02:19:33.533 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2024-09-17T02:19:33.533 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.533 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2024-09-17T02:19:33.533 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.533 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2024-09-17T02:19:33.534 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.534 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2024-09-17T02:19:33.534 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.534 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2024-09-17T02:19:33.534 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2024-09-17T02:19:33.534 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.534 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2024-09-17T02:19:33.534 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2024-09-17T02:19:33.534 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2024-09-17T02:19:33.534 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore compression algorithm = zstd 2024-09-17T02:19:33.534 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore compression mode = aggressive 2024-09-17T02:19:33.534 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2024-09-17T02:19:33.534 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 1/20 2024-09-17T02:19:33.535 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 1/20 2024-09-17T02:19:33.535 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-17T02:19:33.535 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2024-09-17T02:19:33.535 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 4/10 2024-09-17T02:19:33.535 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T02:19:33.535 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2024-09-17T02:19:33.535 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2024-09-17T02:19:33.535 INFO:teuthology.orchestra.run.smithi153.stdout: osd blocked scrub grace period = 3600 2024-09-17T02:19:33.535 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2024-09-17T02:19:33.535 INFO:teuthology.orchestra.run.smithi153.stdout: osd max markdown count = 1000 2024-09-17T02:19:33.535 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2024-09-17T02:19:33.535 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.535 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2024-09-17T02:19:33.536 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-17T02:19:33.536 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2024-09-17T02:19:33.536 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-09-17T02:19:33.536 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-09-17T02:19:33.536 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-09-17T02:19:33.536 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-09-17T02:19:33.536 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2024-09-17T02:19:33.536 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.536 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2024-09-17T02:19:33.536 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-17T02:19:33.536 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-09-17T02:19:33.536 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2024-09-17T02:19:33.536 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-09-17T02:19:33.536 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2024-09-17T02:19:33.537 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2024-09-17T02:19:33.537 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-09-17T02:19:33.537 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2024-09-17T02:19:33.537 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2024-09-17T02:19:33.537 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-09-17T02:19:33.537 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.537 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T02:19:33.537 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T02:19:33.537 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T02:19:33.537 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.537 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T02:19:33.537 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T02:19:33.538 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T02:19:33.538 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.538 INFO:teuthology.orchestra.run.smithi153.stdout: # 1m isn't quite enough 2024-09-17T02:19:33.538 INFO:teuthology.orchestra.run.smithi153.stdout: mon_down_mkfs_grace = 2m 2024-09-17T02:19:33.538 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.538 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_filestore_osds = false 2024-09-17T02:19:33.538 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T02:19:33.538 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2024-09-17T02:19:33.538 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2024-09-17T02:19:33.538 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2024-09-17T02:19:33.538 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2024-09-17T02:19:33.538 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T02:19:33.538 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T02:19:33.538 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2024-09-17T02:19:33.539 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2024-09-17T02:19:33.539 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2024-09-17T02:19:33.539 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2024-09-17T02:19:33.539 INFO:teuthology.orchestra.run.smithi153.stdout:[client.0] 2024-09-17T02:19:33.539 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-09-17T02:19:33.541 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-17T02:19:33.541 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-17T02:19:33.631 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-17T02:19:33.631 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-17T02:19:33.631 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-17T02:19:33.636 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-17T02:19:33.636 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-17T02:19:33.685 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi001.front.sepia.ceph.com 2024-09-17T02:19:33.685 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-17T02:19:33.685 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T02:19:33.685 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T02:19:33.749 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-17T02:19:33.750 DEBUG:teuthology.orchestra.run.smithi001:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T02:19:33.797 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi032.front.sepia.ceph.com 2024-09-17T02:19:33.797 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-17T02:19:33.797 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T02:19:33.798 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T02:19:33.821 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-17T02:19:33.821 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T02:19:33.867 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi153.front.sepia.ceph.com 2024-09-17T02:19:33.867 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T02:19:33.867 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T02:19:33.867 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T02:19:33.891 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T02:19:33.891 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T02:19:33.940 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi164.front.sepia.ceph.com 2024-09-17T02:19:33.940 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T02:19:33.940 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T02:19:33.940 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T02:19:33.963 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T02:19:33.963 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T02:19:34.011 INFO:tasks.ceph:Setting up mon nodes... 2024-09-17T02:19:34.012 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-17T02:19:34.012 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T02:19:34.057 INFO:teuthology.orchestra.run.smithi001.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T02:19:34.060 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T02:19:34.102 INFO:teuthology.orchestra.run.smithi001.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T02:19:34.105 INFO:tasks.ceph:Setting up mds nodes... 2024-09-17T02:19:34.105 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T02:19:34.191 INFO:teuthology.orchestra.run.smithi001.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T02:19:34.193 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-17T02:19:34.248 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-17T02:19:34.248 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T02:19:34.323 INFO:teuthology.orchestra.run.smithi001.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-17T02:19:34.335 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-17T02:19:34.336 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi032.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-09-17T02:19:34.336 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-17T02:19:34.351 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-17T02:19:34.351 INFO:tasks.ceph:role: osd.0 2024-09-17T02:19:34.351 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi032.front.sepia.ceph.com 2024-09-17T02:19:34.351 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T02:19:34.407 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T02:19:34.408 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T02:19:34.408 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T02:19:34.408 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T02:19:34.408 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T02:19:34.408 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-09-17T02:19:34.408 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T02:19:34.408 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T02:19:34.408 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T02:19:34.408 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T02:19:34.432 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-09-17T02:19:34.434 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-09-17T02:19:34.434 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-17T02:19:34.494 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-17T02:19:34.548 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:19:34.548 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T02:19:34.548 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T02:19:34.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-17T02:19:34.705+0000 7f949210a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-17T02:19:34.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-17T02:19:34.705+0000 7f949210a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-17T02:19:34.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-17T02:19:34.705+0000 7f949210a7c0 -1 bdev(0x55efdaaa3800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-17T02:19:34.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-17T02:19:34.705+0000 7f949210a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-17T02:19:37.954 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T02:19:37.968 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-17T02:19:37.982 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-09-17T02:19:37.983 INFO:tasks.ceph:role: osd.1 2024-09-17T02:19:37.983 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-17T02:19:37.983 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T02:19:38.046 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T02:19:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T02:19:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T02:19:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T02:19:38.047 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T02:19:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-09-17T02:19:38.047 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T02:19:38.047 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T02:19:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T02:19:38.047 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T02:19:38.531 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-09-17T02:19:38.533 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-09-17T02:19:38.533 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-17T02:19:38.679 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-17T02:19:38.691 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:19:38.691 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T02:19:38.691 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T02:19:38.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T02:19:38.812+0000 7f39ba4dd7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-17T02:19:38.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T02:19:38.820+0000 7f39ba4dd7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-17T02:19:38.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T02:19:38.820+0000 7f39ba4dd7c0 -1 bdev(0x55b63593d800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-17T02:19:38.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T02:19:38.820+0000 7f39ba4dd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-17T02:19:41.948 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T02:19:41.962 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-17T02:19:41.976 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-09-17T02:19:41.976 INFO:tasks.ceph:role: osd.2 2024-09-17T02:19:41.976 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-17T02:19:41.976 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T02:19:42.038 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T02:19:42.038 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T02:19:42.039 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T02:19:42.039 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T02:19:42.039 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T02:19:42.039 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-09-17T02:19:42.039 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T02:19:42.039 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T02:19:42.039 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T02:19:42.039 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T02:19:42.530 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-09-17T02:19:42.532 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-09-17T02:19:42.532 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-17T02:19:42.681 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-17T02:19:42.693 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:19:42.694 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T02:19:42.694 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T02:19:42.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T02:19:42.814+0000 7f9dbe8a47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-17T02:19:42.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T02:19:42.818+0000 7f9dbe8a47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-17T02:19:42.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T02:19:42.818+0000 7f9dbe8a47c0 -1 bdev(0x562dd38db800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-17T02:19:42.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T02:19:42.818+0000 7f9dbe8a47c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-17T02:19:46.010 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T02:19:46.024 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-17T02:19:46.024 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-17T02:19:46.024 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-17T02:19:46.038 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-17T02:19:46.038 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-17T02:19:46.093 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-17T02:19:46.094 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-17T02:19:46.149 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-17T02:19:46.149 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-17T02:19:46.163 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T02:19:46.164 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-17T02:19:46.178 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T02:19:46.178 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-17T02:19:46.191 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-17T02:19:46.192 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-17T02:19:46.197 INFO:tasks.ceph:Adding keys to all mons... 2024-09-17T02:19:46.197 DEBUG:teuthology.orchestra.run.smithi001:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T02:19:46.251 INFO:teuthology.orchestra.run.smithi001.stdout:[mgr.x] 2024-09-17T02:19:46.251 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQA25+hmr7+6AxAADFBxRcwxx41J5ax2fSLEfQ== 2024-09-17T02:19:46.251 INFO:teuthology.orchestra.run.smithi001.stdout:[mgr.y] 2024-09-17T02:19:46.251 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQA25+hmXFBkBhAAA3C/EM58EosnpOXpfUuXwA== 2024-09-17T02:19:46.251 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.a] 2024-09-17T02:19:46.251 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQA25+hmBtCxCxAAaYb/ajDrfuL2izSBCuQI2w== 2024-09-17T02:19:46.251 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.0] 2024-09-17T02:19:46.252 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQA25+hmMXgrKhAAB+5/5fcOGMJ8TNHLYCJzNw== 2024-09-17T02:19:46.252 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.1] 2024-09-17T02:19:46.252 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQA65+hmO2uNMBAAH7fVTivCs3eX1un9RFAhsw== 2024-09-17T02:19:46.252 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.2] 2024-09-17T02:19:46.252 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQA+5+hmdCzbMBAAxFJzMfIdXwwdZIrGYnJAqA== 2024-09-17T02:19:46.252 INFO:teuthology.orchestra.run.smithi001.stdout:[client.0] 2024-09-17T02:19:46.252 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQA25+hmxvuVExAA+PIFU5dJHbg7BW994oYJRA== 2024-09-17T02:19:46.253 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T02:19:46.344 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T02:19:46.388 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T02:19:46.475 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T02:19:46.516 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T02:19:46.598 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T02:19:46.683 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T02:19:46.770 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-17T02:19:46.770 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-17T02:19:46.781 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T02:19:46.893 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-17T02:19:46.904 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-17T02:19:46.954 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T02:19:47.041 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-17T02:19:47.053 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-17T02:19:47.113 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T02:19:47.210 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-17T02:19:47.223 DEBUG:teuthology.orchestra.run.smithi001:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T02:19:47.269 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-17T02:19:47.269 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-17T02:19:47.270 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-17T02:19:47.314 INFO:tasks.ceph.mon.a:Started 2024-09-17T02:19:47.314 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-17T02:19:47.315 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-17T02:19:47.316 INFO:tasks.ceph.mon.b:Started 2024-09-17T02:19:47.316 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-17T02:19:47.317 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-17T02:19:47.319 INFO:tasks.ceph.mon.c:Started 2024-09-17T02:19:47.319 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-17T02:19:47.319 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-17T02:19:47.319 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-17T02:19:47.321 INFO:tasks.ceph.mgr.x:Started 2024-09-17T02:19:47.321 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-17T02:19:47.321 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-17T02:19:47.323 INFO:tasks.ceph.mgr.y:Started 2024-09-17T02:19:47.323 INFO:tasks.ceph:Setting crush tunables to default 2024-09-17T02:19:47.323 DEBUG:teuthology.orchestra.run.smithi001:> sudo ceph --cluster ceph osd crush tunables default 2024-09-17T02:19:52.839 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-17T02:19:52.841+0000 7f914b6b9180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T02:19:53.328 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-17T02:19:53.329+0000 7f914b6b9180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T02:19:53.525 INFO:tasks.ceph.mgr.x.smithi001.stderr:2024-09-17T02:19:53.525+0000 7ff15c81a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T02:19:53.536 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-17T02:19:53.537+0000 7f914b6b9180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T02:19:53.551 INFO:teuthology.orchestra.run.smithi001.stderr:adjusted tunables profile to default 2024-09-17T02:19:53.572 INFO:tasks.ceph:check_enable_crimson: False 2024-09-17T02:19:53.572 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-17T02:19:53.573 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-17T02:19:53.573 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-17T02:19:53.587 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T02:19:53.587 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-17T02:19:53.602 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T02:19:53.603 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-17T02:19:53.617 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new fae746a8-754d-4e52-9819-004ebb0d6886 0 2024-09-17T02:19:53.883 INFO:teuthology.orchestra.run.smithi164.stdout:0 2024-09-17T02:19:53.900 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new c9397688-80ca-4c21-b80d-1740194c389d 1 2024-09-17T02:19:53.923 INFO:tasks.ceph.mgr.x.smithi001.stderr:2024-09-17T02:19:53.925+0000 7ff15c81a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T02:19:54.061 INFO:tasks.ceph.mgr.x.smithi001.stderr:2024-09-17T02:19:54.065+0000 7ff15c81a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T02:19:54.117 INFO:teuthology.orchestra.run.smithi164.stdout:1 2024-09-17T02:19:54.133 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 6d8c01a8-b657-4abc-a624-2b35ef0512ea 2 2024-09-17T02:19:54.147 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-17T02:19:54.149+0000 7f914b6b9180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T02:19:54.204 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-17T02:19:54.205+0000 7f914b6b9180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T02:19:54.260 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-17T02:19:54.261+0000 7f914b6b9180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T02:19:54.328 INFO:teuthology.orchestra.run.smithi164.stdout:2 2024-09-17T02:19:54.343 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-17T02:19:54.344 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-17T02:19:54.344 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-17T02:19:54.345+0000 7f914b6b9180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T02:19:54.346 INFO:tasks.ceph.osd.0:Started 2024-09-17T02:19:54.346 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-17T02:19:54.346 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-17T02:19:54.349 INFO:tasks.ceph.osd.1:Started 2024-09-17T02:19:54.350 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-17T02:19:54.350 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-17T02:19:54.352 INFO:tasks.ceph.osd.2:Started 2024-09-17T02:19:54.353 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:19:54.400 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-17T02:19:54.401+0000 7f914b6b9180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T02:19:54.486 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-17T02:19:54.489+0000 7f914b6b9180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T02:19:54.516 INFO:tasks.ceph.mgr.x.smithi001.stderr:2024-09-17T02:19:54.517+0000 7ff15c81a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T02:19:54.544 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-17T02:19:54.545+0000 7f914b6b9180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T02:19:54.561 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:19:54.561 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":5,"fsid":"37cd4495-4915-41f4-bad2-2394cbe235f3","created":"2024-09-17T02:19:52.516342+0000","modified":"2024-09-17T02:19:54.329423+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T02:19:54.329423+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"fae746a8-754d-4e52-9819-004ebb0d6886","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c9397688-80ca-4c21-b80d-1740194c389d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6d8c01a8-b657-4abc-a624-2b35ef0512ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:19:54.573 INFO:tasks.ceph.mgr.x.smithi001.stderr:2024-09-17T02:19:54.577+0000 7ff15c81a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T02:19:54.578 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-17T02:19:54.578 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-17T02:19:54.625 INFO:tasks.ceph.mgr.x.smithi001.stderr:2024-09-17T02:19:54.625+0000 7ff15c81a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T02:19:54.703 INFO:tasks.ceph.mgr.x.smithi001.stderr:2024-09-17T02:19:54.705+0000 7ff15c81a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T02:19:54.706 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-17T02:19:54.709+0000 7f914b6b9180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T02:19:54.755 INFO:tasks.ceph.mgr.x.smithi001.stderr:2024-09-17T02:19:54.757+0000 7ff15c81a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T02:19:54.772 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-17T02:19:54.773+0000 7f914b6b9180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T02:19:54.832 INFO:tasks.ceph.mgr.x.smithi001.stderr:2024-09-17T02:19:54.833+0000 7ff15c81a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T02:19:54.879 DEBUG:teuthology.orchestra.run.smithi001:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T02:19:54.885 INFO:tasks.ceph.mgr.x.smithi001.stderr:2024-09-17T02:19:54.889+0000 7ff15c81a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T02:19:55.050 INFO:tasks.ceph.mgr.x.smithi001.stderr:2024-09-17T02:19:55.053+0000 7ff15c81a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T02:19:55.108 INFO:teuthology.misc.health.smithi001.stdout: 2024-09-17T02:19:55.108 INFO:teuthology.misc.health.smithi001.stdout:{"epoch":5,"fsid":"37cd4495-4915-41f4-bad2-2394cbe235f3","created":"2024-09-17T02:19:52.516342+0000","modified":"2024-09-17T02:19:54.329423+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T02:19:54.329423+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"fae746a8-754d-4e52-9819-004ebb0d6886","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c9397688-80ca-4c21-b80d-1740194c389d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6d8c01a8-b657-4abc-a624-2b35ef0512ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:19:55.135 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-17T02:19:55.145 INFO:tasks.ceph.mgr.x.smithi001.stderr:2024-09-17T02:19:55.149+0000 7ff15c81a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T02:19:55.379 INFO:tasks.ceph.mgr.x.smithi001.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-17T02:19:55.379 INFO:tasks.ceph.mgr.x.smithi001.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-17T02:19:55.379 INFO:tasks.ceph.mgr.x.smithi001.stderr: from numpy import show_config as show_numpy_config 2024-09-17T02:19:55.380 INFO:tasks.ceph.mgr.y.smithi001.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-17T02:19:55.380 INFO:tasks.ceph.mgr.y.smithi001.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-17T02:19:55.380 INFO:tasks.ceph.mgr.y.smithi001.stderr: from numpy import show_config as show_numpy_config 2024-09-17T02:19:55.420 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:19:55.424+0000 7fd489bd57c0 -1 Falling back to public interface 2024-09-17T02:19:55.426 INFO:tasks.ceph.mgr.x.smithi001.stderr:2024-09-17T02:19:55.429+0000 7ff15c81a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T02:19:55.427 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-17T02:19:55.429+0000 7f914b6b9180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T02:19:55.460 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:19:55.462+0000 7fcbbbeec7c0 -1 Falling back to public interface 2024-09-17T02:19:55.569 INFO:tasks.ceph.mgr.x.smithi001.stderr:2024-09-17T02:19:55.573+0000 7ff15c81a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T02:19:55.581 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-17T02:19:55.581+0000 7f914b6b9180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T02:19:55.660 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:19:55.665+0000 7f252317e7c0 -1 Falling back to public interface 2024-09-17T02:19:55.732 INFO:tasks.ceph.mgr.x.smithi001.stderr:2024-09-17T02:19:55.733+0000 7ff15c81a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T02:19:55.732 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-17T02:19:55.733+0000 7f914b6b9180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T02:19:55.798 INFO:tasks.ceph.mgr.x.smithi001.stderr:2024-09-17T02:19:55.801+0000 7ff15c81a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T02:19:55.800 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-17T02:19:55.801+0000 7f914b6b9180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T02:19:55.942 INFO:tasks.ceph.mgr.x.smithi001.stderr:2024-09-17T02:19:55.945+0000 7ff15c81a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T02:19:55.946 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-17T02:19:55.949+0000 7f914b6b9180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T02:19:56.599 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-17T02:19:56.601+0000 7f914b6b9180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T02:19:56.599 INFO:tasks.ceph.mgr.x.smithi001.stderr:2024-09-17T02:19:56.601+0000 7ff15c81a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T02:19:56.679 INFO:tasks.ceph.mgr.x.smithi001.stderr:2024-09-17T02:19:56.681+0000 7ff15c81a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T02:19:56.680 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-17T02:19:56.681+0000 7f914b6b9180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T02:19:56.873 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-17T02:19:56.873+0000 7f914b6b9180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T02:19:56.873 INFO:tasks.ceph.mgr.x.smithi001.stderr:2024-09-17T02:19:56.873+0000 7ff15c81a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T02:19:56.950 INFO:tasks.ceph.mgr.x.smithi001.stderr:2024-09-17T02:19:56.953+0000 7ff15c81a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T02:19:56.951 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-17T02:19:56.953+0000 7f914b6b9180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T02:19:57.258 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-17T02:19:57.261+0000 7f914b6b9180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T02:19:57.258 INFO:tasks.ceph.mgr.x.smithi001.stderr:2024-09-17T02:19:57.261+0000 7ff15c81a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T02:19:57.323 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-17T02:19:57.325+0000 7f914b6b9180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T02:19:57.323 INFO:tasks.ceph.mgr.x.smithi001.stderr:2024-09-17T02:19:57.325+0000 7ff15c81a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T02:19:58.353 INFO:tasks.ceph.mgr.x.smithi001.stderr:2024-09-17T02:19:58.357+0000 7ff103450640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-17T02:19:58.354 INFO:tasks.ceph.mgr.x.smithi001.stderr:2024-09-17T02:19:58.357+0000 7ff103450640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-17T02:19:59.269 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:19:59.272+0000 7fd489bd57c0 -1 osd.1 0 log_to_monitors true 2024-09-17T02:19:59.304 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:19:59.306+0000 7fcbbbeec7c0 -1 osd.2 0 log_to_monitors true 2024-09-17T02:19:59.496 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:19:59.501+0000 7f252317e7c0 -1 osd.0 0 log_to_monitors true 2024-09-17T02:20:01.224 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:01.226+0000 7fcbb86a7640 -1 osd.2 0 waiting for initial osdmap 2024-09-17T02:20:01.227 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:01.232+0000 7fd486390640 -1 osd.1 0 waiting for initial osdmap 2024-09-17T02:20:01.243 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:01.246+0000 7fcbafcca640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T02:20:01.251 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:01.256+0000 7fd47d9b3640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T02:20:01.438 DEBUG:teuthology.orchestra.run.smithi001:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T02:20:01.739 INFO:teuthology.misc.health.smithi001.stdout: 2024-09-17T02:20:01.739 INFO:teuthology.misc.health.smithi001.stdout:{"epoch":8,"fsid":"37cd4495-4915-41f4-bad2-2394cbe235f3","created":"2024-09-17T02:19:52.516342+0000","modified":"2024-09-17T02:20:01.407203+0000","last_up_change":"2024-09-17T02:20:01.407203+0000","last_in_change":"2024-09-17T02:19:54.329423+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"fae746a8-754d-4e52-9819-004ebb0d6886","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c9397688-80ca-4c21-b80d-1740194c389d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6801","nonce":1905904204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6803","nonce":1905904204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6807","nonce":1905904204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6805","nonce":1905904204}]},"public_addr":"172.21.15.153:6801/1905904204","cluster_addr":"172.21.15.153:6803/1905904204","heartbeat_back_addr":"172.21.15.153:6807/1905904204","heartbeat_front_addr":"172.21.15.153:6805/1905904204","state":["exists","up"]},{"osd":2,"uuid":"6d8c01a8-b657-4abc-a624-2b35ef0512ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6801","nonce":603659517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6803","nonce":603659517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6807","nonce":603659517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6805","nonce":603659517}]},"public_addr":"172.21.15.164:6801/603659517","cluster_addr":"172.21.15.164:6803/603659517","heartbeat_back_addr":"172.21.15.164:6807/603659517","heartbeat_front_addr":"172.21.15.164:6805/603659517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:20:01.757 DEBUG:teuthology.misc:2 of 3 OSDs are up 2024-09-17T02:20:02.290 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:02.297+0000 7f251f127640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T02:20:02.311 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:02.317+0000 7f2516f5c640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T02:20:08.058 DEBUG:teuthology.orchestra.run.smithi001:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T02:20:08.362 INFO:teuthology.misc.health.smithi001.stdout: 2024-09-17T02:20:08.363 INFO:teuthology.misc.health.smithi001.stdout:{"epoch":12,"fsid":"37cd4495-4915-41f4-bad2-2394cbe235f3","created":"2024-09-17T02:19:52.516342+0000","modified":"2024-09-17T02:20:05.453584+0000","last_up_change":"2024-09-17T02:20:02.422255+0000","last_in_change":"2024-09-17T02:19:54.329423+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:20:03.416336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fae746a8-754d-4e52-9819-004ebb0d6886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6801","nonce":2347677104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6803","nonce":2347677104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6807","nonce":2347677104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6805","nonce":2347677104}]},"public_addr":"172.21.15.32:6801/2347677104","cluster_addr":"172.21.15.32:6803/2347677104","heartbeat_back_addr":"172.21.15.32:6807/2347677104","heartbeat_front_addr":"172.21.15.32:6805/2347677104","state":["exists","up"]},{"osd":1,"uuid":"c9397688-80ca-4c21-b80d-1740194c389d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6801","nonce":1905904204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6803","nonce":1905904204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6807","nonce":1905904204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6805","nonce":1905904204}]},"public_addr":"172.21.15.153:6801/1905904204","cluster_addr":"172.21.15.153:6803/1905904204","heartbeat_back_addr":"172.21.15.153:6807/1905904204","heartbeat_front_addr":"172.21.15.153:6805/1905904204","state":["exists","up"]},{"osd":2,"uuid":"6d8c01a8-b657-4abc-a624-2b35ef0512ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6801","nonce":603659517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6803","nonce":603659517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6807","nonce":603659517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6805","nonce":603659517}]},"public_addr":"172.21.15.164:6801/603659517","cluster_addr":"172.21.15.164:6803/603659517","heartbeat_back_addr":"172.21.15.164:6807/603659517","heartbeat_front_addr":"172.21.15.164:6805/603659517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.476482+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.250903+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.326430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:20:08.380 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-17T02:20:08.380 INFO:tasks.ceph:Creating RBD pool 2024-09-17T02:20:08.380 DEBUG:teuthology.orchestra.run.smithi001:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-17T02:20:09.486 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'rbd' created 2024-09-17T02:20:09.508 DEBUG:teuthology.orchestra.run.smithi001:> rbd --cluster ceph pool init rbd 2024-09-17T02:20:12.530 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-17T02:20:12.530 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T02:20:12.531 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T02:20:12.533 INFO:tasks.ceph.mds.a:Started 2024-09-17T02:20:12.533 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-17T02:20:12.533 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:20:12.619 INFO:tasks.ceph.mds.a.smithi001.stdout:starting mds.a at 2024-09-17T02:20:12.868 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:20:12.868 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":2,"btime":"2024-09-17T02:20:12:647096+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4207,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6803/3107361006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3107361006},{"type":"v1","addr":"172.21.15.1:6803","nonce":3107361006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-17T02:20:12.868 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 2 2024-09-17T02:20:12.887 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T02:20:13.194 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:20:13.195 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2024-09-17T02:20:13.195 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:13.195 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 1, 2024-09-17T02:20:13.195 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": ".mgr" 2024-09-17T02:20:13.195 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:13.195 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:13.195 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 2, 2024-09-17T02:20:13.195 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": "rbd" 2024-09-17T02:20:13.195 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:20:13.195 INFO:teuthology.orchestra.run.smithi001.stdout:] 2024-09-17T02:20:13.212 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T02:20:13.213 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T02:20:14.519 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' created 2024-09-17T02:20:14.543 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T02:20:15.523 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' created 2024-09-17T02:20:15.548 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T02:20:16.547 INFO:teuthology.orchestra.run.smithi001.stderr:new fs with metadata pool 3 and data pool 4 2024-09-17T02:20:16.571 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:20:16.879 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:20:16.880 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"fsid":"37cd4495-4915-41f4-bad2-2394cbe235f3","created":"2024-09-17T02:19:52.516342+0000","modified":"2024-09-17T02:20:15.896249+0000","last_up_change":"2024-09-17T02:20:02.422255+0000","last_in_change":"2024-09-17T02:19:54.329423+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:20:03.416336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T02:20:08.718296+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:20:13.566396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-17T02:20:14.902662+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fae746a8-754d-4e52-9819-004ebb0d6886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6801","nonce":2347677104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6803","nonce":2347677104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6807","nonce":2347677104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6805","nonce":2347677104}]},"public_addr":"172.21.15.32:6801/2347677104","cluster_addr":"172.21.15.32:6803/2347677104","heartbeat_back_addr":"172.21.15.32:6807/2347677104","heartbeat_front_addr":"172.21.15.32:6805/2347677104","state":["exists","up"]},{"osd":1,"uuid":"c9397688-80ca-4c21-b80d-1740194c389d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6801","nonce":1905904204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6803","nonce":1905904204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6807","nonce":1905904204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6805","nonce":1905904204}]},"public_addr":"172.21.15.153:6801/1905904204","cluster_addr":"172.21.15.153:6803/1905904204","heartbeat_back_addr":"172.21.15.153:6807/1905904204","heartbeat_front_addr":"172.21.15.153:6805/1905904204","state":["exists","up"]},{"osd":2,"uuid":"6d8c01a8-b657-4abc-a624-2b35ef0512ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6801","nonce":603659517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6803","nonce":603659517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6807","nonce":603659517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6805","nonce":603659517}]},"public_addr":"172.21.15.164:6801/603659517","cluster_addr":"172.21.15.164:6803/603659517","heartbeat_back_addr":"172.21.15.164:6807/603659517","heartbeat_front_addr":"172.21.15.164:6805/603659517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.476482+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.250903+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.326430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:20:16.899 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:20:17.205 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:20:17.205 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"fsid":"37cd4495-4915-41f4-bad2-2394cbe235f3","created":"2024-09-17T02:19:52.516342+0000","modified":"2024-09-17T02:20:15.896249+0000","last_up_change":"2024-09-17T02:20:02.422255+0000","last_in_change":"2024-09-17T02:19:54.329423+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:20:03.416336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T02:20:08.718296+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:20:13.566396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-17T02:20:14.902662+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fae746a8-754d-4e52-9819-004ebb0d6886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6801","nonce":2347677104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6803","nonce":2347677104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6807","nonce":2347677104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6805","nonce":2347677104}]},"public_addr":"172.21.15.32:6801/2347677104","cluster_addr":"172.21.15.32:6803/2347677104","heartbeat_back_addr":"172.21.15.32:6807/2347677104","heartbeat_front_addr":"172.21.15.32:6805/2347677104","state":["exists","up"]},{"osd":1,"uuid":"c9397688-80ca-4c21-b80d-1740194c389d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6801","nonce":1905904204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6803","nonce":1905904204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6807","nonce":1905904204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6805","nonce":1905904204}]},"public_addr":"172.21.15.153:6801/1905904204","cluster_addr":"172.21.15.153:6803/1905904204","heartbeat_back_addr":"172.21.15.153:6807/1905904204","heartbeat_front_addr":"172.21.15.153:6805/1905904204","state":["exists","up"]},{"osd":2,"uuid":"6d8c01a8-b657-4abc-a624-2b35ef0512ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6801","nonce":603659517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6803","nonce":603659517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6807","nonce":603659517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6805","nonce":603659517}]},"public_addr":"172.21.15.164:6801/603659517","cluster_addr":"172.21.15.164:6803/603659517","heartbeat_back_addr":"172.21.15.164:6807/603659517","heartbeat_front_addr":"172.21.15.164:6805/603659517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.476482+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.250903+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.326430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:20:17.224 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T02:20:17.648 INFO:tasks.ceph.mds.a.smithi001.stderr:2024-09-17T02:20:17.653+0000 7f7a6b224640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T02:20:18.576 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T02:20:18.577 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T02:20:19.585 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T02:20:19.585 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:20:19.912 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:20:19.912 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":6,"btime":"2024-09-17T02:20:19:554662+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:20:15.896969+0000","modified":"2024-09-17T02:20:18.924053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4207":{"gid":4207,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.1:6803/3107361006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3107361006},{"type":"v1","addr":"172.21.15.1:6803","nonce":3107361006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4207,"qdb_cluster":[4207]},"id":1}]} 2024-09-17T02:20:19.912 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 6 2024-09-17T02:20:19.930 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:20:20.231 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:20:20.231 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":20,"fsid":"37cd4495-4915-41f4-bad2-2394cbe235f3","created":"2024-09-17T02:19:52.516342+0000","modified":"2024-09-17T02:20:17.546817+0000","last_up_change":"2024-09-17T02:20:02.422255+0000","last_in_change":"2024-09-17T02:19:54.329423+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:20:03.416336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T02:20:08.718296+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:20:13.566396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-17T02:20:14.902662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fae746a8-754d-4e52-9819-004ebb0d6886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6801","nonce":2347677104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6803","nonce":2347677104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6807","nonce":2347677104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6805","nonce":2347677104}]},"public_addr":"172.21.15.32:6801/2347677104","cluster_addr":"172.21.15.32:6803/2347677104","heartbeat_back_addr":"172.21.15.32:6807/2347677104","heartbeat_front_addr":"172.21.15.32:6805/2347677104","state":["exists","up"]},{"osd":1,"uuid":"c9397688-80ca-4c21-b80d-1740194c389d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6801","nonce":1905904204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6803","nonce":1905904204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6807","nonce":1905904204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6805","nonce":1905904204}]},"public_addr":"172.21.15.153:6801/1905904204","cluster_addr":"172.21.15.153:6803/1905904204","heartbeat_back_addr":"172.21.15.153:6807/1905904204","heartbeat_front_addr":"172.21.15.153:6805/1905904204","state":["exists","up"]},{"osd":2,"uuid":"6d8c01a8-b657-4abc-a624-2b35ef0512ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6801","nonce":603659517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6803","nonce":603659517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6807","nonce":603659517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6805","nonce":603659517}]},"public_addr":"172.21.15.164:6801/603659517","cluster_addr":"172.21.15.164:6803/603659517","heartbeat_back_addr":"172.21.15.164:6807/603659517","heartbeat_front_addr":"172.21.15.164:6805/603659517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.476482+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.250903+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.326430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:20:20.250 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T02:20:20.251 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:20:20.553 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:20:20.555 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-17T02:20:20.573 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-17T02:20:19.344034+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":249,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":198,"ondisk_log_size":198,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94232,"kb_used_data":664,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283021288,"statfs":{"total":289910292480,"available":289813798912,"internally_reserved":0,"allocated":679936,"data_stored":1357473,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,0,0,4,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2421,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.818459"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287583+0000","last_change":"2024-09-17T02:20:16.577643+0000","last_active":"2024-09-17T02:20:18.287583+0000","last_peered":"2024-09-17T02:20:18.287583+0000","last_clean":"2024-09-17T02:20:18.287583+0000","last_became_active":"2024-09-17T02:20:16.576566+0000","last_became_peered":"2024-09-17T02:20:16.576566+0000","last_unstale":"2024-09-17T02:20:18.287583+0000","last_undegraded":"2024-09-17T02:20:18.287583+0000","last_fullsized":"2024-09-17T02:20:18.287583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:34.971816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286435+0000","last_change":"2024-09-17T02:20:16.574137+0000","last_active":"2024-09-17T02:20:18.286435+0000","last_peered":"2024-09-17T02:20:18.286435+0000","last_clean":"2024-09-17T02:20:18.286435+0000","last_became_active":"2024-09-17T02:20:16.571755+0000","last_became_peered":"2024-09-17T02:20:16.571755+0000","last_unstale":"2024-09-17T02:20:18.286435+0000","last_undegraded":"2024-09-17T02:20:18.286435+0000","last_fullsized":"2024-09-17T02:20:18.286435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:56.146270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.586782+0000","last_change":"2024-09-17T02:20:16.582493+0000","last_active":"2024-09-17T02:20:16.586782+0000","last_peered":"2024-09-17T02:20:16.586782+0000","last_clean":"2024-09-17T02:20:16.586782+0000","last_became_active":"2024-09-17T02:20:16.581463+0000","last_became_peered":"2024-09-17T02:20:16.581463+0000","last_unstale":"2024-09-17T02:20:16.586782+0000","last_undegraded":"2024-09-17T02:20:16.586782+0000","last_fullsized":"2024-09-17T02:20:16.586782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:41:31.822425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.573319+0000","last_change":"2024-09-17T02:20:16.568747+0000","last_active":"2024-09-17T02:20:16.573319+0000","last_peered":"2024-09-17T02:20:16.573319+0000","last_clean":"2024-09-17T02:20:16.573319+0000","last_became_active":"2024-09-17T02:20:16.566795+0000","last_became_peered":"2024-09-17T02:20:16.566795+0000","last_unstale":"2024-09-17T02:20:16.573319+0000","last_undegraded":"2024-09-17T02:20:16.573319+0000","last_fullsized":"2024-09-17T02:20:16.573319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:46.737455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286208+0000","last_change":"2024-09-17T02:20:16.568625+0000","last_active":"2024-09-17T02:20:18.286208+0000","last_peered":"2024-09-17T02:20:18.286208+0000","last_clean":"2024-09-17T02:20:18.286208+0000","last_became_active":"2024-09-17T02:20:16.567707+0000","last_became_peered":"2024-09-17T02:20:16.567707+0000","last_unstale":"2024-09-17T02:20:18.286208+0000","last_undegraded":"2024-09-17T02:20:18.286208+0000","last_fullsized":"2024-09-17T02:20:18.286208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:44.452839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.573183+0000","last_change":"2024-09-17T02:20:16.568765+0000","last_active":"2024-09-17T02:20:16.573183+0000","last_peered":"2024-09-17T02:20:16.573183+0000","last_clean":"2024-09-17T02:20:16.573183+0000","last_became_active":"2024-09-17T02:20:16.564108+0000","last_became_peered":"2024-09-17T02:20:16.564108+0000","last_unstale":"2024-09-17T02:20:16.573183+0000","last_undegraded":"2024-09-17T02:20:16.573183+0000","last_fullsized":"2024-09-17T02:20:16.573183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:42.251927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.569247+0000","last_change":"2024-09-17T02:20:16.563357+0000","last_active":"2024-09-17T02:20:16.569247+0000","last_peered":"2024-09-17T02:20:16.569247+0000","last_clean":"2024-09-17T02:20:16.569247+0000","last_became_active":"2024-09-17T02:20:16.562276+0000","last_became_peered":"2024-09-17T02:20:16.562276+0000","last_unstale":"2024-09-17T02:20:16.569247+0000","last_undegraded":"2024-09-17T02:20:16.569247+0000","last_fullsized":"2024-09-17T02:20:16.569247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:59.341802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.573107+0000","last_change":"2024-09-17T02:20:16.568482+0000","last_active":"2024-09-17T02:20:16.573107+0000","last_peered":"2024-09-17T02:20:16.573107+0000","last_clean":"2024-09-17T02:20:16.573107+0000","last_became_active":"2024-09-17T02:20:16.565416+0000","last_became_peered":"2024-09-17T02:20:16.565416+0000","last_unstale":"2024-09-17T02:20:16.573107+0000","last_undegraded":"2024-09-17T02:20:16.573107+0000","last_fullsized":"2024-09-17T02:20:16.573107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:05.087679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.586646+0000","last_change":"2024-09-17T02:20:16.584665+0000","last_active":"2024-09-17T02:20:16.586646+0000","last_peered":"2024-09-17T02:20:16.586646+0000","last_clean":"2024-09-17T02:20:16.586646+0000","last_became_active":"2024-09-17T02:20:16.580797+0000","last_became_peered":"2024-09-17T02:20:16.580797+0000","last_unstale":"2024-09-17T02:20:16.586646+0000","last_undegraded":"2024-09-17T02:20:16.586646+0000","last_fullsized":"2024-09-17T02:20:16.586646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:38.051514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287106+0000","last_change":"2024-09-17T02:20:16.577666+0000","last_active":"2024-09-17T02:20:18.287106+0000","last_peered":"2024-09-17T02:20:18.287106+0000","last_clean":"2024-09-17T02:20:18.287106+0000","last_became_active":"2024-09-17T02:20:16.574914+0000","last_became_peered":"2024-09-17T02:20:16.574914+0000","last_unstale":"2024-09-17T02:20:18.287106+0000","last_undegraded":"2024-09-17T02:20:18.287106+0000","last_fullsized":"2024-09-17T02:20:18.287106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:48.730100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.572185+0000","last_change":"2024-09-17T02:20:16.565609+0000","last_active":"2024-09-17T02:20:16.572185+0000","last_peered":"2024-09-17T02:20:16.572185+0000","last_clean":"2024-09-17T02:20:16.572185+0000","last_became_active":"2024-09-17T02:20:16.564092+0000","last_became_peered":"2024-09-17T02:20:16.564092+0000","last_unstale":"2024-09-17T02:20:16.572185+0000","last_undegraded":"2024-09-17T02:20:16.572185+0000","last_fullsized":"2024-09-17T02:20:16.572185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:04.464014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286686+0000","last_change":"2024-09-17T02:20:16.584447+0000","last_active":"2024-09-17T02:20:18.286686+0000","last_peered":"2024-09-17T02:20:18.286686+0000","last_clean":"2024-09-17T02:20:18.286686+0000","last_became_active":"2024-09-17T02:20:16.580416+0000","last_became_peered":"2024-09-17T02:20:16.580416+0000","last_unstale":"2024-09-17T02:20:18.286686+0000","last_undegraded":"2024-09-17T02:20:18.286686+0000","last_fullsized":"2024-09-17T02:20:18.286686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:19.742400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285729+0000","last_change":"2024-09-17T02:20:16.573447+0000","last_active":"2024-09-17T02:20:18.285729+0000","last_peered":"2024-09-17T02:20:18.285729+0000","last_clean":"2024-09-17T02:20:18.285729+0000","last_became_active":"2024-09-17T02:20:16.571757+0000","last_became_peered":"2024-09-17T02:20:16.571757+0000","last_unstale":"2024-09-17T02:20:18.285729+0000","last_undegraded":"2024-09-17T02:20:18.285729+0000","last_fullsized":"2024-09-17T02:20:18.285729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:12.584579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.569335+0000","last_change":"2024-09-17T02:20:16.563197+0000","last_active":"2024-09-17T02:20:16.569335+0000","last_peered":"2024-09-17T02:20:16.569335+0000","last_clean":"2024-09-17T02:20:16.569335+0000","last_became_active":"2024-09-17T02:20:16.561221+0000","last_became_peered":"2024-09-17T02:20:16.561221+0000","last_unstale":"2024-09-17T02:20:16.569335+0000","last_undegraded":"2024-09-17T02:20:16.569335+0000","last_fullsized":"2024-09-17T02:20:16.569335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:42.531174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.585398+0000","last_change":"2024-09-17T02:20:16.581305+0000","last_active":"2024-09-17T02:20:16.585398+0000","last_peered":"2024-09-17T02:20:16.585398+0000","last_clean":"2024-09-17T02:20:16.585398+0000","last_became_active":"2024-09-17T02:20:16.580377+0000","last_became_peered":"2024-09-17T02:20:16.580377+0000","last_unstale":"2024-09-17T02:20:16.585398+0000","last_undegraded":"2024-09-17T02:20:16.585398+0000","last_fullsized":"2024-09-17T02:20:16.585398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:40.577627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.571144+0000","last_change":"2024-09-17T02:20:16.562686+0000","last_active":"2024-09-17T02:20:16.571144+0000","last_peered":"2024-09-17T02:20:16.571144+0000","last_clean":"2024-09-17T02:20:16.571144+0000","last_became_active":"2024-09-17T02:20:16.561446+0000","last_became_peered":"2024-09-17T02:20:16.561446+0000","last_unstale":"2024-09-17T02:20:16.571144+0000","last_undegraded":"2024-09-17T02:20:16.571144+0000","last_fullsized":"2024-09-17T02:20:16.571144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:05.558789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.566936+0000","last_change":"2024-09-17T02:20:16.563482+0000","last_active":"2024-09-17T02:20:16.566936+0000","last_peered":"2024-09-17T02:20:16.566936+0000","last_clean":"2024-09-17T02:20:16.566936+0000","last_became_active":"2024-09-17T02:20:16.562735+0000","last_became_peered":"2024-09-17T02:20:16.562735+0000","last_unstale":"2024-09-17T02:20:16.566936+0000","last_undegraded":"2024-09-17T02:20:16.566936+0000","last_fullsized":"2024-09-17T02:20:16.566936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:10.839201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287548+0000","last_change":"2024-09-17T02:20:16.568659+0000","last_active":"2024-09-17T02:20:18.287548+0000","last_peered":"2024-09-17T02:20:18.287548+0000","last_clean":"2024-09-17T02:20:18.287548+0000","last_became_active":"2024-09-17T02:20:16.565734+0000","last_became_peered":"2024-09-17T02:20:16.565734+0000","last_unstale":"2024-09-17T02:20:18.287548+0000","last_undegraded":"2024-09-17T02:20:18.287548+0000","last_fullsized":"2024-09-17T02:20:18.287548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:05.723619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.589834+0000","last_change":"2024-09-17T02:20:16.586950+0000","last_active":"2024-09-17T02:20:16.589834+0000","last_peered":"2024-09-17T02:20:16.589834+0000","last_clean":"2024-09-17T02:20:16.589834+0000","last_became_active":"2024-09-17T02:20:16.586281+0000","last_became_peered":"2024-09-17T02:20:16.586281+0000","last_unstale":"2024-09-17T02:20:16.589834+0000","last_undegraded":"2024-09-17T02:20:16.589834+0000","last_fullsized":"2024-09-17T02:20:16.589834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:02.039167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.573605+0000","last_change":"2024-09-17T02:20:16.570514+0000","last_active":"2024-09-17T02:20:16.573605+0000","last_peered":"2024-09-17T02:20:16.573605+0000","last_clean":"2024-09-17T02:20:16.573605+0000","last_became_active":"2024-09-17T02:20:16.567156+0000","last_became_peered":"2024-09-17T02:20:16.567156+0000","last_unstale":"2024-09-17T02:20:16.573605+0000","last_undegraded":"2024-09-17T02:20:16.573605+0000","last_fullsized":"2024-09-17T02:20:16.573605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:25.757570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.573729+0000","last_change":"2024-09-17T02:20:16.571275+0000","last_active":"2024-09-17T02:20:16.573729+0000","last_peered":"2024-09-17T02:20:16.573729+0000","last_clean":"2024-09-17T02:20:16.573729+0000","last_became_active":"2024-09-17T02:20:16.569751+0000","last_became_peered":"2024-09-17T02:20:16.569751+0000","last_unstale":"2024-09-17T02:20:16.573729+0000","last_undegraded":"2024-09-17T02:20:16.573729+0000","last_fullsized":"2024-09-17T02:20:16.573729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:02.039167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285399+0000","last_change":"2024-09-17T02:20:16.567109+0000","last_active":"2024-09-17T02:20:18.285399+0000","last_peered":"2024-09-17T02:20:18.285399+0000","last_clean":"2024-09-17T02:20:18.285399+0000","last_became_active":"2024-09-17T02:20:16.564753+0000","last_became_peered":"2024-09-17T02:20:16.564753+0000","last_unstale":"2024-09-17T02:20:18.285399+0000","last_undegraded":"2024-09-17T02:20:18.285399+0000","last_fullsized":"2024-09-17T02:20:18.285399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:01.888476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.563090+0000","last_change":"2024-09-17T02:20:16.558778+0000","last_active":"2024-09-17T02:20:16.563090+0000","last_peered":"2024-09-17T02:20:16.563090+0000","last_clean":"2024-09-17T02:20:16.563090+0000","last_became_active":"2024-09-17T02:20:16.557967+0000","last_became_peered":"2024-09-17T02:20:16.557967+0000","last_unstale":"2024-09-17T02:20:16.563090+0000","last_undegraded":"2024-09-17T02:20:16.563090+0000","last_fullsized":"2024-09-17T02:20:16.563090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:16.855771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285052+0000","last_change":"2024-09-17T02:20:16.564194+0000","last_active":"2024-09-17T02:20:18.285052+0000","last_peered":"2024-09-17T02:20:18.285052+0000","last_clean":"2024-09-17T02:20:18.285052+0000","last_became_active":"2024-09-17T02:20:16.562564+0000","last_became_peered":"2024-09-17T02:20:16.562564+0000","last_unstale":"2024-09-17T02:20:18.285052+0000","last_undegraded":"2024-09-17T02:20:18.285052+0000","last_fullsized":"2024-09-17T02:20:18.285052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:10.932999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287608+0000","last_change":"2024-09-17T02:20:16.573189+0000","last_active":"2024-09-17T02:20:18.287608+0000","last_peered":"2024-09-17T02:20:18.287608+0000","last_clean":"2024-09-17T02:20:18.287608+0000","last_became_active":"2024-09-17T02:20:16.570669+0000","last_became_peered":"2024-09-17T02:20:16.570669+0000","last_unstale":"2024-09-17T02:20:18.287608+0000","last_undegraded":"2024-09-17T02:20:18.287608+0000","last_fullsized":"2024-09-17T02:20:18.287608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:52.753219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.585474+0000","last_change":"2024-09-17T02:20:16.581076+0000","last_active":"2024-09-17T02:20:16.585474+0000","last_peered":"2024-09-17T02:20:16.585474+0000","last_clean":"2024-09-17T02:20:16.585474+0000","last_became_active":"2024-09-17T02:20:16.579989+0000","last_became_peered":"2024-09-17T02:20:16.579989+0000","last_unstale":"2024-09-17T02:20:16.585474+0000","last_undegraded":"2024-09-17T02:20:16.585474+0000","last_fullsized":"2024-09-17T02:20:16.585474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:42.251927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.586849+0000","last_change":"2024-09-17T02:20:16.582808+0000","last_active":"2024-09-17T02:20:16.586849+0000","last_peered":"2024-09-17T02:20:16.586849+0000","last_clean":"2024-09-17T02:20:16.586849+0000","last_became_active":"2024-09-17T02:20:16.581358+0000","last_became_peered":"2024-09-17T02:20:16.581358+0000","last_unstale":"2024-09-17T02:20:16.586849+0000","last_undegraded":"2024-09-17T02:20:16.586849+0000","last_fullsized":"2024-09-17T02:20:16.586849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:21.356437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287997+0000","last_change":"2024-09-17T02:20:16.583361+0000","last_active":"2024-09-17T02:20:18.287997+0000","last_peered":"2024-09-17T02:20:18.287997+0000","last_clean":"2024-09-17T02:20:18.287997+0000","last_became_active":"2024-09-17T02:20:16.579817+0000","last_became_peered":"2024-09-17T02:20:16.579817+0000","last_unstale":"2024-09-17T02:20:18.287997+0000","last_undegraded":"2024-09-17T02:20:18.287997+0000","last_fullsized":"2024-09-17T02:20:18.287997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:54.029860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.585491+0000","last_change":"2024-09-17T02:20:16.581125+0000","last_active":"2024-09-17T02:20:16.585491+0000","last_peered":"2024-09-17T02:20:16.585491+0000","last_clean":"2024-09-17T02:20:16.585491+0000","last_became_active":"2024-09-17T02:20:16.580393+0000","last_became_peered":"2024-09-17T02:20:16.580393+0000","last_unstale":"2024-09-17T02:20:16.585491+0000","last_undegraded":"2024-09-17T02:20:16.585491+0000","last_fullsized":"2024-09-17T02:20:16.585491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:25.757570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286569+0000","last_change":"2024-09-17T02:20:16.565220+0000","last_active":"2024-09-17T02:20:18.286569+0000","last_peered":"2024-09-17T02:20:18.286569+0000","last_clean":"2024-09-17T02:20:18.286569+0000","last_became_active":"2024-09-17T02:20:16.562419+0000","last_became_peered":"2024-09-17T02:20:16.562419+0000","last_unstale":"2024-09-17T02:20:18.286569+0000","last_undegraded":"2024-09-17T02:20:18.286569+0000","last_fullsized":"2024-09-17T02:20:18.286569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:03.961277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.585181+0000","last_change":"2024-09-17T02:20:16.579408+0000","last_active":"2024-09-17T02:20:16.585181+0000","last_peered":"2024-09-17T02:20:16.585181+0000","last_clean":"2024-09-17T02:20:16.585181+0000","last_became_active":"2024-09-17T02:20:16.577202+0000","last_became_peered":"2024-09-17T02:20:16.577202+0000","last_unstale":"2024-09-17T02:20:16.585181+0000","last_undegraded":"2024-09-17T02:20:16.585181+0000","last_fullsized":"2024-09-17T02:20:16.585181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:31.214767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.573662+0000","last_change":"2024-09-17T02:20:16.570810+0000","last_active":"2024-09-17T02:20:16.573662+0000","last_peered":"2024-09-17T02:20:16.573662+0000","last_clean":"2024-09-17T02:20:16.573662+0000","last_became_active":"2024-09-17T02:20:16.569273+0000","last_became_peered":"2024-09-17T02:20:16.569273+0000","last_unstale":"2024-09-17T02:20:16.573662+0000","last_undegraded":"2024-09-17T02:20:16.573662+0000","last_fullsized":"2024-09-17T02:20:16.573662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:34.105158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287137+0000","last_change":"2024-09-17T02:20:16.572798+0000","last_active":"2024-09-17T02:20:18.287137+0000","last_peered":"2024-09-17T02:20:18.287137+0000","last_clean":"2024-09-17T02:20:18.287137+0000","last_became_active":"2024-09-17T02:20:16.571174+0000","last_became_peered":"2024-09-17T02:20:16.571174+0000","last_unstale":"2024-09-17T02:20:18.287137+0000","last_undegraded":"2024-09-17T02:20:18.287137+0000","last_fullsized":"2024-09-17T02:20:18.287137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:00.116621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.587195+0000","last_change":"2024-09-17T02:20:15.559935+0000","last_active":"2024-09-17T02:20:16.587195+0000","last_peered":"2024-09-17T02:20:16.587195+0000","last_clean":"2024-09-17T02:20:16.587195+0000","last_became_active":"2024-09-17T02:20:15.559413+0000","last_became_peered":"2024-09-17T02:20:15.559413+0000","last_unstale":"2024-09-17T02:20:16.587195+0000","last_undegraded":"2024-09-17T02:20:16.587195+0000","last_fullsized":"2024-09-17T02:20:16.587195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:52.985837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287177+0000","last_change":"2024-09-17T02:20:16.581819+0000","last_active":"2024-09-17T02:20:18.287177+0000","last_peered":"2024-09-17T02:20:18.287177+0000","last_clean":"2024-09-17T02:20:18.287177+0000","last_became_active":"2024-09-17T02:20:16.577168+0000","last_became_peered":"2024-09-17T02:20:16.577168+0000","last_unstale":"2024-09-17T02:20:18.287177+0000","last_undegraded":"2024-09-17T02:20:18.287177+0000","last_fullsized":"2024-09-17T02:20:18.287177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:47.756576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.543151+0000","last_change":"2024-09-17T02:20:15.550890+0000","last_active":"2024-09-17T02:20:16.543151+0000","last_peered":"2024-09-17T02:20:16.543151+0000","last_clean":"2024-09-17T02:20:16.543151+0000","last_became_active":"2024-09-17T02:20:15.550077+0000","last_became_peered":"2024-09-17T02:20:15.550077+0000","last_unstale":"2024-09-17T02:20:16.543151+0000","last_undegraded":"2024-09-17T02:20:16.543151+0000","last_fullsized":"2024-09-17T02:20:16.543151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:36.119249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.585537+0000","last_change":"2024-09-17T02:20:16.581457+0000","last_active":"2024-09-17T02:20:16.585537+0000","last_peered":"2024-09-17T02:20:16.585537+0000","last_clean":"2024-09-17T02:20:16.585537+0000","last_became_active":"2024-09-17T02:20:16.579428+0000","last_became_peered":"2024-09-17T02:20:16.579428+0000","last_unstale":"2024-09-17T02:20:16.585537+0000","last_undegraded":"2024-09-17T02:20:16.585537+0000","last_fullsized":"2024-09-17T02:20:16.585537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:34.105158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285758+0000","last_change":"2024-09-17T02:20:15.569442+0000","last_active":"2024-09-17T02:20:18.285758+0000","last_peered":"2024-09-17T02:20:18.285758+0000","last_clean":"2024-09-17T02:20:18.285758+0000","last_became_active":"2024-09-17T02:20:15.567946+0000","last_became_peered":"2024-09-17T02:20:15.567946+0000","last_unstale":"2024-09-17T02:20:18.285758+0000","last_undegraded":"2024-09-17T02:20:18.285758+0000","last_fullsized":"2024-09-17T02:20:18.285758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:55.866388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.585200+0000","last_change":"2024-09-17T02:20:16.579779+0000","last_active":"2024-09-17T02:20:16.585200+0000","last_peered":"2024-09-17T02:20:16.585200+0000","last_clean":"2024-09-17T02:20:16.585200+0000","last_became_active":"2024-09-17T02:20:16.576734+0000","last_became_peered":"2024-09-17T02:20:16.576734+0000","last_unstale":"2024-09-17T02:20:16.585200+0000","last_undegraded":"2024-09-17T02:20:16.585200+0000","last_fullsized":"2024-09-17T02:20:16.585200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:05.087679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.588816+0000","last_change":"2024-09-17T02:20:15.559245+0000","last_active":"2024-09-17T02:20:16.588816+0000","last_peered":"2024-09-17T02:20:16.588816+0000","last_clean":"2024-09-17T02:20:16.588816+0000","last_became_active":"2024-09-17T02:20:15.558518+0000","last_became_peered":"2024-09-17T02:20:15.558518+0000","last_unstale":"2024-09-17T02:20:16.588816+0000","last_undegraded":"2024-09-17T02:20:16.588816+0000","last_fullsized":"2024-09-17T02:20:16.588816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:52.783635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.584564+0000","last_change":"2024-09-17T02:20:15.559110+0000","last_active":"2024-09-17T02:20:16.584564+0000","last_peered":"2024-09-17T02:20:16.584564+0000","last_clean":"2024-09-17T02:20:16.584564+0000","last_became_active":"2024-09-17T02:20:15.558285+0000","last_became_peered":"2024-09-17T02:20:15.558285+0000","last_unstale":"2024-09-17T02:20:16.584564+0000","last_undegraded":"2024-09-17T02:20:16.584564+0000","last_fullsized":"2024-09-17T02:20:16.584564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:15.782658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285013+0000","last_change":"2024-09-17T02:20:16.584359+0000","last_active":"2024-09-17T02:20:18.285013+0000","last_peered":"2024-09-17T02:20:18.285013+0000","last_clean":"2024-09-17T02:20:18.285013+0000","last_became_active":"2024-09-17T02:20:16.582303+0000","last_became_peered":"2024-09-17T02:20:16.582303+0000","last_unstale":"2024-09-17T02:20:18.285013+0000","last_undegraded":"2024-09-17T02:20:18.285013+0000","last_fullsized":"2024-09-17T02:20:18.285013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:12.345284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287762+0000","last_change":"2024-09-17T02:20:15.568414+0000","last_active":"2024-09-17T02:20:18.287762+0000","last_peered":"2024-09-17T02:20:18.287762+0000","last_clean":"2024-09-17T02:20:18.287762+0000","last_became_active":"2024-09-17T02:20:15.567596+0000","last_became_peered":"2024-09-17T02:20:15.567596+0000","last_unstale":"2024-09-17T02:20:18.287762+0000","last_undegraded":"2024-09-17T02:20:18.287762+0000","last_fullsized":"2024-09-17T02:20:18.287762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:11.356699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285690+0000","last_change":"2024-09-17T02:20:16.565402+0000","last_active":"2024-09-17T02:20:18.285690+0000","last_peered":"2024-09-17T02:20:18.285690+0000","last_clean":"2024-09-17T02:20:18.285690+0000","last_became_active":"2024-09-17T02:20:16.563113+0000","last_became_peered":"2024-09-17T02:20:16.563113+0000","last_unstale":"2024-09-17T02:20:18.285690+0000","last_undegraded":"2024-09-17T02:20:18.285690+0000","last_fullsized":"2024-09-17T02:20:18.285690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:38:36.115641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.587805+0000","last_change":"2024-09-17T02:20:15.559767+0000","last_active":"2024-09-17T02:20:16.587805+0000","last_peered":"2024-09-17T02:20:16.587805+0000","last_clean":"2024-09-17T02:20:16.587805+0000","last_became_active":"2024-09-17T02:20:15.558888+0000","last_became_peered":"2024-09-17T02:20:15.558888+0000","last_unstale":"2024-09-17T02:20:16.587805+0000","last_undegraded":"2024-09-17T02:20:16.587805+0000","last_fullsized":"2024-09-17T02:20:16.587805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:09.831510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.572298+0000","last_change":"2024-09-17T02:20:16.565632+0000","last_active":"2024-09-17T02:20:16.572298+0000","last_peered":"2024-09-17T02:20:16.572298+0000","last_clean":"2024-09-17T02:20:16.572298+0000","last_became_active":"2024-09-17T02:20:16.563630+0000","last_became_peered":"2024-09-17T02:20:16.563630+0000","last_unstale":"2024-09-17T02:20:16.572298+0000","last_undegraded":"2024-09-17T02:20:16.572298+0000","last_fullsized":"2024-09-17T02:20:16.572298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:57.008091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.548943+0000","last_change":"2024-09-17T02:20:15.562539+0000","last_active":"2024-09-17T02:20:16.548943+0000","last_peered":"2024-09-17T02:20:16.548943+0000","last_clean":"2024-09-17T02:20:16.548943+0000","last_became_active":"2024-09-17T02:20:15.561801+0000","last_became_peered":"2024-09-17T02:20:15.561801+0000","last_unstale":"2024-09-17T02:20:16.548943+0000","last_undegraded":"2024-09-17T02:20:16.548943+0000","last_fullsized":"2024-09-17T02:20:16.548943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:15.848081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.585059+0000","last_change":"2024-09-17T02:20:16.578474+0000","last_active":"2024-09-17T02:20:16.585059+0000","last_peered":"2024-09-17T02:20:16.585059+0000","last_clean":"2024-09-17T02:20:16.585059+0000","last_became_active":"2024-09-17T02:20:16.576264+0000","last_became_peered":"2024-09-17T02:20:16.576264+0000","last_unstale":"2024-09-17T02:20:16.585059+0000","last_undegraded":"2024-09-17T02:20:16.585059+0000","last_fullsized":"2024-09-17T02:20:16.585059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:59.341802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.583282+0000","last_change":"2024-09-17T02:20:15.551986+0000","last_active":"2024-09-17T02:20:16.583282+0000","last_peered":"2024-09-17T02:20:16.583282+0000","last_clean":"2024-09-17T02:20:16.583282+0000","last_became_active":"2024-09-17T02:20:15.550418+0000","last_became_peered":"2024-09-17T02:20:15.550418+0000","last_unstale":"2024-09-17T02:20:16.583282+0000","last_undegraded":"2024-09-17T02:20:16.583282+0000","last_fullsized":"2024-09-17T02:20:16.583282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:17.866665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.573722+0000","last_change":"2024-09-17T02:20:16.570845+0000","last_active":"2024-09-17T02:20:16.573722+0000","last_peered":"2024-09-17T02:20:16.573722+0000","last_clean":"2024-09-17T02:20:16.573722+0000","last_became_active":"2024-09-17T02:20:16.568862+0000","last_became_peered":"2024-09-17T02:20:16.568862+0000","last_unstale":"2024-09-17T02:20:16.573722+0000","last_undegraded":"2024-09-17T02:20:16.573722+0000","last_fullsized":"2024-09-17T02:20:16.573722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:18.975086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.548072+0000","last_change":"2024-09-17T02:20:15.559849+0000","last_active":"2024-09-17T02:20:16.548072+0000","last_peered":"2024-09-17T02:20:16.548072+0000","last_clean":"2024-09-17T02:20:16.548072+0000","last_became_active":"2024-09-17T02:20:15.559431+0000","last_became_peered":"2024-09-17T02:20:15.559431+0000","last_unstale":"2024-09-17T02:20:16.548072+0000","last_undegraded":"2024-09-17T02:20:16.548072+0000","last_fullsized":"2024-09-17T02:20:16.548072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:31.933850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.589092+0000","last_change":"2024-09-17T02:20:16.586434+0000","last_active":"2024-09-17T02:20:16.589092+0000","last_peered":"2024-09-17T02:20:16.589092+0000","last_clean":"2024-09-17T02:20:16.589092+0000","last_became_active":"2024-09-17T02:20:16.585466+0000","last_became_peered":"2024-09-17T02:20:16.585466+0000","last_unstale":"2024-09-17T02:20:16.589092+0000","last_undegraded":"2024-09-17T02:20:16.589092+0000","last_fullsized":"2024-09-17T02:20:16.589092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:24.706394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286282+0000","last_change":"2024-09-17T02:20:15.568506+0000","last_active":"2024-09-17T02:20:18.286282+0000","last_peered":"2024-09-17T02:20:18.286282+0000","last_clean":"2024-09-17T02:20:18.286282+0000","last_became_active":"2024-09-17T02:20:15.567720+0000","last_became_peered":"2024-09-17T02:20:15.567720+0000","last_unstale":"2024-09-17T02:20:18.286282+0000","last_undegraded":"2024-09-17T02:20:18.286282+0000","last_fullsized":"2024-09-17T02:20:18.286282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:46.560153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.586056+0000","last_change":"2024-09-17T02:20:16.582353+0000","last_active":"2024-09-17T02:20:16.586056+0000","last_peered":"2024-09-17T02:20:16.586056+0000","last_clean":"2024-09-17T02:20:16.586056+0000","last_became_active":"2024-09-17T02:20:16.581462+0000","last_became_peered":"2024-09-17T02:20:16.581462+0000","last_unstale":"2024-09-17T02:20:16.586056+0000","last_undegraded":"2024-09-17T02:20:16.586056+0000","last_fullsized":"2024-09-17T02:20:16.586056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:20.414231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285391+0000","last_change":"2024-09-17T02:20:15.565444+0000","last_active":"2024-09-17T02:20:18.285391+0000","last_peered":"2024-09-17T02:20:18.285391+0000","last_clean":"2024-09-17T02:20:18.285391+0000","last_became_active":"2024-09-17T02:20:15.564640+0000","last_became_peered":"2024-09-17T02:20:15.564640+0000","last_unstale":"2024-09-17T02:20:18.285391+0000","last_undegraded":"2024-09-17T02:20:18.285391+0000","last_fullsized":"2024-09-17T02:20:18.285391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:29.214563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.586581+0000","last_change":"2024-09-17T02:20:16.583084+0000","last_active":"2024-09-17T02:20:16.586581+0000","last_peered":"2024-09-17T02:20:16.586581+0000","last_clean":"2024-09-17T02:20:16.586581+0000","last_became_active":"2024-09-17T02:20:16.582326+0000","last_became_peered":"2024-09-17T02:20:16.582326+0000","last_unstale":"2024-09-17T02:20:16.586581+0000","last_undegraded":"2024-09-17T02:20:16.586581+0000","last_fullsized":"2024-09-17T02:20:16.586581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:18.975086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":222,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.549481+0000","last_change":"2024-09-17T02:20:04.612894+0000","last_active":"2024-09-17T02:20:16.549481+0000","last_peered":"2024-09-17T02:20:16.549481+0000","last_clean":"2024-09-17T02:20:16.549481+0000","last_became_active":"2024-09-17T02:20:04.610517+0000","last_became_peered":"2024-09-17T02:20:04.610517+0000","last_unstale":"2024-09-17T02:20:16.549481+0000","last_undegraded":"2024-09-17T02:20:16.549481+0000","last_fullsized":"2024-09-17T02:20:16.549481+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_clean_scrub_stamp":"2024-09-17T02:20:03.432050+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:51.879303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.549339+0000","last_change":"2024-09-17T02:20:12.513513+0000","last_active":"2024-09-17T02:20:16.549339+0000","last_peered":"2024-09-17T02:20:16.549339+0000","last_clean":"2024-09-17T02:20:16.549339+0000","last_became_active":"2024-09-17T02:20:10.504616+0000","last_became_peered":"2024-09-17T02:20:10.504616+0000","last_unstale":"2024-09-17T02:20:16.549339+0000","last_undegraded":"2024-09-17T02:20:16.549339+0000","last_fullsized":"2024-09-17T02:20:16.549339+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:13.341611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001517832,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.543871+0000","last_change":"2024-09-17T02:20:15.560646+0000","last_active":"2024-09-17T02:20:16.543871+0000","last_peered":"2024-09-17T02:20:16.543871+0000","last_clean":"2024-09-17T02:20:16.543871+0000","last_became_active":"2024-09-17T02:20:15.559104+0000","last_became_peered":"2024-09-17T02:20:15.559104+0000","last_unstale":"2024-09-17T02:20:16.543871+0000","last_undegraded":"2024-09-17T02:20:16.543871+0000","last_fullsized":"2024-09-17T02:20:16.543871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:44.299986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.588442+0000","last_change":"2024-09-17T02:20:16.585522+0000","last_active":"2024-09-17T02:20:16.588442+0000","last_peered":"2024-09-17T02:20:16.588442+0000","last_clean":"2024-09-17T02:20:16.588442+0000","last_became_active":"2024-09-17T02:20:16.584520+0000","last_became_peered":"2024-09-17T02:20:16.584520+0000","last_unstale":"2024-09-17T02:20:16.588442+0000","last_undegraded":"2024-09-17T02:20:16.588442+0000","last_fullsized":"2024-09-17T02:20:16.588442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:54:33.088375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.549172+0000","last_change":"2024-09-17T02:20:12.512798+0000","last_active":"2024-09-17T02:20:16.549172+0000","last_peered":"2024-09-17T02:20:16.549172+0000","last_clean":"2024-09-17T02:20:16.549172+0000","last_became_active":"2024-09-17T02:20:10.502115+0000","last_became_peered":"2024-09-17T02:20:10.502115+0000","last_unstale":"2024-09-17T02:20:16.549172+0000","last_undegraded":"2024-09-17T02:20:16.549172+0000","last_fullsized":"2024-09-17T02:20:16.549172+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:17.554878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083467700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.544565+0000","last_change":"2024-09-17T02:20:15.551632+0000","last_active":"2024-09-17T02:20:16.544565+0000","last_peered":"2024-09-17T02:20:16.544565+0000","last_clean":"2024-09-17T02:20:16.544565+0000","last_became_active":"2024-09-17T02:20:15.551062+0000","last_became_peered":"2024-09-17T02:20:15.551062+0000","last_unstale":"2024-09-17T02:20:16.544565+0000","last_undegraded":"2024-09-17T02:20:16.544565+0000","last_fullsized":"2024-09-17T02:20:16.544565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:55.295518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287261+0000","last_change":"2024-09-17T02:20:16.571568+0000","last_active":"2024-09-17T02:20:18.287261+0000","last_peered":"2024-09-17T02:20:18.287261+0000","last_clean":"2024-09-17T02:20:18.287261+0000","last_became_active":"2024-09-17T02:20:16.570622+0000","last_became_peered":"2024-09-17T02:20:16.570622+0000","last_unstale":"2024-09-17T02:20:18.287261+0000","last_undegraded":"2024-09-17T02:20:18.287261+0000","last_fullsized":"2024-09-17T02:20:18.287261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:57.083446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.544742+0000","last_change":"2024-09-17T02:20:12.511823+0000","last_active":"2024-09-17T02:20:16.544742+0000","last_peered":"2024-09-17T02:20:16.544742+0000","last_clean":"2024-09-17T02:20:16.544742+0000","last_became_active":"2024-09-17T02:20:10.497164+0000","last_became_peered":"2024-09-17T02:20:10.497164+0000","last_unstale":"2024-09-17T02:20:16.544742+0000","last_undegraded":"2024-09-17T02:20:16.544742+0000","last_fullsized":"2024-09-17T02:20:16.544742+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:21.242753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081052700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285368+0000","last_change":"2024-09-17T02:20:15.569475+0000","last_active":"2024-09-17T02:20:18.285368+0000","last_peered":"2024-09-17T02:20:18.285368+0000","last_clean":"2024-09-17T02:20:18.285368+0000","last_became_active":"2024-09-17T02:20:15.567965+0000","last_became_peered":"2024-09-17T02:20:15.567965+0000","last_unstale":"2024-09-17T02:20:18.285368+0000","last_undegraded":"2024-09-17T02:20:18.285368+0000","last_fullsized":"2024-09-17T02:20:18.285368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:06.649112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.585250+0000","last_change":"2024-09-17T02:20:16.578902+0000","last_active":"2024-09-17T02:20:16.585250+0000","last_peered":"2024-09-17T02:20:16.585250+0000","last_clean":"2024-09-17T02:20:16.585250+0000","last_became_active":"2024-09-17T02:20:16.576512+0000","last_became_peered":"2024-09-17T02:20:16.576512+0000","last_unstale":"2024-09-17T02:20:16.585250+0000","last_undegraded":"2024-09-17T02:20:16.585250+0000","last_fullsized":"2024-09-17T02:20:16.585250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:04.464014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.546556+0000","last_change":"2024-09-17T02:20:12.512742+0000","last_active":"2024-09-17T02:20:16.546556+0000","last_peered":"2024-09-17T02:20:16.546556+0000","last_clean":"2024-09-17T02:20:16.546556+0000","last_became_active":"2024-09-17T02:20:10.503622+0000","last_became_peered":"2024-09-17T02:20:10.503622+0000","last_unstale":"2024-09-17T02:20:16.546556+0000","last_undegraded":"2024-09-17T02:20:16.546556+0000","last_fullsized":"2024-09-17T02:20:16.546556+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:36.226043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078085399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.549379+0000","last_change":"2024-09-17T02:20:15.562840+0000","last_active":"2024-09-17T02:20:16.549379+0000","last_peered":"2024-09-17T02:20:16.549379+0000","last_clean":"2024-09-17T02:20:16.549379+0000","last_became_active":"2024-09-17T02:20:15.562177+0000","last_became_peered":"2024-09-17T02:20:15.562177+0000","last_unstale":"2024-09-17T02:20:16.549379+0000","last_undegraded":"2024-09-17T02:20:16.549379+0000","last_fullsized":"2024-09-17T02:20:16.549379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:39.709524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.585280+0000","last_change":"2024-09-17T02:20:16.580184+0000","last_active":"2024-09-17T02:20:16.585280+0000","last_peered":"2024-09-17T02:20:16.585280+0000","last_clean":"2024-09-17T02:20:16.585280+0000","last_became_active":"2024-09-17T02:20:16.578343+0000","last_became_peered":"2024-09-17T02:20:16.578343+0000","last_unstale":"2024-09-17T02:20:16.585280+0000","last_undegraded":"2024-09-17T02:20:16.585280+0000","last_fullsized":"2024-09-17T02:20:16.585280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:46.737455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.550190+0000","last_change":"2024-09-17T02:20:15.562922+0000","last_active":"2024-09-17T02:20:16.550190+0000","last_peered":"2024-09-17T02:20:16.550190+0000","last_clean":"2024-09-17T02:20:16.550190+0000","last_became_active":"2024-09-17T02:20:15.562138+0000","last_became_peered":"2024-09-17T02:20:15.562138+0000","last_unstale":"2024-09-17T02:20:16.550190+0000","last_undegraded":"2024-09-17T02:20:16.550190+0000","last_fullsized":"2024-09-17T02:20:16.550190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:00.819275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.544771+0000","last_change":"2024-09-17T02:20:12.511838+0000","last_active":"2024-09-17T02:20:16.544771+0000","last_peered":"2024-09-17T02:20:16.544771+0000","last_clean":"2024-09-17T02:20:16.544771+0000","last_became_active":"2024-09-17T02:20:10.497049+0000","last_became_peered":"2024-09-17T02:20:10.497049+0000","last_unstale":"2024-09-17T02:20:16.544771+0000","last_undegraded":"2024-09-17T02:20:16.544771+0000","last_fullsized":"2024-09-17T02:20:16.544771+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:54.446484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079701100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286426+0000","last_change":"2024-09-17T02:20:16.571485+0000","last_active":"2024-09-17T02:20:18.286426+0000","last_peered":"2024-09-17T02:20:18.286426+0000","last_clean":"2024-09-17T02:20:18.286426+0000","last_became_active":"2024-09-17T02:20:16.567570+0000","last_became_peered":"2024-09-17T02:20:16.567570+0000","last_unstale":"2024-09-17T02:20:18.286426+0000","last_undegraded":"2024-09-17T02:20:18.286426+0000","last_fullsized":"2024-09-17T02:20:18.286426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:14.228385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.544626+0000","last_change":"2024-09-17T02:20:15.559252+0000","last_active":"2024-09-17T02:20:16.544626+0000","last_peered":"2024-09-17T02:20:16.544626+0000","last_clean":"2024-09-17T02:20:16.544626+0000","last_became_active":"2024-09-17T02:20:15.557667+0000","last_became_peered":"2024-09-17T02:20:15.557667+0000","last_unstale":"2024-09-17T02:20:16.544626+0000","last_undegraded":"2024-09-17T02:20:16.544626+0000","last_fullsized":"2024-09-17T02:20:16.544626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:01.292626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287685+0000","last_change":"2024-09-17T02:20:12.661034+0000","last_active":"2024-09-17T02:20:18.287685+0000","last_peered":"2024-09-17T02:20:18.287685+0000","last_clean":"2024-09-17T02:20:18.287685+0000","last_became_active":"2024-09-17T02:20:10.497829+0000","last_became_peered":"2024-09-17T02:20:10.497829+0000","last_unstale":"2024-09-17T02:20:18.287685+0000","last_undegraded":"2024-09-17T02:20:18.287685+0000","last_fullsized":"2024-09-17T02:20:18.287685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:46:27.427685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096944700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286097+0000","last_change":"2024-09-17T02:20:16.579478+0000","last_active":"2024-09-17T02:20:18.286097+0000","last_peered":"2024-09-17T02:20:18.286097+0000","last_clean":"2024-09-17T02:20:18.286097+0000","last_became_active":"2024-09-17T02:20:16.578705+0000","last_became_peered":"2024-09-17T02:20:16.578705+0000","last_unstale":"2024-09-17T02:20:18.286097+0000","last_undegraded":"2024-09-17T02:20:18.286097+0000","last_fullsized":"2024-09-17T02:20:18.286097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:21.656908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.586317+0000","last_change":"2024-09-17T02:20:15.558961+0000","last_active":"2024-09-17T02:20:16.586317+0000","last_peered":"2024-09-17T02:20:16.586317+0000","last_clean":"2024-09-17T02:20:16.586317+0000","last_became_active":"2024-09-17T02:20:15.558299+0000","last_became_peered":"2024-09-17T02:20:15.558299+0000","last_unstale":"2024-09-17T02:20:16.586317+0000","last_undegraded":"2024-09-17T02:20:16.586317+0000","last_fullsized":"2024-09-17T02:20:16.586317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:39.709524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.547541+0000","last_change":"2024-09-17T02:20:12.512481+0000","last_active":"2024-09-17T02:20:16.547541+0000","last_peered":"2024-09-17T02:20:16.547541+0000","last_clean":"2024-09-17T02:20:16.547541+0000","last_became_active":"2024-09-17T02:20:10.497021+0000","last_became_peered":"2024-09-17T02:20:10.497021+0000","last_unstale":"2024-09-17T02:20:16.547541+0000","last_undegraded":"2024-09-17T02:20:16.547541+0000","last_fullsized":"2024-09-17T02:20:16.547541+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:41.167283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001400079,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.565319+0000","last_change":"2024-09-17T02:20:16.560687+0000","last_active":"2024-09-17T02:20:16.565319+0000","last_peered":"2024-09-17T02:20:16.565319+0000","last_clean":"2024-09-17T02:20:16.565319+0000","last_became_active":"2024-09-17T02:20:16.559758+0000","last_became_peered":"2024-09-17T02:20:16.559758+0000","last_unstale":"2024-09-17T02:20:16.565319+0000","last_undegraded":"2024-09-17T02:20:16.565319+0000","last_fullsized":"2024-09-17T02:20:16.565319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:53.791325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.547402+0000","last_change":"2024-09-17T02:20:15.551758+0000","last_active":"2024-09-17T02:20:16.547402+0000","last_peered":"2024-09-17T02:20:16.547402+0000","last_clean":"2024-09-17T02:20:16.547402+0000","last_became_active":"2024-09-17T02:20:15.550353+0000","last_became_peered":"2024-09-17T02:20:15.550353+0000","last_unstale":"2024-09-17T02:20:16.547402+0000","last_undegraded":"2024-09-17T02:20:16.547402+0000","last_fullsized":"2024-09-17T02:20:16.547402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:04.229911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.545164+0000","last_change":"2024-09-17T02:20:12.513530+0000","last_active":"2024-09-17T02:20:16.545164+0000","last_peered":"2024-09-17T02:20:16.545164+0000","last_clean":"2024-09-17T02:20:16.545164+0000","last_became_active":"2024-09-17T02:20:10.502692+0000","last_became_peered":"2024-09-17T02:20:10.502692+0000","last_unstale":"2024-09-17T02:20:16.545164+0000","last_undegraded":"2024-09-17T02:20:16.545164+0000","last_fullsized":"2024-09-17T02:20:16.545164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:53.004641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015329009999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285205+0000","last_change":"2024-09-17T02:20:16.575882+0000","last_active":"2024-09-17T02:20:18.285205+0000","last_peered":"2024-09-17T02:20:18.285205+0000","last_clean":"2024-09-17T02:20:18.285205+0000","last_became_active":"2024-09-17T02:20:16.573968+0000","last_became_peered":"2024-09-17T02:20:16.573968+0000","last_unstale":"2024-09-17T02:20:18.285205+0000","last_undegraded":"2024-09-17T02:20:18.285205+0000","last_fullsized":"2024-09-17T02:20:18.285205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:18.090082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.586228+0000","last_change":"2024-09-17T02:20:16.582881+0000","last_active":"2024-09-17T02:20:16.586228+0000","last_peered":"2024-09-17T02:20:16.586228+0000","last_clean":"2024-09-17T02:20:16.586228+0000","last_became_active":"2024-09-17T02:20:16.580985+0000","last_became_peered":"2024-09-17T02:20:16.580985+0000","last_unstale":"2024-09-17T02:20:16.586228+0000","last_undegraded":"2024-09-17T02:20:16.586228+0000","last_fullsized":"2024-09-17T02:20:16.586228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:07.190169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.592784+0000","last_change":"2024-09-17T02:20:15.558925+0000","last_active":"2024-09-17T02:20:16.592784+0000","last_peered":"2024-09-17T02:20:16.592784+0000","last_clean":"2024-09-17T02:20:16.592784+0000","last_became_active":"2024-09-17T02:20:15.558174+0000","last_became_peered":"2024-09-17T02:20:15.558174+0000","last_unstale":"2024-09-17T02:20:16.592784+0000","last_undegraded":"2024-09-17T02:20:16.592784+0000","last_fullsized":"2024-09-17T02:20:16.592784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:55.639841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.585140+0000","last_change":"2024-09-17T02:20:16.579411+0000","last_active":"2024-09-17T02:20:16.585140+0000","last_peered":"2024-09-17T02:20:16.585140+0000","last_clean":"2024-09-17T02:20:16.585140+0000","last_became_active":"2024-09-17T02:20:16.576294+0000","last_became_peered":"2024-09-17T02:20:16.576294+0000","last_unstale":"2024-09-17T02:20:16.585140+0000","last_undegraded":"2024-09-17T02:20:16.585140+0000","last_fullsized":"2024-09-17T02:20:16.585140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:52:42.871134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287526+0000","last_change":"2024-09-17T02:20:15.569117+0000","last_active":"2024-09-17T02:20:18.287526+0000","last_peered":"2024-09-17T02:20:18.287526+0000","last_clean":"2024-09-17T02:20:18.287526+0000","last_became_active":"2024-09-17T02:20:15.567405+0000","last_became_peered":"2024-09-17T02:20:15.567405+0000","last_unstale":"2024-09-17T02:20:18.287526+0000","last_undegraded":"2024-09-17T02:20:18.287526+0000","last_fullsized":"2024-09-17T02:20:18.287526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:55:10.186481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.545050+0000","last_change":"2024-09-17T02:20:15.562827+0000","last_active":"2024-09-17T02:20:16.545050+0000","last_peered":"2024-09-17T02:20:16.545050+0000","last_clean":"2024-09-17T02:20:16.545050+0000","last_became_active":"2024-09-17T02:20:15.562073+0000","last_became_peered":"2024-09-17T02:20:15.562073+0000","last_unstale":"2024-09-17T02:20:16.545050+0000","last_undegraded":"2024-09-17T02:20:16.545050+0000","last_fullsized":"2024-09-17T02:20:16.545050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:17.866665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.584189+0000","last_change":"2024-09-17T02:20:16.577670+0000","last_active":"2024-09-17T02:20:16.584189+0000","last_peered":"2024-09-17T02:20:16.584189+0000","last_clean":"2024-09-17T02:20:16.584189+0000","last_became_active":"2024-09-17T02:20:16.575082+0000","last_became_peered":"2024-09-17T02:20:16.575082+0000","last_unstale":"2024-09-17T02:20:16.584189+0000","last_undegraded":"2024-09-17T02:20:16.584189+0000","last_fullsized":"2024-09-17T02:20:16.584189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:05.558789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.547931+0000","last_change":"2024-09-17T02:20:15.555513+0000","last_active":"2024-09-17T02:20:16.547931+0000","last_peered":"2024-09-17T02:20:16.547931+0000","last_clean":"2024-09-17T02:20:16.547931+0000","last_became_active":"2024-09-17T02:20:15.554256+0000","last_became_peered":"2024-09-17T02:20:15.554256+0000","last_unstale":"2024-09-17T02:20:16.547931+0000","last_undegraded":"2024-09-17T02:20:16.547931+0000","last_fullsized":"2024-09-17T02:20:16.547931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:52.985837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.584231+0000","last_change":"2024-09-17T02:20:16.577803+0000","last_active":"2024-09-17T02:20:16.584231+0000","last_peered":"2024-09-17T02:20:16.584231+0000","last_clean":"2024-09-17T02:20:16.584231+0000","last_became_active":"2024-09-17T02:20:16.576640+0000","last_became_peered":"2024-09-17T02:20:16.576640+0000","last_unstale":"2024-09-17T02:20:16.584231+0000","last_undegraded":"2024-09-17T02:20:16.584231+0000","last_fullsized":"2024-09-17T02:20:16.584231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:42.531174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.288014+0000","last_change":"2024-09-17T02:20:16.571738+0000","last_active":"2024-09-17T02:20:18.288014+0000","last_peered":"2024-09-17T02:20:18.288014+0000","last_clean":"2024-09-17T02:20:18.288014+0000","last_became_active":"2024-09-17T02:20:16.568615+0000","last_became_peered":"2024-09-17T02:20:16.568615+0000","last_unstale":"2024-09-17T02:20:18.288014+0000","last_undegraded":"2024-09-17T02:20:18.288014+0000","last_fullsized":"2024-09-17T02:20:18.288014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:42.931361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.543862+0000","last_change":"2024-09-17T02:20:15.558467+0000","last_active":"2024-09-17T02:20:16.543862+0000","last_peered":"2024-09-17T02:20:16.543862+0000","last_clean":"2024-09-17T02:20:16.543862+0000","last_became_active":"2024-09-17T02:20:15.557186+0000","last_became_peered":"2024-09-17T02:20:15.557186+0000","last_unstale":"2024-09-17T02:20:16.543862+0000","last_undegraded":"2024-09-17T02:20:16.543862+0000","last_fullsized":"2024-09-17T02:20:16.543862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:56.879445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.584139+0000","last_change":"2024-09-17T02:20:16.577527+0000","last_active":"2024-09-17T02:20:16.584139+0000","last_peered":"2024-09-17T02:20:16.584139+0000","last_clean":"2024-09-17T02:20:16.584139+0000","last_became_active":"2024-09-17T02:20:16.574761+0000","last_became_peered":"2024-09-17T02:20:16.574761+0000","last_unstale":"2024-09-17T02:20:16.584139+0000","last_undegraded":"2024-09-17T02:20:16.584139+0000","last_fullsized":"2024-09-17T02:20:16.584139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:01.826966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.545165+0000","last_change":"2024-09-17T02:20:15.552417+0000","last_active":"2024-09-17T02:20:16.545165+0000","last_peered":"2024-09-17T02:20:16.545165+0000","last_clean":"2024-09-17T02:20:16.545165+0000","last_became_active":"2024-09-17T02:20:15.551609+0000","last_became_peered":"2024-09-17T02:20:15.551609+0000","last_unstale":"2024-09-17T02:20:16.545165+0000","last_undegraded":"2024-09-17T02:20:16.545165+0000","last_fullsized":"2024-09-17T02:20:16.545165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:15.782658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286869+0000","last_change":"2024-09-17T02:20:16.591978+0000","last_active":"2024-09-17T02:20:18.286869+0000","last_peered":"2024-09-17T02:20:18.286869+0000","last_clean":"2024-09-17T02:20:18.286869+0000","last_became_active":"2024-09-17T02:20:16.591378+0000","last_became_peered":"2024-09-17T02:20:16.591378+0000","last_unstale":"2024-09-17T02:20:18.286869+0000","last_undegraded":"2024-09-17T02:20:18.286869+0000","last_fullsized":"2024-09-17T02:20:18.286869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:44.489118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286792+0000","last_change":"2024-09-17T02:20:15.565262+0000","last_active":"2024-09-17T02:20:18.286792+0000","last_peered":"2024-09-17T02:20:18.286792+0000","last_clean":"2024-09-17T02:20:18.286792+0000","last_became_active":"2024-09-17T02:20:15.564415+0000","last_became_peered":"2024-09-17T02:20:15.564415+0000","last_unstale":"2024-09-17T02:20:18.286792+0000","last_undegraded":"2024-09-17T02:20:18.286792+0000","last_fullsized":"2024-09-17T02:20:18.286792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:42.049312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286398+0000","last_change":"2024-09-17T02:20:16.573407+0000","last_active":"2024-09-17T02:20:18.286398+0000","last_peered":"2024-09-17T02:20:18.286398+0000","last_clean":"2024-09-17T02:20:18.286398+0000","last_became_active":"2024-09-17T02:20:16.570987+0000","last_became_peered":"2024-09-17T02:20:16.570987+0000","last_unstale":"2024-09-17T02:20:18.286398+0000","last_undegraded":"2024-09-17T02:20:18.286398+0000","last_fullsized":"2024-09-17T02:20:18.286398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:23:09.424550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286401+0000","last_change":"2024-09-17T02:20:15.568883+0000","last_active":"2024-09-17T02:20:18.286401+0000","last_peered":"2024-09-17T02:20:18.286401+0000","last_clean":"2024-09-17T02:20:18.286401+0000","last_became_active":"2024-09-17T02:20:15.567980+0000","last_became_peered":"2024-09-17T02:20:15.567980+0000","last_unstale":"2024-09-17T02:20:18.286401+0000","last_undegraded":"2024-09-17T02:20:18.286401+0000","last_fullsized":"2024-09-17T02:20:18.286401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:04.059900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.572983+0000","last_change":"2024-09-17T02:20:16.568209+0000","last_active":"2024-09-17T02:20:16.572983+0000","last_peered":"2024-09-17T02:20:16.572983+0000","last_clean":"2024-09-17T02:20:16.572983+0000","last_became_active":"2024-09-17T02:20:16.566585+0000","last_became_peered":"2024-09-17T02:20:16.566585+0000","last_unstale":"2024-09-17T02:20:16.572983+0000","last_undegraded":"2024-09-17T02:20:16.572983+0000","last_fullsized":"2024-09-17T02:20:16.572983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:52:42.871134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.587955+0000","last_change":"2024-09-17T02:20:15.558296+0000","last_active":"2024-09-17T02:20:16.587955+0000","last_peered":"2024-09-17T02:20:16.587955+0000","last_clean":"2024-09-17T02:20:16.587955+0000","last_became_active":"2024-09-17T02:20:15.557520+0000","last_became_peered":"2024-09-17T02:20:15.557520+0000","last_unstale":"2024-09-17T02:20:16.587955+0000","last_undegraded":"2024-09-17T02:20:16.587955+0000","last_fullsized":"2024-09-17T02:20:16.587955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:04.229911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.573531+0000","last_change":"2024-09-17T02:20:16.568334+0000","last_active":"2024-09-17T02:20:16.573531+0000","last_peered":"2024-09-17T02:20:16.573531+0000","last_clean":"2024-09-17T02:20:16.573531+0000","last_became_active":"2024-09-17T02:20:16.566982+0000","last_became_peered":"2024-09-17T02:20:16.566982+0000","last_unstale":"2024-09-17T02:20:16.573531+0000","last_undegraded":"2024-09-17T02:20:16.573531+0000","last_fullsized":"2024-09-17T02:20:16.573531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:31.214767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287197+0000","last_change":"2024-09-17T02:20:15.569712+0000","last_active":"2024-09-17T02:20:18.287197+0000","last_peered":"2024-09-17T02:20:18.287197+0000","last_clean":"2024-09-17T02:20:18.287197+0000","last_became_active":"2024-09-17T02:20:15.569106+0000","last_became_peered":"2024-09-17T02:20:15.569106+0000","last_unstale":"2024-09-17T02:20:18.287197+0000","last_undegraded":"2024-09-17T02:20:18.287197+0000","last_fullsized":"2024-09-17T02:20:18.287197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:02.822970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286608+0000","last_change":"2024-09-17T02:20:16.570456+0000","last_active":"2024-09-17T02:20:18.286608+0000","last_peered":"2024-09-17T02:20:18.286608+0000","last_clean":"2024-09-17T02:20:18.286608+0000","last_became_active":"2024-09-17T02:20:16.568095+0000","last_became_peered":"2024-09-17T02:20:16.568095+0000","last_unstale":"2024-09-17T02:20:18.286608+0000","last_undegraded":"2024-09-17T02:20:18.286608+0000","last_fullsized":"2024-09-17T02:20:18.286608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:58.329169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.581628+0000","last_change":"2024-09-17T02:20:15.560293+0000","last_active":"2024-09-17T02:20:16.581628+0000","last_peered":"2024-09-17T02:20:16.581628+0000","last_clean":"2024-09-17T02:20:16.581628+0000","last_became_active":"2024-09-17T02:20:15.559074+0000","last_became_peered":"2024-09-17T02:20:15.559074+0000","last_unstale":"2024-09-17T02:20:16.581628+0000","last_undegraded":"2024-09-17T02:20:16.581628+0000","last_fullsized":"2024-09-17T02:20:16.581628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:55.639841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.573725+0000","last_change":"2024-09-17T02:20:16.570950+0000","last_active":"2024-09-17T02:20:16.573725+0000","last_peered":"2024-09-17T02:20:16.573725+0000","last_clean":"2024-09-17T02:20:16.573725+0000","last_became_active":"2024-09-17T02:20:16.569496+0000","last_became_peered":"2024-09-17T02:20:16.569496+0000","last_unstale":"2024-09-17T02:20:16.573725+0000","last_undegraded":"2024-09-17T02:20:16.573725+0000","last_fullsized":"2024-09-17T02:20:16.573725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:38.051514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.584491+0000","last_change":"2024-09-17T02:20:15.544675+0000","last_active":"2024-09-17T02:20:16.584491+0000","last_peered":"2024-09-17T02:20:16.584491+0000","last_clean":"2024-09-17T02:20:16.584491+0000","last_became_active":"2024-09-17T02:20:15.544213+0000","last_became_peered":"2024-09-17T02:20:15.544213+0000","last_unstale":"2024-09-17T02:20:16.584491+0000","last_undegraded":"2024-09-17T02:20:16.584491+0000","last_fullsized":"2024-09-17T02:20:16.584491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:31.933850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35588,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336252,"statfs":{"total":96636764160,"available":96600322048,"internally_reserved":0,"allocated":245760,"data_stored":649455,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":258048,"data_stored":650090,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":176128,"data_stored":57928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,0,0,4,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T02:20:20.578 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:20:20.916 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:20:20.918 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-17T02:20:20.932 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-17T02:20:19.344034+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":249,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":198,"ondisk_log_size":198,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94232,"kb_used_data":664,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283021288,"statfs":{"total":289910292480,"available":289813798912,"internally_reserved":0,"allocated":679936,"data_stored":1357473,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,0,0,4,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2421,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.818459"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287583+0000","last_change":"2024-09-17T02:20:16.577643+0000","last_active":"2024-09-17T02:20:18.287583+0000","last_peered":"2024-09-17T02:20:18.287583+0000","last_clean":"2024-09-17T02:20:18.287583+0000","last_became_active":"2024-09-17T02:20:16.576566+0000","last_became_peered":"2024-09-17T02:20:16.576566+0000","last_unstale":"2024-09-17T02:20:18.287583+0000","last_undegraded":"2024-09-17T02:20:18.287583+0000","last_fullsized":"2024-09-17T02:20:18.287583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:34.971816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286435+0000","last_change":"2024-09-17T02:20:16.574137+0000","last_active":"2024-09-17T02:20:18.286435+0000","last_peered":"2024-09-17T02:20:18.286435+0000","last_clean":"2024-09-17T02:20:18.286435+0000","last_became_active":"2024-09-17T02:20:16.571755+0000","last_became_peered":"2024-09-17T02:20:16.571755+0000","last_unstale":"2024-09-17T02:20:18.286435+0000","last_undegraded":"2024-09-17T02:20:18.286435+0000","last_fullsized":"2024-09-17T02:20:18.286435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:56.146270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.586782+0000","last_change":"2024-09-17T02:20:16.582493+0000","last_active":"2024-09-17T02:20:16.586782+0000","last_peered":"2024-09-17T02:20:16.586782+0000","last_clean":"2024-09-17T02:20:16.586782+0000","last_became_active":"2024-09-17T02:20:16.581463+0000","last_became_peered":"2024-09-17T02:20:16.581463+0000","last_unstale":"2024-09-17T02:20:16.586782+0000","last_undegraded":"2024-09-17T02:20:16.586782+0000","last_fullsized":"2024-09-17T02:20:16.586782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:41:31.822425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.573319+0000","last_change":"2024-09-17T02:20:16.568747+0000","last_active":"2024-09-17T02:20:16.573319+0000","last_peered":"2024-09-17T02:20:16.573319+0000","last_clean":"2024-09-17T02:20:16.573319+0000","last_became_active":"2024-09-17T02:20:16.566795+0000","last_became_peered":"2024-09-17T02:20:16.566795+0000","last_unstale":"2024-09-17T02:20:16.573319+0000","last_undegraded":"2024-09-17T02:20:16.573319+0000","last_fullsized":"2024-09-17T02:20:16.573319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:46.737455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286208+0000","last_change":"2024-09-17T02:20:16.568625+0000","last_active":"2024-09-17T02:20:18.286208+0000","last_peered":"2024-09-17T02:20:18.286208+0000","last_clean":"2024-09-17T02:20:18.286208+0000","last_became_active":"2024-09-17T02:20:16.567707+0000","last_became_peered":"2024-09-17T02:20:16.567707+0000","last_unstale":"2024-09-17T02:20:18.286208+0000","last_undegraded":"2024-09-17T02:20:18.286208+0000","last_fullsized":"2024-09-17T02:20:18.286208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:44.452839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.573183+0000","last_change":"2024-09-17T02:20:16.568765+0000","last_active":"2024-09-17T02:20:16.573183+0000","last_peered":"2024-09-17T02:20:16.573183+0000","last_clean":"2024-09-17T02:20:16.573183+0000","last_became_active":"2024-09-17T02:20:16.564108+0000","last_became_peered":"2024-09-17T02:20:16.564108+0000","last_unstale":"2024-09-17T02:20:16.573183+0000","last_undegraded":"2024-09-17T02:20:16.573183+0000","last_fullsized":"2024-09-17T02:20:16.573183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:42.251927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.569247+0000","last_change":"2024-09-17T02:20:16.563357+0000","last_active":"2024-09-17T02:20:16.569247+0000","last_peered":"2024-09-17T02:20:16.569247+0000","last_clean":"2024-09-17T02:20:16.569247+0000","last_became_active":"2024-09-17T02:20:16.562276+0000","last_became_peered":"2024-09-17T02:20:16.562276+0000","last_unstale":"2024-09-17T02:20:16.569247+0000","last_undegraded":"2024-09-17T02:20:16.569247+0000","last_fullsized":"2024-09-17T02:20:16.569247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:59.341802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.573107+0000","last_change":"2024-09-17T02:20:16.568482+0000","last_active":"2024-09-17T02:20:16.573107+0000","last_peered":"2024-09-17T02:20:16.573107+0000","last_clean":"2024-09-17T02:20:16.573107+0000","last_became_active":"2024-09-17T02:20:16.565416+0000","last_became_peered":"2024-09-17T02:20:16.565416+0000","last_unstale":"2024-09-17T02:20:16.573107+0000","last_undegraded":"2024-09-17T02:20:16.573107+0000","last_fullsized":"2024-09-17T02:20:16.573107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:05.087679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.586646+0000","last_change":"2024-09-17T02:20:16.584665+0000","last_active":"2024-09-17T02:20:16.586646+0000","last_peered":"2024-09-17T02:20:16.586646+0000","last_clean":"2024-09-17T02:20:16.586646+0000","last_became_active":"2024-09-17T02:20:16.580797+0000","last_became_peered":"2024-09-17T02:20:16.580797+0000","last_unstale":"2024-09-17T02:20:16.586646+0000","last_undegraded":"2024-09-17T02:20:16.586646+0000","last_fullsized":"2024-09-17T02:20:16.586646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:38.051514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287106+0000","last_change":"2024-09-17T02:20:16.577666+0000","last_active":"2024-09-17T02:20:18.287106+0000","last_peered":"2024-09-17T02:20:18.287106+0000","last_clean":"2024-09-17T02:20:18.287106+0000","last_became_active":"2024-09-17T02:20:16.574914+0000","last_became_peered":"2024-09-17T02:20:16.574914+0000","last_unstale":"2024-09-17T02:20:18.287106+0000","last_undegraded":"2024-09-17T02:20:18.287106+0000","last_fullsized":"2024-09-17T02:20:18.287106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:48.730100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.572185+0000","last_change":"2024-09-17T02:20:16.565609+0000","last_active":"2024-09-17T02:20:16.572185+0000","last_peered":"2024-09-17T02:20:16.572185+0000","last_clean":"2024-09-17T02:20:16.572185+0000","last_became_active":"2024-09-17T02:20:16.564092+0000","last_became_peered":"2024-09-17T02:20:16.564092+0000","last_unstale":"2024-09-17T02:20:16.572185+0000","last_undegraded":"2024-09-17T02:20:16.572185+0000","last_fullsized":"2024-09-17T02:20:16.572185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:04.464014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286686+0000","last_change":"2024-09-17T02:20:16.584447+0000","last_active":"2024-09-17T02:20:18.286686+0000","last_peered":"2024-09-17T02:20:18.286686+0000","last_clean":"2024-09-17T02:20:18.286686+0000","last_became_active":"2024-09-17T02:20:16.580416+0000","last_became_peered":"2024-09-17T02:20:16.580416+0000","last_unstale":"2024-09-17T02:20:18.286686+0000","last_undegraded":"2024-09-17T02:20:18.286686+0000","last_fullsized":"2024-09-17T02:20:18.286686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:19.742400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285729+0000","last_change":"2024-09-17T02:20:16.573447+0000","last_active":"2024-09-17T02:20:18.285729+0000","last_peered":"2024-09-17T02:20:18.285729+0000","last_clean":"2024-09-17T02:20:18.285729+0000","last_became_active":"2024-09-17T02:20:16.571757+0000","last_became_peered":"2024-09-17T02:20:16.571757+0000","last_unstale":"2024-09-17T02:20:18.285729+0000","last_undegraded":"2024-09-17T02:20:18.285729+0000","last_fullsized":"2024-09-17T02:20:18.285729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:12.584579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.569335+0000","last_change":"2024-09-17T02:20:16.563197+0000","last_active":"2024-09-17T02:20:16.569335+0000","last_peered":"2024-09-17T02:20:16.569335+0000","last_clean":"2024-09-17T02:20:16.569335+0000","last_became_active":"2024-09-17T02:20:16.561221+0000","last_became_peered":"2024-09-17T02:20:16.561221+0000","last_unstale":"2024-09-17T02:20:16.569335+0000","last_undegraded":"2024-09-17T02:20:16.569335+0000","last_fullsized":"2024-09-17T02:20:16.569335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:42.531174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.585398+0000","last_change":"2024-09-17T02:20:16.581305+0000","last_active":"2024-09-17T02:20:16.585398+0000","last_peered":"2024-09-17T02:20:16.585398+0000","last_clean":"2024-09-17T02:20:16.585398+0000","last_became_active":"2024-09-17T02:20:16.580377+0000","last_became_peered":"2024-09-17T02:20:16.580377+0000","last_unstale":"2024-09-17T02:20:16.585398+0000","last_undegraded":"2024-09-17T02:20:16.585398+0000","last_fullsized":"2024-09-17T02:20:16.585398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:40.577627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.571144+0000","last_change":"2024-09-17T02:20:16.562686+0000","last_active":"2024-09-17T02:20:16.571144+0000","last_peered":"2024-09-17T02:20:16.571144+0000","last_clean":"2024-09-17T02:20:16.571144+0000","last_became_active":"2024-09-17T02:20:16.561446+0000","last_became_peered":"2024-09-17T02:20:16.561446+0000","last_unstale":"2024-09-17T02:20:16.571144+0000","last_undegraded":"2024-09-17T02:20:16.571144+0000","last_fullsized":"2024-09-17T02:20:16.571144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:05.558789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.566936+0000","last_change":"2024-09-17T02:20:16.563482+0000","last_active":"2024-09-17T02:20:16.566936+0000","last_peered":"2024-09-17T02:20:16.566936+0000","last_clean":"2024-09-17T02:20:16.566936+0000","last_became_active":"2024-09-17T02:20:16.562735+0000","last_became_peered":"2024-09-17T02:20:16.562735+0000","last_unstale":"2024-09-17T02:20:16.566936+0000","last_undegraded":"2024-09-17T02:20:16.566936+0000","last_fullsized":"2024-09-17T02:20:16.566936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:10.839201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287548+0000","last_change":"2024-09-17T02:20:16.568659+0000","last_active":"2024-09-17T02:20:18.287548+0000","last_peered":"2024-09-17T02:20:18.287548+0000","last_clean":"2024-09-17T02:20:18.287548+0000","last_became_active":"2024-09-17T02:20:16.565734+0000","last_became_peered":"2024-09-17T02:20:16.565734+0000","last_unstale":"2024-09-17T02:20:18.287548+0000","last_undegraded":"2024-09-17T02:20:18.287548+0000","last_fullsized":"2024-09-17T02:20:18.287548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:05.723619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.589834+0000","last_change":"2024-09-17T02:20:16.586950+0000","last_active":"2024-09-17T02:20:16.589834+0000","last_peered":"2024-09-17T02:20:16.589834+0000","last_clean":"2024-09-17T02:20:16.589834+0000","last_became_active":"2024-09-17T02:20:16.586281+0000","last_became_peered":"2024-09-17T02:20:16.586281+0000","last_unstale":"2024-09-17T02:20:16.589834+0000","last_undegraded":"2024-09-17T02:20:16.589834+0000","last_fullsized":"2024-09-17T02:20:16.589834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:02.039167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.573605+0000","last_change":"2024-09-17T02:20:16.570514+0000","last_active":"2024-09-17T02:20:16.573605+0000","last_peered":"2024-09-17T02:20:16.573605+0000","last_clean":"2024-09-17T02:20:16.573605+0000","last_became_active":"2024-09-17T02:20:16.567156+0000","last_became_peered":"2024-09-17T02:20:16.567156+0000","last_unstale":"2024-09-17T02:20:16.573605+0000","last_undegraded":"2024-09-17T02:20:16.573605+0000","last_fullsized":"2024-09-17T02:20:16.573605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:25.757570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.573729+0000","last_change":"2024-09-17T02:20:16.571275+0000","last_active":"2024-09-17T02:20:16.573729+0000","last_peered":"2024-09-17T02:20:16.573729+0000","last_clean":"2024-09-17T02:20:16.573729+0000","last_became_active":"2024-09-17T02:20:16.569751+0000","last_became_peered":"2024-09-17T02:20:16.569751+0000","last_unstale":"2024-09-17T02:20:16.573729+0000","last_undegraded":"2024-09-17T02:20:16.573729+0000","last_fullsized":"2024-09-17T02:20:16.573729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:02.039167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285399+0000","last_change":"2024-09-17T02:20:16.567109+0000","last_active":"2024-09-17T02:20:18.285399+0000","last_peered":"2024-09-17T02:20:18.285399+0000","last_clean":"2024-09-17T02:20:18.285399+0000","last_became_active":"2024-09-17T02:20:16.564753+0000","last_became_peered":"2024-09-17T02:20:16.564753+0000","last_unstale":"2024-09-17T02:20:18.285399+0000","last_undegraded":"2024-09-17T02:20:18.285399+0000","last_fullsized":"2024-09-17T02:20:18.285399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:01.888476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.563090+0000","last_change":"2024-09-17T02:20:16.558778+0000","last_active":"2024-09-17T02:20:16.563090+0000","last_peered":"2024-09-17T02:20:16.563090+0000","last_clean":"2024-09-17T02:20:16.563090+0000","last_became_active":"2024-09-17T02:20:16.557967+0000","last_became_peered":"2024-09-17T02:20:16.557967+0000","last_unstale":"2024-09-17T02:20:16.563090+0000","last_undegraded":"2024-09-17T02:20:16.563090+0000","last_fullsized":"2024-09-17T02:20:16.563090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:16.855771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285052+0000","last_change":"2024-09-17T02:20:16.564194+0000","last_active":"2024-09-17T02:20:18.285052+0000","last_peered":"2024-09-17T02:20:18.285052+0000","last_clean":"2024-09-17T02:20:18.285052+0000","last_became_active":"2024-09-17T02:20:16.562564+0000","last_became_peered":"2024-09-17T02:20:16.562564+0000","last_unstale":"2024-09-17T02:20:18.285052+0000","last_undegraded":"2024-09-17T02:20:18.285052+0000","last_fullsized":"2024-09-17T02:20:18.285052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:10.932999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287608+0000","last_change":"2024-09-17T02:20:16.573189+0000","last_active":"2024-09-17T02:20:18.287608+0000","last_peered":"2024-09-17T02:20:18.287608+0000","last_clean":"2024-09-17T02:20:18.287608+0000","last_became_active":"2024-09-17T02:20:16.570669+0000","last_became_peered":"2024-09-17T02:20:16.570669+0000","last_unstale":"2024-09-17T02:20:18.287608+0000","last_undegraded":"2024-09-17T02:20:18.287608+0000","last_fullsized":"2024-09-17T02:20:18.287608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:52.753219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.585474+0000","last_change":"2024-09-17T02:20:16.581076+0000","last_active":"2024-09-17T02:20:16.585474+0000","last_peered":"2024-09-17T02:20:16.585474+0000","last_clean":"2024-09-17T02:20:16.585474+0000","last_became_active":"2024-09-17T02:20:16.579989+0000","last_became_peered":"2024-09-17T02:20:16.579989+0000","last_unstale":"2024-09-17T02:20:16.585474+0000","last_undegraded":"2024-09-17T02:20:16.585474+0000","last_fullsized":"2024-09-17T02:20:16.585474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:42.251927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.586849+0000","last_change":"2024-09-17T02:20:16.582808+0000","last_active":"2024-09-17T02:20:16.586849+0000","last_peered":"2024-09-17T02:20:16.586849+0000","last_clean":"2024-09-17T02:20:16.586849+0000","last_became_active":"2024-09-17T02:20:16.581358+0000","last_became_peered":"2024-09-17T02:20:16.581358+0000","last_unstale":"2024-09-17T02:20:16.586849+0000","last_undegraded":"2024-09-17T02:20:16.586849+0000","last_fullsized":"2024-09-17T02:20:16.586849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:21.356437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287997+0000","last_change":"2024-09-17T02:20:16.583361+0000","last_active":"2024-09-17T02:20:18.287997+0000","last_peered":"2024-09-17T02:20:18.287997+0000","last_clean":"2024-09-17T02:20:18.287997+0000","last_became_active":"2024-09-17T02:20:16.579817+0000","last_became_peered":"2024-09-17T02:20:16.579817+0000","last_unstale":"2024-09-17T02:20:18.287997+0000","last_undegraded":"2024-09-17T02:20:18.287997+0000","last_fullsized":"2024-09-17T02:20:18.287997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:54.029860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.585491+0000","last_change":"2024-09-17T02:20:16.581125+0000","last_active":"2024-09-17T02:20:16.585491+0000","last_peered":"2024-09-17T02:20:16.585491+0000","last_clean":"2024-09-17T02:20:16.585491+0000","last_became_active":"2024-09-17T02:20:16.580393+0000","last_became_peered":"2024-09-17T02:20:16.580393+0000","last_unstale":"2024-09-17T02:20:16.585491+0000","last_undegraded":"2024-09-17T02:20:16.585491+0000","last_fullsized":"2024-09-17T02:20:16.585491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:25.757570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286569+0000","last_change":"2024-09-17T02:20:16.565220+0000","last_active":"2024-09-17T02:20:18.286569+0000","last_peered":"2024-09-17T02:20:18.286569+0000","last_clean":"2024-09-17T02:20:18.286569+0000","last_became_active":"2024-09-17T02:20:16.562419+0000","last_became_peered":"2024-09-17T02:20:16.562419+0000","last_unstale":"2024-09-17T02:20:18.286569+0000","last_undegraded":"2024-09-17T02:20:18.286569+0000","last_fullsized":"2024-09-17T02:20:18.286569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:03.961277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.585181+0000","last_change":"2024-09-17T02:20:16.579408+0000","last_active":"2024-09-17T02:20:16.585181+0000","last_peered":"2024-09-17T02:20:16.585181+0000","last_clean":"2024-09-17T02:20:16.585181+0000","last_became_active":"2024-09-17T02:20:16.577202+0000","last_became_peered":"2024-09-17T02:20:16.577202+0000","last_unstale":"2024-09-17T02:20:16.585181+0000","last_undegraded":"2024-09-17T02:20:16.585181+0000","last_fullsized":"2024-09-17T02:20:16.585181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:31.214767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.573662+0000","last_change":"2024-09-17T02:20:16.570810+0000","last_active":"2024-09-17T02:20:16.573662+0000","last_peered":"2024-09-17T02:20:16.573662+0000","last_clean":"2024-09-17T02:20:16.573662+0000","last_became_active":"2024-09-17T02:20:16.569273+0000","last_became_peered":"2024-09-17T02:20:16.569273+0000","last_unstale":"2024-09-17T02:20:16.573662+0000","last_undegraded":"2024-09-17T02:20:16.573662+0000","last_fullsized":"2024-09-17T02:20:16.573662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:34.105158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287137+0000","last_change":"2024-09-17T02:20:16.572798+0000","last_active":"2024-09-17T02:20:18.287137+0000","last_peered":"2024-09-17T02:20:18.287137+0000","last_clean":"2024-09-17T02:20:18.287137+0000","last_became_active":"2024-09-17T02:20:16.571174+0000","last_became_peered":"2024-09-17T02:20:16.571174+0000","last_unstale":"2024-09-17T02:20:18.287137+0000","last_undegraded":"2024-09-17T02:20:18.287137+0000","last_fullsized":"2024-09-17T02:20:18.287137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:00.116621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.587195+0000","last_change":"2024-09-17T02:20:15.559935+0000","last_active":"2024-09-17T02:20:16.587195+0000","last_peered":"2024-09-17T02:20:16.587195+0000","last_clean":"2024-09-17T02:20:16.587195+0000","last_became_active":"2024-09-17T02:20:15.559413+0000","last_became_peered":"2024-09-17T02:20:15.559413+0000","last_unstale":"2024-09-17T02:20:16.587195+0000","last_undegraded":"2024-09-17T02:20:16.587195+0000","last_fullsized":"2024-09-17T02:20:16.587195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:52.985837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287177+0000","last_change":"2024-09-17T02:20:16.581819+0000","last_active":"2024-09-17T02:20:18.287177+0000","last_peered":"2024-09-17T02:20:18.287177+0000","last_clean":"2024-09-17T02:20:18.287177+0000","last_became_active":"2024-09-17T02:20:16.577168+0000","last_became_peered":"2024-09-17T02:20:16.577168+0000","last_unstale":"2024-09-17T02:20:18.287177+0000","last_undegraded":"2024-09-17T02:20:18.287177+0000","last_fullsized":"2024-09-17T02:20:18.287177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:47.756576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.543151+0000","last_change":"2024-09-17T02:20:15.550890+0000","last_active":"2024-09-17T02:20:16.543151+0000","last_peered":"2024-09-17T02:20:16.543151+0000","last_clean":"2024-09-17T02:20:16.543151+0000","last_became_active":"2024-09-17T02:20:15.550077+0000","last_became_peered":"2024-09-17T02:20:15.550077+0000","last_unstale":"2024-09-17T02:20:16.543151+0000","last_undegraded":"2024-09-17T02:20:16.543151+0000","last_fullsized":"2024-09-17T02:20:16.543151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:36.119249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.585537+0000","last_change":"2024-09-17T02:20:16.581457+0000","last_active":"2024-09-17T02:20:16.585537+0000","last_peered":"2024-09-17T02:20:16.585537+0000","last_clean":"2024-09-17T02:20:16.585537+0000","last_became_active":"2024-09-17T02:20:16.579428+0000","last_became_peered":"2024-09-17T02:20:16.579428+0000","last_unstale":"2024-09-17T02:20:16.585537+0000","last_undegraded":"2024-09-17T02:20:16.585537+0000","last_fullsized":"2024-09-17T02:20:16.585537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:34.105158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285758+0000","last_change":"2024-09-17T02:20:15.569442+0000","last_active":"2024-09-17T02:20:18.285758+0000","last_peered":"2024-09-17T02:20:18.285758+0000","last_clean":"2024-09-17T02:20:18.285758+0000","last_became_active":"2024-09-17T02:20:15.567946+0000","last_became_peered":"2024-09-17T02:20:15.567946+0000","last_unstale":"2024-09-17T02:20:18.285758+0000","last_undegraded":"2024-09-17T02:20:18.285758+0000","last_fullsized":"2024-09-17T02:20:18.285758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:55.866388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.585200+0000","last_change":"2024-09-17T02:20:16.579779+0000","last_active":"2024-09-17T02:20:16.585200+0000","last_peered":"2024-09-17T02:20:16.585200+0000","last_clean":"2024-09-17T02:20:16.585200+0000","last_became_active":"2024-09-17T02:20:16.576734+0000","last_became_peered":"2024-09-17T02:20:16.576734+0000","last_unstale":"2024-09-17T02:20:16.585200+0000","last_undegraded":"2024-09-17T02:20:16.585200+0000","last_fullsized":"2024-09-17T02:20:16.585200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:05.087679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.588816+0000","last_change":"2024-09-17T02:20:15.559245+0000","last_active":"2024-09-17T02:20:16.588816+0000","last_peered":"2024-09-17T02:20:16.588816+0000","last_clean":"2024-09-17T02:20:16.588816+0000","last_became_active":"2024-09-17T02:20:15.558518+0000","last_became_peered":"2024-09-17T02:20:15.558518+0000","last_unstale":"2024-09-17T02:20:16.588816+0000","last_undegraded":"2024-09-17T02:20:16.588816+0000","last_fullsized":"2024-09-17T02:20:16.588816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:52.783635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.584564+0000","last_change":"2024-09-17T02:20:15.559110+0000","last_active":"2024-09-17T02:20:16.584564+0000","last_peered":"2024-09-17T02:20:16.584564+0000","last_clean":"2024-09-17T02:20:16.584564+0000","last_became_active":"2024-09-17T02:20:15.558285+0000","last_became_peered":"2024-09-17T02:20:15.558285+0000","last_unstale":"2024-09-17T02:20:16.584564+0000","last_undegraded":"2024-09-17T02:20:16.584564+0000","last_fullsized":"2024-09-17T02:20:16.584564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:15.782658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285013+0000","last_change":"2024-09-17T02:20:16.584359+0000","last_active":"2024-09-17T02:20:18.285013+0000","last_peered":"2024-09-17T02:20:18.285013+0000","last_clean":"2024-09-17T02:20:18.285013+0000","last_became_active":"2024-09-17T02:20:16.582303+0000","last_became_peered":"2024-09-17T02:20:16.582303+0000","last_unstale":"2024-09-17T02:20:18.285013+0000","last_undegraded":"2024-09-17T02:20:18.285013+0000","last_fullsized":"2024-09-17T02:20:18.285013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:12.345284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287762+0000","last_change":"2024-09-17T02:20:15.568414+0000","last_active":"2024-09-17T02:20:18.287762+0000","last_peered":"2024-09-17T02:20:18.287762+0000","last_clean":"2024-09-17T02:20:18.287762+0000","last_became_active":"2024-09-17T02:20:15.567596+0000","last_became_peered":"2024-09-17T02:20:15.567596+0000","last_unstale":"2024-09-17T02:20:18.287762+0000","last_undegraded":"2024-09-17T02:20:18.287762+0000","last_fullsized":"2024-09-17T02:20:18.287762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:11.356699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285690+0000","last_change":"2024-09-17T02:20:16.565402+0000","last_active":"2024-09-17T02:20:18.285690+0000","last_peered":"2024-09-17T02:20:18.285690+0000","last_clean":"2024-09-17T02:20:18.285690+0000","last_became_active":"2024-09-17T02:20:16.563113+0000","last_became_peered":"2024-09-17T02:20:16.563113+0000","last_unstale":"2024-09-17T02:20:18.285690+0000","last_undegraded":"2024-09-17T02:20:18.285690+0000","last_fullsized":"2024-09-17T02:20:18.285690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:38:36.115641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.587805+0000","last_change":"2024-09-17T02:20:15.559767+0000","last_active":"2024-09-17T02:20:16.587805+0000","last_peered":"2024-09-17T02:20:16.587805+0000","last_clean":"2024-09-17T02:20:16.587805+0000","last_became_active":"2024-09-17T02:20:15.558888+0000","last_became_peered":"2024-09-17T02:20:15.558888+0000","last_unstale":"2024-09-17T02:20:16.587805+0000","last_undegraded":"2024-09-17T02:20:16.587805+0000","last_fullsized":"2024-09-17T02:20:16.587805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:09.831510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.572298+0000","last_change":"2024-09-17T02:20:16.565632+0000","last_active":"2024-09-17T02:20:16.572298+0000","last_peered":"2024-09-17T02:20:16.572298+0000","last_clean":"2024-09-17T02:20:16.572298+0000","last_became_active":"2024-09-17T02:20:16.563630+0000","last_became_peered":"2024-09-17T02:20:16.563630+0000","last_unstale":"2024-09-17T02:20:16.572298+0000","last_undegraded":"2024-09-17T02:20:16.572298+0000","last_fullsized":"2024-09-17T02:20:16.572298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:57.008091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.548943+0000","last_change":"2024-09-17T02:20:15.562539+0000","last_active":"2024-09-17T02:20:16.548943+0000","last_peered":"2024-09-17T02:20:16.548943+0000","last_clean":"2024-09-17T02:20:16.548943+0000","last_became_active":"2024-09-17T02:20:15.561801+0000","last_became_peered":"2024-09-17T02:20:15.561801+0000","last_unstale":"2024-09-17T02:20:16.548943+0000","last_undegraded":"2024-09-17T02:20:16.548943+0000","last_fullsized":"2024-09-17T02:20:16.548943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:15.848081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.585059+0000","last_change":"2024-09-17T02:20:16.578474+0000","last_active":"2024-09-17T02:20:16.585059+0000","last_peered":"2024-09-17T02:20:16.585059+0000","last_clean":"2024-09-17T02:20:16.585059+0000","last_became_active":"2024-09-17T02:20:16.576264+0000","last_became_peered":"2024-09-17T02:20:16.576264+0000","last_unstale":"2024-09-17T02:20:16.585059+0000","last_undegraded":"2024-09-17T02:20:16.585059+0000","last_fullsized":"2024-09-17T02:20:16.585059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:59.341802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.583282+0000","last_change":"2024-09-17T02:20:15.551986+0000","last_active":"2024-09-17T02:20:16.583282+0000","last_peered":"2024-09-17T02:20:16.583282+0000","last_clean":"2024-09-17T02:20:16.583282+0000","last_became_active":"2024-09-17T02:20:15.550418+0000","last_became_peered":"2024-09-17T02:20:15.550418+0000","last_unstale":"2024-09-17T02:20:16.583282+0000","last_undegraded":"2024-09-17T02:20:16.583282+0000","last_fullsized":"2024-09-17T02:20:16.583282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:17.866665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.573722+0000","last_change":"2024-09-17T02:20:16.570845+0000","last_active":"2024-09-17T02:20:16.573722+0000","last_peered":"2024-09-17T02:20:16.573722+0000","last_clean":"2024-09-17T02:20:16.573722+0000","last_became_active":"2024-09-17T02:20:16.568862+0000","last_became_peered":"2024-09-17T02:20:16.568862+0000","last_unstale":"2024-09-17T02:20:16.573722+0000","last_undegraded":"2024-09-17T02:20:16.573722+0000","last_fullsized":"2024-09-17T02:20:16.573722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:18.975086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.548072+0000","last_change":"2024-09-17T02:20:15.559849+0000","last_active":"2024-09-17T02:20:16.548072+0000","last_peered":"2024-09-17T02:20:16.548072+0000","last_clean":"2024-09-17T02:20:16.548072+0000","last_became_active":"2024-09-17T02:20:15.559431+0000","last_became_peered":"2024-09-17T02:20:15.559431+0000","last_unstale":"2024-09-17T02:20:16.548072+0000","last_undegraded":"2024-09-17T02:20:16.548072+0000","last_fullsized":"2024-09-17T02:20:16.548072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:31.933850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.589092+0000","last_change":"2024-09-17T02:20:16.586434+0000","last_active":"2024-09-17T02:20:16.589092+0000","last_peered":"2024-09-17T02:20:16.589092+0000","last_clean":"2024-09-17T02:20:16.589092+0000","last_became_active":"2024-09-17T02:20:16.585466+0000","last_became_peered":"2024-09-17T02:20:16.585466+0000","last_unstale":"2024-09-17T02:20:16.589092+0000","last_undegraded":"2024-09-17T02:20:16.589092+0000","last_fullsized":"2024-09-17T02:20:16.589092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:24.706394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286282+0000","last_change":"2024-09-17T02:20:15.568506+0000","last_active":"2024-09-17T02:20:18.286282+0000","last_peered":"2024-09-17T02:20:18.286282+0000","last_clean":"2024-09-17T02:20:18.286282+0000","last_became_active":"2024-09-17T02:20:15.567720+0000","last_became_peered":"2024-09-17T02:20:15.567720+0000","last_unstale":"2024-09-17T02:20:18.286282+0000","last_undegraded":"2024-09-17T02:20:18.286282+0000","last_fullsized":"2024-09-17T02:20:18.286282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:46.560153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.586056+0000","last_change":"2024-09-17T02:20:16.582353+0000","last_active":"2024-09-17T02:20:16.586056+0000","last_peered":"2024-09-17T02:20:16.586056+0000","last_clean":"2024-09-17T02:20:16.586056+0000","last_became_active":"2024-09-17T02:20:16.581462+0000","last_became_peered":"2024-09-17T02:20:16.581462+0000","last_unstale":"2024-09-17T02:20:16.586056+0000","last_undegraded":"2024-09-17T02:20:16.586056+0000","last_fullsized":"2024-09-17T02:20:16.586056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:20.414231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285391+0000","last_change":"2024-09-17T02:20:15.565444+0000","last_active":"2024-09-17T02:20:18.285391+0000","last_peered":"2024-09-17T02:20:18.285391+0000","last_clean":"2024-09-17T02:20:18.285391+0000","last_became_active":"2024-09-17T02:20:15.564640+0000","last_became_peered":"2024-09-17T02:20:15.564640+0000","last_unstale":"2024-09-17T02:20:18.285391+0000","last_undegraded":"2024-09-17T02:20:18.285391+0000","last_fullsized":"2024-09-17T02:20:18.285391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:29.214563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.586581+0000","last_change":"2024-09-17T02:20:16.583084+0000","last_active":"2024-09-17T02:20:16.586581+0000","last_peered":"2024-09-17T02:20:16.586581+0000","last_clean":"2024-09-17T02:20:16.586581+0000","last_became_active":"2024-09-17T02:20:16.582326+0000","last_became_peered":"2024-09-17T02:20:16.582326+0000","last_unstale":"2024-09-17T02:20:16.586581+0000","last_undegraded":"2024-09-17T02:20:16.586581+0000","last_fullsized":"2024-09-17T02:20:16.586581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:18.975086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":222,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.549481+0000","last_change":"2024-09-17T02:20:04.612894+0000","last_active":"2024-09-17T02:20:16.549481+0000","last_peered":"2024-09-17T02:20:16.549481+0000","last_clean":"2024-09-17T02:20:16.549481+0000","last_became_active":"2024-09-17T02:20:04.610517+0000","last_became_peered":"2024-09-17T02:20:04.610517+0000","last_unstale":"2024-09-17T02:20:16.549481+0000","last_undegraded":"2024-09-17T02:20:16.549481+0000","last_fullsized":"2024-09-17T02:20:16.549481+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_clean_scrub_stamp":"2024-09-17T02:20:03.432050+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:51.879303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.549339+0000","last_change":"2024-09-17T02:20:12.513513+0000","last_active":"2024-09-17T02:20:16.549339+0000","last_peered":"2024-09-17T02:20:16.549339+0000","last_clean":"2024-09-17T02:20:16.549339+0000","last_became_active":"2024-09-17T02:20:10.504616+0000","last_became_peered":"2024-09-17T02:20:10.504616+0000","last_unstale":"2024-09-17T02:20:16.549339+0000","last_undegraded":"2024-09-17T02:20:16.549339+0000","last_fullsized":"2024-09-17T02:20:16.549339+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:13.341611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001517832,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.543871+0000","last_change":"2024-09-17T02:20:15.560646+0000","last_active":"2024-09-17T02:20:16.543871+0000","last_peered":"2024-09-17T02:20:16.543871+0000","last_clean":"2024-09-17T02:20:16.543871+0000","last_became_active":"2024-09-17T02:20:15.559104+0000","last_became_peered":"2024-09-17T02:20:15.559104+0000","last_unstale":"2024-09-17T02:20:16.543871+0000","last_undegraded":"2024-09-17T02:20:16.543871+0000","last_fullsized":"2024-09-17T02:20:16.543871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:44.299986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.588442+0000","last_change":"2024-09-17T02:20:16.585522+0000","last_active":"2024-09-17T02:20:16.588442+0000","last_peered":"2024-09-17T02:20:16.588442+0000","last_clean":"2024-09-17T02:20:16.588442+0000","last_became_active":"2024-09-17T02:20:16.584520+0000","last_became_peered":"2024-09-17T02:20:16.584520+0000","last_unstale":"2024-09-17T02:20:16.588442+0000","last_undegraded":"2024-09-17T02:20:16.588442+0000","last_fullsized":"2024-09-17T02:20:16.588442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:54:33.088375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.549172+0000","last_change":"2024-09-17T02:20:12.512798+0000","last_active":"2024-09-17T02:20:16.549172+0000","last_peered":"2024-09-17T02:20:16.549172+0000","last_clean":"2024-09-17T02:20:16.549172+0000","last_became_active":"2024-09-17T02:20:10.502115+0000","last_became_peered":"2024-09-17T02:20:10.502115+0000","last_unstale":"2024-09-17T02:20:16.549172+0000","last_undegraded":"2024-09-17T02:20:16.549172+0000","last_fullsized":"2024-09-17T02:20:16.549172+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:17.554878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083467700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.544565+0000","last_change":"2024-09-17T02:20:15.551632+0000","last_active":"2024-09-17T02:20:16.544565+0000","last_peered":"2024-09-17T02:20:16.544565+0000","last_clean":"2024-09-17T02:20:16.544565+0000","last_became_active":"2024-09-17T02:20:15.551062+0000","last_became_peered":"2024-09-17T02:20:15.551062+0000","last_unstale":"2024-09-17T02:20:16.544565+0000","last_undegraded":"2024-09-17T02:20:16.544565+0000","last_fullsized":"2024-09-17T02:20:16.544565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:55.295518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287261+0000","last_change":"2024-09-17T02:20:16.571568+0000","last_active":"2024-09-17T02:20:18.287261+0000","last_peered":"2024-09-17T02:20:18.287261+0000","last_clean":"2024-09-17T02:20:18.287261+0000","last_became_active":"2024-09-17T02:20:16.570622+0000","last_became_peered":"2024-09-17T02:20:16.570622+0000","last_unstale":"2024-09-17T02:20:18.287261+0000","last_undegraded":"2024-09-17T02:20:18.287261+0000","last_fullsized":"2024-09-17T02:20:18.287261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:57.083446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.544742+0000","last_change":"2024-09-17T02:20:12.511823+0000","last_active":"2024-09-17T02:20:16.544742+0000","last_peered":"2024-09-17T02:20:16.544742+0000","last_clean":"2024-09-17T02:20:16.544742+0000","last_became_active":"2024-09-17T02:20:10.497164+0000","last_became_peered":"2024-09-17T02:20:10.497164+0000","last_unstale":"2024-09-17T02:20:16.544742+0000","last_undegraded":"2024-09-17T02:20:16.544742+0000","last_fullsized":"2024-09-17T02:20:16.544742+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:21.242753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081052700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285368+0000","last_change":"2024-09-17T02:20:15.569475+0000","last_active":"2024-09-17T02:20:18.285368+0000","last_peered":"2024-09-17T02:20:18.285368+0000","last_clean":"2024-09-17T02:20:18.285368+0000","last_became_active":"2024-09-17T02:20:15.567965+0000","last_became_peered":"2024-09-17T02:20:15.567965+0000","last_unstale":"2024-09-17T02:20:18.285368+0000","last_undegraded":"2024-09-17T02:20:18.285368+0000","last_fullsized":"2024-09-17T02:20:18.285368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:06.649112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.585250+0000","last_change":"2024-09-17T02:20:16.578902+0000","last_active":"2024-09-17T02:20:16.585250+0000","last_peered":"2024-09-17T02:20:16.585250+0000","last_clean":"2024-09-17T02:20:16.585250+0000","last_became_active":"2024-09-17T02:20:16.576512+0000","last_became_peered":"2024-09-17T02:20:16.576512+0000","last_unstale":"2024-09-17T02:20:16.585250+0000","last_undegraded":"2024-09-17T02:20:16.585250+0000","last_fullsized":"2024-09-17T02:20:16.585250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:04.464014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.546556+0000","last_change":"2024-09-17T02:20:12.512742+0000","last_active":"2024-09-17T02:20:16.546556+0000","last_peered":"2024-09-17T02:20:16.546556+0000","last_clean":"2024-09-17T02:20:16.546556+0000","last_became_active":"2024-09-17T02:20:10.503622+0000","last_became_peered":"2024-09-17T02:20:10.503622+0000","last_unstale":"2024-09-17T02:20:16.546556+0000","last_undegraded":"2024-09-17T02:20:16.546556+0000","last_fullsized":"2024-09-17T02:20:16.546556+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:36.226043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078085399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.549379+0000","last_change":"2024-09-17T02:20:15.562840+0000","last_active":"2024-09-17T02:20:16.549379+0000","last_peered":"2024-09-17T02:20:16.549379+0000","last_clean":"2024-09-17T02:20:16.549379+0000","last_became_active":"2024-09-17T02:20:15.562177+0000","last_became_peered":"2024-09-17T02:20:15.562177+0000","last_unstale":"2024-09-17T02:20:16.549379+0000","last_undegraded":"2024-09-17T02:20:16.549379+0000","last_fullsized":"2024-09-17T02:20:16.549379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:39.709524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.585280+0000","last_change":"2024-09-17T02:20:16.580184+0000","last_active":"2024-09-17T02:20:16.585280+0000","last_peered":"2024-09-17T02:20:16.585280+0000","last_clean":"2024-09-17T02:20:16.585280+0000","last_became_active":"2024-09-17T02:20:16.578343+0000","last_became_peered":"2024-09-17T02:20:16.578343+0000","last_unstale":"2024-09-17T02:20:16.585280+0000","last_undegraded":"2024-09-17T02:20:16.585280+0000","last_fullsized":"2024-09-17T02:20:16.585280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:46.737455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.550190+0000","last_change":"2024-09-17T02:20:15.562922+0000","last_active":"2024-09-17T02:20:16.550190+0000","last_peered":"2024-09-17T02:20:16.550190+0000","last_clean":"2024-09-17T02:20:16.550190+0000","last_became_active":"2024-09-17T02:20:15.562138+0000","last_became_peered":"2024-09-17T02:20:15.562138+0000","last_unstale":"2024-09-17T02:20:16.550190+0000","last_undegraded":"2024-09-17T02:20:16.550190+0000","last_fullsized":"2024-09-17T02:20:16.550190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:00.819275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.544771+0000","last_change":"2024-09-17T02:20:12.511838+0000","last_active":"2024-09-17T02:20:16.544771+0000","last_peered":"2024-09-17T02:20:16.544771+0000","last_clean":"2024-09-17T02:20:16.544771+0000","last_became_active":"2024-09-17T02:20:10.497049+0000","last_became_peered":"2024-09-17T02:20:10.497049+0000","last_unstale":"2024-09-17T02:20:16.544771+0000","last_undegraded":"2024-09-17T02:20:16.544771+0000","last_fullsized":"2024-09-17T02:20:16.544771+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:54.446484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079701100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286426+0000","last_change":"2024-09-17T02:20:16.571485+0000","last_active":"2024-09-17T02:20:18.286426+0000","last_peered":"2024-09-17T02:20:18.286426+0000","last_clean":"2024-09-17T02:20:18.286426+0000","last_became_active":"2024-09-17T02:20:16.567570+0000","last_became_peered":"2024-09-17T02:20:16.567570+0000","last_unstale":"2024-09-17T02:20:18.286426+0000","last_undegraded":"2024-09-17T02:20:18.286426+0000","last_fullsized":"2024-09-17T02:20:18.286426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:14.228385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.544626+0000","last_change":"2024-09-17T02:20:15.559252+0000","last_active":"2024-09-17T02:20:16.544626+0000","last_peered":"2024-09-17T02:20:16.544626+0000","last_clean":"2024-09-17T02:20:16.544626+0000","last_became_active":"2024-09-17T02:20:15.557667+0000","last_became_peered":"2024-09-17T02:20:15.557667+0000","last_unstale":"2024-09-17T02:20:16.544626+0000","last_undegraded":"2024-09-17T02:20:16.544626+0000","last_fullsized":"2024-09-17T02:20:16.544626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:01.292626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287685+0000","last_change":"2024-09-17T02:20:12.661034+0000","last_active":"2024-09-17T02:20:18.287685+0000","last_peered":"2024-09-17T02:20:18.287685+0000","last_clean":"2024-09-17T02:20:18.287685+0000","last_became_active":"2024-09-17T02:20:10.497829+0000","last_became_peered":"2024-09-17T02:20:10.497829+0000","last_unstale":"2024-09-17T02:20:18.287685+0000","last_undegraded":"2024-09-17T02:20:18.287685+0000","last_fullsized":"2024-09-17T02:20:18.287685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:46:27.427685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096944700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286097+0000","last_change":"2024-09-17T02:20:16.579478+0000","last_active":"2024-09-17T02:20:18.286097+0000","last_peered":"2024-09-17T02:20:18.286097+0000","last_clean":"2024-09-17T02:20:18.286097+0000","last_became_active":"2024-09-17T02:20:16.578705+0000","last_became_peered":"2024-09-17T02:20:16.578705+0000","last_unstale":"2024-09-17T02:20:18.286097+0000","last_undegraded":"2024-09-17T02:20:18.286097+0000","last_fullsized":"2024-09-17T02:20:18.286097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:21.656908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.586317+0000","last_change":"2024-09-17T02:20:15.558961+0000","last_active":"2024-09-17T02:20:16.586317+0000","last_peered":"2024-09-17T02:20:16.586317+0000","last_clean":"2024-09-17T02:20:16.586317+0000","last_became_active":"2024-09-17T02:20:15.558299+0000","last_became_peered":"2024-09-17T02:20:15.558299+0000","last_unstale":"2024-09-17T02:20:16.586317+0000","last_undegraded":"2024-09-17T02:20:16.586317+0000","last_fullsized":"2024-09-17T02:20:16.586317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:39.709524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.547541+0000","last_change":"2024-09-17T02:20:12.512481+0000","last_active":"2024-09-17T02:20:16.547541+0000","last_peered":"2024-09-17T02:20:16.547541+0000","last_clean":"2024-09-17T02:20:16.547541+0000","last_became_active":"2024-09-17T02:20:10.497021+0000","last_became_peered":"2024-09-17T02:20:10.497021+0000","last_unstale":"2024-09-17T02:20:16.547541+0000","last_undegraded":"2024-09-17T02:20:16.547541+0000","last_fullsized":"2024-09-17T02:20:16.547541+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:41.167283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001400079,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.565319+0000","last_change":"2024-09-17T02:20:16.560687+0000","last_active":"2024-09-17T02:20:16.565319+0000","last_peered":"2024-09-17T02:20:16.565319+0000","last_clean":"2024-09-17T02:20:16.565319+0000","last_became_active":"2024-09-17T02:20:16.559758+0000","last_became_peered":"2024-09-17T02:20:16.559758+0000","last_unstale":"2024-09-17T02:20:16.565319+0000","last_undegraded":"2024-09-17T02:20:16.565319+0000","last_fullsized":"2024-09-17T02:20:16.565319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:53.791325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.547402+0000","last_change":"2024-09-17T02:20:15.551758+0000","last_active":"2024-09-17T02:20:16.547402+0000","last_peered":"2024-09-17T02:20:16.547402+0000","last_clean":"2024-09-17T02:20:16.547402+0000","last_became_active":"2024-09-17T02:20:15.550353+0000","last_became_peered":"2024-09-17T02:20:15.550353+0000","last_unstale":"2024-09-17T02:20:16.547402+0000","last_undegraded":"2024-09-17T02:20:16.547402+0000","last_fullsized":"2024-09-17T02:20:16.547402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:04.229911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.545164+0000","last_change":"2024-09-17T02:20:12.513530+0000","last_active":"2024-09-17T02:20:16.545164+0000","last_peered":"2024-09-17T02:20:16.545164+0000","last_clean":"2024-09-17T02:20:16.545164+0000","last_became_active":"2024-09-17T02:20:10.502692+0000","last_became_peered":"2024-09-17T02:20:10.502692+0000","last_unstale":"2024-09-17T02:20:16.545164+0000","last_undegraded":"2024-09-17T02:20:16.545164+0000","last_fullsized":"2024-09-17T02:20:16.545164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:53.004641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015329009999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285205+0000","last_change":"2024-09-17T02:20:16.575882+0000","last_active":"2024-09-17T02:20:18.285205+0000","last_peered":"2024-09-17T02:20:18.285205+0000","last_clean":"2024-09-17T02:20:18.285205+0000","last_became_active":"2024-09-17T02:20:16.573968+0000","last_became_peered":"2024-09-17T02:20:16.573968+0000","last_unstale":"2024-09-17T02:20:18.285205+0000","last_undegraded":"2024-09-17T02:20:18.285205+0000","last_fullsized":"2024-09-17T02:20:18.285205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:18.090082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.586228+0000","last_change":"2024-09-17T02:20:16.582881+0000","last_active":"2024-09-17T02:20:16.586228+0000","last_peered":"2024-09-17T02:20:16.586228+0000","last_clean":"2024-09-17T02:20:16.586228+0000","last_became_active":"2024-09-17T02:20:16.580985+0000","last_became_peered":"2024-09-17T02:20:16.580985+0000","last_unstale":"2024-09-17T02:20:16.586228+0000","last_undegraded":"2024-09-17T02:20:16.586228+0000","last_fullsized":"2024-09-17T02:20:16.586228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:07.190169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.592784+0000","last_change":"2024-09-17T02:20:15.558925+0000","last_active":"2024-09-17T02:20:16.592784+0000","last_peered":"2024-09-17T02:20:16.592784+0000","last_clean":"2024-09-17T02:20:16.592784+0000","last_became_active":"2024-09-17T02:20:15.558174+0000","last_became_peered":"2024-09-17T02:20:15.558174+0000","last_unstale":"2024-09-17T02:20:16.592784+0000","last_undegraded":"2024-09-17T02:20:16.592784+0000","last_fullsized":"2024-09-17T02:20:16.592784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:55.639841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.585140+0000","last_change":"2024-09-17T02:20:16.579411+0000","last_active":"2024-09-17T02:20:16.585140+0000","last_peered":"2024-09-17T02:20:16.585140+0000","last_clean":"2024-09-17T02:20:16.585140+0000","last_became_active":"2024-09-17T02:20:16.576294+0000","last_became_peered":"2024-09-17T02:20:16.576294+0000","last_unstale":"2024-09-17T02:20:16.585140+0000","last_undegraded":"2024-09-17T02:20:16.585140+0000","last_fullsized":"2024-09-17T02:20:16.585140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:52:42.871134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287526+0000","last_change":"2024-09-17T02:20:15.569117+0000","last_active":"2024-09-17T02:20:18.287526+0000","last_peered":"2024-09-17T02:20:18.287526+0000","last_clean":"2024-09-17T02:20:18.287526+0000","last_became_active":"2024-09-17T02:20:15.567405+0000","last_became_peered":"2024-09-17T02:20:15.567405+0000","last_unstale":"2024-09-17T02:20:18.287526+0000","last_undegraded":"2024-09-17T02:20:18.287526+0000","last_fullsized":"2024-09-17T02:20:18.287526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:55:10.186481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.545050+0000","last_change":"2024-09-17T02:20:15.562827+0000","last_active":"2024-09-17T02:20:16.545050+0000","last_peered":"2024-09-17T02:20:16.545050+0000","last_clean":"2024-09-17T02:20:16.545050+0000","last_became_active":"2024-09-17T02:20:15.562073+0000","last_became_peered":"2024-09-17T02:20:15.562073+0000","last_unstale":"2024-09-17T02:20:16.545050+0000","last_undegraded":"2024-09-17T02:20:16.545050+0000","last_fullsized":"2024-09-17T02:20:16.545050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:17.866665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.584189+0000","last_change":"2024-09-17T02:20:16.577670+0000","last_active":"2024-09-17T02:20:16.584189+0000","last_peered":"2024-09-17T02:20:16.584189+0000","last_clean":"2024-09-17T02:20:16.584189+0000","last_became_active":"2024-09-17T02:20:16.575082+0000","last_became_peered":"2024-09-17T02:20:16.575082+0000","last_unstale":"2024-09-17T02:20:16.584189+0000","last_undegraded":"2024-09-17T02:20:16.584189+0000","last_fullsized":"2024-09-17T02:20:16.584189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:05.558789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.547931+0000","last_change":"2024-09-17T02:20:15.555513+0000","last_active":"2024-09-17T02:20:16.547931+0000","last_peered":"2024-09-17T02:20:16.547931+0000","last_clean":"2024-09-17T02:20:16.547931+0000","last_became_active":"2024-09-17T02:20:15.554256+0000","last_became_peered":"2024-09-17T02:20:15.554256+0000","last_unstale":"2024-09-17T02:20:16.547931+0000","last_undegraded":"2024-09-17T02:20:16.547931+0000","last_fullsized":"2024-09-17T02:20:16.547931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:52.985837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.584231+0000","last_change":"2024-09-17T02:20:16.577803+0000","last_active":"2024-09-17T02:20:16.584231+0000","last_peered":"2024-09-17T02:20:16.584231+0000","last_clean":"2024-09-17T02:20:16.584231+0000","last_became_active":"2024-09-17T02:20:16.576640+0000","last_became_peered":"2024-09-17T02:20:16.576640+0000","last_unstale":"2024-09-17T02:20:16.584231+0000","last_undegraded":"2024-09-17T02:20:16.584231+0000","last_fullsized":"2024-09-17T02:20:16.584231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:42.531174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.288014+0000","last_change":"2024-09-17T02:20:16.571738+0000","last_active":"2024-09-17T02:20:18.288014+0000","last_peered":"2024-09-17T02:20:18.288014+0000","last_clean":"2024-09-17T02:20:18.288014+0000","last_became_active":"2024-09-17T02:20:16.568615+0000","last_became_peered":"2024-09-17T02:20:16.568615+0000","last_unstale":"2024-09-17T02:20:18.288014+0000","last_undegraded":"2024-09-17T02:20:18.288014+0000","last_fullsized":"2024-09-17T02:20:18.288014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:42.931361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.543862+0000","last_change":"2024-09-17T02:20:15.558467+0000","last_active":"2024-09-17T02:20:16.543862+0000","last_peered":"2024-09-17T02:20:16.543862+0000","last_clean":"2024-09-17T02:20:16.543862+0000","last_became_active":"2024-09-17T02:20:15.557186+0000","last_became_peered":"2024-09-17T02:20:15.557186+0000","last_unstale":"2024-09-17T02:20:16.543862+0000","last_undegraded":"2024-09-17T02:20:16.543862+0000","last_fullsized":"2024-09-17T02:20:16.543862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:56.879445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.584139+0000","last_change":"2024-09-17T02:20:16.577527+0000","last_active":"2024-09-17T02:20:16.584139+0000","last_peered":"2024-09-17T02:20:16.584139+0000","last_clean":"2024-09-17T02:20:16.584139+0000","last_became_active":"2024-09-17T02:20:16.574761+0000","last_became_peered":"2024-09-17T02:20:16.574761+0000","last_unstale":"2024-09-17T02:20:16.584139+0000","last_undegraded":"2024-09-17T02:20:16.584139+0000","last_fullsized":"2024-09-17T02:20:16.584139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:01.826966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.545165+0000","last_change":"2024-09-17T02:20:15.552417+0000","last_active":"2024-09-17T02:20:16.545165+0000","last_peered":"2024-09-17T02:20:16.545165+0000","last_clean":"2024-09-17T02:20:16.545165+0000","last_became_active":"2024-09-17T02:20:15.551609+0000","last_became_peered":"2024-09-17T02:20:15.551609+0000","last_unstale":"2024-09-17T02:20:16.545165+0000","last_undegraded":"2024-09-17T02:20:16.545165+0000","last_fullsized":"2024-09-17T02:20:16.545165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:15.782658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286869+0000","last_change":"2024-09-17T02:20:16.591978+0000","last_active":"2024-09-17T02:20:18.286869+0000","last_peered":"2024-09-17T02:20:18.286869+0000","last_clean":"2024-09-17T02:20:18.286869+0000","last_became_active":"2024-09-17T02:20:16.591378+0000","last_became_peered":"2024-09-17T02:20:16.591378+0000","last_unstale":"2024-09-17T02:20:18.286869+0000","last_undegraded":"2024-09-17T02:20:18.286869+0000","last_fullsized":"2024-09-17T02:20:18.286869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:44.489118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286792+0000","last_change":"2024-09-17T02:20:15.565262+0000","last_active":"2024-09-17T02:20:18.286792+0000","last_peered":"2024-09-17T02:20:18.286792+0000","last_clean":"2024-09-17T02:20:18.286792+0000","last_became_active":"2024-09-17T02:20:15.564415+0000","last_became_peered":"2024-09-17T02:20:15.564415+0000","last_unstale":"2024-09-17T02:20:18.286792+0000","last_undegraded":"2024-09-17T02:20:18.286792+0000","last_fullsized":"2024-09-17T02:20:18.286792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:42.049312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286398+0000","last_change":"2024-09-17T02:20:16.573407+0000","last_active":"2024-09-17T02:20:18.286398+0000","last_peered":"2024-09-17T02:20:18.286398+0000","last_clean":"2024-09-17T02:20:18.286398+0000","last_became_active":"2024-09-17T02:20:16.570987+0000","last_became_peered":"2024-09-17T02:20:16.570987+0000","last_unstale":"2024-09-17T02:20:18.286398+0000","last_undegraded":"2024-09-17T02:20:18.286398+0000","last_fullsized":"2024-09-17T02:20:18.286398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:23:09.424550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286401+0000","last_change":"2024-09-17T02:20:15.568883+0000","last_active":"2024-09-17T02:20:18.286401+0000","last_peered":"2024-09-17T02:20:18.286401+0000","last_clean":"2024-09-17T02:20:18.286401+0000","last_became_active":"2024-09-17T02:20:15.567980+0000","last_became_peered":"2024-09-17T02:20:15.567980+0000","last_unstale":"2024-09-17T02:20:18.286401+0000","last_undegraded":"2024-09-17T02:20:18.286401+0000","last_fullsized":"2024-09-17T02:20:18.286401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:04.059900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.572983+0000","last_change":"2024-09-17T02:20:16.568209+0000","last_active":"2024-09-17T02:20:16.572983+0000","last_peered":"2024-09-17T02:20:16.572983+0000","last_clean":"2024-09-17T02:20:16.572983+0000","last_became_active":"2024-09-17T02:20:16.566585+0000","last_became_peered":"2024-09-17T02:20:16.566585+0000","last_unstale":"2024-09-17T02:20:16.572983+0000","last_undegraded":"2024-09-17T02:20:16.572983+0000","last_fullsized":"2024-09-17T02:20:16.572983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:52:42.871134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.587955+0000","last_change":"2024-09-17T02:20:15.558296+0000","last_active":"2024-09-17T02:20:16.587955+0000","last_peered":"2024-09-17T02:20:16.587955+0000","last_clean":"2024-09-17T02:20:16.587955+0000","last_became_active":"2024-09-17T02:20:15.557520+0000","last_became_peered":"2024-09-17T02:20:15.557520+0000","last_unstale":"2024-09-17T02:20:16.587955+0000","last_undegraded":"2024-09-17T02:20:16.587955+0000","last_fullsized":"2024-09-17T02:20:16.587955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:04.229911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.573531+0000","last_change":"2024-09-17T02:20:16.568334+0000","last_active":"2024-09-17T02:20:16.573531+0000","last_peered":"2024-09-17T02:20:16.573531+0000","last_clean":"2024-09-17T02:20:16.573531+0000","last_became_active":"2024-09-17T02:20:16.566982+0000","last_became_peered":"2024-09-17T02:20:16.566982+0000","last_unstale":"2024-09-17T02:20:16.573531+0000","last_undegraded":"2024-09-17T02:20:16.573531+0000","last_fullsized":"2024-09-17T02:20:16.573531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:31.214767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287197+0000","last_change":"2024-09-17T02:20:15.569712+0000","last_active":"2024-09-17T02:20:18.287197+0000","last_peered":"2024-09-17T02:20:18.287197+0000","last_clean":"2024-09-17T02:20:18.287197+0000","last_became_active":"2024-09-17T02:20:15.569106+0000","last_became_peered":"2024-09-17T02:20:15.569106+0000","last_unstale":"2024-09-17T02:20:18.287197+0000","last_undegraded":"2024-09-17T02:20:18.287197+0000","last_fullsized":"2024-09-17T02:20:18.287197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:02.822970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286608+0000","last_change":"2024-09-17T02:20:16.570456+0000","last_active":"2024-09-17T02:20:18.286608+0000","last_peered":"2024-09-17T02:20:18.286608+0000","last_clean":"2024-09-17T02:20:18.286608+0000","last_became_active":"2024-09-17T02:20:16.568095+0000","last_became_peered":"2024-09-17T02:20:16.568095+0000","last_unstale":"2024-09-17T02:20:18.286608+0000","last_undegraded":"2024-09-17T02:20:18.286608+0000","last_fullsized":"2024-09-17T02:20:18.286608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:58.329169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.581628+0000","last_change":"2024-09-17T02:20:15.560293+0000","last_active":"2024-09-17T02:20:16.581628+0000","last_peered":"2024-09-17T02:20:16.581628+0000","last_clean":"2024-09-17T02:20:16.581628+0000","last_became_active":"2024-09-17T02:20:15.559074+0000","last_became_peered":"2024-09-17T02:20:15.559074+0000","last_unstale":"2024-09-17T02:20:16.581628+0000","last_undegraded":"2024-09-17T02:20:16.581628+0000","last_fullsized":"2024-09-17T02:20:16.581628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:55.639841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.573725+0000","last_change":"2024-09-17T02:20:16.570950+0000","last_active":"2024-09-17T02:20:16.573725+0000","last_peered":"2024-09-17T02:20:16.573725+0000","last_clean":"2024-09-17T02:20:16.573725+0000","last_became_active":"2024-09-17T02:20:16.569496+0000","last_became_peered":"2024-09-17T02:20:16.569496+0000","last_unstale":"2024-09-17T02:20:16.573725+0000","last_undegraded":"2024-09-17T02:20:16.573725+0000","last_fullsized":"2024-09-17T02:20:16.573725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:38.051514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:20:16.584491+0000","last_change":"2024-09-17T02:20:15.544675+0000","last_active":"2024-09-17T02:20:16.584491+0000","last_peered":"2024-09-17T02:20:16.584491+0000","last_clean":"2024-09-17T02:20:16.584491+0000","last_became_active":"2024-09-17T02:20:15.544213+0000","last_became_peered":"2024-09-17T02:20:15.544213+0000","last_unstale":"2024-09-17T02:20:16.584491+0000","last_undegraded":"2024-09-17T02:20:16.584491+0000","last_fullsized":"2024-09-17T02:20:16.584491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:31.933850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35588,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336252,"statfs":{"total":96636764160,"available":96600322048,"internally_reserved":0,"allocated":245760,"data_stored":649455,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":258048,"data_stored":650090,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":176128,"data_stored":57928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,0,0,4,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T02:20:20.936 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T02:20:20.936 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T02:20:20.936 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-17T02:20:20.937 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-17T02:20:20.937 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-17T02:20:21.310 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:20:21.326 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":3896122254},{"type":"v1","addr":"172.21.15.1:6801","nonce":3896122254}]},"active_addr":"172.21.15.1:6801/3896122254","active_change":"2024-09-17T02:19:57.330598+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4099,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":809865730}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":201892753}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":4191427341}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":3511832202}]}]} 2024-09-17T02:20:21.332 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-17T02:20:21.332 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T02:20:21.332 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:20:21.623 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:20:21.623 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":20,"fsid":"37cd4495-4915-41f4-bad2-2394cbe235f3","created":"2024-09-17T02:19:52.516342+0000","modified":"2024-09-17T02:20:17.546817+0000","last_up_change":"2024-09-17T02:20:02.422255+0000","last_in_change":"2024-09-17T02:19:54.329423+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:20:03.416336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T02:20:08.718296+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:20:13.566396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-17T02:20:14.902662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fae746a8-754d-4e52-9819-004ebb0d6886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6801","nonce":2347677104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6803","nonce":2347677104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6807","nonce":2347677104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6805","nonce":2347677104}]},"public_addr":"172.21.15.32:6801/2347677104","cluster_addr":"172.21.15.32:6803/2347677104","heartbeat_back_addr":"172.21.15.32:6807/2347677104","heartbeat_front_addr":"172.21.15.32:6805/2347677104","state":["exists","up"]},{"osd":1,"uuid":"c9397688-80ca-4c21-b80d-1740194c389d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6801","nonce":1905904204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6803","nonce":1905904204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6807","nonce":1905904204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6805","nonce":1905904204}]},"public_addr":"172.21.15.153:6801/1905904204","cluster_addr":"172.21.15.153:6803/1905904204","heartbeat_back_addr":"172.21.15.153:6807/1905904204","heartbeat_front_addr":"172.21.15.153:6805/1905904204","state":["exists","up"]},{"osd":2,"uuid":"6d8c01a8-b657-4abc-a624-2b35ef0512ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6801","nonce":603659517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6803","nonce":603659517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6807","nonce":603659517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6805","nonce":603659517}]},"public_addr":"172.21.15.164:6801/603659517","cluster_addr":"172.21.15.164:6803/603659517","heartbeat_back_addr":"172.21.15.164:6807/603659517","heartbeat_front_addr":"172.21.15.164:6805/603659517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.476482+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.250903+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.326430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:20:21.640 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T02:20:21.641 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:20:21.937 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:20:21.937 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":20,"fsid":"37cd4495-4915-41f4-bad2-2394cbe235f3","created":"2024-09-17T02:19:52.516342+0000","modified":"2024-09-17T02:20:17.546817+0000","last_up_change":"2024-09-17T02:20:02.422255+0000","last_in_change":"2024-09-17T02:19:54.329423+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:20:03.416336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T02:20:08.718296+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:20:13.566396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-17T02:20:14.902662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fae746a8-754d-4e52-9819-004ebb0d6886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6801","nonce":2347677104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6803","nonce":2347677104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6807","nonce":2347677104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6805","nonce":2347677104}]},"public_addr":"172.21.15.32:6801/2347677104","cluster_addr":"172.21.15.32:6803/2347677104","heartbeat_back_addr":"172.21.15.32:6807/2347677104","heartbeat_front_addr":"172.21.15.32:6805/2347677104","state":["exists","up"]},{"osd":1,"uuid":"c9397688-80ca-4c21-b80d-1740194c389d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6801","nonce":1905904204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6803","nonce":1905904204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6807","nonce":1905904204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6805","nonce":1905904204}]},"public_addr":"172.21.15.153:6801/1905904204","cluster_addr":"172.21.15.153:6803/1905904204","heartbeat_back_addr":"172.21.15.153:6807/1905904204","heartbeat_front_addr":"172.21.15.153:6805/1905904204","state":["exists","up"]},{"osd":2,"uuid":"6d8c01a8-b657-4abc-a624-2b35ef0512ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6801","nonce":603659517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6803","nonce":603659517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6807","nonce":603659517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6805","nonce":603659517}]},"public_addr":"172.21.15.164:6801/603659517","cluster_addr":"172.21.15.164:6803/603659517","heartbeat_back_addr":"172.21.15.164:6807/603659517","heartbeat_front_addr":"172.21.15.164:6805/603659517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.476482+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.250903+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.326430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:20:21.956 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T02:20:21.957 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T02:20:21.957 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T02:20:22.127 INFO:teuthology.orchestra.run.smithi001.stdout:38654705671 2024-09-17T02:20:22.128 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T02:20:22.129 INFO:teuthology.orchestra.run.smithi001.stdout:34359738375 2024-09-17T02:20:22.129 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T02:20:22.135 INFO:teuthology.orchestra.run.smithi001.stdout:34359738374 2024-09-17T02:20:22.136 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T02:20:22.416 INFO:teuthology.orchestra.run.smithi001.stdout:38654705670 2024-09-17T02:20:22.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705670 for osd.0 2024-09-17T02:20:22.456 INFO:teuthology.orchestra.run.smithi001.stdout:34359738373 2024-09-17T02:20:22.463 INFO:teuthology.orchestra.run.smithi001.stdout:34359738374 2024-09-17T02:20:22.474 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.1 2024-09-17T02:20:22.481 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.2 2024-09-17T02:20:23.436 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T02:20:23.475 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T02:20:23.482 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T02:20:23.754 INFO:teuthology.orchestra.run.smithi001.stdout:38654705671 2024-09-17T02:20:23.771 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.0 2024-09-17T02:20:23.771 DEBUG:teuthology.parallel:result is None 2024-09-17T02:20:23.781 INFO:teuthology.orchestra.run.smithi001.stdout:34359738376 2024-09-17T02:20:23.788 INFO:teuthology.orchestra.run.smithi001.stdout:34359738375 2024-09-17T02:20:23.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738376 for osd.2 2024-09-17T02:20:23.804 DEBUG:teuthology.parallel:result is None 2024-09-17T02:20:23.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738375 for osd.1 2024-09-17T02:20:23.809 DEBUG:teuthology.parallel:result is None 2024-09-17T02:20:23.810 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T02:20:23.810 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:20:24.143 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:20:24.145 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-17T02:20:24.159 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-09-17T02:20:23.345360+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94268,"kb_used_data":688,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283021252,"statfs":{"total":289910292480,"available":289813762048,"internally_reserved":0,"allocated":704512,"data_stored":1371366,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2421,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.806890"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287583+0000","last_change":"2024-09-17T02:20:16.577643+0000","last_active":"2024-09-17T02:20:18.287583+0000","last_peered":"2024-09-17T02:20:18.287583+0000","last_clean":"2024-09-17T02:20:18.287583+0000","last_became_active":"2024-09-17T02:20:16.576566+0000","last_became_peered":"2024-09-17T02:20:16.576566+0000","last_unstale":"2024-09-17T02:20:18.287583+0000","last_undegraded":"2024-09-17T02:20:18.287583+0000","last_fullsized":"2024-09-17T02:20:18.287583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:34.971816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286435+0000","last_change":"2024-09-17T02:20:16.574137+0000","last_active":"2024-09-17T02:20:18.286435+0000","last_peered":"2024-09-17T02:20:18.286435+0000","last_clean":"2024-09-17T02:20:18.286435+0000","last_became_active":"2024-09-17T02:20:16.571755+0000","last_became_peered":"2024-09-17T02:20:16.571755+0000","last_unstale":"2024-09-17T02:20:18.286435+0000","last_undegraded":"2024-09-17T02:20:18.286435+0000","last_fullsized":"2024-09-17T02:20:18.286435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:56.146270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561529+0000","last_change":"2024-09-17T02:20:16.582493+0000","last_active":"2024-09-17T02:20:17.561529+0000","last_peered":"2024-09-17T02:20:17.561529+0000","last_clean":"2024-09-17T02:20:17.561529+0000","last_became_active":"2024-09-17T02:20:16.581463+0000","last_became_peered":"2024-09-17T02:20:16.581463+0000","last_unstale":"2024-09-17T02:20:17.561529+0000","last_undegraded":"2024-09-17T02:20:17.561529+0000","last_fullsized":"2024-09-17T02:20:17.561529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:12.134652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561118+0000","last_change":"2024-09-17T02:20:16.568747+0000","last_active":"2024-09-17T02:20:17.561118+0000","last_peered":"2024-09-17T02:20:17.561118+0000","last_clean":"2024-09-17T02:20:17.561118+0000","last_became_active":"2024-09-17T02:20:16.566795+0000","last_became_peered":"2024-09-17T02:20:16.566795+0000","last_unstale":"2024-09-17T02:20:17.561118+0000","last_undegraded":"2024-09-17T02:20:17.561118+0000","last_fullsized":"2024-09-17T02:20:17.561118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:51.799644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286208+0000","last_change":"2024-09-17T02:20:16.568625+0000","last_active":"2024-09-17T02:20:18.286208+0000","last_peered":"2024-09-17T02:20:18.286208+0000","last_clean":"2024-09-17T02:20:18.286208+0000","last_became_active":"2024-09-17T02:20:16.567707+0000","last_became_peered":"2024-09-17T02:20:16.567707+0000","last_unstale":"2024-09-17T02:20:18.286208+0000","last_undegraded":"2024-09-17T02:20:18.286208+0000","last_fullsized":"2024-09-17T02:20:18.286208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:44.452839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559506+0000","last_change":"2024-09-17T02:20:16.568765+0000","last_active":"2024-09-17T02:20:17.559506+0000","last_peered":"2024-09-17T02:20:17.559506+0000","last_clean":"2024-09-17T02:20:17.559506+0000","last_became_active":"2024-09-17T02:20:16.564108+0000","last_became_peered":"2024-09-17T02:20:16.564108+0000","last_unstale":"2024-09-17T02:20:17.559506+0000","last_undegraded":"2024-09-17T02:20:17.559506+0000","last_fullsized":"2024-09-17T02:20:17.559506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:26.782410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559579+0000","last_change":"2024-09-17T02:20:16.563357+0000","last_active":"2024-09-17T02:20:17.559579+0000","last_peered":"2024-09-17T02:20:17.559579+0000","last_clean":"2024-09-17T02:20:17.559579+0000","last_became_active":"2024-09-17T02:20:16.562276+0000","last_became_peered":"2024-09-17T02:20:16.562276+0000","last_unstale":"2024-09-17T02:20:17.559579+0000","last_undegraded":"2024-09-17T02:20:17.559579+0000","last_fullsized":"2024-09-17T02:20:17.559579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:47.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559460+0000","last_change":"2024-09-17T02:20:16.568482+0000","last_active":"2024-09-17T02:20:17.559460+0000","last_peered":"2024-09-17T02:20:17.559460+0000","last_clean":"2024-09-17T02:20:17.559460+0000","last_became_active":"2024-09-17T02:20:16.565416+0000","last_became_peered":"2024-09-17T02:20:16.565416+0000","last_unstale":"2024-09-17T02:20:17.559460+0000","last_undegraded":"2024-09-17T02:20:17.559460+0000","last_fullsized":"2024-09-17T02:20:17.559460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:13.574859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559952+0000","last_change":"2024-09-17T02:20:16.584665+0000","last_active":"2024-09-17T02:20:17.559952+0000","last_peered":"2024-09-17T02:20:17.559952+0000","last_clean":"2024-09-17T02:20:17.559952+0000","last_became_active":"2024-09-17T02:20:16.580797+0000","last_became_peered":"2024-09-17T02:20:16.580797+0000","last_unstale":"2024-09-17T02:20:17.559952+0000","last_undegraded":"2024-09-17T02:20:17.559952+0000","last_fullsized":"2024-09-17T02:20:17.559952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:47.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287106+0000","last_change":"2024-09-17T02:20:16.577666+0000","last_active":"2024-09-17T02:20:18.287106+0000","last_peered":"2024-09-17T02:20:18.287106+0000","last_clean":"2024-09-17T02:20:18.287106+0000","last_became_active":"2024-09-17T02:20:16.574914+0000","last_became_peered":"2024-09-17T02:20:16.574914+0000","last_unstale":"2024-09-17T02:20:18.287106+0000","last_undegraded":"2024-09-17T02:20:18.287106+0000","last_fullsized":"2024-09-17T02:20:18.287106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:48.730100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561136+0000","last_change":"2024-09-17T02:20:16.565609+0000","last_active":"2024-09-17T02:20:17.561136+0000","last_peered":"2024-09-17T02:20:17.561136+0000","last_clean":"2024-09-17T02:20:17.561136+0000","last_became_active":"2024-09-17T02:20:16.564092+0000","last_became_peered":"2024-09-17T02:20:16.564092+0000","last_unstale":"2024-09-17T02:20:17.561136+0000","last_undegraded":"2024-09-17T02:20:17.561136+0000","last_fullsized":"2024-09-17T02:20:17.561136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:40.921595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286686+0000","last_change":"2024-09-17T02:20:16.584447+0000","last_active":"2024-09-17T02:20:18.286686+0000","last_peered":"2024-09-17T02:20:18.286686+0000","last_clean":"2024-09-17T02:20:18.286686+0000","last_became_active":"2024-09-17T02:20:16.580416+0000","last_became_peered":"2024-09-17T02:20:16.580416+0000","last_unstale":"2024-09-17T02:20:18.286686+0000","last_undegraded":"2024-09-17T02:20:18.286686+0000","last_fullsized":"2024-09-17T02:20:18.286686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:19.742400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285729+0000","last_change":"2024-09-17T02:20:16.573447+0000","last_active":"2024-09-17T02:20:18.285729+0000","last_peered":"2024-09-17T02:20:18.285729+0000","last_clean":"2024-09-17T02:20:18.285729+0000","last_became_active":"2024-09-17T02:20:16.571757+0000","last_became_peered":"2024-09-17T02:20:16.571757+0000","last_unstale":"2024-09-17T02:20:18.285729+0000","last_undegraded":"2024-09-17T02:20:18.285729+0000","last_fullsized":"2024-09-17T02:20:18.285729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:12.584579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560276+0000","last_change":"2024-09-17T02:20:16.563197+0000","last_active":"2024-09-17T02:20:17.560276+0000","last_peered":"2024-09-17T02:20:17.560276+0000","last_clean":"2024-09-17T02:20:17.560276+0000","last_became_active":"2024-09-17T02:20:16.561221+0000","last_became_peered":"2024-09-17T02:20:16.561221+0000","last_unstale":"2024-09-17T02:20:17.560276+0000","last_undegraded":"2024-09-17T02:20:17.560276+0000","last_fullsized":"2024-09-17T02:20:17.560276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:43.309196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559960+0000","last_change":"2024-09-17T02:20:16.581305+0000","last_active":"2024-09-17T02:20:17.559960+0000","last_peered":"2024-09-17T02:20:17.559960+0000","last_clean":"2024-09-17T02:20:17.559960+0000","last_became_active":"2024-09-17T02:20:16.580377+0000","last_became_peered":"2024-09-17T02:20:16.580377+0000","last_unstale":"2024-09-17T02:20:17.559960+0000","last_undegraded":"2024-09-17T02:20:17.559960+0000","last_fullsized":"2024-09-17T02:20:17.559960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:43.454908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559106+0000","last_change":"2024-09-17T02:20:16.562686+0000","last_active":"2024-09-17T02:20:17.559106+0000","last_peered":"2024-09-17T02:20:17.559106+0000","last_clean":"2024-09-17T02:20:17.559106+0000","last_became_active":"2024-09-17T02:20:16.561446+0000","last_became_peered":"2024-09-17T02:20:16.561446+0000","last_unstale":"2024-09-17T02:20:17.559106+0000","last_undegraded":"2024-09-17T02:20:17.559106+0000","last_fullsized":"2024-09-17T02:20:17.559106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:22.801598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560996+0000","last_change":"2024-09-17T02:20:16.563482+0000","last_active":"2024-09-17T02:20:17.560996+0000","last_peered":"2024-09-17T02:20:17.560996+0000","last_clean":"2024-09-17T02:20:17.560996+0000","last_became_active":"2024-09-17T02:20:16.562735+0000","last_became_peered":"2024-09-17T02:20:16.562735+0000","last_unstale":"2024-09-17T02:20:17.560996+0000","last_undegraded":"2024-09-17T02:20:17.560996+0000","last_fullsized":"2024-09-17T02:20:17.560996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:10.315951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287548+0000","last_change":"2024-09-17T02:20:16.568659+0000","last_active":"2024-09-17T02:20:18.287548+0000","last_peered":"2024-09-17T02:20:18.287548+0000","last_clean":"2024-09-17T02:20:18.287548+0000","last_became_active":"2024-09-17T02:20:16.565734+0000","last_became_peered":"2024-09-17T02:20:16.565734+0000","last_unstale":"2024-09-17T02:20:18.287548+0000","last_undegraded":"2024-09-17T02:20:18.287548+0000","last_fullsized":"2024-09-17T02:20:18.287548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:05.723619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559666+0000","last_change":"2024-09-17T02:20:16.586950+0000","last_active":"2024-09-17T02:20:17.559666+0000","last_peered":"2024-09-17T02:20:17.559666+0000","last_clean":"2024-09-17T02:20:17.559666+0000","last_became_active":"2024-09-17T02:20:16.586281+0000","last_became_peered":"2024-09-17T02:20:16.586281+0000","last_unstale":"2024-09-17T02:20:17.559666+0000","last_undegraded":"2024-09-17T02:20:17.559666+0000","last_fullsized":"2024-09-17T02:20:17.559666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:22.801598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561561+0000","last_change":"2024-09-17T02:20:16.570514+0000","last_active":"2024-09-17T02:20:17.561561+0000","last_peered":"2024-09-17T02:20:17.561561+0000","last_clean":"2024-09-17T02:20:17.561561+0000","last_became_active":"2024-09-17T02:20:16.567156+0000","last_became_peered":"2024-09-17T02:20:16.567156+0000","last_unstale":"2024-09-17T02:20:17.561561+0000","last_undegraded":"2024-09-17T02:20:17.561561+0000","last_fullsized":"2024-09-17T02:20:17.561561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:51.596077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561439+0000","last_change":"2024-09-17T02:20:16.571275+0000","last_active":"2024-09-17T02:20:17.561439+0000","last_peered":"2024-09-17T02:20:17.561439+0000","last_clean":"2024-09-17T02:20:17.561439+0000","last_became_active":"2024-09-17T02:20:16.569751+0000","last_became_peered":"2024-09-17T02:20:16.569751+0000","last_unstale":"2024-09-17T02:20:17.561439+0000","last_undegraded":"2024-09-17T02:20:17.561439+0000","last_fullsized":"2024-09-17T02:20:17.561439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:41.362905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285399+0000","last_change":"2024-09-17T02:20:16.567109+0000","last_active":"2024-09-17T02:20:18.285399+0000","last_peered":"2024-09-17T02:20:18.285399+0000","last_clean":"2024-09-17T02:20:18.285399+0000","last_became_active":"2024-09-17T02:20:16.564753+0000","last_became_peered":"2024-09-17T02:20:16.564753+0000","last_unstale":"2024-09-17T02:20:18.285399+0000","last_undegraded":"2024-09-17T02:20:18.285399+0000","last_fullsized":"2024-09-17T02:20:18.285399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:01.888476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.557727+0000","last_change":"2024-09-17T02:20:16.558778+0000","last_active":"2024-09-17T02:20:17.557727+0000","last_peered":"2024-09-17T02:20:17.557727+0000","last_clean":"2024-09-17T02:20:17.557727+0000","last_became_active":"2024-09-17T02:20:16.557967+0000","last_became_peered":"2024-09-17T02:20:16.557967+0000","last_unstale":"2024-09-17T02:20:17.557727+0000","last_undegraded":"2024-09-17T02:20:17.557727+0000","last_fullsized":"2024-09-17T02:20:17.557727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:40.577627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285052+0000","last_change":"2024-09-17T02:20:16.564194+0000","last_active":"2024-09-17T02:20:18.285052+0000","last_peered":"2024-09-17T02:20:18.285052+0000","last_clean":"2024-09-17T02:20:18.285052+0000","last_became_active":"2024-09-17T02:20:16.562564+0000","last_became_peered":"2024-09-17T02:20:16.562564+0000","last_unstale":"2024-09-17T02:20:18.285052+0000","last_undegraded":"2024-09-17T02:20:18.285052+0000","last_fullsized":"2024-09-17T02:20:18.285052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:10.932999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287608+0000","last_change":"2024-09-17T02:20:16.573189+0000","last_active":"2024-09-17T02:20:18.287608+0000","last_peered":"2024-09-17T02:20:18.287608+0000","last_clean":"2024-09-17T02:20:18.287608+0000","last_became_active":"2024-09-17T02:20:16.570669+0000","last_became_peered":"2024-09-17T02:20:16.570669+0000","last_unstale":"2024-09-17T02:20:18.287608+0000","last_undegraded":"2024-09-17T02:20:18.287608+0000","last_fullsized":"2024-09-17T02:20:18.287608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:52.753219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560314+0000","last_change":"2024-09-17T02:20:16.581076+0000","last_active":"2024-09-17T02:20:17.560314+0000","last_peered":"2024-09-17T02:20:17.560314+0000","last_clean":"2024-09-17T02:20:17.560314+0000","last_became_active":"2024-09-17T02:20:16.579989+0000","last_became_peered":"2024-09-17T02:20:16.579989+0000","last_unstale":"2024-09-17T02:20:17.560314+0000","last_undegraded":"2024-09-17T02:20:17.560314+0000","last_fullsized":"2024-09-17T02:20:17.560314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:43.454908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561562+0000","last_change":"2024-09-17T02:20:16.582808+0000","last_active":"2024-09-17T02:20:17.561562+0000","last_peered":"2024-09-17T02:20:17.561562+0000","last_clean":"2024-09-17T02:20:17.561562+0000","last_became_active":"2024-09-17T02:20:16.581358+0000","last_became_peered":"2024-09-17T02:20:16.581358+0000","last_unstale":"2024-09-17T02:20:17.561562+0000","last_undegraded":"2024-09-17T02:20:17.561562+0000","last_fullsized":"2024-09-17T02:20:17.561562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:26.441162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287997+0000","last_change":"2024-09-17T02:20:16.583361+0000","last_active":"2024-09-17T02:20:18.287997+0000","last_peered":"2024-09-17T02:20:18.287997+0000","last_clean":"2024-09-17T02:20:18.287997+0000","last_became_active":"2024-09-17T02:20:16.579817+0000","last_became_peered":"2024-09-17T02:20:16.579817+0000","last_unstale":"2024-09-17T02:20:18.287997+0000","last_undegraded":"2024-09-17T02:20:18.287997+0000","last_fullsized":"2024-09-17T02:20:18.287997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:54.029860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559128+0000","last_change":"2024-09-17T02:20:16.581125+0000","last_active":"2024-09-17T02:20:17.559128+0000","last_peered":"2024-09-17T02:20:17.559128+0000","last_clean":"2024-09-17T02:20:17.559128+0000","last_became_active":"2024-09-17T02:20:16.580393+0000","last_became_peered":"2024-09-17T02:20:16.580393+0000","last_unstale":"2024-09-17T02:20:17.559128+0000","last_undegraded":"2024-09-17T02:20:17.559128+0000","last_fullsized":"2024-09-17T02:20:17.559128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:24.706394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286569+0000","last_change":"2024-09-17T02:20:16.565220+0000","last_active":"2024-09-17T02:20:18.286569+0000","last_peered":"2024-09-17T02:20:18.286569+0000","last_clean":"2024-09-17T02:20:18.286569+0000","last_became_active":"2024-09-17T02:20:16.562419+0000","last_became_peered":"2024-09-17T02:20:16.562419+0000","last_unstale":"2024-09-17T02:20:18.286569+0000","last_undegraded":"2024-09-17T02:20:18.286569+0000","last_fullsized":"2024-09-17T02:20:18.286569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:03.961277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.557946+0000","last_change":"2024-09-17T02:20:16.579408+0000","last_active":"2024-09-17T02:20:17.557946+0000","last_peered":"2024-09-17T02:20:17.557946+0000","last_clean":"2024-09-17T02:20:17.557946+0000","last_became_active":"2024-09-17T02:20:16.577202+0000","last_became_peered":"2024-09-17T02:20:16.577202+0000","last_unstale":"2024-09-17T02:20:17.557946+0000","last_undegraded":"2024-09-17T02:20:17.557946+0000","last_fullsized":"2024-09-17T02:20:17.557946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:20.414231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559533+0000","last_change":"2024-09-17T02:20:16.570810+0000","last_active":"2024-09-17T02:20:17.559533+0000","last_peered":"2024-09-17T02:20:17.559533+0000","last_clean":"2024-09-17T02:20:17.559533+0000","last_became_active":"2024-09-17T02:20:16.569273+0000","last_became_peered":"2024-09-17T02:20:16.569273+0000","last_unstale":"2024-09-17T02:20:17.559533+0000","last_undegraded":"2024-09-17T02:20:17.559533+0000","last_fullsized":"2024-09-17T02:20:17.559533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:42.123535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287137+0000","last_change":"2024-09-17T02:20:16.572798+0000","last_active":"2024-09-17T02:20:18.287137+0000","last_peered":"2024-09-17T02:20:18.287137+0000","last_clean":"2024-09-17T02:20:18.287137+0000","last_became_active":"2024-09-17T02:20:16.571174+0000","last_became_peered":"2024-09-17T02:20:16.571174+0000","last_unstale":"2024-09-17T02:20:18.287137+0000","last_undegraded":"2024-09-17T02:20:18.287137+0000","last_fullsized":"2024-09-17T02:20:18.287137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:00.116621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561420+0000","last_change":"2024-09-17T02:20:15.559935+0000","last_active":"2024-09-17T02:20:17.561420+0000","last_peered":"2024-09-17T02:20:17.561420+0000","last_clean":"2024-09-17T02:20:17.561420+0000","last_became_active":"2024-09-17T02:20:15.559413+0000","last_became_peered":"2024-09-17T02:20:15.559413+0000","last_unstale":"2024-09-17T02:20:17.561420+0000","last_undegraded":"2024-09-17T02:20:17.561420+0000","last_fullsized":"2024-09-17T02:20:17.561420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:52.985837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287177+0000","last_change":"2024-09-17T02:20:16.581819+0000","last_active":"2024-09-17T02:20:18.287177+0000","last_peered":"2024-09-17T02:20:18.287177+0000","last_clean":"2024-09-17T02:20:18.287177+0000","last_became_active":"2024-09-17T02:20:16.577168+0000","last_became_peered":"2024-09-17T02:20:16.577168+0000","last_unstale":"2024-09-17T02:20:18.287177+0000","last_undegraded":"2024-09-17T02:20:18.287177+0000","last_fullsized":"2024-09-17T02:20:18.287177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:47.756576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558392+0000","last_change":"2024-09-17T02:20:15.550890+0000","last_active":"2024-09-17T02:20:17.558392+0000","last_peered":"2024-09-17T02:20:17.558392+0000","last_clean":"2024-09-17T02:20:17.558392+0000","last_became_active":"2024-09-17T02:20:15.550077+0000","last_became_peered":"2024-09-17T02:20:15.550077+0000","last_unstale":"2024-09-17T02:20:17.558392+0000","last_undegraded":"2024-09-17T02:20:17.558392+0000","last_fullsized":"2024-09-17T02:20:17.558392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:36.119249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560885+0000","last_change":"2024-09-17T02:20:16.581457+0000","last_active":"2024-09-17T02:20:17.560885+0000","last_peered":"2024-09-17T02:20:17.560885+0000","last_clean":"2024-09-17T02:20:17.560885+0000","last_became_active":"2024-09-17T02:20:16.579428+0000","last_became_peered":"2024-09-17T02:20:16.579428+0000","last_unstale":"2024-09-17T02:20:17.560885+0000","last_undegraded":"2024-09-17T02:20:17.560885+0000","last_fullsized":"2024-09-17T02:20:17.560885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:55.083688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285758+0000","last_change":"2024-09-17T02:20:15.569442+0000","last_active":"2024-09-17T02:20:18.285758+0000","last_peered":"2024-09-17T02:20:18.285758+0000","last_clean":"2024-09-17T02:20:18.285758+0000","last_became_active":"2024-09-17T02:20:15.567946+0000","last_became_peered":"2024-09-17T02:20:15.567946+0000","last_unstale":"2024-09-17T02:20:18.285758+0000","last_undegraded":"2024-09-17T02:20:18.285758+0000","last_fullsized":"2024-09-17T02:20:18.285758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:55.866388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559959+0000","last_change":"2024-09-17T02:20:16.579779+0000","last_active":"2024-09-17T02:20:17.559959+0000","last_peered":"2024-09-17T02:20:17.559959+0000","last_clean":"2024-09-17T02:20:17.559959+0000","last_became_active":"2024-09-17T02:20:16.576734+0000","last_became_peered":"2024-09-17T02:20:16.576734+0000","last_unstale":"2024-09-17T02:20:17.559959+0000","last_undegraded":"2024-09-17T02:20:17.559959+0000","last_fullsized":"2024-09-17T02:20:17.559959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:26.782410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559862+0000","last_change":"2024-09-17T02:20:15.559245+0000","last_active":"2024-09-17T02:20:17.559862+0000","last_peered":"2024-09-17T02:20:17.559862+0000","last_clean":"2024-09-17T02:20:17.559862+0000","last_became_active":"2024-09-17T02:20:15.558518+0000","last_became_peered":"2024-09-17T02:20:15.558518+0000","last_unstale":"2024-09-17T02:20:17.559862+0000","last_undegraded":"2024-09-17T02:20:17.559862+0000","last_fullsized":"2024-09-17T02:20:17.559862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:52.783635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561043+0000","last_change":"2024-09-17T02:20:15.559110+0000","last_active":"2024-09-17T02:20:17.561043+0000","last_peered":"2024-09-17T02:20:17.561043+0000","last_clean":"2024-09-17T02:20:17.561043+0000","last_became_active":"2024-09-17T02:20:15.558285+0000","last_became_peered":"2024-09-17T02:20:15.558285+0000","last_unstale":"2024-09-17T02:20:17.561043+0000","last_undegraded":"2024-09-17T02:20:17.561043+0000","last_fullsized":"2024-09-17T02:20:17.561043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:15.782658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285013+0000","last_change":"2024-09-17T02:20:16.584359+0000","last_active":"2024-09-17T02:20:18.285013+0000","last_peered":"2024-09-17T02:20:18.285013+0000","last_clean":"2024-09-17T02:20:18.285013+0000","last_became_active":"2024-09-17T02:20:16.582303+0000","last_became_peered":"2024-09-17T02:20:16.582303+0000","last_unstale":"2024-09-17T02:20:18.285013+0000","last_undegraded":"2024-09-17T02:20:18.285013+0000","last_fullsized":"2024-09-17T02:20:18.285013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:12.345284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287762+0000","last_change":"2024-09-17T02:20:15.568414+0000","last_active":"2024-09-17T02:20:18.287762+0000","last_peered":"2024-09-17T02:20:18.287762+0000","last_clean":"2024-09-17T02:20:18.287762+0000","last_became_active":"2024-09-17T02:20:15.567596+0000","last_became_peered":"2024-09-17T02:20:15.567596+0000","last_unstale":"2024-09-17T02:20:18.287762+0000","last_undegraded":"2024-09-17T02:20:18.287762+0000","last_fullsized":"2024-09-17T02:20:18.287762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:11.356699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285690+0000","last_change":"2024-09-17T02:20:16.565402+0000","last_active":"2024-09-17T02:20:18.285690+0000","last_peered":"2024-09-17T02:20:18.285690+0000","last_clean":"2024-09-17T02:20:18.285690+0000","last_became_active":"2024-09-17T02:20:16.563113+0000","last_became_peered":"2024-09-17T02:20:16.563113+0000","last_unstale":"2024-09-17T02:20:18.285690+0000","last_undegraded":"2024-09-17T02:20:18.285690+0000","last_fullsized":"2024-09-17T02:20:18.285690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:38:36.115641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.562269+0000","last_change":"2024-09-17T02:20:15.559767+0000","last_active":"2024-09-17T02:20:17.562269+0000","last_peered":"2024-09-17T02:20:17.562269+0000","last_clean":"2024-09-17T02:20:17.562269+0000","last_became_active":"2024-09-17T02:20:15.558888+0000","last_became_peered":"2024-09-17T02:20:15.558888+0000","last_unstale":"2024-09-17T02:20:17.562269+0000","last_undegraded":"2024-09-17T02:20:17.562269+0000","last_fullsized":"2024-09-17T02:20:17.562269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:09.831510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559986+0000","last_change":"2024-09-17T02:20:16.565632+0000","last_active":"2024-09-17T02:20:17.559986+0000","last_peered":"2024-09-17T02:20:17.559986+0000","last_clean":"2024-09-17T02:20:17.559986+0000","last_became_active":"2024-09-17T02:20:16.563630+0000","last_became_peered":"2024-09-17T02:20:16.563630+0000","last_unstale":"2024-09-17T02:20:17.559986+0000","last_undegraded":"2024-09-17T02:20:17.559986+0000","last_fullsized":"2024-09-17T02:20:17.559986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:05.049317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.562156+0000","last_change":"2024-09-17T02:20:15.562539+0000","last_active":"2024-09-17T02:20:17.562156+0000","last_peered":"2024-09-17T02:20:17.562156+0000","last_clean":"2024-09-17T02:20:17.562156+0000","last_became_active":"2024-09-17T02:20:15.561801+0000","last_became_peered":"2024-09-17T02:20:15.561801+0000","last_unstale":"2024-09-17T02:20:17.562156+0000","last_undegraded":"2024-09-17T02:20:17.562156+0000","last_fullsized":"2024-09-17T02:20:17.562156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:15.848081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559360+0000","last_change":"2024-09-17T02:20:16.578474+0000","last_active":"2024-09-17T02:20:17.559360+0000","last_peered":"2024-09-17T02:20:17.559360+0000","last_clean":"2024-09-17T02:20:17.559360+0000","last_became_active":"2024-09-17T02:20:16.576264+0000","last_became_peered":"2024-09-17T02:20:16.576264+0000","last_unstale":"2024-09-17T02:20:17.559360+0000","last_undegraded":"2024-09-17T02:20:17.559360+0000","last_fullsized":"2024-09-17T02:20:17.559360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:48.313282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559626+0000","last_change":"2024-09-17T02:20:15.551986+0000","last_active":"2024-09-17T02:20:17.559626+0000","last_peered":"2024-09-17T02:20:17.559626+0000","last_clean":"2024-09-17T02:20:17.559626+0000","last_became_active":"2024-09-17T02:20:15.550418+0000","last_became_peered":"2024-09-17T02:20:15.550418+0000","last_unstale":"2024-09-17T02:20:17.559626+0000","last_undegraded":"2024-09-17T02:20:17.559626+0000","last_fullsized":"2024-09-17T02:20:17.559626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:17.866665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561875+0000","last_change":"2024-09-17T02:20:16.570845+0000","last_active":"2024-09-17T02:20:17.561875+0000","last_peered":"2024-09-17T02:20:17.561875+0000","last_clean":"2024-09-17T02:20:17.561875+0000","last_became_active":"2024-09-17T02:20:16.568862+0000","last_became_peered":"2024-09-17T02:20:16.568862+0000","last_unstale":"2024-09-17T02:20:17.561875+0000","last_undegraded":"2024-09-17T02:20:17.561875+0000","last_fullsized":"2024-09-17T02:20:17.561875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:30.715391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560696+0000","last_change":"2024-09-17T02:20:15.559849+0000","last_active":"2024-09-17T02:20:17.560696+0000","last_peered":"2024-09-17T02:20:17.560696+0000","last_clean":"2024-09-17T02:20:17.560696+0000","last_became_active":"2024-09-17T02:20:15.559431+0000","last_became_peered":"2024-09-17T02:20:15.559431+0000","last_unstale":"2024-09-17T02:20:17.560696+0000","last_undegraded":"2024-09-17T02:20:17.560696+0000","last_fullsized":"2024-09-17T02:20:17.560696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:31.933850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561999+0000","last_change":"2024-09-17T02:20:16.586434+0000","last_active":"2024-09-17T02:20:17.561999+0000","last_peered":"2024-09-17T02:20:17.561999+0000","last_clean":"2024-09-17T02:20:17.561999+0000","last_became_active":"2024-09-17T02:20:16.585466+0000","last_became_peered":"2024-09-17T02:20:16.585466+0000","last_unstale":"2024-09-17T02:20:17.561999+0000","last_undegraded":"2024-09-17T02:20:17.561999+0000","last_fullsized":"2024-09-17T02:20:17.561999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:57:29.891850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286282+0000","last_change":"2024-09-17T02:20:15.568506+0000","last_active":"2024-09-17T02:20:18.286282+0000","last_peered":"2024-09-17T02:20:18.286282+0000","last_clean":"2024-09-17T02:20:18.286282+0000","last_became_active":"2024-09-17T02:20:15.567720+0000","last_became_peered":"2024-09-17T02:20:15.567720+0000","last_unstale":"2024-09-17T02:20:18.286282+0000","last_undegraded":"2024-09-17T02:20:18.286282+0000","last_fullsized":"2024-09-17T02:20:18.286282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:46.560153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560661+0000","last_change":"2024-09-17T02:20:16.582353+0000","last_active":"2024-09-17T02:20:17.560661+0000","last_peered":"2024-09-17T02:20:17.560661+0000","last_clean":"2024-09-17T02:20:17.560661+0000","last_became_active":"2024-09-17T02:20:16.581462+0000","last_became_peered":"2024-09-17T02:20:16.581462+0000","last_unstale":"2024-09-17T02:20:17.560661+0000","last_undegraded":"2024-09-17T02:20:17.560661+0000","last_fullsized":"2024-09-17T02:20:17.560661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:44.023284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285391+0000","last_change":"2024-09-17T02:20:15.565444+0000","last_active":"2024-09-17T02:20:18.285391+0000","last_peered":"2024-09-17T02:20:18.285391+0000","last_clean":"2024-09-17T02:20:18.285391+0000","last_became_active":"2024-09-17T02:20:15.564640+0000","last_became_peered":"2024-09-17T02:20:15.564640+0000","last_unstale":"2024-09-17T02:20:18.285391+0000","last_undegraded":"2024-09-17T02:20:18.285391+0000","last_fullsized":"2024-09-17T02:20:18.285391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:29.214563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560331+0000","last_change":"2024-09-17T02:20:16.583084+0000","last_active":"2024-09-17T02:20:17.560331+0000","last_peered":"2024-09-17T02:20:17.560331+0000","last_clean":"2024-09-17T02:20:17.560331+0000","last_became_active":"2024-09-17T02:20:16.582326+0000","last_became_peered":"2024-09-17T02:20:16.582326+0000","last_unstale":"2024-09-17T02:20:17.560331+0000","last_undegraded":"2024-09-17T02:20:17.560331+0000","last_fullsized":"2024-09-17T02:20:17.560331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:05.049317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":224,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560852+0000","last_change":"2024-09-17T02:20:04.612894+0000","last_active":"2024-09-17T02:20:17.560852+0000","last_peered":"2024-09-17T02:20:17.560852+0000","last_clean":"2024-09-17T02:20:17.560852+0000","last_became_active":"2024-09-17T02:20:04.610517+0000","last_became_peered":"2024-09-17T02:20:04.610517+0000","last_unstale":"2024-09-17T02:20:17.560852+0000","last_undegraded":"2024-09-17T02:20:17.560852+0000","last_fullsized":"2024-09-17T02:20:17.560852+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_clean_scrub_stamp":"2024-09-17T02:20:03.432050+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:51.879303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":28,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561660+0000","last_change":"2024-09-17T02:20:12.513513+0000","last_active":"2024-09-17T02:20:17.561660+0000","last_peered":"2024-09-17T02:20:17.561660+0000","last_clean":"2024-09-17T02:20:17.561660+0000","last_became_active":"2024-09-17T02:20:10.504616+0000","last_became_peered":"2024-09-17T02:20:10.504616+0000","last_unstale":"2024-09-17T02:20:17.561660+0000","last_undegraded":"2024-09-17T02:20:17.561660+0000","last_fullsized":"2024-09-17T02:20:17.561660+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:13.341611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001517832,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558593+0000","last_change":"2024-09-17T02:20:15.560646+0000","last_active":"2024-09-17T02:20:17.558593+0000","last_peered":"2024-09-17T02:20:17.558593+0000","last_clean":"2024-09-17T02:20:17.558593+0000","last_became_active":"2024-09-17T02:20:15.559104+0000","last_became_peered":"2024-09-17T02:20:15.559104+0000","last_unstale":"2024-09-17T02:20:17.558593+0000","last_undegraded":"2024-09-17T02:20:17.558593+0000","last_fullsized":"2024-09-17T02:20:17.558593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:44.299986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.562163+0000","last_change":"2024-09-17T02:20:16.585522+0000","last_active":"2024-09-17T02:20:17.562163+0000","last_peered":"2024-09-17T02:20:17.562163+0000","last_clean":"2024-09-17T02:20:17.562163+0000","last_became_active":"2024-09-17T02:20:16.584520+0000","last_became_peered":"2024-09-17T02:20:16.584520+0000","last_unstale":"2024-09-17T02:20:17.562163+0000","last_undegraded":"2024-09-17T02:20:17.562163+0000","last_fullsized":"2024-09-17T02:20:17.562163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:14.123192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560572+0000","last_change":"2024-09-17T02:20:12.512798+0000","last_active":"2024-09-17T02:20:17.560572+0000","last_peered":"2024-09-17T02:20:17.560572+0000","last_clean":"2024-09-17T02:20:17.560572+0000","last_became_active":"2024-09-17T02:20:10.502115+0000","last_became_peered":"2024-09-17T02:20:10.502115+0000","last_unstale":"2024-09-17T02:20:17.560572+0000","last_undegraded":"2024-09-17T02:20:17.560572+0000","last_fullsized":"2024-09-17T02:20:17.560572+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:17.554878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083467700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558499+0000","last_change":"2024-09-17T02:20:15.551632+0000","last_active":"2024-09-17T02:20:17.558499+0000","last_peered":"2024-09-17T02:20:17.558499+0000","last_clean":"2024-09-17T02:20:17.558499+0000","last_became_active":"2024-09-17T02:20:15.551062+0000","last_became_peered":"2024-09-17T02:20:15.551062+0000","last_unstale":"2024-09-17T02:20:17.558499+0000","last_undegraded":"2024-09-17T02:20:17.558499+0000","last_fullsized":"2024-09-17T02:20:17.558499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:55.295518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287261+0000","last_change":"2024-09-17T02:20:16.571568+0000","last_active":"2024-09-17T02:20:18.287261+0000","last_peered":"2024-09-17T02:20:18.287261+0000","last_clean":"2024-09-17T02:20:18.287261+0000","last_became_active":"2024-09-17T02:20:16.570622+0000","last_became_peered":"2024-09-17T02:20:16.570622+0000","last_unstale":"2024-09-17T02:20:18.287261+0000","last_undegraded":"2024-09-17T02:20:18.287261+0000","last_fullsized":"2024-09-17T02:20:18.287261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:57.083446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558959+0000","last_change":"2024-09-17T02:20:12.511823+0000","last_active":"2024-09-17T02:20:17.558959+0000","last_peered":"2024-09-17T02:20:17.558959+0000","last_clean":"2024-09-17T02:20:17.558959+0000","last_became_active":"2024-09-17T02:20:10.497164+0000","last_became_peered":"2024-09-17T02:20:10.497164+0000","last_unstale":"2024-09-17T02:20:17.558959+0000","last_undegraded":"2024-09-17T02:20:17.558959+0000","last_fullsized":"2024-09-17T02:20:17.558959+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:21.242753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081052700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285368+0000","last_change":"2024-09-17T02:20:15.569475+0000","last_active":"2024-09-17T02:20:18.285368+0000","last_peered":"2024-09-17T02:20:18.285368+0000","last_clean":"2024-09-17T02:20:18.285368+0000","last_became_active":"2024-09-17T02:20:15.567965+0000","last_became_peered":"2024-09-17T02:20:15.567965+0000","last_unstale":"2024-09-17T02:20:18.285368+0000","last_undegraded":"2024-09-17T02:20:18.285368+0000","last_fullsized":"2024-09-17T02:20:18.285368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:06.649112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560384+0000","last_change":"2024-09-17T02:20:16.578902+0000","last_active":"2024-09-17T02:20:17.560384+0000","last_peered":"2024-09-17T02:20:17.560384+0000","last_clean":"2024-09-17T02:20:17.560384+0000","last_became_active":"2024-09-17T02:20:16.576512+0000","last_became_peered":"2024-09-17T02:20:16.576512+0000","last_unstale":"2024-09-17T02:20:17.560384+0000","last_undegraded":"2024-09-17T02:20:17.560384+0000","last_fullsized":"2024-09-17T02:20:17.560384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:29.757455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560859+0000","last_change":"2024-09-17T02:20:12.512742+0000","last_active":"2024-09-17T02:20:17.560859+0000","last_peered":"2024-09-17T02:20:17.560859+0000","last_clean":"2024-09-17T02:20:17.560859+0000","last_became_active":"2024-09-17T02:20:10.503622+0000","last_became_peered":"2024-09-17T02:20:10.503622+0000","last_unstale":"2024-09-17T02:20:17.560859+0000","last_undegraded":"2024-09-17T02:20:17.560859+0000","last_fullsized":"2024-09-17T02:20:17.560859+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:36.226043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078085399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561586+0000","last_change":"2024-09-17T02:20:15.562840+0000","last_active":"2024-09-17T02:20:17.561586+0000","last_peered":"2024-09-17T02:20:17.561586+0000","last_clean":"2024-09-17T02:20:17.561586+0000","last_became_active":"2024-09-17T02:20:15.562177+0000","last_became_peered":"2024-09-17T02:20:15.562177+0000","last_unstale":"2024-09-17T02:20:17.561586+0000","last_undegraded":"2024-09-17T02:20:17.561586+0000","last_fullsized":"2024-09-17T02:20:17.561586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:39.709524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559748+0000","last_change":"2024-09-17T02:20:16.580184+0000","last_active":"2024-09-17T02:20:17.559748+0000","last_peered":"2024-09-17T02:20:17.559748+0000","last_clean":"2024-09-17T02:20:17.559748+0000","last_became_active":"2024-09-17T02:20:16.578343+0000","last_became_peered":"2024-09-17T02:20:16.578343+0000","last_unstale":"2024-09-17T02:20:17.559748+0000","last_undegraded":"2024-09-17T02:20:17.559748+0000","last_fullsized":"2024-09-17T02:20:17.559748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:42.123535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.562400+0000","last_change":"2024-09-17T02:20:15.562922+0000","last_active":"2024-09-17T02:20:17.562400+0000","last_peered":"2024-09-17T02:20:17.562400+0000","last_clean":"2024-09-17T02:20:17.562400+0000","last_became_active":"2024-09-17T02:20:15.562138+0000","last_became_peered":"2024-09-17T02:20:15.562138+0000","last_unstale":"2024-09-17T02:20:17.562400+0000","last_undegraded":"2024-09-17T02:20:17.562400+0000","last_fullsized":"2024-09-17T02:20:17.562400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:00.819275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559993+0000","last_change":"2024-09-17T02:20:12.511838+0000","last_active":"2024-09-17T02:20:17.559993+0000","last_peered":"2024-09-17T02:20:17.559993+0000","last_clean":"2024-09-17T02:20:17.559993+0000","last_became_active":"2024-09-17T02:20:10.497049+0000","last_became_peered":"2024-09-17T02:20:10.497049+0000","last_unstale":"2024-09-17T02:20:17.559993+0000","last_undegraded":"2024-09-17T02:20:17.559993+0000","last_fullsized":"2024-09-17T02:20:17.559993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:54.446484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079701100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286426+0000","last_change":"2024-09-17T02:20:16.571485+0000","last_active":"2024-09-17T02:20:18.286426+0000","last_peered":"2024-09-17T02:20:18.286426+0000","last_clean":"2024-09-17T02:20:18.286426+0000","last_became_active":"2024-09-17T02:20:16.567570+0000","last_became_peered":"2024-09-17T02:20:16.567570+0000","last_unstale":"2024-09-17T02:20:18.286426+0000","last_undegraded":"2024-09-17T02:20:18.286426+0000","last_fullsized":"2024-09-17T02:20:18.286426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:14.228385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559752+0000","last_change":"2024-09-17T02:20:15.559252+0000","last_active":"2024-09-17T02:20:17.559752+0000","last_peered":"2024-09-17T02:20:17.559752+0000","last_clean":"2024-09-17T02:20:17.559752+0000","last_became_active":"2024-09-17T02:20:15.557667+0000","last_became_peered":"2024-09-17T02:20:15.557667+0000","last_unstale":"2024-09-17T02:20:17.559752+0000","last_undegraded":"2024-09-17T02:20:17.559752+0000","last_fullsized":"2024-09-17T02:20:17.559752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:01.292626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287685+0000","last_change":"2024-09-17T02:20:12.661034+0000","last_active":"2024-09-17T02:20:18.287685+0000","last_peered":"2024-09-17T02:20:18.287685+0000","last_clean":"2024-09-17T02:20:18.287685+0000","last_became_active":"2024-09-17T02:20:10.497829+0000","last_became_peered":"2024-09-17T02:20:10.497829+0000","last_unstale":"2024-09-17T02:20:18.287685+0000","last_undegraded":"2024-09-17T02:20:18.287685+0000","last_fullsized":"2024-09-17T02:20:18.287685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:46:27.427685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096944700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286097+0000","last_change":"2024-09-17T02:20:16.579478+0000","last_active":"2024-09-17T02:20:18.286097+0000","last_peered":"2024-09-17T02:20:18.286097+0000","last_clean":"2024-09-17T02:20:18.286097+0000","last_became_active":"2024-09-17T02:20:16.578705+0000","last_became_peered":"2024-09-17T02:20:16.578705+0000","last_unstale":"2024-09-17T02:20:18.286097+0000","last_undegraded":"2024-09-17T02:20:18.286097+0000","last_fullsized":"2024-09-17T02:20:18.286097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:21.656908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561074+0000","last_change":"2024-09-17T02:20:15.558961+0000","last_active":"2024-09-17T02:20:17.561074+0000","last_peered":"2024-09-17T02:20:17.561074+0000","last_clean":"2024-09-17T02:20:17.561074+0000","last_became_active":"2024-09-17T02:20:15.558299+0000","last_became_peered":"2024-09-17T02:20:15.558299+0000","last_unstale":"2024-09-17T02:20:17.561074+0000","last_undegraded":"2024-09-17T02:20:17.561074+0000","last_fullsized":"2024-09-17T02:20:17.561074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:39.709524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561104+0000","last_change":"2024-09-17T02:20:12.512481+0000","last_active":"2024-09-17T02:20:17.561104+0000","last_peered":"2024-09-17T02:20:17.561104+0000","last_clean":"2024-09-17T02:20:17.561104+0000","last_became_active":"2024-09-17T02:20:10.497021+0000","last_became_peered":"2024-09-17T02:20:10.497021+0000","last_unstale":"2024-09-17T02:20:17.561104+0000","last_undegraded":"2024-09-17T02:20:17.561104+0000","last_fullsized":"2024-09-17T02:20:17.561104+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:41.167283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001400079,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558440+0000","last_change":"2024-09-17T02:20:16.560687+0000","last_active":"2024-09-17T02:20:17.558440+0000","last_peered":"2024-09-17T02:20:17.558440+0000","last_clean":"2024-09-17T02:20:17.558440+0000","last_became_active":"2024-09-17T02:20:16.559758+0000","last_became_peered":"2024-09-17T02:20:16.559758+0000","last_unstale":"2024-09-17T02:20:17.558440+0000","last_undegraded":"2024-09-17T02:20:17.558440+0000","last_fullsized":"2024-09-17T02:20:17.558440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:54:33.088375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560971+0000","last_change":"2024-09-17T02:20:15.551758+0000","last_active":"2024-09-17T02:20:17.560971+0000","last_peered":"2024-09-17T02:20:17.560971+0000","last_clean":"2024-09-17T02:20:17.560971+0000","last_became_active":"2024-09-17T02:20:15.550353+0000","last_became_peered":"2024-09-17T02:20:15.550353+0000","last_unstale":"2024-09-17T02:20:17.560971+0000","last_undegraded":"2024-09-17T02:20:17.560971+0000","last_fullsized":"2024-09-17T02:20:17.560971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:04.229911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561418+0000","last_change":"2024-09-17T02:20:12.513530+0000","last_active":"2024-09-17T02:20:17.561418+0000","last_peered":"2024-09-17T02:20:17.561418+0000","last_clean":"2024-09-17T02:20:17.561418+0000","last_became_active":"2024-09-17T02:20:10.502692+0000","last_became_peered":"2024-09-17T02:20:10.502692+0000","last_unstale":"2024-09-17T02:20:17.561418+0000","last_undegraded":"2024-09-17T02:20:17.561418+0000","last_fullsized":"2024-09-17T02:20:17.561418+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:53.004641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015329009999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285205+0000","last_change":"2024-09-17T02:20:16.575882+0000","last_active":"2024-09-17T02:20:18.285205+0000","last_peered":"2024-09-17T02:20:18.285205+0000","last_clean":"2024-09-17T02:20:18.285205+0000","last_became_active":"2024-09-17T02:20:16.573968+0000","last_became_peered":"2024-09-17T02:20:16.573968+0000","last_unstale":"2024-09-17T02:20:18.285205+0000","last_undegraded":"2024-09-17T02:20:18.285205+0000","last_fullsized":"2024-09-17T02:20:18.285205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:18.090082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560482+0000","last_change":"2024-09-17T02:20:16.582881+0000","last_active":"2024-09-17T02:20:17.560482+0000","last_peered":"2024-09-17T02:20:17.560482+0000","last_clean":"2024-09-17T02:20:17.560482+0000","last_became_active":"2024-09-17T02:20:16.580985+0000","last_became_peered":"2024-09-17T02:20:16.580985+0000","last_unstale":"2024-09-17T02:20:17.560482+0000","last_undegraded":"2024-09-17T02:20:17.560482+0000","last_fullsized":"2024-09-17T02:20:17.560482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:10.315951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.562026+0000","last_change":"2024-09-17T02:20:15.558925+0000","last_active":"2024-09-17T02:20:17.562026+0000","last_peered":"2024-09-17T02:20:17.562026+0000","last_clean":"2024-09-17T02:20:17.562026+0000","last_became_active":"2024-09-17T02:20:15.558174+0000","last_became_peered":"2024-09-17T02:20:15.558174+0000","last_unstale":"2024-09-17T02:20:17.562026+0000","last_undegraded":"2024-09-17T02:20:17.562026+0000","last_fullsized":"2024-09-17T02:20:17.562026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:55.639841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558215+0000","last_change":"2024-09-17T02:20:16.579411+0000","last_active":"2024-09-17T02:20:17.558215+0000","last_peered":"2024-09-17T02:20:17.558215+0000","last_clean":"2024-09-17T02:20:17.558215+0000","last_became_active":"2024-09-17T02:20:16.576294+0000","last_became_peered":"2024-09-17T02:20:16.576294+0000","last_unstale":"2024-09-17T02:20:17.558215+0000","last_undegraded":"2024-09-17T02:20:17.558215+0000","last_fullsized":"2024-09-17T02:20:17.558215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:41:31.822425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287526+0000","last_change":"2024-09-17T02:20:15.569117+0000","last_active":"2024-09-17T02:20:18.287526+0000","last_peered":"2024-09-17T02:20:18.287526+0000","last_clean":"2024-09-17T02:20:18.287526+0000","last_became_active":"2024-09-17T02:20:15.567405+0000","last_became_peered":"2024-09-17T02:20:15.567405+0000","last_unstale":"2024-09-17T02:20:18.287526+0000","last_undegraded":"2024-09-17T02:20:18.287526+0000","last_fullsized":"2024-09-17T02:20:18.287526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:55:10.186481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561160+0000","last_change":"2024-09-17T02:20:15.562827+0000","last_active":"2024-09-17T02:20:17.561160+0000","last_peered":"2024-09-17T02:20:17.561160+0000","last_clean":"2024-09-17T02:20:17.561160+0000","last_became_active":"2024-09-17T02:20:15.562073+0000","last_became_peered":"2024-09-17T02:20:15.562073+0000","last_unstale":"2024-09-17T02:20:17.561160+0000","last_undegraded":"2024-09-17T02:20:17.561160+0000","last_fullsized":"2024-09-17T02:20:17.561160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:17.866665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558226+0000","last_change":"2024-09-17T02:20:16.577670+0000","last_active":"2024-09-17T02:20:17.558226+0000","last_peered":"2024-09-17T02:20:17.558226+0000","last_clean":"2024-09-17T02:20:17.558226+0000","last_became_active":"2024-09-17T02:20:16.575082+0000","last_became_peered":"2024-09-17T02:20:16.575082+0000","last_unstale":"2024-09-17T02:20:17.558226+0000","last_undegraded":"2024-09-17T02:20:17.558226+0000","last_fullsized":"2024-09-17T02:20:17.558226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:21.356437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560821+0000","last_change":"2024-09-17T02:20:15.555513+0000","last_active":"2024-09-17T02:20:17.560821+0000","last_peered":"2024-09-17T02:20:17.560821+0000","last_clean":"2024-09-17T02:20:17.560821+0000","last_became_active":"2024-09-17T02:20:15.554256+0000","last_became_peered":"2024-09-17T02:20:15.554256+0000","last_unstale":"2024-09-17T02:20:17.560821+0000","last_undegraded":"2024-09-17T02:20:17.560821+0000","last_fullsized":"2024-09-17T02:20:17.560821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:52.985837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558359+0000","last_change":"2024-09-17T02:20:16.577803+0000","last_active":"2024-09-17T02:20:17.558359+0000","last_peered":"2024-09-17T02:20:17.558359+0000","last_clean":"2024-09-17T02:20:17.558359+0000","last_became_active":"2024-09-17T02:20:16.576640+0000","last_became_peered":"2024-09-17T02:20:16.576640+0000","last_unstale":"2024-09-17T02:20:17.558359+0000","last_undegraded":"2024-09-17T02:20:17.558359+0000","last_fullsized":"2024-09-17T02:20:17.558359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:07.190169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.288014+0000","last_change":"2024-09-17T02:20:16.571738+0000","last_active":"2024-09-17T02:20:18.288014+0000","last_peered":"2024-09-17T02:20:18.288014+0000","last_clean":"2024-09-17T02:20:18.288014+0000","last_became_active":"2024-09-17T02:20:16.568615+0000","last_became_peered":"2024-09-17T02:20:16.568615+0000","last_unstale":"2024-09-17T02:20:18.288014+0000","last_undegraded":"2024-09-17T02:20:18.288014+0000","last_fullsized":"2024-09-17T02:20:18.288014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:42.931361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558692+0000","last_change":"2024-09-17T02:20:15.558467+0000","last_active":"2024-09-17T02:20:17.558692+0000","last_peered":"2024-09-17T02:20:17.558692+0000","last_clean":"2024-09-17T02:20:17.558692+0000","last_became_active":"2024-09-17T02:20:15.557186+0000","last_became_peered":"2024-09-17T02:20:15.557186+0000","last_unstale":"2024-09-17T02:20:17.558692+0000","last_undegraded":"2024-09-17T02:20:17.558692+0000","last_fullsized":"2024-09-17T02:20:17.558692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:56.879445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560355+0000","last_change":"2024-09-17T02:20:16.577527+0000","last_active":"2024-09-17T02:20:17.560355+0000","last_peered":"2024-09-17T02:20:17.560355+0000","last_clean":"2024-09-17T02:20:17.560355+0000","last_became_active":"2024-09-17T02:20:16.574761+0000","last_became_peered":"2024-09-17T02:20:16.574761+0000","last_unstale":"2024-09-17T02:20:17.560355+0000","last_undegraded":"2024-09-17T02:20:17.560355+0000","last_fullsized":"2024-09-17T02:20:17.560355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:43.309196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558428+0000","last_change":"2024-09-17T02:20:15.552417+0000","last_active":"2024-09-17T02:20:17.558428+0000","last_peered":"2024-09-17T02:20:17.558428+0000","last_clean":"2024-09-17T02:20:17.558428+0000","last_became_active":"2024-09-17T02:20:15.551609+0000","last_became_peered":"2024-09-17T02:20:15.551609+0000","last_unstale":"2024-09-17T02:20:17.558428+0000","last_undegraded":"2024-09-17T02:20:17.558428+0000","last_fullsized":"2024-09-17T02:20:17.558428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:15.782658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286869+0000","last_change":"2024-09-17T02:20:16.591978+0000","last_active":"2024-09-17T02:20:18.286869+0000","last_peered":"2024-09-17T02:20:18.286869+0000","last_clean":"2024-09-17T02:20:18.286869+0000","last_became_active":"2024-09-17T02:20:16.591378+0000","last_became_peered":"2024-09-17T02:20:16.591378+0000","last_unstale":"2024-09-17T02:20:18.286869+0000","last_undegraded":"2024-09-17T02:20:18.286869+0000","last_fullsized":"2024-09-17T02:20:18.286869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:44.489118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286792+0000","last_change":"2024-09-17T02:20:15.565262+0000","last_active":"2024-09-17T02:20:18.286792+0000","last_peered":"2024-09-17T02:20:18.286792+0000","last_clean":"2024-09-17T02:20:18.286792+0000","last_became_active":"2024-09-17T02:20:15.564415+0000","last_became_peered":"2024-09-17T02:20:15.564415+0000","last_unstale":"2024-09-17T02:20:18.286792+0000","last_undegraded":"2024-09-17T02:20:18.286792+0000","last_fullsized":"2024-09-17T02:20:18.286792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:42.049312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286398+0000","last_change":"2024-09-17T02:20:16.573407+0000","last_active":"2024-09-17T02:20:18.286398+0000","last_peered":"2024-09-17T02:20:18.286398+0000","last_clean":"2024-09-17T02:20:18.286398+0000","last_became_active":"2024-09-17T02:20:16.570987+0000","last_became_peered":"2024-09-17T02:20:16.570987+0000","last_unstale":"2024-09-17T02:20:18.286398+0000","last_undegraded":"2024-09-17T02:20:18.286398+0000","last_fullsized":"2024-09-17T02:20:18.286398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:23:09.424550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286401+0000","last_change":"2024-09-17T02:20:15.568883+0000","last_active":"2024-09-17T02:20:18.286401+0000","last_peered":"2024-09-17T02:20:18.286401+0000","last_clean":"2024-09-17T02:20:18.286401+0000","last_became_active":"2024-09-17T02:20:15.567980+0000","last_became_peered":"2024-09-17T02:20:15.567980+0000","last_unstale":"2024-09-17T02:20:18.286401+0000","last_undegraded":"2024-09-17T02:20:18.286401+0000","last_fullsized":"2024-09-17T02:20:18.286401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:04.059900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561194+0000","last_change":"2024-09-17T02:20:16.568209+0000","last_active":"2024-09-17T02:20:17.561194+0000","last_peered":"2024-09-17T02:20:17.561194+0000","last_clean":"2024-09-17T02:20:17.561194+0000","last_became_active":"2024-09-17T02:20:16.566585+0000","last_became_peered":"2024-09-17T02:20:16.566585+0000","last_unstale":"2024-09-17T02:20:17.561194+0000","last_undegraded":"2024-09-17T02:20:17.561194+0000","last_fullsized":"2024-09-17T02:20:17.561194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:44:59.713633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561836+0000","last_change":"2024-09-17T02:20:15.558296+0000","last_active":"2024-09-17T02:20:17.561836+0000","last_peered":"2024-09-17T02:20:17.561836+0000","last_clean":"2024-09-17T02:20:17.561836+0000","last_became_active":"2024-09-17T02:20:15.557520+0000","last_became_peered":"2024-09-17T02:20:15.557520+0000","last_unstale":"2024-09-17T02:20:17.561836+0000","last_undegraded":"2024-09-17T02:20:17.561836+0000","last_fullsized":"2024-09-17T02:20:17.561836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:04.229911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560569+0000","last_change":"2024-09-17T02:20:16.568334+0000","last_active":"2024-09-17T02:20:17.560569+0000","last_peered":"2024-09-17T02:20:17.560569+0000","last_clean":"2024-09-17T02:20:17.560569+0000","last_became_active":"2024-09-17T02:20:16.566982+0000","last_became_peered":"2024-09-17T02:20:16.566982+0000","last_unstale":"2024-09-17T02:20:17.560569+0000","last_undegraded":"2024-09-17T02:20:17.560569+0000","last_fullsized":"2024-09-17T02:20:17.560569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:55.083688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287197+0000","last_change":"2024-09-17T02:20:15.569712+0000","last_active":"2024-09-17T02:20:18.287197+0000","last_peered":"2024-09-17T02:20:18.287197+0000","last_clean":"2024-09-17T02:20:18.287197+0000","last_became_active":"2024-09-17T02:20:15.569106+0000","last_became_peered":"2024-09-17T02:20:15.569106+0000","last_unstale":"2024-09-17T02:20:18.287197+0000","last_undegraded":"2024-09-17T02:20:18.287197+0000","last_fullsized":"2024-09-17T02:20:18.287197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:02.822970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286608+0000","last_change":"2024-09-17T02:20:16.570456+0000","last_active":"2024-09-17T02:20:18.286608+0000","last_peered":"2024-09-17T02:20:18.286608+0000","last_clean":"2024-09-17T02:20:18.286608+0000","last_became_active":"2024-09-17T02:20:16.568095+0000","last_became_peered":"2024-09-17T02:20:16.568095+0000","last_unstale":"2024-09-17T02:20:18.286608+0000","last_undegraded":"2024-09-17T02:20:18.286608+0000","last_fullsized":"2024-09-17T02:20:18.286608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:58.329169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560601+0000","last_change":"2024-09-17T02:20:15.560293+0000","last_active":"2024-09-17T02:20:17.560601+0000","last_peered":"2024-09-17T02:20:17.560601+0000","last_clean":"2024-09-17T02:20:17.560601+0000","last_became_active":"2024-09-17T02:20:15.559074+0000","last_became_peered":"2024-09-17T02:20:15.559074+0000","last_unstale":"2024-09-17T02:20:17.560601+0000","last_undegraded":"2024-09-17T02:20:17.560601+0000","last_fullsized":"2024-09-17T02:20:17.560601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:55.639841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560319+0000","last_change":"2024-09-17T02:20:16.570950+0000","last_active":"2024-09-17T02:20:17.560319+0000","last_peered":"2024-09-17T02:20:17.560319+0000","last_clean":"2024-09-17T02:20:17.560319+0000","last_became_active":"2024-09-17T02:20:16.569496+0000","last_became_peered":"2024-09-17T02:20:16.569496+0000","last_unstale":"2024-09-17T02:20:17.560319+0000","last_undegraded":"2024-09-17T02:20:17.560319+0000","last_fullsized":"2024-09-17T02:20:17.560319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:29.757455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560576+0000","last_change":"2024-09-17T02:20:15.544675+0000","last_active":"2024-09-17T02:20:17.560576+0000","last_peered":"2024-09-17T02:20:17.560576+0000","last_clean":"2024-09-17T02:20:17.560576+0000","last_became_active":"2024-09-17T02:20:15.544213+0000","last_became_peered":"2024-09-17T02:20:15.544213+0000","last_unstale":"2024-09-17T02:20:17.560576+0000","last_undegraded":"2024-09-17T02:20:17.560576+0000","last_fullsized":"2024-09-17T02:20:17.560576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:31.933850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35600,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336240,"statfs":{"total":96636764160,"available":96600309760,"internally_reserved":0,"allocated":253952,"data_stored":654086,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":266240,"data_stored":654721,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":62559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T02:20:24.163 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:20:24.500 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:20:24.501 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-17T02:20:24.516 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-09-17T02:20:23.345360+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94268,"kb_used_data":688,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283021252,"statfs":{"total":289910292480,"available":289813762048,"internally_reserved":0,"allocated":704512,"data_stored":1371366,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2421,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.806890"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287583+0000","last_change":"2024-09-17T02:20:16.577643+0000","last_active":"2024-09-17T02:20:18.287583+0000","last_peered":"2024-09-17T02:20:18.287583+0000","last_clean":"2024-09-17T02:20:18.287583+0000","last_became_active":"2024-09-17T02:20:16.576566+0000","last_became_peered":"2024-09-17T02:20:16.576566+0000","last_unstale":"2024-09-17T02:20:18.287583+0000","last_undegraded":"2024-09-17T02:20:18.287583+0000","last_fullsized":"2024-09-17T02:20:18.287583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:34.971816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286435+0000","last_change":"2024-09-17T02:20:16.574137+0000","last_active":"2024-09-17T02:20:18.286435+0000","last_peered":"2024-09-17T02:20:18.286435+0000","last_clean":"2024-09-17T02:20:18.286435+0000","last_became_active":"2024-09-17T02:20:16.571755+0000","last_became_peered":"2024-09-17T02:20:16.571755+0000","last_unstale":"2024-09-17T02:20:18.286435+0000","last_undegraded":"2024-09-17T02:20:18.286435+0000","last_fullsized":"2024-09-17T02:20:18.286435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:56.146270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561529+0000","last_change":"2024-09-17T02:20:16.582493+0000","last_active":"2024-09-17T02:20:17.561529+0000","last_peered":"2024-09-17T02:20:17.561529+0000","last_clean":"2024-09-17T02:20:17.561529+0000","last_became_active":"2024-09-17T02:20:16.581463+0000","last_became_peered":"2024-09-17T02:20:16.581463+0000","last_unstale":"2024-09-17T02:20:17.561529+0000","last_undegraded":"2024-09-17T02:20:17.561529+0000","last_fullsized":"2024-09-17T02:20:17.561529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:12.134652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561118+0000","last_change":"2024-09-17T02:20:16.568747+0000","last_active":"2024-09-17T02:20:17.561118+0000","last_peered":"2024-09-17T02:20:17.561118+0000","last_clean":"2024-09-17T02:20:17.561118+0000","last_became_active":"2024-09-17T02:20:16.566795+0000","last_became_peered":"2024-09-17T02:20:16.566795+0000","last_unstale":"2024-09-17T02:20:17.561118+0000","last_undegraded":"2024-09-17T02:20:17.561118+0000","last_fullsized":"2024-09-17T02:20:17.561118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:51.799644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286208+0000","last_change":"2024-09-17T02:20:16.568625+0000","last_active":"2024-09-17T02:20:18.286208+0000","last_peered":"2024-09-17T02:20:18.286208+0000","last_clean":"2024-09-17T02:20:18.286208+0000","last_became_active":"2024-09-17T02:20:16.567707+0000","last_became_peered":"2024-09-17T02:20:16.567707+0000","last_unstale":"2024-09-17T02:20:18.286208+0000","last_undegraded":"2024-09-17T02:20:18.286208+0000","last_fullsized":"2024-09-17T02:20:18.286208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:44.452839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559506+0000","last_change":"2024-09-17T02:20:16.568765+0000","last_active":"2024-09-17T02:20:17.559506+0000","last_peered":"2024-09-17T02:20:17.559506+0000","last_clean":"2024-09-17T02:20:17.559506+0000","last_became_active":"2024-09-17T02:20:16.564108+0000","last_became_peered":"2024-09-17T02:20:16.564108+0000","last_unstale":"2024-09-17T02:20:17.559506+0000","last_undegraded":"2024-09-17T02:20:17.559506+0000","last_fullsized":"2024-09-17T02:20:17.559506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:26.782410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559579+0000","last_change":"2024-09-17T02:20:16.563357+0000","last_active":"2024-09-17T02:20:17.559579+0000","last_peered":"2024-09-17T02:20:17.559579+0000","last_clean":"2024-09-17T02:20:17.559579+0000","last_became_active":"2024-09-17T02:20:16.562276+0000","last_became_peered":"2024-09-17T02:20:16.562276+0000","last_unstale":"2024-09-17T02:20:17.559579+0000","last_undegraded":"2024-09-17T02:20:17.559579+0000","last_fullsized":"2024-09-17T02:20:17.559579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:47.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559460+0000","last_change":"2024-09-17T02:20:16.568482+0000","last_active":"2024-09-17T02:20:17.559460+0000","last_peered":"2024-09-17T02:20:17.559460+0000","last_clean":"2024-09-17T02:20:17.559460+0000","last_became_active":"2024-09-17T02:20:16.565416+0000","last_became_peered":"2024-09-17T02:20:16.565416+0000","last_unstale":"2024-09-17T02:20:17.559460+0000","last_undegraded":"2024-09-17T02:20:17.559460+0000","last_fullsized":"2024-09-17T02:20:17.559460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:13.574859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559952+0000","last_change":"2024-09-17T02:20:16.584665+0000","last_active":"2024-09-17T02:20:17.559952+0000","last_peered":"2024-09-17T02:20:17.559952+0000","last_clean":"2024-09-17T02:20:17.559952+0000","last_became_active":"2024-09-17T02:20:16.580797+0000","last_became_peered":"2024-09-17T02:20:16.580797+0000","last_unstale":"2024-09-17T02:20:17.559952+0000","last_undegraded":"2024-09-17T02:20:17.559952+0000","last_fullsized":"2024-09-17T02:20:17.559952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:47.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287106+0000","last_change":"2024-09-17T02:20:16.577666+0000","last_active":"2024-09-17T02:20:18.287106+0000","last_peered":"2024-09-17T02:20:18.287106+0000","last_clean":"2024-09-17T02:20:18.287106+0000","last_became_active":"2024-09-17T02:20:16.574914+0000","last_became_peered":"2024-09-17T02:20:16.574914+0000","last_unstale":"2024-09-17T02:20:18.287106+0000","last_undegraded":"2024-09-17T02:20:18.287106+0000","last_fullsized":"2024-09-17T02:20:18.287106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:48.730100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561136+0000","last_change":"2024-09-17T02:20:16.565609+0000","last_active":"2024-09-17T02:20:17.561136+0000","last_peered":"2024-09-17T02:20:17.561136+0000","last_clean":"2024-09-17T02:20:17.561136+0000","last_became_active":"2024-09-17T02:20:16.564092+0000","last_became_peered":"2024-09-17T02:20:16.564092+0000","last_unstale":"2024-09-17T02:20:17.561136+0000","last_undegraded":"2024-09-17T02:20:17.561136+0000","last_fullsized":"2024-09-17T02:20:17.561136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:40.921595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286686+0000","last_change":"2024-09-17T02:20:16.584447+0000","last_active":"2024-09-17T02:20:18.286686+0000","last_peered":"2024-09-17T02:20:18.286686+0000","last_clean":"2024-09-17T02:20:18.286686+0000","last_became_active":"2024-09-17T02:20:16.580416+0000","last_became_peered":"2024-09-17T02:20:16.580416+0000","last_unstale":"2024-09-17T02:20:18.286686+0000","last_undegraded":"2024-09-17T02:20:18.286686+0000","last_fullsized":"2024-09-17T02:20:18.286686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:19.742400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285729+0000","last_change":"2024-09-17T02:20:16.573447+0000","last_active":"2024-09-17T02:20:18.285729+0000","last_peered":"2024-09-17T02:20:18.285729+0000","last_clean":"2024-09-17T02:20:18.285729+0000","last_became_active":"2024-09-17T02:20:16.571757+0000","last_became_peered":"2024-09-17T02:20:16.571757+0000","last_unstale":"2024-09-17T02:20:18.285729+0000","last_undegraded":"2024-09-17T02:20:18.285729+0000","last_fullsized":"2024-09-17T02:20:18.285729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:12.584579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560276+0000","last_change":"2024-09-17T02:20:16.563197+0000","last_active":"2024-09-17T02:20:17.560276+0000","last_peered":"2024-09-17T02:20:17.560276+0000","last_clean":"2024-09-17T02:20:17.560276+0000","last_became_active":"2024-09-17T02:20:16.561221+0000","last_became_peered":"2024-09-17T02:20:16.561221+0000","last_unstale":"2024-09-17T02:20:17.560276+0000","last_undegraded":"2024-09-17T02:20:17.560276+0000","last_fullsized":"2024-09-17T02:20:17.560276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:43.309196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559960+0000","last_change":"2024-09-17T02:20:16.581305+0000","last_active":"2024-09-17T02:20:17.559960+0000","last_peered":"2024-09-17T02:20:17.559960+0000","last_clean":"2024-09-17T02:20:17.559960+0000","last_became_active":"2024-09-17T02:20:16.580377+0000","last_became_peered":"2024-09-17T02:20:16.580377+0000","last_unstale":"2024-09-17T02:20:17.559960+0000","last_undegraded":"2024-09-17T02:20:17.559960+0000","last_fullsized":"2024-09-17T02:20:17.559960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:43.454908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559106+0000","last_change":"2024-09-17T02:20:16.562686+0000","last_active":"2024-09-17T02:20:17.559106+0000","last_peered":"2024-09-17T02:20:17.559106+0000","last_clean":"2024-09-17T02:20:17.559106+0000","last_became_active":"2024-09-17T02:20:16.561446+0000","last_became_peered":"2024-09-17T02:20:16.561446+0000","last_unstale":"2024-09-17T02:20:17.559106+0000","last_undegraded":"2024-09-17T02:20:17.559106+0000","last_fullsized":"2024-09-17T02:20:17.559106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:22.801598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560996+0000","last_change":"2024-09-17T02:20:16.563482+0000","last_active":"2024-09-17T02:20:17.560996+0000","last_peered":"2024-09-17T02:20:17.560996+0000","last_clean":"2024-09-17T02:20:17.560996+0000","last_became_active":"2024-09-17T02:20:16.562735+0000","last_became_peered":"2024-09-17T02:20:16.562735+0000","last_unstale":"2024-09-17T02:20:17.560996+0000","last_undegraded":"2024-09-17T02:20:17.560996+0000","last_fullsized":"2024-09-17T02:20:17.560996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:10.315951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287548+0000","last_change":"2024-09-17T02:20:16.568659+0000","last_active":"2024-09-17T02:20:18.287548+0000","last_peered":"2024-09-17T02:20:18.287548+0000","last_clean":"2024-09-17T02:20:18.287548+0000","last_became_active":"2024-09-17T02:20:16.565734+0000","last_became_peered":"2024-09-17T02:20:16.565734+0000","last_unstale":"2024-09-17T02:20:18.287548+0000","last_undegraded":"2024-09-17T02:20:18.287548+0000","last_fullsized":"2024-09-17T02:20:18.287548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:05.723619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559666+0000","last_change":"2024-09-17T02:20:16.586950+0000","last_active":"2024-09-17T02:20:17.559666+0000","last_peered":"2024-09-17T02:20:17.559666+0000","last_clean":"2024-09-17T02:20:17.559666+0000","last_became_active":"2024-09-17T02:20:16.586281+0000","last_became_peered":"2024-09-17T02:20:16.586281+0000","last_unstale":"2024-09-17T02:20:17.559666+0000","last_undegraded":"2024-09-17T02:20:17.559666+0000","last_fullsized":"2024-09-17T02:20:17.559666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:22.801598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561561+0000","last_change":"2024-09-17T02:20:16.570514+0000","last_active":"2024-09-17T02:20:17.561561+0000","last_peered":"2024-09-17T02:20:17.561561+0000","last_clean":"2024-09-17T02:20:17.561561+0000","last_became_active":"2024-09-17T02:20:16.567156+0000","last_became_peered":"2024-09-17T02:20:16.567156+0000","last_unstale":"2024-09-17T02:20:17.561561+0000","last_undegraded":"2024-09-17T02:20:17.561561+0000","last_fullsized":"2024-09-17T02:20:17.561561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:51.596077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561439+0000","last_change":"2024-09-17T02:20:16.571275+0000","last_active":"2024-09-17T02:20:17.561439+0000","last_peered":"2024-09-17T02:20:17.561439+0000","last_clean":"2024-09-17T02:20:17.561439+0000","last_became_active":"2024-09-17T02:20:16.569751+0000","last_became_peered":"2024-09-17T02:20:16.569751+0000","last_unstale":"2024-09-17T02:20:17.561439+0000","last_undegraded":"2024-09-17T02:20:17.561439+0000","last_fullsized":"2024-09-17T02:20:17.561439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:41.362905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285399+0000","last_change":"2024-09-17T02:20:16.567109+0000","last_active":"2024-09-17T02:20:18.285399+0000","last_peered":"2024-09-17T02:20:18.285399+0000","last_clean":"2024-09-17T02:20:18.285399+0000","last_became_active":"2024-09-17T02:20:16.564753+0000","last_became_peered":"2024-09-17T02:20:16.564753+0000","last_unstale":"2024-09-17T02:20:18.285399+0000","last_undegraded":"2024-09-17T02:20:18.285399+0000","last_fullsized":"2024-09-17T02:20:18.285399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:01.888476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.557727+0000","last_change":"2024-09-17T02:20:16.558778+0000","last_active":"2024-09-17T02:20:17.557727+0000","last_peered":"2024-09-17T02:20:17.557727+0000","last_clean":"2024-09-17T02:20:17.557727+0000","last_became_active":"2024-09-17T02:20:16.557967+0000","last_became_peered":"2024-09-17T02:20:16.557967+0000","last_unstale":"2024-09-17T02:20:17.557727+0000","last_undegraded":"2024-09-17T02:20:17.557727+0000","last_fullsized":"2024-09-17T02:20:17.557727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:40.577627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285052+0000","last_change":"2024-09-17T02:20:16.564194+0000","last_active":"2024-09-17T02:20:18.285052+0000","last_peered":"2024-09-17T02:20:18.285052+0000","last_clean":"2024-09-17T02:20:18.285052+0000","last_became_active":"2024-09-17T02:20:16.562564+0000","last_became_peered":"2024-09-17T02:20:16.562564+0000","last_unstale":"2024-09-17T02:20:18.285052+0000","last_undegraded":"2024-09-17T02:20:18.285052+0000","last_fullsized":"2024-09-17T02:20:18.285052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:10.932999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287608+0000","last_change":"2024-09-17T02:20:16.573189+0000","last_active":"2024-09-17T02:20:18.287608+0000","last_peered":"2024-09-17T02:20:18.287608+0000","last_clean":"2024-09-17T02:20:18.287608+0000","last_became_active":"2024-09-17T02:20:16.570669+0000","last_became_peered":"2024-09-17T02:20:16.570669+0000","last_unstale":"2024-09-17T02:20:18.287608+0000","last_undegraded":"2024-09-17T02:20:18.287608+0000","last_fullsized":"2024-09-17T02:20:18.287608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:52.753219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560314+0000","last_change":"2024-09-17T02:20:16.581076+0000","last_active":"2024-09-17T02:20:17.560314+0000","last_peered":"2024-09-17T02:20:17.560314+0000","last_clean":"2024-09-17T02:20:17.560314+0000","last_became_active":"2024-09-17T02:20:16.579989+0000","last_became_peered":"2024-09-17T02:20:16.579989+0000","last_unstale":"2024-09-17T02:20:17.560314+0000","last_undegraded":"2024-09-17T02:20:17.560314+0000","last_fullsized":"2024-09-17T02:20:17.560314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:43.454908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561562+0000","last_change":"2024-09-17T02:20:16.582808+0000","last_active":"2024-09-17T02:20:17.561562+0000","last_peered":"2024-09-17T02:20:17.561562+0000","last_clean":"2024-09-17T02:20:17.561562+0000","last_became_active":"2024-09-17T02:20:16.581358+0000","last_became_peered":"2024-09-17T02:20:16.581358+0000","last_unstale":"2024-09-17T02:20:17.561562+0000","last_undegraded":"2024-09-17T02:20:17.561562+0000","last_fullsized":"2024-09-17T02:20:17.561562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:26.441162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287997+0000","last_change":"2024-09-17T02:20:16.583361+0000","last_active":"2024-09-17T02:20:18.287997+0000","last_peered":"2024-09-17T02:20:18.287997+0000","last_clean":"2024-09-17T02:20:18.287997+0000","last_became_active":"2024-09-17T02:20:16.579817+0000","last_became_peered":"2024-09-17T02:20:16.579817+0000","last_unstale":"2024-09-17T02:20:18.287997+0000","last_undegraded":"2024-09-17T02:20:18.287997+0000","last_fullsized":"2024-09-17T02:20:18.287997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:54.029860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559128+0000","last_change":"2024-09-17T02:20:16.581125+0000","last_active":"2024-09-17T02:20:17.559128+0000","last_peered":"2024-09-17T02:20:17.559128+0000","last_clean":"2024-09-17T02:20:17.559128+0000","last_became_active":"2024-09-17T02:20:16.580393+0000","last_became_peered":"2024-09-17T02:20:16.580393+0000","last_unstale":"2024-09-17T02:20:17.559128+0000","last_undegraded":"2024-09-17T02:20:17.559128+0000","last_fullsized":"2024-09-17T02:20:17.559128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:24.706394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286569+0000","last_change":"2024-09-17T02:20:16.565220+0000","last_active":"2024-09-17T02:20:18.286569+0000","last_peered":"2024-09-17T02:20:18.286569+0000","last_clean":"2024-09-17T02:20:18.286569+0000","last_became_active":"2024-09-17T02:20:16.562419+0000","last_became_peered":"2024-09-17T02:20:16.562419+0000","last_unstale":"2024-09-17T02:20:18.286569+0000","last_undegraded":"2024-09-17T02:20:18.286569+0000","last_fullsized":"2024-09-17T02:20:18.286569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:03.961277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.557946+0000","last_change":"2024-09-17T02:20:16.579408+0000","last_active":"2024-09-17T02:20:17.557946+0000","last_peered":"2024-09-17T02:20:17.557946+0000","last_clean":"2024-09-17T02:20:17.557946+0000","last_became_active":"2024-09-17T02:20:16.577202+0000","last_became_peered":"2024-09-17T02:20:16.577202+0000","last_unstale":"2024-09-17T02:20:17.557946+0000","last_undegraded":"2024-09-17T02:20:17.557946+0000","last_fullsized":"2024-09-17T02:20:17.557946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:20.414231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559533+0000","last_change":"2024-09-17T02:20:16.570810+0000","last_active":"2024-09-17T02:20:17.559533+0000","last_peered":"2024-09-17T02:20:17.559533+0000","last_clean":"2024-09-17T02:20:17.559533+0000","last_became_active":"2024-09-17T02:20:16.569273+0000","last_became_peered":"2024-09-17T02:20:16.569273+0000","last_unstale":"2024-09-17T02:20:17.559533+0000","last_undegraded":"2024-09-17T02:20:17.559533+0000","last_fullsized":"2024-09-17T02:20:17.559533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:42.123535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287137+0000","last_change":"2024-09-17T02:20:16.572798+0000","last_active":"2024-09-17T02:20:18.287137+0000","last_peered":"2024-09-17T02:20:18.287137+0000","last_clean":"2024-09-17T02:20:18.287137+0000","last_became_active":"2024-09-17T02:20:16.571174+0000","last_became_peered":"2024-09-17T02:20:16.571174+0000","last_unstale":"2024-09-17T02:20:18.287137+0000","last_undegraded":"2024-09-17T02:20:18.287137+0000","last_fullsized":"2024-09-17T02:20:18.287137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:00.116621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561420+0000","last_change":"2024-09-17T02:20:15.559935+0000","last_active":"2024-09-17T02:20:17.561420+0000","last_peered":"2024-09-17T02:20:17.561420+0000","last_clean":"2024-09-17T02:20:17.561420+0000","last_became_active":"2024-09-17T02:20:15.559413+0000","last_became_peered":"2024-09-17T02:20:15.559413+0000","last_unstale":"2024-09-17T02:20:17.561420+0000","last_undegraded":"2024-09-17T02:20:17.561420+0000","last_fullsized":"2024-09-17T02:20:17.561420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:52.985837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287177+0000","last_change":"2024-09-17T02:20:16.581819+0000","last_active":"2024-09-17T02:20:18.287177+0000","last_peered":"2024-09-17T02:20:18.287177+0000","last_clean":"2024-09-17T02:20:18.287177+0000","last_became_active":"2024-09-17T02:20:16.577168+0000","last_became_peered":"2024-09-17T02:20:16.577168+0000","last_unstale":"2024-09-17T02:20:18.287177+0000","last_undegraded":"2024-09-17T02:20:18.287177+0000","last_fullsized":"2024-09-17T02:20:18.287177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:47.756576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558392+0000","last_change":"2024-09-17T02:20:15.550890+0000","last_active":"2024-09-17T02:20:17.558392+0000","last_peered":"2024-09-17T02:20:17.558392+0000","last_clean":"2024-09-17T02:20:17.558392+0000","last_became_active":"2024-09-17T02:20:15.550077+0000","last_became_peered":"2024-09-17T02:20:15.550077+0000","last_unstale":"2024-09-17T02:20:17.558392+0000","last_undegraded":"2024-09-17T02:20:17.558392+0000","last_fullsized":"2024-09-17T02:20:17.558392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:36.119249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560885+0000","last_change":"2024-09-17T02:20:16.581457+0000","last_active":"2024-09-17T02:20:17.560885+0000","last_peered":"2024-09-17T02:20:17.560885+0000","last_clean":"2024-09-17T02:20:17.560885+0000","last_became_active":"2024-09-17T02:20:16.579428+0000","last_became_peered":"2024-09-17T02:20:16.579428+0000","last_unstale":"2024-09-17T02:20:17.560885+0000","last_undegraded":"2024-09-17T02:20:17.560885+0000","last_fullsized":"2024-09-17T02:20:17.560885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:55.083688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285758+0000","last_change":"2024-09-17T02:20:15.569442+0000","last_active":"2024-09-17T02:20:18.285758+0000","last_peered":"2024-09-17T02:20:18.285758+0000","last_clean":"2024-09-17T02:20:18.285758+0000","last_became_active":"2024-09-17T02:20:15.567946+0000","last_became_peered":"2024-09-17T02:20:15.567946+0000","last_unstale":"2024-09-17T02:20:18.285758+0000","last_undegraded":"2024-09-17T02:20:18.285758+0000","last_fullsized":"2024-09-17T02:20:18.285758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:55.866388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559959+0000","last_change":"2024-09-17T02:20:16.579779+0000","last_active":"2024-09-17T02:20:17.559959+0000","last_peered":"2024-09-17T02:20:17.559959+0000","last_clean":"2024-09-17T02:20:17.559959+0000","last_became_active":"2024-09-17T02:20:16.576734+0000","last_became_peered":"2024-09-17T02:20:16.576734+0000","last_unstale":"2024-09-17T02:20:17.559959+0000","last_undegraded":"2024-09-17T02:20:17.559959+0000","last_fullsized":"2024-09-17T02:20:17.559959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:26.782410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559862+0000","last_change":"2024-09-17T02:20:15.559245+0000","last_active":"2024-09-17T02:20:17.559862+0000","last_peered":"2024-09-17T02:20:17.559862+0000","last_clean":"2024-09-17T02:20:17.559862+0000","last_became_active":"2024-09-17T02:20:15.558518+0000","last_became_peered":"2024-09-17T02:20:15.558518+0000","last_unstale":"2024-09-17T02:20:17.559862+0000","last_undegraded":"2024-09-17T02:20:17.559862+0000","last_fullsized":"2024-09-17T02:20:17.559862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:52.783635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561043+0000","last_change":"2024-09-17T02:20:15.559110+0000","last_active":"2024-09-17T02:20:17.561043+0000","last_peered":"2024-09-17T02:20:17.561043+0000","last_clean":"2024-09-17T02:20:17.561043+0000","last_became_active":"2024-09-17T02:20:15.558285+0000","last_became_peered":"2024-09-17T02:20:15.558285+0000","last_unstale":"2024-09-17T02:20:17.561043+0000","last_undegraded":"2024-09-17T02:20:17.561043+0000","last_fullsized":"2024-09-17T02:20:17.561043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:15.782658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285013+0000","last_change":"2024-09-17T02:20:16.584359+0000","last_active":"2024-09-17T02:20:18.285013+0000","last_peered":"2024-09-17T02:20:18.285013+0000","last_clean":"2024-09-17T02:20:18.285013+0000","last_became_active":"2024-09-17T02:20:16.582303+0000","last_became_peered":"2024-09-17T02:20:16.582303+0000","last_unstale":"2024-09-17T02:20:18.285013+0000","last_undegraded":"2024-09-17T02:20:18.285013+0000","last_fullsized":"2024-09-17T02:20:18.285013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:12.345284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287762+0000","last_change":"2024-09-17T02:20:15.568414+0000","last_active":"2024-09-17T02:20:18.287762+0000","last_peered":"2024-09-17T02:20:18.287762+0000","last_clean":"2024-09-17T02:20:18.287762+0000","last_became_active":"2024-09-17T02:20:15.567596+0000","last_became_peered":"2024-09-17T02:20:15.567596+0000","last_unstale":"2024-09-17T02:20:18.287762+0000","last_undegraded":"2024-09-17T02:20:18.287762+0000","last_fullsized":"2024-09-17T02:20:18.287762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:11.356699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285690+0000","last_change":"2024-09-17T02:20:16.565402+0000","last_active":"2024-09-17T02:20:18.285690+0000","last_peered":"2024-09-17T02:20:18.285690+0000","last_clean":"2024-09-17T02:20:18.285690+0000","last_became_active":"2024-09-17T02:20:16.563113+0000","last_became_peered":"2024-09-17T02:20:16.563113+0000","last_unstale":"2024-09-17T02:20:18.285690+0000","last_undegraded":"2024-09-17T02:20:18.285690+0000","last_fullsized":"2024-09-17T02:20:18.285690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:38:36.115641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.562269+0000","last_change":"2024-09-17T02:20:15.559767+0000","last_active":"2024-09-17T02:20:17.562269+0000","last_peered":"2024-09-17T02:20:17.562269+0000","last_clean":"2024-09-17T02:20:17.562269+0000","last_became_active":"2024-09-17T02:20:15.558888+0000","last_became_peered":"2024-09-17T02:20:15.558888+0000","last_unstale":"2024-09-17T02:20:17.562269+0000","last_undegraded":"2024-09-17T02:20:17.562269+0000","last_fullsized":"2024-09-17T02:20:17.562269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:09.831510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559986+0000","last_change":"2024-09-17T02:20:16.565632+0000","last_active":"2024-09-17T02:20:17.559986+0000","last_peered":"2024-09-17T02:20:17.559986+0000","last_clean":"2024-09-17T02:20:17.559986+0000","last_became_active":"2024-09-17T02:20:16.563630+0000","last_became_peered":"2024-09-17T02:20:16.563630+0000","last_unstale":"2024-09-17T02:20:17.559986+0000","last_undegraded":"2024-09-17T02:20:17.559986+0000","last_fullsized":"2024-09-17T02:20:17.559986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:05.049317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.562156+0000","last_change":"2024-09-17T02:20:15.562539+0000","last_active":"2024-09-17T02:20:17.562156+0000","last_peered":"2024-09-17T02:20:17.562156+0000","last_clean":"2024-09-17T02:20:17.562156+0000","last_became_active":"2024-09-17T02:20:15.561801+0000","last_became_peered":"2024-09-17T02:20:15.561801+0000","last_unstale":"2024-09-17T02:20:17.562156+0000","last_undegraded":"2024-09-17T02:20:17.562156+0000","last_fullsized":"2024-09-17T02:20:17.562156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:15.848081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559360+0000","last_change":"2024-09-17T02:20:16.578474+0000","last_active":"2024-09-17T02:20:17.559360+0000","last_peered":"2024-09-17T02:20:17.559360+0000","last_clean":"2024-09-17T02:20:17.559360+0000","last_became_active":"2024-09-17T02:20:16.576264+0000","last_became_peered":"2024-09-17T02:20:16.576264+0000","last_unstale":"2024-09-17T02:20:17.559360+0000","last_undegraded":"2024-09-17T02:20:17.559360+0000","last_fullsized":"2024-09-17T02:20:17.559360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:48.313282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559626+0000","last_change":"2024-09-17T02:20:15.551986+0000","last_active":"2024-09-17T02:20:17.559626+0000","last_peered":"2024-09-17T02:20:17.559626+0000","last_clean":"2024-09-17T02:20:17.559626+0000","last_became_active":"2024-09-17T02:20:15.550418+0000","last_became_peered":"2024-09-17T02:20:15.550418+0000","last_unstale":"2024-09-17T02:20:17.559626+0000","last_undegraded":"2024-09-17T02:20:17.559626+0000","last_fullsized":"2024-09-17T02:20:17.559626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:17.866665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561875+0000","last_change":"2024-09-17T02:20:16.570845+0000","last_active":"2024-09-17T02:20:17.561875+0000","last_peered":"2024-09-17T02:20:17.561875+0000","last_clean":"2024-09-17T02:20:17.561875+0000","last_became_active":"2024-09-17T02:20:16.568862+0000","last_became_peered":"2024-09-17T02:20:16.568862+0000","last_unstale":"2024-09-17T02:20:17.561875+0000","last_undegraded":"2024-09-17T02:20:17.561875+0000","last_fullsized":"2024-09-17T02:20:17.561875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:30.715391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560696+0000","last_change":"2024-09-17T02:20:15.559849+0000","last_active":"2024-09-17T02:20:17.560696+0000","last_peered":"2024-09-17T02:20:17.560696+0000","last_clean":"2024-09-17T02:20:17.560696+0000","last_became_active":"2024-09-17T02:20:15.559431+0000","last_became_peered":"2024-09-17T02:20:15.559431+0000","last_unstale":"2024-09-17T02:20:17.560696+0000","last_undegraded":"2024-09-17T02:20:17.560696+0000","last_fullsized":"2024-09-17T02:20:17.560696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:31.933850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561999+0000","last_change":"2024-09-17T02:20:16.586434+0000","last_active":"2024-09-17T02:20:17.561999+0000","last_peered":"2024-09-17T02:20:17.561999+0000","last_clean":"2024-09-17T02:20:17.561999+0000","last_became_active":"2024-09-17T02:20:16.585466+0000","last_became_peered":"2024-09-17T02:20:16.585466+0000","last_unstale":"2024-09-17T02:20:17.561999+0000","last_undegraded":"2024-09-17T02:20:17.561999+0000","last_fullsized":"2024-09-17T02:20:17.561999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:57:29.891850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286282+0000","last_change":"2024-09-17T02:20:15.568506+0000","last_active":"2024-09-17T02:20:18.286282+0000","last_peered":"2024-09-17T02:20:18.286282+0000","last_clean":"2024-09-17T02:20:18.286282+0000","last_became_active":"2024-09-17T02:20:15.567720+0000","last_became_peered":"2024-09-17T02:20:15.567720+0000","last_unstale":"2024-09-17T02:20:18.286282+0000","last_undegraded":"2024-09-17T02:20:18.286282+0000","last_fullsized":"2024-09-17T02:20:18.286282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:46.560153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560661+0000","last_change":"2024-09-17T02:20:16.582353+0000","last_active":"2024-09-17T02:20:17.560661+0000","last_peered":"2024-09-17T02:20:17.560661+0000","last_clean":"2024-09-17T02:20:17.560661+0000","last_became_active":"2024-09-17T02:20:16.581462+0000","last_became_peered":"2024-09-17T02:20:16.581462+0000","last_unstale":"2024-09-17T02:20:17.560661+0000","last_undegraded":"2024-09-17T02:20:17.560661+0000","last_fullsized":"2024-09-17T02:20:17.560661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:44.023284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285391+0000","last_change":"2024-09-17T02:20:15.565444+0000","last_active":"2024-09-17T02:20:18.285391+0000","last_peered":"2024-09-17T02:20:18.285391+0000","last_clean":"2024-09-17T02:20:18.285391+0000","last_became_active":"2024-09-17T02:20:15.564640+0000","last_became_peered":"2024-09-17T02:20:15.564640+0000","last_unstale":"2024-09-17T02:20:18.285391+0000","last_undegraded":"2024-09-17T02:20:18.285391+0000","last_fullsized":"2024-09-17T02:20:18.285391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:29.214563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560331+0000","last_change":"2024-09-17T02:20:16.583084+0000","last_active":"2024-09-17T02:20:17.560331+0000","last_peered":"2024-09-17T02:20:17.560331+0000","last_clean":"2024-09-17T02:20:17.560331+0000","last_became_active":"2024-09-17T02:20:16.582326+0000","last_became_peered":"2024-09-17T02:20:16.582326+0000","last_unstale":"2024-09-17T02:20:17.560331+0000","last_undegraded":"2024-09-17T02:20:17.560331+0000","last_fullsized":"2024-09-17T02:20:17.560331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:05.049317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":224,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560852+0000","last_change":"2024-09-17T02:20:04.612894+0000","last_active":"2024-09-17T02:20:17.560852+0000","last_peered":"2024-09-17T02:20:17.560852+0000","last_clean":"2024-09-17T02:20:17.560852+0000","last_became_active":"2024-09-17T02:20:04.610517+0000","last_became_peered":"2024-09-17T02:20:04.610517+0000","last_unstale":"2024-09-17T02:20:17.560852+0000","last_undegraded":"2024-09-17T02:20:17.560852+0000","last_fullsized":"2024-09-17T02:20:17.560852+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_clean_scrub_stamp":"2024-09-17T02:20:03.432050+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:51.879303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":28,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561660+0000","last_change":"2024-09-17T02:20:12.513513+0000","last_active":"2024-09-17T02:20:17.561660+0000","last_peered":"2024-09-17T02:20:17.561660+0000","last_clean":"2024-09-17T02:20:17.561660+0000","last_became_active":"2024-09-17T02:20:10.504616+0000","last_became_peered":"2024-09-17T02:20:10.504616+0000","last_unstale":"2024-09-17T02:20:17.561660+0000","last_undegraded":"2024-09-17T02:20:17.561660+0000","last_fullsized":"2024-09-17T02:20:17.561660+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:13.341611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001517832,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558593+0000","last_change":"2024-09-17T02:20:15.560646+0000","last_active":"2024-09-17T02:20:17.558593+0000","last_peered":"2024-09-17T02:20:17.558593+0000","last_clean":"2024-09-17T02:20:17.558593+0000","last_became_active":"2024-09-17T02:20:15.559104+0000","last_became_peered":"2024-09-17T02:20:15.559104+0000","last_unstale":"2024-09-17T02:20:17.558593+0000","last_undegraded":"2024-09-17T02:20:17.558593+0000","last_fullsized":"2024-09-17T02:20:17.558593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:44.299986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.562163+0000","last_change":"2024-09-17T02:20:16.585522+0000","last_active":"2024-09-17T02:20:17.562163+0000","last_peered":"2024-09-17T02:20:17.562163+0000","last_clean":"2024-09-17T02:20:17.562163+0000","last_became_active":"2024-09-17T02:20:16.584520+0000","last_became_peered":"2024-09-17T02:20:16.584520+0000","last_unstale":"2024-09-17T02:20:17.562163+0000","last_undegraded":"2024-09-17T02:20:17.562163+0000","last_fullsized":"2024-09-17T02:20:17.562163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:14.123192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560572+0000","last_change":"2024-09-17T02:20:12.512798+0000","last_active":"2024-09-17T02:20:17.560572+0000","last_peered":"2024-09-17T02:20:17.560572+0000","last_clean":"2024-09-17T02:20:17.560572+0000","last_became_active":"2024-09-17T02:20:10.502115+0000","last_became_peered":"2024-09-17T02:20:10.502115+0000","last_unstale":"2024-09-17T02:20:17.560572+0000","last_undegraded":"2024-09-17T02:20:17.560572+0000","last_fullsized":"2024-09-17T02:20:17.560572+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:17.554878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083467700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558499+0000","last_change":"2024-09-17T02:20:15.551632+0000","last_active":"2024-09-17T02:20:17.558499+0000","last_peered":"2024-09-17T02:20:17.558499+0000","last_clean":"2024-09-17T02:20:17.558499+0000","last_became_active":"2024-09-17T02:20:15.551062+0000","last_became_peered":"2024-09-17T02:20:15.551062+0000","last_unstale":"2024-09-17T02:20:17.558499+0000","last_undegraded":"2024-09-17T02:20:17.558499+0000","last_fullsized":"2024-09-17T02:20:17.558499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:55.295518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287261+0000","last_change":"2024-09-17T02:20:16.571568+0000","last_active":"2024-09-17T02:20:18.287261+0000","last_peered":"2024-09-17T02:20:18.287261+0000","last_clean":"2024-09-17T02:20:18.287261+0000","last_became_active":"2024-09-17T02:20:16.570622+0000","last_became_peered":"2024-09-17T02:20:16.570622+0000","last_unstale":"2024-09-17T02:20:18.287261+0000","last_undegraded":"2024-09-17T02:20:18.287261+0000","last_fullsized":"2024-09-17T02:20:18.287261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:57.083446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558959+0000","last_change":"2024-09-17T02:20:12.511823+0000","last_active":"2024-09-17T02:20:17.558959+0000","last_peered":"2024-09-17T02:20:17.558959+0000","last_clean":"2024-09-17T02:20:17.558959+0000","last_became_active":"2024-09-17T02:20:10.497164+0000","last_became_peered":"2024-09-17T02:20:10.497164+0000","last_unstale":"2024-09-17T02:20:17.558959+0000","last_undegraded":"2024-09-17T02:20:17.558959+0000","last_fullsized":"2024-09-17T02:20:17.558959+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:21.242753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081052700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285368+0000","last_change":"2024-09-17T02:20:15.569475+0000","last_active":"2024-09-17T02:20:18.285368+0000","last_peered":"2024-09-17T02:20:18.285368+0000","last_clean":"2024-09-17T02:20:18.285368+0000","last_became_active":"2024-09-17T02:20:15.567965+0000","last_became_peered":"2024-09-17T02:20:15.567965+0000","last_unstale":"2024-09-17T02:20:18.285368+0000","last_undegraded":"2024-09-17T02:20:18.285368+0000","last_fullsized":"2024-09-17T02:20:18.285368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:06.649112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560384+0000","last_change":"2024-09-17T02:20:16.578902+0000","last_active":"2024-09-17T02:20:17.560384+0000","last_peered":"2024-09-17T02:20:17.560384+0000","last_clean":"2024-09-17T02:20:17.560384+0000","last_became_active":"2024-09-17T02:20:16.576512+0000","last_became_peered":"2024-09-17T02:20:16.576512+0000","last_unstale":"2024-09-17T02:20:17.560384+0000","last_undegraded":"2024-09-17T02:20:17.560384+0000","last_fullsized":"2024-09-17T02:20:17.560384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:29.757455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560859+0000","last_change":"2024-09-17T02:20:12.512742+0000","last_active":"2024-09-17T02:20:17.560859+0000","last_peered":"2024-09-17T02:20:17.560859+0000","last_clean":"2024-09-17T02:20:17.560859+0000","last_became_active":"2024-09-17T02:20:10.503622+0000","last_became_peered":"2024-09-17T02:20:10.503622+0000","last_unstale":"2024-09-17T02:20:17.560859+0000","last_undegraded":"2024-09-17T02:20:17.560859+0000","last_fullsized":"2024-09-17T02:20:17.560859+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:36.226043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078085399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561586+0000","last_change":"2024-09-17T02:20:15.562840+0000","last_active":"2024-09-17T02:20:17.561586+0000","last_peered":"2024-09-17T02:20:17.561586+0000","last_clean":"2024-09-17T02:20:17.561586+0000","last_became_active":"2024-09-17T02:20:15.562177+0000","last_became_peered":"2024-09-17T02:20:15.562177+0000","last_unstale":"2024-09-17T02:20:17.561586+0000","last_undegraded":"2024-09-17T02:20:17.561586+0000","last_fullsized":"2024-09-17T02:20:17.561586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:39.709524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559748+0000","last_change":"2024-09-17T02:20:16.580184+0000","last_active":"2024-09-17T02:20:17.559748+0000","last_peered":"2024-09-17T02:20:17.559748+0000","last_clean":"2024-09-17T02:20:17.559748+0000","last_became_active":"2024-09-17T02:20:16.578343+0000","last_became_peered":"2024-09-17T02:20:16.578343+0000","last_unstale":"2024-09-17T02:20:17.559748+0000","last_undegraded":"2024-09-17T02:20:17.559748+0000","last_fullsized":"2024-09-17T02:20:17.559748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:42.123535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.562400+0000","last_change":"2024-09-17T02:20:15.562922+0000","last_active":"2024-09-17T02:20:17.562400+0000","last_peered":"2024-09-17T02:20:17.562400+0000","last_clean":"2024-09-17T02:20:17.562400+0000","last_became_active":"2024-09-17T02:20:15.562138+0000","last_became_peered":"2024-09-17T02:20:15.562138+0000","last_unstale":"2024-09-17T02:20:17.562400+0000","last_undegraded":"2024-09-17T02:20:17.562400+0000","last_fullsized":"2024-09-17T02:20:17.562400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:00.819275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559993+0000","last_change":"2024-09-17T02:20:12.511838+0000","last_active":"2024-09-17T02:20:17.559993+0000","last_peered":"2024-09-17T02:20:17.559993+0000","last_clean":"2024-09-17T02:20:17.559993+0000","last_became_active":"2024-09-17T02:20:10.497049+0000","last_became_peered":"2024-09-17T02:20:10.497049+0000","last_unstale":"2024-09-17T02:20:17.559993+0000","last_undegraded":"2024-09-17T02:20:17.559993+0000","last_fullsized":"2024-09-17T02:20:17.559993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:54.446484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079701100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286426+0000","last_change":"2024-09-17T02:20:16.571485+0000","last_active":"2024-09-17T02:20:18.286426+0000","last_peered":"2024-09-17T02:20:18.286426+0000","last_clean":"2024-09-17T02:20:18.286426+0000","last_became_active":"2024-09-17T02:20:16.567570+0000","last_became_peered":"2024-09-17T02:20:16.567570+0000","last_unstale":"2024-09-17T02:20:18.286426+0000","last_undegraded":"2024-09-17T02:20:18.286426+0000","last_fullsized":"2024-09-17T02:20:18.286426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:14.228385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559752+0000","last_change":"2024-09-17T02:20:15.559252+0000","last_active":"2024-09-17T02:20:17.559752+0000","last_peered":"2024-09-17T02:20:17.559752+0000","last_clean":"2024-09-17T02:20:17.559752+0000","last_became_active":"2024-09-17T02:20:15.557667+0000","last_became_peered":"2024-09-17T02:20:15.557667+0000","last_unstale":"2024-09-17T02:20:17.559752+0000","last_undegraded":"2024-09-17T02:20:17.559752+0000","last_fullsized":"2024-09-17T02:20:17.559752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:01.292626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287685+0000","last_change":"2024-09-17T02:20:12.661034+0000","last_active":"2024-09-17T02:20:18.287685+0000","last_peered":"2024-09-17T02:20:18.287685+0000","last_clean":"2024-09-17T02:20:18.287685+0000","last_became_active":"2024-09-17T02:20:10.497829+0000","last_became_peered":"2024-09-17T02:20:10.497829+0000","last_unstale":"2024-09-17T02:20:18.287685+0000","last_undegraded":"2024-09-17T02:20:18.287685+0000","last_fullsized":"2024-09-17T02:20:18.287685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:46:27.427685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096944700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286097+0000","last_change":"2024-09-17T02:20:16.579478+0000","last_active":"2024-09-17T02:20:18.286097+0000","last_peered":"2024-09-17T02:20:18.286097+0000","last_clean":"2024-09-17T02:20:18.286097+0000","last_became_active":"2024-09-17T02:20:16.578705+0000","last_became_peered":"2024-09-17T02:20:16.578705+0000","last_unstale":"2024-09-17T02:20:18.286097+0000","last_undegraded":"2024-09-17T02:20:18.286097+0000","last_fullsized":"2024-09-17T02:20:18.286097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:21.656908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561074+0000","last_change":"2024-09-17T02:20:15.558961+0000","last_active":"2024-09-17T02:20:17.561074+0000","last_peered":"2024-09-17T02:20:17.561074+0000","last_clean":"2024-09-17T02:20:17.561074+0000","last_became_active":"2024-09-17T02:20:15.558299+0000","last_became_peered":"2024-09-17T02:20:15.558299+0000","last_unstale":"2024-09-17T02:20:17.561074+0000","last_undegraded":"2024-09-17T02:20:17.561074+0000","last_fullsized":"2024-09-17T02:20:17.561074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:39.709524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561104+0000","last_change":"2024-09-17T02:20:12.512481+0000","last_active":"2024-09-17T02:20:17.561104+0000","last_peered":"2024-09-17T02:20:17.561104+0000","last_clean":"2024-09-17T02:20:17.561104+0000","last_became_active":"2024-09-17T02:20:10.497021+0000","last_became_peered":"2024-09-17T02:20:10.497021+0000","last_unstale":"2024-09-17T02:20:17.561104+0000","last_undegraded":"2024-09-17T02:20:17.561104+0000","last_fullsized":"2024-09-17T02:20:17.561104+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:41.167283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001400079,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558440+0000","last_change":"2024-09-17T02:20:16.560687+0000","last_active":"2024-09-17T02:20:17.558440+0000","last_peered":"2024-09-17T02:20:17.558440+0000","last_clean":"2024-09-17T02:20:17.558440+0000","last_became_active":"2024-09-17T02:20:16.559758+0000","last_became_peered":"2024-09-17T02:20:16.559758+0000","last_unstale":"2024-09-17T02:20:17.558440+0000","last_undegraded":"2024-09-17T02:20:17.558440+0000","last_fullsized":"2024-09-17T02:20:17.558440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:54:33.088375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560971+0000","last_change":"2024-09-17T02:20:15.551758+0000","last_active":"2024-09-17T02:20:17.560971+0000","last_peered":"2024-09-17T02:20:17.560971+0000","last_clean":"2024-09-17T02:20:17.560971+0000","last_became_active":"2024-09-17T02:20:15.550353+0000","last_became_peered":"2024-09-17T02:20:15.550353+0000","last_unstale":"2024-09-17T02:20:17.560971+0000","last_undegraded":"2024-09-17T02:20:17.560971+0000","last_fullsized":"2024-09-17T02:20:17.560971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:04.229911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561418+0000","last_change":"2024-09-17T02:20:12.513530+0000","last_active":"2024-09-17T02:20:17.561418+0000","last_peered":"2024-09-17T02:20:17.561418+0000","last_clean":"2024-09-17T02:20:17.561418+0000","last_became_active":"2024-09-17T02:20:10.502692+0000","last_became_peered":"2024-09-17T02:20:10.502692+0000","last_unstale":"2024-09-17T02:20:17.561418+0000","last_undegraded":"2024-09-17T02:20:17.561418+0000","last_fullsized":"2024-09-17T02:20:17.561418+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:53.004641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015329009999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.285205+0000","last_change":"2024-09-17T02:20:16.575882+0000","last_active":"2024-09-17T02:20:18.285205+0000","last_peered":"2024-09-17T02:20:18.285205+0000","last_clean":"2024-09-17T02:20:18.285205+0000","last_became_active":"2024-09-17T02:20:16.573968+0000","last_became_peered":"2024-09-17T02:20:16.573968+0000","last_unstale":"2024-09-17T02:20:18.285205+0000","last_undegraded":"2024-09-17T02:20:18.285205+0000","last_fullsized":"2024-09-17T02:20:18.285205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:18.090082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560482+0000","last_change":"2024-09-17T02:20:16.582881+0000","last_active":"2024-09-17T02:20:17.560482+0000","last_peered":"2024-09-17T02:20:17.560482+0000","last_clean":"2024-09-17T02:20:17.560482+0000","last_became_active":"2024-09-17T02:20:16.580985+0000","last_became_peered":"2024-09-17T02:20:16.580985+0000","last_unstale":"2024-09-17T02:20:17.560482+0000","last_undegraded":"2024-09-17T02:20:17.560482+0000","last_fullsized":"2024-09-17T02:20:17.560482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:10.315951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.562026+0000","last_change":"2024-09-17T02:20:15.558925+0000","last_active":"2024-09-17T02:20:17.562026+0000","last_peered":"2024-09-17T02:20:17.562026+0000","last_clean":"2024-09-17T02:20:17.562026+0000","last_became_active":"2024-09-17T02:20:15.558174+0000","last_became_peered":"2024-09-17T02:20:15.558174+0000","last_unstale":"2024-09-17T02:20:17.562026+0000","last_undegraded":"2024-09-17T02:20:17.562026+0000","last_fullsized":"2024-09-17T02:20:17.562026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:55.639841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558215+0000","last_change":"2024-09-17T02:20:16.579411+0000","last_active":"2024-09-17T02:20:17.558215+0000","last_peered":"2024-09-17T02:20:17.558215+0000","last_clean":"2024-09-17T02:20:17.558215+0000","last_became_active":"2024-09-17T02:20:16.576294+0000","last_became_peered":"2024-09-17T02:20:16.576294+0000","last_unstale":"2024-09-17T02:20:17.558215+0000","last_undegraded":"2024-09-17T02:20:17.558215+0000","last_fullsized":"2024-09-17T02:20:17.558215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:41:31.822425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287526+0000","last_change":"2024-09-17T02:20:15.569117+0000","last_active":"2024-09-17T02:20:18.287526+0000","last_peered":"2024-09-17T02:20:18.287526+0000","last_clean":"2024-09-17T02:20:18.287526+0000","last_became_active":"2024-09-17T02:20:15.567405+0000","last_became_peered":"2024-09-17T02:20:15.567405+0000","last_unstale":"2024-09-17T02:20:18.287526+0000","last_undegraded":"2024-09-17T02:20:18.287526+0000","last_fullsized":"2024-09-17T02:20:18.287526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:55:10.186481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561160+0000","last_change":"2024-09-17T02:20:15.562827+0000","last_active":"2024-09-17T02:20:17.561160+0000","last_peered":"2024-09-17T02:20:17.561160+0000","last_clean":"2024-09-17T02:20:17.561160+0000","last_became_active":"2024-09-17T02:20:15.562073+0000","last_became_peered":"2024-09-17T02:20:15.562073+0000","last_unstale":"2024-09-17T02:20:17.561160+0000","last_undegraded":"2024-09-17T02:20:17.561160+0000","last_fullsized":"2024-09-17T02:20:17.561160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:17.866665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558226+0000","last_change":"2024-09-17T02:20:16.577670+0000","last_active":"2024-09-17T02:20:17.558226+0000","last_peered":"2024-09-17T02:20:17.558226+0000","last_clean":"2024-09-17T02:20:17.558226+0000","last_became_active":"2024-09-17T02:20:16.575082+0000","last_became_peered":"2024-09-17T02:20:16.575082+0000","last_unstale":"2024-09-17T02:20:17.558226+0000","last_undegraded":"2024-09-17T02:20:17.558226+0000","last_fullsized":"2024-09-17T02:20:17.558226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:21.356437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560821+0000","last_change":"2024-09-17T02:20:15.555513+0000","last_active":"2024-09-17T02:20:17.560821+0000","last_peered":"2024-09-17T02:20:17.560821+0000","last_clean":"2024-09-17T02:20:17.560821+0000","last_became_active":"2024-09-17T02:20:15.554256+0000","last_became_peered":"2024-09-17T02:20:15.554256+0000","last_unstale":"2024-09-17T02:20:17.560821+0000","last_undegraded":"2024-09-17T02:20:17.560821+0000","last_fullsized":"2024-09-17T02:20:17.560821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:52.985837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558359+0000","last_change":"2024-09-17T02:20:16.577803+0000","last_active":"2024-09-17T02:20:17.558359+0000","last_peered":"2024-09-17T02:20:17.558359+0000","last_clean":"2024-09-17T02:20:17.558359+0000","last_became_active":"2024-09-17T02:20:16.576640+0000","last_became_peered":"2024-09-17T02:20:16.576640+0000","last_unstale":"2024-09-17T02:20:17.558359+0000","last_undegraded":"2024-09-17T02:20:17.558359+0000","last_fullsized":"2024-09-17T02:20:17.558359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:07.190169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.288014+0000","last_change":"2024-09-17T02:20:16.571738+0000","last_active":"2024-09-17T02:20:18.288014+0000","last_peered":"2024-09-17T02:20:18.288014+0000","last_clean":"2024-09-17T02:20:18.288014+0000","last_became_active":"2024-09-17T02:20:16.568615+0000","last_became_peered":"2024-09-17T02:20:16.568615+0000","last_unstale":"2024-09-17T02:20:18.288014+0000","last_undegraded":"2024-09-17T02:20:18.288014+0000","last_fullsized":"2024-09-17T02:20:18.288014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:42.931361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558692+0000","last_change":"2024-09-17T02:20:15.558467+0000","last_active":"2024-09-17T02:20:17.558692+0000","last_peered":"2024-09-17T02:20:17.558692+0000","last_clean":"2024-09-17T02:20:17.558692+0000","last_became_active":"2024-09-17T02:20:15.557186+0000","last_became_peered":"2024-09-17T02:20:15.557186+0000","last_unstale":"2024-09-17T02:20:17.558692+0000","last_undegraded":"2024-09-17T02:20:17.558692+0000","last_fullsized":"2024-09-17T02:20:17.558692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:56.879445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560355+0000","last_change":"2024-09-17T02:20:16.577527+0000","last_active":"2024-09-17T02:20:17.560355+0000","last_peered":"2024-09-17T02:20:17.560355+0000","last_clean":"2024-09-17T02:20:17.560355+0000","last_became_active":"2024-09-17T02:20:16.574761+0000","last_became_peered":"2024-09-17T02:20:16.574761+0000","last_unstale":"2024-09-17T02:20:17.560355+0000","last_undegraded":"2024-09-17T02:20:17.560355+0000","last_fullsized":"2024-09-17T02:20:17.560355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:43.309196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558428+0000","last_change":"2024-09-17T02:20:15.552417+0000","last_active":"2024-09-17T02:20:17.558428+0000","last_peered":"2024-09-17T02:20:17.558428+0000","last_clean":"2024-09-17T02:20:17.558428+0000","last_became_active":"2024-09-17T02:20:15.551609+0000","last_became_peered":"2024-09-17T02:20:15.551609+0000","last_unstale":"2024-09-17T02:20:17.558428+0000","last_undegraded":"2024-09-17T02:20:17.558428+0000","last_fullsized":"2024-09-17T02:20:17.558428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:15.782658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286869+0000","last_change":"2024-09-17T02:20:16.591978+0000","last_active":"2024-09-17T02:20:18.286869+0000","last_peered":"2024-09-17T02:20:18.286869+0000","last_clean":"2024-09-17T02:20:18.286869+0000","last_became_active":"2024-09-17T02:20:16.591378+0000","last_became_peered":"2024-09-17T02:20:16.591378+0000","last_unstale":"2024-09-17T02:20:18.286869+0000","last_undegraded":"2024-09-17T02:20:18.286869+0000","last_fullsized":"2024-09-17T02:20:18.286869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:44.489118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286792+0000","last_change":"2024-09-17T02:20:15.565262+0000","last_active":"2024-09-17T02:20:18.286792+0000","last_peered":"2024-09-17T02:20:18.286792+0000","last_clean":"2024-09-17T02:20:18.286792+0000","last_became_active":"2024-09-17T02:20:15.564415+0000","last_became_peered":"2024-09-17T02:20:15.564415+0000","last_unstale":"2024-09-17T02:20:18.286792+0000","last_undegraded":"2024-09-17T02:20:18.286792+0000","last_fullsized":"2024-09-17T02:20:18.286792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:42.049312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286398+0000","last_change":"2024-09-17T02:20:16.573407+0000","last_active":"2024-09-17T02:20:18.286398+0000","last_peered":"2024-09-17T02:20:18.286398+0000","last_clean":"2024-09-17T02:20:18.286398+0000","last_became_active":"2024-09-17T02:20:16.570987+0000","last_became_peered":"2024-09-17T02:20:16.570987+0000","last_unstale":"2024-09-17T02:20:18.286398+0000","last_undegraded":"2024-09-17T02:20:18.286398+0000","last_fullsized":"2024-09-17T02:20:18.286398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:23:09.424550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286401+0000","last_change":"2024-09-17T02:20:15.568883+0000","last_active":"2024-09-17T02:20:18.286401+0000","last_peered":"2024-09-17T02:20:18.286401+0000","last_clean":"2024-09-17T02:20:18.286401+0000","last_became_active":"2024-09-17T02:20:15.567980+0000","last_became_peered":"2024-09-17T02:20:15.567980+0000","last_unstale":"2024-09-17T02:20:18.286401+0000","last_undegraded":"2024-09-17T02:20:18.286401+0000","last_fullsized":"2024-09-17T02:20:18.286401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:04.059900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561194+0000","last_change":"2024-09-17T02:20:16.568209+0000","last_active":"2024-09-17T02:20:17.561194+0000","last_peered":"2024-09-17T02:20:17.561194+0000","last_clean":"2024-09-17T02:20:17.561194+0000","last_became_active":"2024-09-17T02:20:16.566585+0000","last_became_peered":"2024-09-17T02:20:16.566585+0000","last_unstale":"2024-09-17T02:20:17.561194+0000","last_undegraded":"2024-09-17T02:20:17.561194+0000","last_fullsized":"2024-09-17T02:20:17.561194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:44:59.713633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561836+0000","last_change":"2024-09-17T02:20:15.558296+0000","last_active":"2024-09-17T02:20:17.561836+0000","last_peered":"2024-09-17T02:20:17.561836+0000","last_clean":"2024-09-17T02:20:17.561836+0000","last_became_active":"2024-09-17T02:20:15.557520+0000","last_became_peered":"2024-09-17T02:20:15.557520+0000","last_unstale":"2024-09-17T02:20:17.561836+0000","last_undegraded":"2024-09-17T02:20:17.561836+0000","last_fullsized":"2024-09-17T02:20:17.561836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:04.229911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560569+0000","last_change":"2024-09-17T02:20:16.568334+0000","last_active":"2024-09-17T02:20:17.560569+0000","last_peered":"2024-09-17T02:20:17.560569+0000","last_clean":"2024-09-17T02:20:17.560569+0000","last_became_active":"2024-09-17T02:20:16.566982+0000","last_became_peered":"2024-09-17T02:20:16.566982+0000","last_unstale":"2024-09-17T02:20:17.560569+0000","last_undegraded":"2024-09-17T02:20:17.560569+0000","last_fullsized":"2024-09-17T02:20:17.560569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:55.083688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.287197+0000","last_change":"2024-09-17T02:20:15.569712+0000","last_active":"2024-09-17T02:20:18.287197+0000","last_peered":"2024-09-17T02:20:18.287197+0000","last_clean":"2024-09-17T02:20:18.287197+0000","last_became_active":"2024-09-17T02:20:15.569106+0000","last_became_peered":"2024-09-17T02:20:15.569106+0000","last_unstale":"2024-09-17T02:20:18.287197+0000","last_undegraded":"2024-09-17T02:20:18.287197+0000","last_fullsized":"2024-09-17T02:20:18.287197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:02.822970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:18.286608+0000","last_change":"2024-09-17T02:20:16.570456+0000","last_active":"2024-09-17T02:20:18.286608+0000","last_peered":"2024-09-17T02:20:18.286608+0000","last_clean":"2024-09-17T02:20:18.286608+0000","last_became_active":"2024-09-17T02:20:16.568095+0000","last_became_peered":"2024-09-17T02:20:16.568095+0000","last_unstale":"2024-09-17T02:20:18.286608+0000","last_undegraded":"2024-09-17T02:20:18.286608+0000","last_fullsized":"2024-09-17T02:20:18.286608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:58.329169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560601+0000","last_change":"2024-09-17T02:20:15.560293+0000","last_active":"2024-09-17T02:20:17.560601+0000","last_peered":"2024-09-17T02:20:17.560601+0000","last_clean":"2024-09-17T02:20:17.560601+0000","last_became_active":"2024-09-17T02:20:15.559074+0000","last_became_peered":"2024-09-17T02:20:15.559074+0000","last_unstale":"2024-09-17T02:20:17.560601+0000","last_undegraded":"2024-09-17T02:20:17.560601+0000","last_fullsized":"2024-09-17T02:20:17.560601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:55.639841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560319+0000","last_change":"2024-09-17T02:20:16.570950+0000","last_active":"2024-09-17T02:20:17.560319+0000","last_peered":"2024-09-17T02:20:17.560319+0000","last_clean":"2024-09-17T02:20:17.560319+0000","last_became_active":"2024-09-17T02:20:16.569496+0000","last_became_peered":"2024-09-17T02:20:16.569496+0000","last_unstale":"2024-09-17T02:20:17.560319+0000","last_undegraded":"2024-09-17T02:20:17.560319+0000","last_fullsized":"2024-09-17T02:20:17.560319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:29.757455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560576+0000","last_change":"2024-09-17T02:20:15.544675+0000","last_active":"2024-09-17T02:20:17.560576+0000","last_peered":"2024-09-17T02:20:17.560576+0000","last_clean":"2024-09-17T02:20:17.560576+0000","last_became_active":"2024-09-17T02:20:15.544213+0000","last_became_peered":"2024-09-17T02:20:15.544213+0000","last_unstale":"2024-09-17T02:20:17.560576+0000","last_undegraded":"2024-09-17T02:20:17.560576+0000","last_fullsized":"2024-09-17T02:20:17.560576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:31.933850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35600,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336240,"statfs":{"total":96636764160,"available":96600309760,"internally_reserved":0,"allocated":253952,"data_stored":654086,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":266240,"data_stored":654721,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":62559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T02:20:24.585 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T02:20:24.585 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T02:20:24.586 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-17T02:20:24.586 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T02:20:24.917 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:20:24.918 INFO:teuthology.orchestra.run.smithi001.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T02:20:24.935 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-17T02:20:24.935 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:20:25.251 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:20:25.252 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":6,"btime":"2024-09-17T02:20:19:554662+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:20:15.896969+0000","modified":"2024-09-17T02:20:18.924053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4207":{"gid":4207,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.1:6803/3107361006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3107361006},{"type":"v1","addr":"172.21.15.1:6803","nonce":3107361006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4207,"qdb_cluster":[4207]},"id":1}]} 2024-09-17T02:20:25.252 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 6 2024-09-17T02:20:25.269 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:20:25.587 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:20:25.587 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":6,"btime":"2024-09-17T02:20:19:554662+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:20:15.896969+0000","modified":"2024-09-17T02:20:18.924053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4207":{"gid":4207,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.1:6803/3107361006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3107361006},{"type":"v1","addr":"172.21.15.1:6803","nonce":3107361006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4207,"qdb_cluster":[4207]},"id":1}]} 2024-09-17T02:20:25.588 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 6 2024-09-17T02:20:25.605 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:20:25.887 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:20:25.888 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"fsid":"37cd4495-4915-41f4-bad2-2394cbe235f3","created":"2024-09-17T02:19:52.516342+0000","modified":"2024-09-17T02:20:22.420667+0000","last_up_change":"2024-09-17T02:20:02.422255+0000","last_in_change":"2024-09-17T02:19:54.329423+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:20:03.416336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T02:20:08.718296+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:20:13.566396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-17T02:20:14.902662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fae746a8-754d-4e52-9819-004ebb0d6886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6801","nonce":2347677104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6803","nonce":2347677104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6807","nonce":2347677104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6805","nonce":2347677104}]},"public_addr":"172.21.15.32:6801/2347677104","cluster_addr":"172.21.15.32:6803/2347677104","heartbeat_back_addr":"172.21.15.32:6807/2347677104","heartbeat_front_addr":"172.21.15.32:6805/2347677104","state":["exists","up"]},{"osd":1,"uuid":"c9397688-80ca-4c21-b80d-1740194c389d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6801","nonce":1905904204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6803","nonce":1905904204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6807","nonce":1905904204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6805","nonce":1905904204}]},"public_addr":"172.21.15.153:6801/1905904204","cluster_addr":"172.21.15.153:6803/1905904204","heartbeat_back_addr":"172.21.15.153:6807/1905904204","heartbeat_front_addr":"172.21.15.153:6805/1905904204","state":["exists","up"]},{"osd":2,"uuid":"6d8c01a8-b657-4abc-a624-2b35ef0512ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6801","nonce":603659517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6803","nonce":603659517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6807","nonce":603659517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":603659517},{"type":"v1","addr":"172.21.15.164:6805","nonce":603659517}]},"public_addr":"172.21.15.164:6801/603659517","cluster_addr":"172.21.15.164:6803/603659517","heartbeat_back_addr":"172.21.15.164:6807/603659517","heartbeat_front_addr":"172.21.15.164:6805/603659517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.476482+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.250903+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.326430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:20:25.905 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:20:26.219 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:20:26.219 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":6,"btime":"2024-09-17T02:20:19:554662+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:20:15.896969+0000","modified":"2024-09-17T02:20:18.924053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4207":{"gid":4207,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.1:6803/3107361006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3107361006},{"type":"v1","addr":"172.21.15.1:6803","nonce":3107361006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4207,"qdb_cluster":[4207]},"id":1}]} 2024-09-17T02:20:26.219 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 6 2024-09-17T02:20:26.337 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T02:20:15.896969+0000', 'modified': '2024-09-17T02:20:18.924053+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4207}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4207': {'gid': 4207, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.1:6803/3107361006', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.1:6802', 'nonce': 3107361006}, {'type': 'v1', 'addr': '172.21.15.1:6803', 'nonce': 3107361006}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4207, 'qdb_cluster': [4207]} 2024-09-17T02:20:26.338 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T02:20:26.338 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T02:20:26.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-17T02:20:26.481+0000 7f4ecbfff640 0 client.4387 ms_handle_reset on v2:172.21.15.1:6802/3107361006 2024-09-17T02:20:26.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-17T02:20:26.505+0000 7f4ecbfff640 0 client.4479 ms_handle_reset on v2:172.21.15.1:6802/3107361006 2024-09-17T02:20:26.502 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-17T02:20:26.502 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "37cd4495-4915-41f4-bad2-2394cbe235f3", 2024-09-17T02:20:26.502 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2024-09-17T02:20:26.502 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 4207, 2024-09-17T02:20:26.503 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-17T02:20:26.503 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-17T02:20:26.503 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-17T02:20:26.503 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 9.9595829370000004, 2024-09-17T02:20:26.503 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 6, 2024-09-17T02:20:26.503 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 21, 2024-09-17T02:20:26.503 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 20, 2024-09-17T02:20:26.503 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 13.882456145000001 2024-09-17T02:20:26.503 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-17T02:20:26.517 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-17T02:20:26.528 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-17T02:20:26.528 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'e20bff7d16f5b09c58ead9548e8cf98cf87ee227'}} 2024-09-17T02:20:26.528 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-17T02:20:26.528 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-09-17T02:20:26.528 DEBUG:teuthology.orchestra.run.smithi001:> sync 2024-09-17T02:20:26.786 DEBUG:teuthology.orchestra.run.smithi032:> sync 2024-09-17T02:20:26.954 DEBUG:teuthology.orchestra.run.smithi153:> sync 2024-09-17T02:20:27.078 DEBUG:teuthology.orchestra.run.smithi164:> sync 2024-09-17T02:20:27.179 DEBUG:tasks.thrashosds:checking console status of smithi001 2024-09-17T02:20:27.179 DEBUG:teuthology.orchestra.console.smithi001:Waiting for login prompt 2024-09-17T02:20:27.179 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi001 2024-09-17T02:20:27.292 DEBUG:teuthology.orchestra.console.smithi001:expect before: [Enter `^Ec?' for help] 2024-09-17T02:20:27.292 DEBUG:teuthology.orchestra.console.smithi001:expect after: smithi001 login: 2024-09-17T02:20:27.346 DEBUG:teuthology.orchestra.console.smithi001:console disconnect output: [Enter `^Ec?' for help] smithi001 login: [disconnect] 2024-09-17T02:20:27.447 DEBUG:tasks.thrashosds:checking console status of smithi032 2024-09-17T02:20:27.447 DEBUG:teuthology.orchestra.console.smithi032:Waiting for login prompt 2024-09-17T02:20:27.447 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi032 2024-09-17T02:20:27.612 DEBUG:teuthology.orchestra.console.smithi032:expect before: [Enter `^Ec?' for help] 2024-09-17T02:20:27.612 DEBUG:teuthology.orchestra.console.smithi032:expect after: smithi032 login: 2024-09-17T02:20:27.664 DEBUG:teuthology.orchestra.console.smithi032:console disconnect output: [Enter `^Ec?' for help] smithi032 login: [disconnect] 2024-09-17T02:20:27.765 DEBUG:tasks.thrashosds:checking console status of smithi153 2024-09-17T02:20:27.766 DEBUG:teuthology.orchestra.console.smithi153:Waiting for login prompt 2024-09-17T02:20:27.766 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi153 2024-09-17T02:20:27.848 DEBUG:teuthology.orchestra.console.smithi153:expect before: [Enter `^Ec?' for help] 2024-09-17T02:20:27.848 DEBUG:teuthology.orchestra.console.smithi153:expect after: smithi153 login: 2024-09-17T02:20:27.900 DEBUG:teuthology.orchestra.console.smithi153:console disconnect output: [Enter `^Ec?' for help] smithi153 login: [disconnect] 2024-09-17T02:20:28.001 DEBUG:tasks.thrashosds:checking console status of smithi164 2024-09-17T02:20:28.001 DEBUG:teuthology.orchestra.console.smithi164:Waiting for login prompt 2024-09-17T02:20:28.001 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi164 2024-09-17T02:20:28.159 DEBUG:teuthology.orchestra.console.smithi164:expect before: [Enter `^Ec?' for help] 2024-09-17T02:20:28.159 DEBUG:teuthology.orchestra.console.smithi164:expect after: smithi164 login: 2024-09-17T02:20:28.212 DEBUG:teuthology.orchestra.console.smithi164:console disconnect output: [Enter `^Ec?' for help] smithi164 login: [disconnect] 2024-09-17T02:20:28.313 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-17T02:20:28.653 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-17T02:20:28.653 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T02:20:28.654 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:20:28.958 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:20:28.960 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-17T02:20:28.974 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-09-17T02:20:27.346340+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94268,"kb_used_data":688,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283021252,"statfs":{"total":289910292480,"available":289813762048,"internally_reserved":0,"allocated":704512,"data_stored":1371366,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.792766"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.648912+0000","last_change":"2024-09-17T02:20:16.577643+0000","last_active":"2024-09-17T02:20:22.648912+0000","last_peered":"2024-09-17T02:20:22.648912+0000","last_clean":"2024-09-17T02:20:22.648912+0000","last_became_active":"2024-09-17T02:20:16.576566+0000","last_became_peered":"2024-09-17T02:20:16.576566+0000","last_unstale":"2024-09-17T02:20:22.648912+0000","last_undegraded":"2024-09-17T02:20:22.648912+0000","last_fullsized":"2024-09-17T02:20:22.648912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:34.971816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.647987+0000","last_change":"2024-09-17T02:20:16.574137+0000","last_active":"2024-09-17T02:20:22.647987+0000","last_peered":"2024-09-17T02:20:22.647987+0000","last_clean":"2024-09-17T02:20:22.647987+0000","last_became_active":"2024-09-17T02:20:16.571755+0000","last_became_peered":"2024-09-17T02:20:16.571755+0000","last_unstale":"2024-09-17T02:20:22.647987+0000","last_undegraded":"2024-09-17T02:20:22.647987+0000","last_fullsized":"2024-09-17T02:20:22.647987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:56.146270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561529+0000","last_change":"2024-09-17T02:20:16.582493+0000","last_active":"2024-09-17T02:20:17.561529+0000","last_peered":"2024-09-17T02:20:17.561529+0000","last_clean":"2024-09-17T02:20:17.561529+0000","last_became_active":"2024-09-17T02:20:16.581463+0000","last_became_peered":"2024-09-17T02:20:16.581463+0000","last_unstale":"2024-09-17T02:20:17.561529+0000","last_undegraded":"2024-09-17T02:20:17.561529+0000","last_fullsized":"2024-09-17T02:20:17.561529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:12.134652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561118+0000","last_change":"2024-09-17T02:20:16.568747+0000","last_active":"2024-09-17T02:20:17.561118+0000","last_peered":"2024-09-17T02:20:17.561118+0000","last_clean":"2024-09-17T02:20:17.561118+0000","last_became_active":"2024-09-17T02:20:16.566795+0000","last_became_peered":"2024-09-17T02:20:16.566795+0000","last_unstale":"2024-09-17T02:20:17.561118+0000","last_undegraded":"2024-09-17T02:20:17.561118+0000","last_fullsized":"2024-09-17T02:20:17.561118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:51.799644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.647744+0000","last_change":"2024-09-17T02:20:16.568625+0000","last_active":"2024-09-17T02:20:22.647744+0000","last_peered":"2024-09-17T02:20:22.647744+0000","last_clean":"2024-09-17T02:20:22.647744+0000","last_became_active":"2024-09-17T02:20:16.567707+0000","last_became_peered":"2024-09-17T02:20:16.567707+0000","last_unstale":"2024-09-17T02:20:22.647744+0000","last_undegraded":"2024-09-17T02:20:22.647744+0000","last_fullsized":"2024-09-17T02:20:22.647744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:44.452839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559506+0000","last_change":"2024-09-17T02:20:16.568765+0000","last_active":"2024-09-17T02:20:17.559506+0000","last_peered":"2024-09-17T02:20:17.559506+0000","last_clean":"2024-09-17T02:20:17.559506+0000","last_became_active":"2024-09-17T02:20:16.564108+0000","last_became_peered":"2024-09-17T02:20:16.564108+0000","last_unstale":"2024-09-17T02:20:17.559506+0000","last_undegraded":"2024-09-17T02:20:17.559506+0000","last_fullsized":"2024-09-17T02:20:17.559506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:26.782410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559579+0000","last_change":"2024-09-17T02:20:16.563357+0000","last_active":"2024-09-17T02:20:17.559579+0000","last_peered":"2024-09-17T02:20:17.559579+0000","last_clean":"2024-09-17T02:20:17.559579+0000","last_became_active":"2024-09-17T02:20:16.562276+0000","last_became_peered":"2024-09-17T02:20:16.562276+0000","last_unstale":"2024-09-17T02:20:17.559579+0000","last_undegraded":"2024-09-17T02:20:17.559579+0000","last_fullsized":"2024-09-17T02:20:17.559579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:47.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559460+0000","last_change":"2024-09-17T02:20:16.568482+0000","last_active":"2024-09-17T02:20:17.559460+0000","last_peered":"2024-09-17T02:20:17.559460+0000","last_clean":"2024-09-17T02:20:17.559460+0000","last_became_active":"2024-09-17T02:20:16.565416+0000","last_became_peered":"2024-09-17T02:20:16.565416+0000","last_unstale":"2024-09-17T02:20:17.559460+0000","last_undegraded":"2024-09-17T02:20:17.559460+0000","last_fullsized":"2024-09-17T02:20:17.559460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:13.574859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559952+0000","last_change":"2024-09-17T02:20:16.584665+0000","last_active":"2024-09-17T02:20:17.559952+0000","last_peered":"2024-09-17T02:20:17.559952+0000","last_clean":"2024-09-17T02:20:17.559952+0000","last_became_active":"2024-09-17T02:20:16.580797+0000","last_became_peered":"2024-09-17T02:20:16.580797+0000","last_unstale":"2024-09-17T02:20:17.559952+0000","last_undegraded":"2024-09-17T02:20:17.559952+0000","last_fullsized":"2024-09-17T02:20:17.559952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:47.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.648297+0000","last_change":"2024-09-17T02:20:16.577666+0000","last_active":"2024-09-17T02:20:22.648297+0000","last_peered":"2024-09-17T02:20:22.648297+0000","last_clean":"2024-09-17T02:20:22.648297+0000","last_became_active":"2024-09-17T02:20:16.574914+0000","last_became_peered":"2024-09-17T02:20:16.574914+0000","last_unstale":"2024-09-17T02:20:22.648297+0000","last_undegraded":"2024-09-17T02:20:22.648297+0000","last_fullsized":"2024-09-17T02:20:22.648297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:48.730100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561136+0000","last_change":"2024-09-17T02:20:16.565609+0000","last_active":"2024-09-17T02:20:17.561136+0000","last_peered":"2024-09-17T02:20:17.561136+0000","last_clean":"2024-09-17T02:20:17.561136+0000","last_became_active":"2024-09-17T02:20:16.564092+0000","last_became_peered":"2024-09-17T02:20:16.564092+0000","last_unstale":"2024-09-17T02:20:17.561136+0000","last_undegraded":"2024-09-17T02:20:17.561136+0000","last_fullsized":"2024-09-17T02:20:17.561136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:40.921595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.647795+0000","last_change":"2024-09-17T02:20:16.584447+0000","last_active":"2024-09-17T02:20:22.647795+0000","last_peered":"2024-09-17T02:20:22.647795+0000","last_clean":"2024-09-17T02:20:22.647795+0000","last_became_active":"2024-09-17T02:20:16.580416+0000","last_became_peered":"2024-09-17T02:20:16.580416+0000","last_unstale":"2024-09-17T02:20:22.647795+0000","last_undegraded":"2024-09-17T02:20:22.647795+0000","last_fullsized":"2024-09-17T02:20:22.647795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:19.742400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.647468+0000","last_change":"2024-09-17T02:20:16.573447+0000","last_active":"2024-09-17T02:20:22.647468+0000","last_peered":"2024-09-17T02:20:22.647468+0000","last_clean":"2024-09-17T02:20:22.647468+0000","last_became_active":"2024-09-17T02:20:16.571757+0000","last_became_peered":"2024-09-17T02:20:16.571757+0000","last_unstale":"2024-09-17T02:20:22.647468+0000","last_undegraded":"2024-09-17T02:20:22.647468+0000","last_fullsized":"2024-09-17T02:20:22.647468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:12.584579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560276+0000","last_change":"2024-09-17T02:20:16.563197+0000","last_active":"2024-09-17T02:20:17.560276+0000","last_peered":"2024-09-17T02:20:17.560276+0000","last_clean":"2024-09-17T02:20:17.560276+0000","last_became_active":"2024-09-17T02:20:16.561221+0000","last_became_peered":"2024-09-17T02:20:16.561221+0000","last_unstale":"2024-09-17T02:20:17.560276+0000","last_undegraded":"2024-09-17T02:20:17.560276+0000","last_fullsized":"2024-09-17T02:20:17.560276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:43.309196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559960+0000","last_change":"2024-09-17T02:20:16.581305+0000","last_active":"2024-09-17T02:20:17.559960+0000","last_peered":"2024-09-17T02:20:17.559960+0000","last_clean":"2024-09-17T02:20:17.559960+0000","last_became_active":"2024-09-17T02:20:16.580377+0000","last_became_peered":"2024-09-17T02:20:16.580377+0000","last_unstale":"2024-09-17T02:20:17.559960+0000","last_undegraded":"2024-09-17T02:20:17.559960+0000","last_fullsized":"2024-09-17T02:20:17.559960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:43.454908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559106+0000","last_change":"2024-09-17T02:20:16.562686+0000","last_active":"2024-09-17T02:20:17.559106+0000","last_peered":"2024-09-17T02:20:17.559106+0000","last_clean":"2024-09-17T02:20:17.559106+0000","last_became_active":"2024-09-17T02:20:16.561446+0000","last_became_peered":"2024-09-17T02:20:16.561446+0000","last_unstale":"2024-09-17T02:20:17.559106+0000","last_undegraded":"2024-09-17T02:20:17.559106+0000","last_fullsized":"2024-09-17T02:20:17.559106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:22.801598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560996+0000","last_change":"2024-09-17T02:20:16.563482+0000","last_active":"2024-09-17T02:20:17.560996+0000","last_peered":"2024-09-17T02:20:17.560996+0000","last_clean":"2024-09-17T02:20:17.560996+0000","last_became_active":"2024-09-17T02:20:16.562735+0000","last_became_peered":"2024-09-17T02:20:16.562735+0000","last_unstale":"2024-09-17T02:20:17.560996+0000","last_undegraded":"2024-09-17T02:20:17.560996+0000","last_fullsized":"2024-09-17T02:20:17.560996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:10.315951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.648599+0000","last_change":"2024-09-17T02:20:16.568659+0000","last_active":"2024-09-17T02:20:22.648599+0000","last_peered":"2024-09-17T02:20:22.648599+0000","last_clean":"2024-09-17T02:20:22.648599+0000","last_became_active":"2024-09-17T02:20:16.565734+0000","last_became_peered":"2024-09-17T02:20:16.565734+0000","last_unstale":"2024-09-17T02:20:22.648599+0000","last_undegraded":"2024-09-17T02:20:22.648599+0000","last_fullsized":"2024-09-17T02:20:22.648599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:05.723619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559666+0000","last_change":"2024-09-17T02:20:16.586950+0000","last_active":"2024-09-17T02:20:17.559666+0000","last_peered":"2024-09-17T02:20:17.559666+0000","last_clean":"2024-09-17T02:20:17.559666+0000","last_became_active":"2024-09-17T02:20:16.586281+0000","last_became_peered":"2024-09-17T02:20:16.586281+0000","last_unstale":"2024-09-17T02:20:17.559666+0000","last_undegraded":"2024-09-17T02:20:17.559666+0000","last_fullsized":"2024-09-17T02:20:17.559666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:22.801598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561561+0000","last_change":"2024-09-17T02:20:16.570514+0000","last_active":"2024-09-17T02:20:17.561561+0000","last_peered":"2024-09-17T02:20:17.561561+0000","last_clean":"2024-09-17T02:20:17.561561+0000","last_became_active":"2024-09-17T02:20:16.567156+0000","last_became_peered":"2024-09-17T02:20:16.567156+0000","last_unstale":"2024-09-17T02:20:17.561561+0000","last_undegraded":"2024-09-17T02:20:17.561561+0000","last_fullsized":"2024-09-17T02:20:17.561561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:51.596077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561439+0000","last_change":"2024-09-17T02:20:16.571275+0000","last_active":"2024-09-17T02:20:17.561439+0000","last_peered":"2024-09-17T02:20:17.561439+0000","last_clean":"2024-09-17T02:20:17.561439+0000","last_became_active":"2024-09-17T02:20:16.569751+0000","last_became_peered":"2024-09-17T02:20:16.569751+0000","last_unstale":"2024-09-17T02:20:17.561439+0000","last_undegraded":"2024-09-17T02:20:17.561439+0000","last_fullsized":"2024-09-17T02:20:17.561439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:41.362905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.646762+0000","last_change":"2024-09-17T02:20:16.567109+0000","last_active":"2024-09-17T02:20:22.646762+0000","last_peered":"2024-09-17T02:20:22.646762+0000","last_clean":"2024-09-17T02:20:22.646762+0000","last_became_active":"2024-09-17T02:20:16.564753+0000","last_became_peered":"2024-09-17T02:20:16.564753+0000","last_unstale":"2024-09-17T02:20:22.646762+0000","last_undegraded":"2024-09-17T02:20:22.646762+0000","last_fullsized":"2024-09-17T02:20:22.646762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:01.888476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.557727+0000","last_change":"2024-09-17T02:20:16.558778+0000","last_active":"2024-09-17T02:20:17.557727+0000","last_peered":"2024-09-17T02:20:17.557727+0000","last_clean":"2024-09-17T02:20:17.557727+0000","last_became_active":"2024-09-17T02:20:16.557967+0000","last_became_peered":"2024-09-17T02:20:16.557967+0000","last_unstale":"2024-09-17T02:20:17.557727+0000","last_undegraded":"2024-09-17T02:20:17.557727+0000","last_fullsized":"2024-09-17T02:20:17.557727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:40.577627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.646170+0000","last_change":"2024-09-17T02:20:16.564194+0000","last_active":"2024-09-17T02:20:22.646170+0000","last_peered":"2024-09-17T02:20:22.646170+0000","last_clean":"2024-09-17T02:20:22.646170+0000","last_became_active":"2024-09-17T02:20:16.562564+0000","last_became_peered":"2024-09-17T02:20:16.562564+0000","last_unstale":"2024-09-17T02:20:22.646170+0000","last_undegraded":"2024-09-17T02:20:22.646170+0000","last_fullsized":"2024-09-17T02:20:22.646170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:10.932999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.649017+0000","last_change":"2024-09-17T02:20:16.573189+0000","last_active":"2024-09-17T02:20:22.649017+0000","last_peered":"2024-09-17T02:20:22.649017+0000","last_clean":"2024-09-17T02:20:22.649017+0000","last_became_active":"2024-09-17T02:20:16.570669+0000","last_became_peered":"2024-09-17T02:20:16.570669+0000","last_unstale":"2024-09-17T02:20:22.649017+0000","last_undegraded":"2024-09-17T02:20:22.649017+0000","last_fullsized":"2024-09-17T02:20:22.649017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:52.753219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560314+0000","last_change":"2024-09-17T02:20:16.581076+0000","last_active":"2024-09-17T02:20:17.560314+0000","last_peered":"2024-09-17T02:20:17.560314+0000","last_clean":"2024-09-17T02:20:17.560314+0000","last_became_active":"2024-09-17T02:20:16.579989+0000","last_became_peered":"2024-09-17T02:20:16.579989+0000","last_unstale":"2024-09-17T02:20:17.560314+0000","last_undegraded":"2024-09-17T02:20:17.560314+0000","last_fullsized":"2024-09-17T02:20:17.560314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:43.454908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561562+0000","last_change":"2024-09-17T02:20:16.582808+0000","last_active":"2024-09-17T02:20:17.561562+0000","last_peered":"2024-09-17T02:20:17.561562+0000","last_clean":"2024-09-17T02:20:17.561562+0000","last_became_active":"2024-09-17T02:20:16.581358+0000","last_became_peered":"2024-09-17T02:20:16.581358+0000","last_unstale":"2024-09-17T02:20:17.561562+0000","last_undegraded":"2024-09-17T02:20:17.561562+0000","last_fullsized":"2024-09-17T02:20:17.561562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:26.441162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.648437+0000","last_change":"2024-09-17T02:20:16.583361+0000","last_active":"2024-09-17T02:20:22.648437+0000","last_peered":"2024-09-17T02:20:22.648437+0000","last_clean":"2024-09-17T02:20:22.648437+0000","last_became_active":"2024-09-17T02:20:16.579817+0000","last_became_peered":"2024-09-17T02:20:16.579817+0000","last_unstale":"2024-09-17T02:20:22.648437+0000","last_undegraded":"2024-09-17T02:20:22.648437+0000","last_fullsized":"2024-09-17T02:20:22.648437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:54.029860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559128+0000","last_change":"2024-09-17T02:20:16.581125+0000","last_active":"2024-09-17T02:20:17.559128+0000","last_peered":"2024-09-17T02:20:17.559128+0000","last_clean":"2024-09-17T02:20:17.559128+0000","last_became_active":"2024-09-17T02:20:16.580393+0000","last_became_peered":"2024-09-17T02:20:16.580393+0000","last_unstale":"2024-09-17T02:20:17.559128+0000","last_undegraded":"2024-09-17T02:20:17.559128+0000","last_fullsized":"2024-09-17T02:20:17.559128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:24.706394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.647088+0000","last_change":"2024-09-17T02:20:16.565220+0000","last_active":"2024-09-17T02:20:22.647088+0000","last_peered":"2024-09-17T02:20:22.647088+0000","last_clean":"2024-09-17T02:20:22.647088+0000","last_became_active":"2024-09-17T02:20:16.562419+0000","last_became_peered":"2024-09-17T02:20:16.562419+0000","last_unstale":"2024-09-17T02:20:22.647088+0000","last_undegraded":"2024-09-17T02:20:22.647088+0000","last_fullsized":"2024-09-17T02:20:22.647088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:03.961277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.557946+0000","last_change":"2024-09-17T02:20:16.579408+0000","last_active":"2024-09-17T02:20:17.557946+0000","last_peered":"2024-09-17T02:20:17.557946+0000","last_clean":"2024-09-17T02:20:17.557946+0000","last_became_active":"2024-09-17T02:20:16.577202+0000","last_became_peered":"2024-09-17T02:20:16.577202+0000","last_unstale":"2024-09-17T02:20:17.557946+0000","last_undegraded":"2024-09-17T02:20:17.557946+0000","last_fullsized":"2024-09-17T02:20:17.557946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:20.414231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559533+0000","last_change":"2024-09-17T02:20:16.570810+0000","last_active":"2024-09-17T02:20:17.559533+0000","last_peered":"2024-09-17T02:20:17.559533+0000","last_clean":"2024-09-17T02:20:17.559533+0000","last_became_active":"2024-09-17T02:20:16.569273+0000","last_became_peered":"2024-09-17T02:20:16.569273+0000","last_unstale":"2024-09-17T02:20:17.559533+0000","last_undegraded":"2024-09-17T02:20:17.559533+0000","last_fullsized":"2024-09-17T02:20:17.559533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:42.123535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.648078+0000","last_change":"2024-09-17T02:20:16.572798+0000","last_active":"2024-09-17T02:20:22.648078+0000","last_peered":"2024-09-17T02:20:22.648078+0000","last_clean":"2024-09-17T02:20:22.648078+0000","last_became_active":"2024-09-17T02:20:16.571174+0000","last_became_peered":"2024-09-17T02:20:16.571174+0000","last_unstale":"2024-09-17T02:20:22.648078+0000","last_undegraded":"2024-09-17T02:20:22.648078+0000","last_fullsized":"2024-09-17T02:20:22.648078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:00.116621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561420+0000","last_change":"2024-09-17T02:20:15.559935+0000","last_active":"2024-09-17T02:20:17.561420+0000","last_peered":"2024-09-17T02:20:17.561420+0000","last_clean":"2024-09-17T02:20:17.561420+0000","last_became_active":"2024-09-17T02:20:15.559413+0000","last_became_peered":"2024-09-17T02:20:15.559413+0000","last_unstale":"2024-09-17T02:20:17.561420+0000","last_undegraded":"2024-09-17T02:20:17.561420+0000","last_fullsized":"2024-09-17T02:20:17.561420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:52.985837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.648459+0000","last_change":"2024-09-17T02:20:16.581819+0000","last_active":"2024-09-17T02:20:22.648459+0000","last_peered":"2024-09-17T02:20:22.648459+0000","last_clean":"2024-09-17T02:20:22.648459+0000","last_became_active":"2024-09-17T02:20:16.577168+0000","last_became_peered":"2024-09-17T02:20:16.577168+0000","last_unstale":"2024-09-17T02:20:22.648459+0000","last_undegraded":"2024-09-17T02:20:22.648459+0000","last_fullsized":"2024-09-17T02:20:22.648459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:47.756576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558392+0000","last_change":"2024-09-17T02:20:15.550890+0000","last_active":"2024-09-17T02:20:17.558392+0000","last_peered":"2024-09-17T02:20:17.558392+0000","last_clean":"2024-09-17T02:20:17.558392+0000","last_became_active":"2024-09-17T02:20:15.550077+0000","last_became_peered":"2024-09-17T02:20:15.550077+0000","last_unstale":"2024-09-17T02:20:17.558392+0000","last_undegraded":"2024-09-17T02:20:17.558392+0000","last_fullsized":"2024-09-17T02:20:17.558392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:36.119249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560885+0000","last_change":"2024-09-17T02:20:16.581457+0000","last_active":"2024-09-17T02:20:17.560885+0000","last_peered":"2024-09-17T02:20:17.560885+0000","last_clean":"2024-09-17T02:20:17.560885+0000","last_became_active":"2024-09-17T02:20:16.579428+0000","last_became_peered":"2024-09-17T02:20:16.579428+0000","last_unstale":"2024-09-17T02:20:17.560885+0000","last_undegraded":"2024-09-17T02:20:17.560885+0000","last_fullsized":"2024-09-17T02:20:17.560885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:55.083688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.646858+0000","last_change":"2024-09-17T02:20:15.569442+0000","last_active":"2024-09-17T02:20:22.646858+0000","last_peered":"2024-09-17T02:20:22.646858+0000","last_clean":"2024-09-17T02:20:22.646858+0000","last_became_active":"2024-09-17T02:20:15.567946+0000","last_became_peered":"2024-09-17T02:20:15.567946+0000","last_unstale":"2024-09-17T02:20:22.646858+0000","last_undegraded":"2024-09-17T02:20:22.646858+0000","last_fullsized":"2024-09-17T02:20:22.646858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:55.866388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559959+0000","last_change":"2024-09-17T02:20:16.579779+0000","last_active":"2024-09-17T02:20:17.559959+0000","last_peered":"2024-09-17T02:20:17.559959+0000","last_clean":"2024-09-17T02:20:17.559959+0000","last_became_active":"2024-09-17T02:20:16.576734+0000","last_became_peered":"2024-09-17T02:20:16.576734+0000","last_unstale":"2024-09-17T02:20:17.559959+0000","last_undegraded":"2024-09-17T02:20:17.559959+0000","last_fullsized":"2024-09-17T02:20:17.559959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:26.782410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559862+0000","last_change":"2024-09-17T02:20:15.559245+0000","last_active":"2024-09-17T02:20:17.559862+0000","last_peered":"2024-09-17T02:20:17.559862+0000","last_clean":"2024-09-17T02:20:17.559862+0000","last_became_active":"2024-09-17T02:20:15.558518+0000","last_became_peered":"2024-09-17T02:20:15.558518+0000","last_unstale":"2024-09-17T02:20:17.559862+0000","last_undegraded":"2024-09-17T02:20:17.559862+0000","last_fullsized":"2024-09-17T02:20:17.559862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:52.783635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561043+0000","last_change":"2024-09-17T02:20:15.559110+0000","last_active":"2024-09-17T02:20:17.561043+0000","last_peered":"2024-09-17T02:20:17.561043+0000","last_clean":"2024-09-17T02:20:17.561043+0000","last_became_active":"2024-09-17T02:20:15.558285+0000","last_became_peered":"2024-09-17T02:20:15.558285+0000","last_unstale":"2024-09-17T02:20:17.561043+0000","last_undegraded":"2024-09-17T02:20:17.561043+0000","last_fullsized":"2024-09-17T02:20:17.561043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:15.782658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.646333+0000","last_change":"2024-09-17T02:20:16.584359+0000","last_active":"2024-09-17T02:20:22.646333+0000","last_peered":"2024-09-17T02:20:22.646333+0000","last_clean":"2024-09-17T02:20:22.646333+0000","last_became_active":"2024-09-17T02:20:16.582303+0000","last_became_peered":"2024-09-17T02:20:16.582303+0000","last_unstale":"2024-09-17T02:20:22.646333+0000","last_undegraded":"2024-09-17T02:20:22.646333+0000","last_fullsized":"2024-09-17T02:20:22.646333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:12.345284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.648841+0000","last_change":"2024-09-17T02:20:15.568414+0000","last_active":"2024-09-17T02:20:22.648841+0000","last_peered":"2024-09-17T02:20:22.648841+0000","last_clean":"2024-09-17T02:20:22.648841+0000","last_became_active":"2024-09-17T02:20:15.567596+0000","last_became_peered":"2024-09-17T02:20:15.567596+0000","last_unstale":"2024-09-17T02:20:22.648841+0000","last_undegraded":"2024-09-17T02:20:22.648841+0000","last_fullsized":"2024-09-17T02:20:22.648841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:11.356699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.646537+0000","last_change":"2024-09-17T02:20:16.565402+0000","last_active":"2024-09-17T02:20:22.646537+0000","last_peered":"2024-09-17T02:20:22.646537+0000","last_clean":"2024-09-17T02:20:22.646537+0000","last_became_active":"2024-09-17T02:20:16.563113+0000","last_became_peered":"2024-09-17T02:20:16.563113+0000","last_unstale":"2024-09-17T02:20:22.646537+0000","last_undegraded":"2024-09-17T02:20:22.646537+0000","last_fullsized":"2024-09-17T02:20:22.646537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:38:36.115641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.562269+0000","last_change":"2024-09-17T02:20:15.559767+0000","last_active":"2024-09-17T02:20:17.562269+0000","last_peered":"2024-09-17T02:20:17.562269+0000","last_clean":"2024-09-17T02:20:17.562269+0000","last_became_active":"2024-09-17T02:20:15.558888+0000","last_became_peered":"2024-09-17T02:20:15.558888+0000","last_unstale":"2024-09-17T02:20:17.562269+0000","last_undegraded":"2024-09-17T02:20:17.562269+0000","last_fullsized":"2024-09-17T02:20:17.562269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:09.831510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559986+0000","last_change":"2024-09-17T02:20:16.565632+0000","last_active":"2024-09-17T02:20:17.559986+0000","last_peered":"2024-09-17T02:20:17.559986+0000","last_clean":"2024-09-17T02:20:17.559986+0000","last_became_active":"2024-09-17T02:20:16.563630+0000","last_became_peered":"2024-09-17T02:20:16.563630+0000","last_unstale":"2024-09-17T02:20:17.559986+0000","last_undegraded":"2024-09-17T02:20:17.559986+0000","last_fullsized":"2024-09-17T02:20:17.559986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:05.049317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.562156+0000","last_change":"2024-09-17T02:20:15.562539+0000","last_active":"2024-09-17T02:20:17.562156+0000","last_peered":"2024-09-17T02:20:17.562156+0000","last_clean":"2024-09-17T02:20:17.562156+0000","last_became_active":"2024-09-17T02:20:15.561801+0000","last_became_peered":"2024-09-17T02:20:15.561801+0000","last_unstale":"2024-09-17T02:20:17.562156+0000","last_undegraded":"2024-09-17T02:20:17.562156+0000","last_fullsized":"2024-09-17T02:20:17.562156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:15.848081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559360+0000","last_change":"2024-09-17T02:20:16.578474+0000","last_active":"2024-09-17T02:20:17.559360+0000","last_peered":"2024-09-17T02:20:17.559360+0000","last_clean":"2024-09-17T02:20:17.559360+0000","last_became_active":"2024-09-17T02:20:16.576264+0000","last_became_peered":"2024-09-17T02:20:16.576264+0000","last_unstale":"2024-09-17T02:20:17.559360+0000","last_undegraded":"2024-09-17T02:20:17.559360+0000","last_fullsized":"2024-09-17T02:20:17.559360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:48.313282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559626+0000","last_change":"2024-09-17T02:20:15.551986+0000","last_active":"2024-09-17T02:20:17.559626+0000","last_peered":"2024-09-17T02:20:17.559626+0000","last_clean":"2024-09-17T02:20:17.559626+0000","last_became_active":"2024-09-17T02:20:15.550418+0000","last_became_peered":"2024-09-17T02:20:15.550418+0000","last_unstale":"2024-09-17T02:20:17.559626+0000","last_undegraded":"2024-09-17T02:20:17.559626+0000","last_fullsized":"2024-09-17T02:20:17.559626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:17.866665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561875+0000","last_change":"2024-09-17T02:20:16.570845+0000","last_active":"2024-09-17T02:20:17.561875+0000","last_peered":"2024-09-17T02:20:17.561875+0000","last_clean":"2024-09-17T02:20:17.561875+0000","last_became_active":"2024-09-17T02:20:16.568862+0000","last_became_peered":"2024-09-17T02:20:16.568862+0000","last_unstale":"2024-09-17T02:20:17.561875+0000","last_undegraded":"2024-09-17T02:20:17.561875+0000","last_fullsized":"2024-09-17T02:20:17.561875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:30.715391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560696+0000","last_change":"2024-09-17T02:20:15.559849+0000","last_active":"2024-09-17T02:20:17.560696+0000","last_peered":"2024-09-17T02:20:17.560696+0000","last_clean":"2024-09-17T02:20:17.560696+0000","last_became_active":"2024-09-17T02:20:15.559431+0000","last_became_peered":"2024-09-17T02:20:15.559431+0000","last_unstale":"2024-09-17T02:20:17.560696+0000","last_undegraded":"2024-09-17T02:20:17.560696+0000","last_fullsized":"2024-09-17T02:20:17.560696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:31.933850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561999+0000","last_change":"2024-09-17T02:20:16.586434+0000","last_active":"2024-09-17T02:20:17.561999+0000","last_peered":"2024-09-17T02:20:17.561999+0000","last_clean":"2024-09-17T02:20:17.561999+0000","last_became_active":"2024-09-17T02:20:16.585466+0000","last_became_peered":"2024-09-17T02:20:16.585466+0000","last_unstale":"2024-09-17T02:20:17.561999+0000","last_undegraded":"2024-09-17T02:20:17.561999+0000","last_fullsized":"2024-09-17T02:20:17.561999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:57:29.891850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.646893+0000","last_change":"2024-09-17T02:20:15.568506+0000","last_active":"2024-09-17T02:20:22.646893+0000","last_peered":"2024-09-17T02:20:22.646893+0000","last_clean":"2024-09-17T02:20:22.646893+0000","last_became_active":"2024-09-17T02:20:15.567720+0000","last_became_peered":"2024-09-17T02:20:15.567720+0000","last_unstale":"2024-09-17T02:20:22.646893+0000","last_undegraded":"2024-09-17T02:20:22.646893+0000","last_fullsized":"2024-09-17T02:20:22.646893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:46.560153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560661+0000","last_change":"2024-09-17T02:20:16.582353+0000","last_active":"2024-09-17T02:20:17.560661+0000","last_peered":"2024-09-17T02:20:17.560661+0000","last_clean":"2024-09-17T02:20:17.560661+0000","last_became_active":"2024-09-17T02:20:16.581462+0000","last_became_peered":"2024-09-17T02:20:16.581462+0000","last_unstale":"2024-09-17T02:20:17.560661+0000","last_undegraded":"2024-09-17T02:20:17.560661+0000","last_fullsized":"2024-09-17T02:20:17.560661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:44.023284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.646475+0000","last_change":"2024-09-17T02:20:15.565444+0000","last_active":"2024-09-17T02:20:22.646475+0000","last_peered":"2024-09-17T02:20:22.646475+0000","last_clean":"2024-09-17T02:20:22.646475+0000","last_became_active":"2024-09-17T02:20:15.564640+0000","last_became_peered":"2024-09-17T02:20:15.564640+0000","last_unstale":"2024-09-17T02:20:22.646475+0000","last_undegraded":"2024-09-17T02:20:22.646475+0000","last_fullsized":"2024-09-17T02:20:22.646475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:29.214563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560331+0000","last_change":"2024-09-17T02:20:16.583084+0000","last_active":"2024-09-17T02:20:17.560331+0000","last_peered":"2024-09-17T02:20:17.560331+0000","last_clean":"2024-09-17T02:20:17.560331+0000","last_became_active":"2024-09-17T02:20:16.582326+0000","last_became_peered":"2024-09-17T02:20:16.582326+0000","last_unstale":"2024-09-17T02:20:17.560331+0000","last_undegraded":"2024-09-17T02:20:17.560331+0000","last_fullsized":"2024-09-17T02:20:17.560331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:05.049317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":224,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560852+0000","last_change":"2024-09-17T02:20:04.612894+0000","last_active":"2024-09-17T02:20:17.560852+0000","last_peered":"2024-09-17T02:20:17.560852+0000","last_clean":"2024-09-17T02:20:17.560852+0000","last_became_active":"2024-09-17T02:20:04.610517+0000","last_became_peered":"2024-09-17T02:20:04.610517+0000","last_unstale":"2024-09-17T02:20:17.560852+0000","last_undegraded":"2024-09-17T02:20:17.560852+0000","last_fullsized":"2024-09-17T02:20:17.560852+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_clean_scrub_stamp":"2024-09-17T02:20:03.432050+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:51.879303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":28,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561660+0000","last_change":"2024-09-17T02:20:12.513513+0000","last_active":"2024-09-17T02:20:17.561660+0000","last_peered":"2024-09-17T02:20:17.561660+0000","last_clean":"2024-09-17T02:20:17.561660+0000","last_became_active":"2024-09-17T02:20:10.504616+0000","last_became_peered":"2024-09-17T02:20:10.504616+0000","last_unstale":"2024-09-17T02:20:17.561660+0000","last_undegraded":"2024-09-17T02:20:17.561660+0000","last_fullsized":"2024-09-17T02:20:17.561660+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:13.341611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001517832,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558593+0000","last_change":"2024-09-17T02:20:15.560646+0000","last_active":"2024-09-17T02:20:17.558593+0000","last_peered":"2024-09-17T02:20:17.558593+0000","last_clean":"2024-09-17T02:20:17.558593+0000","last_became_active":"2024-09-17T02:20:15.559104+0000","last_became_peered":"2024-09-17T02:20:15.559104+0000","last_unstale":"2024-09-17T02:20:17.558593+0000","last_undegraded":"2024-09-17T02:20:17.558593+0000","last_fullsized":"2024-09-17T02:20:17.558593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:44.299986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.562163+0000","last_change":"2024-09-17T02:20:16.585522+0000","last_active":"2024-09-17T02:20:17.562163+0000","last_peered":"2024-09-17T02:20:17.562163+0000","last_clean":"2024-09-17T02:20:17.562163+0000","last_became_active":"2024-09-17T02:20:16.584520+0000","last_became_peered":"2024-09-17T02:20:16.584520+0000","last_unstale":"2024-09-17T02:20:17.562163+0000","last_undegraded":"2024-09-17T02:20:17.562163+0000","last_fullsized":"2024-09-17T02:20:17.562163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:14.123192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560572+0000","last_change":"2024-09-17T02:20:12.512798+0000","last_active":"2024-09-17T02:20:17.560572+0000","last_peered":"2024-09-17T02:20:17.560572+0000","last_clean":"2024-09-17T02:20:17.560572+0000","last_became_active":"2024-09-17T02:20:10.502115+0000","last_became_peered":"2024-09-17T02:20:10.502115+0000","last_unstale":"2024-09-17T02:20:17.560572+0000","last_undegraded":"2024-09-17T02:20:17.560572+0000","last_fullsized":"2024-09-17T02:20:17.560572+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:17.554878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083467700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558499+0000","last_change":"2024-09-17T02:20:15.551632+0000","last_active":"2024-09-17T02:20:17.558499+0000","last_peered":"2024-09-17T02:20:17.558499+0000","last_clean":"2024-09-17T02:20:17.558499+0000","last_became_active":"2024-09-17T02:20:15.551062+0000","last_became_peered":"2024-09-17T02:20:15.551062+0000","last_unstale":"2024-09-17T02:20:17.558499+0000","last_undegraded":"2024-09-17T02:20:17.558499+0000","last_fullsized":"2024-09-17T02:20:17.558499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:55.295518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.648418+0000","last_change":"2024-09-17T02:20:16.571568+0000","last_active":"2024-09-17T02:20:22.648418+0000","last_peered":"2024-09-17T02:20:22.648418+0000","last_clean":"2024-09-17T02:20:22.648418+0000","last_became_active":"2024-09-17T02:20:16.570622+0000","last_became_peered":"2024-09-17T02:20:16.570622+0000","last_unstale":"2024-09-17T02:20:22.648418+0000","last_undegraded":"2024-09-17T02:20:22.648418+0000","last_fullsized":"2024-09-17T02:20:22.648418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:57.083446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558959+0000","last_change":"2024-09-17T02:20:12.511823+0000","last_active":"2024-09-17T02:20:17.558959+0000","last_peered":"2024-09-17T02:20:17.558959+0000","last_clean":"2024-09-17T02:20:17.558959+0000","last_became_active":"2024-09-17T02:20:10.497164+0000","last_became_peered":"2024-09-17T02:20:10.497164+0000","last_unstale":"2024-09-17T02:20:17.558959+0000","last_undegraded":"2024-09-17T02:20:17.558959+0000","last_fullsized":"2024-09-17T02:20:17.558959+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:21.242753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081052700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.646592+0000","last_change":"2024-09-17T02:20:15.569475+0000","last_active":"2024-09-17T02:20:22.646592+0000","last_peered":"2024-09-17T02:20:22.646592+0000","last_clean":"2024-09-17T02:20:22.646592+0000","last_became_active":"2024-09-17T02:20:15.567965+0000","last_became_peered":"2024-09-17T02:20:15.567965+0000","last_unstale":"2024-09-17T02:20:22.646592+0000","last_undegraded":"2024-09-17T02:20:22.646592+0000","last_fullsized":"2024-09-17T02:20:22.646592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:06.649112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560384+0000","last_change":"2024-09-17T02:20:16.578902+0000","last_active":"2024-09-17T02:20:17.560384+0000","last_peered":"2024-09-17T02:20:17.560384+0000","last_clean":"2024-09-17T02:20:17.560384+0000","last_became_active":"2024-09-17T02:20:16.576512+0000","last_became_peered":"2024-09-17T02:20:16.576512+0000","last_unstale":"2024-09-17T02:20:17.560384+0000","last_undegraded":"2024-09-17T02:20:17.560384+0000","last_fullsized":"2024-09-17T02:20:17.560384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:29.757455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560859+0000","last_change":"2024-09-17T02:20:12.512742+0000","last_active":"2024-09-17T02:20:17.560859+0000","last_peered":"2024-09-17T02:20:17.560859+0000","last_clean":"2024-09-17T02:20:17.560859+0000","last_became_active":"2024-09-17T02:20:10.503622+0000","last_became_peered":"2024-09-17T02:20:10.503622+0000","last_unstale":"2024-09-17T02:20:17.560859+0000","last_undegraded":"2024-09-17T02:20:17.560859+0000","last_fullsized":"2024-09-17T02:20:17.560859+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:36.226043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078085399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561586+0000","last_change":"2024-09-17T02:20:15.562840+0000","last_active":"2024-09-17T02:20:17.561586+0000","last_peered":"2024-09-17T02:20:17.561586+0000","last_clean":"2024-09-17T02:20:17.561586+0000","last_became_active":"2024-09-17T02:20:15.562177+0000","last_became_peered":"2024-09-17T02:20:15.562177+0000","last_unstale":"2024-09-17T02:20:17.561586+0000","last_undegraded":"2024-09-17T02:20:17.561586+0000","last_fullsized":"2024-09-17T02:20:17.561586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:39.709524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559748+0000","last_change":"2024-09-17T02:20:16.580184+0000","last_active":"2024-09-17T02:20:17.559748+0000","last_peered":"2024-09-17T02:20:17.559748+0000","last_clean":"2024-09-17T02:20:17.559748+0000","last_became_active":"2024-09-17T02:20:16.578343+0000","last_became_peered":"2024-09-17T02:20:16.578343+0000","last_unstale":"2024-09-17T02:20:17.559748+0000","last_undegraded":"2024-09-17T02:20:17.559748+0000","last_fullsized":"2024-09-17T02:20:17.559748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:42.123535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.562400+0000","last_change":"2024-09-17T02:20:15.562922+0000","last_active":"2024-09-17T02:20:17.562400+0000","last_peered":"2024-09-17T02:20:17.562400+0000","last_clean":"2024-09-17T02:20:17.562400+0000","last_became_active":"2024-09-17T02:20:15.562138+0000","last_became_peered":"2024-09-17T02:20:15.562138+0000","last_unstale":"2024-09-17T02:20:17.562400+0000","last_undegraded":"2024-09-17T02:20:17.562400+0000","last_fullsized":"2024-09-17T02:20:17.562400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:00.819275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559993+0000","last_change":"2024-09-17T02:20:12.511838+0000","last_active":"2024-09-17T02:20:17.559993+0000","last_peered":"2024-09-17T02:20:17.559993+0000","last_clean":"2024-09-17T02:20:17.559993+0000","last_became_active":"2024-09-17T02:20:10.497049+0000","last_became_peered":"2024-09-17T02:20:10.497049+0000","last_unstale":"2024-09-17T02:20:17.559993+0000","last_undegraded":"2024-09-17T02:20:17.559993+0000","last_fullsized":"2024-09-17T02:20:17.559993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:54.446484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079701100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.646841+0000","last_change":"2024-09-17T02:20:16.571485+0000","last_active":"2024-09-17T02:20:22.646841+0000","last_peered":"2024-09-17T02:20:22.646841+0000","last_clean":"2024-09-17T02:20:22.646841+0000","last_became_active":"2024-09-17T02:20:16.567570+0000","last_became_peered":"2024-09-17T02:20:16.567570+0000","last_unstale":"2024-09-17T02:20:22.646841+0000","last_undegraded":"2024-09-17T02:20:22.646841+0000","last_fullsized":"2024-09-17T02:20:22.646841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:14.228385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559752+0000","last_change":"2024-09-17T02:20:15.559252+0000","last_active":"2024-09-17T02:20:17.559752+0000","last_peered":"2024-09-17T02:20:17.559752+0000","last_clean":"2024-09-17T02:20:17.559752+0000","last_became_active":"2024-09-17T02:20:15.557667+0000","last_became_peered":"2024-09-17T02:20:15.557667+0000","last_unstale":"2024-09-17T02:20:17.559752+0000","last_undegraded":"2024-09-17T02:20:17.559752+0000","last_fullsized":"2024-09-17T02:20:17.559752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:01.292626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.649204+0000","last_change":"2024-09-17T02:20:12.661034+0000","last_active":"2024-09-17T02:20:22.649204+0000","last_peered":"2024-09-17T02:20:22.649204+0000","last_clean":"2024-09-17T02:20:22.649204+0000","last_became_active":"2024-09-17T02:20:10.497829+0000","last_became_peered":"2024-09-17T02:20:10.497829+0000","last_unstale":"2024-09-17T02:20:22.649204+0000","last_undegraded":"2024-09-17T02:20:22.649204+0000","last_fullsized":"2024-09-17T02:20:22.649204+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:46:27.427685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096944700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.647519+0000","last_change":"2024-09-17T02:20:16.579478+0000","last_active":"2024-09-17T02:20:22.647519+0000","last_peered":"2024-09-17T02:20:22.647519+0000","last_clean":"2024-09-17T02:20:22.647519+0000","last_became_active":"2024-09-17T02:20:16.578705+0000","last_became_peered":"2024-09-17T02:20:16.578705+0000","last_unstale":"2024-09-17T02:20:22.647519+0000","last_undegraded":"2024-09-17T02:20:22.647519+0000","last_fullsized":"2024-09-17T02:20:22.647519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:21.656908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561074+0000","last_change":"2024-09-17T02:20:15.558961+0000","last_active":"2024-09-17T02:20:17.561074+0000","last_peered":"2024-09-17T02:20:17.561074+0000","last_clean":"2024-09-17T02:20:17.561074+0000","last_became_active":"2024-09-17T02:20:15.558299+0000","last_became_peered":"2024-09-17T02:20:15.558299+0000","last_unstale":"2024-09-17T02:20:17.561074+0000","last_undegraded":"2024-09-17T02:20:17.561074+0000","last_fullsized":"2024-09-17T02:20:17.561074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:39.709524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561104+0000","last_change":"2024-09-17T02:20:12.512481+0000","last_active":"2024-09-17T02:20:17.561104+0000","last_peered":"2024-09-17T02:20:17.561104+0000","last_clean":"2024-09-17T02:20:17.561104+0000","last_became_active":"2024-09-17T02:20:10.497021+0000","last_became_peered":"2024-09-17T02:20:10.497021+0000","last_unstale":"2024-09-17T02:20:17.561104+0000","last_undegraded":"2024-09-17T02:20:17.561104+0000","last_fullsized":"2024-09-17T02:20:17.561104+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:41.167283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001400079,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558440+0000","last_change":"2024-09-17T02:20:16.560687+0000","last_active":"2024-09-17T02:20:17.558440+0000","last_peered":"2024-09-17T02:20:17.558440+0000","last_clean":"2024-09-17T02:20:17.558440+0000","last_became_active":"2024-09-17T02:20:16.559758+0000","last_became_peered":"2024-09-17T02:20:16.559758+0000","last_unstale":"2024-09-17T02:20:17.558440+0000","last_undegraded":"2024-09-17T02:20:17.558440+0000","last_fullsized":"2024-09-17T02:20:17.558440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:54:33.088375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560971+0000","last_change":"2024-09-17T02:20:15.551758+0000","last_active":"2024-09-17T02:20:17.560971+0000","last_peered":"2024-09-17T02:20:17.560971+0000","last_clean":"2024-09-17T02:20:17.560971+0000","last_became_active":"2024-09-17T02:20:15.550353+0000","last_became_peered":"2024-09-17T02:20:15.550353+0000","last_unstale":"2024-09-17T02:20:17.560971+0000","last_undegraded":"2024-09-17T02:20:17.560971+0000","last_fullsized":"2024-09-17T02:20:17.560971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:04.229911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561418+0000","last_change":"2024-09-17T02:20:12.513530+0000","last_active":"2024-09-17T02:20:17.561418+0000","last_peered":"2024-09-17T02:20:17.561418+0000","last_clean":"2024-09-17T02:20:17.561418+0000","last_became_active":"2024-09-17T02:20:10.502692+0000","last_became_peered":"2024-09-17T02:20:10.502692+0000","last_unstale":"2024-09-17T02:20:17.561418+0000","last_undegraded":"2024-09-17T02:20:17.561418+0000","last_fullsized":"2024-09-17T02:20:17.561418+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:53.004641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015329009999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.646544+0000","last_change":"2024-09-17T02:20:16.575882+0000","last_active":"2024-09-17T02:20:22.646544+0000","last_peered":"2024-09-17T02:20:22.646544+0000","last_clean":"2024-09-17T02:20:22.646544+0000","last_became_active":"2024-09-17T02:20:16.573968+0000","last_became_peered":"2024-09-17T02:20:16.573968+0000","last_unstale":"2024-09-17T02:20:22.646544+0000","last_undegraded":"2024-09-17T02:20:22.646544+0000","last_fullsized":"2024-09-17T02:20:22.646544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:18.090082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560482+0000","last_change":"2024-09-17T02:20:16.582881+0000","last_active":"2024-09-17T02:20:17.560482+0000","last_peered":"2024-09-17T02:20:17.560482+0000","last_clean":"2024-09-17T02:20:17.560482+0000","last_became_active":"2024-09-17T02:20:16.580985+0000","last_became_peered":"2024-09-17T02:20:16.580985+0000","last_unstale":"2024-09-17T02:20:17.560482+0000","last_undegraded":"2024-09-17T02:20:17.560482+0000","last_fullsized":"2024-09-17T02:20:17.560482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:10.315951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.562026+0000","last_change":"2024-09-17T02:20:15.558925+0000","last_active":"2024-09-17T02:20:17.562026+0000","last_peered":"2024-09-17T02:20:17.562026+0000","last_clean":"2024-09-17T02:20:17.562026+0000","last_became_active":"2024-09-17T02:20:15.558174+0000","last_became_peered":"2024-09-17T02:20:15.558174+0000","last_unstale":"2024-09-17T02:20:17.562026+0000","last_undegraded":"2024-09-17T02:20:17.562026+0000","last_fullsized":"2024-09-17T02:20:17.562026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:55.639841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558215+0000","last_change":"2024-09-17T02:20:16.579411+0000","last_active":"2024-09-17T02:20:17.558215+0000","last_peered":"2024-09-17T02:20:17.558215+0000","last_clean":"2024-09-17T02:20:17.558215+0000","last_became_active":"2024-09-17T02:20:16.576294+0000","last_became_peered":"2024-09-17T02:20:16.576294+0000","last_unstale":"2024-09-17T02:20:17.558215+0000","last_undegraded":"2024-09-17T02:20:17.558215+0000","last_fullsized":"2024-09-17T02:20:17.558215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:41:31.822425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.648911+0000","last_change":"2024-09-17T02:20:15.569117+0000","last_active":"2024-09-17T02:20:22.648911+0000","last_peered":"2024-09-17T02:20:22.648911+0000","last_clean":"2024-09-17T02:20:22.648911+0000","last_became_active":"2024-09-17T02:20:15.567405+0000","last_became_peered":"2024-09-17T02:20:15.567405+0000","last_unstale":"2024-09-17T02:20:22.648911+0000","last_undegraded":"2024-09-17T02:20:22.648911+0000","last_fullsized":"2024-09-17T02:20:22.648911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:55:10.186481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561160+0000","last_change":"2024-09-17T02:20:15.562827+0000","last_active":"2024-09-17T02:20:17.561160+0000","last_peered":"2024-09-17T02:20:17.561160+0000","last_clean":"2024-09-17T02:20:17.561160+0000","last_became_active":"2024-09-17T02:20:15.562073+0000","last_became_peered":"2024-09-17T02:20:15.562073+0000","last_unstale":"2024-09-17T02:20:17.561160+0000","last_undegraded":"2024-09-17T02:20:17.561160+0000","last_fullsized":"2024-09-17T02:20:17.561160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:17.866665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558226+0000","last_change":"2024-09-17T02:20:16.577670+0000","last_active":"2024-09-17T02:20:17.558226+0000","last_peered":"2024-09-17T02:20:17.558226+0000","last_clean":"2024-09-17T02:20:17.558226+0000","last_became_active":"2024-09-17T02:20:16.575082+0000","last_became_peered":"2024-09-17T02:20:16.575082+0000","last_unstale":"2024-09-17T02:20:17.558226+0000","last_undegraded":"2024-09-17T02:20:17.558226+0000","last_fullsized":"2024-09-17T02:20:17.558226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:21.356437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560821+0000","last_change":"2024-09-17T02:20:15.555513+0000","last_active":"2024-09-17T02:20:17.560821+0000","last_peered":"2024-09-17T02:20:17.560821+0000","last_clean":"2024-09-17T02:20:17.560821+0000","last_became_active":"2024-09-17T02:20:15.554256+0000","last_became_peered":"2024-09-17T02:20:15.554256+0000","last_unstale":"2024-09-17T02:20:17.560821+0000","last_undegraded":"2024-09-17T02:20:17.560821+0000","last_fullsized":"2024-09-17T02:20:17.560821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:52.985837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558359+0000","last_change":"2024-09-17T02:20:16.577803+0000","last_active":"2024-09-17T02:20:17.558359+0000","last_peered":"2024-09-17T02:20:17.558359+0000","last_clean":"2024-09-17T02:20:17.558359+0000","last_became_active":"2024-09-17T02:20:16.576640+0000","last_became_peered":"2024-09-17T02:20:16.576640+0000","last_unstale":"2024-09-17T02:20:17.558359+0000","last_undegraded":"2024-09-17T02:20:17.558359+0000","last_fullsized":"2024-09-17T02:20:17.558359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:07.190169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.649215+0000","last_change":"2024-09-17T02:20:16.571738+0000","last_active":"2024-09-17T02:20:22.649215+0000","last_peered":"2024-09-17T02:20:22.649215+0000","last_clean":"2024-09-17T02:20:22.649215+0000","last_became_active":"2024-09-17T02:20:16.568615+0000","last_became_peered":"2024-09-17T02:20:16.568615+0000","last_unstale":"2024-09-17T02:20:22.649215+0000","last_undegraded":"2024-09-17T02:20:22.649215+0000","last_fullsized":"2024-09-17T02:20:22.649215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:42.931361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558692+0000","last_change":"2024-09-17T02:20:15.558467+0000","last_active":"2024-09-17T02:20:17.558692+0000","last_peered":"2024-09-17T02:20:17.558692+0000","last_clean":"2024-09-17T02:20:17.558692+0000","last_became_active":"2024-09-17T02:20:15.557186+0000","last_became_peered":"2024-09-17T02:20:15.557186+0000","last_unstale":"2024-09-17T02:20:17.558692+0000","last_undegraded":"2024-09-17T02:20:17.558692+0000","last_fullsized":"2024-09-17T02:20:17.558692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:56.879445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560355+0000","last_change":"2024-09-17T02:20:16.577527+0000","last_active":"2024-09-17T02:20:17.560355+0000","last_peered":"2024-09-17T02:20:17.560355+0000","last_clean":"2024-09-17T02:20:17.560355+0000","last_became_active":"2024-09-17T02:20:16.574761+0000","last_became_peered":"2024-09-17T02:20:16.574761+0000","last_unstale":"2024-09-17T02:20:17.560355+0000","last_undegraded":"2024-09-17T02:20:17.560355+0000","last_fullsized":"2024-09-17T02:20:17.560355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:43.309196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558428+0000","last_change":"2024-09-17T02:20:15.552417+0000","last_active":"2024-09-17T02:20:17.558428+0000","last_peered":"2024-09-17T02:20:17.558428+0000","last_clean":"2024-09-17T02:20:17.558428+0000","last_became_active":"2024-09-17T02:20:15.551609+0000","last_became_peered":"2024-09-17T02:20:15.551609+0000","last_unstale":"2024-09-17T02:20:17.558428+0000","last_undegraded":"2024-09-17T02:20:17.558428+0000","last_fullsized":"2024-09-17T02:20:17.558428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:15.782658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.648238+0000","last_change":"2024-09-17T02:20:16.591978+0000","last_active":"2024-09-17T02:20:22.648238+0000","last_peered":"2024-09-17T02:20:22.648238+0000","last_clean":"2024-09-17T02:20:22.648238+0000","last_became_active":"2024-09-17T02:20:16.591378+0000","last_became_peered":"2024-09-17T02:20:16.591378+0000","last_unstale":"2024-09-17T02:20:22.648238+0000","last_undegraded":"2024-09-17T02:20:22.648238+0000","last_fullsized":"2024-09-17T02:20:22.648238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:44.489118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.647204+0000","last_change":"2024-09-17T02:20:15.565262+0000","last_active":"2024-09-17T02:20:22.647204+0000","last_peered":"2024-09-17T02:20:22.647204+0000","last_clean":"2024-09-17T02:20:22.647204+0000","last_became_active":"2024-09-17T02:20:15.564415+0000","last_became_peered":"2024-09-17T02:20:15.564415+0000","last_unstale":"2024-09-17T02:20:22.647204+0000","last_undegraded":"2024-09-17T02:20:22.647204+0000","last_fullsized":"2024-09-17T02:20:22.647204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:42.049312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.647968+0000","last_change":"2024-09-17T02:20:16.573407+0000","last_active":"2024-09-17T02:20:22.647968+0000","last_peered":"2024-09-17T02:20:22.647968+0000","last_clean":"2024-09-17T02:20:22.647968+0000","last_became_active":"2024-09-17T02:20:16.570987+0000","last_became_peered":"2024-09-17T02:20:16.570987+0000","last_unstale":"2024-09-17T02:20:22.647968+0000","last_undegraded":"2024-09-17T02:20:22.647968+0000","last_fullsized":"2024-09-17T02:20:22.647968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:23:09.424550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.647821+0000","last_change":"2024-09-17T02:20:15.568883+0000","last_active":"2024-09-17T02:20:22.647821+0000","last_peered":"2024-09-17T02:20:22.647821+0000","last_clean":"2024-09-17T02:20:22.647821+0000","last_became_active":"2024-09-17T02:20:15.567980+0000","last_became_peered":"2024-09-17T02:20:15.567980+0000","last_unstale":"2024-09-17T02:20:22.647821+0000","last_undegraded":"2024-09-17T02:20:22.647821+0000","last_fullsized":"2024-09-17T02:20:22.647821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:04.059900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561194+0000","last_change":"2024-09-17T02:20:16.568209+0000","last_active":"2024-09-17T02:20:17.561194+0000","last_peered":"2024-09-17T02:20:17.561194+0000","last_clean":"2024-09-17T02:20:17.561194+0000","last_became_active":"2024-09-17T02:20:16.566585+0000","last_became_peered":"2024-09-17T02:20:16.566585+0000","last_unstale":"2024-09-17T02:20:17.561194+0000","last_undegraded":"2024-09-17T02:20:17.561194+0000","last_fullsized":"2024-09-17T02:20:17.561194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:44:59.713633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561836+0000","last_change":"2024-09-17T02:20:15.558296+0000","last_active":"2024-09-17T02:20:17.561836+0000","last_peered":"2024-09-17T02:20:17.561836+0000","last_clean":"2024-09-17T02:20:17.561836+0000","last_became_active":"2024-09-17T02:20:15.557520+0000","last_became_peered":"2024-09-17T02:20:15.557520+0000","last_unstale":"2024-09-17T02:20:17.561836+0000","last_undegraded":"2024-09-17T02:20:17.561836+0000","last_fullsized":"2024-09-17T02:20:17.561836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:04.229911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560569+0000","last_change":"2024-09-17T02:20:16.568334+0000","last_active":"2024-09-17T02:20:17.560569+0000","last_peered":"2024-09-17T02:20:17.560569+0000","last_clean":"2024-09-17T02:20:17.560569+0000","last_became_active":"2024-09-17T02:20:16.566982+0000","last_became_peered":"2024-09-17T02:20:16.566982+0000","last_unstale":"2024-09-17T02:20:17.560569+0000","last_undegraded":"2024-09-17T02:20:17.560569+0000","last_fullsized":"2024-09-17T02:20:17.560569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:55.083688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.648518+0000","last_change":"2024-09-17T02:20:15.569712+0000","last_active":"2024-09-17T02:20:22.648518+0000","last_peered":"2024-09-17T02:20:22.648518+0000","last_clean":"2024-09-17T02:20:22.648518+0000","last_became_active":"2024-09-17T02:20:15.569106+0000","last_became_peered":"2024-09-17T02:20:15.569106+0000","last_unstale":"2024-09-17T02:20:22.648518+0000","last_undegraded":"2024-09-17T02:20:22.648518+0000","last_fullsized":"2024-09-17T02:20:22.648518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:02.822970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.647039+0000","last_change":"2024-09-17T02:20:16.570456+0000","last_active":"2024-09-17T02:20:22.647039+0000","last_peered":"2024-09-17T02:20:22.647039+0000","last_clean":"2024-09-17T02:20:22.647039+0000","last_became_active":"2024-09-17T02:20:16.568095+0000","last_became_peered":"2024-09-17T02:20:16.568095+0000","last_unstale":"2024-09-17T02:20:22.647039+0000","last_undegraded":"2024-09-17T02:20:22.647039+0000","last_fullsized":"2024-09-17T02:20:22.647039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:58.329169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560601+0000","last_change":"2024-09-17T02:20:15.560293+0000","last_active":"2024-09-17T02:20:17.560601+0000","last_peered":"2024-09-17T02:20:17.560601+0000","last_clean":"2024-09-17T02:20:17.560601+0000","last_became_active":"2024-09-17T02:20:15.559074+0000","last_became_peered":"2024-09-17T02:20:15.559074+0000","last_unstale":"2024-09-17T02:20:17.560601+0000","last_undegraded":"2024-09-17T02:20:17.560601+0000","last_fullsized":"2024-09-17T02:20:17.560601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:55.639841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560319+0000","last_change":"2024-09-17T02:20:16.570950+0000","last_active":"2024-09-17T02:20:17.560319+0000","last_peered":"2024-09-17T02:20:17.560319+0000","last_clean":"2024-09-17T02:20:17.560319+0000","last_became_active":"2024-09-17T02:20:16.569496+0000","last_became_peered":"2024-09-17T02:20:16.569496+0000","last_unstale":"2024-09-17T02:20:17.560319+0000","last_undegraded":"2024-09-17T02:20:17.560319+0000","last_fullsized":"2024-09-17T02:20:17.560319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:29.757455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560576+0000","last_change":"2024-09-17T02:20:15.544675+0000","last_active":"2024-09-17T02:20:17.560576+0000","last_peered":"2024-09-17T02:20:17.560576+0000","last_clean":"2024-09-17T02:20:17.560576+0000","last_became_active":"2024-09-17T02:20:15.544213+0000","last_became_peered":"2024-09-17T02:20:15.544213+0000","last_unstale":"2024-09-17T02:20:17.560576+0000","last_undegraded":"2024-09-17T02:20:17.560576+0000","last_fullsized":"2024-09-17T02:20:17.560576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:31.933850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35600,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336240,"statfs":{"total":96636764160,"available":96600309760,"internally_reserved":0,"allocated":253952,"data_stored":654086,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":266240,"data_stored":654721,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":62559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T02:20:28.979 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:20:29.323 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:20:29.325 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-17T02:20:29.341 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-09-17T02:20:27.346340+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94268,"kb_used_data":688,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283021252,"statfs":{"total":289910292480,"available":289813762048,"internally_reserved":0,"allocated":704512,"data_stored":1371366,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.792766"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.648912+0000","last_change":"2024-09-17T02:20:16.577643+0000","last_active":"2024-09-17T02:20:22.648912+0000","last_peered":"2024-09-17T02:20:22.648912+0000","last_clean":"2024-09-17T02:20:22.648912+0000","last_became_active":"2024-09-17T02:20:16.576566+0000","last_became_peered":"2024-09-17T02:20:16.576566+0000","last_unstale":"2024-09-17T02:20:22.648912+0000","last_undegraded":"2024-09-17T02:20:22.648912+0000","last_fullsized":"2024-09-17T02:20:22.648912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:34.971816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.647987+0000","last_change":"2024-09-17T02:20:16.574137+0000","last_active":"2024-09-17T02:20:22.647987+0000","last_peered":"2024-09-17T02:20:22.647987+0000","last_clean":"2024-09-17T02:20:22.647987+0000","last_became_active":"2024-09-17T02:20:16.571755+0000","last_became_peered":"2024-09-17T02:20:16.571755+0000","last_unstale":"2024-09-17T02:20:22.647987+0000","last_undegraded":"2024-09-17T02:20:22.647987+0000","last_fullsized":"2024-09-17T02:20:22.647987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:56.146270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561529+0000","last_change":"2024-09-17T02:20:16.582493+0000","last_active":"2024-09-17T02:20:17.561529+0000","last_peered":"2024-09-17T02:20:17.561529+0000","last_clean":"2024-09-17T02:20:17.561529+0000","last_became_active":"2024-09-17T02:20:16.581463+0000","last_became_peered":"2024-09-17T02:20:16.581463+0000","last_unstale":"2024-09-17T02:20:17.561529+0000","last_undegraded":"2024-09-17T02:20:17.561529+0000","last_fullsized":"2024-09-17T02:20:17.561529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:12.134652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561118+0000","last_change":"2024-09-17T02:20:16.568747+0000","last_active":"2024-09-17T02:20:17.561118+0000","last_peered":"2024-09-17T02:20:17.561118+0000","last_clean":"2024-09-17T02:20:17.561118+0000","last_became_active":"2024-09-17T02:20:16.566795+0000","last_became_peered":"2024-09-17T02:20:16.566795+0000","last_unstale":"2024-09-17T02:20:17.561118+0000","last_undegraded":"2024-09-17T02:20:17.561118+0000","last_fullsized":"2024-09-17T02:20:17.561118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:51.799644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.647744+0000","last_change":"2024-09-17T02:20:16.568625+0000","last_active":"2024-09-17T02:20:22.647744+0000","last_peered":"2024-09-17T02:20:22.647744+0000","last_clean":"2024-09-17T02:20:22.647744+0000","last_became_active":"2024-09-17T02:20:16.567707+0000","last_became_peered":"2024-09-17T02:20:16.567707+0000","last_unstale":"2024-09-17T02:20:22.647744+0000","last_undegraded":"2024-09-17T02:20:22.647744+0000","last_fullsized":"2024-09-17T02:20:22.647744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:44.452839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559506+0000","last_change":"2024-09-17T02:20:16.568765+0000","last_active":"2024-09-17T02:20:17.559506+0000","last_peered":"2024-09-17T02:20:17.559506+0000","last_clean":"2024-09-17T02:20:17.559506+0000","last_became_active":"2024-09-17T02:20:16.564108+0000","last_became_peered":"2024-09-17T02:20:16.564108+0000","last_unstale":"2024-09-17T02:20:17.559506+0000","last_undegraded":"2024-09-17T02:20:17.559506+0000","last_fullsized":"2024-09-17T02:20:17.559506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:26.782410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559579+0000","last_change":"2024-09-17T02:20:16.563357+0000","last_active":"2024-09-17T02:20:17.559579+0000","last_peered":"2024-09-17T02:20:17.559579+0000","last_clean":"2024-09-17T02:20:17.559579+0000","last_became_active":"2024-09-17T02:20:16.562276+0000","last_became_peered":"2024-09-17T02:20:16.562276+0000","last_unstale":"2024-09-17T02:20:17.559579+0000","last_undegraded":"2024-09-17T02:20:17.559579+0000","last_fullsized":"2024-09-17T02:20:17.559579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:47.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559460+0000","last_change":"2024-09-17T02:20:16.568482+0000","last_active":"2024-09-17T02:20:17.559460+0000","last_peered":"2024-09-17T02:20:17.559460+0000","last_clean":"2024-09-17T02:20:17.559460+0000","last_became_active":"2024-09-17T02:20:16.565416+0000","last_became_peered":"2024-09-17T02:20:16.565416+0000","last_unstale":"2024-09-17T02:20:17.559460+0000","last_undegraded":"2024-09-17T02:20:17.559460+0000","last_fullsized":"2024-09-17T02:20:17.559460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:13.574859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559952+0000","last_change":"2024-09-17T02:20:16.584665+0000","last_active":"2024-09-17T02:20:17.559952+0000","last_peered":"2024-09-17T02:20:17.559952+0000","last_clean":"2024-09-17T02:20:17.559952+0000","last_became_active":"2024-09-17T02:20:16.580797+0000","last_became_peered":"2024-09-17T02:20:16.580797+0000","last_unstale":"2024-09-17T02:20:17.559952+0000","last_undegraded":"2024-09-17T02:20:17.559952+0000","last_fullsized":"2024-09-17T02:20:17.559952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:47.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.648297+0000","last_change":"2024-09-17T02:20:16.577666+0000","last_active":"2024-09-17T02:20:22.648297+0000","last_peered":"2024-09-17T02:20:22.648297+0000","last_clean":"2024-09-17T02:20:22.648297+0000","last_became_active":"2024-09-17T02:20:16.574914+0000","last_became_peered":"2024-09-17T02:20:16.574914+0000","last_unstale":"2024-09-17T02:20:22.648297+0000","last_undegraded":"2024-09-17T02:20:22.648297+0000","last_fullsized":"2024-09-17T02:20:22.648297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:48.730100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561136+0000","last_change":"2024-09-17T02:20:16.565609+0000","last_active":"2024-09-17T02:20:17.561136+0000","last_peered":"2024-09-17T02:20:17.561136+0000","last_clean":"2024-09-17T02:20:17.561136+0000","last_became_active":"2024-09-17T02:20:16.564092+0000","last_became_peered":"2024-09-17T02:20:16.564092+0000","last_unstale":"2024-09-17T02:20:17.561136+0000","last_undegraded":"2024-09-17T02:20:17.561136+0000","last_fullsized":"2024-09-17T02:20:17.561136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:40.921595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.647795+0000","last_change":"2024-09-17T02:20:16.584447+0000","last_active":"2024-09-17T02:20:22.647795+0000","last_peered":"2024-09-17T02:20:22.647795+0000","last_clean":"2024-09-17T02:20:22.647795+0000","last_became_active":"2024-09-17T02:20:16.580416+0000","last_became_peered":"2024-09-17T02:20:16.580416+0000","last_unstale":"2024-09-17T02:20:22.647795+0000","last_undegraded":"2024-09-17T02:20:22.647795+0000","last_fullsized":"2024-09-17T02:20:22.647795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:19.742400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.647468+0000","last_change":"2024-09-17T02:20:16.573447+0000","last_active":"2024-09-17T02:20:22.647468+0000","last_peered":"2024-09-17T02:20:22.647468+0000","last_clean":"2024-09-17T02:20:22.647468+0000","last_became_active":"2024-09-17T02:20:16.571757+0000","last_became_peered":"2024-09-17T02:20:16.571757+0000","last_unstale":"2024-09-17T02:20:22.647468+0000","last_undegraded":"2024-09-17T02:20:22.647468+0000","last_fullsized":"2024-09-17T02:20:22.647468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:12.584579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560276+0000","last_change":"2024-09-17T02:20:16.563197+0000","last_active":"2024-09-17T02:20:17.560276+0000","last_peered":"2024-09-17T02:20:17.560276+0000","last_clean":"2024-09-17T02:20:17.560276+0000","last_became_active":"2024-09-17T02:20:16.561221+0000","last_became_peered":"2024-09-17T02:20:16.561221+0000","last_unstale":"2024-09-17T02:20:17.560276+0000","last_undegraded":"2024-09-17T02:20:17.560276+0000","last_fullsized":"2024-09-17T02:20:17.560276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:43.309196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559960+0000","last_change":"2024-09-17T02:20:16.581305+0000","last_active":"2024-09-17T02:20:17.559960+0000","last_peered":"2024-09-17T02:20:17.559960+0000","last_clean":"2024-09-17T02:20:17.559960+0000","last_became_active":"2024-09-17T02:20:16.580377+0000","last_became_peered":"2024-09-17T02:20:16.580377+0000","last_unstale":"2024-09-17T02:20:17.559960+0000","last_undegraded":"2024-09-17T02:20:17.559960+0000","last_fullsized":"2024-09-17T02:20:17.559960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:43.454908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559106+0000","last_change":"2024-09-17T02:20:16.562686+0000","last_active":"2024-09-17T02:20:17.559106+0000","last_peered":"2024-09-17T02:20:17.559106+0000","last_clean":"2024-09-17T02:20:17.559106+0000","last_became_active":"2024-09-17T02:20:16.561446+0000","last_became_peered":"2024-09-17T02:20:16.561446+0000","last_unstale":"2024-09-17T02:20:17.559106+0000","last_undegraded":"2024-09-17T02:20:17.559106+0000","last_fullsized":"2024-09-17T02:20:17.559106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:22.801598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560996+0000","last_change":"2024-09-17T02:20:16.563482+0000","last_active":"2024-09-17T02:20:17.560996+0000","last_peered":"2024-09-17T02:20:17.560996+0000","last_clean":"2024-09-17T02:20:17.560996+0000","last_became_active":"2024-09-17T02:20:16.562735+0000","last_became_peered":"2024-09-17T02:20:16.562735+0000","last_unstale":"2024-09-17T02:20:17.560996+0000","last_undegraded":"2024-09-17T02:20:17.560996+0000","last_fullsized":"2024-09-17T02:20:17.560996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:10.315951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.648599+0000","last_change":"2024-09-17T02:20:16.568659+0000","last_active":"2024-09-17T02:20:22.648599+0000","last_peered":"2024-09-17T02:20:22.648599+0000","last_clean":"2024-09-17T02:20:22.648599+0000","last_became_active":"2024-09-17T02:20:16.565734+0000","last_became_peered":"2024-09-17T02:20:16.565734+0000","last_unstale":"2024-09-17T02:20:22.648599+0000","last_undegraded":"2024-09-17T02:20:22.648599+0000","last_fullsized":"2024-09-17T02:20:22.648599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:05.723619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559666+0000","last_change":"2024-09-17T02:20:16.586950+0000","last_active":"2024-09-17T02:20:17.559666+0000","last_peered":"2024-09-17T02:20:17.559666+0000","last_clean":"2024-09-17T02:20:17.559666+0000","last_became_active":"2024-09-17T02:20:16.586281+0000","last_became_peered":"2024-09-17T02:20:16.586281+0000","last_unstale":"2024-09-17T02:20:17.559666+0000","last_undegraded":"2024-09-17T02:20:17.559666+0000","last_fullsized":"2024-09-17T02:20:17.559666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:22.801598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561561+0000","last_change":"2024-09-17T02:20:16.570514+0000","last_active":"2024-09-17T02:20:17.561561+0000","last_peered":"2024-09-17T02:20:17.561561+0000","last_clean":"2024-09-17T02:20:17.561561+0000","last_became_active":"2024-09-17T02:20:16.567156+0000","last_became_peered":"2024-09-17T02:20:16.567156+0000","last_unstale":"2024-09-17T02:20:17.561561+0000","last_undegraded":"2024-09-17T02:20:17.561561+0000","last_fullsized":"2024-09-17T02:20:17.561561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:51.596077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561439+0000","last_change":"2024-09-17T02:20:16.571275+0000","last_active":"2024-09-17T02:20:17.561439+0000","last_peered":"2024-09-17T02:20:17.561439+0000","last_clean":"2024-09-17T02:20:17.561439+0000","last_became_active":"2024-09-17T02:20:16.569751+0000","last_became_peered":"2024-09-17T02:20:16.569751+0000","last_unstale":"2024-09-17T02:20:17.561439+0000","last_undegraded":"2024-09-17T02:20:17.561439+0000","last_fullsized":"2024-09-17T02:20:17.561439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:41.362905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.646762+0000","last_change":"2024-09-17T02:20:16.567109+0000","last_active":"2024-09-17T02:20:22.646762+0000","last_peered":"2024-09-17T02:20:22.646762+0000","last_clean":"2024-09-17T02:20:22.646762+0000","last_became_active":"2024-09-17T02:20:16.564753+0000","last_became_peered":"2024-09-17T02:20:16.564753+0000","last_unstale":"2024-09-17T02:20:22.646762+0000","last_undegraded":"2024-09-17T02:20:22.646762+0000","last_fullsized":"2024-09-17T02:20:22.646762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:01.888476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.557727+0000","last_change":"2024-09-17T02:20:16.558778+0000","last_active":"2024-09-17T02:20:17.557727+0000","last_peered":"2024-09-17T02:20:17.557727+0000","last_clean":"2024-09-17T02:20:17.557727+0000","last_became_active":"2024-09-17T02:20:16.557967+0000","last_became_peered":"2024-09-17T02:20:16.557967+0000","last_unstale":"2024-09-17T02:20:17.557727+0000","last_undegraded":"2024-09-17T02:20:17.557727+0000","last_fullsized":"2024-09-17T02:20:17.557727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:40.577627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.646170+0000","last_change":"2024-09-17T02:20:16.564194+0000","last_active":"2024-09-17T02:20:22.646170+0000","last_peered":"2024-09-17T02:20:22.646170+0000","last_clean":"2024-09-17T02:20:22.646170+0000","last_became_active":"2024-09-17T02:20:16.562564+0000","last_became_peered":"2024-09-17T02:20:16.562564+0000","last_unstale":"2024-09-17T02:20:22.646170+0000","last_undegraded":"2024-09-17T02:20:22.646170+0000","last_fullsized":"2024-09-17T02:20:22.646170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:10.932999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.649017+0000","last_change":"2024-09-17T02:20:16.573189+0000","last_active":"2024-09-17T02:20:22.649017+0000","last_peered":"2024-09-17T02:20:22.649017+0000","last_clean":"2024-09-17T02:20:22.649017+0000","last_became_active":"2024-09-17T02:20:16.570669+0000","last_became_peered":"2024-09-17T02:20:16.570669+0000","last_unstale":"2024-09-17T02:20:22.649017+0000","last_undegraded":"2024-09-17T02:20:22.649017+0000","last_fullsized":"2024-09-17T02:20:22.649017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:52.753219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560314+0000","last_change":"2024-09-17T02:20:16.581076+0000","last_active":"2024-09-17T02:20:17.560314+0000","last_peered":"2024-09-17T02:20:17.560314+0000","last_clean":"2024-09-17T02:20:17.560314+0000","last_became_active":"2024-09-17T02:20:16.579989+0000","last_became_peered":"2024-09-17T02:20:16.579989+0000","last_unstale":"2024-09-17T02:20:17.560314+0000","last_undegraded":"2024-09-17T02:20:17.560314+0000","last_fullsized":"2024-09-17T02:20:17.560314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:43.454908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561562+0000","last_change":"2024-09-17T02:20:16.582808+0000","last_active":"2024-09-17T02:20:17.561562+0000","last_peered":"2024-09-17T02:20:17.561562+0000","last_clean":"2024-09-17T02:20:17.561562+0000","last_became_active":"2024-09-17T02:20:16.581358+0000","last_became_peered":"2024-09-17T02:20:16.581358+0000","last_unstale":"2024-09-17T02:20:17.561562+0000","last_undegraded":"2024-09-17T02:20:17.561562+0000","last_fullsized":"2024-09-17T02:20:17.561562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:26.441162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.648437+0000","last_change":"2024-09-17T02:20:16.583361+0000","last_active":"2024-09-17T02:20:22.648437+0000","last_peered":"2024-09-17T02:20:22.648437+0000","last_clean":"2024-09-17T02:20:22.648437+0000","last_became_active":"2024-09-17T02:20:16.579817+0000","last_became_peered":"2024-09-17T02:20:16.579817+0000","last_unstale":"2024-09-17T02:20:22.648437+0000","last_undegraded":"2024-09-17T02:20:22.648437+0000","last_fullsized":"2024-09-17T02:20:22.648437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:54.029860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559128+0000","last_change":"2024-09-17T02:20:16.581125+0000","last_active":"2024-09-17T02:20:17.559128+0000","last_peered":"2024-09-17T02:20:17.559128+0000","last_clean":"2024-09-17T02:20:17.559128+0000","last_became_active":"2024-09-17T02:20:16.580393+0000","last_became_peered":"2024-09-17T02:20:16.580393+0000","last_unstale":"2024-09-17T02:20:17.559128+0000","last_undegraded":"2024-09-17T02:20:17.559128+0000","last_fullsized":"2024-09-17T02:20:17.559128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:24.706394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.647088+0000","last_change":"2024-09-17T02:20:16.565220+0000","last_active":"2024-09-17T02:20:22.647088+0000","last_peered":"2024-09-17T02:20:22.647088+0000","last_clean":"2024-09-17T02:20:22.647088+0000","last_became_active":"2024-09-17T02:20:16.562419+0000","last_became_peered":"2024-09-17T02:20:16.562419+0000","last_unstale":"2024-09-17T02:20:22.647088+0000","last_undegraded":"2024-09-17T02:20:22.647088+0000","last_fullsized":"2024-09-17T02:20:22.647088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:03.961277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.557946+0000","last_change":"2024-09-17T02:20:16.579408+0000","last_active":"2024-09-17T02:20:17.557946+0000","last_peered":"2024-09-17T02:20:17.557946+0000","last_clean":"2024-09-17T02:20:17.557946+0000","last_became_active":"2024-09-17T02:20:16.577202+0000","last_became_peered":"2024-09-17T02:20:16.577202+0000","last_unstale":"2024-09-17T02:20:17.557946+0000","last_undegraded":"2024-09-17T02:20:17.557946+0000","last_fullsized":"2024-09-17T02:20:17.557946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:20.414231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559533+0000","last_change":"2024-09-17T02:20:16.570810+0000","last_active":"2024-09-17T02:20:17.559533+0000","last_peered":"2024-09-17T02:20:17.559533+0000","last_clean":"2024-09-17T02:20:17.559533+0000","last_became_active":"2024-09-17T02:20:16.569273+0000","last_became_peered":"2024-09-17T02:20:16.569273+0000","last_unstale":"2024-09-17T02:20:17.559533+0000","last_undegraded":"2024-09-17T02:20:17.559533+0000","last_fullsized":"2024-09-17T02:20:17.559533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:42.123535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.648078+0000","last_change":"2024-09-17T02:20:16.572798+0000","last_active":"2024-09-17T02:20:22.648078+0000","last_peered":"2024-09-17T02:20:22.648078+0000","last_clean":"2024-09-17T02:20:22.648078+0000","last_became_active":"2024-09-17T02:20:16.571174+0000","last_became_peered":"2024-09-17T02:20:16.571174+0000","last_unstale":"2024-09-17T02:20:22.648078+0000","last_undegraded":"2024-09-17T02:20:22.648078+0000","last_fullsized":"2024-09-17T02:20:22.648078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:00.116621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561420+0000","last_change":"2024-09-17T02:20:15.559935+0000","last_active":"2024-09-17T02:20:17.561420+0000","last_peered":"2024-09-17T02:20:17.561420+0000","last_clean":"2024-09-17T02:20:17.561420+0000","last_became_active":"2024-09-17T02:20:15.559413+0000","last_became_peered":"2024-09-17T02:20:15.559413+0000","last_unstale":"2024-09-17T02:20:17.561420+0000","last_undegraded":"2024-09-17T02:20:17.561420+0000","last_fullsized":"2024-09-17T02:20:17.561420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:52.985837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.648459+0000","last_change":"2024-09-17T02:20:16.581819+0000","last_active":"2024-09-17T02:20:22.648459+0000","last_peered":"2024-09-17T02:20:22.648459+0000","last_clean":"2024-09-17T02:20:22.648459+0000","last_became_active":"2024-09-17T02:20:16.577168+0000","last_became_peered":"2024-09-17T02:20:16.577168+0000","last_unstale":"2024-09-17T02:20:22.648459+0000","last_undegraded":"2024-09-17T02:20:22.648459+0000","last_fullsized":"2024-09-17T02:20:22.648459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:47.756576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558392+0000","last_change":"2024-09-17T02:20:15.550890+0000","last_active":"2024-09-17T02:20:17.558392+0000","last_peered":"2024-09-17T02:20:17.558392+0000","last_clean":"2024-09-17T02:20:17.558392+0000","last_became_active":"2024-09-17T02:20:15.550077+0000","last_became_peered":"2024-09-17T02:20:15.550077+0000","last_unstale":"2024-09-17T02:20:17.558392+0000","last_undegraded":"2024-09-17T02:20:17.558392+0000","last_fullsized":"2024-09-17T02:20:17.558392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:36.119249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560885+0000","last_change":"2024-09-17T02:20:16.581457+0000","last_active":"2024-09-17T02:20:17.560885+0000","last_peered":"2024-09-17T02:20:17.560885+0000","last_clean":"2024-09-17T02:20:17.560885+0000","last_became_active":"2024-09-17T02:20:16.579428+0000","last_became_peered":"2024-09-17T02:20:16.579428+0000","last_unstale":"2024-09-17T02:20:17.560885+0000","last_undegraded":"2024-09-17T02:20:17.560885+0000","last_fullsized":"2024-09-17T02:20:17.560885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:55.083688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.646858+0000","last_change":"2024-09-17T02:20:15.569442+0000","last_active":"2024-09-17T02:20:22.646858+0000","last_peered":"2024-09-17T02:20:22.646858+0000","last_clean":"2024-09-17T02:20:22.646858+0000","last_became_active":"2024-09-17T02:20:15.567946+0000","last_became_peered":"2024-09-17T02:20:15.567946+0000","last_unstale":"2024-09-17T02:20:22.646858+0000","last_undegraded":"2024-09-17T02:20:22.646858+0000","last_fullsized":"2024-09-17T02:20:22.646858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:55.866388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559959+0000","last_change":"2024-09-17T02:20:16.579779+0000","last_active":"2024-09-17T02:20:17.559959+0000","last_peered":"2024-09-17T02:20:17.559959+0000","last_clean":"2024-09-17T02:20:17.559959+0000","last_became_active":"2024-09-17T02:20:16.576734+0000","last_became_peered":"2024-09-17T02:20:16.576734+0000","last_unstale":"2024-09-17T02:20:17.559959+0000","last_undegraded":"2024-09-17T02:20:17.559959+0000","last_fullsized":"2024-09-17T02:20:17.559959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:26.782410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559862+0000","last_change":"2024-09-17T02:20:15.559245+0000","last_active":"2024-09-17T02:20:17.559862+0000","last_peered":"2024-09-17T02:20:17.559862+0000","last_clean":"2024-09-17T02:20:17.559862+0000","last_became_active":"2024-09-17T02:20:15.558518+0000","last_became_peered":"2024-09-17T02:20:15.558518+0000","last_unstale":"2024-09-17T02:20:17.559862+0000","last_undegraded":"2024-09-17T02:20:17.559862+0000","last_fullsized":"2024-09-17T02:20:17.559862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:52.783635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561043+0000","last_change":"2024-09-17T02:20:15.559110+0000","last_active":"2024-09-17T02:20:17.561043+0000","last_peered":"2024-09-17T02:20:17.561043+0000","last_clean":"2024-09-17T02:20:17.561043+0000","last_became_active":"2024-09-17T02:20:15.558285+0000","last_became_peered":"2024-09-17T02:20:15.558285+0000","last_unstale":"2024-09-17T02:20:17.561043+0000","last_undegraded":"2024-09-17T02:20:17.561043+0000","last_fullsized":"2024-09-17T02:20:17.561043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:15.782658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.646333+0000","last_change":"2024-09-17T02:20:16.584359+0000","last_active":"2024-09-17T02:20:22.646333+0000","last_peered":"2024-09-17T02:20:22.646333+0000","last_clean":"2024-09-17T02:20:22.646333+0000","last_became_active":"2024-09-17T02:20:16.582303+0000","last_became_peered":"2024-09-17T02:20:16.582303+0000","last_unstale":"2024-09-17T02:20:22.646333+0000","last_undegraded":"2024-09-17T02:20:22.646333+0000","last_fullsized":"2024-09-17T02:20:22.646333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:12.345284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.648841+0000","last_change":"2024-09-17T02:20:15.568414+0000","last_active":"2024-09-17T02:20:22.648841+0000","last_peered":"2024-09-17T02:20:22.648841+0000","last_clean":"2024-09-17T02:20:22.648841+0000","last_became_active":"2024-09-17T02:20:15.567596+0000","last_became_peered":"2024-09-17T02:20:15.567596+0000","last_unstale":"2024-09-17T02:20:22.648841+0000","last_undegraded":"2024-09-17T02:20:22.648841+0000","last_fullsized":"2024-09-17T02:20:22.648841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:11.356699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.646537+0000","last_change":"2024-09-17T02:20:16.565402+0000","last_active":"2024-09-17T02:20:22.646537+0000","last_peered":"2024-09-17T02:20:22.646537+0000","last_clean":"2024-09-17T02:20:22.646537+0000","last_became_active":"2024-09-17T02:20:16.563113+0000","last_became_peered":"2024-09-17T02:20:16.563113+0000","last_unstale":"2024-09-17T02:20:22.646537+0000","last_undegraded":"2024-09-17T02:20:22.646537+0000","last_fullsized":"2024-09-17T02:20:22.646537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:38:36.115641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.562269+0000","last_change":"2024-09-17T02:20:15.559767+0000","last_active":"2024-09-17T02:20:17.562269+0000","last_peered":"2024-09-17T02:20:17.562269+0000","last_clean":"2024-09-17T02:20:17.562269+0000","last_became_active":"2024-09-17T02:20:15.558888+0000","last_became_peered":"2024-09-17T02:20:15.558888+0000","last_unstale":"2024-09-17T02:20:17.562269+0000","last_undegraded":"2024-09-17T02:20:17.562269+0000","last_fullsized":"2024-09-17T02:20:17.562269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:09.831510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559986+0000","last_change":"2024-09-17T02:20:16.565632+0000","last_active":"2024-09-17T02:20:17.559986+0000","last_peered":"2024-09-17T02:20:17.559986+0000","last_clean":"2024-09-17T02:20:17.559986+0000","last_became_active":"2024-09-17T02:20:16.563630+0000","last_became_peered":"2024-09-17T02:20:16.563630+0000","last_unstale":"2024-09-17T02:20:17.559986+0000","last_undegraded":"2024-09-17T02:20:17.559986+0000","last_fullsized":"2024-09-17T02:20:17.559986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:05.049317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.562156+0000","last_change":"2024-09-17T02:20:15.562539+0000","last_active":"2024-09-17T02:20:17.562156+0000","last_peered":"2024-09-17T02:20:17.562156+0000","last_clean":"2024-09-17T02:20:17.562156+0000","last_became_active":"2024-09-17T02:20:15.561801+0000","last_became_peered":"2024-09-17T02:20:15.561801+0000","last_unstale":"2024-09-17T02:20:17.562156+0000","last_undegraded":"2024-09-17T02:20:17.562156+0000","last_fullsized":"2024-09-17T02:20:17.562156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:15.848081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559360+0000","last_change":"2024-09-17T02:20:16.578474+0000","last_active":"2024-09-17T02:20:17.559360+0000","last_peered":"2024-09-17T02:20:17.559360+0000","last_clean":"2024-09-17T02:20:17.559360+0000","last_became_active":"2024-09-17T02:20:16.576264+0000","last_became_peered":"2024-09-17T02:20:16.576264+0000","last_unstale":"2024-09-17T02:20:17.559360+0000","last_undegraded":"2024-09-17T02:20:17.559360+0000","last_fullsized":"2024-09-17T02:20:17.559360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:48.313282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559626+0000","last_change":"2024-09-17T02:20:15.551986+0000","last_active":"2024-09-17T02:20:17.559626+0000","last_peered":"2024-09-17T02:20:17.559626+0000","last_clean":"2024-09-17T02:20:17.559626+0000","last_became_active":"2024-09-17T02:20:15.550418+0000","last_became_peered":"2024-09-17T02:20:15.550418+0000","last_unstale":"2024-09-17T02:20:17.559626+0000","last_undegraded":"2024-09-17T02:20:17.559626+0000","last_fullsized":"2024-09-17T02:20:17.559626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:17.866665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561875+0000","last_change":"2024-09-17T02:20:16.570845+0000","last_active":"2024-09-17T02:20:17.561875+0000","last_peered":"2024-09-17T02:20:17.561875+0000","last_clean":"2024-09-17T02:20:17.561875+0000","last_became_active":"2024-09-17T02:20:16.568862+0000","last_became_peered":"2024-09-17T02:20:16.568862+0000","last_unstale":"2024-09-17T02:20:17.561875+0000","last_undegraded":"2024-09-17T02:20:17.561875+0000","last_fullsized":"2024-09-17T02:20:17.561875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:30.715391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560696+0000","last_change":"2024-09-17T02:20:15.559849+0000","last_active":"2024-09-17T02:20:17.560696+0000","last_peered":"2024-09-17T02:20:17.560696+0000","last_clean":"2024-09-17T02:20:17.560696+0000","last_became_active":"2024-09-17T02:20:15.559431+0000","last_became_peered":"2024-09-17T02:20:15.559431+0000","last_unstale":"2024-09-17T02:20:17.560696+0000","last_undegraded":"2024-09-17T02:20:17.560696+0000","last_fullsized":"2024-09-17T02:20:17.560696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:31.933850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561999+0000","last_change":"2024-09-17T02:20:16.586434+0000","last_active":"2024-09-17T02:20:17.561999+0000","last_peered":"2024-09-17T02:20:17.561999+0000","last_clean":"2024-09-17T02:20:17.561999+0000","last_became_active":"2024-09-17T02:20:16.585466+0000","last_became_peered":"2024-09-17T02:20:16.585466+0000","last_unstale":"2024-09-17T02:20:17.561999+0000","last_undegraded":"2024-09-17T02:20:17.561999+0000","last_fullsized":"2024-09-17T02:20:17.561999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:57:29.891850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.646893+0000","last_change":"2024-09-17T02:20:15.568506+0000","last_active":"2024-09-17T02:20:22.646893+0000","last_peered":"2024-09-17T02:20:22.646893+0000","last_clean":"2024-09-17T02:20:22.646893+0000","last_became_active":"2024-09-17T02:20:15.567720+0000","last_became_peered":"2024-09-17T02:20:15.567720+0000","last_unstale":"2024-09-17T02:20:22.646893+0000","last_undegraded":"2024-09-17T02:20:22.646893+0000","last_fullsized":"2024-09-17T02:20:22.646893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:46.560153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560661+0000","last_change":"2024-09-17T02:20:16.582353+0000","last_active":"2024-09-17T02:20:17.560661+0000","last_peered":"2024-09-17T02:20:17.560661+0000","last_clean":"2024-09-17T02:20:17.560661+0000","last_became_active":"2024-09-17T02:20:16.581462+0000","last_became_peered":"2024-09-17T02:20:16.581462+0000","last_unstale":"2024-09-17T02:20:17.560661+0000","last_undegraded":"2024-09-17T02:20:17.560661+0000","last_fullsized":"2024-09-17T02:20:17.560661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:44.023284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.646475+0000","last_change":"2024-09-17T02:20:15.565444+0000","last_active":"2024-09-17T02:20:22.646475+0000","last_peered":"2024-09-17T02:20:22.646475+0000","last_clean":"2024-09-17T02:20:22.646475+0000","last_became_active":"2024-09-17T02:20:15.564640+0000","last_became_peered":"2024-09-17T02:20:15.564640+0000","last_unstale":"2024-09-17T02:20:22.646475+0000","last_undegraded":"2024-09-17T02:20:22.646475+0000","last_fullsized":"2024-09-17T02:20:22.646475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:29.214563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560331+0000","last_change":"2024-09-17T02:20:16.583084+0000","last_active":"2024-09-17T02:20:17.560331+0000","last_peered":"2024-09-17T02:20:17.560331+0000","last_clean":"2024-09-17T02:20:17.560331+0000","last_became_active":"2024-09-17T02:20:16.582326+0000","last_became_peered":"2024-09-17T02:20:16.582326+0000","last_unstale":"2024-09-17T02:20:17.560331+0000","last_undegraded":"2024-09-17T02:20:17.560331+0000","last_fullsized":"2024-09-17T02:20:17.560331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:05.049317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":224,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560852+0000","last_change":"2024-09-17T02:20:04.612894+0000","last_active":"2024-09-17T02:20:17.560852+0000","last_peered":"2024-09-17T02:20:17.560852+0000","last_clean":"2024-09-17T02:20:17.560852+0000","last_became_active":"2024-09-17T02:20:04.610517+0000","last_became_peered":"2024-09-17T02:20:04.610517+0000","last_unstale":"2024-09-17T02:20:17.560852+0000","last_undegraded":"2024-09-17T02:20:17.560852+0000","last_fullsized":"2024-09-17T02:20:17.560852+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_clean_scrub_stamp":"2024-09-17T02:20:03.432050+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:51.879303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":28,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561660+0000","last_change":"2024-09-17T02:20:12.513513+0000","last_active":"2024-09-17T02:20:17.561660+0000","last_peered":"2024-09-17T02:20:17.561660+0000","last_clean":"2024-09-17T02:20:17.561660+0000","last_became_active":"2024-09-17T02:20:10.504616+0000","last_became_peered":"2024-09-17T02:20:10.504616+0000","last_unstale":"2024-09-17T02:20:17.561660+0000","last_undegraded":"2024-09-17T02:20:17.561660+0000","last_fullsized":"2024-09-17T02:20:17.561660+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:13.341611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001517832,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558593+0000","last_change":"2024-09-17T02:20:15.560646+0000","last_active":"2024-09-17T02:20:17.558593+0000","last_peered":"2024-09-17T02:20:17.558593+0000","last_clean":"2024-09-17T02:20:17.558593+0000","last_became_active":"2024-09-17T02:20:15.559104+0000","last_became_peered":"2024-09-17T02:20:15.559104+0000","last_unstale":"2024-09-17T02:20:17.558593+0000","last_undegraded":"2024-09-17T02:20:17.558593+0000","last_fullsized":"2024-09-17T02:20:17.558593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:44.299986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.562163+0000","last_change":"2024-09-17T02:20:16.585522+0000","last_active":"2024-09-17T02:20:17.562163+0000","last_peered":"2024-09-17T02:20:17.562163+0000","last_clean":"2024-09-17T02:20:17.562163+0000","last_became_active":"2024-09-17T02:20:16.584520+0000","last_became_peered":"2024-09-17T02:20:16.584520+0000","last_unstale":"2024-09-17T02:20:17.562163+0000","last_undegraded":"2024-09-17T02:20:17.562163+0000","last_fullsized":"2024-09-17T02:20:17.562163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:14.123192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560572+0000","last_change":"2024-09-17T02:20:12.512798+0000","last_active":"2024-09-17T02:20:17.560572+0000","last_peered":"2024-09-17T02:20:17.560572+0000","last_clean":"2024-09-17T02:20:17.560572+0000","last_became_active":"2024-09-17T02:20:10.502115+0000","last_became_peered":"2024-09-17T02:20:10.502115+0000","last_unstale":"2024-09-17T02:20:17.560572+0000","last_undegraded":"2024-09-17T02:20:17.560572+0000","last_fullsized":"2024-09-17T02:20:17.560572+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:17.554878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083467700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558499+0000","last_change":"2024-09-17T02:20:15.551632+0000","last_active":"2024-09-17T02:20:17.558499+0000","last_peered":"2024-09-17T02:20:17.558499+0000","last_clean":"2024-09-17T02:20:17.558499+0000","last_became_active":"2024-09-17T02:20:15.551062+0000","last_became_peered":"2024-09-17T02:20:15.551062+0000","last_unstale":"2024-09-17T02:20:17.558499+0000","last_undegraded":"2024-09-17T02:20:17.558499+0000","last_fullsized":"2024-09-17T02:20:17.558499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:55.295518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.648418+0000","last_change":"2024-09-17T02:20:16.571568+0000","last_active":"2024-09-17T02:20:22.648418+0000","last_peered":"2024-09-17T02:20:22.648418+0000","last_clean":"2024-09-17T02:20:22.648418+0000","last_became_active":"2024-09-17T02:20:16.570622+0000","last_became_peered":"2024-09-17T02:20:16.570622+0000","last_unstale":"2024-09-17T02:20:22.648418+0000","last_undegraded":"2024-09-17T02:20:22.648418+0000","last_fullsized":"2024-09-17T02:20:22.648418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:57.083446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558959+0000","last_change":"2024-09-17T02:20:12.511823+0000","last_active":"2024-09-17T02:20:17.558959+0000","last_peered":"2024-09-17T02:20:17.558959+0000","last_clean":"2024-09-17T02:20:17.558959+0000","last_became_active":"2024-09-17T02:20:10.497164+0000","last_became_peered":"2024-09-17T02:20:10.497164+0000","last_unstale":"2024-09-17T02:20:17.558959+0000","last_undegraded":"2024-09-17T02:20:17.558959+0000","last_fullsized":"2024-09-17T02:20:17.558959+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:21.242753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081052700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.646592+0000","last_change":"2024-09-17T02:20:15.569475+0000","last_active":"2024-09-17T02:20:22.646592+0000","last_peered":"2024-09-17T02:20:22.646592+0000","last_clean":"2024-09-17T02:20:22.646592+0000","last_became_active":"2024-09-17T02:20:15.567965+0000","last_became_peered":"2024-09-17T02:20:15.567965+0000","last_unstale":"2024-09-17T02:20:22.646592+0000","last_undegraded":"2024-09-17T02:20:22.646592+0000","last_fullsized":"2024-09-17T02:20:22.646592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:06.649112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560384+0000","last_change":"2024-09-17T02:20:16.578902+0000","last_active":"2024-09-17T02:20:17.560384+0000","last_peered":"2024-09-17T02:20:17.560384+0000","last_clean":"2024-09-17T02:20:17.560384+0000","last_became_active":"2024-09-17T02:20:16.576512+0000","last_became_peered":"2024-09-17T02:20:16.576512+0000","last_unstale":"2024-09-17T02:20:17.560384+0000","last_undegraded":"2024-09-17T02:20:17.560384+0000","last_fullsized":"2024-09-17T02:20:17.560384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:29.757455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560859+0000","last_change":"2024-09-17T02:20:12.512742+0000","last_active":"2024-09-17T02:20:17.560859+0000","last_peered":"2024-09-17T02:20:17.560859+0000","last_clean":"2024-09-17T02:20:17.560859+0000","last_became_active":"2024-09-17T02:20:10.503622+0000","last_became_peered":"2024-09-17T02:20:10.503622+0000","last_unstale":"2024-09-17T02:20:17.560859+0000","last_undegraded":"2024-09-17T02:20:17.560859+0000","last_fullsized":"2024-09-17T02:20:17.560859+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:36.226043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078085399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561586+0000","last_change":"2024-09-17T02:20:15.562840+0000","last_active":"2024-09-17T02:20:17.561586+0000","last_peered":"2024-09-17T02:20:17.561586+0000","last_clean":"2024-09-17T02:20:17.561586+0000","last_became_active":"2024-09-17T02:20:15.562177+0000","last_became_peered":"2024-09-17T02:20:15.562177+0000","last_unstale":"2024-09-17T02:20:17.561586+0000","last_undegraded":"2024-09-17T02:20:17.561586+0000","last_fullsized":"2024-09-17T02:20:17.561586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:39.709524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559748+0000","last_change":"2024-09-17T02:20:16.580184+0000","last_active":"2024-09-17T02:20:17.559748+0000","last_peered":"2024-09-17T02:20:17.559748+0000","last_clean":"2024-09-17T02:20:17.559748+0000","last_became_active":"2024-09-17T02:20:16.578343+0000","last_became_peered":"2024-09-17T02:20:16.578343+0000","last_unstale":"2024-09-17T02:20:17.559748+0000","last_undegraded":"2024-09-17T02:20:17.559748+0000","last_fullsized":"2024-09-17T02:20:17.559748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:42.123535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.562400+0000","last_change":"2024-09-17T02:20:15.562922+0000","last_active":"2024-09-17T02:20:17.562400+0000","last_peered":"2024-09-17T02:20:17.562400+0000","last_clean":"2024-09-17T02:20:17.562400+0000","last_became_active":"2024-09-17T02:20:15.562138+0000","last_became_peered":"2024-09-17T02:20:15.562138+0000","last_unstale":"2024-09-17T02:20:17.562400+0000","last_undegraded":"2024-09-17T02:20:17.562400+0000","last_fullsized":"2024-09-17T02:20:17.562400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:00.819275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559993+0000","last_change":"2024-09-17T02:20:12.511838+0000","last_active":"2024-09-17T02:20:17.559993+0000","last_peered":"2024-09-17T02:20:17.559993+0000","last_clean":"2024-09-17T02:20:17.559993+0000","last_became_active":"2024-09-17T02:20:10.497049+0000","last_became_peered":"2024-09-17T02:20:10.497049+0000","last_unstale":"2024-09-17T02:20:17.559993+0000","last_undegraded":"2024-09-17T02:20:17.559993+0000","last_fullsized":"2024-09-17T02:20:17.559993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:54.446484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079701100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.646841+0000","last_change":"2024-09-17T02:20:16.571485+0000","last_active":"2024-09-17T02:20:22.646841+0000","last_peered":"2024-09-17T02:20:22.646841+0000","last_clean":"2024-09-17T02:20:22.646841+0000","last_became_active":"2024-09-17T02:20:16.567570+0000","last_became_peered":"2024-09-17T02:20:16.567570+0000","last_unstale":"2024-09-17T02:20:22.646841+0000","last_undegraded":"2024-09-17T02:20:22.646841+0000","last_fullsized":"2024-09-17T02:20:22.646841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:14.228385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.559752+0000","last_change":"2024-09-17T02:20:15.559252+0000","last_active":"2024-09-17T02:20:17.559752+0000","last_peered":"2024-09-17T02:20:17.559752+0000","last_clean":"2024-09-17T02:20:17.559752+0000","last_became_active":"2024-09-17T02:20:15.557667+0000","last_became_peered":"2024-09-17T02:20:15.557667+0000","last_unstale":"2024-09-17T02:20:17.559752+0000","last_undegraded":"2024-09-17T02:20:17.559752+0000","last_fullsized":"2024-09-17T02:20:17.559752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:01.292626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.649204+0000","last_change":"2024-09-17T02:20:12.661034+0000","last_active":"2024-09-17T02:20:22.649204+0000","last_peered":"2024-09-17T02:20:22.649204+0000","last_clean":"2024-09-17T02:20:22.649204+0000","last_became_active":"2024-09-17T02:20:10.497829+0000","last_became_peered":"2024-09-17T02:20:10.497829+0000","last_unstale":"2024-09-17T02:20:22.649204+0000","last_undegraded":"2024-09-17T02:20:22.649204+0000","last_fullsized":"2024-09-17T02:20:22.649204+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:46:27.427685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096944700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.647519+0000","last_change":"2024-09-17T02:20:16.579478+0000","last_active":"2024-09-17T02:20:22.647519+0000","last_peered":"2024-09-17T02:20:22.647519+0000","last_clean":"2024-09-17T02:20:22.647519+0000","last_became_active":"2024-09-17T02:20:16.578705+0000","last_became_peered":"2024-09-17T02:20:16.578705+0000","last_unstale":"2024-09-17T02:20:22.647519+0000","last_undegraded":"2024-09-17T02:20:22.647519+0000","last_fullsized":"2024-09-17T02:20:22.647519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:21.656908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561074+0000","last_change":"2024-09-17T02:20:15.558961+0000","last_active":"2024-09-17T02:20:17.561074+0000","last_peered":"2024-09-17T02:20:17.561074+0000","last_clean":"2024-09-17T02:20:17.561074+0000","last_became_active":"2024-09-17T02:20:15.558299+0000","last_became_peered":"2024-09-17T02:20:15.558299+0000","last_unstale":"2024-09-17T02:20:17.561074+0000","last_undegraded":"2024-09-17T02:20:17.561074+0000","last_fullsized":"2024-09-17T02:20:17.561074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:39.709524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561104+0000","last_change":"2024-09-17T02:20:12.512481+0000","last_active":"2024-09-17T02:20:17.561104+0000","last_peered":"2024-09-17T02:20:17.561104+0000","last_clean":"2024-09-17T02:20:17.561104+0000","last_became_active":"2024-09-17T02:20:10.497021+0000","last_became_peered":"2024-09-17T02:20:10.497021+0000","last_unstale":"2024-09-17T02:20:17.561104+0000","last_undegraded":"2024-09-17T02:20:17.561104+0000","last_fullsized":"2024-09-17T02:20:17.561104+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:41.167283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001400079,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558440+0000","last_change":"2024-09-17T02:20:16.560687+0000","last_active":"2024-09-17T02:20:17.558440+0000","last_peered":"2024-09-17T02:20:17.558440+0000","last_clean":"2024-09-17T02:20:17.558440+0000","last_became_active":"2024-09-17T02:20:16.559758+0000","last_became_peered":"2024-09-17T02:20:16.559758+0000","last_unstale":"2024-09-17T02:20:17.558440+0000","last_undegraded":"2024-09-17T02:20:17.558440+0000","last_fullsized":"2024-09-17T02:20:17.558440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:54:33.088375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560971+0000","last_change":"2024-09-17T02:20:15.551758+0000","last_active":"2024-09-17T02:20:17.560971+0000","last_peered":"2024-09-17T02:20:17.560971+0000","last_clean":"2024-09-17T02:20:17.560971+0000","last_became_active":"2024-09-17T02:20:15.550353+0000","last_became_peered":"2024-09-17T02:20:15.550353+0000","last_unstale":"2024-09-17T02:20:17.560971+0000","last_undegraded":"2024-09-17T02:20:17.560971+0000","last_fullsized":"2024-09-17T02:20:17.560971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:04.229911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561418+0000","last_change":"2024-09-17T02:20:12.513530+0000","last_active":"2024-09-17T02:20:17.561418+0000","last_peered":"2024-09-17T02:20:17.561418+0000","last_clean":"2024-09-17T02:20:17.561418+0000","last_became_active":"2024-09-17T02:20:10.502692+0000","last_became_peered":"2024-09-17T02:20:10.502692+0000","last_unstale":"2024-09-17T02:20:17.561418+0000","last_undegraded":"2024-09-17T02:20:17.561418+0000","last_fullsized":"2024-09-17T02:20:17.561418+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:53.004641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015329009999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.646544+0000","last_change":"2024-09-17T02:20:16.575882+0000","last_active":"2024-09-17T02:20:22.646544+0000","last_peered":"2024-09-17T02:20:22.646544+0000","last_clean":"2024-09-17T02:20:22.646544+0000","last_became_active":"2024-09-17T02:20:16.573968+0000","last_became_peered":"2024-09-17T02:20:16.573968+0000","last_unstale":"2024-09-17T02:20:22.646544+0000","last_undegraded":"2024-09-17T02:20:22.646544+0000","last_fullsized":"2024-09-17T02:20:22.646544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:18.090082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560482+0000","last_change":"2024-09-17T02:20:16.582881+0000","last_active":"2024-09-17T02:20:17.560482+0000","last_peered":"2024-09-17T02:20:17.560482+0000","last_clean":"2024-09-17T02:20:17.560482+0000","last_became_active":"2024-09-17T02:20:16.580985+0000","last_became_peered":"2024-09-17T02:20:16.580985+0000","last_unstale":"2024-09-17T02:20:17.560482+0000","last_undegraded":"2024-09-17T02:20:17.560482+0000","last_fullsized":"2024-09-17T02:20:17.560482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:10.315951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.562026+0000","last_change":"2024-09-17T02:20:15.558925+0000","last_active":"2024-09-17T02:20:17.562026+0000","last_peered":"2024-09-17T02:20:17.562026+0000","last_clean":"2024-09-17T02:20:17.562026+0000","last_became_active":"2024-09-17T02:20:15.558174+0000","last_became_peered":"2024-09-17T02:20:15.558174+0000","last_unstale":"2024-09-17T02:20:17.562026+0000","last_undegraded":"2024-09-17T02:20:17.562026+0000","last_fullsized":"2024-09-17T02:20:17.562026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:55.639841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558215+0000","last_change":"2024-09-17T02:20:16.579411+0000","last_active":"2024-09-17T02:20:17.558215+0000","last_peered":"2024-09-17T02:20:17.558215+0000","last_clean":"2024-09-17T02:20:17.558215+0000","last_became_active":"2024-09-17T02:20:16.576294+0000","last_became_peered":"2024-09-17T02:20:16.576294+0000","last_unstale":"2024-09-17T02:20:17.558215+0000","last_undegraded":"2024-09-17T02:20:17.558215+0000","last_fullsized":"2024-09-17T02:20:17.558215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:41:31.822425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.648911+0000","last_change":"2024-09-17T02:20:15.569117+0000","last_active":"2024-09-17T02:20:22.648911+0000","last_peered":"2024-09-17T02:20:22.648911+0000","last_clean":"2024-09-17T02:20:22.648911+0000","last_became_active":"2024-09-17T02:20:15.567405+0000","last_became_peered":"2024-09-17T02:20:15.567405+0000","last_unstale":"2024-09-17T02:20:22.648911+0000","last_undegraded":"2024-09-17T02:20:22.648911+0000","last_fullsized":"2024-09-17T02:20:22.648911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:55:10.186481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561160+0000","last_change":"2024-09-17T02:20:15.562827+0000","last_active":"2024-09-17T02:20:17.561160+0000","last_peered":"2024-09-17T02:20:17.561160+0000","last_clean":"2024-09-17T02:20:17.561160+0000","last_became_active":"2024-09-17T02:20:15.562073+0000","last_became_peered":"2024-09-17T02:20:15.562073+0000","last_unstale":"2024-09-17T02:20:17.561160+0000","last_undegraded":"2024-09-17T02:20:17.561160+0000","last_fullsized":"2024-09-17T02:20:17.561160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:17.866665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558226+0000","last_change":"2024-09-17T02:20:16.577670+0000","last_active":"2024-09-17T02:20:17.558226+0000","last_peered":"2024-09-17T02:20:17.558226+0000","last_clean":"2024-09-17T02:20:17.558226+0000","last_became_active":"2024-09-17T02:20:16.575082+0000","last_became_peered":"2024-09-17T02:20:16.575082+0000","last_unstale":"2024-09-17T02:20:17.558226+0000","last_undegraded":"2024-09-17T02:20:17.558226+0000","last_fullsized":"2024-09-17T02:20:17.558226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:21.356437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560821+0000","last_change":"2024-09-17T02:20:15.555513+0000","last_active":"2024-09-17T02:20:17.560821+0000","last_peered":"2024-09-17T02:20:17.560821+0000","last_clean":"2024-09-17T02:20:17.560821+0000","last_became_active":"2024-09-17T02:20:15.554256+0000","last_became_peered":"2024-09-17T02:20:15.554256+0000","last_unstale":"2024-09-17T02:20:17.560821+0000","last_undegraded":"2024-09-17T02:20:17.560821+0000","last_fullsized":"2024-09-17T02:20:17.560821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:52.985837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558359+0000","last_change":"2024-09-17T02:20:16.577803+0000","last_active":"2024-09-17T02:20:17.558359+0000","last_peered":"2024-09-17T02:20:17.558359+0000","last_clean":"2024-09-17T02:20:17.558359+0000","last_became_active":"2024-09-17T02:20:16.576640+0000","last_became_peered":"2024-09-17T02:20:16.576640+0000","last_unstale":"2024-09-17T02:20:17.558359+0000","last_undegraded":"2024-09-17T02:20:17.558359+0000","last_fullsized":"2024-09-17T02:20:17.558359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:07.190169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.649215+0000","last_change":"2024-09-17T02:20:16.571738+0000","last_active":"2024-09-17T02:20:22.649215+0000","last_peered":"2024-09-17T02:20:22.649215+0000","last_clean":"2024-09-17T02:20:22.649215+0000","last_became_active":"2024-09-17T02:20:16.568615+0000","last_became_peered":"2024-09-17T02:20:16.568615+0000","last_unstale":"2024-09-17T02:20:22.649215+0000","last_undegraded":"2024-09-17T02:20:22.649215+0000","last_fullsized":"2024-09-17T02:20:22.649215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:42.931361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558692+0000","last_change":"2024-09-17T02:20:15.558467+0000","last_active":"2024-09-17T02:20:17.558692+0000","last_peered":"2024-09-17T02:20:17.558692+0000","last_clean":"2024-09-17T02:20:17.558692+0000","last_became_active":"2024-09-17T02:20:15.557186+0000","last_became_peered":"2024-09-17T02:20:15.557186+0000","last_unstale":"2024-09-17T02:20:17.558692+0000","last_undegraded":"2024-09-17T02:20:17.558692+0000","last_fullsized":"2024-09-17T02:20:17.558692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:56.879445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560355+0000","last_change":"2024-09-17T02:20:16.577527+0000","last_active":"2024-09-17T02:20:17.560355+0000","last_peered":"2024-09-17T02:20:17.560355+0000","last_clean":"2024-09-17T02:20:17.560355+0000","last_became_active":"2024-09-17T02:20:16.574761+0000","last_became_peered":"2024-09-17T02:20:16.574761+0000","last_unstale":"2024-09-17T02:20:17.560355+0000","last_undegraded":"2024-09-17T02:20:17.560355+0000","last_fullsized":"2024-09-17T02:20:17.560355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:43.309196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.558428+0000","last_change":"2024-09-17T02:20:15.552417+0000","last_active":"2024-09-17T02:20:17.558428+0000","last_peered":"2024-09-17T02:20:17.558428+0000","last_clean":"2024-09-17T02:20:17.558428+0000","last_became_active":"2024-09-17T02:20:15.551609+0000","last_became_peered":"2024-09-17T02:20:15.551609+0000","last_unstale":"2024-09-17T02:20:17.558428+0000","last_undegraded":"2024-09-17T02:20:17.558428+0000","last_fullsized":"2024-09-17T02:20:17.558428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:15.782658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.648238+0000","last_change":"2024-09-17T02:20:16.591978+0000","last_active":"2024-09-17T02:20:22.648238+0000","last_peered":"2024-09-17T02:20:22.648238+0000","last_clean":"2024-09-17T02:20:22.648238+0000","last_became_active":"2024-09-17T02:20:16.591378+0000","last_became_peered":"2024-09-17T02:20:16.591378+0000","last_unstale":"2024-09-17T02:20:22.648238+0000","last_undegraded":"2024-09-17T02:20:22.648238+0000","last_fullsized":"2024-09-17T02:20:22.648238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:44.489118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.647204+0000","last_change":"2024-09-17T02:20:15.565262+0000","last_active":"2024-09-17T02:20:22.647204+0000","last_peered":"2024-09-17T02:20:22.647204+0000","last_clean":"2024-09-17T02:20:22.647204+0000","last_became_active":"2024-09-17T02:20:15.564415+0000","last_became_peered":"2024-09-17T02:20:15.564415+0000","last_unstale":"2024-09-17T02:20:22.647204+0000","last_undegraded":"2024-09-17T02:20:22.647204+0000","last_fullsized":"2024-09-17T02:20:22.647204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:42.049312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.647968+0000","last_change":"2024-09-17T02:20:16.573407+0000","last_active":"2024-09-17T02:20:22.647968+0000","last_peered":"2024-09-17T02:20:22.647968+0000","last_clean":"2024-09-17T02:20:22.647968+0000","last_became_active":"2024-09-17T02:20:16.570987+0000","last_became_peered":"2024-09-17T02:20:16.570987+0000","last_unstale":"2024-09-17T02:20:22.647968+0000","last_undegraded":"2024-09-17T02:20:22.647968+0000","last_fullsized":"2024-09-17T02:20:22.647968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:23:09.424550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.647821+0000","last_change":"2024-09-17T02:20:15.568883+0000","last_active":"2024-09-17T02:20:22.647821+0000","last_peered":"2024-09-17T02:20:22.647821+0000","last_clean":"2024-09-17T02:20:22.647821+0000","last_became_active":"2024-09-17T02:20:15.567980+0000","last_became_peered":"2024-09-17T02:20:15.567980+0000","last_unstale":"2024-09-17T02:20:22.647821+0000","last_undegraded":"2024-09-17T02:20:22.647821+0000","last_fullsized":"2024-09-17T02:20:22.647821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:04.059900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561194+0000","last_change":"2024-09-17T02:20:16.568209+0000","last_active":"2024-09-17T02:20:17.561194+0000","last_peered":"2024-09-17T02:20:17.561194+0000","last_clean":"2024-09-17T02:20:17.561194+0000","last_became_active":"2024-09-17T02:20:16.566585+0000","last_became_peered":"2024-09-17T02:20:16.566585+0000","last_unstale":"2024-09-17T02:20:17.561194+0000","last_undegraded":"2024-09-17T02:20:17.561194+0000","last_fullsized":"2024-09-17T02:20:17.561194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:44:59.713633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.561836+0000","last_change":"2024-09-17T02:20:15.558296+0000","last_active":"2024-09-17T02:20:17.561836+0000","last_peered":"2024-09-17T02:20:17.561836+0000","last_clean":"2024-09-17T02:20:17.561836+0000","last_became_active":"2024-09-17T02:20:15.557520+0000","last_became_peered":"2024-09-17T02:20:15.557520+0000","last_unstale":"2024-09-17T02:20:17.561836+0000","last_undegraded":"2024-09-17T02:20:17.561836+0000","last_fullsized":"2024-09-17T02:20:17.561836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:04.229911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560569+0000","last_change":"2024-09-17T02:20:16.568334+0000","last_active":"2024-09-17T02:20:17.560569+0000","last_peered":"2024-09-17T02:20:17.560569+0000","last_clean":"2024-09-17T02:20:17.560569+0000","last_became_active":"2024-09-17T02:20:16.566982+0000","last_became_peered":"2024-09-17T02:20:16.566982+0000","last_unstale":"2024-09-17T02:20:17.560569+0000","last_undegraded":"2024-09-17T02:20:17.560569+0000","last_fullsized":"2024-09-17T02:20:17.560569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:55.083688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.648518+0000","last_change":"2024-09-17T02:20:15.569712+0000","last_active":"2024-09-17T02:20:22.648518+0000","last_peered":"2024-09-17T02:20:22.648518+0000","last_clean":"2024-09-17T02:20:22.648518+0000","last_became_active":"2024-09-17T02:20:15.569106+0000","last_became_peered":"2024-09-17T02:20:15.569106+0000","last_unstale":"2024-09-17T02:20:22.648518+0000","last_undegraded":"2024-09-17T02:20:22.648518+0000","last_fullsized":"2024-09-17T02:20:22.648518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:02.822970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:20:22.647039+0000","last_change":"2024-09-17T02:20:16.570456+0000","last_active":"2024-09-17T02:20:22.647039+0000","last_peered":"2024-09-17T02:20:22.647039+0000","last_clean":"2024-09-17T02:20:22.647039+0000","last_became_active":"2024-09-17T02:20:16.568095+0000","last_became_peered":"2024-09-17T02:20:16.568095+0000","last_unstale":"2024-09-17T02:20:22.647039+0000","last_undegraded":"2024-09-17T02:20:22.647039+0000","last_fullsized":"2024-09-17T02:20:22.647039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:58.329169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560601+0000","last_change":"2024-09-17T02:20:15.560293+0000","last_active":"2024-09-17T02:20:17.560601+0000","last_peered":"2024-09-17T02:20:17.560601+0000","last_clean":"2024-09-17T02:20:17.560601+0000","last_became_active":"2024-09-17T02:20:15.559074+0000","last_became_peered":"2024-09-17T02:20:15.559074+0000","last_unstale":"2024-09-17T02:20:17.560601+0000","last_undegraded":"2024-09-17T02:20:17.560601+0000","last_fullsized":"2024-09-17T02:20:17.560601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:55.639841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560319+0000","last_change":"2024-09-17T02:20:16.570950+0000","last_active":"2024-09-17T02:20:17.560319+0000","last_peered":"2024-09-17T02:20:17.560319+0000","last_clean":"2024-09-17T02:20:17.560319+0000","last_became_active":"2024-09-17T02:20:16.569496+0000","last_became_peered":"2024-09-17T02:20:16.569496+0000","last_unstale":"2024-09-17T02:20:17.560319+0000","last_undegraded":"2024-09-17T02:20:17.560319+0000","last_fullsized":"2024-09-17T02:20:17.560319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:29.757455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T02:20:17.560576+0000","last_change":"2024-09-17T02:20:15.544675+0000","last_active":"2024-09-17T02:20:17.560576+0000","last_peered":"2024-09-17T02:20:17.560576+0000","last_clean":"2024-09-17T02:20:17.560576+0000","last_became_active":"2024-09-17T02:20:15.544213+0000","last_became_peered":"2024-09-17T02:20:15.544213+0000","last_unstale":"2024-09-17T02:20:17.560576+0000","last_undegraded":"2024-09-17T02:20:17.560576+0000","last_fullsized":"2024-09-17T02:20:17.560576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:31.933850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35600,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336240,"statfs":{"total":96636764160,"available":96600309760,"internally_reserved":0,"allocated":253952,"data_stored":654086,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":266240,"data_stored":654721,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":62559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T02:20:29.346 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T02:20:29.346 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-17T02:20:29.693 INFO:teuthology.orchestra.run.smithi001.stdout:epoch 21 2024-09-17T02:20:29.693 INFO:teuthology.orchestra.run.smithi001.stdout:fsid 37cd4495-4915-41f4-bad2-2394cbe235f3 2024-09-17T02:20:29.693 INFO:teuthology.orchestra.run.smithi001.stdout:created 2024-09-17T02:19:52.516342+0000 2024-09-17T02:20:29.693 INFO:teuthology.orchestra.run.smithi001.stdout:modified 2024-09-17T02:20:22.420667+0000 2024-09-17T02:20:29.693 INFO:teuthology.orchestra.run.smithi001.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-17T02:20:29.694 INFO:teuthology.orchestra.run.smithi001.stdout:crush_version 5 2024-09-17T02:20:29.694 INFO:teuthology.orchestra.run.smithi001.stdout:full_ratio 0.95 2024-09-17T02:20:29.694 INFO:teuthology.orchestra.run.smithi001.stdout:backfillfull_ratio 0.9 2024-09-17T02:20:29.694 INFO:teuthology.orchestra.run.smithi001.stdout:nearfull_ratio 0.85 2024-09-17T02:20:29.694 INFO:teuthology.orchestra.run.smithi001.stdout:require_min_compat_client luminous 2024-09-17T02:20:29.694 INFO:teuthology.orchestra.run.smithi001.stdout:min_compat_client jewel 2024-09-17T02:20:29.694 INFO:teuthology.orchestra.run.smithi001.stdout:require_osd_release squid 2024-09-17T02:20:29.694 INFO:teuthology.orchestra.run.smithi001.stdout:stretch_mode_enabled false 2024-09-17T02:20:29.694 INFO:teuthology.orchestra.run.smithi001.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 12 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-09-17T02:20:29.694 INFO:teuthology.orchestra.run.smithi001.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 16 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.50 2024-09-17T02:20:29.695 INFO:teuthology.orchestra.run.smithi001.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-09-17T02:20:29.695 INFO:teuthology.orchestra.run.smithi001.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-09-17T02:20:29.695 INFO:teuthology.orchestra.run.smithi001.stdout:max_osd 3 2024-09-17T02:20:29.695 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0 up in weight 1 up_from 9 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6800/2347677104,v1:172.21.15.32:6801/2347677104] [v2:172.21.15.32:6802/2347677104,v1:172.21.15.32:6803/2347677104] exists,up fae746a8-754d-4e52-9819-004ebb0d6886 2024-09-17T02:20:29.695 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1 up in weight 1 up_from 8 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6800/1905904204,v1:172.21.15.153:6801/1905904204] [v2:172.21.15.153:6802/1905904204,v1:172.21.15.153:6803/1905904204] exists,up c9397688-80ca-4c21-b80d-1740194c389d 2024-09-17T02:20:29.695 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2 up in weight 1 up_from 8 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.164:6800/603659517,v1:172.21.15.164:6801/603659517] [v2:172.21.15.164:6802/603659517,v1:172.21.15.164:6803/603659517] exists,up 6d8c01a8-b657-4abc-a624-2b35ef0512ea 2024-09-17T02:20:29.712 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 9 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6800/2347677104,v1:172.21.15.32:6801/2347677104] [v2:172.21.15.32:6802/2347677104,v1:172.21.15.32:6803/2347677104] exists,up fae746a8-754d-4e52-9819-004ebb0d6886', 'osd.1 up in weight 1 up_from 8 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6800/1905904204,v1:172.21.15.153:6801/1905904204] [v2:172.21.15.153:6802/1905904204,v1:172.21.15.153:6803/1905904204] exists,up c9397688-80ca-4c21-b80d-1740194c389d', 'osd.2 up in weight 1 up_from 8 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.164:6800/603659517,v1:172.21.15.164:6801/603659517] [v2:172.21.15.164:6802/603659517,v1:172.21.15.164:6803/603659517] exists,up 6d8c01a8-b657-4abc-a624-2b35ef0512ea'] 2024-09-17T02:20:29.713 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-17T02:20:29.832 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-17T02:20:29.832 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mon.a", 2024-09-17T02:20:29.832 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster": "ceph", 2024-09-17T02:20:29.832 INFO:teuthology.orchestra.run.smithi001.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-17T02:20:29.832 INFO:teuthology.orchestra.run.smithi001.stdout: "admin_socket_mode": "", 2024-09-17T02:20:29.832 INFO:teuthology.orchestra.run.smithi001.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-17T02:20:29.832 INFO:teuthology.orchestra.run.smithi001.stdout: "auth_client_required": "cephx, none", 2024-09-17T02:20:29.832 INFO:teuthology.orchestra.run.smithi001.stdout: "auth_cluster_required": "cephx", 2024-09-17T02:20:29.832 INFO:teuthology.orchestra.run.smithi001.stdout: "auth_debug": "true", 2024-09-17T02:20:29.832 INFO:teuthology.orchestra.run.smithi001.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-17T02:20:29.832 INFO:teuthology.orchestra.run.smithi001.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-17T02:20:29.833 INFO:teuthology.orchestra.run.smithi001.stdout: "auth_service_required": "cephx", 2024-09-17T02:20:29.833 INFO:teuthology.orchestra.run.smithi001.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-17T02:20:29.833 INFO:teuthology.orchestra.run.smithi001.stdout: "auth_supported": "cephx", 2024-09-17T02:20:29.833 INFO:teuthology.orchestra.run.smithi001.stdout: "bdev_aio": "true", 2024-09-17T02:20:29.833 INFO:teuthology.orchestra.run.smithi001.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-17T02:20:29.833 INFO:teuthology.orchestra.run.smithi001.stdout: "bdev_aio_poll_ms": "250", 2024-09-17T02:20:29.833 INFO:teuthology.orchestra.run.smithi001.stdout: "bdev_aio_reap_max": "16", 2024-09-17T02:20:29.833 INFO:teuthology.orchestra.run.smithi001.stdout: "bdev_async_discard": "false", 2024-09-17T02:20:29.833 INFO:teuthology.orchestra.run.smithi001.stdout: "bdev_block_size": "4096", 2024-09-17T02:20:29.833 INFO:teuthology.orchestra.run.smithi001.stdout: "bdev_debug_aio": "false", 2024-09-17T02:20:29.833 INFO:teuthology.orchestra.run.smithi001.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-17T02:20:29.833 INFO:teuthology.orchestra.run.smithi001.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-17T02:20:29.833 INFO:teuthology.orchestra.run.smithi001.stdout: "bdev_debug_inflight_ios": "false", 2024-09-17T02:20:29.834 INFO:teuthology.orchestra.run.smithi001.stdout: "bdev_enable_discard": "false", 2024-09-17T02:20:29.834 INFO:teuthology.orchestra.run.smithi001.stdout: "bdev_flock_retry": "3", 2024-09-17T02:20:29.834 INFO:teuthology.orchestra.run.smithi001.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-17T02:20:29.834 INFO:teuthology.orchestra.run.smithi001.stdout: "bdev_inject_crash": "0", 2024-09-17T02:20:29.834 INFO:teuthology.orchestra.run.smithi001.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-17T02:20:29.834 INFO:teuthology.orchestra.run.smithi001.stdout: "bdev_ioring": "false", 2024-09-17T02:20:29.834 INFO:teuthology.orchestra.run.smithi001.stdout: "bdev_ioring_hipri": "false", 2024-09-17T02:20:29.834 INFO:teuthology.orchestra.run.smithi001.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-17T02:20:29.834 INFO:teuthology.orchestra.run.smithi001.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-17T02:20:29.834 INFO:teuthology.orchestra.run.smithi001.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-17T02:20:29.834 INFO:teuthology.orchestra.run.smithi001.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-17T02:20:29.834 INFO:teuthology.orchestra.run.smithi001.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-17T02:20:29.834 INFO:teuthology.orchestra.run.smithi001.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-17T02:20:29.835 INFO:teuthology.orchestra.run.smithi001.stdout: "bdev_type": "", 2024-09-17T02:20:29.835 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_alloc_size": "1048576", 2024-09-17T02:20:29.835 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_allocator": "hybrid", 2024-09-17T02:20:29.835 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_buffered_io": "true", 2024-09-17T02:20:29.835 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_check_for_zeros": "false", 2024-09-17T02:20:29.835 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-17T02:20:29.835 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-17T02:20:29.835 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_compact_log_sync": "false", 2024-09-17T02:20:29.835 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-17T02:20:29.835 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-17T02:20:29.835 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-17T02:20:29.835 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-17T02:20:29.835 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_max_log_runway": "4194304", 2024-09-17T02:20:29.836 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_max_prefetch": "1048576", 2024-09-17T02:20:29.836 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_min_flush_size": "524288", 2024-09-17T02:20:29.836 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_min_log_runway": "1048576", 2024-09-17T02:20:29.836 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_replay_recovery": "false", 2024-09-17T02:20:29.836 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-17T02:20:29.836 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-17T02:20:29.836 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_sync_write": "false", 2024-09-17T02:20:29.836 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-17T02:20:29.836 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-17T02:20:29.836 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-17T02:20:29.837 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_allocation_from_file": "true", 2024-09-17T02:20:29.837 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_allocator": "hybrid", 2024-09-17T02:20:29.837 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-17T02:20:29.837 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-17T02:20:29.837 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-17T02:20:29.837 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-17T02:20:29.837 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_bdev_label_multi": "true", 2024-09-17T02:20:29.837 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-17T02:20:29.837 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-17T02:20:29.838 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-17T02:20:29.838 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-17T02:20:29.838 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-17T02:20:29.838 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_block_create": "true", 2024-09-17T02:20:29.838 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_block_db_create": "false", 2024-09-17T02:20:29.838 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_block_db_path": "", 2024-09-17T02:20:29.838 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_block_db_size": "0", 2024-09-17T02:20:29.838 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_block_path": "", 2024-09-17T02:20:29.838 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_block_preallocate_file": "false", 2024-09-17T02:20:29.839 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_block_size": "107374182400", 2024-09-17T02:20:29.839 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_block_wal_create": "false", 2024-09-17T02:20:29.839 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_block_wal_path": "", 2024-09-17T02:20:29.839 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_block_wal_size": "100663296", 2024-09-17T02:20:29.839 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_bluefs": "true", 2024-09-17T02:20:29.839 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-17T02:20:29.839 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-17T02:20:29.839 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-17T02:20:29.839 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-17T02:20:29.839 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-17T02:20:29.839 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-17T02:20:29.839 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-17T02:20:29.839 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-17T02:20:29.839 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_autotune": "true", 2024-09-17T02:20:29.840 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-17T02:20:29.840 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-17T02:20:29.840 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-17T02:20:29.840 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-17T02:20:29.840 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_size": "0", 2024-09-17T02:20:29.840 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-17T02:20:29.840 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-17T02:20:29.840 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-17T02:20:29.840 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-17T02:20:29.840 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_type": "2q", 2024-09-17T02:20:29.840 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-17T02:20:29.840 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_clone_cow": "true", 2024-09-17T02:20:29.840 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-17T02:20:29.841 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-17T02:20:29.841 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-17T02:20:29.841 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-17T02:20:29.841 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-17T02:20:29.841 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-17T02:20:29.841 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-17T02:20:29.841 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_compression_mode": "none", 2024-09-17T02:20:29.841 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-17T02:20:29.841 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_csum_type": "crc32c", 2024-09-17T02:20:29.841 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-17T02:20:29.841 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_debug_freelist": "false", 2024-09-17T02:20:29.841 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-17T02:20:29.841 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-17T02:20:29.842 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-17T02:20:29.842 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-17T02:20:29.842 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-17T02:20:29.842 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-17T02:20:29.842 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-17T02:20:29.842 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-17T02:20:29.842 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-17T02:20:29.842 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-17T02:20:29.842 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-17T02:20:29.842 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-17T02:20:29.842 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_debug_small_allocations": "0", 2024-09-17T02:20:29.842 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-17T02:20:29.842 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_default_buffered_read": "true", 2024-09-17T02:20:29.843 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_default_buffered_write": "false", 2024-09-17T02:20:29.843 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-17T02:20:29.843 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-17T02:20:29.843 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-17T02:20:29.843 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-17T02:20:29.843 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-17T02:20:29.843 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-17T02:20:29.843 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-17T02:20:29.843 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-17T02:20:29.843 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-17T02:20:29.843 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fail_eio": "false", 2024-09-17T02:20:29.843 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-17T02:20:29.843 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-17T02:20:29.844 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-17T02:20:29.844 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-17T02:20:29.844 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-17T02:20:29.844 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-17T02:20:29.844 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_on_mount": "false", 2024-09-17T02:20:29.844 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-17T02:20:29.844 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_on_umount": "false", 2024-09-17T02:20:29.844 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-17T02:20:29.844 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-17T02:20:29.844 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-17T02:20:29.844 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-17T02:20:29.844 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-17T02:20:29.844 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-17T02:20:29.845 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-17T02:20:29.845 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-17T02:20:29.845 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_ignore_data_csum": "false", 2024-09-17T02:20:29.845 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-17T02:20:29.845 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-17T02:20:29.845 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-17T02:20:29.845 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-17T02:20:29.845 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_log_op_age": "5.000000", 2024-09-17T02:20:29.845 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_max_alloc_size": "0", 2024-09-17T02:20:29.845 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_max_blob_size": "0", 2024-09-17T02:20:29.845 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-17T02:20:29.845 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-17T02:20:29.845 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-17T02:20:29.845 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_max_deferred_txc": "32", 2024-09-17T02:20:29.846 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_min_alloc_size": "0", 2024-09-17T02:20:29.846 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-17T02:20:29.846 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-17T02:20:29.846 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_nid_prealloc": "1024", 2024-09-17T02:20:29.846 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-17T02:20:29.846 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-17T02:20:29.846 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-17T02:20:29.846 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-17T02:20:29.846 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_retry_disk_reads": "3", 2024-09-17T02:20:29.846 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_rocksdb_cf": "true", 2024-09-17T02:20:29.846 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-17T02:20:29.846 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-17T02:20:29.847 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-17T02:20:29.847 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-17T02:20:29.847 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-17T02:20:29.847 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-17T02:20:29.847 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-17T02:20:29.847 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-17T02:20:29.847 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_spdk_mem": "512", 2024-09-17T02:20:29.847 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-17T02:20:29.847 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-17T02:20:29.847 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-17T02:20:29.847 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-17T02:20:29.847 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-17T02:20:29.848 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-17T02:20:29.848 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-17T02:20:29.848 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_tracing": "false", 2024-09-17T02:20:29.848 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-17T02:20:29.848 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-17T02:20:29.848 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-17T02:20:29.848 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-17T02:20:29.848 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-17T02:20:29.848 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-17T02:20:29.848 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-17T02:20:29.849 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-17T02:20:29.849 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-17T02:20:29.849 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_zero_block_detection": "false", 2024-09-17T02:20:29.849 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-17T02:20:29.849 INFO:teuthology.orchestra.run.smithi001.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-17T02:20:29.849 INFO:teuthology.orchestra.run.smithi001.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-17T02:20:29.849 INFO:teuthology.orchestra.run.smithi001.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-17T02:20:29.849 INFO:teuthology.orchestra.run.smithi001.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-17T02:20:29.849 INFO:teuthology.orchestra.run.smithi001.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-17T02:20:29.849 INFO:teuthology.orchestra.run.smithi001.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-17T02:20:29.849 INFO:teuthology.orchestra.run.smithi001.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-17T02:20:29.849 INFO:teuthology.orchestra.run.smithi001.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-17T02:20:29.849 INFO:teuthology.orchestra.run.smithi001.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-17T02:20:29.849 INFO:teuthology.orchestra.run.smithi001.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-17T02:20:29.850 INFO:teuthology.orchestra.run.smithi001.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-17T02:20:29.850 INFO:teuthology.orchestra.run.smithi001.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-17T02:20:29.850 INFO:teuthology.orchestra.run.smithi001.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-17T02:20:29.850 INFO:teuthology.orchestra.run.smithi001.stdout: "cephx_cluster_require_signatures": "false", 2024-09-17T02:20:29.850 INFO:teuthology.orchestra.run.smithi001.stdout: "cephx_cluster_require_version": "2", 2024-09-17T02:20:29.850 INFO:teuthology.orchestra.run.smithi001.stdout: "cephx_require_signatures": "false", 2024-09-17T02:20:29.850 INFO:teuthology.orchestra.run.smithi001.stdout: "cephx_require_version": "2", 2024-09-17T02:20:29.850 INFO:teuthology.orchestra.run.smithi001.stdout: "cephx_service_require_signatures": "false", 2024-09-17T02:20:29.850 INFO:teuthology.orchestra.run.smithi001.stdout: "cephx_service_require_version": "2", 2024-09-17T02:20:29.850 INFO:teuthology.orchestra.run.smithi001.stdout: "cephx_sign_messages": "true", 2024-09-17T02:20:29.850 INFO:teuthology.orchestra.run.smithi001.stdout: "chdir": "", 2024-09-17T02:20:29.850 INFO:teuthology.orchestra.run.smithi001.stdout: "client_acl_type": "", 2024-09-17T02:20:29.850 INFO:teuthology.orchestra.run.smithi001.stdout: "client_asio_thread_count": "2", 2024-09-17T02:20:29.851 INFO:teuthology.orchestra.run.smithi001.stdout: "client_cache_mid": "0.750000", 2024-09-17T02:20:29.851 INFO:teuthology.orchestra.run.smithi001.stdout: "client_cache_size": "16384", 2024-09-17T02:20:29.851 INFO:teuthology.orchestra.run.smithi001.stdout: "client_caps_release_delay": "5", 2024-09-17T02:20:29.851 INFO:teuthology.orchestra.run.smithi001.stdout: "client_check_pool_perm": "true", 2024-09-17T02:20:29.851 INFO:teuthology.orchestra.run.smithi001.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-17T02:20:29.851 INFO:teuthology.orchestra.run.smithi001.stdout: "client_debug_force_sync_read": "false", 2024-09-17T02:20:29.851 INFO:teuthology.orchestra.run.smithi001.stdout: "client_debug_getattr_caps": "false", 2024-09-17T02:20:29.851 INFO:teuthology.orchestra.run.smithi001.stdout: "client_debug_inject_features": "", 2024-09-17T02:20:29.851 INFO:teuthology.orchestra.run.smithi001.stdout: "client_debug_inject_tick_delay": "0", 2024-09-17T02:20:29.851 INFO:teuthology.orchestra.run.smithi001.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-17T02:20:29.851 INFO:teuthology.orchestra.run.smithi001.stdout: "client_die_on_failed_remount": "false", 2024-09-17T02:20:29.851 INFO:teuthology.orchestra.run.smithi001.stdout: "client_dirsize_rbytes": "true", 2024-09-17T02:20:29.851 INFO:teuthology.orchestra.run.smithi001.stdout: "client_force_lazyio": "false", 2024-09-17T02:20:29.851 INFO:teuthology.orchestra.run.smithi001.stdout: "client_fs": "", 2024-09-17T02:20:29.852 INFO:teuthology.orchestra.run.smithi001.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-17T02:20:29.852 INFO:teuthology.orchestra.run.smithi001.stdout: "client_inject_release_failure": "false", 2024-09-17T02:20:29.852 INFO:teuthology.orchestra.run.smithi001.stdout: "client_max_inline_size": "4096", 2024-09-17T02:20:29.852 INFO:teuthology.orchestra.run.smithi001.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-17T02:20:29.852 INFO:teuthology.orchestra.run.smithi001.stdout: "client_mds_namespace": "", 2024-09-17T02:20:29.852 INFO:teuthology.orchestra.run.smithi001.stdout: "client_metadata": "", 2024-09-17T02:20:29.852 INFO:teuthology.orchestra.run.smithi001.stdout: "client_mount_gid": "-1", 2024-09-17T02:20:29.852 INFO:teuthology.orchestra.run.smithi001.stdout: "client_mount_timeout": "300", 2024-09-17T02:20:29.852 INFO:teuthology.orchestra.run.smithi001.stdout: "client_mount_uid": "-1", 2024-09-17T02:20:29.852 INFO:teuthology.orchestra.run.smithi001.stdout: "client_mountpoint": "/", 2024-09-17T02:20:29.852 INFO:teuthology.orchestra.run.smithi001.stdout: "client_notify_timeout": "10", 2024-09-17T02:20:29.852 INFO:teuthology.orchestra.run.smithi001.stdout: "client_oc": "true", 2024-09-17T02:20:29.852 INFO:teuthology.orchestra.run.smithi001.stdout: "client_oc_max_dirty": "104857600", 2024-09-17T02:20:29.853 INFO:teuthology.orchestra.run.smithi001.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-17T02:20:29.853 INFO:teuthology.orchestra.run.smithi001.stdout: "client_oc_max_objects": "1000", 2024-09-17T02:20:29.853 INFO:teuthology.orchestra.run.smithi001.stdout: "client_oc_size": "209715200", 2024-09-17T02:20:29.853 INFO:teuthology.orchestra.run.smithi001.stdout: "client_oc_target_dirty": "8388608", 2024-09-17T02:20:29.853 INFO:teuthology.orchestra.run.smithi001.stdout: "client_permissions": "true", 2024-09-17T02:20:29.853 INFO:teuthology.orchestra.run.smithi001.stdout: "client_quota": "true", 2024-09-17T02:20:29.853 INFO:teuthology.orchestra.run.smithi001.stdout: "client_quota_df": "true", 2024-09-17T02:20:29.853 INFO:teuthology.orchestra.run.smithi001.stdout: "client_readahead_max_bytes": "0", 2024-09-17T02:20:29.853 INFO:teuthology.orchestra.run.smithi001.stdout: "client_readahead_max_periods": "4", 2024-09-17T02:20:29.853 INFO:teuthology.orchestra.run.smithi001.stdout: "client_readahead_min": "131072", 2024-09-17T02:20:29.853 INFO:teuthology.orchestra.run.smithi001.stdout: "client_reconnect_stale": "false", 2024-09-17T02:20:29.853 INFO:teuthology.orchestra.run.smithi001.stdout: "client_shutdown_timeout": "30", 2024-09-17T02:20:29.853 INFO:teuthology.orchestra.run.smithi001.stdout: "client_snapdir": ".snap", 2024-09-17T02:20:29.853 INFO:teuthology.orchestra.run.smithi001.stdout: "client_tick_interval": "1", 2024-09-17T02:20:29.854 INFO:teuthology.orchestra.run.smithi001.stdout: "client_trace": "", 2024-09-17T02:20:29.854 INFO:teuthology.orchestra.run.smithi001.stdout: "client_try_dentry_invalidate": "false", 2024-09-17T02:20:29.854 INFO:teuthology.orchestra.run.smithi001.stdout: "client_use_faked_inos": "false", 2024-09-17T02:20:29.854 INFO:teuthology.orchestra.run.smithi001.stdout: "client_use_random_mds": "false", 2024-09-17T02:20:29.854 INFO:teuthology.orchestra.run.smithi001.stdout: "clog_to_graylog": "false", 2024-09-17T02:20:29.854 INFO:teuthology.orchestra.run.smithi001.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-17T02:20:29.854 INFO:teuthology.orchestra.run.smithi001.stdout: "clog_to_graylog_port": "12201", 2024-09-17T02:20:29.854 INFO:teuthology.orchestra.run.smithi001.stdout: "clog_to_monitors": "default=true", 2024-09-17T02:20:29.854 INFO:teuthology.orchestra.run.smithi001.stdout: "clog_to_syslog": "false", 2024-09-17T02:20:29.854 INFO:teuthology.orchestra.run.smithi001.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-17T02:20:29.854 INFO:teuthology.orchestra.run.smithi001.stdout: "clog_to_syslog_level": "info", 2024-09-17T02:20:29.854 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_addr": "-", 2024-09-17T02:20:29.854 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_network": "", 2024-09-17T02:20:29.855 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_network_interface": "", 2024-09-17T02:20:29.855 INFO:teuthology.orchestra.run.smithi001.stdout: "compressor_zlib_isal": "false", 2024-09-17T02:20:29.855 INFO:teuthology.orchestra.run.smithi001.stdout: "compressor_zlib_level": "5", 2024-09-17T02:20:29.855 INFO:teuthology.orchestra.run.smithi001.stdout: "compressor_zlib_winsize": "-15", 2024-09-17T02:20:29.855 INFO:teuthology.orchestra.run.smithi001.stdout: "compressor_zstd_level": "1", 2024-09-17T02:20:29.855 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-17T02:20:29.855 INFO:teuthology.orchestra.run.smithi001.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-17T02:20:29.855 INFO:teuthology.orchestra.run.smithi001.stdout: "crimson_alien_op_num_threads": "6", 2024-09-17T02:20:29.855 INFO:teuthology.orchestra.run.smithi001.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-17T02:20:29.855 INFO:teuthology.orchestra.run.smithi001.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-17T02:20:29.855 INFO:teuthology.orchestra.run.smithi001.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-17T02:20:29.855 INFO:teuthology.orchestra.run.smithi001.stdout: "crimson_osd_stat_interval": "0", 2024-09-17T02:20:29.855 INFO:teuthology.orchestra.run.smithi001.stdout: "crimson_seastar_cpu_cores": "", 2024-09-17T02:20:29.856 INFO:teuthology.orchestra.run.smithi001.stdout: "crimson_seastar_num_threads": "0", 2024-09-17T02:20:29.856 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_location": "", 2024-09-17T02:20:29.856 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_location_hook": "", 2024-09-17T02:20:29.856 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_location_hook_timeout": "10", 2024-09-17T02:20:29.856 INFO:teuthology.orchestra.run.smithi001.stdout: "daemonize": "false", 2024-09-17T02:20:29.856 INFO:teuthology.orchestra.run.smithi001.stdout: "daos_pool": "tank", 2024-09-17T02:20:29.856 INFO:teuthology.orchestra.run.smithi001.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-17T02:20:29.856 INFO:teuthology.orchestra.run.smithi001.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-17T02:20:29.856 INFO:teuthology.orchestra.run.smithi001.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-17T02:20:29.856 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_alienstore": "0/5", 2024-09-17T02:20:29.856 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_allow_any_pool_priority": "false", 2024-09-17T02:20:29.856 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_asok": "1/5", 2024-09-17T02:20:29.856 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_asok_assert_abort": "false", 2024-09-17T02:20:29.856 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_asserts_on_shutdown": "true", 2024-09-17T02:20:29.857 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_auth": "20/20", 2024-09-17T02:20:29.857 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_bdev": "1/3", 2024-09-17T02:20:29.857 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_bluefs": "1/5", 2024-09-17T02:20:29.857 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_bluestore": "1/5", 2024-09-17T02:20:29.857 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_buffer": "0/1", 2024-09-17T02:20:29.857 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_ceph_exporter": "1/5", 2024-09-17T02:20:29.857 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_cephfs_mirror": "0/5", 2024-09-17T02:20:29.857 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_cephsqlite": "0/5", 2024-09-17T02:20:29.857 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_client": "0/5", 2024-09-17T02:20:29.857 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_compressor": "1/5", 2024-09-17T02:20:29.857 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_context": "0/1", 2024-09-17T02:20:29.857 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_crimson_interrupt": "0/5", 2024-09-17T02:20:29.857 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_crush": "1/1", 2024-09-17T02:20:29.857 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_crypto": "1/5", 2024-09-17T02:20:29.858 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_cyanstore": "0/5", 2024-09-17T02:20:29.858 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_deliberately_leak_memory": "false", 2024-09-17T02:20:29.858 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_disable_randomized_ping": "false", 2024-09-17T02:20:29.858 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_dpdk": "1/5", 2024-09-17T02:20:29.858 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_eventtrace": "1/5", 2024-09-17T02:20:29.858 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_filer": "0/1", 2024-09-17T02:20:29.858 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_filestore": "1/3", 2024-09-17T02:20:29.858 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_finisher": "1/1", 2024-09-17T02:20:29.858 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_fuse": "1/5", 2024-09-17T02:20:29.858 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_heartbeat_testing_span": "0", 2024-09-17T02:20:29.858 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_heartbeatmap": "1/5", 2024-09-17T02:20:29.858 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-17T02:20:29.858 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_javaclient": "1/5", 2024-09-17T02:20:29.859 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_journal": "1/3", 2024-09-17T02:20:29.859 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_journaler": "0/5", 2024-09-17T02:20:29.859 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_kstore": "1/5", 2024-09-17T02:20:29.859 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_lockdep": "0/1", 2024-09-17T02:20:29.859 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_mclock": "1/5", 2024-09-17T02:20:29.859 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_mds": "1/5", 2024-09-17T02:20:29.859 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_mds_balancer": "1/5", 2024-09-17T02:20:29.859 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_mds_locker": "1/5", 2024-09-17T02:20:29.859 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_mds_log": "1/5", 2024-09-17T02:20:29.859 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_mds_log_expire": "1/5", 2024-09-17T02:20:29.859 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_mds_migrator": "1/5", 2024-09-17T02:20:29.859 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_mds_quiesce": "3/5", 2024-09-17T02:20:29.859 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_memstore": "1/5", 2024-09-17T02:20:29.859 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_mgr": "2/5", 2024-09-17T02:20:29.860 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_mgrc": "1/5", 2024-09-17T02:20:29.860 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_mon": "20/20", 2024-09-17T02:20:29.860 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_monc": "0/10", 2024-09-17T02:20:29.860 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_ms": "1/1", 2024-09-17T02:20:29.860 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_none": "0/5", 2024-09-17T02:20:29.860 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_objclass": "0/5", 2024-09-17T02:20:29.860 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_objectcacher": "0/5", 2024-09-17T02:20:29.860 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_objecter": "0/1", 2024-09-17T02:20:29.860 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_optracker": "0/5", 2024-09-17T02:20:29.860 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_osd": "1/5", 2024-09-17T02:20:29.860 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_paxos": "20/20", 2024-09-17T02:20:29.860 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_perfcounter": "1/5", 2024-09-17T02:20:29.860 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_prioritycache": "1/5", 2024-09-17T02:20:29.861 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_rados": "0/5", 2024-09-17T02:20:29.861 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_rbd": "0/5", 2024-09-17T02:20:29.861 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_rbd_mirror": "0/5", 2024-09-17T02:20:29.861 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_rbd_pwl": "0/5", 2024-09-17T02:20:29.861 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_rbd_replay": "0/5", 2024-09-17T02:20:29.861 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_refs": "0/0", 2024-09-17T02:20:29.861 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_reserver": "1/1", 2024-09-17T02:20:29.861 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_rgw": "1/5", 2024-09-17T02:20:29.861 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_rgw_access": "1/5", 2024-09-17T02:20:29.861 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_rgw_datacache": "1/5", 2024-09-17T02:20:29.861 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_rgw_dbstore": "1/5", 2024-09-17T02:20:29.861 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_rgw_flight": "1/5", 2024-09-17T02:20:29.861 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-17T02:20:29.861 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_rgw_sync": "1/5", 2024-09-17T02:20:29.862 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_rocksdb": "4/5", 2024-09-17T02:20:29.862 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_seastore": "0/5", 2024-09-17T02:20:29.862 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_seastore_backref": "0/5", 2024-09-17T02:20:29.862 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_seastore_cache": "0/5", 2024-09-17T02:20:29.862 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_seastore_cleaner": "0/5", 2024-09-17T02:20:29.862 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_seastore_device": "0/5", 2024-09-17T02:20:29.862 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_seastore_epm": "0/5", 2024-09-17T02:20:29.862 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-17T02:20:29.862 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_seastore_journal": "0/5", 2024-09-17T02:20:29.862 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_seastore_lba": "0/5", 2024-09-17T02:20:29.862 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_seastore_odata": "0/5", 2024-09-17T02:20:29.862 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_seastore_omap": "0/5", 2024-09-17T02:20:29.862 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_seastore_onode": "0/5", 2024-09-17T02:20:29.863 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_seastore_t": "0/5", 2024-09-17T02:20:29.863 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_seastore_tm": "0/5", 2024-09-17T02:20:29.863 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_striper": "0/1", 2024-09-17T02:20:29.863 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_test": "0/5", 2024-09-17T02:20:29.863 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_throttle": "1/1", 2024-09-17T02:20:29.863 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_timer": "0/1", 2024-09-17T02:20:29.863 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_tp": "0/5", 2024-09-17T02:20:29.863 INFO:teuthology.orchestra.run.smithi001.stdout: "debug_trace": "1/5", 2024-09-17T02:20:29.863 INFO:teuthology.orchestra.run.smithi001.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-17T02:20:29.863 INFO:teuthology.orchestra.run.smithi001.stdout: "device_failure_prediction_mode": "none", 2024-09-17T02:20:29.863 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-17T02:20:29.863 INFO:teuthology.orchestra.run.smithi001.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-17T02:20:29.863 INFO:teuthology.orchestra.run.smithi001.stdout: "err_to_graylog": "false", 2024-09-17T02:20:29.864 INFO:teuthology.orchestra.run.smithi001.stdout: "err_to_journald": "false", 2024-09-17T02:20:29.864 INFO:teuthology.orchestra.run.smithi001.stdout: "err_to_stderr": "true", 2024-09-17T02:20:29.864 INFO:teuthology.orchestra.run.smithi001.stdout: "err_to_syslog": "false", 2024-09-17T02:20:29.864 INFO:teuthology.orchestra.run.smithi001.stdout: "event_tracing": "false", 2024-09-17T02:20:29.864 INFO:teuthology.orchestra.run.smithi001.stdout: "exporter_addr": "0.0.0.0", 2024-09-17T02:20:29.864 INFO:teuthology.orchestra.run.smithi001.stdout: "exporter_http_port": "9926", 2024-09-17T02:20:29.864 INFO:teuthology.orchestra.run.smithi001.stdout: "exporter_prio_limit": "5", 2024-09-17T02:20:29.864 INFO:teuthology.orchestra.run.smithi001.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-17T02:20:29.864 INFO:teuthology.orchestra.run.smithi001.stdout: "exporter_sort_metrics": "true", 2024-09-17T02:20:29.864 INFO:teuthology.orchestra.run.smithi001.stdout: "exporter_stats_period": "5", 2024-09-17T02:20:29.864 INFO:teuthology.orchestra.run.smithi001.stdout: "fake_statfs_for_testing": "0", 2024-09-17T02:20:29.864 INFO:teuthology.orchestra.run.smithi001.stdout: "fatal_signal_handlers": "true", 2024-09-17T02:20:29.865 INFO:teuthology.orchestra.run.smithi001.stdout: "filer_max_purge_ops": "10", 2024-09-17T02:20:29.865 INFO:teuthology.orchestra.run.smithi001.stdout: "filer_max_truncate_ops": "128", 2024-09-17T02:20:29.865 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_apply_finisher_threads": "1", 2024-09-17T02:20:29.865 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_blackhole": "false", 2024-09-17T02:20:29.865 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_btrfs_clone_range": "true", 2024-09-17T02:20:29.865 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_btrfs_snap": "true", 2024-09-17T02:20:29.865 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_caller_concurrency": "10", 2024-09-17T02:20:29.865 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_collect_device_partition_information": "true", 2024-09-17T02:20:29.865 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_commit_timeout": "600.000000", 2024-09-17T02:20:29.865 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_debug_inject_read_err": "false", 2024-09-17T02:20:29.865 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_debug_omap_check": "false", 2024-09-17T02:20:29.865 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-17T02:20:29.865 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_debug_verify_split": "false", 2024-09-17T02:20:29.865 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_dump_file": "", 2024-09-17T02:20:29.866 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-17T02:20:29.866 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-17T02:20:29.866 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_fadvise": "true", 2024-09-17T02:20:29.866 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_fail_eio": "true", 2024-09-17T02:20:29.866 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_fd_cache_shards": "16", 2024-09-17T02:20:29.866 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_fd_cache_size": "128", 2024-09-17T02:20:29.866 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_fiemap": "false", 2024-09-17T02:20:29.866 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_fiemap_threshold": "4096", 2024-09-17T02:20:29.866 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-17T02:20:29.866 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-17T02:20:29.866 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_inject_stall": "0", 2024-09-17T02:20:29.866 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_journal_parallel": "false", 2024-09-17T02:20:29.866 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_journal_trailing": "false", 2024-09-17T02:20:29.867 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_journal_writeahead": "false", 2024-09-17T02:20:29.867 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_kill_at": "0", 2024-09-17T02:20:29.867 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-17T02:20:29.867 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-17T02:20:29.867 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-17T02:20:29.867 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-17T02:20:29.867 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-17T02:20:29.867 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_max_inline_xattrs": "0", 2024-09-17T02:20:29.867 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-17T02:20:29.867 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-17T02:20:29.867 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-17T02:20:29.867 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-17T02:20:29.867 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_max_xattr_value_size": "0", 2024-09-17T02:20:29.868 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-17T02:20:29.868 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-17T02:20:29.868 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-17T02:20:29.868 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_merge_threshold": "-10", 2024-09-17T02:20:29.868 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-17T02:20:29.868 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_odsync_write": "false", 2024-09-17T02:20:29.868 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_omap_backend": "rocksdb", 2024-09-17T02:20:29.868 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_omap_backend_path": "", 2024-09-17T02:20:29.868 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-17T02:20:29.868 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-17T02:20:29.868 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-17T02:20:29.868 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_op_thread_timeout": "60", 2024-09-17T02:20:29.869 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_op_threads": "2", 2024-09-17T02:20:29.869 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_punch_hole": "false", 2024-09-17T02:20:29.869 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-17T02:20:29.869 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-17T02:20:29.869 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-17T02:20:29.869 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-17T02:20:29.869 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-17T02:20:29.869 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-17T02:20:29.869 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-17T02:20:29.869 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-17T02:20:29.869 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-17T02:20:29.869 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_queue_max_ops": "50", 2024-09-17T02:20:29.869 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-17T02:20:29.870 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_seek_data_hole": "false", 2024-09-17T02:20:29.870 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_sloppy_crc": "false", 2024-09-17T02:20:29.870 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-17T02:20:29.870 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_splice": "false", 2024-09-17T02:20:29.870 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_split_multiple": "2", 2024-09-17T02:20:29.870 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_split_rand_factor": "20", 2024-09-17T02:20:29.870 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_update_to": "1000", 2024-09-17T02:20:29.870 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-17T02:20:29.870 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-17T02:20:29.870 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-17T02:20:29.870 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-17T02:20:29.870 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-17T02:20:29.870 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-17T02:20:29.870 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_wbthrottle_enable": "true", 2024-09-17T02:20:29.871 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-17T02:20:29.871 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-17T02:20:29.871 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-17T02:20:29.871 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-17T02:20:29.871 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-17T02:20:29.871 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-17T02:20:29.871 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_xfs_extsize": "false", 2024-09-17T02:20:29.871 INFO:teuthology.orchestra.run.smithi001.stdout: "filestore_zfs_snap": "false", 2024-09-17T02:20:29.871 INFO:teuthology.orchestra.run.smithi001.stdout: "fio_dir": "/tmp/fio", 2024-09-17T02:20:29.871 INFO:teuthology.orchestra.run.smithi001.stdout: "fsid": "37cd4495-4915-41f4-bad2-2394cbe235f3", 2024-09-17T02:20:29.871 INFO:teuthology.orchestra.run.smithi001.stdout: "fuse_allow_other": "true", 2024-09-17T02:20:29.871 INFO:teuthology.orchestra.run.smithi001.stdout: "fuse_atomic_o_trunc": "true", 2024-09-17T02:20:29.871 INFO:teuthology.orchestra.run.smithi001.stdout: "fuse_big_writes": "true", 2024-09-17T02:20:29.872 INFO:teuthology.orchestra.run.smithi001.stdout: "fuse_debug": "false", 2024-09-17T02:20:29.872 INFO:teuthology.orchestra.run.smithi001.stdout: "fuse_default_permissions": "false", 2024-09-17T02:20:29.872 INFO:teuthology.orchestra.run.smithi001.stdout: "fuse_disable_pagecache": "false", 2024-09-17T02:20:29.872 INFO:teuthology.orchestra.run.smithi001.stdout: "fuse_max_write": "0", 2024-09-17T02:20:29.872 INFO:teuthology.orchestra.run.smithi001.stdout: "fuse_multithreaded": "true", 2024-09-17T02:20:29.872 INFO:teuthology.orchestra.run.smithi001.stdout: "fuse_require_active_mds": "true", 2024-09-17T02:20:29.872 INFO:teuthology.orchestra.run.smithi001.stdout: "fuse_set_user_groups": "true", 2024-09-17T02:20:29.872 INFO:teuthology.orchestra.run.smithi001.stdout: "fuse_splice_move": "true", 2024-09-17T02:20:29.872 INFO:teuthology.orchestra.run.smithi001.stdout: "fuse_splice_read": "true", 2024-09-17T02:20:29.872 INFO:teuthology.orchestra.run.smithi001.stdout: "fuse_splice_write": "true", 2024-09-17T02:20:29.872 INFO:teuthology.orchestra.run.smithi001.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-17T02:20:29.872 INFO:teuthology.orchestra.run.smithi001.stdout: "fuse_use_invalidate_cb": "true", 2024-09-17T02:20:29.872 INFO:teuthology.orchestra.run.smithi001.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-17T02:20:29.872 INFO:teuthology.orchestra.run.smithi001.stdout: "gss_target_name": "ceph", 2024-09-17T02:20:29.873 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_file": "", 2024-09-17T02:20:29.873 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_inject_failure": "0", 2024-09-17T02:20:29.873 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_interval": "5", 2024-09-17T02:20:29.873 INFO:teuthology.orchestra.run.smithi001.stdout: "host": "smithi001", 2024-09-17T02:20:29.873 INFO:teuthology.orchestra.run.smithi001.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-17T02:20:29.873 INFO:teuthology.orchestra.run.smithi001.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-17T02:20:29.873 INFO:teuthology.orchestra.run.smithi001.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-17T02:20:29.873 INFO:teuthology.orchestra.run.smithi001.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-17T02:20:29.873 INFO:teuthology.orchestra.run.smithi001.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-17T02:20:29.873 INFO:teuthology.orchestra.run.smithi001.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-17T02:20:29.873 INFO:teuthology.orchestra.run.smithi001.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-17T02:20:29.873 INFO:teuthology.orchestra.run.smithi001.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-17T02:20:29.873 INFO:teuthology.orchestra.run.smithi001.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-17T02:20:29.873 INFO:teuthology.orchestra.run.smithi001.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-17T02:20:29.874 INFO:teuthology.orchestra.run.smithi001.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-17T02:20:29.874 INFO:teuthology.orchestra.run.smithi001.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-17T02:20:29.874 INFO:teuthology.orchestra.run.smithi001.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-17T02:20:29.874 INFO:teuthology.orchestra.run.smithi001.stdout: "inject_early_sigterm": "false", 2024-09-17T02:20:29.874 INFO:teuthology.orchestra.run.smithi001.stdout: "jaeger_agent_port": "6799", 2024-09-17T02:20:29.874 INFO:teuthology.orchestra.run.smithi001.stdout: "jaeger_tracing_enable": "false", 2024-09-17T02:20:29.874 INFO:teuthology.orchestra.run.smithi001.stdout: "journal_aio": "true", 2024-09-17T02:20:29.874 INFO:teuthology.orchestra.run.smithi001.stdout: "journal_align_min_size": "65536", 2024-09-17T02:20:29.874 INFO:teuthology.orchestra.run.smithi001.stdout: "journal_block_align": "true", 2024-09-17T02:20:29.874 INFO:teuthology.orchestra.run.smithi001.stdout: "journal_block_size": "4096", 2024-09-17T02:20:29.874 INFO:teuthology.orchestra.run.smithi001.stdout: "journal_dio": "true", 2024-09-17T02:20:29.874 INFO:teuthology.orchestra.run.smithi001.stdout: "journal_discard": "false", 2024-09-17T02:20:29.874 INFO:teuthology.orchestra.run.smithi001.stdout: "journal_force_aio": "false", 2024-09-17T02:20:29.875 INFO:teuthology.orchestra.run.smithi001.stdout: "journal_ignore_corruption": "false", 2024-09-17T02:20:29.875 INFO:teuthology.orchestra.run.smithi001.stdout: "journal_max_write_bytes": "10485760", 2024-09-17T02:20:29.875 INFO:teuthology.orchestra.run.smithi001.stdout: "journal_max_write_entries": "100", 2024-09-17T02:20:29.875 INFO:teuthology.orchestra.run.smithi001.stdout: "journal_replay_from": "0", 2024-09-17T02:20:29.875 INFO:teuthology.orchestra.run.smithi001.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-17T02:20:29.875 INFO:teuthology.orchestra.run.smithi001.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-17T02:20:29.875 INFO:teuthology.orchestra.run.smithi001.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-17T02:20:29.875 INFO:teuthology.orchestra.run.smithi001.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-17T02:20:29.875 INFO:teuthology.orchestra.run.smithi001.stdout: "journal_write_header_frequency": "0", 2024-09-17T02:20:29.875 INFO:teuthology.orchestra.run.smithi001.stdout: "journal_zero_on_create": "false", 2024-09-17T02:20:29.875 INFO:teuthology.orchestra.run.smithi001.stdout: "journaler_prefetch_periods": "10", 2024-09-17T02:20:29.875 INFO:teuthology.orchestra.run.smithi001.stdout: "journaler_prezero_periods": "5", 2024-09-17T02:20:29.875 INFO:teuthology.orchestra.run.smithi001.stdout: "journaler_write_head_interval": "15", 2024-09-17T02:20:29.875 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "", 2024-09-17T02:20:29.876 INFO:teuthology.orchestra.run.smithi001.stdout: "keyfile": "", 2024-09-17T02:20:29.876 INFO:teuthology.orchestra.run.smithi001.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-17T02:20:29.876 INFO:teuthology.orchestra.run.smithi001.stdout: "kstore_backend": "rocksdb", 2024-09-17T02:20:29.876 INFO:teuthology.orchestra.run.smithi001.stdout: "kstore_default_stripe_size": "65536", 2024-09-17T02:20:29.876 INFO:teuthology.orchestra.run.smithi001.stdout: "kstore_fsck_on_mount": "false", 2024-09-17T02:20:29.876 INFO:teuthology.orchestra.run.smithi001.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-17T02:20:29.876 INFO:teuthology.orchestra.run.smithi001.stdout: "kstore_max_bytes": "67108864", 2024-09-17T02:20:29.876 INFO:teuthology.orchestra.run.smithi001.stdout: "kstore_max_ops": "512", 2024-09-17T02:20:29.876 INFO:teuthology.orchestra.run.smithi001.stdout: "kstore_nid_prealloc": "1024", 2024-09-17T02:20:29.876 INFO:teuthology.orchestra.run.smithi001.stdout: "kstore_onode_map_size": "1024", 2024-09-17T02:20:29.876 INFO:teuthology.orchestra.run.smithi001.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-17T02:20:29.876 INFO:teuthology.orchestra.run.smithi001.stdout: "kstore_sync_submit_transaction": "false", 2024-09-17T02:20:29.876 INFO:teuthology.orchestra.run.smithi001.stdout: "kstore_sync_transaction": "false", 2024-09-17T02:20:29.876 INFO:teuthology.orchestra.run.smithi001.stdout: "librados_thread_count": "2", 2024-09-17T02:20:29.877 INFO:teuthology.orchestra.run.smithi001.stdout: "lockdep": "false", 2024-09-17T02:20:29.877 INFO:teuthology.orchestra.run.smithi001.stdout: "lockdep_force_backtrace": "false", 2024-09-17T02:20:29.877 INFO:teuthology.orchestra.run.smithi001.stdout: "log_coarse_timestamps": "true", 2024-09-17T02:20:29.877 INFO:teuthology.orchestra.run.smithi001.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-17T02:20:29.877 INFO:teuthology.orchestra.run.smithi001.stdout: "log_flush_on_exit": "false", 2024-09-17T02:20:29.877 INFO:teuthology.orchestra.run.smithi001.stdout: "log_graylog_host": "127.0.0.1", 2024-09-17T02:20:29.877 INFO:teuthology.orchestra.run.smithi001.stdout: "log_graylog_port": "12201", 2024-09-17T02:20:29.877 INFO:teuthology.orchestra.run.smithi001.stdout: "log_max_new": "1000", 2024-09-17T02:20:29.877 INFO:teuthology.orchestra.run.smithi001.stdout: "log_max_recent": "10000", 2024-09-17T02:20:29.877 INFO:teuthology.orchestra.run.smithi001.stdout: "log_stderr_prefix": "", 2024-09-17T02:20:29.877 INFO:teuthology.orchestra.run.smithi001.stdout: "log_stop_at_utilization": "0.970000", 2024-09-17T02:20:29.877 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": "true", 2024-09-17T02:20:29.877 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_graylog": "false", 2024-09-17T02:20:29.878 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_journald": "false", 2024-09-17T02:20:29.878 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_stderr": "false", 2024-09-17T02:20:29.878 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_syslog": "false", 2024-09-17T02:20:29.878 INFO:teuthology.orchestra.run.smithi001.stdout: "max_rotating_auth_attempts": "10", 2024-09-17T02:20:29.878 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-17T02:20:29.878 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_action_on_write_error": "1", 2024-09-17T02:20:29.878 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_alternate_name_max": "8192", 2024-09-17T02:20:29.878 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_asio_thread_count": "2", 2024-09-17T02:20:29.878 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_bal_export_pin": "true", 2024-09-17T02:20:29.878 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_bal_fragment_dirs": "true", 2024-09-17T02:20:29.878 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-17T02:20:29.878 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_bal_fragment_interval": "5", 2024-09-17T02:20:29.878 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-17T02:20:29.879 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-17T02:20:29.879 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_bal_interval": "10", 2024-09-17T02:20:29.879 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_bal_max": "-1", 2024-09-17T02:20:29.879 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_bal_max_until": "-1", 2024-09-17T02:20:29.879 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_bal_merge_size": "50", 2024-09-17T02:20:29.879 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_bal_midchunk": "0.300000", 2024-09-17T02:20:29.879 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-17T02:20:29.879 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_bal_min_start": "0.200000", 2024-09-17T02:20:29.879 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_bal_minchunk": "0.001000", 2024-09-17T02:20:29.879 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_bal_mode": "0", 2024-09-17T02:20:29.879 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_bal_need_max": "1.200000", 2024-09-17T02:20:29.879 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_bal_need_min": "0.800000", 2024-09-17T02:20:29.879 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_bal_overload_epochs": "2", 2024-09-17T02:20:29.879 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-17T02:20:29.880 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-17T02:20:29.880 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_bal_split_bits": "3", 2024-09-17T02:20:29.880 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-17T02:20:29.880 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_bal_split_size": "10000", 2024-09-17T02:20:29.880 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-17T02:20:29.880 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_bal_target_decay": "10.000000", 2024-09-17T02:20:29.880 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-17T02:20:29.880 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_beacon_grace": "15.000000", 2024-09-17T02:20:29.880 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_beacon_interval": "4.000000", 2024-09-17T02:20:29.880 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-17T02:20:29.880 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-17T02:20:29.880 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_cache_mid": "0.700000", 2024-09-17T02:20:29.880 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-17T02:20:29.881 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_cache_quiesce_delay": "0", 2024-09-17T02:20:29.881 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-17T02:20:29.881 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-17T02:20:29.881 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-17T02:20:29.881 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_cache_release_free_interval": "10", 2024-09-17T02:20:29.881 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_cache_reservation": "0.050000", 2024-09-17T02:20:29.881 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-17T02:20:29.881 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_cache_trim_interval": "1", 2024-09-17T02:20:29.881 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_cache_trim_threshold": "262144", 2024-09-17T02:20:29.881 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-17T02:20:29.881 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-17T02:20:29.881 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-17T02:20:29.881 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_client_prealloc_inos": "1000", 2024-09-17T02:20:29.882 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-17T02:20:29.882 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_connect_bootstrapping": "false", 2024-09-17T02:20:29.882 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_damage_table_max_entries": "10000", 2024-09-17T02:20:29.882 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-17T02:20:29.882 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_debug_auth_pins": "false", 2024-09-17T02:20:29.882 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_debug_frag": "false", 2024-09-17T02:20:29.882 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_debug_scatterstat": "false", 2024-09-17T02:20:29.882 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_debug_subtrees": "false", 2024-09-17T02:20:29.882 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_decay_halflife": "5.000000", 2024-09-17T02:20:29.882 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_default_dir_hash": "2", 2024-09-17T02:20:29.882 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_defer_session_stale": "true", 2024-09-17T02:20:29.882 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_deny_all_reconnect": "false", 2024-09-17T02:20:29.882 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_dir_keys_per_op": "16384", 2024-09-17T02:20:29.882 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_dir_max_commit_size": "10", 2024-09-17T02:20:29.882 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_dir_max_entries": "0", 2024-09-17T02:20:29.883 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_dir_prefetch": "true", 2024-09-17T02:20:29.883 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-17T02:20:29.883 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-17T02:20:29.883 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_dump_cache_on_map": "false", 2024-09-17T02:20:29.883 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-17T02:20:29.883 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-17T02:20:29.883 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_early_reply": "true", 2024-09-17T02:20:29.883 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_enable_op_tracker": "true", 2024-09-17T02:20:29.883 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_enforce_unique_name": "true", 2024-09-17T02:20:29.883 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-17T02:20:29.883 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-17T02:20:29.883 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_export_ephemeral_random": "true", 2024-09-17T02:20:29.883 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-17T02:20:29.884 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-17T02:20:29.884 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-17T02:20:29.884 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-17T02:20:29.884 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-17T02:20:29.884 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-17T02:20:29.884 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-17T02:20:29.884 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-17T02:20:29.884 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_health_summarize_threshold": "10", 2024-09-17T02:20:29.884 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-17T02:20:29.884 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-17T02:20:29.884 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_inject_health_dummy": "false", 2024-09-17T02:20:29.884 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-17T02:20:29.884 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_inject_migrator_session_race": "false", 2024-09-17T02:20:29.884 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-17T02:20:29.885 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-17T02:20:29.885 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-17T02:20:29.885 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_join_fs": "", 2024-09-17T02:20:29.885 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_journal_format": "1", 2024-09-17T02:20:29.885 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-17T02:20:29.885 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_kill_create_at": "0", 2024-09-17T02:20:29.885 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_kill_export_at": "0", 2024-09-17T02:20:29.885 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_kill_import_at": "0", 2024-09-17T02:20:29.885 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_kill_journal_at": "0", 2024-09-17T02:20:29.885 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_kill_journal_expire_at": "0", 2024-09-17T02:20:29.885 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_kill_journal_replay_at": "0", 2024-09-17T02:20:29.885 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_kill_link_at": "0", 2024-09-17T02:20:29.885 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_kill_mdstable_at": "0", 2024-09-17T02:20:29.885 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_kill_openc_at": "0", 2024-09-17T02:20:29.886 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_kill_rename_at": "0", 2024-09-17T02:20:29.886 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_kill_shutdown_at": "0", 2024-09-17T02:20:29.886 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_log_event_large_threshold": "524288", 2024-09-17T02:20:29.886 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_log_events_per_segment": "1024", 2024-09-17T02:20:29.886 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-17T02:20:29.886 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_log_max_events": "-1", 2024-09-17T02:20:29.886 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_log_max_segments": "128", 2024-09-17T02:20:29.886 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_log_pause": "false", 2024-09-17T02:20:29.886 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_log_segment_size": "0", 2024-09-17T02:20:29.886 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-17T02:20:29.886 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-17T02:20:29.886 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-17T02:20:29.886 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_log_trim_threshold": "128", 2024-09-17T02:20:29.886 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-17T02:20:29.886 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_log_warn_factor": "2.000000", 2024-09-17T02:20:29.887 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_max_caps_per_client": "1048576", 2024-09-17T02:20:29.887 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_max_completed_flushes": "100000", 2024-09-17T02:20:29.887 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_max_completed_requests": "100000", 2024-09-17T02:20:29.887 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_max_export_size": "20971520", 2024-09-17T02:20:29.887 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_max_file_recover": "32", 2024-09-17T02:20:29.887 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_max_purge_files": "64", 2024-09-17T02:20:29.887 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_max_purge_ops": "8192", 2024-09-17T02:20:29.887 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-17T02:20:29.887 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-17T02:20:29.887 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_max_snaps_per_dir": "100", 2024-09-17T02:20:29.887 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_metrics_update_interval": "2", 2024-09-17T02:20:29.887 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_min_caps_per_client": "100", 2024-09-17T02:20:29.887 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_min_caps_working_set": "10000", 2024-09-17T02:20:29.888 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-17T02:20:29.888 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_numa_node": "-1", 2024-09-17T02:20:29.888 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-17T02:20:29.888 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_op_complaint_time": "30.000000", 2024-09-17T02:20:29.888 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_op_history_duration": "600", 2024-09-17T02:20:29.888 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_op_history_size": "20", 2024-09-17T02:20:29.888 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_op_history_slow_op_size": "20", 2024-09-17T02:20:29.888 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-17T02:20:29.888 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_op_log_threshold": "5", 2024-09-17T02:20:29.888 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_ping_grace": "15", 2024-09-17T02:20:29.888 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_ping_interval": "5", 2024-09-17T02:20:29.888 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-17T02:20:29.888 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-17T02:20:29.888 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_recall_max_caps": "30000", 2024-09-17T02:20:29.889 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-17T02:20:29.889 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-17T02:20:29.889 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-17T02:20:29.889 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_recall_warning_threshold": "262144", 2024-09-17T02:20:29.889 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-17T02:20:29.889 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_replay_interval": "1.000000", 2024-09-17T02:20:29.889 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-17T02:20:29.889 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-17T02:20:29.889 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_root_ino_gid": "0", 2024-09-17T02:20:29.889 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_root_ino_uid": "0", 2024-09-17T02:20:29.889 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-17T02:20:29.889 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-17T02:20:29.889 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-17T02:20:29.889 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-17T02:20:29.890 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-17T02:20:29.890 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-17T02:20:29.890 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-17T02:20:29.890 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-17T02:20:29.890 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-17T02:20:29.890 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-17T02:20:29.890 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_shutdown_check": "0", 2024-09-17T02:20:29.890 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_skip_ino": "0", 2024-09-17T02:20:29.890 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-17T02:20:29.890 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_snap_max_uid": "4294967294", 2024-09-17T02:20:29.890 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_snap_min_uid": "0", 2024-09-17T02:20:29.890 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_snap_rstat": "false", 2024-09-17T02:20:29.890 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_standby_replay_damaged": "false", 2024-09-17T02:20:29.891 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_symlink_recovery": "true", 2024-09-17T02:20:29.891 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-17T02:20:29.891 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_thrash_exports": "0", 2024-09-17T02:20:29.891 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_thrash_fragments": "0", 2024-09-17T02:20:29.891 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_tick_interval": "5.000000", 2024-09-17T02:20:29.891 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_valgrind_exit": "false", 2024-09-17T02:20:29.891 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_verify_backtrace": "1", 2024-09-17T02:20:29.891 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_verify_scatter": "false", 2024-09-17T02:20:29.891 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-17T02:20:29.891 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_wipe_sessions": "false", 2024-09-17T02:20:29.891 INFO:teuthology.orchestra.run.smithi001.stdout: "mempool_debug": "false", 2024-09-17T02:20:29.891 INFO:teuthology.orchestra.run.smithi001.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-17T02:20:29.891 INFO:teuthology.orchestra.run.smithi001.stdout: "memstore_device_bytes": "1073741824", 2024-09-17T02:20:29.891 INFO:teuthology.orchestra.run.smithi001.stdout: "memstore_page_set": "false", 2024-09-17T02:20:29.892 INFO:teuthology.orchestra.run.smithi001.stdout: "memstore_page_size": "65536", 2024-09-17T02:20:29.892 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_client_bytes": "134217728", 2024-09-17T02:20:29.892 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_client_messages": "512", 2024-09-17T02:20:29.892 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-17T02:20:29.892 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-17T02:20:29.892 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-17T02:20:29.892 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-17T02:20:29.892 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_disabled_modules": "", 2024-09-17T02:20:29.892 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_enable_op_tracker": "true", 2024-09-17T02:20:29.892 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-17T02:20:29.892 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_max_pg_num_change": "128", 2024-09-17T02:20:29.892 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_mds_bytes": "134217728", 2024-09-17T02:20:29.893 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_mds_messages": "128", 2024-09-17T02:20:29.893 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-17T02:20:29.893 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_mon_bytes": "134217728", 2024-09-17T02:20:29.893 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_mon_messages": "128", 2024-09-17T02:20:29.893 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-17T02:20:29.893 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-17T02:20:29.893 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_op_history_duration": "600", 2024-09-17T02:20:29.893 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_op_history_size": "20", 2024-09-17T02:20:29.894 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-17T02:20:29.894 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-17T02:20:29.894 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_op_log_threshold": "5", 2024-09-17T02:20:29.894 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_osd_bytes": "536870912", 2024-09-17T02:20:29.894 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_osd_messages": "8192", 2024-09-17T02:20:29.894 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_pool": "true", 2024-09-17T02:20:29.894 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-17T02:20:29.894 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_standby_modules": "true", 2024-09-17T02:20:29.894 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_stats_period": "5", 2024-09-17T02:20:29.894 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_stats_threshold": "5", 2024-09-17T02:20:29.894 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_tick_period": "2", 2024-09-17T02:20:29.894 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-17T02:20:29.894 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-17T02:20:29.894 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_allow_pool_delete": "true", 2024-09-17T02:20:29.895 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_allow_pool_size_one": "true", 2024-09-17T02:20:29.895 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_auth_validate_all_caps": "true", 2024-09-17T02:20:29.895 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-17T02:20:29.895 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-17T02:20:29.895 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_client_bytes": "104857600", 2024-09-17T02:20:29.895 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_client_directed_command_retry": "2", 2024-09-17T02:20:29.895 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-17T02:20:29.895 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-17T02:20:29.895 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-17T02:20:29.895 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-17T02:20:29.895 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_client_hunt_parallel": "3", 2024-09-17T02:20:29.895 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_client_log_interval": "1.000000", 2024-09-17T02:20:29.895 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-17T02:20:29.896 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_client_ping_interval": "10.000000", 2024-09-17T02:20:29.896 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-17T02:20:29.896 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_client_target_rank": "-1", 2024-09-17T02:20:29.896 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-17T02:20:29.896 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-17T02:20:29.896 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-17T02:20:29.896 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_cluster_log_file_level": "debug", 2024-09-17T02:20:29.896 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_cluster_log_to_file": "true", 2024-09-17T02:20:29.896 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-17T02:20:29.896 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-17T02:20:29.896 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-17T02:20:29.897 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_cluster_log_to_journald": "false", 2024-09-17T02:20:29.897 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-17T02:20:29.897 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-17T02:20:29.897 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-17T02:20:29.897 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-17T02:20:29.897 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_compact_on_bootstrap": "false", 2024-09-17T02:20:29.897 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_compact_on_start": "false", 2024-09-17T02:20:29.897 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_compact_on_trim": "true", 2024-09-17T02:20:29.897 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-17T02:20:29.897 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-17T02:20:29.897 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-17T02:20:29.897 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_cpu_threads": "4", 2024-09-17T02:20:29.897 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_crush_min_required_version": "hammer", 2024-09-17T02:20:29.898 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_daemon_bytes": "419430400", 2024-09-17T02:20:29.898 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-17T02:20:29.898 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_data_avail_crit": "5", 2024-09-17T02:20:29.898 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_data_avail_warn": "5", 2024-09-17T02:20:29.898 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_data_size_warn": "16106127360", 2024-09-17T02:20:29.898 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-17T02:20:29.898 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-17T02:20:29.898 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_debug_dump_json": "false", 2024-09-17T02:20:29.898 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-17T02:20:29.898 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_debug_dump_transactions": "false", 2024-09-17T02:20:29.898 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_debug_extra_checks": "false", 2024-09-17T02:20:29.898 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-17T02:20:29.898 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-17T02:20:29.899 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_debug_no_require_reef": "false", 2024-09-17T02:20:29.899 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_debug_no_require_squid": "false", 2024-09-17T02:20:29.899 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-17T02:20:29.899 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-17T02:20:29.899 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-17T02:20:29.899 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_down_mkfs_grace": "120", 2024-09-17T02:20:29.899 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_down_uptime_grace": "60", 2024-09-17T02:20:29.899 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_election_default_strategy": "1", 2024-09-17T02:20:29.899 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_election_timeout": "5.000000", 2024-09-17T02:20:29.899 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-17T02:20:29.899 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_elector_ping_divisor": "2", 2024-09-17T02:20:29.899 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-17T02:20:29.899 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_enable_op_tracker": "true", 2024-09-17T02:20:29.899 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_fake_pool_delete": "false", 2024-09-17T02:20:29.900 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_force_quorum_join": "false", 2024-09-17T02:20:29.900 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-17T02:20:29.900 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_globalid_prealloc": "10000", 2024-09-17T02:20:29.900 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_health_detail_to_clog": "false", 2024-09-17T02:20:29.900 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_health_log_update_period": "5", 2024-09-17T02:20:29.900 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_health_max_detail": "50", 2024-09-17T02:20:29.900 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_health_to_clog": "true", 2024-09-17T02:20:29.900 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_health_to_clog_interval": "600", 2024-09-17T02:20:29.900 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-17T02:20:29.900 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_host": "172.21.15.1,[v2:172.21.15.1:3301,v1:172.21.15.1:6790],[v2:172.21.15.1:3302,v1:172.21.15.1:6791]", 2024-09-17T02:20:29.900 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_host_override": "", 2024-09-17T02:20:29.900 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_initial_members": "", 2024-09-17T02:20:29.901 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-17T02:20:29.901 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-17T02:20:29.901 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-17T02:20:29.901 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-17T02:20:29.901 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-17T02:20:29.901 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_lease": "5.000000", 2024-09-17T02:20:29.901 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-17T02:20:29.901 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-17T02:20:29.901 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_log_full_interval": "50", 2024-09-17T02:20:29.901 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_log_max": "10000", 2024-09-17T02:20:29.901 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_log_max_summary": "50", 2024-09-17T02:20:29.901 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-17T02:20:29.901 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_max_log_epochs": "500", 2024-09-17T02:20:29.901 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-17T02:20:29.902 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-17T02:20:29.902 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_max_osd": "10000", 2024-09-17T02:20:29.902 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_max_pg_per_osd": "10000", 2024-09-17T02:20:29.902 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_max_pool_pg_num": "65536", 2024-09-17T02:20:29.902 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-17T02:20:29.902 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-17T02:20:29.902 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_mds_force_trim_to": "0", 2024-09-17T02:20:29.902 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_mds_skip_sanity": "false", 2024-09-17T02:20:29.902 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_memory_autotune": "true", 2024-09-17T02:20:29.902 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_memory_target": "2147483648", 2024-09-17T02:20:29.902 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_mgr_beacon_grace": "30", 2024-09-17T02:20:29.902 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-17T02:20:29.902 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_mgr_digest_period": "5", 2024-09-17T02:20:29.902 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_mgr_inactive_grace": "60", 2024-09-17T02:20:29.903 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-17T02:20:29.903 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-17T02:20:29.903 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_min_osdmap_epochs": "500", 2024-09-17T02:20:29.903 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_op_complaint_time": "30", 2024-09-17T02:20:29.903 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_op_history_duration": "600", 2024-09-17T02:20:29.903 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_op_history_size": "20", 2024-09-17T02:20:29.903 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_op_history_slow_op_size": "20", 2024-09-17T02:20:29.903 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-17T02:20:29.903 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_op_log_threshold": "5", 2024-09-17T02:20:29.903 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-17T02:20:29.903 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-17T02:20:29.903 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-17T02:20:29.903 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_auto_mark_in": "false", 2024-09-17T02:20:29.903 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-17T02:20:29.904 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-17T02:20:29.904 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-17T02:20:29.904 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_cache_size": "500", 2024-09-17T02:20:29.904 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-17T02:20:29.904 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-17T02:20:29.904 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-17T02:20:29.904 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_down_out_interval": "600", 2024-09-17T02:20:29.904 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-17T02:20:29.904 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-17T02:20:29.904 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_force_trim_to": "0", 2024-09-17T02:20:29.904 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-17T02:20:29.904 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-17T02:20:29.904 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-17T02:20:29.905 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-17T02:20:29.905 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-17T02:20:29.905 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-17T02:20:29.905 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-17T02:20:29.905 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-17T02:20:29.905 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_min_down_reporters": "2", 2024-09-17T02:20:29.905 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-17T02:20:29.905 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-17T02:20:29.905 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-17T02:20:29.905 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-17T02:20:29.905 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-17T02:20:29.905 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-17T02:20:29.905 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_report_timeout": "900", 2024-09-17T02:20:29.906 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-17T02:20:29.906 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-17T02:20:29.906 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-17T02:20:29.906 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-17T02:20:29.906 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-17T02:20:29.906 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-17T02:20:29.906 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-17T02:20:29.906 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-17T02:20:29.906 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-17T02:20:29.906 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_pg_stuck_threshold": "60", 2024-09-17T02:20:29.906 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-17T02:20:29.906 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-17T02:20:29.906 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-17T02:20:29.907 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-17T02:20:29.907 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-17T02:20:29.907 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-17T02:20:29.907 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_probe_timeout": "2.000000", 2024-09-17T02:20:29.907 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_reweight_max_change": "0.050000", 2024-09-17T02:20:29.907 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_reweight_max_osds": "4", 2024-09-17T02:20:29.907 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-17T02:20:29.907 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-17T02:20:29.907 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-17T02:20:29.907 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-17T02:20:29.907 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-17T02:20:29.907 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_scrub_interval": "86400", 2024-09-17T02:20:29.907 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_scrub_max_keys": "100", 2024-09-17T02:20:29.908 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_scrub_timeout": "300", 2024-09-17T02:20:29.908 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_session_timeout": "300", 2024-09-17T02:20:29.908 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_smart_report_timeout": "5", 2024-09-17T02:20:29.908 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_stat_smooth_intervals": "6", 2024-09-17T02:20:29.908 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-17T02:20:29.908 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_stretch_pool_min_size": "2", 2024-09-17T02:20:29.908 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_stretch_pool_size": "4", 2024-09-17T02:20:29.908 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-17T02:20:29.908 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-17T02:20:29.908 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_sync_debug": "false", 2024-09-17T02:20:29.908 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-17T02:20:29.908 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-17T02:20:29.908 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_sync_provider_kill_at": "0", 2024-09-17T02:20:29.909 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_sync_requester_kill_at": "0", 2024-09-17T02:20:29.909 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_sync_timeout": "60.000000", 2024-09-17T02:20:29.909 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_target_pg_per_osd": "100", 2024-09-17T02:20:29.909 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_tick_interval": "5", 2024-09-17T02:20:29.909 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_timecheck_interval": "300.000000", 2024-09-17T02:20:29.909 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-17T02:20:29.909 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_use_min_delay_socket": "false", 2024-09-17T02:20:29.909 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_warn_older_version_delay": "604800", 2024-09-17T02:20:29.909 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-17T02:20:29.909 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-17T02:20:29.909 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-17T02:20:29.909 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-17T02:20:29.909 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-17T02:20:29.910 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-17T02:20:29.910 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-17T02:20:29.910 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_warn_on_misplaced": "false", 2024-09-17T02:20:29.910 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-17T02:20:29.910 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_warn_on_older_version": "true", 2024-09-17T02:20:29.910 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-17T02:20:29.910 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-17T02:20:29.910 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-17T02:20:29.910 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-17T02:20:29.910 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-17T02:20:29.910 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-17T02:20:29.910 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-17T02:20:29.910 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-17T02:20:29.911 INFO:teuthology.orchestra.run.smithi001.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-17T02:20:29.911 INFO:teuthology.orchestra.run.smithi001.stdout: "monmap": "", 2024-09-17T02:20:29.911 INFO:teuthology.orchestra.run.smithi001.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-17T02:20:29.911 INFO:teuthology.orchestra.run.smithi001.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-17T02:20:29.911 INFO:teuthology.orchestra.run.smithi001.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-17T02:20:29.911 INFO:teuthology.orchestra.run.smithi001.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-17T02:20:29.911 INFO:teuthology.orchestra.run.smithi001.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-17T02:20:29.911 INFO:teuthology.orchestra.run.smithi001.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-17T02:20:29.911 INFO:teuthology.orchestra.run.smithi001.stdout: "motr_tracing_enabled": "false", 2024-09-17T02:20:29.911 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_async_op_threads": "3", 2024-09-17T02:20:29.911 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-17T02:20:29.911 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_async_rdma_cm": "false", 2024-09-17T02:20:29.912 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_async_rdma_device_name": "", 2024-09-17T02:20:29.912 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_async_rdma_dscp": "96", 2024-09-17T02:20:29.912 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-17T02:20:29.912 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-17T02:20:29.912 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_async_rdma_local_gid": "", 2024-09-17T02:20:29.912 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-17T02:20:29.912 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_async_rdma_port_num": "1", 2024-09-17T02:20:29.912 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-17T02:20:29.912 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-17T02:20:29.912 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-17T02:20:29.912 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-17T02:20:29.912 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_async_rdma_sl": "3", 2024-09-17T02:20:29.912 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_async_rdma_support_srq": "true", 2024-09-17T02:20:29.913 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_async_rdma_type": "ib", 2024-09-17T02:20:29.913 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_async_reap_threshold": "5", 2024-09-17T02:20:29.913 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_bind_before_connect": "false", 2024-09-17T02:20:29.913 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_bind_ipv4": "true", 2024-09-17T02:20:29.913 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_bind_ipv6": "false", 2024-09-17T02:20:29.913 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_bind_msgr1": "true", 2024-09-17T02:20:29.913 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_bind_msgr2": "true", 2024-09-17T02:20:29.913 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_bind_port_max": "7568", 2024-09-17T02:20:29.913 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_bind_port_min": "6800", 2024-09-17T02:20:29.913 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-17T02:20:29.913 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_bind_retry_count": "3", 2024-09-17T02:20:29.913 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_bind_retry_delay": "5", 2024-09-17T02:20:29.913 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_blackhole_client": "false", 2024-09-17T02:20:29.914 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_blackhole_mds": "false", 2024-09-17T02:20:29.914 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_blackhole_mgr": "false", 2024-09-17T02:20:29.914 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_blackhole_mon": "false", 2024-09-17T02:20:29.914 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_blackhole_osd": "false", 2024-09-17T02:20:29.914 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_client_mode": "crc secure", 2024-09-17T02:20:29.914 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_cluster_mode": "crc secure", 2024-09-17T02:20:29.914 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_cluster_type": "", 2024-09-17T02:20:29.914 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_compress_secure": "false", 2024-09-17T02:20:29.914 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_connection_idle_timeout": "900", 2024-09-17T02:20:29.914 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_connection_ready_timeout": "10", 2024-09-17T02:20:29.914 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_crc_data": "true", 2024-09-17T02:20:29.914 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_crc_header": "true", 2024-09-17T02:20:29.914 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_die_on_bad_msg": "false", 2024-09-17T02:20:29.914 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_die_on_bug": "true", 2024-09-17T02:20:29.914 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_die_on_old_message": "true", 2024-09-17T02:20:29.915 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_die_on_skipped_message": "false", 2024-09-17T02:20:29.915 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-17T02:20:29.915 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-17T02:20:29.915 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_dpdk_coremask": "0xF", 2024-09-17T02:20:29.915 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-17T02:20:29.915 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-17T02:20:29.915 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_dpdk_enable_tso": "true", 2024-09-17T02:20:29.915 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-17T02:20:29.915 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-17T02:20:29.915 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_dpdk_hugepages": "", 2024-09-17T02:20:29.915 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-17T02:20:29.915 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-17T02:20:29.915 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_dpdk_lro": "true", 2024-09-17T02:20:29.916 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_dpdk_memory_channel": "4", 2024-09-17T02:20:29.916 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-17T02:20:29.916 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_dpdk_pmd": "", 2024-09-17T02:20:29.916 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_dpdk_port_id": "0", 2024-09-17T02:20:29.916 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-17T02:20:29.916 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-17T02:20:29.916 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_dump_on_send": "false", 2024-09-17T02:20:29.916 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_initial_backoff": "0.200000", 2024-09-17T02:20:29.916 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_inject_delay_max": "1.000000", 2024-09-17T02:20:29.916 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-17T02:20:29.916 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_inject_delay_type": "", 2024-09-17T02:20:29.916 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-17T02:20:29.916 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_inject_network_congestion": "0", 2024-09-17T02:20:29.916 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_inject_socket_failures": "0", 2024-09-17T02:20:29.917 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_learn_addr_from_peer": "true", 2024-09-17T02:20:29.917 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_max_accept_failures": "4", 2024-09-17T02:20:29.917 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_max_backoff": "15.000000", 2024-09-17T02:20:29.917 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_mon_client_mode": "secure crc", 2024-09-17T02:20:29.917 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-17T02:20:29.917 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_mon_service_mode": "secure crc", 2024-09-17T02:20:29.917 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_osd_compress_min_size": "1024", 2024-09-17T02:20:29.917 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_osd_compress_mode": "none", 2024-09-17T02:20:29.917 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-17T02:20:29.917 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-17T02:20:29.917 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_pq_min_cost": "65536", 2024-09-17T02:20:29.917 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_public_type": "", 2024-09-17T02:20:29.917 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_service_mode": "crc secure", 2024-09-17T02:20:29.917 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_tcp_listen_backlog": "512", 2024-09-17T02:20:29.918 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_tcp_nodelay": "true", 2024-09-17T02:20:29.918 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-17T02:20:29.918 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_tcp_rcvbuf": "0", 2024-09-17T02:20:29.918 INFO:teuthology.orchestra.run.smithi001.stdout: "ms_type": "async+posix", 2024-09-17T02:20:29.918 INFO:teuthology.orchestra.run.smithi001.stdout: "no_config_file": "false", 2024-09-17T02:20:29.918 INFO:teuthology.orchestra.run.smithi001.stdout: "objecter_completion_locks_per_session": "32", 2024-09-17T02:20:29.918 INFO:teuthology.orchestra.run.smithi001.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-17T02:20:29.918 INFO:teuthology.orchestra.run.smithi001.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-17T02:20:29.918 INFO:teuthology.orchestra.run.smithi001.stdout: "objecter_inflight_ops": "1024", 2024-09-17T02:20:29.918 INFO:teuthology.orchestra.run.smithi001.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-17T02:20:29.918 INFO:teuthology.orchestra.run.smithi001.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-17T02:20:29.918 INFO:teuthology.orchestra.run.smithi001.stdout: "objecter_tick_interval": "5.000000", 2024-09-17T02:20:29.919 INFO:teuthology.orchestra.run.smithi001.stdout: "objecter_timeout": "10.000000", 2024-09-17T02:20:29.919 INFO:teuthology.orchestra.run.smithi001.stdout: "objectstore_blackhole": "false", 2024-09-17T02:20:29.919 INFO:teuthology.orchestra.run.smithi001.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-17T02:20:29.919 INFO:teuthology.orchestra.run.smithi001.stdout: "openssl_engine_opts": "", 2024-09-17T02:20:29.919 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_agent_delay_time": "5.000000", 2024-09-17T02:20:29.919 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_agent_hist_halflife": "1000", 2024-09-17T02:20:29.919 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_agent_max_low_ops": "2", 2024-09-17T02:20:29.919 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_agent_max_ops": "4", 2024-09-17T02:20:29.919 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-17T02:20:29.919 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-17T02:20:29.919 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_agent_slop": "0.020000", 2024-09-17T02:20:29.919 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-17T02:20:29.919 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-17T02:20:29.919 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_asio_thread_count": "2", 2024-09-17T02:20:29.920 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_async_recovery_min_cost": "100", 2024-09-17T02:20:29.920 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-17T02:20:29.920 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-17T02:20:29.920 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_backfill_scan_max": "512", 2024-09-17T02:20:29.920 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_backfill_scan_min": "64", 2024-09-17T02:20:29.920 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_backoff_on_degraded": "false", 2024-09-17T02:20:29.920 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_backoff_on_peering": "false", 2024-09-17T02:20:29.920 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_backoff_on_unfound": "true", 2024-09-17T02:20:29.920 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_beacon_report_interval": "300", 2024-09-17T02:20:29.920 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bench_duration": "30", 2024-09-17T02:20:29.920 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-17T02:20:29.920 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bench_max_block_size": "67108864", 2024-09-17T02:20:29.920 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-17T02:20:29.921 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_blkin_trace_all": "false", 2024-09-17T02:20:29.921 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-17T02:20:29.921 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-17T02:20:29.921 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-17T02:20:29.921 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-17T02:20:29.921 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_check_for_log_corruption": "false", 2024-09-17T02:20:29.921 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-17T02:20:29.921 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-17T02:20:29.921 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-17T02:20:29.921 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-17T02:20:29.921 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_class_update_on_start": "true", 2024-09-17T02:20:29.921 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_client_message_cap": "256", 2024-09-17T02:20:29.921 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_client_message_size_cap": "524288000", 2024-09-17T02:20:29.921 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_client_op_priority": "63", 2024-09-17T02:20:29.922 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_client_watch_timeout": "30", 2024-09-17T02:20:29.922 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_command_max_records": "256", 2024-09-17T02:20:29.922 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_compact_on_start": "false", 2024-09-17T02:20:29.922 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-17T02:20:29.922 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-17T02:20:29.922 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-17T02:20:29.922 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_crush_update_on_start": "true", 2024-09-17T02:20:29.922 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_crush_update_weight_set": "true", 2024-09-17T02:20:29.922 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-17T02:20:29.922 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-17T02:20:29.922 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-17T02:20:29.922 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-17T02:20:29.923 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-17T02:20:29.923 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_debug_feed_pullee": "-1", 2024-09-17T02:20:29.923 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-17T02:20:29.923 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-17T02:20:29.923 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-17T02:20:29.923 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_debug_misdirected_ops": "false", 2024-09-17T02:20:29.924 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_debug_no_acting_change": "false", 2024-09-17T02:20:29.924 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_debug_no_purge_strays": "false", 2024-09-17T02:20:29.924 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_debug_op_order": "false", 2024-09-17T02:20:29.924 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-17T02:20:29.924 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-17T02:20:29.924 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-17T02:20:29.924 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-17T02:20:29.924 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_debug_shutdown": "false", 2024-09-17T02:20:29.924 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-17T02:20:29.925 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-17T02:20:29.925 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_debug_trim_objects": "false", 2024-09-17T02:20:29.925 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-17T02:20:29.925 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-17T02:20:29.925 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_debug_verify_snaps": "false", 2024-09-17T02:20:29.925 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-17T02:20:29.925 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-17T02:20:29.925 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_deep_scrub_keys": "1024", 2024-09-17T02:20:29.925 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-17T02:20:29.926 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-17T02:20:29.926 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-17T02:20:29.926 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_deep_scrub_stride": "524288", 2024-09-17T02:20:29.926 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-17T02:20:29.926 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-17T02:20:29.926 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_default_notify_timeout": "30", 2024-09-17T02:20:29.926 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_delete_sleep": "0.000000", 2024-09-17T02:20:29.926 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-17T02:20:29.926 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-17T02:20:29.926 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-17T02:20:29.926 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_discard_disconnected_ops": "true", 2024-09-17T02:20:29.926 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_enable_op_tracker": "true", 2024-09-17T02:20:29.927 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-17T02:20:29.927 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-17T02:20:29.927 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-17T02:20:29.927 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-17T02:20:29.927 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_fast_info": "true", 2024-09-17T02:20:29.927 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_fast_shutdown": "true", 2024-09-17T02:20:29.927 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-17T02:20:29.927 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-17T02:20:29.927 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-17T02:20:29.927 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-17T02:20:29.927 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-17T02:20:29.927 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_function_tracing": "false", 2024-09-17T02:20:29.927 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_heartbeat_grace": "20", 2024-09-17T02:20:29.928 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_heartbeat_interval": "6", 2024-09-17T02:20:29.928 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-17T02:20:29.928 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_heartbeat_min_peers": "10", 2024-09-17T02:20:29.928 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_heartbeat_min_size": "2000", 2024-09-17T02:20:29.928 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_heartbeat_stale": "600", 2024-09-17T02:20:29.928 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-17T02:20:29.928 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_hit_set_max_size": "100000", 2024-09-17T02:20:29.928 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_hit_set_min_size": "1000", 2024-09-17T02:20:29.928 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-17T02:20:29.928 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-17T02:20:29.928 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-17T02:20:29.928 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-17T02:20:29.928 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-17T02:20:29.929 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-17T02:20:29.929 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_journal_size": "5120", 2024-09-17T02:20:29.929 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_kill_backfill_at": "0", 2024-09-17T02:20:29.929 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-17T02:20:29.929 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_map_cache_size": "50", 2024-09-17T02:20:29.929 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_map_dedup": "true", 2024-09-17T02:20:29.929 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_map_message_max": "40", 2024-09-17T02:20:29.929 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-17T02:20:29.929 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_map_share_max_epochs": "40", 2024-09-17T02:20:29.929 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_max_attr_name_len": "100", 2024-09-17T02:20:29.929 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_max_attr_size": "0", 2024-09-17T02:20:29.929 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_max_backfills": "1", 2024-09-17T02:20:29.929 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_max_markdown_count": "5", 2024-09-17T02:20:29.930 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_max_markdown_period": "600", 2024-09-17T02:20:29.930 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_max_object_name_len": "2048", 2024-09-17T02:20:29.930 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_max_object_namespace_len": "256", 2024-09-17T02:20:29.930 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_max_object_size": "134217728", 2024-09-17T02:20:29.930 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-17T02:20:29.930 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-17T02:20:29.930 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_max_pg_blocked_by": "16", 2024-09-17T02:20:29.930 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_max_pg_log_entries": "10000", 2024-09-17T02:20:29.930 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-17T02:20:29.930 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_max_pgls": "1024", 2024-09-17T02:20:29.930 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_max_push_cost": "8388608", 2024-09-17T02:20:29.931 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_max_push_objects": "10", 2024-09-17T02:20:29.931 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_max_scrubs": "3", 2024-09-17T02:20:29.931 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-17T02:20:29.931 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_max_trimming_pgs": "2", 2024-09-17T02:20:29.931 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_max_write_op_reply_len": "64", 2024-09-17T02:20:29.931 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_max_write_size": "90", 2024-09-17T02:20:29.931 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-17T02:20:29.931 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-17T02:20:29.931 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-17T02:20:29.931 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-17T02:20:29.931 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-17T02:20:29.931 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-17T02:20:29.932 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-17T02:20:29.932 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-17T02:20:29.932 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mclock_profile": "balanced", 2024-09-17T02:20:29.932 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-17T02:20:29.932 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-17T02:20:29.932 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-17T02:20:29.932 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-17T02:20:29.932 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-17T02:20:29.932 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-17T02:20:29.932 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-17T02:20:29.932 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-17T02:20:29.932 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-17T02:20:29.932 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-17T02:20:29.933 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-17T02:20:29.933 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_memory_base": "805306368", 2024-09-17T02:20:29.933 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_memory_cache_min": "134217728", 2024-09-17T02:20:29.933 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-17T02:20:29.933 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-17T02:20:29.933 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_memory_target": "4294967296", 2024-09-17T02:20:29.933 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_memory_target_autotune": "false", 2024-09-17T02:20:29.933 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-17T02:20:29.933 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_min_pg_log_entries": "250", 2024-09-17T02:20:29.933 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_min_recovery_priority": "0", 2024-09-17T02:20:29.933 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-17T02:20:29.933 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-17T02:20:29.933 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mon_report_interval": "5", 2024-09-17T02:20:29.933 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-17T02:20:29.934 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-17T02:20:29.934 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_num_cache_shards": "32", 2024-09-17T02:20:29.934 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_num_op_tracker_shard": "32", 2024-09-17T02:20:29.934 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_numa_auto_affinity": "true", 2024-09-17T02:20:29.934 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_numa_node": "-1", 2024-09-17T02:20:29.934 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_numa_prefer_iface": "true", 2024-09-17T02:20:29.934 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-17T02:20:29.934 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_objecter_finishers": "1", 2024-09-17T02:20:29.934 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_objectstore": "bluestore", 2024-09-17T02:20:29.934 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_objectstore_fuse": "false", 2024-09-17T02:20:29.934 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_objectstore_tracing": "false", 2024-09-17T02:20:29.934 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_op_complaint_time": "30.000000", 2024-09-17T02:20:29.934 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_op_history_duration": "600", 2024-09-17T02:20:29.935 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_op_history_size": "20", 2024-09-17T02:20:29.935 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_op_history_slow_op_size": "20", 2024-09-17T02:20:29.935 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-17T02:20:29.935 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_op_log_threshold": "5", 2024-09-17T02:20:29.935 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_op_num_shards": "0", 2024-09-17T02:20:29.935 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_op_num_shards_hdd": "5", 2024-09-17T02:20:29.935 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_op_num_shards_ssd": "8", 2024-09-17T02:20:29.935 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-17T02:20:29.935 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-17T02:20:29.935 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-17T02:20:29.935 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-17T02:20:29.935 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_op_pq_min_cost": "65536", 2024-09-17T02:20:29.935 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-17T02:20:29.935 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_op_queue_cut_off": "high", 2024-09-17T02:20:29.936 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-17T02:20:29.936 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_op_thread_timeout": "15", 2024-09-17T02:20:29.936 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_open_classes_on_start": "true", 2024-09-17T02:20:29.936 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_os_flags": "0", 2024-09-17T02:20:29.936 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_peering_op_priority": "255", 2024-09-17T02:20:29.936 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pg_delete_cost": "1048576", 2024-09-17T02:20:29.936 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pg_delete_priority": "5", 2024-09-17T02:20:29.936 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-17T02:20:29.936 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-17T02:20:29.936 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-17T02:20:29.936 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pg_log_trim_max": "10000", 2024-09-17T02:20:29.937 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pg_log_trim_min": "100", 2024-09-17T02:20:29.937 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-17T02:20:29.937 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-17T02:20:29.937 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-17T02:20:29.937 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-17T02:20:29.937 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-17T02:20:29.937 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-17T02:20:29.937 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-17T02:20:29.937 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-17T02:20:29.937 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-17T02:20:29.937 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-17T02:20:29.938 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pool_default_crimson": "false", 2024-09-17T02:20:29.938 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-17T02:20:29.938 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-17T02:20:29.938 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-17T02:20:29.938 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-17T02:20:29.938 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-17T02:20:29.938 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-17T02:20:29.938 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-17T02:20:29.939 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-17T02:20:29.939 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pool_default_flags": "0", 2024-09-17T02:20:29.939 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-17T02:20:29.939 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pool_default_min_size": "0", 2024-09-17T02:20:29.939 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-17T02:20:29.939 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pool_default_pg_num": "32", 2024-09-17T02:20:29.939 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pool_default_pgp_num": "0", 2024-09-17T02:20:29.939 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-17T02:20:29.939 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pool_default_read_ratio": "70", 2024-09-17T02:20:29.939 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pool_default_size": "2", 2024-09-17T02:20:29.939 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pool_default_type": "replicated", 2024-09-17T02:20:29.939 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-17T02:20:29.939 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-17T02:20:29.940 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_push_per_object_cost": "1000", 2024-09-17T02:20:29.940 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-17T02:20:29.940 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_recover_clone_overlap": "true", 2024-09-17T02:20:29.940 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-17T02:20:29.940 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_recovery_cost": "20971520", 2024-09-17T02:20:29.940 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-17T02:20:29.940 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_recovery_max_active": "0", 2024-09-17T02:20:29.940 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-17T02:20:29.940 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-17T02:20:29.940 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-17T02:20:29.940 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-17T02:20:29.940 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_recovery_max_single_start": "1", 2024-09-17T02:20:29.940 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_recovery_op_priority": "3", 2024-09-17T02:20:29.941 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-17T02:20:29.941 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_recovery_priority": "5", 2024-09-17T02:20:29.941 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-17T02:20:29.941 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_recovery_sleep": "0.000000", 2024-09-17T02:20:29.941 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-17T02:20:29.941 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-17T02:20:29.941 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-17T02:20:29.941 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_repair_during_recovery": "false", 2024-09-17T02:20:29.941 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_requested_scrub_priority": "120", 2024-09-17T02:20:29.941 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-17T02:20:29.941 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-17T02:20:29.941 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_scrub_auto_repair": "false", 2024-09-17T02:20:29.941 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-17T02:20:29.941 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-17T02:20:29.942 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_scrub_begin_hour": "0", 2024-09-17T02:20:29.942 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_scrub_begin_week_day": "0", 2024-09-17T02:20:29.942 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_scrub_chunk_max": "25", 2024-09-17T02:20:29.942 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_scrub_chunk_min": "5", 2024-09-17T02:20:29.942 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_scrub_cost": "52428800", 2024-09-17T02:20:29.942 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-17T02:20:29.942 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_scrub_during_recovery": "false", 2024-09-17T02:20:29.942 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_scrub_end_hour": "0", 2024-09-17T02:20:29.942 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_scrub_end_week_day": "0", 2024-09-17T02:20:29.942 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_scrub_event_cost": "4096", 2024-09-17T02:20:29.942 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-17T02:20:29.942 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-17T02:20:29.942 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_scrub_invalid_stats": "true", 2024-09-17T02:20:29.943 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-17T02:20:29.943 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-17T02:20:29.943 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_scrub_max_preemptions": "5", 2024-09-17T02:20:29.943 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-17T02:20:29.943 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_scrub_priority": "5", 2024-09-17T02:20:29.943 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_scrub_sleep": "0.000000", 2024-09-17T02:20:29.943 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-17T02:20:29.943 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-17T02:20:29.943 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-17T02:20:29.943 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_skip_data_digest": "false", 2024-09-17T02:20:29.943 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_smart_report_timeout": "5", 2024-09-17T02:20:29.943 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_snap_trim_cost": "1048576", 2024-09-17T02:20:29.943 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_snap_trim_priority": "5", 2024-09-17T02:20:29.943 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-17T02:20:29.944 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-17T02:20:29.944 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-17T02:20:29.944 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-17T02:20:29.944 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-17T02:20:29.944 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-17T02:20:29.944 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-17T02:20:29.944 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_target_transaction_size": "30", 2024-09-17T02:20:29.944 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-17T02:20:29.944 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-17T02:20:29.944 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-17T02:20:29.944 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-17T02:20:29.944 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-17T02:20:29.944 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-17T02:20:29.944 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-17T02:20:29.945 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-17T02:20:29.945 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-17T02:20:29.945 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-17T02:20:29.945 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_tracing": "false", 2024-09-17T02:20:29.945 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_use_stale_snap": "false", 2024-09-17T02:20:29.945 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:20:29.945 INFO:teuthology.orchestra.run.smithi001.stdout: "osdc_blkin_trace_all": "false", 2024-09-17T02:20:29.945 INFO:teuthology.orchestra.run.smithi001.stdout: "paxos_kill_at": "0", 2024-09-17T02:20:29.945 INFO:teuthology.orchestra.run.smithi001.stdout: "paxos_max_join_drift": "10", 2024-09-17T02:20:29.945 INFO:teuthology.orchestra.run.smithi001.stdout: "paxos_min": "500", 2024-09-17T02:20:29.945 INFO:teuthology.orchestra.run.smithi001.stdout: "paxos_min_wait": "0.050000", 2024-09-17T02:20:29.945 INFO:teuthology.orchestra.run.smithi001.stdout: "paxos_propose_interval": "1.000000", 2024-09-17T02:20:29.946 INFO:teuthology.orchestra.run.smithi001.stdout: "paxos_service_trim_max": "500", 2024-09-17T02:20:29.946 INFO:teuthology.orchestra.run.smithi001.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-17T02:20:29.946 INFO:teuthology.orchestra.run.smithi001.stdout: "paxos_service_trim_min": "250", 2024-09-17T02:20:29.946 INFO:teuthology.orchestra.run.smithi001.stdout: "paxos_stash_full_interval": "25", 2024-09-17T02:20:29.946 INFO:teuthology.orchestra.run.smithi001.stdout: "paxos_trim_max": "500", 2024-09-17T02:20:29.946 INFO:teuthology.orchestra.run.smithi001.stdout: "paxos_trim_min": "250", 2024-09-17T02:20:29.946 INFO:teuthology.orchestra.run.smithi001.stdout: "perf": "true", 2024-09-17T02:20:29.946 INFO:teuthology.orchestra.run.smithi001.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-17T02:20:29.946 INFO:teuthology.orchestra.run.smithi001.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-17T02:20:29.946 INFO:teuthology.orchestra.run.smithi001.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-17T02:20:29.946 INFO:teuthology.orchestra.run.smithi001.stdout: "public_addr": "-", 2024-09-17T02:20:29.946 INFO:teuthology.orchestra.run.smithi001.stdout: "public_addrv": "", 2024-09-17T02:20:29.946 INFO:teuthology.orchestra.run.smithi001.stdout: "public_bind_addr": "-", 2024-09-17T02:20:29.947 INFO:teuthology.orchestra.run.smithi001.stdout: "public_network": "", 2024-09-17T02:20:29.947 INFO:teuthology.orchestra.run.smithi001.stdout: "public_network_interface": "", 2024-09-17T02:20:29.947 INFO:teuthology.orchestra.run.smithi001.stdout: "qat_compressor_busy_polling": "false", 2024-09-17T02:20:29.947 INFO:teuthology.orchestra.run.smithi001.stdout: "qat_compressor_enabled": "false", 2024-09-17T02:20:29.947 INFO:teuthology.orchestra.run.smithi001.stdout: "qat_compressor_session_max_number": "256", 2024-09-17T02:20:29.947 INFO:teuthology.orchestra.run.smithi001.stdout: "rados_mon_op_timeout": "0", 2024-09-17T02:20:29.947 INFO:teuthology.orchestra.run.smithi001.stdout: "rados_osd_op_timeout": "0", 2024-09-17T02:20:29.947 INFO:teuthology.orchestra.run.smithi001.stdout: "rados_tracing": "false", 2024-09-17T02:20:29.947 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_atime_update_interval": "60", 2024-09-17T02:20:29.947 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-17T02:20:29.947 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_balance_parent_reads": "false", 2024-09-17T02:20:29.947 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_balance_snap_reads": "false", 2024-09-17T02:20:29.947 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_blkin_trace_all": "false", 2024-09-17T02:20:29.948 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-17T02:20:29.948 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-17T02:20:29.948 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_cache": "true", 2024-09-17T02:20:29.948 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-17T02:20:29.948 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-17T02:20:29.948 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-17T02:20:29.948 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-17T02:20:29.948 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_cache_policy": "writearound", 2024-09-17T02:20:29.948 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_cache_size": "33554432", 2024-09-17T02:20:29.948 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-17T02:20:29.948 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-17T02:20:29.948 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_clone_copy_on_read": "false", 2024-09-17T02:20:29.948 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_compression_hint": "none", 2024-09-17T02:20:29.949 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_concurrent_management_ops": "10", 2024-09-17T02:20:29.949 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-17T02:20:29.949 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_default_clone_format": "auto", 2024-09-17T02:20:29.949 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_default_data_pool": "", 2024-09-17T02:20:29.949 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_default_features": "61", 2024-09-17T02:20:29.949 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_default_format": "2", 2024-09-17T02:20:29.949 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_default_map_options": "", 2024-09-17T02:20:29.949 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_default_order": "22", 2024-09-17T02:20:29.949 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_default_pool": "rbd", 2024-09-17T02:20:29.949 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-17T02:20:29.949 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_default_stripe_count": "0", 2024-09-17T02:20:29.949 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_default_stripe_unit": "0", 2024-09-17T02:20:29.949 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-17T02:20:29.950 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-17T02:20:29.950 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-17T02:20:29.950 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_enable_alloc_hint": "true", 2024-09-17T02:20:29.950 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-17T02:20:29.950 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_io_scheduler": "simple", 2024-09-17T02:20:29.950 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-17T02:20:29.950 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-17T02:20:29.950 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-17T02:20:29.950 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-17T02:20:29.950 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-17T02:20:29.950 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-17T02:20:29.950 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-17T02:20:29.950 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-17T02:20:29.951 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-17T02:20:29.951 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_journal_order": "24", 2024-09-17T02:20:29.951 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_journal_pool": "", 2024-09-17T02:20:29.951 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_journal_splay_width": "4", 2024-09-17T02:20:29.951 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_localize_parent_reads": "false", 2024-09-17T02:20:29.951 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_localize_snap_reads": "false", 2024-09-17T02:20:29.951 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-17T02:20:29.951 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-17T02:20:29.951 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-17T02:20:29.951 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-17T02:20:29.951 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-17T02:20:29.951 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-17T02:20:29.951 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-17T02:20:29.951 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-17T02:20:29.952 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-17T02:20:29.952 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-17T02:20:29.952 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-17T02:20:29.952 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-17T02:20:29.952 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-17T02:20:29.952 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-17T02:20:29.952 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-17T02:20:29.952 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-17T02:20:29.952 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-17T02:20:29.952 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-17T02:20:29.952 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-17T02:20:29.952 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-17T02:20:29.952 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-17T02:20:29.953 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-17T02:20:29.953 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-17T02:20:29.953 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-17T02:20:29.953 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-17T02:20:29.953 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-17T02:20:29.953 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-17T02:20:29.953 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-17T02:20:29.953 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-17T02:20:29.953 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-17T02:20:29.953 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-17T02:20:29.953 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_mtime_update_interval": "60", 2024-09-17T02:20:29.953 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_non_blocking_aio": "true", 2024-09-17T02:20:29.953 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_op_thread_timeout": "60", 2024-09-17T02:20:29.954 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_op_threads": "1", 2024-09-17T02:20:29.954 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_parent_cache_enabled": "false", 2024-09-17T02:20:29.954 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-17T02:20:29.954 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-17T02:20:29.954 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-17T02:20:29.954 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_plugins": "", 2024-09-17T02:20:29.954 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_qos_bps_burst": "0", 2024-09-17T02:20:29.954 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-17T02:20:29.954 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_qos_bps_limit": "0", 2024-09-17T02:20:29.954 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_qos_exclude_ops": "0", 2024-09-17T02:20:29.954 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_qos_iops_burst": "0", 2024-09-17T02:20:29.954 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-17T02:20:29.954 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_qos_iops_limit": "0", 2024-09-17T02:20:29.955 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-17T02:20:29.955 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-17T02:20:29.955 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-17T02:20:29.955 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-17T02:20:29.955 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-17T02:20:29.955 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-17T02:20:29.955 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-17T02:20:29.955 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-17T02:20:29.955 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-17T02:20:29.955 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-17T02:20:29.955 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-17T02:20:29.955 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-17T02:20:29.955 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-17T02:20:29.956 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-17T02:20:29.956 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_read_from_replica_policy": "default", 2024-09-17T02:20:29.956 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-17T02:20:29.956 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-17T02:20:29.956 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-17T02:20:29.956 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-17T02:20:29.956 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_skip_partial_discard": "true", 2024-09-17T02:20:29.956 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-17T02:20:29.956 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_tracing": "false", 2024-09-17T02:20:29.956 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_validate_names": "true", 2024-09-17T02:20:29.956 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_validate_pool": "true", 2024-09-17T02:20:29.956 INFO:teuthology.orchestra.run.smithi001.stdout: "restapi_base_url": "", 2024-09-17T02:20:29.956 INFO:teuthology.orchestra.run.smithi001.stdout: "restapi_log_level": "", 2024-09-17T02:20:29.956 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-17T02:20:29.957 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-17T02:20:29.957 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_acl_grants_max_num": "100", 2024-09-17T02:20:29.957 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_admin_entry": "admin", 2024-09-17T02:20:29.957 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-17T02:20:29.957 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_backend_store": "rados", 2024-09-17T02:20:29.957 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_barbican_url": "", 2024-09-17T02:20:29.957 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_beast_enable_async": "true", 2024-09-17T02:20:29.957 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_bucket_counters_cache": "false", 2024-09-17T02:20:29.957 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-17T02:20:29.957 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-17T02:20:29.957 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-17T02:20:29.957 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-17T02:20:29.958 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-17T02:20:29.958 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-17T02:20:29.958 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-17T02:20:29.958 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-17T02:20:29.958 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_cache_enabled": "true", 2024-09-17T02:20:29.958 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_cache_expiry_interval": "900", 2024-09-17T02:20:29.958 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_cache_lru_size": "25000", 2024-09-17T02:20:29.958 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_config_store": "rados", 2024-09-17T02:20:29.958 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_content_length_compat": "false", 2024-09-17T02:20:29.958 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_copy_obj_progress": "true", 2024-09-17T02:20:29.958 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-17T02:20:29.958 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_cors_rules_max_num": "100", 2024-09-17T02:20:29.958 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_cross_domain_policy": "", 2024-09-17T02:20:29.958 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-17T02:20:29.959 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_kmip_addr": "", 2024-09-17T02:20:29.959 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-17T02:20:29.959 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-17T02:20:29.959 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-17T02:20:29.959 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-17T02:20:29.959 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_kmip_password": "", 2024-09-17T02:20:29.959 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-17T02:20:29.959 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_kmip_username": "", 2024-09-17T02:20:29.959 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_require_ssl": "true", 2024-09-17T02:20:29.959 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-17T02:20:29.959 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-17T02:20:29.959 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-17T02:20:29.959 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-17T02:20:29.959 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-17T02:20:29.959 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-17T02:20:29.960 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-17T02:20:29.960 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-17T02:20:29.960 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-17T02:20:29.960 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-17T02:20:29.960 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-17T02:20:29.960 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-17T02:20:29.960 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-17T02:20:29.960 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-17T02:20:29.960 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-17T02:20:29.960 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_vault_addr": "", 2024-09-17T02:20:29.960 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_vault_auth": "token", 2024-09-17T02:20:29.960 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_vault_namespace": "", 2024-09-17T02:20:29.960 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_vault_prefix": "", 2024-09-17T02:20:29.960 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-17T02:20:29.961 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-17T02:20:29.961 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-17T02:20:29.961 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-17T02:20:29.961 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_vault_token_file": "", 2024-09-17T02:20:29.961 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-17T02:20:29.961 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_curl_buffersize": "524288", 2024-09-17T02:20:29.961 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-17T02:20:29.961 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_curl_low_speed_time": "300", 2024-09-17T02:20:29.961 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-17T02:20:29.961 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-17T02:20:29.961 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-17T02:20:29.961 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-17T02:20:29.961 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-17T02:20:29.962 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-17T02:20:29.962 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-17T02:20:29.962 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-17T02:20:29.962 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-17T02:20:29.962 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-17T02:20:29.962 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_d4n_host": "127.0.0.1", 2024-09-17T02:20:29.962 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_d4n_port": "6379", 2024-09-17T02:20:29.962 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-17T02:20:29.962 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_data_log_changes_size": "1000", 2024-09-17T02:20:29.962 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_data_log_num_shards": "128", 2024-09-17T02:20:29.962 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-17T02:20:29.962 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_data_log_window": "30", 2024-09-17T02:20:29.962 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-17T02:20:29.963 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-17T02:20:29.963 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-17T02:20:29.963 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-17T02:20:29.963 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-17T02:20:29.963 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-17T02:20:29.963 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-17T02:20:29.963 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-17T02:20:29.963 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-17T02:20:29.963 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-17T02:20:29.963 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-17T02:20:29.963 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-17T02:20:29.963 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-17T02:20:29.963 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-17T02:20:29.963 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-17T02:20:29.963 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-17T02:20:29.964 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-17T02:20:29.964 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-17T02:20:29.964 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-17T02:20:29.964 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-17T02:20:29.964 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-17T02:20:29.964 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-17T02:20:29.964 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-17T02:20:29.964 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-17T02:20:29.964 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-17T02:20:29.964 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_dns_name": "", 2024-09-17T02:20:29.964 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_dns_s3website_name": "", 2024-09-17T02:20:29.964 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_dynamic_resharding": "true", 2024-09-17T02:20:29.964 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-17T02:20:29.964 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_enable_gc_threads": "true", 2024-09-17T02:20:29.965 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_enable_lc_threads": "true", 2024-09-17T02:20:29.965 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_enable_ops_log": "false", 2024-09-17T02:20:29.965 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_enable_quota_threads": "true", 2024-09-17T02:20:29.965 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_enable_static_website": "false", 2024-09-17T02:20:29.965 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_enable_usage_log": "false", 2024-09-17T02:20:29.965 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_enforce_swift_acls": "true", 2024-09-17T02:20:29.965 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_exit_timeout_secs": "120", 2024-09-17T02:20:29.968 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_expose_bucket": "false", 2024-09-17T02:20:29.968 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_extended_http_attrs": "", 2024-09-17T02:20:29.968 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_filter": "none", 2024-09-17T02:20:29.968 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-17T02:20:29.968 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_frontends": "beast port=7480", 2024-09-17T02:20:29.969 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-17T02:20:29.969 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_gc_max_deferred": "50", 2024-09-17T02:20:29.969 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-17T02:20:29.969 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_gc_max_objs": "32", 2024-09-17T02:20:29.969 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-17T02:20:29.969 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-17T02:20:29.969 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-17T02:20:29.969 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-17T02:20:29.969 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_gc_processor_period": "3600", 2024-09-17T02:20:29.969 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-17T02:20:29.969 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-17T02:20:29.969 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-17T02:20:29.969 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-17T02:20:29.970 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_init_timeout": "300", 2024-09-17T02:20:29.970 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-17T02:20:29.970 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-17T02:20:29.970 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_kafka_connection_idle": "300", 2024-09-17T02:20:29.970 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-17T02:20:29.970 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-17T02:20:29.970 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-17T02:20:29.970 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-17T02:20:29.970 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-17T02:20:29.970 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_keystone_admin_domain": "", 2024-09-17T02:20:29.970 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_keystone_admin_password": "", 2024-09-17T02:20:29.970 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_keystone_admin_password_path": "", 2024-09-17T02:20:29.970 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_keystone_admin_project": "", 2024-09-17T02:20:29.970 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_keystone_admin_tenant": "", 2024-09-17T02:20:29.971 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_keystone_admin_token": "", 2024-09-17T02:20:29.971 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_keystone_admin_token_path": "", 2024-09-17T02:20:29.971 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_keystone_admin_user": "", 2024-09-17T02:20:29.971 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_keystone_api_version": "2", 2024-09-17T02:20:29.971 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_keystone_barbican_domain": "", 2024-09-17T02:20:29.971 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_keystone_barbican_password": "", 2024-09-17T02:20:29.971 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_keystone_barbican_project": "", 2024-09-17T02:20:29.971 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-17T02:20:29.971 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_keystone_barbican_user": "", 2024-09-17T02:20:29.971 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-17T02:20:29.971 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-17T02:20:29.971 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-17T02:20:29.971 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-17T02:20:29.972 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-17T02:20:29.972 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_keystone_url": "", 2024-09-17T02:20:29.972 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-17T02:20:29.972 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_lc_debug_interval": "-1", 2024-09-17T02:20:29.972 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_lc_lock_max_time": "90", 2024-09-17T02:20:29.972 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_lc_max_objs": "32", 2024-09-17T02:20:29.972 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_lc_max_rules": "1000", 2024-09-17T02:20:29.972 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_lc_max_worker": "3", 2024-09-17T02:20:29.972 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-17T02:20:29.972 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_lc_thread_delay": "0", 2024-09-17T02:20:29.972 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-17T02:20:29.972 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_ldap_dnattr": "uid", 2024-09-17T02:20:29.972 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-17T02:20:29.973 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_ldap_searchfilter": "", 2024-09-17T02:20:29.973 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-17T02:20:29.973 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_ldap_uri": "", 2024-09-17T02:20:29.973 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-17T02:20:29.973 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-17T02:20:29.973 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-17T02:20:29.973 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_log_http_headers": "", 2024-09-17T02:20:29.973 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-17T02:20:29.973 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-17T02:20:29.973 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_log_object_name_utc": "false", 2024-09-17T02:20:29.973 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-17T02:20:29.973 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-17T02:20:29.973 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_max_attr_name_len": "0", 2024-09-17T02:20:29.974 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_max_attr_size": "0", 2024-09-17T02:20:29.974 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-17T02:20:29.974 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_max_chunk_size": "4194304", 2024-09-17T02:20:29.974 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-17T02:20:29.974 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-17T02:20:29.974 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-17T02:20:29.974 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_max_listing_results": "1000", 2024-09-17T02:20:29.974 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_max_notify_retries": "10", 2024-09-17T02:20:29.974 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-17T02:20:29.974 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_max_put_param_size": "1048576", 2024-09-17T02:20:29.974 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_max_put_size": "5368709120", 2024-09-17T02:20:29.974 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_max_slo_entries": "1000", 2024-09-17T02:20:29.974 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_md_log_max_shards": "64", 2024-09-17T02:20:29.974 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-17T02:20:29.975 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-17T02:20:29.975 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-17T02:20:29.975 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-17T02:20:29.975 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_mp_lock_max_time": "600", 2024-09-17T02:20:29.975 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-17T02:20:29.975 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-17T02:20:29.975 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-17T02:20:29.975 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-17T02:20:29.975 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-17T02:20:29.975 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-17T02:20:29.975 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-17T02:20:29.975 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-17T02:20:29.975 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_nfs_max_gc": "300", 2024-09-17T02:20:29.976 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-17T02:20:29.976 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-17T02:20:29.976 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-17T02:20:29.976 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-17T02:20:29.976 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-17T02:20:29.976 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-17T02:20:29.976 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-17T02:20:29.976 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_num_async_rados_threads": "32", 2024-09-17T02:20:29.976 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_num_control_oids": "8", 2024-09-17T02:20:29.976 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_numa_node": "-1", 2024-09-17T02:20:29.976 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-17T02:20:29.976 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-17T02:20:29.976 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_objexp_chunk_size": "100", 2024-09-17T02:20:29.977 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_objexp_gc_interval": "600", 2024-09-17T02:20:29.977 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-17T02:20:29.977 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-17T02:20:29.977 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-17T02:20:29.977 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_op_thread_timeout": "600", 2024-09-17T02:20:29.977 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_op_tracing": "false", 2024-09-17T02:20:29.977 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_opa_token": "", 2024-09-17T02:20:29.977 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_opa_url": "", 2024-09-17T02:20:29.977 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_opa_verify_ssl": "true", 2024-09-17T02:20:29.977 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-17T02:20:29.977 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-17T02:20:29.977 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_ops_log_rados": "false", 2024-09-17T02:20:29.977 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_ops_log_socket_path": "", 2024-09-17T02:20:29.978 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-17T02:20:29.978 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-17T02:20:29.978 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-17T02:20:29.978 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_period_push_interval": "2.000000", 2024-09-17T02:20:29.978 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-17T02:20:29.978 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-17T02:20:29.978 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-17T02:20:29.978 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-17T02:20:29.978 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_posix_cache_lanes": "3", 2024-09-17T02:20:29.978 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-17T02:20:29.978 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-17T02:20:29.978 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_posix_cache_partitions": "3", 2024-09-17T02:20:29.978 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-17T02:20:29.978 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_print_continue": "true", 2024-09-17T02:20:29.979 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-17T02:20:29.979 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-17T02:20:29.979 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-17T02:20:29.979 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-17T02:20:29.979 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-17T02:20:29.979 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_rados_tracing": "false", 2024-09-17T02:20:29.979 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_realm": "", 2024-09-17T02:20:29.979 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_realm_id": "", 2024-09-17T02:20:29.979 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-17T02:20:29.979 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_region": "", 2024-09-17T02:20:29.979 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-17T02:20:29.979 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-17T02:20:29.979 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-17T02:20:29.979 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-17T02:20:29.980 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_request_uri": "", 2024-09-17T02:20:29.980 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_reshard_batch_size": "64", 2024-09-17T02:20:29.980 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-17T02:20:29.980 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_reshard_max_aio": "128", 2024-09-17T02:20:29.980 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_reshard_num_logs": "16", 2024-09-17T02:20:29.980 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_reshard_thread_interval": "600", 2024-09-17T02:20:29.980 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_resolve_cname": "false", 2024-09-17T02:20:29.980 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-17T02:20:29.980 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_run_sync_thread": "true", 2024-09-17T02:20:29.980 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-17T02:20:29.980 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-17T02:20:29.980 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-17T02:20:29.980 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-17T02:20:29.981 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-17T02:20:29.981 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-17T02:20:29.981 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-17T02:20:29.981 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-17T02:20:29.981 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-17T02:20:29.981 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_scheduler_type": "throttler", 2024-09-17T02:20:29.981 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_script_uri": "", 2024-09-17T02:20:29.981 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_service_provider_name": "", 2024-09-17T02:20:29.981 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-17T02:20:29.981 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_sts_client_id": "", 2024-09-17T02:20:29.981 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_sts_client_secret": "", 2024-09-17T02:20:29.981 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_sts_entry": "sts", 2024-09-17T02:20:29.981 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_sts_key": "sts", 2024-09-17T02:20:29.981 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-17T02:20:29.982 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_sts_min_session_duration": "900", 2024-09-17T02:20:29.982 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_sts_token_introspection_url": "", 2024-09-17T02:20:29.982 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_swift_account_in_url": "false", 2024-09-17T02:20:29.982 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_swift_auth_entry": "auth", 2024-09-17T02:20:29.982 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_swift_auth_url": "", 2024-09-17T02:20:29.982 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_swift_custom_header": "", 2024-09-17T02:20:29.982 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-17T02:20:29.982 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_swift_need_stats": "true", 2024-09-17T02:20:29.982 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_swift_tenant_name": "", 2024-09-17T02:20:29.982 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_swift_token_expiration": "86400", 2024-09-17T02:20:29.982 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_swift_url": "", 2024-09-17T02:20:29.982 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_swift_url_prefix": "swift", 2024-09-17T02:20:29.982 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-17T02:20:29.983 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-17T02:20:29.983 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-17T02:20:29.983 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_sync_lease_period": "120", 2024-09-17T02:20:29.983 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-17T02:20:29.983 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-17T02:20:29.983 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-17T02:20:29.983 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-17T02:20:29.983 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-17T02:20:29.983 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-17T02:20:29.983 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-17T02:20:29.983 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-17T02:20:29.983 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-17T02:20:29.983 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_thread_pool_size": "512", 2024-09-17T02:20:29.984 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-17T02:20:29.984 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-17T02:20:29.984 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-17T02:20:29.984 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-17T02:20:29.984 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_torrent_comment": "", 2024-09-17T02:20:29.984 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_torrent_createby": "", 2024-09-17T02:20:29.984 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_torrent_encoding": "", 2024-09-17T02:20:29.984 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_torrent_flag": "false", 2024-09-17T02:20:29.984 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-17T02:20:29.984 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_torrent_origin": "", 2024-09-17T02:20:29.984 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-17T02:20:29.984 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_torrent_tracker": "", 2024-09-17T02:20:29.984 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_trust_forwarded_https": "false", 2024-09-17T02:20:29.984 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-17T02:20:29.985 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-17T02:20:29.985 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_usage_max_shards": "32", 2024-09-17T02:20:29.985 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_usage_max_user_shards": "1", 2024-09-17T02:20:29.985 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_use_opa_authz": "false", 2024-09-17T02:20:29.985 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_user_counters_cache": "false", 2024-09-17T02:20:29.985 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-17T02:20:29.985 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-17T02:20:29.985 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-17T02:20:29.985 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_user_max_buckets": "1000", 2024-09-17T02:20:29.985 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_user_policies_max_num": "100", 2024-09-17T02:20:29.985 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-17T02:20:29.985 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-17T02:20:29.985 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-17T02:20:29.986 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-17T02:20:29.986 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_user_unique_email": "true", 2024-09-17T02:20:29.986 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_verify_ssl": "true", 2024-09-17T02:20:29.986 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-17T02:20:29.986 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_zone": "", 2024-09-17T02:20:29.986 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_zone_id": "", 2024-09-17T02:20:29.986 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-17T02:20:29.986 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_zonegroup": "", 2024-09-17T02:20:29.986 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_zonegroup_id": "", 2024-09-17T02:20:29.986 INFO:teuthology.orchestra.run.smithi001.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-17T02:20:29.986 INFO:teuthology.orchestra.run.smithi001.stdout: "rgwlc_auto_session_clear": "true", 2024-09-17T02:20:29.986 INFO:teuthology.orchestra.run.smithi001.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-17T02:20:29.986 INFO:teuthology.orchestra.run.smithi001.stdout: "rocksdb_block_size": "4096", 2024-09-17T02:20:29.986 INFO:teuthology.orchestra.run.smithi001.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-17T02:20:29.987 INFO:teuthology.orchestra.run.smithi001.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-17T02:20:29.987 INFO:teuthology.orchestra.run.smithi001.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-17T02:20:29.987 INFO:teuthology.orchestra.run.smithi001.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-17T02:20:29.987 INFO:teuthology.orchestra.run.smithi001.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-17T02:20:29.987 INFO:teuthology.orchestra.run.smithi001.stdout: "rocksdb_cache_size": "536870912", 2024-09-17T02:20:29.987 INFO:teuthology.orchestra.run.smithi001.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-17T02:20:29.987 INFO:teuthology.orchestra.run.smithi001.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-17T02:20:29.987 INFO:teuthology.orchestra.run.smithi001.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-17T02:20:29.987 INFO:teuthology.orchestra.run.smithi001.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-17T02:20:29.987 INFO:teuthology.orchestra.run.smithi001.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-17T02:20:29.987 INFO:teuthology.orchestra.run.smithi001.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-17T02:20:29.987 INFO:teuthology.orchestra.run.smithi001.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-17T02:20:29.987 INFO:teuthology.orchestra.run.smithi001.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-17T02:20:29.988 INFO:teuthology.orchestra.run.smithi001.stdout: "rocksdb_index_type": "binary_search", 2024-09-17T02:20:29.988 INFO:teuthology.orchestra.run.smithi001.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-17T02:20:29.988 INFO:teuthology.orchestra.run.smithi001.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-17T02:20:29.988 INFO:teuthology.orchestra.run.smithi001.stdout: "rocksdb_partition_filters": "false", 2024-09-17T02:20:29.988 INFO:teuthology.orchestra.run.smithi001.stdout: "rocksdb_perf": "false", 2024-09-17T02:20:29.988 INFO:teuthology.orchestra.run.smithi001.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-17T02:20:29.988 INFO:teuthology.orchestra.run.smithi001.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-17T02:20:29.988 INFO:teuthology.orchestra.run.smithi001.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-17T02:20:29.988 INFO:teuthology.orchestra.run.smithi001.stdout: "run_dir": "/var/run/ceph", 2024-09-17T02:20:29.988 INFO:teuthology.orchestra.run.smithi001.stdout: "seastore_block_create": "true", 2024-09-17T02:20:29.988 INFO:teuthology.orchestra.run.smithi001.stdout: "seastore_cache_lru_size": "67108864", 2024-09-17T02:20:29.988 INFO:teuthology.orchestra.run.smithi001.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-17T02:20:29.988 INFO:teuthology.orchestra.run.smithi001.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-17T02:20:29.988 INFO:teuthology.orchestra.run.smithi001.stdout: "seastore_default_max_object_size": "16777216", 2024-09-17T02:20:29.989 INFO:teuthology.orchestra.run.smithi001.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-17T02:20:29.989 INFO:teuthology.orchestra.run.smithi001.stdout: "seastore_device_size": "53687091200", 2024-09-17T02:20:29.989 INFO:teuthology.orchestra.run.smithi001.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-17T02:20:29.989 INFO:teuthology.orchestra.run.smithi001.stdout: "seastore_full_integrity_check": "false", 2024-09-17T02:20:29.989 INFO:teuthology.orchestra.run.smithi001.stdout: "seastore_journal_batch_capacity": "16", 2024-09-17T02:20:29.989 INFO:teuthology.orchestra.run.smithi001.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-17T02:20:29.989 INFO:teuthology.orchestra.run.smithi001.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-17T02:20:29.989 INFO:teuthology.orchestra.run.smithi001.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-17T02:20:29.989 INFO:teuthology.orchestra.run.smithi001.stdout: "seastore_main_device_type": "SSD", 2024-09-17T02:20:29.989 INFO:teuthology.orchestra.run.smithi001.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-17T02:20:29.989 INFO:teuthology.orchestra.run.smithi001.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-17T02:20:29.989 INFO:teuthology.orchestra.run.smithi001.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-17T02:20:29.989 INFO:teuthology.orchestra.run.smithi001.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-17T02:20:29.989 INFO:teuthology.orchestra.run.smithi001.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-17T02:20:29.990 INFO:teuthology.orchestra.run.smithi001.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-17T02:20:29.990 INFO:teuthology.orchestra.run.smithi001.stdout: "seastore_segment_size": "67108864", 2024-09-17T02:20:29.990 INFO:teuthology.orchestra.run.smithi001.stdout: "set_keepcaps": "false", 2024-09-17T02:20:29.990 INFO:teuthology.orchestra.run.smithi001.stdout: "setgroup": "", 2024-09-17T02:20:29.990 INFO:teuthology.orchestra.run.smithi001.stdout: "setuser": "", 2024-09-17T02:20:29.990 INFO:teuthology.orchestra.run.smithi001.stdout: "setuser_match_path": "", 2024-09-17T02:20:29.990 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-17T02:20:29.990 INFO:teuthology.orchestra.run.smithi001.stdout: "thp": "false", 2024-09-17T02:20:29.990 INFO:teuthology.orchestra.run.smithi001.stdout: "threadpool_default_timeout": "60", 2024-09-17T02:20:29.990 INFO:teuthology.orchestra.run.smithi001.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-17T02:20:29.990 INFO:teuthology.orchestra.run.smithi001.stdout: "throttler_perf_counter": "true" 2024-09-17T02:20:29.990 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-17T02:20:29.993 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-17T02:20:30.136 INFO:teuthology.orchestra.run.smithi001.stdout:mon.a: {} 2024-09-17T02:20:30.136 INFO:teuthology.orchestra.run.smithi001.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T02:20:30.145 INFO:teuthology.orchestra.run.smithi001.stdout:mon.b: {} 2024-09-17T02:20:30.145 INFO:teuthology.orchestra.run.smithi001.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T02:20:30.155 INFO:teuthology.orchestra.run.smithi001.stdout:mon.c: {} 2024-09-17T02:20:30.155 INFO:teuthology.orchestra.run.smithi001.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T02:20:30.171 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-09-17T02:20:30.171 INFO:teuthology.run_tasks:Running task radosbench... 2024-09-17T02:20:30.184 INFO:tasks.radosbench:Beginning radosbench... 2024-09-17T02:20:30.185 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-09-17T02:20:30.185 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2024-09-17T02:20:30.185 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-17T02:20:30.185 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-17T02:20:30.185 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T02:20:30.186 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-09-17T02:20:30.186 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-17T02:20:30.186 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-17T02:20:30.186 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-09-17T02:20:30.186 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-17T02:20:30.187 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-17T02:20:30.187 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:20:30.187 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-17T02:20:30.187 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:20:30.188 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-17T02:20:30.188 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T02:20:30.189 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:30.192+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:30.289 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:30.292+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:30.320 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:20:30.320 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-17T02:20:30.320 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:20:30.326 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:20:30.326 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:20:30.326 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:30.326 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:30.341 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:20:30.346 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:20:30.346 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:20:30.366 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:20:30.367 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:20:30.389 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:30.392+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:30.466 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:30.466 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:30.482 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:20:30.490 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:30.496+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:30.591 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:30.596+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:30.607 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:30.607 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:30.623 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:20:30.651 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'unique_pool_0' created 2024-09-17T02:20:30.651 INFO:teuthology.orchestra.run.smithi001.stderr:noscrub is set 2024-09-17T02:20:30.673 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-09-17T02:20:30.692 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:30.696+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:30.757 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:30.757 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:30.771 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:20:30.793 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:30.798+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:30.894 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:30.900+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:30.939 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:30.940 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:30.953 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:20:30.998 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:31.004+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:31.076 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:31.077 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:31.091 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:20:31.096 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:31.100+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:31.196 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:31.198+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:31.221 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:31.221 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:31.236 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:20:31.297 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:31.300+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:31.397 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:31.400+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:31.401 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:31.401 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:31.416 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:20:31.498 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:31.504+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:31.538 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:31.539 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:31.553 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:20:31.598 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:31.604+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:31.654 INFO:teuthology.orchestra.run.smithi001.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-09-17T02:20:31.691 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:31.691 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:31.699 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:31.704+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:31.705 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:20:31.802 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:31.808+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:31.875 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:31.875 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:31.890 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:20:31.934 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:31.940+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:32.002 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:32.004+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:32.062 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:32.062 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:32.075 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:20:32.123 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:32.128+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:32.204 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:32.210+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:32.205 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:32.205 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:32.221 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:20:32.305 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:32.308+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:32.383 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:20:32.384 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:32.384 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:32.398 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:20:32.406 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:32.412+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:32.507 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:32.512+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:32.514 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:32.515 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:32.529 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:20:32.543 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:20:32.543 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:20:32.563 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:20:32.564 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:20:32.583 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:20:32.583 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:20:32.607 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:32.610+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:32.662 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:20:32.662 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-17T02:20:32.662 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-09-17T02:20:32.662 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:20:32.675 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T02:20:32.676 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:20:32.679 DEBUG:teuthology.orchestra.run.smithi001:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_0 bench 60 write' 2024-09-17T02:20:32.709 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:32.712+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:32.722 INFO:teuthology.run_tasks:Running task admin_socket... 2024-09-17T02:20:32.731 DEBUG:tasks.admin_socket:Running admin socket tests on client.0 2024-09-17T02:20:32.732 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -- /home/ubuntu/cephtest/admin_socket_client.0 && while test '!' -e /var/run/ceph/ceph-client.0.asok ; do sleep 1 ; done 2024-09-17T02:20:32.765 INFO:tasks.radosbench.radosbench.0.smithi001.stdout:hints = 1 2024-09-17T02:20:32.766 INFO:tasks.radosbench.radosbench.0.smithi001.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 60 seconds or 0 objects 2024-09-17T02:20:32.766 INFO:tasks.radosbench.radosbench.0.smithi001.stdout:Object prefix: benchmark_data_smithi001_23533 2024-09-17T02:20:32.766 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-17T02:20:32.766 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 0 0 0 0 0 0 - 0 2024-09-17T02:20:32.810 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:32.810+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:32.861 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:20:32.861 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-17T02:20:32.861 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-09-17T02:20:32.861 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-09-17T02:20:32.861 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:20:32.880 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:20:32.910 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:32.916+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:33.011 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:33.016+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:33.086 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:20:33.086 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-09-17T02:20:33.086 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-09-17T02:20:33.086 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-17T02:20:33.086 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.086 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-17T02:20:33.086 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:20:33.087 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.631561610999999, 2024-09-17T02:20:33.087 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.15597325500000001, 2024-09-17T02:20:33.087 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:33.087 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:33.087 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.087 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:33.087 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4164", 2024-09-17T02:20:33.087 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/201892753", 2024-09-17T02:20:33.087 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 1 2024-09-17T02:20:33.087 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.087 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:33.087 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:33.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:20:33.088 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:33.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:20:33.088 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:33.089 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458359+0000", 2024-09-17T02:20:33.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3929999999999998e-06 2024-09-17T02:20:33.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.089 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:33.089 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458373+0000", 2024-09-17T02:20:33.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4103e-05 2024-09-17T02:20:33.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.089 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:33.089 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458397+0000", 2024-09-17T02:20:33.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.438e-05 2024-09-17T02:20:33.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.090 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.090 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458421+0000", 2024-09-17T02:20:33.090 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3655999999999998e-05 2024-09-17T02:20:33.090 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.090 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.090 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:33.090 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458529+0000", 2024-09-17T02:20:33.090 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010752900000000001 2024-09-17T02:20:33.090 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.090 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.090 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:20:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458542+0000", 2024-09-17T02:20:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2986999999999999e-05 2024-09-17T02:20:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.611050+0000", 2024-09-17T02:20:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.1525087 2024-09-17T02:20:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.611529+0000", 2024-09-17T02:20:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00047844899999999999 2024-09-17T02:20:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.092 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.092 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:33.092 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.612061+0000", 2024-09-17T02:20:33.092 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00053230300000000003 2024-09-17T02:20:33.092 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.092 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.092 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:33.092 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.613451+0000", 2024-09-17T02:20:33.092 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0013897250000000001 2024-09-17T02:20:33.092 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.092 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.092 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614168+0000", 2024-09-17T02:20:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00071692499999999998 2024-09-17T02:20:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614265+0000", 2024-09-17T02:20:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7589000000000004e-05 2024-09-17T02:20:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614330+0000", 2024-09-17T02:20:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4516000000000004e-05 2024-09-17T02:20:33.093 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.094 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:33.094 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.094 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.094 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.094 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4164.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-17T02:20:33.094 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:04.966730+0000", 2024-09-17T02:20:33.094 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.12318823, 2024-09-17T02:20:33.094 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.024160772, 2024-09-17T02:20:33.094 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:33.094 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4164", 2024-09-17T02:20:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/201892753", 2024-09-17T02:20:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 117 2024-09-17T02:20:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.966730+0000", 2024-09-17T02:20:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.095 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:33.096 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.966730+0000", 2024-09-17T02:20:33.096 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.096 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.096 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.096 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:33.096 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.966731+0000", 2024-09-17T02:20:33.096 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5000000000000002e-07 2024-09-17T02:20:33.096 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.096 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.096 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:33.096 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.966736+0000", 2024-09-17T02:20:33.097 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3900000000000001e-06 2024-09-17T02:20:33.097 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.097 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.097 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:33.097 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.966746+0000", 2024-09-17T02:20:33.097 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4960000000000002e-06 2024-09-17T02:20:33.097 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.097 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.097 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.097 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.966753+0000", 2024-09-17T02:20:33.097 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0770000000000002e-06 2024-09-17T02:20:33.097 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.098 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.098 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:33.098 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.988554+0000", 2024-09-17T02:20:33.098 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.021801503999999999 2024-09-17T02:20:33.098 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.098 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.098 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:33.098 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.988813+0000", 2024-09-17T02:20:33.098 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000258514 2024-09-17T02:20:33.098 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.098 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.098 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:33.098 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.989188+0000", 2024-09-17T02:20:33.098 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000375767 2024-09-17T02:20:33.099 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.099 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.099 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:33.099 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.990403+0000", 2024-09-17T02:20:33.099 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001214487 2024-09-17T02:20:33.099 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.099 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.099 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.099 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.990696+0000", 2024-09-17T02:20:33.099 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029352499999999999 2024-09-17T02:20:33.099 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.099 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.099 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:33.100 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.990782+0000", 2024-09-17T02:20:33.100 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5389000000000005e-05 2024-09-17T02:20:33.100 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.100 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.100 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:33.100 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.990891+0000", 2024-09-17T02:20:33.100 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000108873 2024-09-17T02:20:33.100 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.100 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:33.100 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.100 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.100 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.100 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:33.101 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556145+0000", 2024-09-17T02:20:33.101 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 16.533773309000001, 2024-09-17T02:20:33.101 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.025052441000000002, 2024-09-17T02:20:33.101 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:33.101 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:33.101 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.101 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:33.101 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.101 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:33.101 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556145+0000", 2024-09-17T02:20:33.101 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.101 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.101 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.102 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:33.102 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556145+0000", 2024-09-17T02:20:33.102 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.102 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.102 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.102 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:33.102 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556148+0000", 2024-09-17T02:20:33.102 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4400000000000001e-06 2024-09-17T02:20:33.102 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.102 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.102 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:33.102 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556185+0000", 2024-09-17T02:20:33.102 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6603000000000002e-05 2024-09-17T02:20:33.103 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.103 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.103 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:33.103 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556220+0000", 2024-09-17T02:20:33.103 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5065999999999999e-05 2024-09-17T02:20:33.103 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.103 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.103 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.103 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556244+0000", 2024-09-17T02:20:33.103 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3937000000000001e-05 2024-09-17T02:20:33.103 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.103 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.103 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:33.103 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556378+0000", 2024-09-17T02:20:33.104 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000134129 2024-09-17T02:20:33.104 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.104 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.104 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:33.104 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556573+0000", 2024-09-17T02:20:33.104 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000195038 2024-09-17T02:20:33.104 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.104 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.104 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:33.104 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556765+0000", 2024-09-17T02:20:33.104 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019188199999999999 2024-09-17T02:20:33.104 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.104 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.105 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:33.105 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562153+0000", 2024-09-17T02:20:33.105 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0053883220000000001 2024-09-17T02:20:33.105 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.105 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.105 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.105 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.580640+0000", 2024-09-17T02:20:33.105 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018487145 2024-09-17T02:20:33.105 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.105 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.105 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:33.105 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.580791+0000", 2024-09-17T02:20:33.105 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015011899999999999 2024-09-17T02:20:33.105 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.106 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.106 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:33.106 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.581197+0000", 2024-09-17T02:20:33.106 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00040675999999999999 2024-09-17T02:20:33.106 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.106 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:33.106 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.106 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.106 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.106 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:33.106 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:20:33.106 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 16.533630493, 2024-09-17T02:20:33.106 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029713927000000001, 2024-09-17T02:20:33.107 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:33.107 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:33.107 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.107 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:33.107 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.107 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:33.107 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:20:33.107 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.107 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.107 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.107 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:33.107 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:20:33.107 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.107 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.108 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:33.108 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556289+0000", 2024-09-17T02:20:33.108 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.513e-06 2024-09-17T02:20:33.108 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.108 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:33.108 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556298+0000", 2024-09-17T02:20:33.108 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1630000000000002e-06 2024-09-17T02:20:33.108 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.108 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:33.108 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556318+0000", 2024-09-17T02:20:33.108 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9389999999999999e-05 2024-09-17T02:20:33.109 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.109 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.109 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.109 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556332+0000", 2024-09-17T02:20:33.109 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4506e-05 2024-09-17T02:20:33.109 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.109 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.109 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:33.109 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557304+0000", 2024-09-17T02:20:33.109 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00097169699999999999 2024-09-17T02:20:33.109 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.109 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.109 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:33.110 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557507+0000", 2024-09-17T02:20:33.110 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000203191 2024-09-17T02:20:33.110 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.110 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.110 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:33.110 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557838+0000", 2024-09-17T02:20:33.110 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033061100000000002 2024-09-17T02:20:33.110 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.110 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.110 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:33.110 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562171+0000", 2024-09-17T02:20:33.110 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043329229999999998 2024-09-17T02:20:33.110 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.110 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.111 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.111 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585737+0000", 2024-09-17T02:20:33.111 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023565915 2024-09-17T02:20:33.111 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.111 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.111 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:33.111 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585884+0000", 2024-09-17T02:20:33.111 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014744199999999999 2024-09-17T02:20:33.111 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.111 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.111 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:33.111 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586002+0000", 2024-09-17T02:20:33.111 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000117576 2024-09-17T02:20:33.111 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.112 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:33.112 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.112 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.112 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.112 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:33.112 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:20:33.112 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 16.533538521000001, 2024-09-17T02:20:33.112 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030933694000000001, 2024-09-17T02:20:33.112 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:33.112 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:33.112 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.112 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:33.112 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.113 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:33.113 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:20:33.113 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.113 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.113 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.113 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:33.113 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:20:33.113 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.113 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.114 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.114 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:33.114 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556381+0000", 2024-09-17T02:20:33.114 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2100000000000001e-06 2024-09-17T02:20:33.114 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.114 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.114 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:33.114 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556389+0000", 2024-09-17T02:20:33.114 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5539999999999998e-06 2024-09-17T02:20:33.114 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.114 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.114 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:33.114 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556408+0000", 2024-09-17T02:20:33.114 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8623000000000001e-05 2024-09-17T02:20:33.115 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.115 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.115 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.115 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556427+0000", 2024-09-17T02:20:33.115 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8566000000000001e-05 2024-09-17T02:20:33.115 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.115 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.115 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:33.115 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558741+0000", 2024-09-17T02:20:33.115 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023144390000000002 2024-09-17T02:20:33.116 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.116 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.116 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:33.116 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559040+0000", 2024-09-17T02:20:33.116 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029912100000000001 2024-09-17T02:20:33.116 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.116 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.116 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:33.116 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559222+0000", 2024-09-17T02:20:33.116 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018211200000000001 2024-09-17T02:20:33.116 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.117 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.117 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:33.117 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.566648+0000", 2024-09-17T02:20:33.117 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074257560000000004 2024-09-17T02:20:33.117 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.117 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.117 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.117 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587109+0000", 2024-09-17T02:20:33.117 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.020460685999999999 2024-09-17T02:20:33.118 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.118 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.118 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:33.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587232+0000", 2024-09-17T02:20:33.118 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123325 2024-09-17T02:20:33.118 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.118 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.118 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:33.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587313+0000", 2024-09-17T02:20:33.118 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1302000000000002e-05 2024-09-17T02:20:33.118 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.118 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:33.118 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.119 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.119 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.119 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:33.119 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:20:33.119 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 16.533473075, 2024-09-17T02:20:33.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031045538000000001, 2024-09-17T02:20:33.119 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:33.119 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:33.119 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.119 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:33.119 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.119 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:33.120 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:20:33.120 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.120 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.120 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.120 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:33.120 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:20:33.120 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.120 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.120 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.120 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:33.120 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556446+0000", 2024-09-17T02:20:33.120 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.26e-06 2024-09-17T02:20:33.120 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.121 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.121 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:33.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556454+0000", 2024-09-17T02:20:33.121 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1640000000000004e-06 2024-09-17T02:20:33.121 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.121 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.121 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:33.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556471+0000", 2024-09-17T02:20:33.121 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7586000000000001e-05 2024-09-17T02:20:33.121 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.121 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.121 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556485+0000", 2024-09-17T02:20:33.122 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3523000000000001e-05 2024-09-17T02:20:33.122 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.122 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.122 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:33.122 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559899+0000", 2024-09-17T02:20:33.122 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0034142140000000001 2024-09-17T02:20:33.122 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.122 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.122 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:33.122 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.560104+0000", 2024-09-17T02:20:33.122 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00020539199999999999 2024-09-17T02:20:33.122 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.122 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.123 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:33.123 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.560400+0000", 2024-09-17T02:20:33.123 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029612099999999999 2024-09-17T02:20:33.123 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.123 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.123 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:33.123 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.568427+0000", 2024-09-17T02:20:33.123 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0080262909999999996 2024-09-17T02:20:33.123 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.123 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.123 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.123 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587377+0000", 2024-09-17T02:20:33.123 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018950765000000001 2024-09-17T02:20:33.124 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.124 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.124 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:33.124 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587445+0000", 2024-09-17T02:20:33.124 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.724e-05 2024-09-17T02:20:33.124 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.124 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.124 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:33.124 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587491+0000", 2024-09-17T02:20:33.124 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5982000000000001e-05 2024-09-17T02:20:33.124 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.124 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:33.124 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.125 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.125 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.125 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:33.125 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:20:33.125 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 16.533410305, 2024-09-17T02:20:33.125 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031435547000000001, 2024-09-17T02:20:33.125 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:33.125 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:33.125 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.125 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:33.125 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.125 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:33.125 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:20:33.126 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.126 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.126 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.126 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:33.126 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:20:33.126 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.126 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.126 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.126 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:33.126 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556509+0000", 2024-09-17T02:20:33.126 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.06e-06 2024-09-17T02:20:33.126 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.127 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.127 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:33.127 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556515+0000", 2024-09-17T02:20:33.127 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1029999999999998e-06 2024-09-17T02:20:33.127 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.127 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.127 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:33.127 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556532+0000", 2024-09-17T02:20:33.127 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7054e-05 2024-09-17T02:20:33.127 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.127 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.127 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.127 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556545+0000", 2024-09-17T02:20:33.128 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3023000000000001e-05 2024-09-17T02:20:33.128 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.128 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.128 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:33.128 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561016+0000", 2024-09-17T02:20:33.128 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044705150000000004 2024-09-17T02:20:33.128 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.128 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.128 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:33.128 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561316+0000", 2024-09-17T02:20:33.128 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000299895 2024-09-17T02:20:33.128 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.129 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.129 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:33.129 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561651+0000", 2024-09-17T02:20:33.129 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033519300000000001 2024-09-17T02:20:33.129 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.129 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.129 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:33.129 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571105+0000", 2024-09-17T02:20:33.129 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094540539999999999 2024-09-17T02:20:33.129 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.129 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.130 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.130 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587628+0000", 2024-09-17T02:20:33.130 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016522819000000001 2024-09-17T02:20:33.130 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.130 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.130 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:33.130 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587770+0000", 2024-09-17T02:20:33.130 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000142352 2024-09-17T02:20:33.130 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.130 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.130 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:33.130 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587943+0000", 2024-09-17T02:20:33.130 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017347900000000001 2024-09-17T02:20:33.130 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.130 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:33.131 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.131 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.131 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.131 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:33.131 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:20:33.131 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 16.533354575000001, 2024-09-17T02:20:33.131 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031809104999999997, 2024-09-17T02:20:33.131 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:33.131 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:33.132 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.132 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:33.132 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.132 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:33.132 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:20:33.132 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.132 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.132 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.132 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:33.132 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:20:33.132 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.132 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.133 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.133 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:33.133 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556565+0000", 2024-09-17T02:20:33.133 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.116e-06 2024-09-17T02:20:33.133 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.133 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.133 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:33.133 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556572+0000", 2024-09-17T02:20:33.133 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0230000000000004e-06 2024-09-17T02:20:33.133 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.133 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.133 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:33.133 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556588+0000", 2024-09-17T02:20:33.134 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6643e-05 2024-09-17T02:20:33.134 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.134 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.134 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.134 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556606+0000", 2024-09-17T02:20:33.134 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7159999999999998e-05 2024-09-17T02:20:33.134 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.134 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.134 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:33.134 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562712+0000", 2024-09-17T02:20:33.134 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0061061630000000004 2024-09-17T02:20:33.134 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.134 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.135 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:33.135 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562919+0000", 2024-09-17T02:20:33.135 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000207309 2024-09-17T02:20:33.135 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.135 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.135 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:33.135 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563264+0000", 2024-09-17T02:20:33.135 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00034490699999999998 2024-09-17T02:20:33.135 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.135 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.135 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:33.135 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571812+0000", 2024-09-17T02:20:33.135 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0085477810000000008 2024-09-17T02:20:33.135 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.136 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.136 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.136 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588094+0000", 2024-09-17T02:20:33.136 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016282443000000001 2024-09-17T02:20:33.136 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.136 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.136 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:33.136 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588275+0000", 2024-09-17T02:20:33.136 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018058700000000001 2024-09-17T02:20:33.136 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.136 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.136 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:33.136 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588373+0000", 2024-09-17T02:20:33.137 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7973000000000005e-05 2024-09-17T02:20:33.137 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.137 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:33.137 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.137 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.137 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.137 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:33.137 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:20:33.137 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 16.533296476, 2024-09-17T02:20:33.137 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031950544999999997, 2024-09-17T02:20:33.137 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:33.137 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:33.137 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.137 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:33.138 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.138 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:33.138 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:20:33.138 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.138 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.138 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.138 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:33.138 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:20:33.138 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.138 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.138 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.138 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:33.138 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556623+0000", 2024-09-17T02:20:33.138 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.04e-06 2024-09-17T02:20:33.139 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.139 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.139 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:33.139 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556631+0000", 2024-09-17T02:20:33.139 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1529999999999997e-06 2024-09-17T02:20:33.139 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.139 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.139 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:33.139 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556648+0000", 2024-09-17T02:20:33.139 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6583999999999999e-05 2024-09-17T02:20:33.139 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.139 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.139 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.139 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556661+0000", 2024-09-17T02:20:33.140 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3203e-05 2024-09-17T02:20:33.140 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.140 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.140 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:33.140 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564413+0000", 2024-09-17T02:20:33.140 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0077523100000000001 2024-09-17T02:20:33.140 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.140 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.140 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:33.140 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.565841+0000", 2024-09-17T02:20:33.140 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014276320000000001 2024-09-17T02:20:33.140 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.140 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.141 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:33.141 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.566131+0000", 2024-09-17T02:20:33.141 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029043800000000001 2024-09-17T02:20:33.141 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.141 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.141 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:33.141 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572353+0000", 2024-09-17T02:20:33.141 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.006222399 2024-09-17T02:20:33.141 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.141 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.141 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.141 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588452+0000", 2024-09-17T02:20:33.141 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016098635 2024-09-17T02:20:33.141 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.142 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.142 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:33.142 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588520+0000", 2024-09-17T02:20:33.142 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8040000000000006e-05 2024-09-17T02:20:33.142 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.142 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.142 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:33.142 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588572+0000", 2024-09-17T02:20:33.142 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2111000000000003e-05 2024-09-17T02:20:33.142 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.142 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:33.142 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.142 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.142 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.143 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:33.143 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:20:33.143 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 16.533199310000001, 2024-09-17T02:20:33.143 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.032187205000000003, 2024-09-17T02:20:33.143 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:33.143 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:33.143 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.143 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:33.143 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.143 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:33.143 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:20:33.143 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.143 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.144 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.144 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:33.144 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:20:33.144 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.144 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.144 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.144 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:33.144 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556727+0000", 2024-09-17T02:20:33.144 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3000000000000002e-06 2024-09-17T02:20:33.144 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.144 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.144 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:33.144 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556736+0000", 2024-09-17T02:20:33.144 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4300000000000006e-06 2024-09-17T02:20:33.145 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.145 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.145 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:33.145 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556755+0000", 2024-09-17T02:20:33.145 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9700000000000001e-05 2024-09-17T02:20:33.145 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.145 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.145 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.145 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556771+0000", 2024-09-17T02:20:33.145 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5213e-05 2024-09-17T02:20:33.145 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.145 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.145 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:33.146 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571184+0000", 2024-09-17T02:20:33.146 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014413888999999999 2024-09-17T02:20:33.146 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.146 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.146 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:33.146 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571302+0000", 2024-09-17T02:20:33.146 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011794900000000001 2024-09-17T02:20:33.146 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.146 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.146 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:33.146 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571494+0000", 2024-09-17T02:20:33.146 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000191168 2024-09-17T02:20:33.146 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.147 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.147 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:33.147 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.573775+0000", 2024-09-17T02:20:33.147 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002281656 2024-09-17T02:20:33.147 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.147 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.147 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.147 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588668+0000", 2024-09-17T02:20:33.147 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014892699000000001 2024-09-17T02:20:33.147 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.147 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.147 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:33.147 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588813+0000", 2024-09-17T02:20:33.148 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014530700000000001 2024-09-17T02:20:33.148 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.148 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.148 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:33.148 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588906+0000", 2024-09-17T02:20:33.148 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2893999999999995e-05 2024-09-17T02:20:33.148 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.148 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:33.148 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.148 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.148 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.148 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:33.148 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556790+0000", 2024-09-17T02:20:33.148 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 16.53312858, 2024-09-17T02:20:33.149 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.027122670000000002, 2024-09-17T02:20:33.149 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:33.149 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:33.149 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.149 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:33.149 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.149 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:33.149 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556790+0000", 2024-09-17T02:20:33.149 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.149 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.149 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.149 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:33.149 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556790+0000", 2024-09-17T02:20:33.150 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.150 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.150 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.152 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:33.152 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556791+0000", 2024-09-17T02:20:33.152 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.063e-06 2024-09-17T02:20:33.153 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.153 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.153 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:33.153 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556797+0000", 2024-09-17T02:20:33.153 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0530000000000003e-06 2024-09-17T02:20:33.153 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.153 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.153 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:33.153 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556814+0000", 2024-09-17T02:20:33.153 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7567e-05 2024-09-17T02:20:33.153 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.153 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.153 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.154 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556827+0000", 2024-09-17T02:20:33.154 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3026e-05 2024-09-17T02:20:33.154 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.154 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.154 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:33.154 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556981+0000", 2024-09-17T02:20:33.154 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000153299 2024-09-17T02:20:33.154 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.154 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.154 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:33.154 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557252+0000", 2024-09-17T02:20:33.154 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00027129399999999999 2024-09-17T02:20:33.154 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.155 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.155 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:33.155 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557564+0000", 2024-09-17T02:20:33.155 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000311615 2024-09-17T02:20:33.155 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.155 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.155 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:33.155 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.568194+0000", 2024-09-17T02:20:33.155 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010630175 2024-09-17T02:20:33.155 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.155 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.155 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.155 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.583636+0000", 2024-09-17T02:20:33.156 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015442256999999999 2024-09-17T02:20:33.156 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.156 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.156 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:33.156 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.583758+0000", 2024-09-17T02:20:33.156 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000121692 2024-09-17T02:20:33.156 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.156 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.156 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:33.156 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.583912+0000", 2024-09-17T02:20:33.156 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015462900000000001 2024-09-17T02:20:33.156 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.157 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:33.157 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.157 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.157 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.157 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:33.157 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:20:33.157 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 16.533058144999998, 2024-09-17T02:20:33.157 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028815922000000001, 2024-09-17T02:20:33.157 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:33.157 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:33.157 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.157 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:33.158 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.158 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:33.158 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:20:33.158 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.158 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.158 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.158 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:33.158 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:20:33.158 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.158 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.158 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.158 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:33.158 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556861+0000", 2024-09-17T02:20:33.159 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.08e-06 2024-09-17T02:20:33.159 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.159 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.159 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:33.159 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556867+0000", 2024-09-17T02:20:33.159 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.207e-06 2024-09-17T02:20:33.159 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.159 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.159 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:33.159 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556886+0000", 2024-09-17T02:20:33.159 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9137e-05 2024-09-17T02:20:33.159 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.159 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.160 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.160 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556900+0000", 2024-09-17T02:20:33.160 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3253e-05 2024-09-17T02:20:33.160 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.160 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.160 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:33.160 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558301+0000", 2024-09-17T02:20:33.160 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014008320000000001 2024-09-17T02:20:33.160 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.160 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.160 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:33.160 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558564+0000", 2024-09-17T02:20:33.161 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000263238 2024-09-17T02:20:33.161 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.161 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.161 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:33.161 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558905+0000", 2024-09-17T02:20:33.161 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000341534 2024-09-17T02:20:33.161 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.161 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.161 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:33.161 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.568208+0000", 2024-09-17T02:20:33.161 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0093023689999999996 2024-09-17T02:20:33.161 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.161 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.161 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.162 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585379+0000", 2024-09-17T02:20:33.162 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017171091999999999 2024-09-17T02:20:33.162 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.162 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.162 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:33.162 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585509+0000", 2024-09-17T02:20:33.162 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013036100000000001 2024-09-17T02:20:33.162 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.162 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.162 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:33.162 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585676+0000", 2024-09-17T02:20:33.162 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016681899999999999 2024-09-17T02:20:33.163 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.163 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:33.163 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.163 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.163 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.163 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:33.163 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:20:33.163 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 16.533000877999999, 2024-09-17T02:20:33.163 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030862568, 2024-09-17T02:20:33.163 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:33.163 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:33.163 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.163 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:33.164 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.164 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:33.164 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:20:33.164 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.164 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.164 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.164 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:33.164 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:20:33.164 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.164 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.164 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.164 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:33.164 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556918+0000", 2024-09-17T02:20:33.164 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0529999999999999e-06 2024-09-17T02:20:33.165 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.165 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.165 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:33.165 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556925+0000", 2024-09-17T02:20:33.165 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.6939999999999998e-06 2024-09-17T02:20:33.165 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.165 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.165 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:33.165 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556942+0000", 2024-09-17T02:20:33.165 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6803000000000002e-05 2024-09-17T02:20:33.165 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.166 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.166 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.166 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556955+0000", 2024-09-17T02:20:33.166 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2659e-05 2024-09-17T02:20:33.166 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.166 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.166 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:33.166 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558237+0000", 2024-09-17T02:20:33.166 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001282804 2024-09-17T02:20:33.166 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.166 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.167 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:33.167 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558495+0000", 2024-09-17T02:20:33.167 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000257178 2024-09-17T02:20:33.167 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.167 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.167 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:33.167 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562168+0000", 2024-09-17T02:20:33.167 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0036737110000000001 2024-09-17T02:20:33.167 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.167 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.167 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:33.167 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.570855+0000", 2024-09-17T02:20:33.167 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0086868729999999995 2024-09-17T02:20:33.168 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.168 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.168 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.168 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587568+0000", 2024-09-17T02:20:33.168 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016712444999999999 2024-09-17T02:20:33.168 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.168 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.168 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:33.168 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587677+0000", 2024-09-17T02:20:33.168 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000109879 2024-09-17T02:20:33.168 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.168 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.168 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:33.168 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587780+0000", 2024-09-17T02:20:33.169 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000102469 2024-09-17T02:20:33.169 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.169 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:33.169 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.169 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.169 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.169 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:33.169 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:20:33.169 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 16.532918746, 2024-09-17T02:20:33.169 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031005751000000002, 2024-09-17T02:20:33.169 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:33.169 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:33.169 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.169 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:33.170 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.170 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:33.170 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:20:33.170 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.170 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.170 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.170 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:33.170 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:20:33.170 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.170 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.170 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.170 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:33.170 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557001+0000", 2024-09-17T02:20:33.171 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.237e-06 2024-09-17T02:20:33.171 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.171 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.171 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:33.171 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557007+0000", 2024-09-17T02:20:33.171 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7270000000000001e-06 2024-09-17T02:20:33.171 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.171 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.171 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:33.171 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557025+0000", 2024-09-17T02:20:33.171 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7689999999999998e-05 2024-09-17T02:20:33.171 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.171 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.171 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.172 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557039+0000", 2024-09-17T02:20:33.172 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.385e-05 2024-09-17T02:20:33.172 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.172 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.172 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:33.172 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563783+0000", 2024-09-17T02:20:33.172 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0067437110000000003 2024-09-17T02:20:33.172 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.172 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.172 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:33.172 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564031+0000", 2024-09-17T02:20:33.172 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00024871799999999999 2024-09-17T02:20:33.172 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.173 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.173 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:33.173 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564518+0000", 2024-09-17T02:20:33.173 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00048708999999999997 2024-09-17T02:20:33.173 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.173 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.173 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:33.173 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572375+0000", 2024-09-17T02:20:33.173 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078564780000000001 2024-09-17T02:20:33.173 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.173 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.173 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.173 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587862+0000", 2024-09-17T02:20:33.173 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015486837999999999 2024-09-17T02:20:33.174 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.174 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.174 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:33.174 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587954+0000", 2024-09-17T02:20:33.174 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1766000000000002e-05 2024-09-17T02:20:33.174 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.174 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.174 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:33.174 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588005+0000", 2024-09-17T02:20:33.174 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1646e-05 2024-09-17T02:20:33.174 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.174 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:33.174 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.175 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.175 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.175 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:33.175 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:20:33.175 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 16.532774450000002, 2024-09-17T02:20:33.175 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029554871999999999, 2024-09-17T02:20:33.175 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:33.175 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:33.175 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.175 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:33.175 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.175 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:33.175 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:20:33.176 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.176 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.176 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.176 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:33.176 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:20:33.176 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.176 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.176 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.176 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:33.176 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557145+0000", 2024-09-17T02:20:33.176 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.263e-06 2024-09-17T02:20:33.176 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.176 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.177 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:33.177 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557151+0000", 2024-09-17T02:20:33.177 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1040000000000003e-06 2024-09-17T02:20:33.177 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.177 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.177 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:33.177 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557168+0000", 2024-09-17T02:20:33.177 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7289999999999999e-05 2024-09-17T02:20:33.177 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.177 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.177 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.177 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557182+0000", 2024-09-17T02:20:33.177 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.325e-05 2024-09-17T02:20:33.177 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.178 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.178 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:33.178 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564102+0000", 2024-09-17T02:20:33.178 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069199860000000004 2024-09-17T02:20:33.178 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.178 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.178 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:33.178 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564438+0000", 2024-09-17T02:20:33.178 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033651800000000001 2024-09-17T02:20:33.178 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.178 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.178 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:33.178 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.565422+0000", 2024-09-17T02:20:33.178 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00098332499999999995 2024-09-17T02:20:33.178 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.179 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.179 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:33.179 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572361+0000", 2024-09-17T02:20:33.179 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069392630000000002 2024-09-17T02:20:33.179 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.179 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.179 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.179 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586567+0000", 2024-09-17T02:20:33.179 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014206107000000001 2024-09-17T02:20:33.179 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.179 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.179 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:33.179 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586643+0000", 2024-09-17T02:20:33.179 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5673000000000005e-05 2024-09-17T02:20:33.180 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.180 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.180 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:33.180 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586699+0000", 2024-09-17T02:20:33.180 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6093e-05 2024-09-17T02:20:33.180 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.180 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:33.180 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.180 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.180 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.180 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:33.180 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557197+0000", 2024-09-17T02:20:33.180 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 16.532720770000001, 2024-09-17T02:20:33.181 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.027462931999999999, 2024-09-17T02:20:33.181 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:33.181 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:33.181 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.181 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:33.181 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.181 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:33.181 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557197+0000", 2024-09-17T02:20:33.181 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.181 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.181 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.181 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:33.181 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557197+0000", 2024-09-17T02:20:33.182 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.182 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.182 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.182 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:33.182 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557198+0000", 2024-09-17T02:20:33.182 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.8599999999999997e-07 2024-09-17T02:20:33.182 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.182 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.182 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:33.182 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557204+0000", 2024-09-17T02:20:33.182 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8200000000000002e-06 2024-09-17T02:20:33.182 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.182 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.183 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:33.183 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557223+0000", 2024-09-17T02:20:33.183 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8536999999999999e-05 2024-09-17T02:20:33.183 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.183 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.183 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.183 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557239+0000", 2024-09-17T02:20:33.183 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6725999999999999e-05 2024-09-17T02:20:33.183 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.183 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.183 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:33.183 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557373+0000", 2024-09-17T02:20:33.183 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000133199 2024-09-17T02:20:33.183 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.183 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.184 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:33.184 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557655+0000", 2024-09-17T02:20:33.184 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00028230799999999999 2024-09-17T02:20:33.184 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.184 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.184 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:33.184 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557941+0000", 2024-09-17T02:20:33.184 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00028569100000000003 2024-09-17T02:20:33.184 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.184 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.184 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:33.184 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562956+0000", 2024-09-17T02:20:33.184 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050156109999999997 2024-09-17T02:20:33.184 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.185 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.185 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.185 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.584452+0000", 2024-09-17T02:20:33.185 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.021496107 2024-09-17T02:20:33.185 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.185 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.185 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:33.185 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.584561+0000", 2024-09-17T02:20:33.185 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000108934 2024-09-17T02:20:33.185 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.186 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.186 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:33.186 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.584660+0000", 2024-09-17T02:20:33.186 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.9112999999999998e-05 2024-09-17T02:20:33.186 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.186 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:33.186 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.186 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.186 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.186 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:33.187 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:20:33.187 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 16.532640757999999, 2024-09-17T02:20:33.187 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029800569999999998, 2024-09-17T02:20:33.187 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:33.187 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:33.187 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.187 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:33.187 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.187 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:33.188 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:20:33.188 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.188 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.188 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.188 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:33.188 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:20:33.188 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.188 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.189 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.189 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:33.189 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557279+0000", 2024-09-17T02:20:33.189 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.497e-06 2024-09-17T02:20:33.189 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.189 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.189 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:33.189 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557287+0000", 2024-09-17T02:20:33.189 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9030000000000004e-06 2024-09-17T02:20:33.190 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.190 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.190 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:33.190 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557306+0000", 2024-09-17T02:20:33.190 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9394000000000001e-05 2024-09-17T02:20:33.190 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.190 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.190 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.190 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557323+0000", 2024-09-17T02:20:33.191 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6299000000000001e-05 2024-09-17T02:20:33.191 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.191 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.191 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:33.191 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.570931+0000", 2024-09-17T02:20:33.191 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013608841999999999 2024-09-17T02:20:33.191 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.191 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.191 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:33.191 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571250+0000", 2024-09-17T02:20:33.192 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031817400000000001 2024-09-17T02:20:33.192 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.192 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.192 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:33.192 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571559+0000", 2024-09-17T02:20:33.192 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000309835 2024-09-17T02:20:33.192 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.192 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.192 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:33.193 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.574161+0000", 2024-09-17T02:20:33.193 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002601543 2024-09-17T02:20:33.193 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.193 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.193 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.193 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586866+0000", 2024-09-17T02:20:33.193 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012704968000000001 2024-09-17T02:20:33.193 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.193 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.193 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:33.193 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586987+0000", 2024-09-17T02:20:33.193 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000121369 2024-09-17T02:20:33.193 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.193 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.193 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:33.194 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587078+0000", 2024-09-17T02:20:33.194 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0746000000000002e-05 2024-09-17T02:20:33.194 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.194 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:33.194 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.194 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.194 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.194 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:33.194 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:20:33.194 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 16.532575115, 2024-09-17T02:20:33.194 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029936054, 2024-09-17T02:20:33.194 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:33.194 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:33.195 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.195 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:33.195 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.195 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:33.195 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:20:33.195 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.195 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.195 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.195 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:33.195 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:20:33.195 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.195 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.195 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.195 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:33.196 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557344+0000", 2024-09-17T02:20:33.196 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.347e-06 2024-09-17T02:20:33.196 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.196 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.196 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:33.196 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557351+0000", 2024-09-17T02:20:33.196 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5560000000000004e-06 2024-09-17T02:20:33.196 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.196 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.196 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:33.196 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557369+0000", 2024-09-17T02:20:33.196 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7703e-05 2024-09-17T02:20:33.196 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.196 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.197 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.197 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557382+0000", 2024-09-17T02:20:33.197 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3664e-05 2024-09-17T02:20:33.197 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.197 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.197 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:33.197 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558997+0000", 2024-09-17T02:20:33.197 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0016147970000000001 2024-09-17T02:20:33.197 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.197 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.197 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:33.197 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559236+0000", 2024-09-17T02:20:33.197 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00023900200000000001 2024-09-17T02:20:33.197 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.198 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.198 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:33.198 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559547+0000", 2024-09-17T02:20:33.198 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031132399999999998 2024-09-17T02:20:33.198 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.198 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.198 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:33.198 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563130+0000", 2024-09-17T02:20:33.198 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003582989 2024-09-17T02:20:33.198 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.198 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.198 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.198 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587069+0000", 2024-09-17T02:20:33.198 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023938496 2024-09-17T02:20:33.199 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.199 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.199 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:33.199 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587192+0000", 2024-09-17T02:20:33.199 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123514 2024-09-17T02:20:33.199 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.199 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.199 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:33.199 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587279+0000", 2024-09-17T02:20:33.199 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6662000000000005e-05 2024-09-17T02:20:33.199 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.199 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:33.199 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.199 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.200 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.200 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:33.200 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:20:33.200 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 16.532517229, 2024-09-17T02:20:33.200 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030490703000000001, 2024-09-17T02:20:33.200 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:33.200 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:33.200 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.200 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:33.200 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.200 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:33.200 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:20:33.200 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.200 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.201 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.201 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:33.201 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:20:33.201 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.201 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.201 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.201 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:33.201 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557403+0000", 2024-09-17T02:20:33.201 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.77e-06 2024-09-17T02:20:33.201 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.201 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.201 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:33.201 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557412+0000", 2024-09-17T02:20:33.201 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4099999999999997e-06 2024-09-17T02:20:33.202 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.202 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.202 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:33.202 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557431+0000", 2024-09-17T02:20:33.202 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9177e-05 2024-09-17T02:20:33.202 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.202 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.202 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.202 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557444+0000", 2024-09-17T02:20:33.202 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2999999999999999e-05 2024-09-17T02:20:33.202 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.202 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.202 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:33.203 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557722+0000", 2024-09-17T02:20:33.203 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00027760699999999997 2024-09-17T02:20:33.203 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.203 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.203 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:33.203 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557991+0000", 2024-09-17T02:20:33.203 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00026892499999999999 2024-09-17T02:20:33.203 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.203 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.203 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:33.203 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558265+0000", 2024-09-17T02:20:33.203 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000274524 2024-09-17T02:20:33.203 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.203 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.204 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:33.204 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564270+0000", 2024-09-17T02:20:33.204 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060045339999999997 2024-09-17T02:20:33.204 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.204 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.204 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.204 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587701+0000", 2024-09-17T02:20:33.204 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023431285999999999 2024-09-17T02:20:33.204 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.204 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.204 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:33.204 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587803+0000", 2024-09-17T02:20:33.204 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000101371 2024-09-17T02:20:33.205 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.205 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.205 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:33.205 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587892+0000", 2024-09-17T02:20:33.205 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9098999999999995e-05 2024-09-17T02:20:33.205 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.205 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:33.205 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.205 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.205 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.205 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:33.205 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:20:33.205 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 16.532435632999999, 2024-09-17T02:20:33.206 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029886725999999999, 2024-09-17T02:20:33.206 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:33.206 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:33.206 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:20:33.206 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:33.206 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.206 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:33.206 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:20:33.206 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.206 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.206 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.206 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:33.206 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:20:33.206 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:33.207 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.207 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.207 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:33.207 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557484+0000", 2024-09-17T02:20:33.207 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.26e-06 2024-09-17T02:20:33.207 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.207 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.207 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:33.207 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557489+0000", 2024-09-17T02:20:33.207 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2530000000000004e-06 2024-09-17T02:20:33.207 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.207 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.207 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:33.207 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557507+0000", 2024-09-17T02:20:33.207 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7473999999999999e-05 2024-09-17T02:20:33.208 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.208 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.208 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.208 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557524+0000", 2024-09-17T02:20:33.208 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7912999999999999e-05 2024-09-17T02:20:33.208 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.208 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.208 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:33.208 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572428+0000", 2024-09-17T02:20:33.208 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014903451999999999 2024-09-17T02:20:33.208 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.208 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.208 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:33.208 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572589+0000", 2024-09-17T02:20:33.209 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000161299 2024-09-17T02:20:33.209 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:33.209 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:33.209 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:33.209 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587369+0000", 2024-09-17T02:20:33.209 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014780075 2024-09-17T02:20:33.209 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.209 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:33.209 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.209 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:33.209 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:33.209 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:20:33.211 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:20:33.212 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:33.216+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:33.312 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:33.316+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:33.389 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:20:33.389 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:20:33.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.390 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:2118 5.0 5:01ccaeb9:::benchmark_data_smithi001_23533_object2117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:33.390 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:33.395874+0000", 2024-09-17T02:20:33.390 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00042437600000000002, 2024-09-17T02:20:33.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045388900000000002, 2024-09-17T02:20:33.390 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:33.390 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:33.390 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:33.390 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:33.390 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:33.390 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:33.390 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2118 2024-09-17T02:20:33.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.391 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:33.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:33.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.395874+0000", 2024-09-17T02:20:33.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:33.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.395874+0000", 2024-09-17T02:20:33.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:33.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.395876+0000", 2024-09-17T02:20:33.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.181e-06 2024-09-17T02:20:33.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:33.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.395921+0000", 2024-09-17T02:20:33.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5531000000000002e-05 2024-09-17T02:20:33.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:33.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.395930+0000", 2024-09-17T02:20:33.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8910000000000001e-06 2024-09-17T02:20:33.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.395976+0000", 2024-09-17T02:20:33.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5943999999999999e-05 2024-09-17T02:20:33.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:33.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396049+0000", 2024-09-17T02:20:33.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3245999999999996e-05 2024-09-17T02:20:33.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:33.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396230+0000", 2024-09-17T02:20:33.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000180452 2024-09-17T02:20:33.394 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.394 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:33.394 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.394 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:2120 5.0 5.1864f660 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:33.394 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:33.396030+0000", 2024-09-17T02:20:33.394 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00026892399999999998, 2024-09-17T02:20:33.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038260099999999999, 2024-09-17T02:20:33.394 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:33.394 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:33.395 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:20:33.395 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:33.395 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:33.395 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:33.395 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2120 2024-09-17T02:20:33.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.395 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:33.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:33.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396030+0000", 2024-09-17T02:20:33.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:33.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396030+0000", 2024-09-17T02:20:33.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:33.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396031+0000", 2024-09-17T02:20:33.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2699999999999998e-07 2024-09-17T02:20:33.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:33.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396118+0000", 2024-09-17T02:20:33.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7009999999999995e-05 2024-09-17T02:20:33.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:33.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396128+0000", 2024-09-17T02:20:33.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.825e-06 2024-09-17T02:20:33.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396135+0000", 2024-09-17T02:20:33.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2899999999999997e-06 2024-09-17T02:20:33.397 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.397 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:33.397 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.398 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:2117 5.f e24/22 5:f5184a69:::benchmark_data_smithi001_23533_object2116:head v 24'131, mlcod=24'128)", 2024-09-17T02:20:33.398 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:33.395994+0000", 2024-09-17T02:20:33.398 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.000305156, 2024-09-17T02:20:33.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048233199999999998, 2024-09-17T02:20:33.398 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:33.398 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:33.398 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:33.398 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:33.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:33.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.395994+0000", 2024-09-17T02:20:33.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:33.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.395994+0000", 2024-09-17T02:20:33.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:33.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.395994+0000", 2024-09-17T02:20:33.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8899999999999999e-07 2024-09-17T02:20:33.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:33.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396141+0000", 2024-09-17T02:20:33.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000147245 2024-09-17T02:20:33.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:33.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396152+0000", 2024-09-17T02:20:33.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0896e-05 2024-09-17T02:20:33.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396159+0000", 2024-09-17T02:20:33.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4489999999999996e-06 2024-09-17T02:20:33.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:33.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396196+0000", 2024-09-17T02:20:33.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7339999999999998e-05 2024-09-17T02:20:33.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:33.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396212+0000", 2024-09-17T02:20:33.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6206999999999999e-05 2024-09-17T02:20:33.401 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.401 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:33.402 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.402 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:2121 5.e 5:7279e88b:::benchmark_data_smithi001_23533_object2120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:33.402 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:33.396151+0000", 2024-09-17T02:20:33.402 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0001482, 2024-09-17T02:20:33.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040108899999999998, 2024-09-17T02:20:33.402 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:33.402 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:33.402 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:33.402 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:33.402 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:33.402 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:33.403 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2121 2024-09-17T02:20:33.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.403 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:33.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:33.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396151+0000", 2024-09-17T02:20:33.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:33.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396151+0000", 2024-09-17T02:20:33.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:33.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396151+0000", 2024-09-17T02:20:33.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2399999999999997e-07 2024-09-17T02:20:33.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:33.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396190+0000", 2024-09-17T02:20:33.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8260000000000003e-05 2024-09-17T02:20:33.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:33.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396199+0000", 2024-09-17T02:20:33.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3389999999999999e-06 2024-09-17T02:20:33.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396205+0000", 2024-09-17T02:20:33.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4960000000000001e-06 2024-09-17T02:20:33.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:33.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396255+0000", 2024-09-17T02:20:33.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9968e-05 2024-09-17T02:20:33.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:33.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396337+0000", 2024-09-17T02:20:33.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1969000000000001e-05 2024-09-17T02:20:33.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:33.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396432+0000", 2024-09-17T02:20:33.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4877999999999995e-05 2024-09-17T02:20:33.406 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.406 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:33.407 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.407 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:2106 5.8 e24/22)", 2024-09-17T02:20:33.407 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:33.396251+0000", 2024-09-17T02:20:33.407 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.7655999999999999e-05, 2024-09-17T02:20:33.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036119899999999998, 2024-09-17T02:20:33.407 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:33.407 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:33.407 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:20:33.407 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:33.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:33.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396251+0000", 2024-09-17T02:20:33.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:33.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396251+0000", 2024-09-17T02:20:33.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:33.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396252+0000", 2024-09-17T02:20:33.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9500000000000002e-07 2024-09-17T02:20:33.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:33.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396255+0000", 2024-09-17T02:20:33.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3569999999999998e-06 2024-09-17T02:20:33.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:33.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396264+0000", 2024-09-17T02:20:33.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1630000000000002e-06 2024-09-17T02:20:33.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.396270+0000", 2024-09-17T02:20:33.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1530000000000002e-06 2024-09-17T02:20:33.410 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.410 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:33.410 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.410 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:2106 5.8 5:1d132f37:::benchmark_data_smithi001_23533_object2105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:33.411 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:33.393592+0000", 2024-09-17T02:20:33.411 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0027067530000000001, 2024-09-17T02:20:33.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003051673, 2024-09-17T02:20:33.411 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:33.411 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:33.411 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:33.411 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:33.411 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:33.411 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:33.411 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2106 2024-09-17T02:20:33.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.412 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:33.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:33.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.393592+0000", 2024-09-17T02:20:33.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:33.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.393592+0000", 2024-09-17T02:20:33.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:33.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.393593+0000", 2024-09-17T02:20:33.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8700000000000004e-07 2024-09-17T02:20:33.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:33.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.393764+0000", 2024-09-17T02:20:33.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017120699999999999 2024-09-17T02:20:33.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:33.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.393773+0000", 2024-09-17T02:20:33.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0729999999999994e-06 2024-09-17T02:20:33.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.393780+0000", 2024-09-17T02:20:33.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8700000000000003e-06 2024-09-17T02:20:33.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:33.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.394286+0000", 2024-09-17T02:20:33.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050576400000000002 2024-09-17T02:20:33.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:33.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.394434+0000", 2024-09-17T02:20:33.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014801699999999999 2024-09-17T02:20:33.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:33.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.394588+0000", 2024-09-17T02:20:33.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000153688 2024-09-17T02:20:33.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:33.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.395534+0000", 2024-09-17T02:20:33.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00094674400000000001 2024-09-17T02:20:33.416 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.416 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:33.416 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.416 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.416 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:20:33.416 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 6 2024-09-17T02:20:33.416 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:20:33.418 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:20:33.418 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:33.424+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:33.518 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:33.522+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:33.615 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:20:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:20:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:20:33.616 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:20:33.616 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:20:33.619 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:33.624+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:33.639 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:20:33.673 INFO:teuthology.orchestra.run.smithi001.stderr:nodeep-scrub is set 2024-09-17T02:20:33.720 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:33.724+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:33.738 DEBUG:tasks.admin_socket:Testing objecter_requests with config {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}', 'branch': 'squid'} 2024-09-17T02:20:33.739 DEBUG:teuthology.orchestra.run.smithi001:> wget -q -O /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests -- 'http://git.ceph.com/?p=ceph.git;a=blob_plain;f=src/test/admin_socket/objecter_requests;hb=squid' && chmod u=rx -- /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-09-17T02:20:33.766 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 1 16 3521 3505 219.047 219.062 0.00298042 0.00455594 2024-09-17T02:20:33.802 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:20:33.802 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:20:33.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:20:33.802 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:20:33.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.802 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:33.802 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:20:33.803 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.250202285, 2024-09-17T02:20:33.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035535028000000003, 2024-09-17T02:20:33.803 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:33.803 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:33.803 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.803 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:33.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:33.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:20:33.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:33.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:20:33.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:33.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556550+0000", 2024-09-17T02:20:33.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3500000000000001e-06 2024-09-17T02:20:33.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:33.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556566+0000", 2024-09-17T02:20:33.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5440000000000001e-05 2024-09-17T02:20:33.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:33.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556594+0000", 2024-09-17T02:20:33.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8552999999999999e-05 2024-09-17T02:20:33.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556618+0000", 2024-09-17T02:20:33.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3207e-05 2024-09-17T02:20:33.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:33.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578337+0000", 2024-09-17T02:20:33.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021719517000000001 2024-09-17T02:20:33.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:33.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578655+0000", 2024-09-17T02:20:33.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031837800000000002 2024-09-17T02:20:33.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:33.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.581374+0000", 2024-09-17T02:20:33.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002718238 2024-09-17T02:20:33.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:33.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587083+0000", 2024-09-17T02:20:33.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005708912 2024-09-17T02:20:33.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591823+0000", 2024-09-17T02:20:33.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047406080000000003 2024-09-17T02:20:33.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:33.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591972+0000", 2024-09-17T02:20:33.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014874199999999999 2024-09-17T02:20:33.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:33.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592082+0000", 2024-09-17T02:20:33.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110083 2024-09-17T02:20:33.809 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.809 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:33.809 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.809 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:33.809 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:20:33.810 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.249260798000002, 2024-09-17T02:20:33.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035128756999999997, 2024-09-17T02:20:33.810 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:33.810 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:33.810 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.810 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:33.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:33.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:20:33.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:33.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:20:33.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:33.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557491+0000", 2024-09-17T02:20:33.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.88e-06 2024-09-17T02:20:33.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:33.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557504+0000", 2024-09-17T02:20:33.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2864000000000001e-05 2024-09-17T02:20:33.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:33.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557535+0000", 2024-09-17T02:20:33.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0916e-05 2024-09-17T02:20:33.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557561+0000", 2024-09-17T02:20:33.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5602999999999999e-05 2024-09-17T02:20:33.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:33.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582290+0000", 2024-09-17T02:20:33.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024729729999999998 2024-09-17T02:20:33.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:33.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582642+0000", 2024-09-17T02:20:33.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035143499999999999 2024-09-17T02:20:33.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:33.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582959+0000", 2024-09-17T02:20:33.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031747399999999999 2024-09-17T02:20:33.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:33.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587302+0000", 2024-09-17T02:20:33.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043425169999999997 2024-09-17T02:20:33.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592391+0000", 2024-09-17T02:20:33.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050895799999999998 2024-09-17T02:20:33.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:33.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592516+0000", 2024-09-17T02:20:33.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012420500000000001 2024-09-17T02:20:33.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:33.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592617+0000", 2024-09-17T02:20:33.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010155299999999999 2024-09-17T02:20:33.816 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.816 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:33.816 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.816 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:33.816 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:20:33.816 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.249156298999999, 2024-09-17T02:20:33.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034796066, 2024-09-17T02:20:33.817 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:33.817 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:33.817 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.817 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:33.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:33.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:20:33.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:33.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:20:33.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:33.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557594+0000", 2024-09-17T02:20:33.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3769999999999999e-06 2024-09-17T02:20:33.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:33.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557683+0000", 2024-09-17T02:20:33.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8896999999999999e-05 2024-09-17T02:20:33.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:33.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557707+0000", 2024-09-17T02:20:33.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3839e-05 2024-09-17T02:20:33.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557730+0000", 2024-09-17T02:20:33.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3047000000000001e-05 2024-09-17T02:20:33.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:33.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582329+0000", 2024-09-17T02:20:33.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024599283999999999 2024-09-17T02:20:33.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:33.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582624+0000", 2024-09-17T02:20:33.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000294462 2024-09-17T02:20:33.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:33.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582936+0000", 2024-09-17T02:20:33.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031223399999999999 2024-09-17T02:20:33.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:33.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587347+0000", 2024-09-17T02:20:33.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044110340000000003 2024-09-17T02:20:33.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592165+0000", 2024-09-17T02:20:33.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048176699999999996 2024-09-17T02:20:33.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:33.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592311+0000", 2024-09-17T02:20:33.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014661899999999999 2024-09-17T02:20:33.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:33.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592389+0000", 2024-09-17T02:20:33.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7602999999999995e-05 2024-09-17T02:20:33.822 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.822 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:33.822 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.822 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:33.822 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:20:33.822 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.248638671999998, 2024-09-17T02:20:33.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034457472000000003, 2024-09-17T02:20:33.822 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:33.823 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:33.823 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.823 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:33.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:33.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:20:33.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:33.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:20:33.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:33.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558113+0000", 2024-09-17T02:20:33.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1639999999999999e-06 2024-09-17T02:20:33.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:33.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558125+0000", 2024-09-17T02:20:33.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2269999999999999e-05 2024-09-17T02:20:33.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:33.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558458+0000", 2024-09-17T02:20:33.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033322700000000001 2024-09-17T02:20:33.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558488+0000", 2024-09-17T02:20:33.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.951e-05 2024-09-17T02:20:33.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:33.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584514+0000", 2024-09-17T02:20:33.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026025721000000002 2024-09-17T02:20:33.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:33.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584781+0000", 2024-09-17T02:20:33.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000267142 2024-09-17T02:20:33.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:33.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585078+0000", 2024-09-17T02:20:33.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029738799999999999 2024-09-17T02:20:33.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:33.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588045+0000", 2024-09-17T02:20:33.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029673759999999999 2024-09-17T02:20:33.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592454+0000", 2024-09-17T02:20:33.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044090209999999999 2024-09-17T02:20:33.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:33.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592520+0000", 2024-09-17T02:20:33.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6032999999999996e-05 2024-09-17T02:20:33.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:33.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592568+0000", 2024-09-17T02:20:33.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7620000000000001e-05 2024-09-17T02:20:33.828 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.828 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:33.828 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.828 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:33.829 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:20:33.829 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.248178420999999, 2024-09-17T02:20:33.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031603266999999997, 2024-09-17T02:20:33.829 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:33.829 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:33.829 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.829 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:33.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:33.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:20:33.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:33.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:20:33.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:33.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558573+0000", 2024-09-17T02:20:33.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0660000000000002e-06 2024-09-17T02:20:33.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:33.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558585+0000", 2024-09-17T02:20:33.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1596999999999999e-05 2024-09-17T02:20:33.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:33.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558612+0000", 2024-09-17T02:20:33.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7115999999999999e-05 2024-09-17T02:20:33.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558631+0000", 2024-09-17T02:20:33.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9519999999999999e-05 2024-09-17T02:20:33.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:33.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558783+0000", 2024-09-17T02:20:33.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152025 2024-09-17T02:20:33.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-17T02:20:33.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558798+0000", 2024-09-17T02:20:33.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4966999999999999e-05 2024-09-17T02:20:33.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:33.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.572871+0000", 2024-09-17T02:20:33.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014072782000000001 2024-09-17T02:20:33.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:33.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573153+0000", 2024-09-17T02:20:33.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028214499999999998 2024-09-17T02:20:33.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:33.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573432+0000", 2024-09-17T02:20:33.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027932100000000002 2024-09-17T02:20:33.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:33.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582279+0000", 2024-09-17T02:20:33.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0088463310000000007 2024-09-17T02:20:33.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.589902+0000", 2024-09-17T02:20:33.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0076236050000000003 2024-09-17T02:20:33.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:33.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.589997+0000", 2024-09-17T02:20:33.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4456000000000005e-05 2024-09-17T02:20:33.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:33.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590174+0000", 2024-09-17T02:20:33.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000177336 2024-09-17T02:20:33.835 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.835 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:33.835 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.835 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:33.836 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:20:33.836 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.248075176, 2024-09-17T02:20:33.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031899064999999997, 2024-09-17T02:20:33.836 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:33.836 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:33.836 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.836 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:33.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:33.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:20:33.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:33.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:20:33.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:33.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558676+0000", 2024-09-17T02:20:33.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.39e-06 2024-09-17T02:20:33.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:33.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558686+0000", 2024-09-17T02:20:33.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.022e-05 2024-09-17T02:20:33.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:33.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558708+0000", 2024-09-17T02:20:33.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2249999999999999e-05 2024-09-17T02:20:33.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558725+0000", 2024-09-17T02:20:33.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7387000000000001e-05 2024-09-17T02:20:33.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:33.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558940+0000", 2024-09-17T02:20:33.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021453800000000001 2024-09-17T02:20:33.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting_for_map not empty", 2024-09-17T02:20:33.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558951+0000", 2024-09-17T02:20:33.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1303e-05 2024-09-17T02:20:33.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:33.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576237+0000", 2024-09-17T02:20:33.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017285723999999999 2024-09-17T02:20:33.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:33.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576454+0000", 2024-09-17T02:20:33.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021673800000000001 2024-09-17T02:20:33.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:33.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576932+0000", 2024-09-17T02:20:33.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047792700000000001 2024-09-17T02:20:33.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:33.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585689+0000", 2024-09-17T02:20:33.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0087572880000000002 2024-09-17T02:20:33.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590287+0000", 2024-09-17T02:20:33.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045978060000000003 2024-09-17T02:20:33.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:33.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590447+0000", 2024-09-17T02:20:33.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000160719 2024-09-17T02:20:33.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:33.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590573+0000", 2024-09-17T02:20:33.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012577500000000001 2024-09-17T02:20:33.842 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.842 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:33.842 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.843 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:33.843 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:20:33.843 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.247997206000001, 2024-09-17T02:20:33.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034114029999999997, 2024-09-17T02:20:33.843 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:33.843 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:33.843 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.843 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:33.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:33.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:20:33.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:33.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:20:33.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:33.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558753+0000", 2024-09-17T02:20:33.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2699999999999999e-06 2024-09-17T02:20:33.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:33.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558769+0000", 2024-09-17T02:20:33.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5906e-05 2024-09-17T02:20:33.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:33.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558791+0000", 2024-09-17T02:20:33.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1342999999999999e-05 2024-09-17T02:20:33.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558806+0000", 2024-09-17T02:20:33.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5829999999999999e-05 2024-09-17T02:20:33.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:33.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584906+0000", 2024-09-17T02:20:33.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026099273999999999 2024-09-17T02:20:33.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:33.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585158+0000", 2024-09-17T02:20:33.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025194600000000002 2024-09-17T02:20:33.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:33.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585368+0000", 2024-09-17T02:20:33.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210068 2024-09-17T02:20:33.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:33.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588098+0000", 2024-09-17T02:20:33.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002730522 2024-09-17T02:20:33.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592680+0000", 2024-09-17T02:20:33.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045816019999999997 2024-09-17T02:20:33.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:33.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592774+0000", 2024-09-17T02:20:33.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3726000000000004e-05 2024-09-17T02:20:33.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:33.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592866+0000", 2024-09-17T02:20:33.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2542999999999998e-05 2024-09-17T02:20:33.849 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.849 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:33.849 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.849 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:33.849 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:20:33.849 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.247920903000001, 2024-09-17T02:20:33.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031407875000000002, 2024-09-17T02:20:33.849 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:33.850 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:33.850 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:33.850 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:33.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:33.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:20:33.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:33.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:20:33.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:33.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558830+0000", 2024-09-17T02:20:33.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3599999999999999e-06 2024-09-17T02:20:33.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:33.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558835+0000", 2024-09-17T02:20:33.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6130000000000003e-06 2024-09-17T02:20:33.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:33.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558853+0000", 2024-09-17T02:20:33.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8099999999999999e-05 2024-09-17T02:20:33.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558869+0000", 2024-09-17T02:20:33.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.59e-05 2024-09-17T02:20:33.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:33.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560437+0000", 2024-09-17T02:20:33.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015677989999999999 2024-09-17T02:20:33.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-17T02:20:33.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560453+0000", 2024-09-17T02:20:33.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.535e-05 2024-09-17T02:20:33.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:33.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562422+0000", 2024-09-17T02:20:33.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00196934 2024-09-17T02:20:33.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:33.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562773+0000", 2024-09-17T02:20:33.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035152399999999998 2024-09-17T02:20:33.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:33.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590236+0000", 2024-09-17T02:20:33.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.027462889000000001 2024-09-17T02:20:33.857 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.857 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:33.857 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.857 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:6 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'1, mlcod=0'0)", 2024-09-17T02:20:33.858 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.559725+0000", 2024-09-17T02:20:33.858 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.247023905999999, 2024-09-17T02:20:33.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015153534999999999, 2024-09-17T02:20:33.858 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:33.858 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:33.858 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.858 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:33.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:33.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559725+0000", 2024-09-17T02:20:33.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:33.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559725+0000", 2024-09-17T02:20:33.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:33.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559726+0000", 2024-09-17T02:20:33.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1699999999999997e-07 2024-09-17T02:20:33.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:33.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559736+0000", 2024-09-17T02:20:33.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8360000000000004e-06 2024-09-17T02:20:33.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:33.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559760+0000", 2024-09-17T02:20:33.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4130000000000001e-05 2024-09-17T02:20:33.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559778+0000", 2024-09-17T02:20:33.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7623000000000001e-05 2024-09-17T02:20:33.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:33.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.561459+0000", 2024-09-17T02:20:33.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001681552 2024-09-17T02:20:33.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:33.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.561506+0000", 2024-09-17T02:20:33.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6260000000000001e-05 2024-09-17T02:20:33.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:33.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.574779+0000", 2024-09-17T02:20:33.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013273691000000001 2024-09-17T02:20:33.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:33.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.574879+0000", 2024-09-17T02:20:33.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9625999999999998e-05 2024-09-17T02:20:33.862 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.862 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:33.862 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.862 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:33.862 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.560079+0000", 2024-09-17T02:20:33.862 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.246670408, 2024-09-17T02:20:33.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016073831, 2024-09-17T02:20:33.863 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:33.863 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:33.863 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:33.863 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:33.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:33.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560079+0000", 2024-09-17T02:20:33.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:33.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560079+0000", 2024-09-17T02:20:33.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:33.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560081+0000", 2024-09-17T02:20:33.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.266e-06 2024-09-17T02:20:33.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:33.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560090+0000", 2024-09-17T02:20:33.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2129999999999997e-06 2024-09-17T02:20:33.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:33.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560119+0000", 2024-09-17T02:20:33.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8932999999999999e-05 2024-09-17T02:20:33.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560145+0000", 2024-09-17T02:20:33.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6020000000000002e-05 2024-09-17T02:20:33.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:33.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.561833+0000", 2024-09-17T02:20:33.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016875659999999999 2024-09-17T02:20:33.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:33.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562199+0000", 2024-09-17T02:20:33.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036619000000000002 2024-09-17T02:20:33.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:33.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576153+0000", 2024-09-17T02:20:33.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013953643 2024-09-17T02:20:33.866 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.866 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:33.866 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.867 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:18 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'1, mlcod=0'0)", 2024-09-17T02:20:33.867 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.567765+0000", 2024-09-17T02:20:33.867 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.238984342999998, 2024-09-17T02:20:33.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014868306, 2024-09-17T02:20:33.867 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:33.867 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:33.867 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.867 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:33.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:33.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.567765+0000", 2024-09-17T02:20:33.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:33.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.567765+0000", 2024-09-17T02:20:33.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:33.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.567766+0000", 2024-09-17T02:20:33.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.13e-06 2024-09-17T02:20:33.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:33.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.567811+0000", 2024-09-17T02:20:33.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5361999999999997e-05 2024-09-17T02:20:33.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:33.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.567867+0000", 2024-09-17T02:20:33.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5083000000000001e-05 2024-09-17T02:20:33.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.567885+0000", 2024-09-17T02:20:33.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8827000000000001e-05 2024-09-17T02:20:33.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:33.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570145+0000", 2024-09-17T02:20:33.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002259708 2024-09-17T02:20:33.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:33.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570187+0000", 2024-09-17T02:20:33.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2410000000000002e-05 2024-09-17T02:20:33.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:33.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582543+0000", 2024-09-17T02:20:33.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012356015999999999 2024-09-17T02:20:33.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:33.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582633+0000", 2024-09-17T02:20:33.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9770000000000003e-05 2024-09-17T02:20:33.871 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.871 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:33.871 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.871 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing(3.1e epoch 19/17 rep_tid 1 entries 19'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T02:20:33.871 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.568434+0000", 2024-09-17T02:20:33.871 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.238314894999998, 2024-09-17T02:20:33.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013193651000000001, 2024-09-17T02:20:33.872 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:33.872 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:33.872 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-17T02:20:33.872 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:33.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:33.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568434+0000", 2024-09-17T02:20:33.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:33.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568434+0000", 2024-09-17T02:20:33.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:33.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568436+0000", 2024-09-17T02:20:33.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.857e-06 2024-09-17T02:20:33.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:33.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568455+0000", 2024-09-17T02:20:33.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9076000000000002e-05 2024-09-17T02:20:33.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:33.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568501+0000", 2024-09-17T02:20:33.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5309999999999998e-05 2024-09-17T02:20:33.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568545+0000", 2024-09-17T02:20:33.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4773e-05 2024-09-17T02:20:33.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:33.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570794+0000", 2024-09-17T02:20:33.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022483450000000001 2024-09-17T02:20:33.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:33.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.581628+0000", 2024-09-17T02:20:33.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01083429 2024-09-17T02:20:33.875 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.875 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:33.875 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.875 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:24 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'1, mlcod=0'0)", 2024-09-17T02:20:33.876 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.568621+0000", 2024-09-17T02:20:33.876 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.238128306, 2024-09-17T02:20:33.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015593332, 2024-09-17T02:20:33.876 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:33.876 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:33.876 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.876 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:33.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:33.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568621+0000", 2024-09-17T02:20:33.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:33.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568621+0000", 2024-09-17T02:20:33.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:33.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568622+0000", 2024-09-17T02:20:33.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1570000000000001e-06 2024-09-17T02:20:33.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:33.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568633+0000", 2024-09-17T02:20:33.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1093e-05 2024-09-17T02:20:33.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:33.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568654+0000", 2024-09-17T02:20:33.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1132999999999999e-05 2024-09-17T02:20:33.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568670+0000", 2024-09-17T02:20:33.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5307000000000001e-05 2024-09-17T02:20:33.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:33.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570935+0000", 2024-09-17T02:20:33.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022651609999999999 2024-09-17T02:20:33.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:33.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570980+0000", 2024-09-17T02:20:33.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5170000000000003e-05 2024-09-17T02:20:33.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:33.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584128+0000", 2024-09-17T02:20:33.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013148388 2024-09-17T02:20:33.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:33.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584214+0000", 2024-09-17T02:20:33.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5922999999999997e-05 2024-09-17T02:20:33.881 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.881 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:33.881 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.881 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:25 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'2, mlcod=0'0)", 2024-09-17T02:20:33.881 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.568721+0000", 2024-09-17T02:20:33.881 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.23802839, 2024-09-17T02:20:33.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015657030999999998, 2024-09-17T02:20:33.882 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:33.882 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:33.882 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.882 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:33.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:33.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568721+0000", 2024-09-17T02:20:33.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:33.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568721+0000", 2024-09-17T02:20:33.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:33.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568722+0000", 2024-09-17T02:20:33.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5600000000000004e-07 2024-09-17T02:20:33.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:33.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568742+0000", 2024-09-17T02:20:33.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0506999999999999e-05 2024-09-17T02:20:33.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:33.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568762+0000", 2024-09-17T02:20:33.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9423e-05 2024-09-17T02:20:33.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568777+0000", 2024-09-17T02:20:33.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5457000000000001e-05 2024-09-17T02:20:33.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:33.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.571705+0000", 2024-09-17T02:20:33.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029280130000000001 2024-09-17T02:20:33.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:33.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.571787+0000", 2024-09-17T02:20:33.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1509999999999997e-05 2024-09-17T02:20:33.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:33.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584296+0000", 2024-09-17T02:20:33.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012509398999999999 2024-09-17T02:20:33.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:33.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584378+0000", 2024-09-17T02:20:33.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1866000000000005e-05 2024-09-17T02:20:33.887 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.887 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:33.887 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.887 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:7 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'2, mlcod=0'0)", 2024-09-17T02:20:33.887 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.569013+0000", 2024-09-17T02:20:33.888 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.237736469000001, 2024-09-17T02:20:33.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015831576999999999, 2024-09-17T02:20:33.888 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:33.888 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:33.888 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.888 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:33.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:33.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569013+0000", 2024-09-17T02:20:33.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:33.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569013+0000", 2024-09-17T02:20:33.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:33.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569014+0000", 2024-09-17T02:20:33.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6000000000000002e-07 2024-09-17T02:20:33.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:33.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569024+0000", 2024-09-17T02:20:33.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8369999999999992e-06 2024-09-17T02:20:33.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:33.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570016+0000", 2024-09-17T02:20:33.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00099277000000000002 2024-09-17T02:20:33.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570040+0000", 2024-09-17T02:20:33.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3790000000000001e-05 2024-09-17T02:20:33.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:33.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570154+0000", 2024-09-17T02:20:33.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113689 2024-09-17T02:20:33.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:33.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570208+0000", 2024-09-17T02:20:33.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4305999999999998e-05 2024-09-17T02:20:33.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:33.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.583286+0000", 2024-09-17T02:20:33.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013077945000000001 2024-09-17T02:20:33.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:33.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584844+0000", 2024-09-17T02:20:33.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015583800000000001 2024-09-17T02:20:33.892 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.892 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:33.892 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.892 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:2 3.f e19/17 3:f1f69726:::400.00000000:head v 19'1, mlcod=0'0)", 2024-09-17T02:20:33.892 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.570080+0000", 2024-09-17T02:20:33.892 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.236669338999999, 2024-09-17T02:20:33.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014452469000000001, 2024-09-17T02:20:33.892 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:33.893 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:33.893 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.893 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:33.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:33.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570080+0000", 2024-09-17T02:20:33.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:33.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570080+0000", 2024-09-17T02:20:33.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:33.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570081+0000", 2024-09-17T02:20:33.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.333e-06 2024-09-17T02:20:33.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:33.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570142+0000", 2024-09-17T02:20:33.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0919999999999999e-05 2024-09-17T02:20:33.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:33.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570167+0000", 2024-09-17T02:20:33.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4576e-05 2024-09-17T02:20:33.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570180+0000", 2024-09-17T02:20:33.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3444e-05 2024-09-17T02:20:33.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:33.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573011+0000", 2024-09-17T02:20:33.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028309170000000001 2024-09-17T02:20:33.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:33.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573052+0000", 2024-09-17T02:20:33.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1285999999999997e-05 2024-09-17T02:20:33.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:33.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584432+0000", 2024-09-17T02:20:33.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011379837 2024-09-17T02:20:33.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:33.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584532+0000", 2024-09-17T02:20:33.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010015599999999999 2024-09-17T02:20:33.897 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.897 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:33.897 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.897 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:31 3.d e19/17 3:b50e409b:::mds_snaptable:head v 19'1, mlcod=0'0)", 2024-09-17T02:20:33.897 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.571951+0000", 2024-09-17T02:20:33.897 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.234798172000001, 2024-09-17T02:20:33.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014392149999999999, 2024-09-17T02:20:33.897 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:33.897 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:33.898 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.898 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:33.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:33.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.571951+0000", 2024-09-17T02:20:33.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:33.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.571951+0000", 2024-09-17T02:20:33.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:33.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.571952+0000", 2024-09-17T02:20:33.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3239999999999999e-06 2024-09-17T02:20:33.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:33.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.571967+0000", 2024-09-17T02:20:33.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4686e-05 2024-09-17T02:20:33.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:33.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.574038+0000", 2024-09-17T02:20:33.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020704260000000002 2024-09-17T02:20:33.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.574057+0000", 2024-09-17T02:20:33.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9893000000000001e-05 2024-09-17T02:20:33.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:33.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576689+0000", 2024-09-17T02:20:33.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026314429999999998 2024-09-17T02:20:33.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:33.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576767+0000", 2024-09-17T02:20:33.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7708999999999997e-05 2024-09-17T02:20:33.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:33.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.586260+0000", 2024-09-17T02:20:33.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0094934990000000007 2024-09-17T02:20:33.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:33.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.586343+0000", 2024-09-17T02:20:33.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3170000000000005e-05 2024-09-17T02:20:33.902 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.902 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:33.902 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.902 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:1239 5.4 5:27729820:::benchmark_data_smithi001_23533_object1238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:33.902 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:33.168880+0000", 2024-09-17T02:20:33.902 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.63786964099999999, 2024-09-17T02:20:33.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014295324, 2024-09-17T02:20:33.902 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:33.903 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:33.903 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.903 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:33.903 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:33.903 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:33.903 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1239 2024-09-17T02:20:33.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.903 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:33.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:33.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.168880+0000", 2024-09-17T02:20:33.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:33.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.168880+0000", 2024-09-17T02:20:33.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:33.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.168881+0000", 2024-09-17T02:20:33.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1069999999999999e-06 2024-09-17T02:20:33.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:33.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.168965+0000", 2024-09-17T02:20:33.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3968000000000007e-05 2024-09-17T02:20:33.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:33.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.168977+0000", 2024-09-17T02:20:33.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.224e-05 2024-09-17T02:20:33.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.168985+0000", 2024-09-17T02:20:33.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8080000000000005e-06 2024-09-17T02:20:33.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:33.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.169063+0000", 2024-09-17T02:20:33.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7778e-05 2024-09-17T02:20:33.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:33.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.169196+0000", 2024-09-17T02:20:33.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013365799999999999 2024-09-17T02:20:33.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:33.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.169408+0000", 2024-09-17T02:20:33.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021206900000000001 2024-09-17T02:20:33.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:33.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170122+0000", 2024-09-17T02:20:33.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000714199 2024-09-17T02:20:33.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.182998+0000", 2024-09-17T02:20:33.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012875177 2024-09-17T02:20:33.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:33.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.183116+0000", 2024-09-17T02:20:33.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011828900000000001 2024-09-17T02:20:33.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:33.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.183175+0000", 2024-09-17T02:20:33.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9030999999999998e-05 2024-09-17T02:20:33.908 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.909 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:33.909 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.909 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:1247 5.e 5:771d49ed:::benchmark_data_smithi001_23533_object1246:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:33.909 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:33.170545+0000", 2024-09-17T02:20:33.909 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.63620441400000005, 2024-09-17T02:20:33.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014510571999999999, 2024-09-17T02:20:33.909 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:33.909 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:33.909 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.909 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:33.910 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:33.910 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:33.910 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1247 2024-09-17T02:20:33.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.910 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:33.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:33.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170545+0000", 2024-09-17T02:20:33.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:33.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170545+0000", 2024-09-17T02:20:33.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:33.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170546+0000", 2024-09-17T02:20:33.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.037e-06 2024-09-17T02:20:33.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:33.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170606+0000", 2024-09-17T02:20:33.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9914000000000003e-05 2024-09-17T02:20:33.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:33.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170621+0000", 2024-09-17T02:20:33.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5011000000000001e-05 2024-09-17T02:20:33.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170628+0000", 2024-09-17T02:20:33.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3989999999999998e-06 2024-09-17T02:20:33.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:33.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170703+0000", 2024-09-17T02:20:33.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5082999999999999e-05 2024-09-17T02:20:33.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:33.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170860+0000", 2024-09-17T02:20:33.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015699600000000001 2024-09-17T02:20:33.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:33.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170991+0000", 2024-09-17T02:20:33.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013087900000000001 2024-09-17T02:20:33.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:33.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.172129+0000", 2024-09-17T02:20:33.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001137826 2024-09-17T02:20:33.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.184962+0000", 2024-09-17T02:20:33.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012832582 2024-09-17T02:20:33.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:33.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.185000+0000", 2024-09-17T02:20:33.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8444e-05 2024-09-17T02:20:33.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:33.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.185055+0000", 2024-09-17T02:20:33.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5401e-05 2024-09-17T02:20:33.916 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.916 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:33.916 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.916 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:1248 5.e 5:7f482265:::benchmark_data_smithi001_23533_object1247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:33.916 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:33.170647+0000", 2024-09-17T02:20:33.916 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.63610198699999998, 2024-09-17T02:20:33.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015727534000000001, 2024-09-17T02:20:33.916 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:33.916 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:33.916 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:33.916 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:33.917 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:33.917 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:33.917 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1248 2024-09-17T02:20:33.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.917 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:33.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:33.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170647+0000", 2024-09-17T02:20:33.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:33.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170647+0000", 2024-09-17T02:20:33.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:33.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:33.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170648+0000", 2024-09-17T02:20:33.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4000000000000002e-07 2024-09-17T02:20:33.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:33.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170691+0000", 2024-09-17T02:20:33.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2722000000000002e-05 2024-09-17T02:20:33.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:33.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170699+0000", 2024-09-17T02:20:33.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1540000000000002e-06 2024-09-17T02:20:33.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:33.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170704+0000", 2024-09-17T02:20:33.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1290000000000004e-06 2024-09-17T02:20:33.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:33.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.171489+0000", 2024-09-17T02:20:33.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00078564599999999998 2024-09-17T02:20:33.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:33.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.171653+0000", 2024-09-17T02:20:33.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163027 2024-09-17T02:20:33.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:33.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.171797+0000", 2024-09-17T02:20:33.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000144828 2024-09-17T02:20:33.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:33.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.172344+0000", 2024-09-17T02:20:33.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054687599999999996 2024-09-17T02:20:33.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:33.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.186281+0000", 2024-09-17T02:20:33.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013936755 2024-09-17T02:20:33.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:33.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.186338+0000", 2024-09-17T02:20:33.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6598000000000003e-05 2024-09-17T02:20:33.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:33.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:33.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:33.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.186375+0000", 2024-09-17T02:20:33.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7258999999999997e-05 2024-09-17T02:20:33.922 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.923 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:33.923 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.923 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:33.923 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:33.923 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:20:33.925 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:33.928+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:33.925 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:20:33.983 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --admin-daemon /var/run/ceph/ceph-client.0.asok objecter_requests 2024-09-17T02:20:34.026 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:34.026+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:34.094 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:20:34.094 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:20:34.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.094 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:4813 5.6 5:6377bffc:::benchmark_data_smithi001_23533_object4812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-17T02:20:34.094 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:34.094533+0000", 2024-09-17T02:20:34.095 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0044840419999999997, 2024-09-17T02:20:34.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004504175, 2024-09-17T02:20:34.095 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.095 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.095 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:34.095 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:34.095 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:34.095 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:34.095 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 4813 2024-09-17T02:20:34.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.096 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.094533+0000", 2024-09-17T02:20:34.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.094533+0000", 2024-09-17T02:20:34.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.094534+0000", 2024-09-17T02:20:34.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5600000000000004e-07 2024-09-17T02:20:34.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.094734+0000", 2024-09-17T02:20:34.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000200323 2024-09-17T02:20:34.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.094746+0000", 2024-09-17T02:20:34.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2526e-05 2024-09-17T02:20:34.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.094752+0000", 2024-09-17T02:20:34.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7089999999999999e-06 2024-09-17T02:20:34.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.094828+0000", 2024-09-17T02:20:34.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6237999999999998e-05 2024-09-17T02:20:34.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.094964+0000", 2024-09-17T02:20:34.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013601299999999999 2024-09-17T02:20:34.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:34.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.095110+0000", 2024-09-17T02:20:34.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014582700000000001 2024-09-17T02:20:34.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:34.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096821+0000", 2024-09-17T02:20:34.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017106929999999999 2024-09-17T02:20:34.101 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.101 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.101 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.101 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:4814 5.b e25/22 5:d77adb3a:::benchmark_data_smithi001_23533_object4813:head v 25'297, mlcod=25'294)", 2024-09-17T02:20:34.101 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:34.095340+0000", 2024-09-17T02:20:34.101 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0036766889999999999, 2024-09-17T02:20:34.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003746493, 2024-09-17T02:20:34.102 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.102 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.102 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:34.102 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.095340+0000", 2024-09-17T02:20:34.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.095340+0000", 2024-09-17T02:20:34.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.095340+0000", 2024-09-17T02:20:34.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1199999999999998e-07 2024-09-17T02:20:34.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.095429+0000", 2024-09-17T02:20:34.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8611999999999998e-05 2024-09-17T02:20:34.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.095439+0000", 2024-09-17T02:20:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9969999999999993e-06 2024-09-17T02:20:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.095446+0000", 2024-09-17T02:20:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6760000000000001e-06 2024-09-17T02:20:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.095543+0000", 2024-09-17T02:20:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7608999999999993e-05 2024-09-17T02:20:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.095562+0000", 2024-09-17T02:20:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8760999999999999e-05 2024-09-17T02:20:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:4819 5.3 5:c41f378d:::benchmark_data_smithi001_23533_object4818:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-17T02:20:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:34.096056+0000", 2024-09-17T02:20:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0029609979999999998, 2024-09-17T02:20:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030859559999999999, 2024-09-17T02:20:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 4819 2024-09-17T02:20:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096056+0000", 2024-09-17T02:20:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096056+0000", 2024-09-17T02:20:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096057+0000", 2024-09-17T02:20:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.54e-07 2024-09-17T02:20:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096159+0000", 2024-09-17T02:20:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102143 2024-09-17T02:20:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096177+0000", 2024-09-17T02:20:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8383e-05 2024-09-17T02:20:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096192+0000", 2024-09-17T02:20:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4822e-05 2024-09-17T02:20:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096227+0000", 2024-09-17T02:20:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.506e-05 2024-09-17T02:20:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096300+0000", 2024-09-17T02:20:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2806999999999996e-05 2024-09-17T02:20:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096379+0000", 2024-09-17T02:20:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9281000000000002e-05 2024-09-17T02:20:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097957+0000", 2024-09-17T02:20:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001578386 2024-09-17T02:20:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:4820 5.6 5:6ca15bc8:::benchmark_data_smithi001_23533_object4819:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-17T02:20:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:34.096206+0000", 2024-09-17T02:20:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.002810206, 2024-09-17T02:20:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029901670000000002, 2024-09-17T02:20:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 4820 2024-09-17T02:20:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096206+0000", 2024-09-17T02:20:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096206+0000", 2024-09-17T02:20:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096207+0000", 2024-09-17T02:20:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2699999999999999e-07 2024-09-17T02:20:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096240+0000", 2024-09-17T02:20:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2971e-05 2024-09-17T02:20:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096246+0000", 2024-09-17T02:20:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1070000000000001e-06 2024-09-17T02:20:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096251+0000", 2024-09-17T02:20:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2400000000000001e-06 2024-09-17T02:20:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096301+0000", 2024-09-17T02:20:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0328999999999999e-05 2024-09-17T02:20:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096383+0000", 2024-09-17T02:20:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2127999999999997e-05 2024-09-17T02:20:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096469+0000", 2024-09-17T02:20:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5937000000000001e-05 2024-09-17T02:20:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097999+0000", 2024-09-17T02:20:34.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001530331 2024-09-17T02:20:34.116 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.116 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.116 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.116 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:4815 5.b e25/22 5:dc79713a:::benchmark_data_smithi001_23533_object4814:head v 25'298, mlcod=25'294)", 2024-09-17T02:20:34.116 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:34.096280+0000", 2024-09-17T02:20:34.116 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0027366030000000002, 2024-09-17T02:20:34.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00297795, 2024-09-17T02:20:34.116 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.116 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.116 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:34.117 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096280+0000", 2024-09-17T02:20:34.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096280+0000", 2024-09-17T02:20:34.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096280+0000", 2024-09-17T02:20:34.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.96e-07 2024-09-17T02:20:34.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096392+0000", 2024-09-17T02:20:34.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111538 2024-09-17T02:20:34.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096398+0000", 2024-09-17T02:20:34.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3720000000000001e-06 2024-09-17T02:20:34.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096404+0000", 2024-09-17T02:20:34.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6439999999999997e-06 2024-09-17T02:20:34.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096454+0000", 2024-09-17T02:20:34.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9864000000000002e-05 2024-09-17T02:20:34.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096471+0000", 2024-09-17T02:20:34.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6673000000000001e-05 2024-09-17T02:20:34.120 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.120 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.120 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.120 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:4818 5.1 e25/22 5:8c1ddf8d:::benchmark_data_smithi001_23533_object4817:head v 25'301, mlcod=25'299)", 2024-09-17T02:20:34.120 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:34.096593+0000", 2024-09-17T02:20:34.120 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0024238430000000002, 2024-09-17T02:20:34.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027097139999999998, 2024-09-17T02:20:34.120 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.121 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.121 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:34.121 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096593+0000", 2024-09-17T02:20:34.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096593+0000", 2024-09-17T02:20:34.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096593+0000", 2024-09-17T02:20:34.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.51e-07 2024-09-17T02:20:34.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096707+0000", 2024-09-17T02:20:34.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011336900000000001 2024-09-17T02:20:34.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096713+0000", 2024-09-17T02:20:34.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2700000000000001e-06 2024-09-17T02:20:34.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096718+0000", 2024-09-17T02:20:34.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8500000000000002e-06 2024-09-17T02:20:34.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096768+0000", 2024-09-17T02:20:34.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9743999999999997e-05 2024-09-17T02:20:34.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096785+0000", 2024-09-17T02:20:34.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7595999999999999e-05 2024-09-17T02:20:34.124 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.124 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.124 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.125 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:4821 5.7 e25/22 5:ea0ca0e5:::benchmark_data_smithi001_23533_object4820:head v 25'311, mlcod=25'309)", 2024-09-17T02:20:34.125 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:34.096988+0000", 2024-09-17T02:20:34.125 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0020284719999999999, 2024-09-17T02:20:34.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023459309999999999, 2024-09-17T02:20:34.125 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.125 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.125 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:34.125 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096988+0000", 2024-09-17T02:20:34.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096988+0000", 2024-09-17T02:20:34.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.096989+0000", 2024-09-17T02:20:34.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6400000000000003e-07 2024-09-17T02:20:34.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097053+0000", 2024-09-17T02:20:34.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4704999999999998e-05 2024-09-17T02:20:34.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097060+0000", 2024-09-17T02:20:34.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.781e-06 2024-09-17T02:20:34.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097064+0000", 2024-09-17T02:20:34.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8600000000000003e-06 2024-09-17T02:20:34.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097103+0000", 2024-09-17T02:20:34.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9215000000000003e-05 2024-09-17T02:20:34.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097115+0000", 2024-09-17T02:20:34.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1782e-05 2024-09-17T02:20:34.129 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.129 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.129 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.129 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:4823 5.e e25/22 5:7eceaffa:::benchmark_data_smithi001_23533_object4822:head v 25'286, mlcod=25'284)", 2024-09-17T02:20:34.129 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:34.097477+0000", 2024-09-17T02:20:34.129 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0015399280000000001, 2024-09-17T02:20:34.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019013019999999999, 2024-09-17T02:20:34.130 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.130 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.130 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:34.130 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097477+0000", 2024-09-17T02:20:34.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097477+0000", 2024-09-17T02:20:34.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097478+0000", 2024-09-17T02:20:34.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5099999999999999e-07 2024-09-17T02:20:34.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097531+0000", 2024-09-17T02:20:34.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3170000000000001e-05 2024-09-17T02:20:34.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097540+0000", 2024-09-17T02:20:34.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5100000000000004e-06 2024-09-17T02:20:34.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097557+0000", 2024-09-17T02:20:34.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7053000000000001e-05 2024-09-17T02:20:34.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097601+0000", 2024-09-17T02:20:34.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4045999999999998e-05 2024-09-17T02:20:34.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097613+0000", 2024-09-17T02:20:34.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1235e-05 2024-09-17T02:20:34.134 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.134 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.134 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.134 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:4824 5.1 e25/22 5:8bbfd17c:::benchmark_data_smithi001_23533_object4823:head v 25'302, mlcod=25'299)", 2024-09-17T02:20:34.135 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:34.097478+0000", 2024-09-17T02:20:34.135 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001538525, 2024-09-17T02:20:34.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019311179999999999, 2024-09-17T02:20:34.135 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.135 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.135 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:34.135 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097478+0000", 2024-09-17T02:20:34.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097478+0000", 2024-09-17T02:20:34.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097479+0000", 2024-09-17T02:20:34.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.54e-07 2024-09-17T02:20:34.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097566+0000", 2024-09-17T02:20:34.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7188000000000006e-05 2024-09-17T02:20:34.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097574+0000", 2024-09-17T02:20:34.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0919999999999998e-06 2024-09-17T02:20:34.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097580+0000", 2024-09-17T02:20:34.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8640000000000001e-06 2024-09-17T02:20:34.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097634+0000", 2024-09-17T02:20:34.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4233000000000001e-05 2024-09-17T02:20:34.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097653+0000", 2024-09-17T02:20:34.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8478000000000002e-05 2024-09-17T02:20:34.138 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.138 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.138 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.138 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:4826 5.c 5:332ec89c:::benchmark_data_smithi001_23533_object4825:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-17T02:20:34.138 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:34.097605+0000", 2024-09-17T02:20:34.138 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0014120669999999999, 2024-09-17T02:20:34.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018380989999999999, 2024-09-17T02:20:34.139 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.139 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.139 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:34.139 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:34.139 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:34.139 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:34.139 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 4826 2024-09-17T02:20:34.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.139 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097605+0000", 2024-09-17T02:20:34.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097605+0000", 2024-09-17T02:20:34.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097605+0000", 2024-09-17T02:20:34.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6899999999999996e-07 2024-09-17T02:20:34.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097711+0000", 2024-09-17T02:20:34.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105548 2024-09-17T02:20:34.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097720+0000", 2024-09-17T02:20:34.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5310000000000007e-06 2024-09-17T02:20:34.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097727+0000", 2024-09-17T02:20:34.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9870000000000002e-06 2024-09-17T02:20:34.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097774+0000", 2024-09-17T02:20:34.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6113999999999999e-05 2024-09-17T02:20:34.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097856+0000", 2024-09-17T02:20:34.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2868999999999996e-05 2024-09-17T02:20:34.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:34.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.097959+0000", 2024-09-17T02:20:34.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102299 2024-09-17T02:20:34.144 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.144 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.144 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.144 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:4825 5.1 e25/22 5:81ad7a7c:::benchmark_data_smithi001_23533_object4824:head v 25'303, mlcod=25'299)", 2024-09-17T02:20:34.144 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:34.098249+0000", 2024-09-17T02:20:34.144 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00076747199999999995, 2024-09-17T02:20:34.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001232365, 2024-09-17T02:20:34.144 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.145 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.145 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:34.145 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.098249+0000", 2024-09-17T02:20:34.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.098249+0000", 2024-09-17T02:20:34.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.098250+0000", 2024-09-17T02:20:34.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.09e-07 2024-09-17T02:20:34.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.098308+0000", 2024-09-17T02:20:34.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7624000000000003e-05 2024-09-17T02:20:34.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.098317+0000", 2024-09-17T02:20:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5489999999999995e-06 2024-09-17T02:20:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.098324+0000", 2024-09-17T02:20:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5320000000000003e-06 2024-09-17T02:20:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.098367+0000", 2024-09-17T02:20:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2973999999999999e-05 2024-09-17T02:20:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.098380+0000", 2024-09-17T02:20:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3687e-05 2024-09-17T02:20:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:4827 5.0 e25/22 5:0abe36b3:::benchmark_data_smithi001_23533_object4826:head v 25'289, mlcod=25'287)", 2024-09-17T02:20:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:34.098328+0000", 2024-09-17T02:20:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.000688804, 2024-09-17T02:20:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011852500000000001, 2024-09-17T02:20:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.098328+0000", 2024-09-17T02:20:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.098328+0000", 2024-09-17T02:20:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.098329+0000", 2024-09-17T02:20:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8500000000000001e-07 2024-09-17T02:20:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.098400+0000", 2024-09-17T02:20:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1731999999999997e-05 2024-09-17T02:20:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.098407+0000", 2024-09-17T02:20:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9460000000000001e-06 2024-09-17T02:20:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.098412+0000", 2024-09-17T02:20:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5059999999999997e-06 2024-09-17T02:20:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.098447+0000", 2024-09-17T02:20:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4858999999999999e-05 2024-09-17T02:20:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.098458+0000", 2024-09-17T02:20:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1061e-05 2024-09-17T02:20:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:4829 5.b e25/22 5:d3de320e:::benchmark_data_smithi001_23533_object4828:head v 25'299, mlcod=25'295)", 2024-09-17T02:20:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:34.098805+0000", 2024-09-17T02:20:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00021150499999999999, 2024-09-17T02:20:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00074338900000000001, 2024-09-17T02:20:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.098805+0000", 2024-09-17T02:20:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.098805+0000", 2024-09-17T02:20:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.098806+0000", 2024-09-17T02:20:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4900000000000001e-07 2024-09-17T02:20:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.098890+0000", 2024-09-17T02:20:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4443000000000004e-05 2024-09-17T02:20:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.098897+0000", 2024-09-17T02:20:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0360000000000001e-06 2024-09-17T02:20:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.098901+0000", 2024-09-17T02:20:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6610000000000002e-06 2024-09-17T02:20:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.098936+0000", 2024-09-17T02:20:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4919999999999998e-05 2024-09-17T02:20:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.098949+0000", 2024-09-17T02:20:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3570999999999999e-05 2024-09-17T02:20:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:4830 5.c 5:3e42d74c:::benchmark_data_smithi001_23533_object4829:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-17T02:20:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:34.099114+0000", 2024-09-17T02:20:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9999027, 2024-09-17T02:20:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00046872, 2024-09-17T02:20:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 4830 2024-09-17T02:20:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.099114+0000", 2024-09-17T02:20:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.099114+0000", 2024-09-17T02:20:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.099115+0000", 2024-09-17T02:20:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1500000000000004e-07 2024-09-17T02:20:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.099189+0000", 2024-09-17T02:20:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4278999999999998e-05 2024-09-17T02:20:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.099197+0000", 2024-09-17T02:20:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2979999999999992e-06 2024-09-17T02:20:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.099203+0000", 2024-09-17T02:20:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2789999999999998e-06 2024-09-17T02:20:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.099246+0000", 2024-09-17T02:20:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3262e-05 2024-09-17T02:20:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.099336+0000", 2024-09-17T02:20:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9950000000000004e-05 2024-09-17T02:20:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.099422+0000", 2024-09-17T02:20:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6013999999999993e-05 2024-09-17T02:20:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:4831 5.c 5.bd3defec (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-17T02:20:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:34.099235+0000", 2024-09-17T02:20:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9997816, 2024-09-17T02:20:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00039084200000000002, 2024-09-17T02:20:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:20:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 4831 2024-09-17T02:20:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.099235+0000", 2024-09-17T02:20:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.099235+0000", 2024-09-17T02:20:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.099236+0000", 2024-09-17T02:20:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6199999999999998e-07 2024-09-17T02:20:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.099314+0000", 2024-09-17T02:20:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8141999999999998e-05 2024-09-17T02:20:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.099323+0000", 2024-09-17T02:20:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0820000000000005e-06 2024-09-17T02:20:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.099329+0000", 2024-09-17T02:20:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5799999999999997e-06 2024-09-17T02:20:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4466.0:4826 5.c e25/22)", 2024-09-17T02:20:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:34.099315+0000", 2024-09-17T02:20:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.999702, 2024-09-17T02:20:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033896000000000002, 2024-09-17T02:20:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:20:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.099315+0000", 2024-09-17T02:20:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.099315+0000", 2024-09-17T02:20:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.099315+0000", 2024-09-17T02:20:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9100000000000004e-07 2024-09-17T02:20:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.099318+0000", 2024-09-17T02:20:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1269999999999999e-06 2024-09-17T02:20:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.099325+0000", 2024-09-17T02:20:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6980000000000001e-06 2024-09-17T02:20:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:34.099330+0000", 2024-09-17T02:20:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7550000000000002e-06 2024-09-17T02:20:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:20:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 16 2024-09-17T02:20:34.167 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:20:34.169 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-17T02:20:34.169 INFO:teuthology.orchestra.run.smithi001.stdout: "ops": [ 2024-09-17T02:20:34.169 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:34.169 INFO:teuthology.orchestra.run.smithi001.stdout: "tid": 4911, 2024-09-17T02:20:34.169 INFO:teuthology.orchestra.run.smithi001.stdout: "pg": "5.b009f20e", 2024-09-17T02:20:34.169 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 0, 2024-09-17T02:20:34.169 INFO:teuthology.orchestra.run.smithi001.stdout: "object_id": "benchmark_data_smithi001_23533_object4910", 2024-09-17T02:20:34.169 INFO:teuthology.orchestra.run.smithi001.stdout: "object_locator": "@5", 2024-09-17T02:20:34.169 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_id": "benchmark_data_smithi001_23533_object4910", 2024-09-17T02:20:34.169 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_locator": "@5", 2024-09-17T02:20:34.170 INFO:teuthology.orchestra.run.smithi001.stdout: "paused": 0, 2024-09-17T02:20:34.170 INFO:teuthology.orchestra.run.smithi001.stdout: "used_replica": 0, 2024-09-17T02:20:34.170 INFO:teuthology.orchestra.run.smithi001.stdout: "precalc_pgid": 0, 2024-09-17T02:20:34.170 INFO:teuthology.orchestra.run.smithi001.stdout: "last_sent": "740.646748s", 2024-09-17T02:20:34.170 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0039999650000000003, 2024-09-17T02:20:34.170 INFO:teuthology.orchestra.run.smithi001.stdout: "attempts": 1, 2024-09-17T02:20:34.170 INFO:teuthology.orchestra.run.smithi001.stdout: "snapid": "head", 2024-09-17T02:20:34.170 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_context": "0=[]", 2024-09-17T02:20:34.170 INFO:teuthology.orchestra.run.smithi001.stdout: "mtime": "2024-09-17T02:20:34.118395+0000", 2024-09-17T02:20:34.170 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_ops": [ 2024-09-17T02:20:34.170 INFO:teuthology.orchestra.run.smithi001.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-17T02:20:34.170 INFO:teuthology.orchestra.run.smithi001.stdout: "write 0~65536 in=65536b" 2024-09-17T02:20:34.170 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:34.170 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:34.170 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:34.171 INFO:teuthology.orchestra.run.smithi001.stdout: "tid": 4915, 2024-09-17T02:20:34.171 INFO:teuthology.orchestra.run.smithi001.stdout: "pg": "5.acc9beae", 2024-09-17T02:20:34.171 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 0, 2024-09-17T02:20:34.171 INFO:teuthology.orchestra.run.smithi001.stdout: "object_id": "benchmark_data_smithi001_23533_object4914", 2024-09-17T02:20:34.171 INFO:teuthology.orchestra.run.smithi001.stdout: "object_locator": "@5", 2024-09-17T02:20:34.171 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_id": "benchmark_data_smithi001_23533_object4914", 2024-09-17T02:20:34.171 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_locator": "@5", 2024-09-17T02:20:34.171 INFO:teuthology.orchestra.run.smithi001.stdout: "paused": 0, 2024-09-17T02:20:34.171 INFO:teuthology.orchestra.run.smithi001.stdout: "used_replica": 0, 2024-09-17T02:20:34.171 INFO:teuthology.orchestra.run.smithi001.stdout: "precalc_pgid": 0, 2024-09-17T02:20:34.171 INFO:teuthology.orchestra.run.smithi001.stdout: "last_sent": "740.646748s", 2024-09-17T02:20:34.171 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0039999650000000003, 2024-09-17T02:20:34.171 INFO:teuthology.orchestra.run.smithi001.stdout: "attempts": 1, 2024-09-17T02:20:34.171 INFO:teuthology.orchestra.run.smithi001.stdout: "snapid": "head", 2024-09-17T02:20:34.172 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_context": "0=[]", 2024-09-17T02:20:34.172 INFO:teuthology.orchestra.run.smithi001.stdout: "mtime": "2024-09-17T02:20:34.118718+0000", 2024-09-17T02:20:34.172 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_ops": [ 2024-09-17T02:20:34.172 INFO:teuthology.orchestra.run.smithi001.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-17T02:20:34.172 INFO:teuthology.orchestra.run.smithi001.stdout: "write 0~65536 in=65536b" 2024-09-17T02:20:34.172 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:34.172 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:34.172 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:34.172 INFO:teuthology.orchestra.run.smithi001.stdout: "tid": 4923, 2024-09-17T02:20:34.172 INFO:teuthology.orchestra.run.smithi001.stdout: "pg": "5.4228587e", 2024-09-17T02:20:34.172 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 0, 2024-09-17T02:20:34.172 INFO:teuthology.orchestra.run.smithi001.stdout: "object_id": "benchmark_data_smithi001_23533_object4922", 2024-09-17T02:20:34.172 INFO:teuthology.orchestra.run.smithi001.stdout: "object_locator": "@5", 2024-09-17T02:20:34.172 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_id": "benchmark_data_smithi001_23533_object4922", 2024-09-17T02:20:34.173 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_locator": "@5", 2024-09-17T02:20:34.173 INFO:teuthology.orchestra.run.smithi001.stdout: "paused": 0, 2024-09-17T02:20:34.173 INFO:teuthology.orchestra.run.smithi001.stdout: "used_replica": 0, 2024-09-17T02:20:34.173 INFO:teuthology.orchestra.run.smithi001.stdout: "precalc_pgid": 0, 2024-09-17T02:20:34.173 INFO:teuthology.orchestra.run.smithi001.stdout: "last_sent": "740.646748s", 2024-09-17T02:20:34.173 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0039999650000000003, 2024-09-17T02:20:34.173 INFO:teuthology.orchestra.run.smithi001.stdout: "attempts": 1, 2024-09-17T02:20:34.173 INFO:teuthology.orchestra.run.smithi001.stdout: "snapid": "head", 2024-09-17T02:20:34.173 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_context": "0=[]", 2024-09-17T02:20:34.173 INFO:teuthology.orchestra.run.smithi001.stdout: "mtime": "2024-09-17T02:20:34.120877+0000", 2024-09-17T02:20:34.173 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_ops": [ 2024-09-17T02:20:34.173 INFO:teuthology.orchestra.run.smithi001.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-17T02:20:34.173 INFO:teuthology.orchestra.run.smithi001.stdout: "write 0~65536 in=65536b" 2024-09-17T02:20:34.173 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:34.173 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:34.174 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:34.174 INFO:teuthology.orchestra.run.smithi001.stdout: "tid": 4925, 2024-09-17T02:20:34.174 INFO:teuthology.orchestra.run.smithi001.stdout: "pg": "5.e260be28", 2024-09-17T02:20:34.174 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 0, 2024-09-17T02:20:34.174 INFO:teuthology.orchestra.run.smithi001.stdout: "object_id": "benchmark_data_smithi001_23533_object4924", 2024-09-17T02:20:34.174 INFO:teuthology.orchestra.run.smithi001.stdout: "object_locator": "@5", 2024-09-17T02:20:34.174 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_id": "benchmark_data_smithi001_23533_object4924", 2024-09-17T02:20:34.174 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_locator": "@5", 2024-09-17T02:20:34.174 INFO:teuthology.orchestra.run.smithi001.stdout: "paused": 0, 2024-09-17T02:20:34.174 INFO:teuthology.orchestra.run.smithi001.stdout: "used_replica": 0, 2024-09-17T02:20:34.174 INFO:teuthology.orchestra.run.smithi001.stdout: "precalc_pgid": 0, 2024-09-17T02:20:34.174 INFO:teuthology.orchestra.run.smithi001.stdout: "last_sent": "740.646748s", 2024-09-17T02:20:34.174 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0039999650000000003, 2024-09-17T02:20:34.174 INFO:teuthology.orchestra.run.smithi001.stdout: "attempts": 1, 2024-09-17T02:20:34.175 INFO:teuthology.orchestra.run.smithi001.stdout: "snapid": "head", 2024-09-17T02:20:34.175 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_context": "0=[]", 2024-09-17T02:20:34.175 INFO:teuthology.orchestra.run.smithi001.stdout: "mtime": "2024-09-17T02:20:34.121104+0000", 2024-09-17T02:20:34.175 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_ops": [ 2024-09-17T02:20:34.175 INFO:teuthology.orchestra.run.smithi001.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-17T02:20:34.175 INFO:teuthology.orchestra.run.smithi001.stdout: "write 0~65536 in=65536b" 2024-09-17T02:20:34.175 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:34.175 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:34.175 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:34.175 INFO:teuthology.orchestra.run.smithi001.stdout: "tid": 4928, 2024-09-17T02:20:34.175 INFO:teuthology.orchestra.run.smithi001.stdout: "pg": "5.9cb3b674", 2024-09-17T02:20:34.175 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 0, 2024-09-17T02:20:34.175 INFO:teuthology.orchestra.run.smithi001.stdout: "object_id": "benchmark_data_smithi001_23533_object4927", 2024-09-17T02:20:34.175 INFO:teuthology.orchestra.run.smithi001.stdout: "object_locator": "@5", 2024-09-17T02:20:34.176 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_id": "benchmark_data_smithi001_23533_object4927", 2024-09-17T02:20:34.176 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_locator": "@5", 2024-09-17T02:20:34.176 INFO:teuthology.orchestra.run.smithi001.stdout: "paused": 0, 2024-09-17T02:20:34.176 INFO:teuthology.orchestra.run.smithi001.stdout: "used_replica": 0, 2024-09-17T02:20:34.176 INFO:teuthology.orchestra.run.smithi001.stdout: "precalc_pgid": 0, 2024-09-17T02:20:34.176 INFO:teuthology.orchestra.run.smithi001.stdout: "last_sent": "740.646748s", 2024-09-17T02:20:34.176 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0039999650000000003, 2024-09-17T02:20:34.176 INFO:teuthology.orchestra.run.smithi001.stdout: "attempts": 1, 2024-09-17T02:20:34.176 INFO:teuthology.orchestra.run.smithi001.stdout: "snapid": "head", 2024-09-17T02:20:34.176 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_context": "0=[]", 2024-09-17T02:20:34.176 INFO:teuthology.orchestra.run.smithi001.stdout: "mtime": "2024-09-17T02:20:34.121360+0000", 2024-09-17T02:20:34.176 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_ops": [ 2024-09-17T02:20:34.176 INFO:teuthology.orchestra.run.smithi001.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-17T02:20:34.176 INFO:teuthology.orchestra.run.smithi001.stdout: "write 0~65536 in=65536b" 2024-09-17T02:20:34.177 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:34.177 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:34.177 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:34.177 INFO:teuthology.orchestra.run.smithi001.stdout: "tid": 4932, 2024-09-17T02:20:34.177 INFO:teuthology.orchestra.run.smithi001.stdout: "pg": "5.8be632d8", 2024-09-17T02:20:34.177 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 0, 2024-09-17T02:20:34.177 INFO:teuthology.orchestra.run.smithi001.stdout: "object_id": "benchmark_data_smithi001_23533_object4931", 2024-09-17T02:20:34.177 INFO:teuthology.orchestra.run.smithi001.stdout: "object_locator": "@5", 2024-09-17T02:20:34.177 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_id": "benchmark_data_smithi001_23533_object4931", 2024-09-17T02:20:34.177 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_locator": "@5", 2024-09-17T02:20:34.177 INFO:teuthology.orchestra.run.smithi001.stdout: "paused": 0, 2024-09-17T02:20:34.177 INFO:teuthology.orchestra.run.smithi001.stdout: "used_replica": 0, 2024-09-17T02:20:34.177 INFO:teuthology.orchestra.run.smithi001.stdout: "precalc_pgid": 0, 2024-09-17T02:20:34.177 INFO:teuthology.orchestra.run.smithi001.stdout: "last_sent": "740.650748s", 2024-09-17T02:20:34.178 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0, 2024-09-17T02:20:34.178 INFO:teuthology.orchestra.run.smithi001.stdout: "attempts": 1, 2024-09-17T02:20:34.178 INFO:teuthology.orchestra.run.smithi001.stdout: "snapid": "head", 2024-09-17T02:20:34.178 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_context": "0=[]", 2024-09-17T02:20:34.178 INFO:teuthology.orchestra.run.smithi001.stdout: "mtime": "2024-09-17T02:20:34.122478+0000", 2024-09-17T02:20:34.178 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_ops": [ 2024-09-17T02:20:34.178 INFO:teuthology.orchestra.run.smithi001.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-17T02:20:34.178 INFO:teuthology.orchestra.run.smithi001.stdout: "write 0~65536 in=65536b" 2024-09-17T02:20:34.178 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:34.178 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:34.178 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:34.178 INFO:teuthology.orchestra.run.smithi001.stdout: "tid": 4921, 2024-09-17T02:20:34.178 INFO:teuthology.orchestra.run.smithi001.stdout: "pg": "5.4ccc6596", 2024-09-17T02:20:34.178 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 1, 2024-09-17T02:20:34.179 INFO:teuthology.orchestra.run.smithi001.stdout: "object_id": "benchmark_data_smithi001_23533_object4920", 2024-09-17T02:20:34.179 INFO:teuthology.orchestra.run.smithi001.stdout: "object_locator": "@5", 2024-09-17T02:20:34.179 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_id": "benchmark_data_smithi001_23533_object4920", 2024-09-17T02:20:34.179 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_locator": "@5", 2024-09-17T02:20:34.179 INFO:teuthology.orchestra.run.smithi001.stdout: "paused": 0, 2024-09-17T02:20:34.179 INFO:teuthology.orchestra.run.smithi001.stdout: "used_replica": 0, 2024-09-17T02:20:34.179 INFO:teuthology.orchestra.run.smithi001.stdout: "precalc_pgid": 0, 2024-09-17T02:20:34.179 INFO:teuthology.orchestra.run.smithi001.stdout: "last_sent": "740.646748s", 2024-09-17T02:20:34.179 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0039999650000000003, 2024-09-17T02:20:34.179 INFO:teuthology.orchestra.run.smithi001.stdout: "attempts": 1, 2024-09-17T02:20:34.179 INFO:teuthology.orchestra.run.smithi001.stdout: "snapid": "head", 2024-09-17T02:20:34.179 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_context": "0=[]", 2024-09-17T02:20:34.179 INFO:teuthology.orchestra.run.smithi001.stdout: "mtime": "2024-09-17T02:20:34.119995+0000", 2024-09-17T02:20:34.179 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_ops": [ 2024-09-17T02:20:34.180 INFO:teuthology.orchestra.run.smithi001.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-17T02:20:34.180 INFO:teuthology.orchestra.run.smithi001.stdout: "write 0~65536 in=65536b" 2024-09-17T02:20:34.180 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:34.180 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:34.180 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:34.180 INFO:teuthology.orchestra.run.smithi001.stdout: "tid": 4926, 2024-09-17T02:20:34.180 INFO:teuthology.orchestra.run.smithi001.stdout: "pg": "5.f95fece5", 2024-09-17T02:20:34.180 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 1, 2024-09-17T02:20:34.180 INFO:teuthology.orchestra.run.smithi001.stdout: "object_id": "benchmark_data_smithi001_23533_object4925", 2024-09-17T02:20:34.180 INFO:teuthology.orchestra.run.smithi001.stdout: "object_locator": "@5", 2024-09-17T02:20:34.180 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_id": "benchmark_data_smithi001_23533_object4925", 2024-09-17T02:20:34.180 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_locator": "@5", 2024-09-17T02:20:34.180 INFO:teuthology.orchestra.run.smithi001.stdout: "paused": 0, 2024-09-17T02:20:34.180 INFO:teuthology.orchestra.run.smithi001.stdout: "used_replica": 0, 2024-09-17T02:20:34.181 INFO:teuthology.orchestra.run.smithi001.stdout: "precalc_pgid": 0, 2024-09-17T02:20:34.181 INFO:teuthology.orchestra.run.smithi001.stdout: "last_sent": "740.646748s", 2024-09-17T02:20:34.181 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0039999650000000003, 2024-09-17T02:20:34.181 INFO:teuthology.orchestra.run.smithi001.stdout: "attempts": 1, 2024-09-17T02:20:34.181 INFO:teuthology.orchestra.run.smithi001.stdout: "snapid": "head", 2024-09-17T02:20:34.181 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_context": "0=[]", 2024-09-17T02:20:34.181 INFO:teuthology.orchestra.run.smithi001.stdout: "mtime": "2024-09-17T02:20:34.121285+0000", 2024-09-17T02:20:34.181 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_ops": [ 2024-09-17T02:20:34.181 INFO:teuthology.orchestra.run.smithi001.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-17T02:20:34.181 INFO:teuthology.orchestra.run.smithi001.stdout: "write 0~65536 in=65536b" 2024-09-17T02:20:34.181 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:34.181 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:34.181 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:34.181 INFO:teuthology.orchestra.run.smithi001.stdout: "tid": 4929, 2024-09-17T02:20:34.181 INFO:teuthology.orchestra.run.smithi001.stdout: "pg": "5.9cb4560a", 2024-09-17T02:20:34.182 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 1, 2024-09-17T02:20:34.182 INFO:teuthology.orchestra.run.smithi001.stdout: "object_id": "benchmark_data_smithi001_23533_object4928", 2024-09-17T02:20:34.182 INFO:teuthology.orchestra.run.smithi001.stdout: "object_locator": "@5", 2024-09-17T02:20:34.182 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_id": "benchmark_data_smithi001_23533_object4928", 2024-09-17T02:20:34.182 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_locator": "@5", 2024-09-17T02:20:34.182 INFO:teuthology.orchestra.run.smithi001.stdout: "paused": 0, 2024-09-17T02:20:34.182 INFO:teuthology.orchestra.run.smithi001.stdout: "used_replica": 0, 2024-09-17T02:20:34.182 INFO:teuthology.orchestra.run.smithi001.stdout: "precalc_pgid": 0, 2024-09-17T02:20:34.182 INFO:teuthology.orchestra.run.smithi001.stdout: "last_sent": "740.646748s", 2024-09-17T02:20:34.182 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0039999650000000003, 2024-09-17T02:20:34.182 INFO:teuthology.orchestra.run.smithi001.stdout: "attempts": 1, 2024-09-17T02:20:34.182 INFO:teuthology.orchestra.run.smithi001.stdout: "snapid": "head", 2024-09-17T02:20:34.182 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_context": "0=[]", 2024-09-17T02:20:34.182 INFO:teuthology.orchestra.run.smithi001.stdout: "mtime": "2024-09-17T02:20:34.121627+0000", 2024-09-17T02:20:34.182 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_ops": [ 2024-09-17T02:20:34.183 INFO:teuthology.orchestra.run.smithi001.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-17T02:20:34.183 INFO:teuthology.orchestra.run.smithi001.stdout: "write 0~65536 in=65536b" 2024-09-17T02:20:34.183 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:34.183 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:34.183 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:34.183 INFO:teuthology.orchestra.run.smithi001.stdout: "tid": 4930, 2024-09-17T02:20:34.183 INFO:teuthology.orchestra.run.smithi001.stdout: "pg": "5.23aab2f5", 2024-09-17T02:20:34.183 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 1, 2024-09-17T02:20:34.183 INFO:teuthology.orchestra.run.smithi001.stdout: "object_id": "benchmark_data_smithi001_23533_object4929", 2024-09-17T02:20:34.183 INFO:teuthology.orchestra.run.smithi001.stdout: "object_locator": "@5", 2024-09-17T02:20:34.183 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_id": "benchmark_data_smithi001_23533_object4929", 2024-09-17T02:20:34.183 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_locator": "@5", 2024-09-17T02:20:34.183 INFO:teuthology.orchestra.run.smithi001.stdout: "paused": 0, 2024-09-17T02:20:34.183 INFO:teuthology.orchestra.run.smithi001.stdout: "used_replica": 0, 2024-09-17T02:20:34.184 INFO:teuthology.orchestra.run.smithi001.stdout: "precalc_pgid": 0, 2024-09-17T02:20:34.184 INFO:teuthology.orchestra.run.smithi001.stdout: "last_sent": "740.646748s", 2024-09-17T02:20:34.184 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0039999650000000003, 2024-09-17T02:20:34.184 INFO:teuthology.orchestra.run.smithi001.stdout: "attempts": 1, 2024-09-17T02:20:34.184 INFO:teuthology.orchestra.run.smithi001.stdout: "snapid": "head", 2024-09-17T02:20:34.184 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_context": "0=[]", 2024-09-17T02:20:34.184 INFO:teuthology.orchestra.run.smithi001.stdout: "mtime": "2024-09-17T02:20:34.121917+0000", 2024-09-17T02:20:34.184 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_ops": [ 2024-09-17T02:20:34.184 INFO:teuthology.orchestra.run.smithi001.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-17T02:20:34.184 INFO:teuthology.orchestra.run.smithi001.stdout: "write 0~65536 in=65536b" 2024-09-17T02:20:34.184 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:34.184 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:34.184 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:34.184 INFO:teuthology.orchestra.run.smithi001.stdout: "tid": 4933, 2024-09-17T02:20:34.184 INFO:teuthology.orchestra.run.smithi001.stdout: "pg": "5.14414313", 2024-09-17T02:20:34.185 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 1, 2024-09-17T02:20:34.185 INFO:teuthology.orchestra.run.smithi001.stdout: "object_id": "benchmark_data_smithi001_23533_object4932", 2024-09-17T02:20:34.185 INFO:teuthology.orchestra.run.smithi001.stdout: "object_locator": "@5", 2024-09-17T02:20:34.185 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_id": "benchmark_data_smithi001_23533_object4932", 2024-09-17T02:20:34.185 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_locator": "@5", 2024-09-17T02:20:34.185 INFO:teuthology.orchestra.run.smithi001.stdout: "paused": 0, 2024-09-17T02:20:34.185 INFO:teuthology.orchestra.run.smithi001.stdout: "used_replica": 0, 2024-09-17T02:20:34.185 INFO:teuthology.orchestra.run.smithi001.stdout: "precalc_pgid": 0, 2024-09-17T02:20:34.185 INFO:teuthology.orchestra.run.smithi001.stdout: "last_sent": "740.650748s", 2024-09-17T02:20:34.185 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0, 2024-09-17T02:20:34.185 INFO:teuthology.orchestra.run.smithi001.stdout: "attempts": 1, 2024-09-17T02:20:34.185 INFO:teuthology.orchestra.run.smithi001.stdout: "snapid": "head", 2024-09-17T02:20:34.185 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_context": "0=[]", 2024-09-17T02:20:34.186 INFO:teuthology.orchestra.run.smithi001.stdout: "mtime": "2024-09-17T02:20:34.122787+0000", 2024-09-17T02:20:34.186 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_ops": [ 2024-09-17T02:20:34.186 INFO:teuthology.orchestra.run.smithi001.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-17T02:20:34.186 INFO:teuthology.orchestra.run.smithi001.stdout: "write 0~65536 in=65536b" 2024-09-17T02:20:34.186 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:34.186 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:34.186 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:34.186 INFO:teuthology.orchestra.run.smithi001.stdout: "tid": 4922, 2024-09-17T02:20:34.186 INFO:teuthology.orchestra.run.smithi001.stdout: "pg": "5.47c18d29", 2024-09-17T02:20:34.186 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 2, 2024-09-17T02:20:34.186 INFO:teuthology.orchestra.run.smithi001.stdout: "object_id": "benchmark_data_smithi001_23533_object4921", 2024-09-17T02:20:34.186 INFO:teuthology.orchestra.run.smithi001.stdout: "object_locator": "@5", 2024-09-17T02:20:34.187 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_id": "benchmark_data_smithi001_23533_object4921", 2024-09-17T02:20:34.187 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_locator": "@5", 2024-09-17T02:20:34.187 INFO:teuthology.orchestra.run.smithi001.stdout: "paused": 0, 2024-09-17T02:20:34.187 INFO:teuthology.orchestra.run.smithi001.stdout: "used_replica": 0, 2024-09-17T02:20:34.187 INFO:teuthology.orchestra.run.smithi001.stdout: "precalc_pgid": 0, 2024-09-17T02:20:34.187 INFO:teuthology.orchestra.run.smithi001.stdout: "last_sent": "740.646748s", 2024-09-17T02:20:34.187 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0039999650000000003, 2024-09-17T02:20:34.187 INFO:teuthology.orchestra.run.smithi001.stdout: "attempts": 1, 2024-09-17T02:20:34.187 INFO:teuthology.orchestra.run.smithi001.stdout: "snapid": "head", 2024-09-17T02:20:34.187 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_context": "0=[]", 2024-09-17T02:20:34.187 INFO:teuthology.orchestra.run.smithi001.stdout: "mtime": "2024-09-17T02:20:34.120645+0000", 2024-09-17T02:20:34.187 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_ops": [ 2024-09-17T02:20:34.187 INFO:teuthology.orchestra.run.smithi001.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-17T02:20:34.187 INFO:teuthology.orchestra.run.smithi001.stdout: "write 0~65536 in=65536b" 2024-09-17T02:20:34.188 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:34.188 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:34.188 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:34.188 INFO:teuthology.orchestra.run.smithi001.stdout: "tid": 4924, 2024-09-17T02:20:34.188 INFO:teuthology.orchestra.run.smithi001.stdout: "pg": "5.e2500292", 2024-09-17T02:20:34.188 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 2, 2024-09-17T02:20:34.188 INFO:teuthology.orchestra.run.smithi001.stdout: "object_id": "benchmark_data_smithi001_23533_object4923", 2024-09-17T02:20:34.188 INFO:teuthology.orchestra.run.smithi001.stdout: "object_locator": "@5", 2024-09-17T02:20:34.188 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_id": "benchmark_data_smithi001_23533_object4923", 2024-09-17T02:20:34.188 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_locator": "@5", 2024-09-17T02:20:34.188 INFO:teuthology.orchestra.run.smithi001.stdout: "paused": 0, 2024-09-17T02:20:34.188 INFO:teuthology.orchestra.run.smithi001.stdout: "used_replica": 0, 2024-09-17T02:20:34.188 INFO:teuthology.orchestra.run.smithi001.stdout: "precalc_pgid": 0, 2024-09-17T02:20:34.188 INFO:teuthology.orchestra.run.smithi001.stdout: "last_sent": "740.646748s", 2024-09-17T02:20:34.189 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0039999650000000003, 2024-09-17T02:20:34.189 INFO:teuthology.orchestra.run.smithi001.stdout: "attempts": 1, 2024-09-17T02:20:34.189 INFO:teuthology.orchestra.run.smithi001.stdout: "snapid": "head", 2024-09-17T02:20:34.189 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_context": "0=[]", 2024-09-17T02:20:34.189 INFO:teuthology.orchestra.run.smithi001.stdout: "mtime": "2024-09-17T02:20:34.120975+0000", 2024-09-17T02:20:34.189 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_ops": [ 2024-09-17T02:20:34.189 INFO:teuthology.orchestra.run.smithi001.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-17T02:20:34.189 INFO:teuthology.orchestra.run.smithi001.stdout: "write 0~65536 in=65536b" 2024-09-17T02:20:34.189 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:34.189 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:34.189 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:34.189 INFO:teuthology.orchestra.run.smithi001.stdout: "tid": 4927, 2024-09-17T02:20:34.189 INFO:teuthology.orchestra.run.smithi001.stdout: "pg": "5.47b20889", 2024-09-17T02:20:34.189 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 2, 2024-09-17T02:20:34.190 INFO:teuthology.orchestra.run.smithi001.stdout: "object_id": "benchmark_data_smithi001_23533_object4926", 2024-09-17T02:20:34.190 INFO:teuthology.orchestra.run.smithi001.stdout: "object_locator": "@5", 2024-09-17T02:20:34.190 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_id": "benchmark_data_smithi001_23533_object4926", 2024-09-17T02:20:34.190 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_locator": "@5", 2024-09-17T02:20:34.190 INFO:teuthology.orchestra.run.smithi001.stdout: "paused": 0, 2024-09-17T02:20:34.190 INFO:teuthology.orchestra.run.smithi001.stdout: "used_replica": 0, 2024-09-17T02:20:34.190 INFO:teuthology.orchestra.run.smithi001.stdout: "precalc_pgid": 0, 2024-09-17T02:20:34.190 INFO:teuthology.orchestra.run.smithi001.stdout: "last_sent": "740.646748s", 2024-09-17T02:20:34.190 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0039999650000000003, 2024-09-17T02:20:34.190 INFO:teuthology.orchestra.run.smithi001.stdout: "attempts": 1, 2024-09-17T02:20:34.190 INFO:teuthology.orchestra.run.smithi001.stdout: "snapid": "head", 2024-09-17T02:20:34.190 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_context": "0=[]", 2024-09-17T02:20:34.190 INFO:teuthology.orchestra.run.smithi001.stdout: "mtime": "2024-09-17T02:20:34.121347+0000", 2024-09-17T02:20:34.190 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_ops": [ 2024-09-17T02:20:34.191 INFO:teuthology.orchestra.run.smithi001.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-17T02:20:34.191 INFO:teuthology.orchestra.run.smithi001.stdout: "write 0~65536 in=65536b" 2024-09-17T02:20:34.191 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:34.191 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:34.191 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:34.191 INFO:teuthology.orchestra.run.smithi001.stdout: "tid": 4931, 2024-09-17T02:20:34.191 INFO:teuthology.orchestra.run.smithi001.stdout: "pg": "5.ed2b8af1", 2024-09-17T02:20:34.191 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 2, 2024-09-17T02:20:34.191 INFO:teuthology.orchestra.run.smithi001.stdout: "object_id": "benchmark_data_smithi001_23533_object4930", 2024-09-17T02:20:34.191 INFO:teuthology.orchestra.run.smithi001.stdout: "object_locator": "@5", 2024-09-17T02:20:34.191 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_id": "benchmark_data_smithi001_23533_object4930", 2024-09-17T02:20:34.191 INFO:teuthology.orchestra.run.smithi001.stdout: "target_object_locator": "@5", 2024-09-17T02:20:34.191 INFO:teuthology.orchestra.run.smithi001.stdout: "paused": 0, 2024-09-17T02:20:34.191 INFO:teuthology.orchestra.run.smithi001.stdout: "used_replica": 0, 2024-09-17T02:20:34.192 INFO:teuthology.orchestra.run.smithi001.stdout: "precalc_pgid": 0, 2024-09-17T02:20:34.192 INFO:teuthology.orchestra.run.smithi001.stdout: "last_sent": "740.646748s", 2024-09-17T02:20:34.192 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0039999650000000003, 2024-09-17T02:20:34.192 INFO:teuthology.orchestra.run.smithi001.stdout: "attempts": 1, 2024-09-17T02:20:34.192 INFO:teuthology.orchestra.run.smithi001.stdout: "snapid": "head", 2024-09-17T02:20:34.192 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_context": "0=[]", 2024-09-17T02:20:34.192 INFO:teuthology.orchestra.run.smithi001.stdout: "mtime": "2024-09-17T02:20:34.122129+0000", 2024-09-17T02:20:34.192 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_ops": [ 2024-09-17T02:20:34.192 INFO:teuthology.orchestra.run.smithi001.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-17T02:20:34.192 INFO:teuthology.orchestra.run.smithi001.stdout: "write 0~65536 in=65536b" 2024-09-17T02:20:34.192 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:34.192 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:20:34.192 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-17T02:20:34.192 INFO:teuthology.orchestra.run.smithi001.stdout: "linger_ops": [], 2024-09-17T02:20:34.193 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_ops": [], 2024-09-17T02:20:34.193 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_stat_ops": [], 2024-09-17T02:20:34.193 INFO:teuthology.orchestra.run.smithi001.stdout: "statfs_ops": [], 2024-09-17T02:20:34.193 INFO:teuthology.orchestra.run.smithi001.stdout: "command_ops": [] 2024-09-17T02:20:34.193 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-17T02:20:34.193 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:20:34.193 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:34.172+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:34.194 DEBUG:tasks.admin_socket:admin socket command objecter_requests returned { "ops": [ { "tid": 4911, "pg": "5.b009f20e", "osd": 0, "object_id": "benchmark_data_smithi001_23533_object4910", "object_locator": "@5", "target_object_id": "benchmark_data_smithi001_23533_object4910", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "740.646748s", "age": 0.0039999650000000003, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-17T02:20:34.118395+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4915, "pg": "5.acc9beae", "osd": 0, "object_id": "benchmark_data_smithi001_23533_object4914", "object_locator": "@5", "target_object_id": "benchmark_data_smithi001_23533_object4914", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "740.646748s", "age": 0.0039999650000000003, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-17T02:20:34.118718+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4923, "pg": "5.4228587e", "osd": 0, "object_id": "benchmark_data_smithi001_23533_object4922", "object_locator": "@5", "target_object_id": "benchmark_data_smithi001_23533_object4922", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "740.646748s", "age": 0.0039999650000000003, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-17T02:20:34.120877+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4925, "pg": "5.e260be28", "osd": 0, "object_id": "benchmark_data_smithi001_23533_object4924", "object_locator": "@5", "target_object_id": "benchmark_data_smithi001_23533_object4924", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "740.646748s", "age": 0.0039999650000000003, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-17T02:20:34.121104+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4928, "pg": "5.9cb3b674", "osd": 0, "object_id": "benchmark_data_smithi001_23533_object4927", "object_locator": "@5", "target_object_id": "benchmark_data_smithi001_23533_object4927", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "740.646748s", "age": 0.0039999650000000003, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-17T02:20:34.121360+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4932, "pg": "5.8be632d8", "osd": 0, "object_id": "benchmark_data_smithi001_23533_object4931", "object_locator": "@5", "target_object_id": "benchmark_data_smithi001_23533_object4931", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "740.650748s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-17T02:20:34.122478+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4921, "pg": "5.4ccc6596", "osd": 1, "object_id": "benchmark_data_smithi001_23533_object4920", "object_locator": "@5", "target_object_id": "benchmark_data_smithi001_23533_object4920", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "740.646748s", "age": 0.0039999650000000003, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-17T02:20:34.119995+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4926, "pg": "5.f95fece5", "osd": 1, "object_id": "benchmark_data_smithi001_23533_object4925", "object_locator": "@5", "target_object_id": "benchmark_data_smithi001_23533_object4925", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "740.646748s", "age": 0.0039999650000000003, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-17T02:20:34.121285+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4929, "pg": "5.9cb4560a", "osd": 1, "object_id": "benchmark_data_smithi001_23533_object4928", "object_locator": "@5", "target_object_id": "benchmark_data_smithi001_23533_object4928", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "740.646748s", "age": 0.0039999650000000003, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-17T02:20:34.121627+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4930, "pg": "5.23aab2f5", "osd": 1, "object_id": "benchmark_data_smithi001_23533_object4929", "object_locator": "@5", "target_object_id": "benchmark_data_smithi001_23533_object4929", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "740.646748s", "age": 0.0039999650000000003, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-17T02:20:34.121917+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4933, "pg": "5.14414313", "osd": 1, "object_id": "benchmark_data_smithi001_23533_object4932", "object_locator": "@5", "target_object_id": "benchmark_data_smithi001_23533_object4932", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "740.650748s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-17T02:20:34.122787+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4922, "pg": "5.47c18d29", "osd": 2, "object_id": "benchmark_data_smithi001_23533_object4921", "object_locator": "@5", "target_object_id": "benchmark_data_smithi001_23533_object4921", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "740.646748s", "age": 0.0039999650000000003, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-17T02:20:34.120645+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4924, "pg": "5.e2500292", "osd": 2, "object_id": "benchmark_data_smithi001_23533_object4923", "object_locator": "@5", "target_object_id": "benchmark_data_smithi001_23533_object4923", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "740.646748s", "age": 0.0039999650000000003, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-17T02:20:34.120975+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4927, "pg": "5.47b20889", "osd": 2, "object_id": "benchmark_data_smithi001_23533_object4926", "object_locator": "@5", "target_object_id": "benchmark_data_smithi001_23533_object4926", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "740.646748s", "age": 0.0039999650000000003, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-17T02:20:34.121347+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4931, "pg": "5.ed2b8af1", "osd": 2, "object_id": "benchmark_data_smithi001_23533_object4930", "object_locator": "@5", "target_object_id": "benchmark_data_smithi001_23533_object4930", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "740.646748s", "age": 0.0039999650000000003, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-17T02:20:34.122129+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] } ], "linger_ops": [], "pool_ops": [], "pool_stat_ops": [], "statfs_ops": [], "command_ops": [] } 2024-09-17T02:20:34.194 DEBUG:teuthology.orchestra.run.smithi001:> /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-09-17T02:20:34.229 DEBUG:teuthology.orchestra.run.smithi001:> rm -rf -- /home/ubuntu/cephtest/admin_socket_client.0 2024-09-17T02:20:34.269 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:34.270+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:34.277 DEBUG:teuthology.parallel:result is None 2024-09-17T02:20:34.277 DEBUG:teuthology.run_tasks:Unwinding manager radosbench 2024-09-17T02:20:34.286 INFO:tasks.radosbench:joining radosbench (timing out after 2100s) 2024-09-17T02:20:34.286 INFO:teuthology.orchestra.run:waiting for 2100 2024-09-17T02:20:34.370 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:34.370+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:34.379 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:20:34.379 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:20:34.379 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:20:34.379 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:20:34.379 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:20:34.404 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:20:34.473 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:34.476+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:34.571 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:20:34.571 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:20:34.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:20:34.571 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:20:34.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.572 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:34.572 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:20:34.572 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.013612771999998, 2024-09-17T02:20:34.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021799929999999999, 2024-09-17T02:20:34.572 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.572 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.572 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:34.572 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:20:34.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:20:34.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562007+0000", 2024-09-17T02:20:34.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6260000000000001e-06 2024-09-17T02:20:34.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562021+0000", 2024-09-17T02:20:34.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4440000000000001e-05 2024-09-17T02:20:34.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562053+0000", 2024-09-17T02:20:34.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2159000000000002e-05 2024-09-17T02:20:34.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562076+0000", 2024-09-17T02:20:34.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2926999999999999e-05 2024-09-17T02:20:34.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562218+0000", 2024-09-17T02:20:34.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000141726 2024-09-17T02:20:34.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562506+0000", 2024-09-17T02:20:34.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028752399999999999 2024-09-17T02:20:34.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:34.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562830+0000", 2024-09-17T02:20:34.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032427399999999999 2024-09-17T02:20:34.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:34.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566900+0000", 2024-09-17T02:20:34.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040705660000000003 2024-09-17T02:20:34.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:34.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583581+0000", 2024-09-17T02:20:34.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016680210000000001 2024-09-17T02:20:34.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:34.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583704+0000", 2024-09-17T02:20:34.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012289899999999999 2024-09-17T02:20:34.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:34.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583803+0000", 2024-09-17T02:20:34.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9579000000000003e-05 2024-09-17T02:20:34.578 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.578 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.578 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.578 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:34.578 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:20:34.578 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.013485559999999, 2024-09-17T02:20:34.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022056035000000002, 2024-09-17T02:20:34.578 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.578 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.578 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:34.578 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:20:34.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:20:34.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562132+0000", 2024-09-17T02:20:34.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6300000000000001e-06 2024-09-17T02:20:34.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562142+0000", 2024-09-17T02:20:34.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.022e-05 2024-09-17T02:20:34.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562164+0000", 2024-09-17T02:20:34.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2002999999999999e-05 2024-09-17T02:20:34.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562180+0000", 2024-09-17T02:20:34.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5930000000000002e-05 2024-09-17T02:20:34.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563517+0000", 2024-09-17T02:20:34.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001336776 2024-09-17T02:20:34.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563635+0000", 2024-09-17T02:20:34.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117976 2024-09-17T02:20:34.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.582 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:34.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563819+0000", 2024-09-17T02:20:34.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018411499999999999 2024-09-17T02:20:34.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.582 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:34.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566977+0000", 2024-09-17T02:20:34.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031575990000000001 2024-09-17T02:20:34.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:34.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583917+0000", 2024-09-17T02:20:34.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016940093999999999 2024-09-17T02:20:34.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:34.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584066+0000", 2024-09-17T02:20:34.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000149746 2024-09-17T02:20:34.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:34.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584186+0000", 2024-09-17T02:20:34.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011994600000000001 2024-09-17T02:20:34.584 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.584 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.584 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.584 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:34.584 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:20:34.584 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.013304849000001, 2024-09-17T02:20:34.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023664803000000002, 2024-09-17T02:20:34.584 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.584 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.584 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:34.584 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:20:34.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:20:34.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562313+0000", 2024-09-17T02:20:34.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.764e-06 2024-09-17T02:20:34.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.586 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562323+0000", 2024-09-17T02:20:34.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0166000000000001e-05 2024-09-17T02:20:34.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.586 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562343+0000", 2024-09-17T02:20:34.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9633999999999999e-05 2024-09-17T02:20:34.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.586 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562367+0000", 2024-09-17T02:20:34.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4556e-05 2024-09-17T02:20:34.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563777+0000", 2024-09-17T02:20:34.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014102330000000001 2024-09-17T02:20:34.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563969+0000", 2024-09-17T02:20:34.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000191361 2024-09-17T02:20:34.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:34.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564148+0000", 2024-09-17T02:20:34.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017934599999999999 2024-09-17T02:20:34.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:34.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566989+0000", 2024-09-17T02:20:34.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028407010000000002 2024-09-17T02:20:34.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:34.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585770+0000", 2024-09-17T02:20:34.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018781566999999999 2024-09-17T02:20:34.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.589 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:34.589 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585874+0000", 2024-09-17T02:20:34.589 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103489 2024-09-17T02:20:34.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.589 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:34.589 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585976+0000", 2024-09-17T02:20:34.589 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101986 2024-09-17T02:20:34.589 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.589 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.589 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.590 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:34.590 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:20:34.590 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.013221969, 2024-09-17T02:20:34.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024118555999999999, 2024-09-17T02:20:34.590 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.590 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.591 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:34.591 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:20:34.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:20:34.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562395+0000", 2024-09-17T02:20:34.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3969999999999999e-06 2024-09-17T02:20:34.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562405+0000", 2024-09-17T02:20:34.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4229999999999994e-06 2024-09-17T02:20:34.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562427+0000", 2024-09-17T02:20:34.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759999999999998e-05 2024-09-17T02:20:34.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562444+0000", 2024-09-17T02:20:34.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7019000000000001e-05 2024-09-17T02:20:34.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.594 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564681+0000", 2024-09-17T02:20:34.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022376929999999998 2024-09-17T02:20:34.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.594 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564887+0000", 2024-09-17T02:20:34.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000206178 2024-09-17T02:20:34.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.594 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:34.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565230+0000", 2024-09-17T02:20:34.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034233499999999998 2024-09-17T02:20:34.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:34.595 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567000+0000", 2024-09-17T02:20:34.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017706390000000001 2024-09-17T02:20:34.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:34.595 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586126+0000", 2024-09-17T02:20:34.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019125672 2024-09-17T02:20:34.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:34.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586314+0000", 2024-09-17T02:20:34.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018740200000000001 2024-09-17T02:20:34.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:34.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586513+0000", 2024-09-17T02:20:34.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019903799999999999 2024-09-17T02:20:34.596 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.596 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.596 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.596 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:34.597 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:20:34.597 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.013147296, 2024-09-17T02:20:34.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021940779000000001, 2024-09-17T02:20:34.597 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.597 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.597 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:34.597 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:20:34.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:20:34.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562470+0000", 2024-09-17T02:20:34.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5030000000000001e-06 2024-09-17T02:20:34.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562478+0000", 2024-09-17T02:20:34.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.157e-06 2024-09-17T02:20:34.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562496+0000", 2024-09-17T02:20:34.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7876e-05 2024-09-17T02:20:34.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562511+0000", 2024-09-17T02:20:34.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5067e-05 2024-09-17T02:20:34.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564628+0000", 2024-09-17T02:20:34.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021171860000000001 2024-09-17T02:20:34.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564838+0000", 2024-09-17T02:20:34.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000209283 2024-09-17T02:20:34.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:34.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565078+0000", 2024-09-17T02:20:34.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024075100000000001 2024-09-17T02:20:34.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:34.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567012+0000", 2024-09-17T02:20:34.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019331050000000001 2024-09-17T02:20:34.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:34.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584289+0000", 2024-09-17T02:20:34.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017277464999999999 2024-09-17T02:20:34.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:34.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584363+0000", 2024-09-17T02:20:34.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3852999999999999e-05 2024-09-17T02:20:34.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:34.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584409+0000", 2024-09-17T02:20:34.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6533000000000003e-05 2024-09-17T02:20:34.602 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.602 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.602 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.602 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:34.602 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:20:34.602 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.013083906999999, 2024-09-17T02:20:34.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020580694, 2024-09-17T02:20:34.603 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.603 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.603 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:34.603 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:20:34.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:20:34.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562533+0000", 2024-09-17T02:20:34.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3239999999999999e-06 2024-09-17T02:20:34.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562541+0000", 2024-09-17T02:20:34.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3529999999999997e-06 2024-09-17T02:20:34.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562559+0000", 2024-09-17T02:20:34.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8306000000000001e-05 2024-09-17T02:20:34.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.605 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562572+0000", 2024-09-17T02:20:34.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2993000000000001e-05 2024-09-17T02:20:34.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.605 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563230+0000", 2024-09-17T02:20:34.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00065806899999999995 2024-09-17T02:20:34.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563510+0000", 2024-09-17T02:20:34.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028016400000000001 2024-09-17T02:20:34.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:34.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563677+0000", 2024-09-17T02:20:34.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000166243 2024-09-17T02:20:34.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:34.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566312+0000", 2024-09-17T02:20:34.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026351349999999998 2024-09-17T02:20:34.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:34.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.582943+0000", 2024-09-17T02:20:34.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016631781000000002 2024-09-17T02:20:34.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:34.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583035+0000", 2024-09-17T02:20:34.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1682999999999996e-05 2024-09-17T02:20:34.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:34.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583113+0000", 2024-09-17T02:20:34.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7643000000000002e-05 2024-09-17T02:20:34.608 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.608 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.608 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.608 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:34.608 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:20:34.609 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.012976847000001, 2024-09-17T02:20:34.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020802284000000001, 2024-09-17T02:20:34.609 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.609 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.609 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:34.609 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.609 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:20:34.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:20:34.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562640+0000", 2024-09-17T02:20:34.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.37e-06 2024-09-17T02:20:34.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562648+0000", 2024-09-17T02:20:34.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.576e-06 2024-09-17T02:20:34.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562668+0000", 2024-09-17T02:20:34.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0397000000000001e-05 2024-09-17T02:20:34.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562690+0000", 2024-09-17T02:20:34.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1713e-05 2024-09-17T02:20:34.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564290+0000", 2024-09-17T02:20:34.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001599397 2024-09-17T02:20:34.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564527+0000", 2024-09-17T02:20:34.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023731199999999999 2024-09-17T02:20:34.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:34.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583441+0000", 2024-09-17T02:20:34.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018914519000000001 2024-09-17T02:20:34.613 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.613 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.613 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.613 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:34.613 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:20:34.613 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.012901771999999, 2024-09-17T02:20:34.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021867154, 2024-09-17T02:20:34.613 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.614 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.614 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:34.614 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:20:34.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:20:34.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562716+0000", 2024-09-17T02:20:34.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.384e-06 2024-09-17T02:20:34.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562726+0000", 2024-09-17T02:20:34.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.04e-05 2024-09-17T02:20:34.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562745+0000", 2024-09-17T02:20:34.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8770000000000002e-05 2024-09-17T02:20:34.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562759+0000", 2024-09-17T02:20:34.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4392999999999999e-05 2024-09-17T02:20:34.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565882+0000", 2024-09-17T02:20:34.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031227659999999999 2024-09-17T02:20:34.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566217+0000", 2024-09-17T02:20:34.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033498000000000002 2024-09-17T02:20:34.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:34.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584581+0000", 2024-09-17T02:20:34.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018364460999999999 2024-09-17T02:20:34.617 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.617 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.617 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.618 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:34.618 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562778+0000", 2024-09-17T02:20:34.618 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.012837635, 2024-09-17T02:20:34.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018969949, 2024-09-17T02:20:34.618 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.618 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.618 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:34.618 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562778+0000", 2024-09-17T02:20:34.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562778+0000", 2024-09-17T02:20:34.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562779+0000", 2024-09-17T02:20:34.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0470000000000001e-06 2024-09-17T02:20:34.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562798+0000", 2024-09-17T02:20:34.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8723e-05 2024-09-17T02:20:34.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562819+0000", 2024-09-17T02:20:34.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1192999999999999e-05 2024-09-17T02:20:34.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562834+0000", 2024-09-17T02:20:34.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4619e-05 2024-09-17T02:20:34.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562977+0000", 2024-09-17T02:20:34.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014338900000000001 2024-09-17T02:20:34.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563366+0000", 2024-09-17T02:20:34.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038909399999999999 2024-09-17T02:20:34.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:34.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.581748+0000", 2024-09-17T02:20:34.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018381884000000001 2024-09-17T02:20:34.621 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.621 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.621 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.622 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:242 5.5 5:a0fd8b3d:::benchmark_data_smithi001_23533_object241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:34.622 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:32.864185+0000", 2024-09-17T02:20:34.622 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.7114305679999999, 2024-09-17T02:20:34.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012979684999999999, 2024-09-17T02:20:34.622 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.622 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.622 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:34.622 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:34.622 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:34.622 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:34.622 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 242 2024-09-17T02:20:34.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.623 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:32.864185+0000", 2024-09-17T02:20:34.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:32.864185+0000", 2024-09-17T02:20:34.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:32.864193+0000", 2024-09-17T02:20:34.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4560000000000003e-06 2024-09-17T02:20:34.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:32.864300+0000", 2024-09-17T02:20:34.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106648 2024-09-17T02:20:34.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:32.864331+0000", 2024-09-17T02:20:34.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1486999999999999e-05 2024-09-17T02:20:34.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:32.864340+0000", 2024-09-17T02:20:34.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1779999999999992e-06 2024-09-17T02:20:34.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:32.866694+0000", 2024-09-17T02:20:34.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002353768 2024-09-17T02:20:34.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:32.866919+0000", 2024-09-17T02:20:34.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022478799999999999 2024-09-17T02:20:34.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:34.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:32.867078+0000", 2024-09-17T02:20:34.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015965099999999999 2024-09-17T02:20:34.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:34.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:32.868578+0000", 2024-09-17T02:20:34.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014993179999999999 2024-09-17T02:20:34.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:34.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:32.877012+0000", 2024-09-17T02:20:34.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0084341920000000001 2024-09-17T02:20:34.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:34.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:32.877103+0000", 2024-09-17T02:20:34.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1384999999999993e-05 2024-09-17T02:20:34.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:34.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:32.877165+0000", 2024-09-17T02:20:34.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1814000000000001e-05 2024-09-17T02:20:34.628 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.628 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.628 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.628 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:1227 5.3 5:c07fff60:::benchmark_data_smithi001_23533_object1226:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:34.628 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.165009+0000", 2024-09-17T02:20:34.628 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.410607071, 2024-09-17T02:20:34.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016027434, 2024-09-17T02:20:34.629 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.629 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.629 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:34.629 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:34.629 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:34.629 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:34.629 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1227 2024-09-17T02:20:34.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.629 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165009+0000", 2024-09-17T02:20:34.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165009+0000", 2024-09-17T02:20:34.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165010+0000", 2024-09-17T02:20:34.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9800000000000003e-07 2024-09-17T02:20:34.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165045+0000", 2024-09-17T02:20:34.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5231999999999997e-05 2024-09-17T02:20:34.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165053+0000", 2024-09-17T02:20:34.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9289999999999998e-06 2024-09-17T02:20:34.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165058+0000", 2024-09-17T02:20:34.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6689999999999997e-06 2024-09-17T02:20:34.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165611+0000", 2024-09-17T02:20:34.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00055364200000000002 2024-09-17T02:20:34.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165764+0000", 2024-09-17T02:20:34.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000153132 2024-09-17T02:20:34.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:34.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166112+0000", 2024-09-17T02:20:34.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034738599999999998 2024-09-17T02:20:34.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:34.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168392+0000", 2024-09-17T02:20:34.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022802809999999999 2024-09-17T02:20:34.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:34.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.180931+0000", 2024-09-17T02:20:34.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012538785 2024-09-17T02:20:34.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:34.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.180994+0000", 2024-09-17T02:20:34.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3477000000000002e-05 2024-09-17T02:20:34.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:34.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181036+0000", 2024-09-17T02:20:34.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2103e-05 2024-09-17T02:20:34.635 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.635 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.635 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.635 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:1235 5.2 e24/22 5:45d66796:::benchmark_data_smithi001_23533_object1234:head v 24'85, mlcod=24'82)", 2024-09-17T02:20:34.635 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.166626+0000", 2024-09-17T02:20:34.635 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.408990113, 2024-09-17T02:20:34.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014289484, 2024-09-17T02:20:34.635 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.635 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.635 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:34.635 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166626+0000", 2024-09-17T02:20:34.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166626+0000", 2024-09-17T02:20:34.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166626+0000", 2024-09-17T02:20:34.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5799999999999999e-07 2024-09-17T02:20:34.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166672+0000", 2024-09-17T02:20:34.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5500999999999997e-05 2024-09-17T02:20:34.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166679+0000", 2024-09-17T02:20:34.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.515e-06 2024-09-17T02:20:34.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166684+0000", 2024-09-17T02:20:34.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5619999999999997e-06 2024-09-17T02:20:34.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166723+0000", 2024-09-17T02:20:34.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9410999999999999e-05 2024-09-17T02:20:34.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166741+0000", 2024-09-17T02:20:34.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7731999999999999e-05 2024-09-17T02:20:34.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:34.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168402+0000", 2024-09-17T02:20:34.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001660641 2024-09-17T02:20:34.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:34.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.180915+0000", 2024-09-17T02:20:34.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012513564 2024-09-17T02:20:34.639 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.639 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.639 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.640 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:1236 5.c 5:3ba82733:::benchmark_data_smithi001_23533_object1235:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:34.640 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.167104+0000", 2024-09-17T02:20:34.640 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.4085119989999999, 2024-09-17T02:20:34.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014191949000000001, 2024-09-17T02:20:34.640 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.640 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.640 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:34.640 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:34.640 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:34.640 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:34.640 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1236 2024-09-17T02:20:34.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.641 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167104+0000", 2024-09-17T02:20:34.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167104+0000", 2024-09-17T02:20:34.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167105+0000", 2024-09-17T02:20:34.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7400000000000002e-07 2024-09-17T02:20:34.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167181+0000", 2024-09-17T02:20:34.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6458000000000006e-05 2024-09-17T02:20:34.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167191+0000", 2024-09-17T02:20:34.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3160000000000003e-06 2024-09-17T02:20:34.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167197+0000", 2024-09-17T02:20:34.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9270000000000002e-06 2024-09-17T02:20:34.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167247+0000", 2024-09-17T02:20:34.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0930999999999997e-05 2024-09-17T02:20:34.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167396+0000", 2024-09-17T02:20:34.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014842100000000001 2024-09-17T02:20:34.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:34.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167483+0000", 2024-09-17T02:20:34.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6914000000000002e-05 2024-09-17T02:20:34.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:34.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181143+0000", 2024-09-17T02:20:34.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013660347 2024-09-17T02:20:34.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:34.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181167+0000", 2024-09-17T02:20:34.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3411e-05 2024-09-17T02:20:34.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:34.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181243+0000", 2024-09-17T02:20:34.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.64e-05 2024-09-17T02:20:34.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:34.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181296+0000", 2024-09-17T02:20:34.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.295e-05 2024-09-17T02:20:34.646 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.646 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.646 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.646 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:1238 5.3 5:cb3e0813:::benchmark_data_smithi001_23533_object1237:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:34.646 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.167498+0000", 2024-09-17T02:20:34.646 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.408117939, 2024-09-17T02:20:34.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013696274, 2024-09-17T02:20:34.646 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.646 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.646 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:34.647 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:34.647 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:34.647 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:34.647 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1238 2024-09-17T02:20:34.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.647 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167498+0000", 2024-09-17T02:20:34.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167498+0000", 2024-09-17T02:20:34.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167499+0000", 2024-09-17T02:20:34.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2399999999999997e-07 2024-09-17T02:20:34.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167669+0000", 2024-09-17T02:20:34.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017059700000000001 2024-09-17T02:20:34.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167683+0000", 2024-09-17T02:20:34.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3878e-05 2024-09-17T02:20:34.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167690+0000", 2024-09-17T02:20:34.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1929999999999998e-06 2024-09-17T02:20:34.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167744+0000", 2024-09-17T02:20:34.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4630999999999999e-05 2024-09-17T02:20:34.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167860+0000", 2024-09-17T02:20:34.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011614 2024-09-17T02:20:34.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:34.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167951+0000", 2024-09-17T02:20:34.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0558999999999998e-05 2024-09-17T02:20:34.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:34.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181078+0000", 2024-09-17T02:20:34.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013127369999999999 2024-09-17T02:20:34.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:34.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181097+0000", 2024-09-17T02:20:34.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8715999999999998e-05 2024-09-17T02:20:34.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:34.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181142+0000", 2024-09-17T02:20:34.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5074999999999998e-05 2024-09-17T02:20:34.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:34.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181194+0000", 2024-09-17T02:20:34.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2290999999999998e-05 2024-09-17T02:20:34.652 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.652 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.652 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.652 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:1239 5.4 e24/22 5:27729820:::benchmark_data_smithi001_23533_object1238:head v 24'68, mlcod=24'66)", 2024-09-17T02:20:34.652 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.168195+0000", 2024-09-17T02:20:34.652 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.4074211649999999, 2024-09-17T02:20:34.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013146789000000001, 2024-09-17T02:20:34.653 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.653 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.653 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:34.653 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168195+0000", 2024-09-17T02:20:34.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168195+0000", 2024-09-17T02:20:34.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168195+0000", 2024-09-17T02:20:34.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0500000000000003e-07 2024-09-17T02:20:34.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168290+0000", 2024-09-17T02:20:34.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4256e-05 2024-09-17T02:20:34.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168299+0000", 2024-09-17T02:20:34.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2839999999999995e-06 2024-09-17T02:20:34.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168316+0000", 2024-09-17T02:20:34.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7513e-05 2024-09-17T02:20:34.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168376+0000", 2024-09-17T02:20:34.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9784999999999998e-05 2024-09-17T02:20:34.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168396+0000", 2024-09-17T02:20:34.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9411000000000001e-05 2024-09-17T02:20:34.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:34.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181301+0000", 2024-09-17T02:20:34.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012905029 2024-09-17T02:20:34.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:34.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181342+0000", 2024-09-17T02:20:34.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0905999999999998e-05 2024-09-17T02:20:34.657 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.657 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.657 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.657 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:1241 5.1 e24/22 5:87e2e1ca:::benchmark_data_smithi001_23533_object1240:head v 24'77, mlcod=24'75)", 2024-09-17T02:20:34.657 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.168275+0000", 2024-09-17T02:20:34.657 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.4073409560000001, 2024-09-17T02:20:34.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013467972, 2024-09-17T02:20:34.658 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.658 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.658 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:34.658 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168275+0000", 2024-09-17T02:20:34.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168275+0000", 2024-09-17T02:20:34.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168276+0000", 2024-09-17T02:20:34.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.142e-06 2024-09-17T02:20:34.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168369+0000", 2024-09-17T02:20:34.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2410999999999993e-05 2024-09-17T02:20:34.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168387+0000", 2024-09-17T02:20:34.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8031999999999999e-05 2024-09-17T02:20:34.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168398+0000", 2024-09-17T02:20:34.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.114e-05 2024-09-17T02:20:34.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181020+0000", 2024-09-17T02:20:34.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012622707 2024-09-17T02:20:34.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181039+0000", 2024-09-17T02:20:34.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8702000000000002e-05 2024-09-17T02:20:34.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:34.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181689+0000", 2024-09-17T02:20:34.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00064937100000000004 2024-09-17T02:20:34.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:34.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181743+0000", 2024-09-17T02:20:34.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4466999999999999e-05 2024-09-17T02:20:34.661 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.661 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.662 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.662 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:1245 5.5 5:ad8970a7:::benchmark_data_smithi001_23533_object1244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:34.662 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.168368+0000", 2024-09-17T02:20:34.662 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.4072484080000001, 2024-09-17T02:20:34.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014038418, 2024-09-17T02:20:34.662 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.662 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.662 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:34.662 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:34.662 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:34.662 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:34.663 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1245 2024-09-17T02:20:34.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.663 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168368+0000", 2024-09-17T02:20:34.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168368+0000", 2024-09-17T02:20:34.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168368+0000", 2024-09-17T02:20:34.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8100000000000001e-07 2024-09-17T02:20:34.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168428+0000", 2024-09-17T02:20:34.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9386999999999999e-05 2024-09-17T02:20:34.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168452+0000", 2024-09-17T02:20:34.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4649000000000001e-05 2024-09-17T02:20:34.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168461+0000", 2024-09-17T02:20:34.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0490000000000004e-06 2024-09-17T02:20:34.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168510+0000", 2024-09-17T02:20:34.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9190999999999997e-05 2024-09-17T02:20:34.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168629+0000", 2024-09-17T02:20:34.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011922 2024-09-17T02:20:34.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:34.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168760+0000", 2024-09-17T02:20:34.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131042 2024-09-17T02:20:34.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:34.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181731+0000", 2024-09-17T02:20:34.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012970735000000001 2024-09-17T02:20:34.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:34.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.182320+0000", 2024-09-17T02:20:34.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00058966200000000002 2024-09-17T02:20:34.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:34.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.182370+0000", 2024-09-17T02:20:34.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9709000000000001e-05 2024-09-17T02:20:34.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:34.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.182406+0000", 2024-09-17T02:20:34.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5892999999999997e-05 2024-09-17T02:20:34.667 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.667 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.668 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.668 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:1240 5.2 e24/22 5:43e91071:::benchmark_data_smithi001_23533_object1239:head v 24'86, mlcod=24'83)", 2024-09-17T02:20:34.668 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.168434+0000", 2024-09-17T02:20:34.668 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.407182119, 2024-09-17T02:20:34.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013788056999999999, 2024-09-17T02:20:34.668 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.668 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.668 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:34.668 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168434+0000", 2024-09-17T02:20:34.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168434+0000", 2024-09-17T02:20:34.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168435+0000", 2024-09-17T02:20:34.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4600000000000004e-07 2024-09-17T02:20:34.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168507+0000", 2024-09-17T02:20:34.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2552999999999995e-05 2024-09-17T02:20:34.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168521+0000", 2024-09-17T02:20:34.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3922e-05 2024-09-17T02:20:34.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168533+0000", 2024-09-17T02:20:34.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.184e-05 2024-09-17T02:20:34.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.180963+0000", 2024-09-17T02:20:34.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012430214 2024-09-17T02:20:34.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.180983+0000", 2024-09-17T02:20:34.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9633999999999999e-05 2024-09-17T02:20:34.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:34.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.182178+0000", 2024-09-17T02:20:34.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001195637 2024-09-17T02:20:34.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:34.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.182222+0000", 2024-09-17T02:20:34.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3510999999999997e-05 2024-09-17T02:20:34.672 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.672 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.672 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.672 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:1246 5.6 5:67c897d3:::benchmark_data_smithi001_23533_object1245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:34.672 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.168478+0000", 2024-09-17T02:20:34.673 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.4071382290000001, 2024-09-17T02:20:34.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014731975, 2024-09-17T02:20:34.673 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.673 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.673 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:34.673 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:34.673 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:34.673 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:34.673 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1246 2024-09-17T02:20:34.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.673 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168478+0000", 2024-09-17T02:20:34.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168478+0000", 2024-09-17T02:20:34.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168478+0000", 2024-09-17T02:20:34.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5199999999999996e-07 2024-09-17T02:20:34.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168514+0000", 2024-09-17T02:20:34.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5132999999999997e-05 2024-09-17T02:20:34.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168523+0000", 2024-09-17T02:20:34.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4669999999999993e-06 2024-09-17T02:20:34.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168532+0000", 2024-09-17T02:20:34.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7660000000000004e-06 2024-09-17T02:20:34.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168581+0000", 2024-09-17T02:20:34.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8689000000000001e-05 2024-09-17T02:20:34.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168698+0000", 2024-09-17T02:20:34.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117386 2024-09-17T02:20:34.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:34.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168816+0000", 2024-09-17T02:20:34.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000118118 2024-09-17T02:20:34.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:34.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181677+0000", 2024-09-17T02:20:34.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012861256 2024-09-17T02:20:34.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:34.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.183098+0000", 2024-09-17T02:20:34.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001420745 2024-09-17T02:20:34.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:34.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.183167+0000", 2024-09-17T02:20:34.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8508000000000002e-05 2024-09-17T02:20:34.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:34.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.183210+0000", 2024-09-17T02:20:34.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3155000000000003e-05 2024-09-17T02:20:34.678 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.678 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.678 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.678 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:1244 5.7 e24/22 5:e010310d:::benchmark_data_smithi001_23533_object1243:head v 24'71, mlcod=24'69)", 2024-09-17T02:20:34.678 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.168569+0000", 2024-09-17T02:20:34.678 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.407046778, 2024-09-17T02:20:34.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013661547, 2024-09-17T02:20:34.679 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:34.679 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:34.679 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:34.679 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:34.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:34.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168569+0000", 2024-09-17T02:20:34.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:34.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168569+0000", 2024-09-17T02:20:34.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:34.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:34.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168570+0000", 2024-09-17T02:20:34.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3200000000000004e-07 2024-09-17T02:20:34.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:34.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168607+0000", 2024-09-17T02:20:34.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7489e-05 2024-09-17T02:20:34.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:34.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168615+0000", 2024-09-17T02:20:34.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8939999999999993e-06 2024-09-17T02:20:34.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168623+0000", 2024-09-17T02:20:34.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5719999999999997e-06 2024-09-17T02:20:34.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:34.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181102+0000", 2024-09-17T02:20:34.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012479331 2024-09-17T02:20:34.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:34.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181121+0000", 2024-09-17T02:20:34.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9171e-05 2024-09-17T02:20:34.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:34.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.182203+0000", 2024-09-17T02:20:34.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001081727 2024-09-17T02:20:34.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:34.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:34.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:34.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.182231+0000", 2024-09-17T02:20:34.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7631e-05 2024-09-17T02:20:34.683 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.683 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.683 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.683 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:34.683 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:34.683 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:20:34.684 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:20:34.685 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:34.688+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:34.686 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:20:34.767 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 2 16 7475 7459 233.072 247.125 0.00418069 0.00428303 2024-09-17T02:20:34.786 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:34.786+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:34.851 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:20:34.852 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:20:34.852 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:20:34.853 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-17T02:20:34.853 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:34.853 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:7798 5.7 5:e60c97d9:::benchmark_data_smithi001_23533_object7797:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-17T02:20:34.853 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:34.855352+0000", 2024-09-17T02:20:34.853 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0034490850000000002, 2024-09-17T02:20:34.854 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00347547, 2024-09-17T02:20:34.854 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:34.854 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:34.854 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:34.854 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:34.854 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:34.854 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:34.854 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 7798 2024-09-17T02:20:34.854 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:34.854 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:34.854 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:34.855 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:34.855 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:34.855352+0000", 2024-09-17T02:20:34.855 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:34.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:34.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:34.855 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:34.855 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:34.855352+0000", 2024-09-17T02:20:34.855 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:34.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:34.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:34.855 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:34.855 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:34.855353+0000", 2024-09-17T02:20:34.855 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7899999999999997e-07 2024-09-17T02:20:34.856 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:34.856 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:34.856 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:34.856 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:34.855459+0000", 2024-09-17T02:20:34.856 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000106147 2024-09-17T02:20:34.856 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:34.856 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:34.856 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:34.857 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:34.855468+0000", 2024-09-17T02:20:34.857 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2839999999999995e-06 2024-09-17T02:20:34.857 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:34.857 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:34.857 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.857 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:34.855476+0000", 2024-09-17T02:20:34.857 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3540000000000002e-06 2024-09-17T02:20:34.857 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:34.857 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:34.857 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:34.857 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:34.855552+0000", 2024-09-17T02:20:34.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6744999999999998e-05 2024-09-17T02:20:34.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:34.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:34.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:34.858 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:34.855684+0000", 2024-09-17T02:20:34.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000131867 2024-09-17T02:20:34.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:34.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:34.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:34.858 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:34.855814+0000", 2024-09-17T02:20:34.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012920999999999999 2024-09-17T02:20:34.859 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:34.859 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:34.859 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:34.859 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:34.857040+0000", 2024-09-17T02:20:34.859 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001226628 2024-09-17T02:20:34.859 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:34.859 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:34.859 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:34.859 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:34.859 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:34.859 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:7801 5.1 5:8b801f61:::benchmark_data_smithi001_23533_object7800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-17T02:20:34.859 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:34.857649+0000", 2024-09-17T02:20:34.860 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.00115256, 2024-09-17T02:20:34.860 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0012328759999999999, 2024-09-17T02:20:34.860 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:34.860 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:34.860 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:34.860 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:34.860 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:34.860 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:34.860 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 7801 2024-09-17T02:20:34.860 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:34.860 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:34.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:34.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:34.861 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:34.857649+0000", 2024-09-17T02:20:34.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:34.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:34.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:34.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:34.861 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:34.857649+0000", 2024-09-17T02:20:34.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:34.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:34.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:34.862 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:34.862 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:34.857649+0000", 2024-09-17T02:20:34.862 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2900000000000002e-07 2024-09-17T02:20:34.862 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:34.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:34.862 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:34.862 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:34.857729+0000", 2024-09-17T02:20:34.862 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9736999999999999e-05 2024-09-17T02:20:34.862 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:34.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:34.862 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:34.862 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:34.857740+0000", 2024-09-17T02:20:34.863 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0569e-05 2024-09-17T02:20:34.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:34.863 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:34.863 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:34.863 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:34.857746+0000", 2024-09-17T02:20:34.863 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.6699999999999997e-06 2024-09-17T02:20:34.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:34.863 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:34.863 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:34.863 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:34.857806+0000", 2024-09-17T02:20:34.863 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9286000000000001e-05 2024-09-17T02:20:34.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:34.863 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:34.863 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:34.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:34.857931+0000", 2024-09-17T02:20:34.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000125134 2024-09-17T02:20:34.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:34.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:34.864 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:34.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:34.858087+0000", 2024-09-17T02:20:34.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015641599999999999 2024-09-17T02:20:34.864 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:34.864 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:34.864 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:34.864 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:34.864 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-09-17T02:20:34.864 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 2 2024-09-17T02:20:34.865 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:20:34.870 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:20:34.870 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:20:34.875 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:20:34.886 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:34.892+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:34.887 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:20:34.887 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:20:34.986 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:34.992+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:35.045 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:35.045 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:35.068 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:20:35.089 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:35.092+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:35.190 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:35.192+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:35.225 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:35.225 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:35.245 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:20:35.291 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:35.294+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:35.335 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-17T02:20:35.335 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T02:20:35.335 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-17T02:20:35.335 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 0.377426 2024-09-17T02:20:35.336 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 0.3774263879261257 2024-09-17T02:20:35.392 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:35.394+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:35.403 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:35.403 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:35.423 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:20:35.492 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:35.496+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:35.594 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:35.594 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:35.594 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:35.596+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:35.618 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:20:35.695 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:35.700+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:35.701 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T02:20:35.766 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 3 16 10968 10952 228.145 218.312 0.00531216 0.00437714 2024-09-17T02:20:35.775 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:35.775 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:35.796 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:35.798+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:35.797 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:20:35.896 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:35.900+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:35.961 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:35.961 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:35.984 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:20:36.026 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:36.032+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:36.098 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:36.098+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:36.189 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:36.189 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:36.199 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:36.204+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:36.215 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:20:36.299 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:36.304+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:36.374 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:36.374 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:36.396 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:20:36.400 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:36.404+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:36.502 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:36.504+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:36.554 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:36.554 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:36.572 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:20:36.603 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:36.608+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:36.683 INFO:teuthology.orchestra.run.smithi001.stderr:noscrub is unset 2024-09-17T02:20:36.690 INFO:teuthology.orchestra.run.smithi001.stderr:set osd.0 primary-affinity to 0.377426 (8247352) 2024-09-17T02:20:36.704 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:36.705+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:36.721 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:36.722 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:36.737 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:20:36.767 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 4 16 13890 13874 216.758 182.625 0.00281364 0.00453606 2024-09-17T02:20:36.805 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:36.808+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:36.895 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:36.895 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:36.906 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:36.908+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:36.906 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:20:36.910 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:20:37.006 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:37.012+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:37.044 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:37.044 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:37.059 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:20:37.068 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:20:37.068 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:20:37.090 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:20:37.090 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:20:37.107 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:37.112+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:37.110 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:20:37.110 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:20:37.189 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:20:37.189 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:20:37.189 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:20:37.189 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:20:37.189 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:20:37.200 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:20:37.208 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:37.213+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:37.309 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:37.312+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:37.323 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:20:37.323 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:20:37.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:20:37.324 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:20:37.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.324 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:37.324 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:20:37.324 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.771161433, 2024-09-17T02:20:37.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035535028000000003, 2024-09-17T02:20:37.324 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:37.324 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:37.324 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:37.324 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:37.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:37.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:20:37.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:37.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:20:37.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:37.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556550+0000", 2024-09-17T02:20:37.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3500000000000001e-06 2024-09-17T02:20:37.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:37.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556566+0000", 2024-09-17T02:20:37.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5440000000000001e-05 2024-09-17T02:20:37.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:37.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556594+0000", 2024-09-17T02:20:37.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8552999999999999e-05 2024-09-17T02:20:37.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:37.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556618+0000", 2024-09-17T02:20:37.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3207e-05 2024-09-17T02:20:37.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:37.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578337+0000", 2024-09-17T02:20:37.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021719517000000001 2024-09-17T02:20:37.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:37.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578655+0000", 2024-09-17T02:20:37.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031837800000000002 2024-09-17T02:20:37.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:37.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.581374+0000", 2024-09-17T02:20:37.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002718238 2024-09-17T02:20:37.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:37.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587083+0000", 2024-09-17T02:20:37.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005708912 2024-09-17T02:20:37.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:37.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591823+0000", 2024-09-17T02:20:37.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047406080000000003 2024-09-17T02:20:37.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:37.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591972+0000", 2024-09-17T02:20:37.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014874199999999999 2024-09-17T02:20:37.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:37.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592082+0000", 2024-09-17T02:20:37.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110083 2024-09-17T02:20:37.329 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.329 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:37.329 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.330 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:37.330 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:20:37.330 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.770219946000001, 2024-09-17T02:20:37.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035128756999999997, 2024-09-17T02:20:37.330 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:37.330 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:37.330 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:37.330 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:37.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:37.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:20:37.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:37.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:20:37.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:37.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557491+0000", 2024-09-17T02:20:37.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.88e-06 2024-09-17T02:20:37.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:37.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557504+0000", 2024-09-17T02:20:37.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2864000000000001e-05 2024-09-17T02:20:37.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:37.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557535+0000", 2024-09-17T02:20:37.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0916e-05 2024-09-17T02:20:37.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:37.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557561+0000", 2024-09-17T02:20:37.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5602999999999999e-05 2024-09-17T02:20:37.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:37.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582290+0000", 2024-09-17T02:20:37.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024729729999999998 2024-09-17T02:20:37.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:37.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582642+0000", 2024-09-17T02:20:37.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035143499999999999 2024-09-17T02:20:37.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:37.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582959+0000", 2024-09-17T02:20:37.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031747399999999999 2024-09-17T02:20:37.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:37.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587302+0000", 2024-09-17T02:20:37.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043425169999999997 2024-09-17T02:20:37.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:37.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592391+0000", 2024-09-17T02:20:37.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050895799999999998 2024-09-17T02:20:37.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:37.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592516+0000", 2024-09-17T02:20:37.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012420500000000001 2024-09-17T02:20:37.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:37.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592617+0000", 2024-09-17T02:20:37.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010155299999999999 2024-09-17T02:20:37.335 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.335 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:37.335 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.335 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:37.336 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:20:37.336 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.770115446999998, 2024-09-17T02:20:37.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034796066, 2024-09-17T02:20:37.336 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:37.336 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:37.336 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:37.336 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:37.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:37.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:20:37.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:37.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:20:37.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:37.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557594+0000", 2024-09-17T02:20:37.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3769999999999999e-06 2024-09-17T02:20:37.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:37.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557683+0000", 2024-09-17T02:20:37.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8896999999999999e-05 2024-09-17T02:20:37.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:37.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557707+0000", 2024-09-17T02:20:37.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3839e-05 2024-09-17T02:20:37.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:37.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557730+0000", 2024-09-17T02:20:37.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3047000000000001e-05 2024-09-17T02:20:37.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:37.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582329+0000", 2024-09-17T02:20:37.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024599283999999999 2024-09-17T02:20:37.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:37.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582624+0000", 2024-09-17T02:20:37.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000294462 2024-09-17T02:20:37.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:37.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582936+0000", 2024-09-17T02:20:37.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031223399999999999 2024-09-17T02:20:37.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:37.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587347+0000", 2024-09-17T02:20:37.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044110340000000003 2024-09-17T02:20:37.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:37.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592165+0000", 2024-09-17T02:20:37.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048176699999999996 2024-09-17T02:20:37.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:37.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592311+0000", 2024-09-17T02:20:37.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014661899999999999 2024-09-17T02:20:37.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:37.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592389+0000", 2024-09-17T02:20:37.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7602999999999995e-05 2024-09-17T02:20:37.345 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.345 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:37.345 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.345 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:37.345 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:20:37.345 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.769597820000001, 2024-09-17T02:20:37.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034457472000000003, 2024-09-17T02:20:37.346 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:37.346 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:37.346 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:37.346 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:37.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:37.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:20:37.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:37.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:20:37.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:37.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558113+0000", 2024-09-17T02:20:37.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1639999999999999e-06 2024-09-17T02:20:37.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:37.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558125+0000", 2024-09-17T02:20:37.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2269999999999999e-05 2024-09-17T02:20:37.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:37.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558458+0000", 2024-09-17T02:20:37.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033322700000000001 2024-09-17T02:20:37.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:37.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558488+0000", 2024-09-17T02:20:37.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.951e-05 2024-09-17T02:20:37.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:37.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584514+0000", 2024-09-17T02:20:37.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026025721000000002 2024-09-17T02:20:37.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:37.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584781+0000", 2024-09-17T02:20:37.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000267142 2024-09-17T02:20:37.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:37.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585078+0000", 2024-09-17T02:20:37.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029738799999999999 2024-09-17T02:20:37.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:37.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588045+0000", 2024-09-17T02:20:37.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029673759999999999 2024-09-17T02:20:37.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:37.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592454+0000", 2024-09-17T02:20:37.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044090209999999999 2024-09-17T02:20:37.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:37.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592520+0000", 2024-09-17T02:20:37.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6032999999999996e-05 2024-09-17T02:20:37.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:37.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592568+0000", 2024-09-17T02:20:37.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7620000000000001e-05 2024-09-17T02:20:37.351 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.351 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:37.351 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.351 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:37.351 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:20:37.351 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.769137569000002, 2024-09-17T02:20:37.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031603266999999997, 2024-09-17T02:20:37.351 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:37.351 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:37.351 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:37.352 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:37.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:37.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:20:37.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:37.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:20:37.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:37.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558573+0000", 2024-09-17T02:20:37.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0660000000000002e-06 2024-09-17T02:20:37.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:37.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558585+0000", 2024-09-17T02:20:37.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1596999999999999e-05 2024-09-17T02:20:37.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:37.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558612+0000", 2024-09-17T02:20:37.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7115999999999999e-05 2024-09-17T02:20:37.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:37.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558631+0000", 2024-09-17T02:20:37.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9519999999999999e-05 2024-09-17T02:20:37.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:37.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558783+0000", 2024-09-17T02:20:37.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152025 2024-09-17T02:20:37.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-17T02:20:37.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558798+0000", 2024-09-17T02:20:37.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4966999999999999e-05 2024-09-17T02:20:37.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:37.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.572871+0000", 2024-09-17T02:20:37.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014072782000000001 2024-09-17T02:20:37.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:37.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573153+0000", 2024-09-17T02:20:37.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028214499999999998 2024-09-17T02:20:37.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:37.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573432+0000", 2024-09-17T02:20:37.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027932100000000002 2024-09-17T02:20:37.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:37.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582279+0000", 2024-09-17T02:20:37.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0088463310000000007 2024-09-17T02:20:37.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:37.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.589902+0000", 2024-09-17T02:20:37.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0076236050000000003 2024-09-17T02:20:37.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:37.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.589997+0000", 2024-09-17T02:20:37.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4456000000000005e-05 2024-09-17T02:20:37.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:37.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590174+0000", 2024-09-17T02:20:37.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000177336 2024-09-17T02:20:37.357 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.357 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:37.357 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.357 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:37.357 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:20:37.357 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.769034324, 2024-09-17T02:20:37.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031899064999999997, 2024-09-17T02:20:37.358 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:37.358 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:37.358 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:37.358 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:37.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:37.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:20:37.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:37.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:20:37.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:37.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558676+0000", 2024-09-17T02:20:37.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.39e-06 2024-09-17T02:20:37.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:37.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558686+0000", 2024-09-17T02:20:37.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.022e-05 2024-09-17T02:20:37.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:37.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558708+0000", 2024-09-17T02:20:37.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2249999999999999e-05 2024-09-17T02:20:37.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:37.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558725+0000", 2024-09-17T02:20:37.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7387000000000001e-05 2024-09-17T02:20:37.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:37.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558940+0000", 2024-09-17T02:20:37.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021453800000000001 2024-09-17T02:20:37.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting_for_map not empty", 2024-09-17T02:20:37.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558951+0000", 2024-09-17T02:20:37.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1303e-05 2024-09-17T02:20:37.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:37.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576237+0000", 2024-09-17T02:20:37.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017285723999999999 2024-09-17T02:20:37.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:37.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576454+0000", 2024-09-17T02:20:37.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021673800000000001 2024-09-17T02:20:37.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:37.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576932+0000", 2024-09-17T02:20:37.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047792700000000001 2024-09-17T02:20:37.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:37.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585689+0000", 2024-09-17T02:20:37.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0087572880000000002 2024-09-17T02:20:37.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:37.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590287+0000", 2024-09-17T02:20:37.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045978060000000003 2024-09-17T02:20:37.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:37.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590447+0000", 2024-09-17T02:20:37.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000160719 2024-09-17T02:20:37.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:37.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590573+0000", 2024-09-17T02:20:37.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012577500000000001 2024-09-17T02:20:37.363 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.363 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:37.363 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.364 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:37.364 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:20:37.364 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.768956354, 2024-09-17T02:20:37.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034114029999999997, 2024-09-17T02:20:37.364 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:37.364 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:37.364 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:37.364 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:37.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:37.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:20:37.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:37.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:20:37.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:37.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558753+0000", 2024-09-17T02:20:37.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2699999999999999e-06 2024-09-17T02:20:37.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:37.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558769+0000", 2024-09-17T02:20:37.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5906e-05 2024-09-17T02:20:37.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:37.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558791+0000", 2024-09-17T02:20:37.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1342999999999999e-05 2024-09-17T02:20:37.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:37.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558806+0000", 2024-09-17T02:20:37.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5829999999999999e-05 2024-09-17T02:20:37.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:37.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584906+0000", 2024-09-17T02:20:37.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026099273999999999 2024-09-17T02:20:37.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:37.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585158+0000", 2024-09-17T02:20:37.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025194600000000002 2024-09-17T02:20:37.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:37.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585368+0000", 2024-09-17T02:20:37.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210068 2024-09-17T02:20:37.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:37.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588098+0000", 2024-09-17T02:20:37.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002730522 2024-09-17T02:20:37.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:37.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592680+0000", 2024-09-17T02:20:37.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045816019999999997 2024-09-17T02:20:37.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:37.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592774+0000", 2024-09-17T02:20:37.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3726000000000004e-05 2024-09-17T02:20:37.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:37.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592866+0000", 2024-09-17T02:20:37.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2542999999999998e-05 2024-09-17T02:20:37.369 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.369 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:37.369 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.369 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:37.369 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:20:37.369 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.768880051, 2024-09-17T02:20:37.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031407875000000002, 2024-09-17T02:20:37.370 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:37.370 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:37.370 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:37.370 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:37.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:37.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:20:37.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:37.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:20:37.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:37.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558830+0000", 2024-09-17T02:20:37.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3599999999999999e-06 2024-09-17T02:20:37.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:37.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558835+0000", 2024-09-17T02:20:37.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6130000000000003e-06 2024-09-17T02:20:37.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:37.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558853+0000", 2024-09-17T02:20:37.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8099999999999999e-05 2024-09-17T02:20:37.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:37.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558869+0000", 2024-09-17T02:20:37.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.59e-05 2024-09-17T02:20:37.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:37.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560437+0000", 2024-09-17T02:20:37.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015677989999999999 2024-09-17T02:20:37.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-17T02:20:37.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560453+0000", 2024-09-17T02:20:37.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.535e-05 2024-09-17T02:20:37.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:37.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562422+0000", 2024-09-17T02:20:37.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00196934 2024-09-17T02:20:37.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:37.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562773+0000", 2024-09-17T02:20:37.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035152399999999998 2024-09-17T02:20:37.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:37.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590236+0000", 2024-09-17T02:20:37.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.027462889000000001 2024-09-17T02:20:37.374 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.374 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:37.375 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.375 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:6 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'1, mlcod=0'0)", 2024-09-17T02:20:37.375 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.559725+0000", 2024-09-17T02:20:37.375 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.767983053999998, 2024-09-17T02:20:37.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015153534999999999, 2024-09-17T02:20:37.375 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:37.375 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:37.375 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:37.375 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:37.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:37.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559725+0000", 2024-09-17T02:20:37.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:37.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559725+0000", 2024-09-17T02:20:37.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:37.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559726+0000", 2024-09-17T02:20:37.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1699999999999997e-07 2024-09-17T02:20:37.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:37.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559736+0000", 2024-09-17T02:20:37.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8360000000000004e-06 2024-09-17T02:20:37.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:37.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559760+0000", 2024-09-17T02:20:37.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4130000000000001e-05 2024-09-17T02:20:37.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:37.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559778+0000", 2024-09-17T02:20:37.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7623000000000001e-05 2024-09-17T02:20:37.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:37.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.561459+0000", 2024-09-17T02:20:37.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001681552 2024-09-17T02:20:37.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:37.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.561506+0000", 2024-09-17T02:20:37.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6260000000000001e-05 2024-09-17T02:20:37.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:37.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.574779+0000", 2024-09-17T02:20:37.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013273691000000001 2024-09-17T02:20:37.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:37.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.574879+0000", 2024-09-17T02:20:37.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9625999999999998e-05 2024-09-17T02:20:37.379 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.379 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:37.379 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.379 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:37.379 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.560079+0000", 2024-09-17T02:20:37.379 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.767629555999999, 2024-09-17T02:20:37.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016073831, 2024-09-17T02:20:37.380 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:37.380 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:37.380 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:37.380 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:37.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:37.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560079+0000", 2024-09-17T02:20:37.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:37.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560079+0000", 2024-09-17T02:20:37.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:37.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560081+0000", 2024-09-17T02:20:37.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.266e-06 2024-09-17T02:20:37.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:37.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560090+0000", 2024-09-17T02:20:37.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2129999999999997e-06 2024-09-17T02:20:37.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:37.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560119+0000", 2024-09-17T02:20:37.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8932999999999999e-05 2024-09-17T02:20:37.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:37.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560145+0000", 2024-09-17T02:20:37.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6020000000000002e-05 2024-09-17T02:20:37.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:37.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.561833+0000", 2024-09-17T02:20:37.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016875659999999999 2024-09-17T02:20:37.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:37.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562199+0000", 2024-09-17T02:20:37.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036619000000000002 2024-09-17T02:20:37.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:37.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576153+0000", 2024-09-17T02:20:37.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013953643 2024-09-17T02:20:37.383 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.383 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:37.383 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.383 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:18 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'1, mlcod=0'0)", 2024-09-17T02:20:37.384 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.567765+0000", 2024-09-17T02:20:37.384 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.759943491000001, 2024-09-17T02:20:37.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014868306, 2024-09-17T02:20:37.384 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:37.384 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:37.384 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:37.384 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:37.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:37.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.567765+0000", 2024-09-17T02:20:37.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:37.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.567765+0000", 2024-09-17T02:20:37.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:37.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.567766+0000", 2024-09-17T02:20:37.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.13e-06 2024-09-17T02:20:37.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:37.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.567811+0000", 2024-09-17T02:20:37.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5361999999999997e-05 2024-09-17T02:20:37.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:37.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.567867+0000", 2024-09-17T02:20:37.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5083000000000001e-05 2024-09-17T02:20:37.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:37.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.567885+0000", 2024-09-17T02:20:37.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8827000000000001e-05 2024-09-17T02:20:37.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:37.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570145+0000", 2024-09-17T02:20:37.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002259708 2024-09-17T02:20:37.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:37.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570187+0000", 2024-09-17T02:20:37.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2410000000000002e-05 2024-09-17T02:20:37.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:37.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582543+0000", 2024-09-17T02:20:37.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012356015999999999 2024-09-17T02:20:37.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:37.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582633+0000", 2024-09-17T02:20:37.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9770000000000003e-05 2024-09-17T02:20:37.388 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.388 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:37.388 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.388 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing(3.1e epoch 19/17 rep_tid 1 entries 19'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T02:20:37.388 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.568434+0000", 2024-09-17T02:20:37.388 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.759274043000001, 2024-09-17T02:20:37.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013193651000000001, 2024-09-17T02:20:37.388 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:37.388 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:37.388 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-17T02:20:37.388 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:37.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:37.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568434+0000", 2024-09-17T02:20:37.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:37.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568434+0000", 2024-09-17T02:20:37.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:37.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568436+0000", 2024-09-17T02:20:37.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.857e-06 2024-09-17T02:20:37.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:37.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568455+0000", 2024-09-17T02:20:37.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9076000000000002e-05 2024-09-17T02:20:37.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:37.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568501+0000", 2024-09-17T02:20:37.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5309999999999998e-05 2024-09-17T02:20:37.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:37.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568545+0000", 2024-09-17T02:20:37.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4773e-05 2024-09-17T02:20:37.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:37.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570794+0000", 2024-09-17T02:20:37.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022483450000000001 2024-09-17T02:20:37.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:37.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.581628+0000", 2024-09-17T02:20:37.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01083429 2024-09-17T02:20:37.391 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.391 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:37.392 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.392 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:24 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'1, mlcod=0'0)", 2024-09-17T02:20:37.392 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.568621+0000", 2024-09-17T02:20:37.392 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.759087453999999, 2024-09-17T02:20:37.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015593332, 2024-09-17T02:20:37.392 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:37.392 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:37.392 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:37.392 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:37.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:37.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568621+0000", 2024-09-17T02:20:37.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:37.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568621+0000", 2024-09-17T02:20:37.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:37.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568622+0000", 2024-09-17T02:20:37.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1570000000000001e-06 2024-09-17T02:20:37.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:37.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568633+0000", 2024-09-17T02:20:37.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1093e-05 2024-09-17T02:20:37.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:37.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568654+0000", 2024-09-17T02:20:37.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1132999999999999e-05 2024-09-17T02:20:37.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:37.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568670+0000", 2024-09-17T02:20:37.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5307000000000001e-05 2024-09-17T02:20:37.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:37.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570935+0000", 2024-09-17T02:20:37.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022651609999999999 2024-09-17T02:20:37.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:37.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570980+0000", 2024-09-17T02:20:37.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5170000000000003e-05 2024-09-17T02:20:37.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:37.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584128+0000", 2024-09-17T02:20:37.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013148388 2024-09-17T02:20:37.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:37.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584214+0000", 2024-09-17T02:20:37.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5922999999999997e-05 2024-09-17T02:20:37.396 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.396 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:37.396 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.397 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:25 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'2, mlcod=0'0)", 2024-09-17T02:20:37.397 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.568721+0000", 2024-09-17T02:20:37.397 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.758987538, 2024-09-17T02:20:37.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015657030999999998, 2024-09-17T02:20:37.397 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:37.397 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:37.397 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:37.397 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:37.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:37.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568721+0000", 2024-09-17T02:20:37.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:37.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568721+0000", 2024-09-17T02:20:37.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:37.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568722+0000", 2024-09-17T02:20:37.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5600000000000004e-07 2024-09-17T02:20:37.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:37.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568742+0000", 2024-09-17T02:20:37.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0506999999999999e-05 2024-09-17T02:20:37.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:37.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568762+0000", 2024-09-17T02:20:37.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9423e-05 2024-09-17T02:20:37.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:37.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568777+0000", 2024-09-17T02:20:37.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5457000000000001e-05 2024-09-17T02:20:37.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:37.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.571705+0000", 2024-09-17T02:20:37.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029280130000000001 2024-09-17T02:20:37.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:37.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.571787+0000", 2024-09-17T02:20:37.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1509999999999997e-05 2024-09-17T02:20:37.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:37.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584296+0000", 2024-09-17T02:20:37.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012509398999999999 2024-09-17T02:20:37.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:37.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584378+0000", 2024-09-17T02:20:37.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1866000000000005e-05 2024-09-17T02:20:37.401 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.401 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:37.402 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.402 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:7 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'2, mlcod=0'0)", 2024-09-17T02:20:37.402 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.569013+0000", 2024-09-17T02:20:37.402 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.758695617000001, 2024-09-17T02:20:37.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015831576999999999, 2024-09-17T02:20:37.402 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:37.402 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:37.402 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:37.402 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:37.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:37.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569013+0000", 2024-09-17T02:20:37.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:37.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569013+0000", 2024-09-17T02:20:37.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:37.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569014+0000", 2024-09-17T02:20:37.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6000000000000002e-07 2024-09-17T02:20:37.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:37.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569024+0000", 2024-09-17T02:20:37.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8369999999999992e-06 2024-09-17T02:20:37.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:37.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570016+0000", 2024-09-17T02:20:37.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00099277000000000002 2024-09-17T02:20:37.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:37.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570040+0000", 2024-09-17T02:20:37.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3790000000000001e-05 2024-09-17T02:20:37.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:37.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570154+0000", 2024-09-17T02:20:37.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113689 2024-09-17T02:20:37.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:37.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570208+0000", 2024-09-17T02:20:37.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4305999999999998e-05 2024-09-17T02:20:37.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:37.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.583286+0000", 2024-09-17T02:20:37.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013077945000000001 2024-09-17T02:20:37.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:37.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584844+0000", 2024-09-17T02:20:37.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015583800000000001 2024-09-17T02:20:37.406 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.406 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:37.406 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.406 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:2 3.f e19/17 3:f1f69726:::400.00000000:head v 19'1, mlcod=0'0)", 2024-09-17T02:20:37.406 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.570080+0000", 2024-09-17T02:20:37.406 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.757628487000002, 2024-09-17T02:20:37.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014452469000000001, 2024-09-17T02:20:37.407 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:37.407 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:37.407 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:37.407 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:37.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:37.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570080+0000", 2024-09-17T02:20:37.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:37.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570080+0000", 2024-09-17T02:20:37.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:37.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570081+0000", 2024-09-17T02:20:37.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.333e-06 2024-09-17T02:20:37.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:37.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570142+0000", 2024-09-17T02:20:37.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0919999999999999e-05 2024-09-17T02:20:37.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:37.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570167+0000", 2024-09-17T02:20:37.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4576e-05 2024-09-17T02:20:37.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:37.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570180+0000", 2024-09-17T02:20:37.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3444e-05 2024-09-17T02:20:37.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:37.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573011+0000", 2024-09-17T02:20:37.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028309170000000001 2024-09-17T02:20:37.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:37.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573052+0000", 2024-09-17T02:20:37.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1285999999999997e-05 2024-09-17T02:20:37.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:37.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584432+0000", 2024-09-17T02:20:37.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011379837 2024-09-17T02:20:37.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:37.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584532+0000", 2024-09-17T02:20:37.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010015599999999999 2024-09-17T02:20:37.411 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.411 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:37.411 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.411 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:31 3.d e19/17 3:b50e409b:::mds_snaptable:head v 19'1, mlcod=0'0)", 2024-09-17T02:20:37.411 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.571951+0000", 2024-09-17T02:20:37.411 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.755757320000001, 2024-09-17T02:20:37.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014392149999999999, 2024-09-17T02:20:37.411 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:37.411 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:37.411 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:37.411 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:37.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:37.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.571951+0000", 2024-09-17T02:20:37.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:37.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.571951+0000", 2024-09-17T02:20:37.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:37.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.571952+0000", 2024-09-17T02:20:37.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3239999999999999e-06 2024-09-17T02:20:37.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:37.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.571967+0000", 2024-09-17T02:20:37.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4686e-05 2024-09-17T02:20:37.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:37.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.574038+0000", 2024-09-17T02:20:37.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020704260000000002 2024-09-17T02:20:37.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:37.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.574057+0000", 2024-09-17T02:20:37.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9893000000000001e-05 2024-09-17T02:20:37.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:37.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576689+0000", 2024-09-17T02:20:37.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026314429999999998 2024-09-17T02:20:37.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:37.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576767+0000", 2024-09-17T02:20:37.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7708999999999997e-05 2024-09-17T02:20:37.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:37.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.586260+0000", 2024-09-17T02:20:37.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0094934990000000007 2024-09-17T02:20:37.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:37.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.586343+0000", 2024-09-17T02:20:37.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3170000000000005e-05 2024-09-17T02:20:37.415 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.415 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:37.415 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.416 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:1239 5.4 5:27729820:::benchmark_data_smithi001_23533_object1238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:37.416 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:33.168880+0000", 2024-09-17T02:20:37.416 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.1588287890000002, 2024-09-17T02:20:37.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014295324, 2024-09-17T02:20:37.416 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:37.416 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:37.416 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:37.416 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:37.416 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:37.416 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:37.416 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1239 2024-09-17T02:20:37.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.416 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:37.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:37.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.168880+0000", 2024-09-17T02:20:37.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:37.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.168880+0000", 2024-09-17T02:20:37.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:37.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.168881+0000", 2024-09-17T02:20:37.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1069999999999999e-06 2024-09-17T02:20:37.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:37.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.168965+0000", 2024-09-17T02:20:37.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3968000000000007e-05 2024-09-17T02:20:37.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:37.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.168977+0000", 2024-09-17T02:20:37.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.224e-05 2024-09-17T02:20:37.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:37.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.168985+0000", 2024-09-17T02:20:37.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8080000000000005e-06 2024-09-17T02:20:37.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:37.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.169063+0000", 2024-09-17T02:20:37.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7778e-05 2024-09-17T02:20:37.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:37.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.169196+0000", 2024-09-17T02:20:37.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013365799999999999 2024-09-17T02:20:37.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:37.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.169408+0000", 2024-09-17T02:20:37.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021206900000000001 2024-09-17T02:20:37.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:37.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170122+0000", 2024-09-17T02:20:37.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000714199 2024-09-17T02:20:37.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:37.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.182998+0000", 2024-09-17T02:20:37.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012875177 2024-09-17T02:20:37.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:37.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.183116+0000", 2024-09-17T02:20:37.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011828900000000001 2024-09-17T02:20:37.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:37.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.183175+0000", 2024-09-17T02:20:37.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9030999999999998e-05 2024-09-17T02:20:37.421 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.421 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:37.421 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.422 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:1247 5.e 5:771d49ed:::benchmark_data_smithi001_23533_object1246:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:37.422 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:33.170545+0000", 2024-09-17T02:20:37.422 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.157163562, 2024-09-17T02:20:37.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014510571999999999, 2024-09-17T02:20:37.422 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:37.422 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:37.422 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:37.422 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:37.422 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:37.422 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:37.422 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1247 2024-09-17T02:20:37.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.422 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:37.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:37.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170545+0000", 2024-09-17T02:20:37.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:37.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170545+0000", 2024-09-17T02:20:37.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:37.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170546+0000", 2024-09-17T02:20:37.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.037e-06 2024-09-17T02:20:37.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:37.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170606+0000", 2024-09-17T02:20:37.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9914000000000003e-05 2024-09-17T02:20:37.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:37.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170621+0000", 2024-09-17T02:20:37.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5011000000000001e-05 2024-09-17T02:20:37.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:37.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170628+0000", 2024-09-17T02:20:37.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3989999999999998e-06 2024-09-17T02:20:37.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:37.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170703+0000", 2024-09-17T02:20:37.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5082999999999999e-05 2024-09-17T02:20:37.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:37.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170860+0000", 2024-09-17T02:20:37.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015699600000000001 2024-09-17T02:20:37.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:37.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170991+0000", 2024-09-17T02:20:37.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013087900000000001 2024-09-17T02:20:37.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:37.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.172129+0000", 2024-09-17T02:20:37.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001137826 2024-09-17T02:20:37.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:37.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.184962+0000", 2024-09-17T02:20:37.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012832582 2024-09-17T02:20:37.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:37.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.185000+0000", 2024-09-17T02:20:37.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8444e-05 2024-09-17T02:20:37.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:37.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.185055+0000", 2024-09-17T02:20:37.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5401e-05 2024-09-17T02:20:37.428 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.428 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:37.428 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.428 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:1248 5.e 5:7f482265:::benchmark_data_smithi001_23533_object1247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:37.428 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:33.170647+0000", 2024-09-17T02:20:37.428 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.1570611350000002, 2024-09-17T02:20:37.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015727534000000001, 2024-09-17T02:20:37.428 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:37.428 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:37.428 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:37.429 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:37.429 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:37.429 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:37.429 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1248 2024-09-17T02:20:37.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.429 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:37.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:37.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170647+0000", 2024-09-17T02:20:37.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:37.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170647+0000", 2024-09-17T02:20:37.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:37.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:37.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170648+0000", 2024-09-17T02:20:37.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4000000000000002e-07 2024-09-17T02:20:37.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:37.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170691+0000", 2024-09-17T02:20:37.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2722000000000002e-05 2024-09-17T02:20:37.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:37.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170699+0000", 2024-09-17T02:20:37.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1540000000000002e-06 2024-09-17T02:20:37.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:37.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170704+0000", 2024-09-17T02:20:37.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1290000000000004e-06 2024-09-17T02:20:37.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:37.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.171489+0000", 2024-09-17T02:20:37.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00078564599999999998 2024-09-17T02:20:37.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:37.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.171653+0000", 2024-09-17T02:20:37.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163027 2024-09-17T02:20:37.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:37.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.171797+0000", 2024-09-17T02:20:37.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000144828 2024-09-17T02:20:37.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:37.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.172344+0000", 2024-09-17T02:20:37.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054687599999999996 2024-09-17T02:20:37.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:37.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.186281+0000", 2024-09-17T02:20:37.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013936755 2024-09-17T02:20:37.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:37.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.186338+0000", 2024-09-17T02:20:37.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6598000000000003e-05 2024-09-17T02:20:37.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:37.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:37.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:37.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.186375+0000", 2024-09-17T02:20:37.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7258999999999997e-05 2024-09-17T02:20:37.434 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.434 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:37.434 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.434 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:37.434 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:37.434 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:20:37.435 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:20:37.436 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:37.437+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:37.537 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:37.540+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:37.568 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:20:37.568 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:20:37.568 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-17T02:20:37.568 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:20:37.582 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:20:37.666 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:37.672+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:37.738 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:37.744+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:37.767 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 5 16 14010 13994 174.906 7.5 0.00797892 0.00571169 2024-09-17T02:20:37.768 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:20:37.768 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:20:37.768 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:20:37.768 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:20:37.768 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:20:37.788 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:20:37.839 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:37.844+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:37.940 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:37.944+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:37.993 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:20:37.994 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:20:37.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:20:37.994 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:20:37.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:37.994 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:37.994 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:20:37.994 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.435727456999999, 2024-09-17T02:20:37.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021799929999999999, 2024-09-17T02:20:37.995 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:37.995 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:37.995 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:37.995 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:37.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:37.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:37.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:20:37.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:37.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:37.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:37.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:37.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:20:37.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:37.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:37.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:37.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:37.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562007+0000", 2024-09-17T02:20:37.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6260000000000001e-06 2024-09-17T02:20:37.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:37.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:37.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:37.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562021+0000", 2024-09-17T02:20:37.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4440000000000001e-05 2024-09-17T02:20:37.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:37.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:37.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:37.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562053+0000", 2024-09-17T02:20:37.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2159000000000002e-05 2024-09-17T02:20:37.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:37.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:37.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:37.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562076+0000", 2024-09-17T02:20:37.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2926999999999999e-05 2024-09-17T02:20:37.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:37.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:37.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:37.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562218+0000", 2024-09-17T02:20:37.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000141726 2024-09-17T02:20:37.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:37.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:37.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:37.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562506+0000", 2024-09-17T02:20:37.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028752399999999999 2024-09-17T02:20:37.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:37.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:37.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:37.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562830+0000", 2024-09-17T02:20:37.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032427399999999999 2024-09-17T02:20:37.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:37.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:37.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:37.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566900+0000", 2024-09-17T02:20:37.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040705660000000003 2024-09-17T02:20:37.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:37.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583581+0000", 2024-09-17T02:20:38.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016680210000000001 2024-09-17T02:20:38.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:38.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583704+0000", 2024-09-17T02:20:38.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012289899999999999 2024-09-17T02:20:38.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583803+0000", 2024-09-17T02:20:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9579000000000003e-05 2024-09-17T02:20:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:20:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.435600245, 2024-09-17T02:20:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022056035000000002, 2024-09-17T02:20:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:38.002 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:38.002 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.002 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:38.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:38.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:20:38.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:38.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:20:38.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:38.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562132+0000", 2024-09-17T02:20:38.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6300000000000001e-06 2024-09-17T02:20:38.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:38.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562142+0000", 2024-09-17T02:20:38.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.022e-05 2024-09-17T02:20:38.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:38.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562164+0000", 2024-09-17T02:20:38.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2002999999999999e-05 2024-09-17T02:20:38.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562180+0000", 2024-09-17T02:20:38.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5930000000000002e-05 2024-09-17T02:20:38.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:38.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563517+0000", 2024-09-17T02:20:38.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001336776 2024-09-17T02:20:38.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:38.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563635+0000", 2024-09-17T02:20:38.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117976 2024-09-17T02:20:38.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:38.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563819+0000", 2024-09-17T02:20:38.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018411499999999999 2024-09-17T02:20:38.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:38.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566977+0000", 2024-09-17T02:20:38.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031575990000000001 2024-09-17T02:20:38.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583917+0000", 2024-09-17T02:20:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016940093999999999 2024-09-17T02:20:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584066+0000", 2024-09-17T02:20:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000149746 2024-09-17T02:20:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584186+0000", 2024-09-17T02:20:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011994600000000001 2024-09-17T02:20:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.007 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:38.007 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.007 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:38.007 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:20:38.007 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.435419534000001, 2024-09-17T02:20:38.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023664803000000002, 2024-09-17T02:20:38.007 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:38.007 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:38.007 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.007 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:38.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:38.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:20:38.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:38.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:20:38.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:38.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562313+0000", 2024-09-17T02:20:38.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.764e-06 2024-09-17T02:20:38.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:38.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562323+0000", 2024-09-17T02:20:38.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0166000000000001e-05 2024-09-17T02:20:38.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:38.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562343+0000", 2024-09-17T02:20:38.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9633999999999999e-05 2024-09-17T02:20:38.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562367+0000", 2024-09-17T02:20:38.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4556e-05 2024-09-17T02:20:38.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:38.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563777+0000", 2024-09-17T02:20:38.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014102330000000001 2024-09-17T02:20:38.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:38.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563969+0000", 2024-09-17T02:20:38.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000191361 2024-09-17T02:20:38.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564148+0000", 2024-09-17T02:20:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017934599999999999 2024-09-17T02:20:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566989+0000", 2024-09-17T02:20:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028407010000000002 2024-09-17T02:20:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585770+0000", 2024-09-17T02:20:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018781566999999999 2024-09-17T02:20:38.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:38.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585874+0000", 2024-09-17T02:20:38.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103489 2024-09-17T02:20:38.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:38.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585976+0000", 2024-09-17T02:20:38.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101986 2024-09-17T02:20:38.012 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.012 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:38.012 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.013 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:38.013 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:20:38.013 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.435336654, 2024-09-17T02:20:38.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024118555999999999, 2024-09-17T02:20:38.013 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:38.013 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:38.013 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.013 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:38.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:38.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:20:38.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:20:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562395+0000", 2024-09-17T02:20:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3969999999999999e-06 2024-09-17T02:20:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562405+0000", 2024-09-17T02:20:38.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4229999999999994e-06 2024-09-17T02:20:38.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:38.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562427+0000", 2024-09-17T02:20:38.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759999999999998e-05 2024-09-17T02:20:38.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562444+0000", 2024-09-17T02:20:38.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7019000000000001e-05 2024-09-17T02:20:38.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:38.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564681+0000", 2024-09-17T02:20:38.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022376929999999998 2024-09-17T02:20:38.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:38.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564887+0000", 2024-09-17T02:20:38.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000206178 2024-09-17T02:20:38.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:38.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565230+0000", 2024-09-17T02:20:38.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034233499999999998 2024-09-17T02:20:38.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567000+0000", 2024-09-17T02:20:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017706390000000001 2024-09-17T02:20:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586126+0000", 2024-09-17T02:20:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019125672 2024-09-17T02:20:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586314+0000", 2024-09-17T02:20:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018740200000000001 2024-09-17T02:20:38.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:38.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586513+0000", 2024-09-17T02:20:38.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019903799999999999 2024-09-17T02:20:38.019 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.019 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:38.019 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.019 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:38.019 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:20:38.019 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.435261981, 2024-09-17T02:20:38.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021940779000000001, 2024-09-17T02:20:38.019 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:38.019 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:38.019 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.020 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:38.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:38.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:20:38.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:38.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:20:38.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:38.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562470+0000", 2024-09-17T02:20:38.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5030000000000001e-06 2024-09-17T02:20:38.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:38.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562478+0000", 2024-09-17T02:20:38.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.157e-06 2024-09-17T02:20:38.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:38.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562496+0000", 2024-09-17T02:20:38.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7876e-05 2024-09-17T02:20:38.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562511+0000", 2024-09-17T02:20:38.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5067e-05 2024-09-17T02:20:38.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:38.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564628+0000", 2024-09-17T02:20:38.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021171860000000001 2024-09-17T02:20:38.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:38.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564838+0000", 2024-09-17T02:20:38.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000209283 2024-09-17T02:20:38.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:38.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565078+0000", 2024-09-17T02:20:38.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024075100000000001 2024-09-17T02:20:38.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:38.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567012+0000", 2024-09-17T02:20:38.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019331050000000001 2024-09-17T02:20:38.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584289+0000", 2024-09-17T02:20:38.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017277464999999999 2024-09-17T02:20:38.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:38.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584363+0000", 2024-09-17T02:20:38.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3852999999999999e-05 2024-09-17T02:20:38.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:38.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584409+0000", 2024-09-17T02:20:38.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6533000000000003e-05 2024-09-17T02:20:38.024 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.025 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:38.025 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.025 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:38.025 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:20:38.025 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.435198591999999, 2024-09-17T02:20:38.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020580694, 2024-09-17T02:20:38.025 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:38.025 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:38.025 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.025 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:38.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:38.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:20:38.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:38.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:20:38.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:38.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562533+0000", 2024-09-17T02:20:38.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3239999999999999e-06 2024-09-17T02:20:38.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:38.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562541+0000", 2024-09-17T02:20:38.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3529999999999997e-06 2024-09-17T02:20:38.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:38.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562559+0000", 2024-09-17T02:20:38.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8306000000000001e-05 2024-09-17T02:20:38.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562572+0000", 2024-09-17T02:20:38.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2993000000000001e-05 2024-09-17T02:20:38.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:38.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563230+0000", 2024-09-17T02:20:38.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00065806899999999995 2024-09-17T02:20:38.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:38.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563510+0000", 2024-09-17T02:20:38.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028016400000000001 2024-09-17T02:20:38.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:38.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563677+0000", 2024-09-17T02:20:38.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000166243 2024-09-17T02:20:38.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:38.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566312+0000", 2024-09-17T02:20:38.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026351349999999998 2024-09-17T02:20:38.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.582943+0000", 2024-09-17T02:20:38.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016631781000000002 2024-09-17T02:20:38.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:38.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583035+0000", 2024-09-17T02:20:38.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1682999999999996e-05 2024-09-17T02:20:38.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:38.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583113+0000", 2024-09-17T02:20:38.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7643000000000002e-05 2024-09-17T02:20:38.030 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.031 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:38.031 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.031 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:38.031 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:20:38.031 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.435091532000001, 2024-09-17T02:20:38.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020802284000000001, 2024-09-17T02:20:38.031 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:38.031 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:38.031 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:38.031 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:38.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:38.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:20:38.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:38.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:20:38.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:38.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562640+0000", 2024-09-17T02:20:38.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.37e-06 2024-09-17T02:20:38.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:38.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562648+0000", 2024-09-17T02:20:38.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.576e-06 2024-09-17T02:20:38.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:38.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562668+0000", 2024-09-17T02:20:38.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0397000000000001e-05 2024-09-17T02:20:38.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562690+0000", 2024-09-17T02:20:38.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1713e-05 2024-09-17T02:20:38.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:38.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564290+0000", 2024-09-17T02:20:38.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001599397 2024-09-17T02:20:38.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:38.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564527+0000", 2024-09-17T02:20:38.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023731199999999999 2024-09-17T02:20:38.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583441+0000", 2024-09-17T02:20:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018914519000000001 2024-09-17T02:20:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:20:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.435016457, 2024-09-17T02:20:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021867154, 2024-09-17T02:20:38.036 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:38.036 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:38.036 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:38.036 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:38.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:38.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:20:38.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:38.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:20:38.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:38.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562716+0000", 2024-09-17T02:20:38.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.384e-06 2024-09-17T02:20:38.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:38.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562726+0000", 2024-09-17T02:20:38.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.04e-05 2024-09-17T02:20:38.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:38.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562745+0000", 2024-09-17T02:20:38.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8770000000000002e-05 2024-09-17T02:20:38.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562759+0000", 2024-09-17T02:20:38.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4392999999999999e-05 2024-09-17T02:20:38.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:38.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565882+0000", 2024-09-17T02:20:38.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031227659999999999 2024-09-17T02:20:38.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:38.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566217+0000", 2024-09-17T02:20:38.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033498000000000002 2024-09-17T02:20:38.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:38.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584581+0000", 2024-09-17T02:20:38.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018364460999999999 2024-09-17T02:20:38.039 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.039 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:38.039 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.040 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:38.040 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562778+0000", 2024-09-17T02:20:38.040 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.434952320000001, 2024-09-17T02:20:38.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018969949, 2024-09-17T02:20:38.040 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:38.040 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:38.040 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:38.040 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:38.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:38.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562778+0000", 2024-09-17T02:20:38.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:38.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562778+0000", 2024-09-17T02:20:38.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:38.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562779+0000", 2024-09-17T02:20:38.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0470000000000001e-06 2024-09-17T02:20:38.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:38.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562798+0000", 2024-09-17T02:20:38.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8723e-05 2024-09-17T02:20:38.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:38.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562819+0000", 2024-09-17T02:20:38.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1192999999999999e-05 2024-09-17T02:20:38.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562834+0000", 2024-09-17T02:20:38.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4619e-05 2024-09-17T02:20:38.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:38.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562977+0000", 2024-09-17T02:20:38.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014338900000000001 2024-09-17T02:20:38.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:38.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563366+0000", 2024-09-17T02:20:38.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038909399999999999 2024-09-17T02:20:38.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:38.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.581748+0000", 2024-09-17T02:20:38.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018381884000000001 2024-09-17T02:20:38.044 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.044 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:38.044 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.044 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:242 5.5 5:a0fd8b3d:::benchmark_data_smithi001_23533_object241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:38.044 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:32.864185+0000", 2024-09-17T02:20:38.044 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.1335452530000003, 2024-09-17T02:20:38.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012979684999999999, 2024-09-17T02:20:38.044 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:38.044 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:38.044 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.045 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:38.045 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:38.045 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:38.045 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 242 2024-09-17T02:20:38.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.045 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:38.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:38.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:32.864185+0000", 2024-09-17T02:20:38.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:32.864185+0000", 2024-09-17T02:20:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:32.864193+0000", 2024-09-17T02:20:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4560000000000003e-06 2024-09-17T02:20:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:32.864300+0000", 2024-09-17T02:20:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106648 2024-09-17T02:20:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:32.864331+0000", 2024-09-17T02:20:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1486999999999999e-05 2024-09-17T02:20:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:32.864340+0000", 2024-09-17T02:20:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1779999999999992e-06 2024-09-17T02:20:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:32.866694+0000", 2024-09-17T02:20:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002353768 2024-09-17T02:20:38.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:38.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:32.866919+0000", 2024-09-17T02:20:38.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022478799999999999 2024-09-17T02:20:38.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:38.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:32.867078+0000", 2024-09-17T02:20:38.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015965099999999999 2024-09-17T02:20:38.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:38.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:32.868578+0000", 2024-09-17T02:20:38.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014993179999999999 2024-09-17T02:20:38.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:32.877012+0000", 2024-09-17T02:20:38.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0084341920000000001 2024-09-17T02:20:38.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:38.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:32.877103+0000", 2024-09-17T02:20:38.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1384999999999993e-05 2024-09-17T02:20:38.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:38.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:32.877165+0000", 2024-09-17T02:20:38.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1814000000000001e-05 2024-09-17T02:20:38.050 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.050 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:38.050 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.050 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:1227 5.3 5:c07fff60:::benchmark_data_smithi001_23533_object1226:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:38.050 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.165009+0000", 2024-09-17T02:20:38.050 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.8327217559999998, 2024-09-17T02:20:38.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016027434, 2024-09-17T02:20:38.051 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:38.051 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:38.051 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.051 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:38.051 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:38.051 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:38.051 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1227 2024-09-17T02:20:38.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.051 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:38.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:38.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165009+0000", 2024-09-17T02:20:38.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:38.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165009+0000", 2024-09-17T02:20:38.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:38.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165010+0000", 2024-09-17T02:20:38.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9800000000000003e-07 2024-09-17T02:20:38.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:38.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165045+0000", 2024-09-17T02:20:38.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5231999999999997e-05 2024-09-17T02:20:38.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:38.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165053+0000", 2024-09-17T02:20:38.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9289999999999998e-06 2024-09-17T02:20:38.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165058+0000", 2024-09-17T02:20:38.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6689999999999997e-06 2024-09-17T02:20:38.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:38.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165611+0000", 2024-09-17T02:20:38.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00055364200000000002 2024-09-17T02:20:38.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:38.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165764+0000", 2024-09-17T02:20:38.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000153132 2024-09-17T02:20:38.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:38.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166112+0000", 2024-09-17T02:20:38.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034738599999999998 2024-09-17T02:20:38.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:38.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168392+0000", 2024-09-17T02:20:38.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022802809999999999 2024-09-17T02:20:38.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.180931+0000", 2024-09-17T02:20:38.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012538785 2024-09-17T02:20:38.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:38.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.180994+0000", 2024-09-17T02:20:38.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3477000000000002e-05 2024-09-17T02:20:38.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:38.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181036+0000", 2024-09-17T02:20:38.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2103e-05 2024-09-17T02:20:38.056 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.056 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:38.056 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.057 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:1235 5.2 e24/22 5:45d66796:::benchmark_data_smithi001_23533_object1234:head v 24'85, mlcod=24'82)", 2024-09-17T02:20:38.057 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.166626+0000", 2024-09-17T02:20:38.057 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.8311047980000001, 2024-09-17T02:20:38.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014289484, 2024-09-17T02:20:38.057 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:38.057 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:38.057 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.057 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:38.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:38.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166626+0000", 2024-09-17T02:20:38.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:38.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166626+0000", 2024-09-17T02:20:38.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:38.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166626+0000", 2024-09-17T02:20:38.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5799999999999999e-07 2024-09-17T02:20:38.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:38.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166672+0000", 2024-09-17T02:20:38.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5500999999999997e-05 2024-09-17T02:20:38.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:38.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166679+0000", 2024-09-17T02:20:38.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.515e-06 2024-09-17T02:20:38.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166684+0000", 2024-09-17T02:20:38.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5619999999999997e-06 2024-09-17T02:20:38.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:38.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166723+0000", 2024-09-17T02:20:38.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9410999999999999e-05 2024-09-17T02:20:38.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:38.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166741+0000", 2024-09-17T02:20:38.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7731999999999999e-05 2024-09-17T02:20:38.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:38.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168402+0000", 2024-09-17T02:20:38.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001660641 2024-09-17T02:20:38.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:38.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.180915+0000", 2024-09-17T02:20:38.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012513564 2024-09-17T02:20:38.061 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.061 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:38.061 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.061 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:1236 5.c 5:3ba82733:::benchmark_data_smithi001_23533_object1235:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:38.062 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.167104+0000", 2024-09-17T02:20:38.062 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.8306266840000003, 2024-09-17T02:20:38.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014191949000000001, 2024-09-17T02:20:38.062 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:38.062 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:38.062 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.062 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:38.062 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:38.062 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:38.062 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1236 2024-09-17T02:20:38.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.062 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:38.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:38.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167104+0000", 2024-09-17T02:20:38.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:38.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167104+0000", 2024-09-17T02:20:38.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:38.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167105+0000", 2024-09-17T02:20:38.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7400000000000002e-07 2024-09-17T02:20:38.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:38.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167181+0000", 2024-09-17T02:20:38.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6458000000000006e-05 2024-09-17T02:20:38.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:38.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167191+0000", 2024-09-17T02:20:38.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3160000000000003e-06 2024-09-17T02:20:38.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167197+0000", 2024-09-17T02:20:38.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9270000000000002e-06 2024-09-17T02:20:38.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:38.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167247+0000", 2024-09-17T02:20:38.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0930999999999997e-05 2024-09-17T02:20:38.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:38.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167396+0000", 2024-09-17T02:20:38.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014842100000000001 2024-09-17T02:20:38.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:38.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167483+0000", 2024-09-17T02:20:38.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6914000000000002e-05 2024-09-17T02:20:38.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181143+0000", 2024-09-17T02:20:38.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013660347 2024-09-17T02:20:38.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:38.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181167+0000", 2024-09-17T02:20:38.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3411e-05 2024-09-17T02:20:38.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:38.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181243+0000", 2024-09-17T02:20:38.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.64e-05 2024-09-17T02:20:38.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:38.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181296+0000", 2024-09-17T02:20:38.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.295e-05 2024-09-17T02:20:38.067 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.067 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:38.067 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.068 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:1238 5.3 5:cb3e0813:::benchmark_data_smithi001_23533_object1237:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:38.068 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.167498+0000", 2024-09-17T02:20:38.068 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.8302326239999998, 2024-09-17T02:20:38.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013696274, 2024-09-17T02:20:38.068 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:38.068 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:38.068 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.068 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:38.068 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:38.068 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:38.068 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1238 2024-09-17T02:20:38.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.069 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:38.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:38.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167498+0000", 2024-09-17T02:20:38.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:38.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167498+0000", 2024-09-17T02:20:38.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:38.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167499+0000", 2024-09-17T02:20:38.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2399999999999997e-07 2024-09-17T02:20:38.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:38.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167669+0000", 2024-09-17T02:20:38.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017059700000000001 2024-09-17T02:20:38.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:38.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167683+0000", 2024-09-17T02:20:38.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3878e-05 2024-09-17T02:20:38.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167690+0000", 2024-09-17T02:20:38.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1929999999999998e-06 2024-09-17T02:20:38.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:38.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167744+0000", 2024-09-17T02:20:38.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4630999999999999e-05 2024-09-17T02:20:38.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:38.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167860+0000", 2024-09-17T02:20:38.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011614 2024-09-17T02:20:38.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:38.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167951+0000", 2024-09-17T02:20:38.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0558999999999998e-05 2024-09-17T02:20:38.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181078+0000", 2024-09-17T02:20:38.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013127369999999999 2024-09-17T02:20:38.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:38.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181097+0000", 2024-09-17T02:20:38.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8715999999999998e-05 2024-09-17T02:20:38.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:38.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181142+0000", 2024-09-17T02:20:38.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5074999999999998e-05 2024-09-17T02:20:38.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:38.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181194+0000", 2024-09-17T02:20:38.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2290999999999998e-05 2024-09-17T02:20:38.074 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.074 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:38.074 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.074 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:1239 5.4 e24/22 5:27729820:::benchmark_data_smithi001_23533_object1238:head v 24'68, mlcod=24'66)", 2024-09-17T02:20:38.074 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.168195+0000", 2024-09-17T02:20:38.074 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.8295358500000001, 2024-09-17T02:20:38.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013146789000000001, 2024-09-17T02:20:38.074 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:38.074 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:38.074 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.074 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:38.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:38.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168195+0000", 2024-09-17T02:20:38.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:38.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168195+0000", 2024-09-17T02:20:38.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:38.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168195+0000", 2024-09-17T02:20:38.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0500000000000003e-07 2024-09-17T02:20:38.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:38.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168290+0000", 2024-09-17T02:20:38.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4256e-05 2024-09-17T02:20:38.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:38.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168299+0000", 2024-09-17T02:20:38.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2839999999999995e-06 2024-09-17T02:20:38.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168316+0000", 2024-09-17T02:20:38.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7513e-05 2024-09-17T02:20:38.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:38.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168376+0000", 2024-09-17T02:20:38.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9784999999999998e-05 2024-09-17T02:20:38.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:38.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168396+0000", 2024-09-17T02:20:38.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9411000000000001e-05 2024-09-17T02:20:38.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:38.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181301+0000", 2024-09-17T02:20:38.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012905029 2024-09-17T02:20:38.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:38.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181342+0000", 2024-09-17T02:20:38.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0905999999999998e-05 2024-09-17T02:20:38.078 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.078 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:38.078 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.079 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:1241 5.1 e24/22 5:87e2e1ca:::benchmark_data_smithi001_23533_object1240:head v 24'77, mlcod=24'75)", 2024-09-17T02:20:38.079 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.168275+0000", 2024-09-17T02:20:38.079 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.829455641, 2024-09-17T02:20:38.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013467972, 2024-09-17T02:20:38.079 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:38.079 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:38.079 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.079 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:38.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:38.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168275+0000", 2024-09-17T02:20:38.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:38.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168275+0000", 2024-09-17T02:20:38.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:38.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168276+0000", 2024-09-17T02:20:38.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.142e-06 2024-09-17T02:20:38.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:38.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168369+0000", 2024-09-17T02:20:38.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2410999999999993e-05 2024-09-17T02:20:38.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:38.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168387+0000", 2024-09-17T02:20:38.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8031999999999999e-05 2024-09-17T02:20:38.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168398+0000", 2024-09-17T02:20:38.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.114e-05 2024-09-17T02:20:38.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:38.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181020+0000", 2024-09-17T02:20:38.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012622707 2024-09-17T02:20:38.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:38.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181039+0000", 2024-09-17T02:20:38.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8702000000000002e-05 2024-09-17T02:20:38.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:38.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181689+0000", 2024-09-17T02:20:38.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00064937100000000004 2024-09-17T02:20:38.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:38.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181743+0000", 2024-09-17T02:20:38.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4466999999999999e-05 2024-09-17T02:20:38.083 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.083 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:38.083 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.083 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:1245 5.5 5:ad8970a7:::benchmark_data_smithi001_23533_object1244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:38.083 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.168368+0000", 2024-09-17T02:20:38.084 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.8293630929999996, 2024-09-17T02:20:38.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014038418, 2024-09-17T02:20:38.084 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:38.084 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:38.084 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.084 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:38.084 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:38.084 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:38.084 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1245 2024-09-17T02:20:38.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.084 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:38.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:38.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168368+0000", 2024-09-17T02:20:38.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:38.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168368+0000", 2024-09-17T02:20:38.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:38.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168368+0000", 2024-09-17T02:20:38.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8100000000000001e-07 2024-09-17T02:20:38.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:38.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168428+0000", 2024-09-17T02:20:38.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9386999999999999e-05 2024-09-17T02:20:38.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:38.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168452+0000", 2024-09-17T02:20:38.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4649000000000001e-05 2024-09-17T02:20:38.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168461+0000", 2024-09-17T02:20:38.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0490000000000004e-06 2024-09-17T02:20:38.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:38.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168510+0000", 2024-09-17T02:20:38.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9190999999999997e-05 2024-09-17T02:20:38.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:38.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168629+0000", 2024-09-17T02:20:38.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011922 2024-09-17T02:20:38.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:38.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168760+0000", 2024-09-17T02:20:38.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131042 2024-09-17T02:20:38.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:38.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181731+0000", 2024-09-17T02:20:38.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012970735000000001 2024-09-17T02:20:38.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.182320+0000", 2024-09-17T02:20:38.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00058966200000000002 2024-09-17T02:20:38.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:38.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.182370+0000", 2024-09-17T02:20:38.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9709000000000001e-05 2024-09-17T02:20:38.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:38.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.182406+0000", 2024-09-17T02:20:38.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5892999999999997e-05 2024-09-17T02:20:38.090 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.090 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:38.090 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.090 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:1240 5.2 e24/22 5:43e91071:::benchmark_data_smithi001_23533_object1239:head v 24'86, mlcod=24'83)", 2024-09-17T02:20:38.090 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.168434+0000", 2024-09-17T02:20:38.090 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.8292968040000002, 2024-09-17T02:20:38.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013788056999999999, 2024-09-17T02:20:38.090 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:38.090 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:38.090 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.091 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:38.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:38.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168434+0000", 2024-09-17T02:20:38.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:38.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168434+0000", 2024-09-17T02:20:38.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:38.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168435+0000", 2024-09-17T02:20:38.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4600000000000004e-07 2024-09-17T02:20:38.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:38.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168507+0000", 2024-09-17T02:20:38.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2552999999999995e-05 2024-09-17T02:20:38.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:38.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168521+0000", 2024-09-17T02:20:38.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3922e-05 2024-09-17T02:20:38.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168533+0000", 2024-09-17T02:20:38.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.184e-05 2024-09-17T02:20:38.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:38.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.180963+0000", 2024-09-17T02:20:38.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012430214 2024-09-17T02:20:38.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:38.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.180983+0000", 2024-09-17T02:20:38.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9633999999999999e-05 2024-09-17T02:20:38.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:38.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.182178+0000", 2024-09-17T02:20:38.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001195637 2024-09-17T02:20:38.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:38.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.182222+0000", 2024-09-17T02:20:38.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3510999999999997e-05 2024-09-17T02:20:38.094 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.095 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:38.095 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.095 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:1246 5.6 5:67c897d3:::benchmark_data_smithi001_23533_object1245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:38.095 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.168478+0000", 2024-09-17T02:20:38.095 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.8292529139999996, 2024-09-17T02:20:38.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014731975, 2024-09-17T02:20:38.095 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:38.095 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:38.095 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.095 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:38.095 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:38.096 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:38.096 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1246 2024-09-17T02:20:38.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.096 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:38.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:38.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168478+0000", 2024-09-17T02:20:38.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:38.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168478+0000", 2024-09-17T02:20:38.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:38.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168478+0000", 2024-09-17T02:20:38.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5199999999999996e-07 2024-09-17T02:20:38.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:38.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168514+0000", 2024-09-17T02:20:38.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5132999999999997e-05 2024-09-17T02:20:38.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:38.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168523+0000", 2024-09-17T02:20:38.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4669999999999993e-06 2024-09-17T02:20:38.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168532+0000", 2024-09-17T02:20:38.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7660000000000004e-06 2024-09-17T02:20:38.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:38.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168581+0000", 2024-09-17T02:20:38.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8689000000000001e-05 2024-09-17T02:20:38.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:38.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168698+0000", 2024-09-17T02:20:38.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117386 2024-09-17T02:20:38.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:38.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168816+0000", 2024-09-17T02:20:38.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000118118 2024-09-17T02:20:38.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:38.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181677+0000", 2024-09-17T02:20:38.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012861256 2024-09-17T02:20:38.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.183098+0000", 2024-09-17T02:20:38.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001420745 2024-09-17T02:20:38.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:38.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.183167+0000", 2024-09-17T02:20:38.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8508000000000002e-05 2024-09-17T02:20:38.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:38.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.183210+0000", 2024-09-17T02:20:38.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3155000000000003e-05 2024-09-17T02:20:38.101 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.101 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:38.101 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.101 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:1244 5.7 e24/22 5:e010310d:::benchmark_data_smithi001_23533_object1243:head v 24'71, mlcod=24'69)", 2024-09-17T02:20:38.101 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.168569+0000", 2024-09-17T02:20:38.101 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.8291614630000002, 2024-09-17T02:20:38.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013661547, 2024-09-17T02:20:38.101 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:38.101 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:38.102 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.102 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:38.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:38.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168569+0000", 2024-09-17T02:20:38.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:38.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168569+0000", 2024-09-17T02:20:38.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:38.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:38.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168570+0000", 2024-09-17T02:20:38.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3200000000000004e-07 2024-09-17T02:20:38.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:38.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168607+0000", 2024-09-17T02:20:38.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7489e-05 2024-09-17T02:20:38.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:38.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168615+0000", 2024-09-17T02:20:38.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8939999999999993e-06 2024-09-17T02:20:38.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168623+0000", 2024-09-17T02:20:38.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5719999999999997e-06 2024-09-17T02:20:38.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:38.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181102+0000", 2024-09-17T02:20:38.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012479331 2024-09-17T02:20:38.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:38.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181121+0000", 2024-09-17T02:20:38.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9171e-05 2024-09-17T02:20:38.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:38.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.182203+0000", 2024-09-17T02:20:38.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001081727 2024-09-17T02:20:38.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:38.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:38.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:38.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.182231+0000", 2024-09-17T02:20:38.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7631e-05 2024-09-17T02:20:38.105 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.105 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:38.105 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.106 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:38.106 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:38.106 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:20:38.107 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:20:38.108 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:38.112+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:38.208 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:38.212+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:38.268 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:20:38.268 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-17T02:20:38.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.268 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:15549 5.5 e27/22 5:aa8b00d8:::benchmark_data_smithi001_23533_object15548:head v 27'970, mlcod=27'968)", 2024-09-17T02:20:38.268 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:38.269641+0000", 2024-09-17T02:20:38.268 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0033951710000000002, 2024-09-17T02:20:38.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0034180249999999999, 2024-09-17T02:20:38.269 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.269 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.269 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:20:38.269 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269641+0000", 2024-09-17T02:20:38.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269641+0000", 2024-09-17T02:20:38.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269641+0000", 2024-09-17T02:20:38.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0699999999999996e-07 2024-09-17T02:20:38.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269704+0000", 2024-09-17T02:20:38.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2961999999999998e-05 2024-09-17T02:20:38.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269715+0000", 2024-09-17T02:20:38.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0774000000000001e-05 2024-09-17T02:20:38.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269722+0000", 2024-09-17T02:20:38.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.058e-06 2024-09-17T02:20:38.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269760+0000", 2024-09-17T02:20:38.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7518000000000002e-05 2024-09-17T02:20:38.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269771+0000", 2024-09-17T02:20:38.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1583000000000001e-05 2024-09-17T02:20:38.272 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.272 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.272 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.272 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:15550 5.3 e27/22 5:c5797f12:::benchmark_data_smithi001_23533_object15549:head v 27'1010, mlcod=27'1008)", 2024-09-17T02:20:38.272 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:38.269751+0000", 2024-09-17T02:20:38.272 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0032846110000000002, 2024-09-17T02:20:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00337747, 2024-09-17T02:20:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:20:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269751+0000", 2024-09-17T02:20:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.273 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269751+0000", 2024-09-17T02:20:38.274 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.274 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.274 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.274 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269752+0000", 2024-09-17T02:20:38.274 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1600000000000002e-07 2024-09-17T02:20:38.274 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.274 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269782+0000", 2024-09-17T02:20:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0508e-05 2024-09-17T02:20:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269799+0000", 2024-09-17T02:20:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6786000000000002e-05 2024-09-17T02:20:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269806+0000", 2024-09-17T02:20:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.6610000000000003e-06 2024-09-17T02:20:38.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269855+0000", 2024-09-17T02:20:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8995000000000001e-05 2024-09-17T02:20:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269871+0000", 2024-09-17T02:20:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6011999999999998e-05 2024-09-17T02:20:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.277 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:15557 5.6 e27/22 5:6a2be26b:::benchmark_data_smithi001_23533_object15556:head v 27'976, mlcod=27'974)", 2024-09-17T02:20:38.277 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:38.269823+0000", 2024-09-17T02:20:38.277 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0032129849999999998, 2024-09-17T02:20:38.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033634699999999999, 2024-09-17T02:20:38.277 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.277 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.277 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:20:38.277 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269823+0000", 2024-09-17T02:20:38.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269823+0000", 2024-09-17T02:20:38.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269823+0000", 2024-09-17T02:20:38.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3799999999999998e-07 2024-09-17T02:20:38.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.279 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269859+0000", 2024-09-17T02:20:38.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5221e-05 2024-09-17T02:20:38.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.279 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.279 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269869+0000", 2024-09-17T02:20:38.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0399e-05 2024-09-17T02:20:38.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.279 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.279 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269874+0000", 2024-09-17T02:20:38.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0440000000000003e-06 2024-09-17T02:20:38.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.280 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269922+0000", 2024-09-17T02:20:38.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7969000000000001e-05 2024-09-17T02:20:38.280 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.280 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269943+0000", 2024-09-17T02:20:38.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1083000000000001e-05 2024-09-17T02:20:38.280 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.280 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.280 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.281 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:15556 5.c e27/22 5:33ef189a:::benchmark_data_smithi001_23533_object15555:head v 27'976, mlcod=27'973)", 2024-09-17T02:20:38.281 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:38.269886+0000", 2024-09-17T02:20:38.281 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0031502380000000001, 2024-09-17T02:20:38.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033552, 2024-09-17T02:20:38.281 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.281 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.281 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:20:38.281 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.281 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.281 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269886+0000", 2024-09-17T02:20:38.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269886+0000", 2024-09-17T02:20:38.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269886+0000", 2024-09-17T02:20:38.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1199999999999999e-07 2024-09-17T02:20:38.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269925+0000", 2024-09-17T02:20:38.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9175999999999999e-05 2024-09-17T02:20:38.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269930+0000", 2024-09-17T02:20:38.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7169999999999999e-06 2024-09-17T02:20:38.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269934+0000", 2024-09-17T02:20:38.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3930000000000001e-06 2024-09-17T02:20:38.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269980+0000", 2024-09-17T02:20:38.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5281999999999998e-05 2024-09-17T02:20:38.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269998+0000", 2024-09-17T02:20:38.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8661999999999999e-05 2024-09-17T02:20:38.284 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.284 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.285 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.285 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:15558 5.c e27/22 5:3e4a0594:::benchmark_data_smithi001_23533_object15557:head v 27'977, mlcod=27'973)", 2024-09-17T02:20:38.285 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:38.269947+0000", 2024-09-17T02:20:38.285 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.003088482, 2024-09-17T02:20:38.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033475549999999999, 2024-09-17T02:20:38.285 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.285 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.285 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:20:38.285 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.286 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.286 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269947+0000", 2024-09-17T02:20:38.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.286 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.286 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.286 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269947+0000", 2024-09-17T02:20:38.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.286 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.286 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.286 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269948+0000", 2024-09-17T02:20:38.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1e-07 2024-09-17T02:20:38.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269978+0000", 2024-09-17T02:20:38.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0054999999999999e-05 2024-09-17T02:20:38.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269984+0000", 2024-09-17T02:20:38.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9819999999999996e-06 2024-09-17T02:20:38.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.269989+0000", 2024-09-17T02:20:38.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4299999999999997e-06 2024-09-17T02:20:38.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.270602+0000", 2024-09-17T02:20:38.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061280600000000003 2024-09-17T02:20:38.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.270621+0000", 2024-09-17T02:20:38.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9096000000000001e-05 2024-09-17T02:20:38.289 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.289 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.289 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.289 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:15563 5.2 5:4f4b0b20:::benchmark_data_smithi001_23533_object15562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-17T02:20:38.289 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:38.271308+0000", 2024-09-17T02:20:38.289 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0017274759999999999, 2024-09-17T02:20:38.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002046146, 2024-09-17T02:20:38.289 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.290 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.290 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:38.290 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:38.290 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:38.290 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:38.290 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 15563 2024-09-17T02:20:38.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.290 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.290 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.290 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.271308+0000", 2024-09-17T02:20:38.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.271308+0000", 2024-09-17T02:20:38.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.271309+0000", 2024-09-17T02:20:38.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8599999999999996e-07 2024-09-17T02:20:38.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.271388+0000", 2024-09-17T02:20:38.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8666999999999997e-05 2024-09-17T02:20:38.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.271399+0000", 2024-09-17T02:20:38.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0665e-05 2024-09-17T02:20:38.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.271406+0000", 2024-09-17T02:20:38.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7800000000000003e-06 2024-09-17T02:20:38.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.271440+0000", 2024-09-17T02:20:38.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3971999999999999e-05 2024-09-17T02:20:38.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.271517+0000", 2024-09-17T02:20:38.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7453000000000005e-05 2024-09-17T02:20:38.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:38.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.271592+0000", 2024-09-17T02:20:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5471999999999998e-05 2024-09-17T02:20:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.273214+0000", 2024-09-17T02:20:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0016218840000000001 2024-09-17T02:20:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:15569 5.d 5:b54a8785:::benchmark_data_smithi001_23533_object15568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-17T02:20:38.294 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:38.272534+0000", 2024-09-17T02:20:38.295 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.00050227799999999999, 2024-09-17T02:20:38.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00089660499999999997, 2024-09-17T02:20:38.295 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.295 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.295 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:38.295 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:38.295 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:38.295 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:38.295 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 15569 2024-09-17T02:20:38.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.295 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272534+0000", 2024-09-17T02:20:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272534+0000", 2024-09-17T02:20:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272535+0000", 2024-09-17T02:20:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3399999999999998e-07 2024-09-17T02:20:38.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272595+0000", 2024-09-17T02:20:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0469e-05 2024-09-17T02:20:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272610+0000", 2024-09-17T02:20:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4657e-05 2024-09-17T02:20:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272621+0000", 2024-09-17T02:20:38.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1161999999999999e-05 2024-09-17T02:20:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272670+0000", 2024-09-17T02:20:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9409000000000001e-05 2024-09-17T02:20:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272809+0000", 2024-09-17T02:20:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013867099999999999 2024-09-17T02:20:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:38.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272926+0000", 2024-09-17T02:20:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000117489 2024-09-17T02:20:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:15564 5.6 e27/22 5:625b77e5:::benchmark_data_smithi001_23533_object15563:head v 27'977, mlcod=27'974)", 2024-09-17T02:20:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:38.272566+0000", 2024-09-17T02:20:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.00046989200000000002, 2024-09-17T02:20:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00093134000000000001, 2024-09-17T02:20:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.299 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:20:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272566+0000", 2024-09-17T02:20:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272566+0000", 2024-09-17T02:20:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272567+0000", 2024-09-17T02:20:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6300000000000004e-07 2024-09-17T02:20:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272626+0000", 2024-09-17T02:20:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9651000000000002e-05 2024-09-17T02:20:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272642+0000", 2024-09-17T02:20:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.507e-05 2024-09-17T02:20:38.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272649+0000", 2024-09-17T02:20:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9489999999999999e-06 2024-09-17T02:20:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272711+0000", 2024-09-17T02:20:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2570999999999994e-05 2024-09-17T02:20:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272735+0000", 2024-09-17T02:20:38.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3949000000000001e-05 2024-09-17T02:20:38.303 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.303 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.303 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.303 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:15565 5.c e27/22 5:3766c625:::benchmark_data_smithi001_23533_object15564:head v 27'978, mlcod=27'974)", 2024-09-17T02:20:38.303 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:38.272698+0000", 2024-09-17T02:20:38.303 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.00033757999999999998, 2024-09-17T02:20:38.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00085118300000000004, 2024-09-17T02:20:38.303 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.303 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.303 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:20:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272698+0000", 2024-09-17T02:20:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272698+0000", 2024-09-17T02:20:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272699+0000", 2024-09-17T02:20:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.51e-07 2024-09-17T02:20:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272739+0000", 2024-09-17T02:20:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9814999999999997e-05 2024-09-17T02:20:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272747+0000", 2024-09-17T02:20:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4789999999999996e-06 2024-09-17T02:20:38.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272754+0000", 2024-09-17T02:20:38.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4439999999999996e-06 2024-09-17T02:20:38.306 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272805+0000", 2024-09-17T02:20:38.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0946000000000003e-05 2024-09-17T02:20:38.306 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272822+0000", 2024-09-17T02:20:38.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7215999999999999e-05 2024-09-17T02:20:38.307 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.307 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.307 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.307 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:15570 5.7 5:eab01862:::benchmark_data_smithi001_23533_object15569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-17T02:20:38.307 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:38.272648+0000", 2024-09-17T02:20:38.307 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.00038759100000000001, 2024-09-17T02:20:38.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00096357599999999995, 2024-09-17T02:20:38.307 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.307 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.307 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:38.307 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 15570 2024-09-17T02:20:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272648+0000", 2024-09-17T02:20:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272648+0000", 2024-09-17T02:20:38.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.309 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.309 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272649+0000", 2024-09-17T02:20:38.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.61e-07 2024-09-17T02:20:38.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.309 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.309 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272772+0000", 2024-09-17T02:20:38.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012277100000000001 2024-09-17T02:20:38.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.309 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.310 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272782+0000", 2024-09-17T02:20:38.310 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0247e-05 2024-09-17T02:20:38.310 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.310 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.310 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.310 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272791+0000", 2024-09-17T02:20:38.310 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2879999999999998e-06 2024-09-17T02:20:38.310 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.310 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.310 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.310 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272845+0000", 2024-09-17T02:20:38.310 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3497e-05 2024-09-17T02:20:38.310 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.311 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.311 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272957+0000", 2024-09-17T02:20:38.311 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000111959 2024-09-17T02:20:38.311 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.311 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:38.311 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.273048+0000", 2024-09-17T02:20:38.311 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1638999999999995e-05 2024-09-17T02:20:38.311 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.311 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.311 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.311 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.312 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:15572 5.d 5.69c6bdd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-17T02:20:38.312 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:38.272809+0000", 2024-09-17T02:20:38.312 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.00022665900000000001, 2024-09-17T02:20:38.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00087660699999999995, 2024-09-17T02:20:38.312 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.312 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.312 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "queued for pg", 2024-09-17T02:20:38.312 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:38.312 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:38.312 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:38.312 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 15572 2024-09-17T02:20:38.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.312 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.313 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.313 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.313 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272809+0000", 2024-09-17T02:20:38.313 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.313 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.313 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.313 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.313 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272809+0000", 2024-09-17T02:20:38.313 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.313 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.313 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.313 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.313 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272810+0000", 2024-09-17T02:20:38.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9699999999999995e-07 2024-09-17T02:20:38.314 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.314 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272846+0000", 2024-09-17T02:20:38.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5444999999999997e-05 2024-09-17T02:20:38.314 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.314 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272854+0000", 2024-09-17T02:20:38.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7860000000000002e-06 2024-09-17T02:20:38.314 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.315 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.272861+0000", 2024-09-17T02:20:38.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.148e-06 2024-09-17T02:20:38.315 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.315 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.315 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.315 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:15573 5.3 e27/22)", 2024-09-17T02:20:38.315 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:38.273639+0000", 2024-09-17T02:20:38.315 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4294967295.9993968, 2024-09-17T02:20:38.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010338100000000001, 2024-09-17T02:20:38.316 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.316 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.316 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "reached pg", 2024-09-17T02:20:38.316 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.316 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.316 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.316 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.273639+0000", 2024-09-17T02:20:38.316 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.316 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.316 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.316 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.316 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.273639+0000", 2024-09-17T02:20:38.316 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.316 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.273640+0000", 2024-09-17T02:20:38.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.6599999999999996e-07 2024-09-17T02:20:38.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.273687+0000", 2024-09-17T02:20:38.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7444999999999997e-05 2024-09-17T02:20:38.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.318 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.273698+0000", 2024-09-17T02:20:38.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1069e-05 2024-09-17T02:20:38.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.318 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.318 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.273704+0000", 2024-09-17T02:20:38.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7679999999999997e-06 2024-09-17T02:20:38.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.318 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.318 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:38.273743+0000", 2024-09-17T02:20:38.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8411999999999997e-05 2024-09-17T02:20:38.319 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.319 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.319 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.319 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.319 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-09-17T02:20:38.319 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 12 2024-09-17T02:20:38.319 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:20:38.320 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:38.324+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:38.321 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:20:38.421 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:38.421+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:38.484 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:20:38.485 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-17T02:20:38.485 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-09-17T02:20:38.485 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-09-17T02:20:38.485 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:20:38.506 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:20:38.523 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:38.528+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:38.624 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:38.625+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:38.712 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:20:38.713 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-09-17T02:20:38.713 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-09-17T02:20:38.713 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-17T02:20:38.713 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.713 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-17T02:20:38.713 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:20:38.713 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 34.257975405000003, 2024-09-17T02:20:38.713 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.15597325500000001, 2024-09-17T02:20:38.713 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.713 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.713 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.714 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:38.714 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4164", 2024-09-17T02:20:38.714 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/201892753", 2024-09-17T02:20:38.714 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 1 2024-09-17T02:20:38.714 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.714 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.714 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.714 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.714 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:20:38.714 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.714 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.714 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.714 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.714 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:20:38.715 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.715 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.715 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.715 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.715 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458359+0000", 2024-09-17T02:20:38.715 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3929999999999998e-06 2024-09-17T02:20:38.715 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.715 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.715 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.715 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458373+0000", 2024-09-17T02:20:38.715 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4103e-05 2024-09-17T02:20:38.715 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.715 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.716 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.716 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458397+0000", 2024-09-17T02:20:38.716 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.438e-05 2024-09-17T02:20:38.716 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.716 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.716 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.716 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458421+0000", 2024-09-17T02:20:38.716 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3655999999999998e-05 2024-09-17T02:20:38.716 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.716 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.716 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.716 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458529+0000", 2024-09-17T02:20:38.716 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010752900000000001 2024-09-17T02:20:38.717 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.717 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.717 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:20:38.717 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458542+0000", 2024-09-17T02:20:38.717 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2986999999999999e-05 2024-09-17T02:20:38.717 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.717 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.717 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.717 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.611050+0000", 2024-09-17T02:20:38.717 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.1525087 2024-09-17T02:20:38.717 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.717 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.717 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.717 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.611529+0000", 2024-09-17T02:20:38.718 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00047844899999999999 2024-09-17T02:20:38.718 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.718 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.718 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:38.718 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.612061+0000", 2024-09-17T02:20:38.718 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00053230300000000003 2024-09-17T02:20:38.718 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.718 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.718 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:38.718 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.613451+0000", 2024-09-17T02:20:38.718 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0013897250000000001 2024-09-17T02:20:38.718 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.718 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.719 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.719 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614168+0000", 2024-09-17T02:20:38.719 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00071692499999999998 2024-09-17T02:20:38.719 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.719 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.719 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:38.719 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614265+0000", 2024-09-17T02:20:38.719 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7589000000000004e-05 2024-09-17T02:20:38.719 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.719 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.719 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:38.719 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614330+0000", 2024-09-17T02:20:38.719 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4516000000000004e-05 2024-09-17T02:20:38.719 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.720 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.720 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.720 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.720 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.720 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4164.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-17T02:20:38.720 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:04.966730+0000", 2024-09-17T02:20:38.720 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.749602023999998, 2024-09-17T02:20:38.720 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.024160772, 2024-09-17T02:20:38.720 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.720 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.720 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.720 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:38.720 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4164", 2024-09-17T02:20:38.721 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/201892753", 2024-09-17T02:20:38.721 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 117 2024-09-17T02:20:38.721 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.721 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.721 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.721 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.721 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.966730+0000", 2024-09-17T02:20:38.721 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.721 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.721 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.721 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.721 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.966730+0000", 2024-09-17T02:20:38.721 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.722 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.722 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.722 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.722 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.966731+0000", 2024-09-17T02:20:38.722 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5000000000000002e-07 2024-09-17T02:20:38.722 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.722 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.722 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.722 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.966736+0000", 2024-09-17T02:20:38.722 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3900000000000001e-06 2024-09-17T02:20:38.722 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.722 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.722 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.722 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.966746+0000", 2024-09-17T02:20:38.723 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4960000000000002e-06 2024-09-17T02:20:38.723 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.723 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.723 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.723 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.966753+0000", 2024-09-17T02:20:38.723 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0770000000000002e-06 2024-09-17T02:20:38.723 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.723 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.723 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.723 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.988554+0000", 2024-09-17T02:20:38.723 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.021801503999999999 2024-09-17T02:20:38.723 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.723 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.724 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.724 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.988813+0000", 2024-09-17T02:20:38.724 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000258514 2024-09-17T02:20:38.724 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.724 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.724 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:38.724 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.989188+0000", 2024-09-17T02:20:38.724 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000375767 2024-09-17T02:20:38.724 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.724 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.724 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:38.724 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.990403+0000", 2024-09-17T02:20:38.725 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001214487 2024-09-17T02:20:38.725 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.725 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.725 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.725 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.990696+0000", 2024-09-17T02:20:38.725 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029352499999999999 2024-09-17T02:20:38.725 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.725 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.725 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:38.725 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.990782+0000", 2024-09-17T02:20:38.725 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5389000000000005e-05 2024-09-17T02:20:38.725 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.725 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.726 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:38.726 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.990891+0000", 2024-09-17T02:20:38.726 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000108873 2024-09-17T02:20:38.726 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.726 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.726 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.726 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.726 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.726 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:38.726 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556145+0000", 2024-09-17T02:20:38.726 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.160187102999998, 2024-09-17T02:20:38.726 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.025052441000000002, 2024-09-17T02:20:38.727 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.727 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.727 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.727 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.727 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.727 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.727 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556145+0000", 2024-09-17T02:20:38.727 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.727 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.727 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.727 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.727 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556145+0000", 2024-09-17T02:20:38.727 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.728 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.728 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.728 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.728 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556148+0000", 2024-09-17T02:20:38.728 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4400000000000001e-06 2024-09-17T02:20:38.728 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.728 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.728 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.728 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556185+0000", 2024-09-17T02:20:38.728 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6603000000000002e-05 2024-09-17T02:20:38.728 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.728 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.728 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.729 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556220+0000", 2024-09-17T02:20:38.729 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5065999999999999e-05 2024-09-17T02:20:38.729 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.729 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.729 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.729 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556244+0000", 2024-09-17T02:20:38.729 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3937000000000001e-05 2024-09-17T02:20:38.729 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.729 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.730 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.730 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556378+0000", 2024-09-17T02:20:38.730 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000134129 2024-09-17T02:20:38.730 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.730 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.730 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.730 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556573+0000", 2024-09-17T02:20:38.730 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000195038 2024-09-17T02:20:38.730 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.731 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:38.731 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556765+0000", 2024-09-17T02:20:38.731 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019188199999999999 2024-09-17T02:20:38.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.731 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:38.731 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562153+0000", 2024-09-17T02:20:38.731 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0053883220000000001 2024-09-17T02:20:38.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.731 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.731 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.580640+0000", 2024-09-17T02:20:38.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018487145 2024-09-17T02:20:38.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.732 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.732 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:38.732 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.580791+0000", 2024-09-17T02:20:38.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015011899999999999 2024-09-17T02:20:38.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.732 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.732 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:38.732 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.581197+0000", 2024-09-17T02:20:38.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00040675999999999999 2024-09-17T02:20:38.733 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.733 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.733 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.733 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:38.733 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:20:38.733 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.160044287000002, 2024-09-17T02:20:38.733 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029713927000000001, 2024-09-17T02:20:38.733 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.734 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.734 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.734 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.734 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.734 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.734 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:20:38.734 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.734 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.734 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.734 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.734 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:20:38.734 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.734 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.735 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.735 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.735 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556289+0000", 2024-09-17T02:20:38.735 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.513e-06 2024-09-17T02:20:38.735 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.735 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.735 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.735 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556298+0000", 2024-09-17T02:20:38.735 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1630000000000002e-06 2024-09-17T02:20:38.735 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.735 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.735 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.735 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556318+0000", 2024-09-17T02:20:38.736 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9389999999999999e-05 2024-09-17T02:20:38.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.736 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.736 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.736 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556332+0000", 2024-09-17T02:20:38.736 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4506e-05 2024-09-17T02:20:38.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.736 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.736 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.736 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557304+0000", 2024-09-17T02:20:38.736 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00097169699999999999 2024-09-17T02:20:38.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.736 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.737 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.737 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557507+0000", 2024-09-17T02:20:38.737 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000203191 2024-09-17T02:20:38.737 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.737 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:38.737 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557838+0000", 2024-09-17T02:20:38.737 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033061100000000002 2024-09-17T02:20:38.737 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.737 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:38.737 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562171+0000", 2024-09-17T02:20:38.737 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043329229999999998 2024-09-17T02:20:38.738 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.738 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.738 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.738 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585737+0000", 2024-09-17T02:20:38.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023565915 2024-09-17T02:20:38.738 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.738 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.738 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:38.738 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585884+0000", 2024-09-17T02:20:38.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014744199999999999 2024-09-17T02:20:38.738 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.738 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.738 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:38.738 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586002+0000", 2024-09-17T02:20:38.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000117576 2024-09-17T02:20:38.739 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.739 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.739 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.739 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.739 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.739 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:38.739 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:20:38.739 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.159952315000002, 2024-09-17T02:20:38.739 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030933694000000001, 2024-09-17T02:20:38.739 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.739 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.739 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.739 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.739 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.740 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.740 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:20:38.740 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.740 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.740 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.740 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.740 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:20:38.740 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.740 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.740 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.740 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.740 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556381+0000", 2024-09-17T02:20:38.740 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2100000000000001e-06 2024-09-17T02:20:38.740 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.741 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.741 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.741 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556389+0000", 2024-09-17T02:20:38.741 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5539999999999998e-06 2024-09-17T02:20:38.741 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.741 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.741 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.741 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556408+0000", 2024-09-17T02:20:38.741 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8623000000000001e-05 2024-09-17T02:20:38.741 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.741 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.741 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.741 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556427+0000", 2024-09-17T02:20:38.741 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8566000000000001e-05 2024-09-17T02:20:38.742 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.742 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.742 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.742 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558741+0000", 2024-09-17T02:20:38.742 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023144390000000002 2024-09-17T02:20:38.742 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.742 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.742 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.742 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559040+0000", 2024-09-17T02:20:38.742 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029912100000000001 2024-09-17T02:20:38.742 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.742 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.742 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:38.742 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559222+0000", 2024-09-17T02:20:38.743 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018211200000000001 2024-09-17T02:20:38.743 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.743 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.743 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:38.743 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.566648+0000", 2024-09-17T02:20:38.743 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074257560000000004 2024-09-17T02:20:38.743 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.743 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.743 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.743 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587109+0000", 2024-09-17T02:20:38.743 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.020460685999999999 2024-09-17T02:20:38.743 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.743 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.743 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:38.744 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587232+0000", 2024-09-17T02:20:38.744 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123325 2024-09-17T02:20:38.744 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.744 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.744 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:38.744 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587313+0000", 2024-09-17T02:20:38.744 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1302000000000002e-05 2024-09-17T02:20:38.744 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.744 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.744 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.744 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.744 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.745 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:38.745 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:20:38.745 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.159886869000001, 2024-09-17T02:20:38.745 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031045538000000001, 2024-09-17T02:20:38.745 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.745 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.745 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.745 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.745 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.745 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.745 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:20:38.745 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.745 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.746 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.746 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.746 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:20:38.746 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.746 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.746 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.746 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.746 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556446+0000", 2024-09-17T02:20:38.746 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.26e-06 2024-09-17T02:20:38.746 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.746 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.746 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.747 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556454+0000", 2024-09-17T02:20:38.747 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1640000000000004e-06 2024-09-17T02:20:38.747 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.747 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.747 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.747 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556471+0000", 2024-09-17T02:20:38.747 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7586000000000001e-05 2024-09-17T02:20:38.747 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.747 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.747 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.747 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556485+0000", 2024-09-17T02:20:38.747 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3523000000000001e-05 2024-09-17T02:20:38.747 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.747 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.748 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.748 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559899+0000", 2024-09-17T02:20:38.748 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0034142140000000001 2024-09-17T02:20:38.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.748 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.748 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.748 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.560104+0000", 2024-09-17T02:20:38.748 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00020539199999999999 2024-09-17T02:20:38.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.748 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.748 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:38.748 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.560400+0000", 2024-09-17T02:20:38.748 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029612099999999999 2024-09-17T02:20:38.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.749 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.749 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:38.749 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.568427+0000", 2024-09-17T02:20:38.749 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0080262909999999996 2024-09-17T02:20:38.749 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.749 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.749 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.749 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587377+0000", 2024-09-17T02:20:38.749 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018950765000000001 2024-09-17T02:20:38.749 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.749 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.749 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:38.749 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587445+0000", 2024-09-17T02:20:38.750 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.724e-05 2024-09-17T02:20:38.750 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.750 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.750 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:38.750 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587491+0000", 2024-09-17T02:20:38.750 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5982000000000001e-05 2024-09-17T02:20:38.750 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.750 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.750 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.750 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.750 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.750 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:38.750 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:20:38.751 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.159824099000001, 2024-09-17T02:20:38.751 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031435547000000001, 2024-09-17T02:20:38.751 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.751 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.751 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.751 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.751 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.751 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.751 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:20:38.751 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.751 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.751 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.751 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.752 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:20:38.752 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.752 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.752 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.752 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.752 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556509+0000", 2024-09-17T02:20:38.752 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.06e-06 2024-09-17T02:20:38.752 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.752 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.752 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.752 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556515+0000", 2024-09-17T02:20:38.752 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1029999999999998e-06 2024-09-17T02:20:38.752 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.753 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.753 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.753 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556532+0000", 2024-09-17T02:20:38.753 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7054e-05 2024-09-17T02:20:38.753 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.753 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.753 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.753 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556545+0000", 2024-09-17T02:20:38.753 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3023000000000001e-05 2024-09-17T02:20:38.753 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.753 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.753 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.753 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561016+0000", 2024-09-17T02:20:38.754 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044705150000000004 2024-09-17T02:20:38.754 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.754 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.754 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.754 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561316+0000", 2024-09-17T02:20:38.754 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000299895 2024-09-17T02:20:38.754 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.754 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.754 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:38.754 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561651+0000", 2024-09-17T02:20:38.754 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033519300000000001 2024-09-17T02:20:38.754 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.754 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.755 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:38.755 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571105+0000", 2024-09-17T02:20:38.755 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094540539999999999 2024-09-17T02:20:38.755 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.755 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.755 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.755 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587628+0000", 2024-09-17T02:20:38.755 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016522819000000001 2024-09-17T02:20:38.755 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.755 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.755 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:38.755 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587770+0000", 2024-09-17T02:20:38.755 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000142352 2024-09-17T02:20:38.755 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.756 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.756 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:38.756 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587943+0000", 2024-09-17T02:20:38.756 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017347900000000001 2024-09-17T02:20:38.756 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.756 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.756 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.756 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.757 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.757 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:38.757 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:20:38.757 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.159768368999998, 2024-09-17T02:20:38.757 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031809104999999997, 2024-09-17T02:20:38.757 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.757 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.757 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.757 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.757 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.757 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.757 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:20:38.757 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.758 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.758 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.758 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.758 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:20:38.758 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.758 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.758 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.758 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.758 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556565+0000", 2024-09-17T02:20:38.758 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.116e-06 2024-09-17T02:20:38.758 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.758 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.758 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.758 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556572+0000", 2024-09-17T02:20:38.759 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0230000000000004e-06 2024-09-17T02:20:38.759 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.759 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.759 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.759 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556588+0000", 2024-09-17T02:20:38.759 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6643e-05 2024-09-17T02:20:38.759 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.759 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.759 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.759 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556606+0000", 2024-09-17T02:20:38.760 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7159999999999998e-05 2024-09-17T02:20:38.760 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.760 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.760 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562712+0000", 2024-09-17T02:20:38.760 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0061061630000000004 2024-09-17T02:20:38.760 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.760 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.760 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562919+0000", 2024-09-17T02:20:38.760 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000207309 2024-09-17T02:20:38.760 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.760 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.760 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:38.761 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563264+0000", 2024-09-17T02:20:38.761 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00034490699999999998 2024-09-17T02:20:38.761 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.761 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.761 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:38.761 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571812+0000", 2024-09-17T02:20:38.761 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0085477810000000008 2024-09-17T02:20:38.761 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.761 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.761 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.761 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588094+0000", 2024-09-17T02:20:38.761 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016282443000000001 2024-09-17T02:20:38.762 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.762 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.762 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:38.762 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588275+0000", 2024-09-17T02:20:38.762 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018058700000000001 2024-09-17T02:20:38.762 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.762 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.762 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:38.762 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588373+0000", 2024-09-17T02:20:38.762 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7973000000000005e-05 2024-09-17T02:20:38.762 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.762 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.762 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.763 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.763 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.763 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:38.763 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:20:38.763 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.159710270000001, 2024-09-17T02:20:38.763 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031950544999999997, 2024-09-17T02:20:38.763 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.763 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.763 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.763 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.763 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.763 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.763 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:20:38.763 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.764 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.764 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:20:38.764 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.764 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.764 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556623+0000", 2024-09-17T02:20:38.764 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.04e-06 2024-09-17T02:20:38.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.764 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556631+0000", 2024-09-17T02:20:38.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1529999999999997e-06 2024-09-17T02:20:38.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556648+0000", 2024-09-17T02:20:38.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6583999999999999e-05 2024-09-17T02:20:38.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556661+0000", 2024-09-17T02:20:38.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3203e-05 2024-09-17T02:20:38.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564413+0000", 2024-09-17T02:20:38.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0077523100000000001 2024-09-17T02:20:38.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.565841+0000", 2024-09-17T02:20:38.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014276320000000001 2024-09-17T02:20:38.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:38.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.566131+0000", 2024-09-17T02:20:38.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029043800000000001 2024-09-17T02:20:38.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:38.767 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572353+0000", 2024-09-17T02:20:38.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.006222399 2024-09-17T02:20:38.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.767 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588452+0000", 2024-09-17T02:20:38.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016098635 2024-09-17T02:20:38.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:38.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588520+0000", 2024-09-17T02:20:38.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8040000000000006e-05 2024-09-17T02:20:38.768 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.768 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.768 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:38.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588572+0000", 2024-09-17T02:20:38.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2111000000000003e-05 2024-09-17T02:20:38.768 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.768 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.768 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.768 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.768 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.768 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:38.768 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:20:38.769 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.159613104000002, 2024-09-17T02:20:38.769 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.032187205000000003, 2024-09-17T02:20:38.769 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.769 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.769 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.769 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.769 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.769 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.769 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:20:38.769 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.769 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.769 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.769 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.770 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:20:38.770 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.770 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.770 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.770 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556727+0000", 2024-09-17T02:20:38.770 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3000000000000002e-06 2024-09-17T02:20:38.770 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.770 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.770 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556736+0000", 2024-09-17T02:20:38.770 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4300000000000006e-06 2024-09-17T02:20:38.770 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556755+0000", 2024-09-17T02:20:38.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9700000000000001e-05 2024-09-17T02:20:38.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556771+0000", 2024-09-17T02:20:38.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5213e-05 2024-09-17T02:20:38.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571184+0000", 2024-09-17T02:20:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014413888999999999 2024-09-17T02:20:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571302+0000", 2024-09-17T02:20:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011794900000000001 2024-09-17T02:20:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571494+0000", 2024-09-17T02:20:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000191168 2024-09-17T02:20:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:38.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.573775+0000", 2024-09-17T02:20:38.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002281656 2024-09-17T02:20:38.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588668+0000", 2024-09-17T02:20:38.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014892699000000001 2024-09-17T02:20:38.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:38.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588813+0000", 2024-09-17T02:20:38.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014530700000000001 2024-09-17T02:20:38.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:38.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588906+0000", 2024-09-17T02:20:38.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2893999999999995e-05 2024-09-17T02:20:38.774 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.774 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.774 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.774 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:38.774 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556790+0000", 2024-09-17T02:20:38.775 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.159542374000001, 2024-09-17T02:20:38.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.027122670000000002, 2024-09-17T02:20:38.775 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.775 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.775 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.775 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556790+0000", 2024-09-17T02:20:38.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556790+0000", 2024-09-17T02:20:38.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556791+0000", 2024-09-17T02:20:38.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.063e-06 2024-09-17T02:20:38.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556797+0000", 2024-09-17T02:20:38.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0530000000000003e-06 2024-09-17T02:20:38.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556814+0000", 2024-09-17T02:20:38.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7567e-05 2024-09-17T02:20:38.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556827+0000", 2024-09-17T02:20:38.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3026e-05 2024-09-17T02:20:38.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556981+0000", 2024-09-17T02:20:38.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000153299 2024-09-17T02:20:38.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557252+0000", 2024-09-17T02:20:38.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00027129399999999999 2024-09-17T02:20:38.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:38.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557564+0000", 2024-09-17T02:20:38.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000311615 2024-09-17T02:20:38.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.568194+0000", 2024-09-17T02:20:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010630175 2024-09-17T02:20:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.583636+0000", 2024-09-17T02:20:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015442256999999999 2024-09-17T02:20:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.583758+0000", 2024-09-17T02:20:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000121692 2024-09-17T02:20:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.780 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.780 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:38.780 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.583912+0000", 2024-09-17T02:20:38.780 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015462900000000001 2024-09-17T02:20:38.780 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.780 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.780 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.780 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.780 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.780 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:38.780 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:20:38.780 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.159471938999999, 2024-09-17T02:20:38.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028815922000000001, 2024-09-17T02:20:38.781 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.781 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.781 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.781 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:20:38.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:20:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556861+0000", 2024-09-17T02:20:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.08e-06 2024-09-17T02:20:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556867+0000", 2024-09-17T02:20:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.207e-06 2024-09-17T02:20:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556886+0000", 2024-09-17T02:20:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9137e-05 2024-09-17T02:20:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556900+0000", 2024-09-17T02:20:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3253e-05 2024-09-17T02:20:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558301+0000", 2024-09-17T02:20:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014008320000000001 2024-09-17T02:20:38.784 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.784 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.784 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.784 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558564+0000", 2024-09-17T02:20:38.785 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000263238 2024-09-17T02:20:38.785 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.785 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.785 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:38.785 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558905+0000", 2024-09-17T02:20:38.785 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000341534 2024-09-17T02:20:38.785 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.785 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.785 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:38.785 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.568208+0000", 2024-09-17T02:20:38.785 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0093023689999999996 2024-09-17T02:20:38.785 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.785 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585379+0000", 2024-09-17T02:20:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017171091999999999 2024-09-17T02:20:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585509+0000", 2024-09-17T02:20:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013036100000000001 2024-09-17T02:20:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585676+0000", 2024-09-17T02:20:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016681899999999999 2024-09-17T02:20:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.787 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.787 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.787 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.787 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.787 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:38.787 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:20:38.787 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.159414672, 2024-09-17T02:20:38.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030862568, 2024-09-17T02:20:38.787 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.787 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.787 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.787 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.788 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.788 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:20:38.788 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.788 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.788 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:20:38.788 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.788 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556918+0000", 2024-09-17T02:20:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0529999999999999e-06 2024-09-17T02:20:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556925+0000", 2024-09-17T02:20:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.6939999999999998e-06 2024-09-17T02:20:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556942+0000", 2024-09-17T02:20:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6803000000000002e-05 2024-09-17T02:20:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.790 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.790 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.790 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556955+0000", 2024-09-17T02:20:38.790 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2659e-05 2024-09-17T02:20:38.790 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.790 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.790 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.790 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558237+0000", 2024-09-17T02:20:38.790 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001282804 2024-09-17T02:20:38.790 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.790 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.790 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.790 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558495+0000", 2024-09-17T02:20:38.791 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000257178 2024-09-17T02:20:38.791 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.791 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.791 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:38.791 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562168+0000", 2024-09-17T02:20:38.791 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0036737110000000001 2024-09-17T02:20:38.791 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.791 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.791 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:38.791 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.570855+0000", 2024-09-17T02:20:38.791 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0086868729999999995 2024-09-17T02:20:38.791 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.792 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.792 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587568+0000", 2024-09-17T02:20:38.792 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016712444999999999 2024-09-17T02:20:38.792 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.792 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:38.792 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587677+0000", 2024-09-17T02:20:38.792 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000109879 2024-09-17T02:20:38.792 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.792 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587780+0000", 2024-09-17T02:20:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000102469 2024-09-17T02:20:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:20:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.159332540000001, 2024-09-17T02:20:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031005751000000002, 2024-09-17T02:20:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.794 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.794 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.794 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.794 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.794 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:20:38.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.794 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.794 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.794 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:20:38.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.794 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.794 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557001+0000", 2024-09-17T02:20:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.237e-06 2024-09-17T02:20:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557007+0000", 2024-09-17T02:20:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7270000000000001e-06 2024-09-17T02:20:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557025+0000", 2024-09-17T02:20:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7689999999999998e-05 2024-09-17T02:20:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.796 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.796 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.796 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557039+0000", 2024-09-17T02:20:38.796 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.385e-05 2024-09-17T02:20:38.796 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.796 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.796 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.796 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563783+0000", 2024-09-17T02:20:38.796 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0067437110000000003 2024-09-17T02:20:38.796 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.796 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.796 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.796 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564031+0000", 2024-09-17T02:20:38.797 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00024871799999999999 2024-09-17T02:20:38.797 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.797 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.797 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:38.797 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564518+0000", 2024-09-17T02:20:38.797 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00048708999999999997 2024-09-17T02:20:38.797 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.797 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.797 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:38.797 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572375+0000", 2024-09-17T02:20:38.797 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078564780000000001 2024-09-17T02:20:38.797 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.797 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587862+0000", 2024-09-17T02:20:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015486837999999999 2024-09-17T02:20:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587954+0000", 2024-09-17T02:20:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1766000000000002e-05 2024-09-17T02:20:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588005+0000", 2024-09-17T02:20:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1646e-05 2024-09-17T02:20:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:20:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.159188243999999, 2024-09-17T02:20:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029554871999999999, 2024-09-17T02:20:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:20:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:20:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557145+0000", 2024-09-17T02:20:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.263e-06 2024-09-17T02:20:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557151+0000", 2024-09-17T02:20:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1040000000000003e-06 2024-09-17T02:20:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557168+0000", 2024-09-17T02:20:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7289999999999999e-05 2024-09-17T02:20:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557182+0000", 2024-09-17T02:20:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.325e-05 2024-09-17T02:20:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564102+0000", 2024-09-17T02:20:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069199860000000004 2024-09-17T02:20:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564438+0000", 2024-09-17T02:20:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033651800000000001 2024-09-17T02:20:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.565422+0000", 2024-09-17T02:20:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00098332499999999995 2024-09-17T02:20:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.803 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.803 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:38.803 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572361+0000", 2024-09-17T02:20:38.803 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069392630000000002 2024-09-17T02:20:38.803 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.803 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.803 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.803 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586567+0000", 2024-09-17T02:20:38.803 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014206107000000001 2024-09-17T02:20:38.803 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.803 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586643+0000", 2024-09-17T02:20:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5673000000000005e-05 2024-09-17T02:20:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586699+0000", 2024-09-17T02:20:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6093e-05 2024-09-17T02:20:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557197+0000", 2024-09-17T02:20:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.159134563999999, 2024-09-17T02:20:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.027462931999999999, 2024-09-17T02:20:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557197+0000", 2024-09-17T02:20:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.806 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.806 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557197+0000", 2024-09-17T02:20:38.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.806 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.806 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.806 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557198+0000", 2024-09-17T02:20:38.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.8599999999999997e-07 2024-09-17T02:20:38.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.806 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.806 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.806 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557204+0000", 2024-09-17T02:20:38.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8200000000000002e-06 2024-09-17T02:20:38.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557223+0000", 2024-09-17T02:20:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8536999999999999e-05 2024-09-17T02:20:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557239+0000", 2024-09-17T02:20:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6725999999999999e-05 2024-09-17T02:20:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557373+0000", 2024-09-17T02:20:38.808 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000133199 2024-09-17T02:20:38.808 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.808 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.808 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.808 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557655+0000", 2024-09-17T02:20:38.808 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00028230799999999999 2024-09-17T02:20:38.808 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.808 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.808 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:38.808 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557941+0000", 2024-09-17T02:20:38.808 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00028569100000000003 2024-09-17T02:20:38.808 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.809 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.809 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:38.809 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562956+0000", 2024-09-17T02:20:38.809 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050156109999999997 2024-09-17T02:20:38.809 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.809 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.809 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.809 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.584452+0000", 2024-09-17T02:20:38.809 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.021496107 2024-09-17T02:20:38.809 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.809 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.809 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:38.810 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.584561+0000", 2024-09-17T02:20:38.810 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000108934 2024-09-17T02:20:38.810 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.810 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.810 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:38.810 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.584660+0000", 2024-09-17T02:20:38.810 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.9112999999999998e-05 2024-09-17T02:20:38.810 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.810 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.810 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.810 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.810 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.810 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:38.811 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:20:38.811 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.159054552000001, 2024-09-17T02:20:38.811 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029800569999999998, 2024-09-17T02:20:38.811 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.811 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.811 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.811 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.811 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.811 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.811 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:20:38.811 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.811 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.812 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.812 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.812 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:20:38.812 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.812 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.812 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.812 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.812 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557279+0000", 2024-09-17T02:20:38.812 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.497e-06 2024-09-17T02:20:38.812 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.812 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.812 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.812 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557287+0000", 2024-09-17T02:20:38.813 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9030000000000004e-06 2024-09-17T02:20:38.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.813 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.813 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.813 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557306+0000", 2024-09-17T02:20:38.813 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9394000000000001e-05 2024-09-17T02:20:38.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.813 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.813 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.813 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557323+0000", 2024-09-17T02:20:38.813 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6299000000000001e-05 2024-09-17T02:20:38.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.814 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.814 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.814 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.570931+0000", 2024-09-17T02:20:38.814 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013608841999999999 2024-09-17T02:20:38.814 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.814 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.814 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.814 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571250+0000", 2024-09-17T02:20:38.814 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031817400000000001 2024-09-17T02:20:38.814 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.814 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.814 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:38.814 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571559+0000", 2024-09-17T02:20:38.815 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000309835 2024-09-17T02:20:38.815 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.815 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.815 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:38.815 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.574161+0000", 2024-09-17T02:20:38.815 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002601543 2024-09-17T02:20:38.815 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.815 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.815 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.815 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586866+0000", 2024-09-17T02:20:38.815 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012704968000000001 2024-09-17T02:20:38.815 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.815 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.816 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:38.816 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586987+0000", 2024-09-17T02:20:38.816 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000121369 2024-09-17T02:20:38.816 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.816 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.816 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:38.816 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587078+0000", 2024-09-17T02:20:38.816 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0746000000000002e-05 2024-09-17T02:20:38.816 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.816 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.816 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.816 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.816 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.817 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:38.817 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:20:38.817 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.158988909000001, 2024-09-17T02:20:38.817 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029936054, 2024-09-17T02:20:38.817 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.817 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.817 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.817 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.817 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.817 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.817 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:20:38.817 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.817 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.818 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.818 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.818 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:20:38.818 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.818 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.818 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.818 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.818 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557344+0000", 2024-09-17T02:20:38.818 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.347e-06 2024-09-17T02:20:38.818 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.818 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.818 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.818 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557351+0000", 2024-09-17T02:20:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5560000000000004e-06 2024-09-17T02:20:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557369+0000", 2024-09-17T02:20:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7703e-05 2024-09-17T02:20:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557382+0000", 2024-09-17T02:20:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3664e-05 2024-09-17T02:20:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.820 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558997+0000", 2024-09-17T02:20:38.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0016147970000000001 2024-09-17T02:20:38.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.820 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.820 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559236+0000", 2024-09-17T02:20:38.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00023900200000000001 2024-09-17T02:20:38.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.820 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:38.820 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559547+0000", 2024-09-17T02:20:38.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031132399999999998 2024-09-17T02:20:38.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.821 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:38.821 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563130+0000", 2024-09-17T02:20:38.821 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003582989 2024-09-17T02:20:38.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.821 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.821 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587069+0000", 2024-09-17T02:20:38.821 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023938496 2024-09-17T02:20:38.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.821 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587192+0000", 2024-09-17T02:20:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123514 2024-09-17T02:20:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587279+0000", 2024-09-17T02:20:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6662000000000005e-05 2024-09-17T02:20:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:20:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.158931023000001, 2024-09-17T02:20:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030490703000000001, 2024-09-17T02:20:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:20:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:20:38.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557403+0000", 2024-09-17T02:20:38.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.77e-06 2024-09-17T02:20:38.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557412+0000", 2024-09-17T02:20:38.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4099999999999997e-06 2024-09-17T02:20:38.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557431+0000", 2024-09-17T02:20:38.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9177e-05 2024-09-17T02:20:38.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557444+0000", 2024-09-17T02:20:38.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2999999999999999e-05 2024-09-17T02:20:38.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557722+0000", 2024-09-17T02:20:38.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00027760699999999997 2024-09-17T02:20:38.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557991+0000", 2024-09-17T02:20:38.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00026892499999999999 2024-09-17T02:20:38.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:38.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558265+0000", 2024-09-17T02:20:38.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000274524 2024-09-17T02:20:38.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:38.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564270+0000", 2024-09-17T02:20:38.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060045339999999997 2024-09-17T02:20:38.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:38.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587701+0000", 2024-09-17T02:20:38.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023431285999999999 2024-09-17T02:20:38.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:38.828 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587803+0000", 2024-09-17T02:20:38.828 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000101371 2024-09-17T02:20:38.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.828 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.828 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:38.828 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587892+0000", 2024-09-17T02:20:38.828 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9098999999999995e-05 2024-09-17T02:20:38.828 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.828 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.829 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.829 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.829 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:38.829 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:20:38.829 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.158849427, 2024-09-17T02:20:38.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029886725999999999, 2024-09-17T02:20:38.829 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:38.829 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:38.829 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:20:38.829 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:38.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:38.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:20:38.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:38.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:20:38.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:38.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:38.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557484+0000", 2024-09-17T02:20:38.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.26e-06 2024-09-17T02:20:38.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:38.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557489+0000", 2024-09-17T02:20:38.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2530000000000004e-06 2024-09-17T02:20:38.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:38.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557507+0000", 2024-09-17T02:20:38.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7473999999999999e-05 2024-09-17T02:20:38.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:38.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557524+0000", 2024-09-17T02:20:38.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7912999999999999e-05 2024-09-17T02:20:38.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:38.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572428+0000", 2024-09-17T02:20:38.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014903451999999999 2024-09-17T02:20:38.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:38.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572589+0000", 2024-09-17T02:20:38.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000161299 2024-09-17T02:20:38.833 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:38.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:38.833 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:38.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587369+0000", 2024-09-17T02:20:38.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014780075 2024-09-17T02:20:38.833 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.833 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.833 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.834 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:38.834 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:38.834 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:20:38.834 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T02:20:38.835 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 6 16 17140 17124 178.354 195.625 0.00520388 0.0056002 2024-09-17T02:20:38.836 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:38.837+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:38.837 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:20:38.937 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:38.940+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:39.001 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:20:39.001 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:20:39.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.001 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:17875 5.0 e27/26 5:004a4742:::benchmark_data_smithi001_23533_object17874:head v 27'1093, mlcod=27'1091)", 2024-09-17T02:20:39.001 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:39.005900+0000", 2024-09-17T02:20:39.001 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0017407029999999999, 2024-09-17T02:20:39.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017629239999999999, 2024-09-17T02:20:39.001 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:39.002 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:39.002 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:39.002 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:39.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:39.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.005900+0000", 2024-09-17T02:20:39.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:39.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:39.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.005900+0000", 2024-09-17T02:20:39.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:39.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:39.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.005900+0000", 2024-09-17T02:20:39.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0399999999999995e-07 2024-09-17T02:20:39.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:39.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.006006+0000", 2024-09-17T02:20:39.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105584 2024-09-17T02:20:39.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:39.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.006019+0000", 2024-09-17T02:20:39.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2571999999999999e-05 2024-09-17T02:20:39.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:39.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.006026+0000", 2024-09-17T02:20:39.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1949999999999997e-06 2024-09-17T02:20:39.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:39.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.006079+0000", 2024-09-17T02:20:39.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3263999999999997e-05 2024-09-17T02:20:39.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:39.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.006097+0000", 2024-09-17T02:20:39.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.802e-05 2024-09-17T02:20:39.005 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:39.005 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:39.005 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:39.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.005 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:17872 5.d e27/26 5:b639a8d2:::benchmark_data_smithi001_23533_object17871:head v 27'1121, mlcod=27'1116)", 2024-09-17T02:20:39.005 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:39.006423+0000", 2024-09-17T02:20:39.005 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0012173889999999999, 2024-09-17T02:20:39.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013091649999999999, 2024-09-17T02:20:39.006 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:39.006 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:39.006 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:39.006 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:39.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:39.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.006423+0000", 2024-09-17T02:20:39.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:39.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:39.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.006423+0000", 2024-09-17T02:20:39.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:39.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:39.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.006424+0000", 2024-09-17T02:20:39.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0699999999999996e-07 2024-09-17T02:20:39.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:39.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.006468+0000", 2024-09-17T02:20:39.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4524000000000003e-05 2024-09-17T02:20:39.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:39.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.006479+0000", 2024-09-17T02:20:39.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1019000000000001e-05 2024-09-17T02:20:39.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:39.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.006486+0000", 2024-09-17T02:20:39.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1579999999999999e-06 2024-09-17T02:20:39.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:39.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.006543+0000", 2024-09-17T02:20:39.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6140000000000001e-05 2024-09-17T02:20:39.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:39.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.006572+0000", 2024-09-17T02:20:39.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9005000000000001e-05 2024-09-17T02:20:39.009 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:39.009 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:39.009 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:39.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.010 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:17877 5.8 e27/26 5:1885fef5:::benchmark_data_smithi001_23533_object17876:head v 27'1137, mlcod=27'1135)", 2024-09-17T02:20:39.010 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:39.006591+0000", 2024-09-17T02:20:39.010 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.001049049, 2024-09-17T02:20:39.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001206361, 2024-09-17T02:20:39.010 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:39.010 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:39.010 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:39.010 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:39.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:39.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.006591+0000", 2024-09-17T02:20:39.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:39.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:39.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.006591+0000", 2024-09-17T02:20:39.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:39.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:39.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.006592+0000", 2024-09-17T02:20:39.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.72e-07 2024-09-17T02:20:39.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:39.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.006629+0000", 2024-09-17T02:20:39.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7500999999999999e-05 2024-09-17T02:20:39.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:39.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.006640+0000", 2024-09-17T02:20:39.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0866000000000001e-05 2024-09-17T02:20:39.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:39.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.006646+0000", 2024-09-17T02:20:39.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1639999999999998e-06 2024-09-17T02:20:39.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:39.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.006685+0000", 2024-09-17T02:20:39.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9113000000000003e-05 2024-09-17T02:20:39.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:39.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.006704+0000", 2024-09-17T02:20:39.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8292999999999999e-05 2024-09-17T02:20:39.013 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:39.013 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:39.013 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:39.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.014 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:17879 5.0 e27/26 5:0fb2a8ba:::benchmark_data_smithi001_23533_object17878:head v 27'1094, mlcod=27'1091)", 2024-09-17T02:20:39.014 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:39.007135+0000", 2024-09-17T02:20:39.014 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00050516099999999996, 2024-09-17T02:20:39.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072376799999999996, 2024-09-17T02:20:39.014 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:39.014 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:39.014 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:39.014 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:39.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:39.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007135+0000", 2024-09-17T02:20:39.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:39.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:39.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007135+0000", 2024-09-17T02:20:39.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:39.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:39.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007136+0000", 2024-09-17T02:20:39.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4199999999999995e-07 2024-09-17T02:20:39.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:39.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007214+0000", 2024-09-17T02:20:39.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7553999999999996e-05 2024-09-17T02:20:39.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:39.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007227+0000", 2024-09-17T02:20:39.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3562e-05 2024-09-17T02:20:39.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:39.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007238+0000", 2024-09-17T02:20:39.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0679000000000001e-05 2024-09-17T02:20:39.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:39.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007285+0000", 2024-09-17T02:20:39.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7576e-05 2024-09-17T02:20:39.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:39.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007305+0000", 2024-09-17T02:20:39.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9323000000000001e-05 2024-09-17T02:20:39.017 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:39.017 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:39.017 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:39.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.018 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:17874 5.d e27/26 5:ba6ded21:::benchmark_data_smithi001_23533_object17873:head v 27'1122, mlcod=27'1117)", 2024-09-17T02:20:39.018 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:39.007456+0000", 2024-09-17T02:20:39.018 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.000184212, 2024-09-17T02:20:39.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046518200000000002, 2024-09-17T02:20:39.018 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:39.018 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:39.018 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:39.018 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:39.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:39.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007456+0000", 2024-09-17T02:20:39.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:39.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:39.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007456+0000", 2024-09-17T02:20:39.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:39.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:39.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007457+0000", 2024-09-17T02:20:39.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:20:39.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:39.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007510+0000", 2024-09-17T02:20:39.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3054999999999999e-05 2024-09-17T02:20:39.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:39.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007521+0000", 2024-09-17T02:20:39.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0941000000000001e-05 2024-09-17T02:20:39.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:39.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007527+0000", 2024-09-17T02:20:39.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5610000000000004e-06 2024-09-17T02:20:39.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:39.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007571+0000", 2024-09-17T02:20:39.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3747e-05 2024-09-17T02:20:39.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:39.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007594+0000", 2024-09-17T02:20:39.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3127999999999999e-05 2024-09-17T02:20:39.021 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:39.022 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:39.022 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:39.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.022 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:17882 5.9 e27/22 5:9a417b14:::benchmark_data_smithi001_23533_object17881:head v 27'1062, mlcod=27'1060)", 2024-09-17T02:20:39.022 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:39.007543+0000", 2024-09-17T02:20:39.022 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.6966999999999995e-05, 2024-09-17T02:20:39.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044087100000000001, 2024-09-17T02:20:39.022 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:39.022 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:39.022 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:39.022 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:39.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:39.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007543+0000", 2024-09-17T02:20:39.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:39.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:39.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007543+0000", 2024-09-17T02:20:39.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:39.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:39.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007544+0000", 2024-09-17T02:20:39.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6800000000000001e-07 2024-09-17T02:20:39.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:39.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007584+0000", 2024-09-17T02:20:39.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0510999999999999e-05 2024-09-17T02:20:39.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:39.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007595+0000", 2024-09-17T02:20:39.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0985000000000001e-05 2024-09-17T02:20:39.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:39.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007601+0000", 2024-09-17T02:20:39.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7100000000000004e-06 2024-09-17T02:20:39.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:39.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007670+0000", 2024-09-17T02:20:39.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9459e-05 2024-09-17T02:20:39.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:39.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007687+0000", 2024-09-17T02:20:39.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6257999999999999e-05 2024-09-17T02:20:39.026 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:39.026 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:39.026 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:39.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.026 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:17885 5.e 5.c3d2330e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-17T02:20:39.026 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:39.007894+0000", 2024-09-17T02:20:39.026 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4294967295.9997463, 2024-09-17T02:20:39.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015323299999999999, 2024-09-17T02:20:39.027 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:39.027 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:39.027 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-17T02:20:39.027 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:39.027 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:39.027 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:39.027 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 17885 2024-09-17T02:20:39.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.027 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:39.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:39.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007894+0000", 2024-09-17T02:20:39.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:39.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:39.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007894+0000", 2024-09-17T02:20:39.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:39.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:39.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007895+0000", 2024-09-17T02:20:39.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1400000000000001e-06 2024-09-17T02:20:39.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:39.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007946+0000", 2024-09-17T02:20:39.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0507999999999998e-05 2024-09-17T02:20:39.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:39.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007960+0000", 2024-09-17T02:20:39.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3783e-05 2024-09-17T02:20:39.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:39.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007967+0000", 2024-09-17T02:20:39.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0350000000000004e-06 2024-09-17T02:20:39.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:39.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.008027+0000", 2024-09-17T02:20:39.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0074000000000001e-05 2024-09-17T02:20:39.030 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:39.030 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:39.030 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:39.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.030 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:17881 5.0 e27/26)", 2024-09-17T02:20:39.030 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:39.008004+0000", 2024-09-17T02:20:39.030 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4294967295.9996362, 2024-09-17T02:20:39.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108486, 2024-09-17T02:20:39.030 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:39.031 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:39.031 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:20:39.031 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:39.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:39.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.008004+0000", 2024-09-17T02:20:39.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:39.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:39.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.008004+0000", 2024-09-17T02:20:39.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:39.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:39.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.008004+0000", 2024-09-17T02:20:39.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.08e-07 2024-09-17T02:20:39.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:39.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.008072+0000", 2024-09-17T02:20:39.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7224000000000006e-05 2024-09-17T02:20:39.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:39.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.008080+0000", 2024-09-17T02:20:39.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6510000000000007e-06 2024-09-17T02:20:39.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:39.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.008086+0000", 2024-09-17T02:20:39.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4559999999999999e-06 2024-09-17T02:20:39.033 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:39.033 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:39.033 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:39.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.033 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:17876 5.b 5:d9c9954d:::benchmark_data_smithi001_23533_object17875:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-17T02:20:39.033 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:39.005303+0000", 2024-09-17T02:20:39.033 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.002337076, 2024-09-17T02:20:39.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028689929999999998, 2024-09-17T02:20:39.034 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:39.034 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:39.034 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:39.034 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:39.034 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:39.034 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:39.034 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 17876 2024-09-17T02:20:39.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.034 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:39.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:39.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.005303+0000", 2024-09-17T02:20:39.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:39.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:39.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.005303+0000", 2024-09-17T02:20:39.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:39.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:39.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.005304+0000", 2024-09-17T02:20:39.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0410000000000001e-06 2024-09-17T02:20:39.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:39.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.005404+0000", 2024-09-17T02:20:39.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9846999999999995e-05 2024-09-17T02:20:39.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:39.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.005417+0000", 2024-09-17T02:20:39.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.326e-05 2024-09-17T02:20:39.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:39.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.005427+0000", 2024-09-17T02:20:39.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1560000000000001e-06 2024-09-17T02:20:39.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:39.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.005485+0000", 2024-09-17T02:20:39.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8038999999999998e-05 2024-09-17T02:20:39.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:39.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.005627+0000", 2024-09-17T02:20:39.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014221700000000001 2024-09-17T02:20:39.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:39.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.005760+0000", 2024-09-17T02:20:39.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000133261 2024-09-17T02:20:39.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:39.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:39.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:39.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:39.007598+0000", 2024-09-17T02:20:39.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001837525 2024-09-17T02:20:39.038 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:39.038 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:39.038 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:39.038 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:39.038 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:20:39.039 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 9 2024-09-17T02:20:39.039 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:20:39.040 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:39.044+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:39.041 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:20:39.130 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:20:39.140 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:39.144+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:39.206 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:20:39.206 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:20:39.206 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:20:39.206 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:20:39.206 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:20:39.228 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:20:39.241 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:39.241+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:39.294 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:20:39.294 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:20:39.315 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:20:39.316 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:20:39.337 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:20:39.338 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:20:39.342 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:39.341+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:39.428 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:39.429 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:39.443 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:39.448+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:39.447 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:20:39.544 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:39.548+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:39.621 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:39.622 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:39.645 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:39.648+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:39.647 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:20:39.702 INFO:teuthology.orchestra.run.smithi001.stderr:nodeep-scrub is unset 2024-09-17T02:20:39.746 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:39.752+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:39.767 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 7 16 20258 20242 180.711 194.875 0.00417346 0.00552863 2024-09-17T02:20:39.847 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:39.852+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:39.859 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:39.859 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:39.880 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:20:39.948 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:39.949+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:40.047 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:40.048 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:40.049 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:40.052+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:40.071 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:20:40.149 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:40.152+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:40.232 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:40.232 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:40.250 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:40.256+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:40.253 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:20:40.351 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:40.356+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:40.417 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:40.417 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:40.440 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:20:40.487 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:40.489+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:40.553 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:40.556+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:40.604 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:40.604 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:40.628 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:20:40.674 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:40.680+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:40.755 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:40.760+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:40.768 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 8 16 23356 23340 182.322 193.625 0.011432 0.0054776 2024-09-17T02:20:40.784 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:40.784 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:40.807 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:20:40.856 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:40.860+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:40.957 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:40.957+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:41.008 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:41.008 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:41.029 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:20:41.058 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:41.064+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:41.159 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:41.161+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:41.191 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:41.191 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:41.213 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:20:41.261 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:41.264+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:41.357 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:20:41.361 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:41.364+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:41.368 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:41.368 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:41.389 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:20:41.462 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:41.461+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:41.526 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:20:41.526 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:20:41.544 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:20:41.545 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:20:41.563 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:41.568+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:41.563 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:20:41.563 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:20:41.589 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:20:41.589 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:20:41.590 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:20:41.590 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:20:41.590 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:20:41.609 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:20:41.664 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:41.665+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:41.715 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-17T02:20:41.715 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T02:20:41.716 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-17T02:20:41.716 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-17T02:20:41.725 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T02:20:41.765 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:41.768+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:41.768 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 9 16 26358 26342 182.909 187.625 0.00350768 0.00546127 2024-09-17T02:20:41.770 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:20:41.770 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:20:41.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:20:41.770 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:20:41.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.770 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:41.771 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:20:41.771 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.212678724, 2024-09-17T02:20:41.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021799929999999999, 2024-09-17T02:20:41.771 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:41.771 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:41.771 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:41.771 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:41.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:41.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:20:41.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:41.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:20:41.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:41.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562007+0000", 2024-09-17T02:20:41.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6260000000000001e-06 2024-09-17T02:20:41.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:41.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562021+0000", 2024-09-17T02:20:41.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4440000000000001e-05 2024-09-17T02:20:41.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:41.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562053+0000", 2024-09-17T02:20:41.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2159000000000002e-05 2024-09-17T02:20:41.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:41.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562076+0000", 2024-09-17T02:20:41.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2926999999999999e-05 2024-09-17T02:20:41.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:41.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562218+0000", 2024-09-17T02:20:41.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000141726 2024-09-17T02:20:41.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:41.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562506+0000", 2024-09-17T02:20:41.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028752399999999999 2024-09-17T02:20:41.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:41.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562830+0000", 2024-09-17T02:20:41.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032427399999999999 2024-09-17T02:20:41.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:41.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566900+0000", 2024-09-17T02:20:41.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040705660000000003 2024-09-17T02:20:41.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:41.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583581+0000", 2024-09-17T02:20:41.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016680210000000001 2024-09-17T02:20:41.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:41.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583704+0000", 2024-09-17T02:20:41.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012289899999999999 2024-09-17T02:20:41.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:41.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583803+0000", 2024-09-17T02:20:41.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9579000000000003e-05 2024-09-17T02:20:41.776 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.776 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:41.776 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.776 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:41.776 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:20:41.776 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.212551512000001, 2024-09-17T02:20:41.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022056035000000002, 2024-09-17T02:20:41.777 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:41.777 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:41.777 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:41.777 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:41.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:41.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:20:41.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:41.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:20:41.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:41.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562132+0000", 2024-09-17T02:20:41.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6300000000000001e-06 2024-09-17T02:20:41.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:41.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562142+0000", 2024-09-17T02:20:41.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.022e-05 2024-09-17T02:20:41.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:41.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562164+0000", 2024-09-17T02:20:41.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2002999999999999e-05 2024-09-17T02:20:41.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:41.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562180+0000", 2024-09-17T02:20:41.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5930000000000002e-05 2024-09-17T02:20:41.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:41.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563517+0000", 2024-09-17T02:20:41.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001336776 2024-09-17T02:20:41.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:41.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563635+0000", 2024-09-17T02:20:41.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117976 2024-09-17T02:20:41.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:41.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563819+0000", 2024-09-17T02:20:41.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018411499999999999 2024-09-17T02:20:41.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:41.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566977+0000", 2024-09-17T02:20:41.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031575990000000001 2024-09-17T02:20:41.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:41.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583917+0000", 2024-09-17T02:20:41.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016940093999999999 2024-09-17T02:20:41.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:41.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584066+0000", 2024-09-17T02:20:41.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000149746 2024-09-17T02:20:41.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:41.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584186+0000", 2024-09-17T02:20:41.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011994600000000001 2024-09-17T02:20:41.782 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.782 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:41.782 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.782 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:41.782 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:20:41.782 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.212370800999999, 2024-09-17T02:20:41.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023664803000000002, 2024-09-17T02:20:41.782 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:41.782 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:41.782 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:41.782 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:41.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:41.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:20:41.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:41.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:20:41.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:41.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562313+0000", 2024-09-17T02:20:41.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.764e-06 2024-09-17T02:20:41.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:41.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562323+0000", 2024-09-17T02:20:41.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0166000000000001e-05 2024-09-17T02:20:41.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:41.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562343+0000", 2024-09-17T02:20:41.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9633999999999999e-05 2024-09-17T02:20:41.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:41.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562367+0000", 2024-09-17T02:20:41.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4556e-05 2024-09-17T02:20:41.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:41.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563777+0000", 2024-09-17T02:20:41.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014102330000000001 2024-09-17T02:20:41.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:41.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563969+0000", 2024-09-17T02:20:41.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000191361 2024-09-17T02:20:41.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:41.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564148+0000", 2024-09-17T02:20:41.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017934599999999999 2024-09-17T02:20:41.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:41.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566989+0000", 2024-09-17T02:20:41.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028407010000000002 2024-09-17T02:20:41.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:41.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585770+0000", 2024-09-17T02:20:41.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018781566999999999 2024-09-17T02:20:41.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:41.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585874+0000", 2024-09-17T02:20:41.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103489 2024-09-17T02:20:41.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:41.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585976+0000", 2024-09-17T02:20:41.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101986 2024-09-17T02:20:41.788 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.788 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:41.788 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.788 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:41.788 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:20:41.788 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.212287921000001, 2024-09-17T02:20:41.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024118555999999999, 2024-09-17T02:20:41.788 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:41.788 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:41.788 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:41.788 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:41.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:41.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:20:41.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:41.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:20:41.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:41.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562395+0000", 2024-09-17T02:20:41.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3969999999999999e-06 2024-09-17T02:20:41.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:41.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562405+0000", 2024-09-17T02:20:41.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4229999999999994e-06 2024-09-17T02:20:41.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:41.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562427+0000", 2024-09-17T02:20:41.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759999999999998e-05 2024-09-17T02:20:41.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:41.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562444+0000", 2024-09-17T02:20:41.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7019000000000001e-05 2024-09-17T02:20:41.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:41.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564681+0000", 2024-09-17T02:20:41.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022376929999999998 2024-09-17T02:20:41.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:41.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564887+0000", 2024-09-17T02:20:41.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000206178 2024-09-17T02:20:41.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:41.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565230+0000", 2024-09-17T02:20:41.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034233499999999998 2024-09-17T02:20:41.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:41.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567000+0000", 2024-09-17T02:20:41.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017706390000000001 2024-09-17T02:20:41.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:41.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586126+0000", 2024-09-17T02:20:41.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019125672 2024-09-17T02:20:41.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:41.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586314+0000", 2024-09-17T02:20:41.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018740200000000001 2024-09-17T02:20:41.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:41.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586513+0000", 2024-09-17T02:20:41.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019903799999999999 2024-09-17T02:20:41.793 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.793 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:41.793 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.794 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:41.794 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:20:41.794 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.212213248000001, 2024-09-17T02:20:41.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021940779000000001, 2024-09-17T02:20:41.794 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:41.794 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:41.794 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:41.794 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:41.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:41.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:20:41.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:41.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:20:41.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:41.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562470+0000", 2024-09-17T02:20:41.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5030000000000001e-06 2024-09-17T02:20:41.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:41.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562478+0000", 2024-09-17T02:20:41.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.157e-06 2024-09-17T02:20:41.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:41.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562496+0000", 2024-09-17T02:20:41.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7876e-05 2024-09-17T02:20:41.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:41.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562511+0000", 2024-09-17T02:20:41.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5067e-05 2024-09-17T02:20:41.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:41.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564628+0000", 2024-09-17T02:20:41.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021171860000000001 2024-09-17T02:20:41.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:41.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564838+0000", 2024-09-17T02:20:41.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000209283 2024-09-17T02:20:41.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:41.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565078+0000", 2024-09-17T02:20:41.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024075100000000001 2024-09-17T02:20:41.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:41.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567012+0000", 2024-09-17T02:20:41.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019331050000000001 2024-09-17T02:20:41.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:41.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584289+0000", 2024-09-17T02:20:41.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017277464999999999 2024-09-17T02:20:41.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:41.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584363+0000", 2024-09-17T02:20:41.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3852999999999999e-05 2024-09-17T02:20:41.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:41.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584409+0000", 2024-09-17T02:20:41.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6533000000000003e-05 2024-09-17T02:20:41.799 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.799 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:41.799 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.799 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:41.800 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:20:41.800 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.212149859, 2024-09-17T02:20:41.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020580694, 2024-09-17T02:20:41.800 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:41.800 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:41.800 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:41.800 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:41.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:41.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:20:41.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:41.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:20:41.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:41.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562533+0000", 2024-09-17T02:20:41.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3239999999999999e-06 2024-09-17T02:20:41.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:41.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562541+0000", 2024-09-17T02:20:41.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3529999999999997e-06 2024-09-17T02:20:41.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:41.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562559+0000", 2024-09-17T02:20:41.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8306000000000001e-05 2024-09-17T02:20:41.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:41.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562572+0000", 2024-09-17T02:20:41.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2993000000000001e-05 2024-09-17T02:20:41.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:41.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563230+0000", 2024-09-17T02:20:41.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00065806899999999995 2024-09-17T02:20:41.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:41.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563510+0000", 2024-09-17T02:20:41.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028016400000000001 2024-09-17T02:20:41.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:41.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563677+0000", 2024-09-17T02:20:41.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000166243 2024-09-17T02:20:41.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:41.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566312+0000", 2024-09-17T02:20:41.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026351349999999998 2024-09-17T02:20:41.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:41.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.582943+0000", 2024-09-17T02:20:41.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016631781000000002 2024-09-17T02:20:41.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:41.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583035+0000", 2024-09-17T02:20:41.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1682999999999996e-05 2024-09-17T02:20:41.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:41.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583113+0000", 2024-09-17T02:20:41.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7643000000000002e-05 2024-09-17T02:20:41.805 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.805 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:41.805 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.805 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:41.805 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:20:41.805 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.212042798999999, 2024-09-17T02:20:41.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020802284000000001, 2024-09-17T02:20:41.805 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:41.805 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:41.806 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:41.806 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:41.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:41.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:20:41.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:41.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:20:41.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:41.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562640+0000", 2024-09-17T02:20:41.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.37e-06 2024-09-17T02:20:41.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:41.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562648+0000", 2024-09-17T02:20:41.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.576e-06 2024-09-17T02:20:41.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:41.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562668+0000", 2024-09-17T02:20:41.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0397000000000001e-05 2024-09-17T02:20:41.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:41.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562690+0000", 2024-09-17T02:20:41.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1713e-05 2024-09-17T02:20:41.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:41.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564290+0000", 2024-09-17T02:20:41.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001599397 2024-09-17T02:20:41.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:41.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564527+0000", 2024-09-17T02:20:41.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023731199999999999 2024-09-17T02:20:41.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:41.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583441+0000", 2024-09-17T02:20:41.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018914519000000001 2024-09-17T02:20:41.809 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.809 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:41.809 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.809 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:41.809 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:20:41.809 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.211967724000001, 2024-09-17T02:20:41.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021867154, 2024-09-17T02:20:41.810 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:41.810 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:41.810 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:41.810 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:41.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:41.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:20:41.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:41.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:20:41.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:41.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562716+0000", 2024-09-17T02:20:41.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.384e-06 2024-09-17T02:20:41.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:41.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562726+0000", 2024-09-17T02:20:41.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.04e-05 2024-09-17T02:20:41.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:41.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562745+0000", 2024-09-17T02:20:41.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8770000000000002e-05 2024-09-17T02:20:41.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:41.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562759+0000", 2024-09-17T02:20:41.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4392999999999999e-05 2024-09-17T02:20:41.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:41.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565882+0000", 2024-09-17T02:20:41.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031227659999999999 2024-09-17T02:20:41.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:41.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566217+0000", 2024-09-17T02:20:41.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033498000000000002 2024-09-17T02:20:41.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:41.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584581+0000", 2024-09-17T02:20:41.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018364460999999999 2024-09-17T02:20:41.813 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.813 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:41.813 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.814 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:41.814 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562778+0000", 2024-09-17T02:20:41.814 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.211903586999998, 2024-09-17T02:20:41.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018969949, 2024-09-17T02:20:41.814 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:41.814 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:41.814 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:41.814 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:41.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:41.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562778+0000", 2024-09-17T02:20:41.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:41.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562778+0000", 2024-09-17T02:20:41.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:41.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562779+0000", 2024-09-17T02:20:41.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0470000000000001e-06 2024-09-17T02:20:41.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:41.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562798+0000", 2024-09-17T02:20:41.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8723e-05 2024-09-17T02:20:41.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:41.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562819+0000", 2024-09-17T02:20:41.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1192999999999999e-05 2024-09-17T02:20:41.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:41.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562834+0000", 2024-09-17T02:20:41.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4619e-05 2024-09-17T02:20:41.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:41.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562977+0000", 2024-09-17T02:20:41.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014338900000000001 2024-09-17T02:20:41.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:41.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563366+0000", 2024-09-17T02:20:41.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038909399999999999 2024-09-17T02:20:41.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:41.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.581748+0000", 2024-09-17T02:20:41.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018381884000000001 2024-09-17T02:20:41.818 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.818 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:41.818 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.818 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:1227 5.3 5:c07fff60:::benchmark_data_smithi001_23533_object1226:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:41.818 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.165009+0000", 2024-09-17T02:20:41.818 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6096730229999991, 2024-09-17T02:20:41.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016027434, 2024-09-17T02:20:41.818 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:41.818 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:41.818 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:41.818 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:41.818 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:41.819 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:41.819 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1227 2024-09-17T02:20:41.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.819 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:41.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:41.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165009+0000", 2024-09-17T02:20:41.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:41.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165009+0000", 2024-09-17T02:20:41.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:41.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165010+0000", 2024-09-17T02:20:41.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9800000000000003e-07 2024-09-17T02:20:41.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:41.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165045+0000", 2024-09-17T02:20:41.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5231999999999997e-05 2024-09-17T02:20:41.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:41.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165053+0000", 2024-09-17T02:20:41.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9289999999999998e-06 2024-09-17T02:20:41.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:41.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165058+0000", 2024-09-17T02:20:41.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6689999999999997e-06 2024-09-17T02:20:41.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:41.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165611+0000", 2024-09-17T02:20:41.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00055364200000000002 2024-09-17T02:20:41.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:41.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165764+0000", 2024-09-17T02:20:41.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000153132 2024-09-17T02:20:41.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:41.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166112+0000", 2024-09-17T02:20:41.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034738599999999998 2024-09-17T02:20:41.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:41.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168392+0000", 2024-09-17T02:20:41.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022802809999999999 2024-09-17T02:20:41.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:41.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.180931+0000", 2024-09-17T02:20:41.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012538785 2024-09-17T02:20:41.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:41.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.180994+0000", 2024-09-17T02:20:41.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3477000000000002e-05 2024-09-17T02:20:41.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:41.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181036+0000", 2024-09-17T02:20:41.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2103e-05 2024-09-17T02:20:41.824 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.824 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:41.824 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.824 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:1235 5.2 e24/22 5:45d66796:::benchmark_data_smithi001_23533_object1234:head v 24'85, mlcod=24'82)", 2024-09-17T02:20:41.824 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.166626+0000", 2024-09-17T02:20:41.824 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6080560649999995, 2024-09-17T02:20:41.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014289484, 2024-09-17T02:20:41.824 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:41.824 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:41.824 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:41.825 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:41.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:41.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166626+0000", 2024-09-17T02:20:41.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:41.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166626+0000", 2024-09-17T02:20:41.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:41.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166626+0000", 2024-09-17T02:20:41.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5799999999999999e-07 2024-09-17T02:20:41.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:41.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166672+0000", 2024-09-17T02:20:41.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5500999999999997e-05 2024-09-17T02:20:41.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:41.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166679+0000", 2024-09-17T02:20:41.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.515e-06 2024-09-17T02:20:41.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:41.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166684+0000", 2024-09-17T02:20:41.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5619999999999997e-06 2024-09-17T02:20:41.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:41.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166723+0000", 2024-09-17T02:20:41.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9410999999999999e-05 2024-09-17T02:20:41.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:41.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166741+0000", 2024-09-17T02:20:41.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7731999999999999e-05 2024-09-17T02:20:41.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:41.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168402+0000", 2024-09-17T02:20:41.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001660641 2024-09-17T02:20:41.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:41.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.180915+0000", 2024-09-17T02:20:41.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012513564 2024-09-17T02:20:41.828 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.828 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:41.828 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.829 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:1236 5.c 5:3ba82733:::benchmark_data_smithi001_23533_object1235:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:41.829 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.167104+0000", 2024-09-17T02:20:41.829 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6075779509999997, 2024-09-17T02:20:41.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014191949000000001, 2024-09-17T02:20:41.829 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:41.829 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:41.829 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:41.829 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:41.829 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:41.829 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:41.829 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1236 2024-09-17T02:20:41.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.830 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:41.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:41.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167104+0000", 2024-09-17T02:20:41.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:41.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167104+0000", 2024-09-17T02:20:41.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:41.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167105+0000", 2024-09-17T02:20:41.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7400000000000002e-07 2024-09-17T02:20:41.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:41.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167181+0000", 2024-09-17T02:20:41.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6458000000000006e-05 2024-09-17T02:20:41.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:41.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167191+0000", 2024-09-17T02:20:41.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3160000000000003e-06 2024-09-17T02:20:41.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:41.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167197+0000", 2024-09-17T02:20:41.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9270000000000002e-06 2024-09-17T02:20:41.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:41.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167247+0000", 2024-09-17T02:20:41.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0930999999999997e-05 2024-09-17T02:20:41.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:41.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167396+0000", 2024-09-17T02:20:41.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014842100000000001 2024-09-17T02:20:41.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:41.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.167483+0000", 2024-09-17T02:20:41.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6914000000000002e-05 2024-09-17T02:20:41.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:41.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181143+0000", 2024-09-17T02:20:41.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013660347 2024-09-17T02:20:41.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:41.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181167+0000", 2024-09-17T02:20:41.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3411e-05 2024-09-17T02:20:41.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:41.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181243+0000", 2024-09-17T02:20:41.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.64e-05 2024-09-17T02:20:41.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:41.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181296+0000", 2024-09-17T02:20:41.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.295e-05 2024-09-17T02:20:41.836 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.836 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:41.836 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.836 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:1245 5.5 5:ad8970a7:::benchmark_data_smithi001_23533_object1244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:41.836 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.168368+0000", 2024-09-17T02:20:41.836 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6063143600000007, 2024-09-17T02:20:41.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014038418, 2024-09-17T02:20:41.836 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:41.837 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:41.837 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:41.837 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:41.837 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:41.837 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:41.837 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1245 2024-09-17T02:20:41.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.837 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:41.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:41.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168368+0000", 2024-09-17T02:20:41.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:41.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168368+0000", 2024-09-17T02:20:41.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:41.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168368+0000", 2024-09-17T02:20:41.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8100000000000001e-07 2024-09-17T02:20:41.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:41.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168428+0000", 2024-09-17T02:20:41.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9386999999999999e-05 2024-09-17T02:20:41.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:41.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168452+0000", 2024-09-17T02:20:41.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4649000000000001e-05 2024-09-17T02:20:41.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:41.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168461+0000", 2024-09-17T02:20:41.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0490000000000004e-06 2024-09-17T02:20:41.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:41.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168510+0000", 2024-09-17T02:20:41.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9190999999999997e-05 2024-09-17T02:20:41.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:41.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168629+0000", 2024-09-17T02:20:41.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011922 2024-09-17T02:20:41.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:41.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168760+0000", 2024-09-17T02:20:41.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131042 2024-09-17T02:20:41.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:41.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181731+0000", 2024-09-17T02:20:41.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012970735000000001 2024-09-17T02:20:41.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:41.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.182320+0000", 2024-09-17T02:20:41.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00058966200000000002 2024-09-17T02:20:41.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:41.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.182370+0000", 2024-09-17T02:20:41.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9709000000000001e-05 2024-09-17T02:20:41.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:41.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.182406+0000", 2024-09-17T02:20:41.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5892999999999997e-05 2024-09-17T02:20:41.842 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.842 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:41.842 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.843 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:1246 5.6 5:67c897d3:::benchmark_data_smithi001_23533_object1245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:41.843 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.168478+0000", 2024-09-17T02:20:41.843 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6062041810000007, 2024-09-17T02:20:41.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014731975, 2024-09-17T02:20:41.843 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:41.843 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:41.843 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:41.843 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:41.843 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:41.843 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:41.843 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1246 2024-09-17T02:20:41.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.843 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:41.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:41.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168478+0000", 2024-09-17T02:20:41.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:41.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168478+0000", 2024-09-17T02:20:41.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:41.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168478+0000", 2024-09-17T02:20:41.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5199999999999996e-07 2024-09-17T02:20:41.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:41.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168514+0000", 2024-09-17T02:20:41.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5132999999999997e-05 2024-09-17T02:20:41.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:41.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168523+0000", 2024-09-17T02:20:41.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4669999999999993e-06 2024-09-17T02:20:41.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:41.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168532+0000", 2024-09-17T02:20:41.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7660000000000004e-06 2024-09-17T02:20:41.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:41.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168581+0000", 2024-09-17T02:20:41.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8689000000000001e-05 2024-09-17T02:20:41.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:41.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168698+0000", 2024-09-17T02:20:41.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117386 2024-09-17T02:20:41.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:41.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168816+0000", 2024-09-17T02:20:41.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000118118 2024-09-17T02:20:41.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:41.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181677+0000", 2024-09-17T02:20:41.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012861256 2024-09-17T02:20:41.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:41.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.183098+0000", 2024-09-17T02:20:41.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001420745 2024-09-17T02:20:41.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:41.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.183167+0000", 2024-09-17T02:20:41.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8508000000000002e-05 2024-09-17T02:20:41.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:41.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.183210+0000", 2024-09-17T02:20:41.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3155000000000003e-05 2024-09-17T02:20:41.848 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.848 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:41.849 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.849 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:15676 5.8 5:1597a883:::benchmark_data_smithi001_23533_object15675:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-17T02:20:41.849 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:38.304260+0000", 2024-09-17T02:20:41.849 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.4704215500000002, 2024-09-17T02:20:41.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014373294999999999, 2024-09-17T02:20:41.849 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:41.849 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:41.849 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:41.849 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:41.849 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:41.849 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:41.850 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15676 2024-09-17T02:20:41.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.850 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:41.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:41.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.304260+0000", 2024-09-17T02:20:41.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:41.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.304260+0000", 2024-09-17T02:20:41.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:41.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.304261+0000", 2024-09-17T02:20:41.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0200000000000001e-07 2024-09-17T02:20:41.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:41.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.304348+0000", 2024-09-17T02:20:41.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7380999999999996e-05 2024-09-17T02:20:41.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:41.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.304355+0000", 2024-09-17T02:20:41.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0299999999999996e-06 2024-09-17T02:20:41.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:41.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.304360+0000", 2024-09-17T02:20:41.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6859999999999997e-06 2024-09-17T02:20:41.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:41.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.304931+0000", 2024-09-17T02:20:41.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00057059700000000005 2024-09-17T02:20:41.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:41.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.305061+0000", 2024-09-17T02:20:41.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130102 2024-09-17T02:20:41.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:41.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.305208+0000", 2024-09-17T02:20:41.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000146811 2024-09-17T02:20:41.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:41.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.308586+0000", 2024-09-17T02:20:41.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033781280000000002 2024-09-17T02:20:41.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:41.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.318573+0000", 2024-09-17T02:20:41.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0099872829999999996 2024-09-17T02:20:41.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:41.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.318609+0000", 2024-09-17T02:20:41.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5839e-05 2024-09-17T02:20:41.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:41.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.318634+0000", 2024-09-17T02:20:41.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4736000000000002e-05 2024-09-17T02:20:41.855 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.855 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:41.855 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.855 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:15677 5.0 5:074d23dc:::benchmark_data_smithi001_23533_object15676:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-17T02:20:41.855 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:38.304371+0000", 2024-09-17T02:20:41.855 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.4703106359999998, 2024-09-17T02:20:41.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014340502999999999, 2024-09-17T02:20:41.855 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:41.855 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:41.855 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:41.855 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:41.855 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:41.856 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:41.856 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15677 2024-09-17T02:20:41.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.856 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:41.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:41.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.304371+0000", 2024-09-17T02:20:41.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:41.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.304371+0000", 2024-09-17T02:20:41.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:41.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.304372+0000", 2024-09-17T02:20:41.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3500000000000002e-07 2024-09-17T02:20:41.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:41.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.304428+0000", 2024-09-17T02:20:41.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5887999999999998e-05 2024-09-17T02:20:41.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:41.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.304435+0000", 2024-09-17T02:20:41.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3150000000000003e-06 2024-09-17T02:20:41.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:41.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.304440+0000", 2024-09-17T02:20:41.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1320000000000002e-06 2024-09-17T02:20:41.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:41.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.304848+0000", 2024-09-17T02:20:41.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00040751999999999997 2024-09-17T02:20:41.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:41.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.304972+0000", 2024-09-17T02:20:41.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012491100000000001 2024-09-17T02:20:41.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:41.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.305115+0000", 2024-09-17T02:20:41.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000142037 2024-09-17T02:20:41.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:41.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.308567+0000", 2024-09-17T02:20:41.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003452929 2024-09-17T02:20:41.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:41.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.318639+0000", 2024-09-17T02:20:41.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010071088000000001 2024-09-17T02:20:41.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:41.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.318678+0000", 2024-09-17T02:20:41.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9700000000000003e-05 2024-09-17T02:20:41.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:41.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.318712+0000", 2024-09-17T02:20:41.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3547999999999998e-05 2024-09-17T02:20:41.860 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.861 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:41.861 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.861 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:15718 5.c 5:3bb46453:::benchmark_data_smithi001_23533_object15717:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-17T02:20:41.861 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:38.321983+0000", 2024-09-17T02:20:41.861 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.4526989820000002, 2024-09-17T02:20:41.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014155806, 2024-09-17T02:20:41.861 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:41.861 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:41.861 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:41.861 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:41.861 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:41.862 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:41.862 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15718 2024-09-17T02:20:41.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.862 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:41.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:41.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.321983+0000", 2024-09-17T02:20:41.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:41.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.321983+0000", 2024-09-17T02:20:41.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:41.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.321984+0000", 2024-09-17T02:20:41.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7199999999999997e-07 2024-09-17T02:20:41.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:41.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.322078+0000", 2024-09-17T02:20:41.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4530000000000005e-05 2024-09-17T02:20:41.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:41.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.322087+0000", 2024-09-17T02:20:41.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8249999999999994e-06 2024-09-17T02:20:41.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:41.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.322094+0000", 2024-09-17T02:20:41.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1060000000000002e-06 2024-09-17T02:20:41.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:41.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.324539+0000", 2024-09-17T02:20:41.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024447409999999998 2024-09-17T02:20:41.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:41.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.324661+0000", 2024-09-17T02:20:41.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000121582 2024-09-17T02:20:41.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:41.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.324786+0000", 2024-09-17T02:20:41.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000125702 2024-09-17T02:20:41.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:41.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.327321+0000", 2024-09-17T02:20:41.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025351140000000002 2024-09-17T02:20:41.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:41.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.336034+0000", 2024-09-17T02:20:41.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008712905 2024-09-17T02:20:41.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:41.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.336113+0000", 2024-09-17T02:20:41.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8998999999999994e-05 2024-09-17T02:20:41.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:41.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.336139+0000", 2024-09-17T02:20:41.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5429999999999999e-05 2024-09-17T02:20:41.867 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.867 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:41.867 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.867 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:15721 5.c 5:3761eeb9:::benchmark_data_smithi001_23533_object15720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-17T02:20:41.867 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:38.322185+0000", 2024-09-17T02:20:41.867 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.4524965239999998, 2024-09-17T02:20:41.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014040133999999999, 2024-09-17T02:20:41.867 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:41.867 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:41.868 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:41.868 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:41.868 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:41.868 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:41.868 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15721 2024-09-17T02:20:41.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.868 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:41.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:41.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.322185+0000", 2024-09-17T02:20:41.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:41.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.322185+0000", 2024-09-17T02:20:41.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:41.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.322186+0000", 2024-09-17T02:20:41.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3799999999999997e-07 2024-09-17T02:20:41.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:41.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.322213+0000", 2024-09-17T02:20:41.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7555e-05 2024-09-17T02:20:41.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:41.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.322219+0000", 2024-09-17T02:20:41.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0799999999999996e-06 2024-09-17T02:20:41.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:41.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.322222+0000", 2024-09-17T02:20:41.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.393e-06 2024-09-17T02:20:41.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:41.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.327468+0000", 2024-09-17T02:20:41.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052460900000000001 2024-09-17T02:20:41.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:41.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.327629+0000", 2024-09-17T02:20:41.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016066400000000001 2024-09-17T02:20:41.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:41.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.327784+0000", 2024-09-17T02:20:41.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015578200000000001 2024-09-17T02:20:41.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:41.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.334125+0000", 2024-09-17T02:20:41.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063409390000000003 2024-09-17T02:20:41.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:41.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.336147+0000", 2024-09-17T02:20:41.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020216779999999998 2024-09-17T02:20:41.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:41.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.336190+0000", 2024-09-17T02:20:41.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2800999999999999e-05 2024-09-17T02:20:41.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:41.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:38.336226+0000", 2024-09-17T02:20:41.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5614000000000002e-05 2024-09-17T02:20:41.873 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.873 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:41.873 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.874 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:26132 5.c 5:3ae49ef5:::benchmark_data_smithi001_23533_object26131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:41.874 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:41.688378+0000", 2024-09-17T02:20:41.874 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.086303505000000003, 2024-09-17T02:20:41.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017107691000000001, 2024-09-17T02:20:41.874 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:41.874 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:41.874 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:41.874 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:41.874 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:41.874 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:41.874 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 26132 2024-09-17T02:20:41.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.875 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:41.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:41.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688378+0000", 2024-09-17T02:20:41.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:41.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688378+0000", 2024-09-17T02:20:41.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:41.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688379+0000", 2024-09-17T02:20:41.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.048e-06 2024-09-17T02:20:41.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:41.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688407+0000", 2024-09-17T02:20:41.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7271e-05 2024-09-17T02:20:41.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:41.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688418+0000", 2024-09-17T02:20:41.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1333e-05 2024-09-17T02:20:41.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:41.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688433+0000", 2024-09-17T02:20:41.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4764e-05 2024-09-17T02:20:41.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:41.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688971+0000", 2024-09-17T02:20:41.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00053786399999999999 2024-09-17T02:20:41.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:41.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.689087+0000", 2024-09-17T02:20:41.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000116385 2024-09-17T02:20:41.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:41.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.689226+0000", 2024-09-17T02:20:41.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013938199999999999 2024-09-17T02:20:41.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:41.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.691077+0000", 2024-09-17T02:20:41.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001850806 2024-09-17T02:20:41.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:41.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.705392+0000", 2024-09-17T02:20:41.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014315006999999999 2024-09-17T02:20:41.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:41.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.705449+0000", 2024-09-17T02:20:41.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7101000000000001e-05 2024-09-17T02:20:41.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:41.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.705486+0000", 2024-09-17T02:20:41.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6730000000000002e-05 2024-09-17T02:20:41.879 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.879 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:41.879 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.880 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:26133 5.5 5:a365a85e:::benchmark_data_smithi001_23533_object26132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:41.880 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:41.688741+0000", 2024-09-17T02:20:41.880 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.085941237000000004, 2024-09-17T02:20:41.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015492462, 2024-09-17T02:20:41.880 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:41.880 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:41.880 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:41.880 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:41.880 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:41.880 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:41.880 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 26133 2024-09-17T02:20:41.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.881 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:41.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:41.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688741+0000", 2024-09-17T02:20:41.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:41.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688741+0000", 2024-09-17T02:20:41.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:41.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:41.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688741+0000", 2024-09-17T02:20:41.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9100000000000003e-07 2024-09-17T02:20:41.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:41.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688847+0000", 2024-09-17T02:20:41.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105612 2024-09-17T02:20:41.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:41.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688855+0000", 2024-09-17T02:20:41.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8359999999999992e-06 2024-09-17T02:20:41.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:41.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688860+0000", 2024-09-17T02:20:41.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6990000000000002e-06 2024-09-17T02:20:41.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:41.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688957+0000", 2024-09-17T02:20:41.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7384000000000001e-05 2024-09-17T02:20:41.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:41.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.689088+0000", 2024-09-17T02:20:41.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013131199999999999 2024-09-17T02:20:41.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:41.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.689211+0000", 2024-09-17T02:20:41.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012225499999999999 2024-09-17T02:20:41.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:41.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.691078+0000", 2024-09-17T02:20:41.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018674780000000001 2024-09-17T02:20:41.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:41.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.704135+0000", 2024-09-17T02:20:41.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013057302999999999 2024-09-17T02:20:41.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:41.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.704198+0000", 2024-09-17T02:20:41.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2551999999999993e-05 2024-09-17T02:20:41.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:41.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:41.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:41.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.704233+0000", 2024-09-17T02:20:41.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5240000000000001e-05 2024-09-17T02:20:41.885 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.885 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:41.886 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.886 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:41.886 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:41.886 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:20:41.887 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:20:41.888 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:41.889+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:41.987 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:41.992+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:42.048 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:20:42.048 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-17T02:20:42.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.049 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:27204 5.2 5:4b0c7fce:::benchmark_data_smithi001_23533_object27203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:42.049 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.050005+0000", 2024-09-17T02:20:42.049 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.003226264, 2024-09-17T02:20:42.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003252535, 2024-09-17T02:20:42.049 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.049 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.049 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:42.049 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:42.049 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:42.049 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:42.049 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 27204 2024-09-17T02:20:42.050 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.050 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.050 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.050 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.050005+0000", 2024-09-17T02:20:42.050 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.050 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.050 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.050 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.050005+0000", 2024-09-17T02:20:42.050 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.050 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.050006+0000", 2024-09-17T02:20:42.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7800000000000001e-07 2024-09-17T02:20:42.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.051 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.050083+0000", 2024-09-17T02:20:42.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6926000000000002e-05 2024-09-17T02:20:42.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.051 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.050091+0000", 2024-09-17T02:20:42.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4279999999999996e-06 2024-09-17T02:20:42.052 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.052 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.052 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.050098+0000", 2024-09-17T02:20:42.052 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1700000000000002e-06 2024-09-17T02:20:42.052 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.052 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:42.052 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.050729+0000", 2024-09-17T02:20:42.052 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00063084700000000003 2024-09-17T02:20:42.052 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.052 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:42.053 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.050842+0000", 2024-09-17T02:20:42.053 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011318 2024-09-17T02:20:42.053 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.053 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.053 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:42.053 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.050959+0000", 2024-09-17T02:20:42.053 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000116895 2024-09-17T02:20:42.053 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.053 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.053 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:42.053 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.052423+0000", 2024-09-17T02:20:42.053 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014642469999999999 2024-09-17T02:20:42.053 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.053 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.054 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.054 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.054 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.054 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:27205 5.1 5:85ead4ac:::benchmark_data_smithi001_23533_object27204:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:42.054 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.050611+0000", 2024-09-17T02:20:42.054 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.002620926, 2024-09-17T02:20:42.054 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027200219999999999, 2024-09-17T02:20:42.054 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.054 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.054 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:42.054 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:42.054 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:42.054 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:42.054 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 27205 2024-09-17T02:20:42.055 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.055 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.055 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.055 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.055 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.050611+0000", 2024-09-17T02:20:42.055 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.055 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.055 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.055 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.055 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.050611+0000", 2024-09-17T02:20:42.055 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.055 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.055 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.055 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.056 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.050612+0000", 2024-09-17T02:20:42.056 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0900000000000001e-07 2024-09-17T02:20:42.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.056 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.056 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.056 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.050645+0000", 2024-09-17T02:20:42.056 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3924000000000002e-05 2024-09-17T02:20:42.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.056 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.056 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.056 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.050655+0000", 2024-09-17T02:20:42.056 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.3780000000000007e-06 2024-09-17T02:20:42.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.057 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.057 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.057 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.050665+0000", 2024-09-17T02:20:42.057 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8449999999999998e-06 2024-09-17T02:20:42.057 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.057 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.057 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:42.057 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.051510+0000", 2024-09-17T02:20:42.057 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00084575299999999998 2024-09-17T02:20:42.057 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.057 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.057 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:42.057 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.051660+0000", 2024-09-17T02:20:42.057 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000149949 2024-09-17T02:20:42.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.058 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.058 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:42.058 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.051795+0000", 2024-09-17T02:20:42.058 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013466899999999999 2024-09-17T02:20:42.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.058 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.058 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:42.058 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053078+0000", 2024-09-17T02:20:42.058 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0012833600000000001 2024-09-17T02:20:42.058 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.058 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.058 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.059 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:27206 5.5 e28/22 5:a85b5e4f:::benchmark_data_smithi001_23533_object27205:head v 28'1710, mlcod=28'1708)", 2024-09-17T02:20:42.059 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.052040+0000", 2024-09-17T02:20:42.059 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0011921130000000001, 2024-09-17T02:20:42.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014006769999999999, 2024-09-17T02:20:42.059 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.059 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.059 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:20:42.059 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.052040+0000", 2024-09-17T02:20:42.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.060 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.060 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.060 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.052040+0000", 2024-09-17T02:20:42.060 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.060 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.060 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.060 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.052040+0000", 2024-09-17T02:20:42.060 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9999999999999998e-07 2024-09-17T02:20:42.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.060 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.060 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.061 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.052082+0000", 2024-09-17T02:20:42.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2061999999999998e-05 2024-09-17T02:20:42.061 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.061 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.061 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.052089+0000", 2024-09-17T02:20:42.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0539999999999997e-06 2024-09-17T02:20:42.061 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.061 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.061 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.052094+0000", 2024-09-17T02:20:42.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4050000000000002e-06 2024-09-17T02:20:42.061 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.062 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:42.062 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.052128+0000", 2024-09-17T02:20:42.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3887000000000003e-05 2024-09-17T02:20:42.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.062 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.062 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:42.062 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.052140+0000", 2024-09-17T02:20:42.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2482e-05 2024-09-17T02:20:42.062 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.062 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.062 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.062 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.063 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:27210 5.d 5:b8dcb6de:::benchmark_data_smithi001_23533_object27209:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:42.063 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.052738+0000", 2024-09-17T02:20:42.063 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.00049386299999999998, 2024-09-17T02:20:42.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00074837000000000005, 2024-09-17T02:20:42.063 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.063 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.063 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:42.063 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:42.063 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:42.063 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:42.063 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 27210 2024-09-17T02:20:42.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.063 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.052738+0000", 2024-09-17T02:20:42.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.052738+0000", 2024-09-17T02:20:42.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.052739+0000", 2024-09-17T02:20:42.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4499999999999996e-07 2024-09-17T02:20:42.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.065 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.065 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.052861+0000", 2024-09-17T02:20:42.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000122031 2024-09-17T02:20:42.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.065 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.065 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.052869+0000", 2024-09-17T02:20:42.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0469999999999994e-06 2024-09-17T02:20:42.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.066 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.066 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.052879+0000", 2024-09-17T02:20:42.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0179e-05 2024-09-17T02:20:42.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.066 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:42.066 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.052921+0000", 2024-09-17T02:20:42.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1964e-05 2024-09-17T02:20:42.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.066 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:42.066 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053073+0000", 2024-09-17T02:20:42.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015211200000000001 2024-09-17T02:20:42.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.067 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:42.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053211+0000", 2024-09-17T02:20:42.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013766000000000001 2024-09-17T02:20:42.067 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.067 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.067 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.067 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:27215 5.d 5.28e5d3fd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:42.068 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.053218+0000", 2024-09-17T02:20:42.068 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 1.3947999999999999e-05, 2024-09-17T02:20:42.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031929000000000001, 2024-09-17T02:20:42.068 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.068 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.068 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "queued for pg", 2024-09-17T02:20:42.068 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:42.068 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:42.068 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:42.068 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 27215 2024-09-17T02:20:42.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.068 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053218+0000", 2024-09-17T02:20:42.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053218+0000", 2024-09-17T02:20:42.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.070 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.070 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053218+0000", 2024-09-17T02:20:42.070 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9999999999999997e-07 2024-09-17T02:20:42.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.070 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.070 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053271+0000", 2024-09-17T02:20:42.070 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2908000000000002e-05 2024-09-17T02:20:42.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.071 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.071 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053286+0000", 2024-09-17T02:20:42.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4983999999999999e-05 2024-09-17T02:20:42.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.071 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.071 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053292+0000", 2024-09-17T02:20:42.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.5500000000000002e-06 2024-09-17T02:20:42.071 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.071 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.071 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.072 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.072 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.072 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:27216 5.d 5.40f1cf8d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:42.072 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.053304+0000", 2024-09-17T02:20:42.072 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4294967295.9999275, 2024-09-17T02:20:42.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00026807699999999997, 2024-09-17T02:20:42.072 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.072 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.072 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "queued for pg", 2024-09-17T02:20:42.072 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:42.072 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:42.072 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:42.072 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 27216 2024-09-17T02:20:42.073 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.073 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.073 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.073 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053304+0000", 2024-09-17T02:20:42.073 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.073 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.073 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.073 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053304+0000", 2024-09-17T02:20:42.073 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.073 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053305+0000", 2024-09-17T02:20:42.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1899999999999998e-07 2024-09-17T02:20:42.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053337+0000", 2024-09-17T02:20:42.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2629000000000002e-05 2024-09-17T02:20:42.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053345+0000", 2024-09-17T02:20:42.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4959999999999999e-06 2024-09-17T02:20:42.075 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.075 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.075 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053348+0000", 2024-09-17T02:20:42.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.703e-06 2024-09-17T02:20:42.075 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.075 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.075 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.075 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.075 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:27209 5.5 e28/22)", 2024-09-17T02:20:42.075 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.053369+0000", 2024-09-17T02:20:42.075 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4294967295.9998631, 2024-09-17T02:20:42.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000231401, 2024-09-17T02:20:42.076 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.076 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.076 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "queued for pg", 2024-09-17T02:20:42.076 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.076 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053369+0000", 2024-09-17T02:20:42.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053369+0000", 2024-09-17T02:20:42.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053370+0000", 2024-09-17T02:20:42.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9999999999999996e-07 2024-09-17T02:20:42.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053428+0000", 2024-09-17T02:20:42.078 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8819e-05 2024-09-17T02:20:42.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.078 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.078 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053439+0000", 2024-09-17T02:20:42.078 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0409e-05 2024-09-17T02:20:42.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.078 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.078 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053444+0000", 2024-09-17T02:20:42.078 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2179999999999998e-06 2024-09-17T02:20:42.078 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.078 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.078 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.079 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:27211 5.c e28/22 5:3607d55b:::benchmark_data_smithi001_23533_object27210:head v 28'1665, mlcod=28'1663)", 2024-09-17T02:20:42.079 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.053455+0000", 2024-09-17T02:20:42.079 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4294967295.9997768, 2024-09-17T02:20:42.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017372500000000001, 2024-09-17T02:20:42.079 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.079 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.079 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:20:42.079 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.079 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.079 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053455+0000", 2024-09-17T02:20:42.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.080 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.080 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.080 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.080 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053455+0000", 2024-09-17T02:20:42.080 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.080 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.080 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.080 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.080 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053455+0000", 2024-09-17T02:20:42.080 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0800000000000001e-07 2024-09-17T02:20:42.080 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.080 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.080 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.080 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053487+0000", 2024-09-17T02:20:42.081 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2194999999999999e-05 2024-09-17T02:20:42.081 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.081 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.081 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.081 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053495+0000", 2024-09-17T02:20:42.081 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3980000000000002e-06 2024-09-17T02:20:42.081 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.081 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.081 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.081 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053498+0000", 2024-09-17T02:20:42.081 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3799999999999998e-06 2024-09-17T02:20:42.081 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.081 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.081 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:42.082 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053539+0000", 2024-09-17T02:20:42.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0444000000000001e-05 2024-09-17T02:20:42.082 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.082 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.082 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:42.082 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.053559+0000", 2024-09-17T02:20:42.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0506e-05 2024-09-17T02:20:42.082 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.082 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.082 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.082 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.082 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-09-17T02:20:42.082 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 8 2024-09-17T02:20:42.083 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:20:42.083 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:20:42.083 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-17T02:20:42.083 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 28, 2024-09-17T02:20:42.084 INFO:teuthology.orchestra.run.smithi001.stdout: "fsid": "37cd4495-4915-41f4-bad2-2394cbe235f3", 2024-09-17T02:20:42.084 INFO:teuthology.orchestra.run.smithi001.stdout: "created": "2024-09-17T02:19:52.516342+0000", 2024-09-17T02:20:42.084 INFO:teuthology.orchestra.run.smithi001.stdout: "modified": "2024-09-17T02:20:39.693121+0000", 2024-09-17T02:20:42.084 INFO:teuthology.orchestra.run.smithi001.stdout: "last_up_change": "2024-09-17T02:20:02.422255+0000", 2024-09-17T02:20:42.084 INFO:teuthology.orchestra.run.smithi001.stdout: "last_in_change": "2024-09-17T02:19:54.329423+0000", 2024-09-17T02:20:42.084 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T02:20:42.084 INFO:teuthology.orchestra.run.smithi001.stdout: "flags_num": 5799936, 2024-09-17T02:20:42.084 INFO:teuthology.orchestra.run.smithi001.stdout: "flags_set": [ 2024-09-17T02:20:42.084 INFO:teuthology.orchestra.run.smithi001.stdout: "pglog_hardlimit", 2024-09-17T02:20:42.084 INFO:teuthology.orchestra.run.smithi001.stdout: "purged_snapdirs", 2024-09-17T02:20:42.084 INFO:teuthology.orchestra.run.smithi001.stdout: "recovery_deletes", 2024-09-17T02:20:42.084 INFO:teuthology.orchestra.run.smithi001.stdout: "sortbitwise" 2024-09-17T02:20:42.084 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-17T02:20:42.085 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_version": 5, 2024-09-17T02:20:42.085 INFO:teuthology.orchestra.run.smithi001.stdout: "full_ratio": 0.94999998807907104, 2024-09-17T02:20:42.085 INFO:teuthology.orchestra.run.smithi001.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-17T02:20:42.085 INFO:teuthology.orchestra.run.smithi001.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-17T02:20:42.085 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_snapshot": "", 2024-09-17T02:20:42.085 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_max": 5, 2024-09-17T02:20:42.085 INFO:teuthology.orchestra.run.smithi001.stdout: "max_osd": 3, 2024-09-17T02:20:42.085 INFO:teuthology.orchestra.run.smithi001.stdout: "require_min_compat_client": "luminous", 2024-09-17T02:20:42.085 INFO:teuthology.orchestra.run.smithi001.stdout: "min_compat_client": "jewel", 2024-09-17T02:20:42.085 INFO:teuthology.orchestra.run.smithi001.stdout: "require_osd_release": "squid", 2024-09-17T02:20:42.085 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_crimson": false, 2024-09-17T02:20:42.086 INFO:teuthology.orchestra.run.smithi001.stdout: "pools": [ 2024-09-17T02:20:42.086 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.086 INFO:teuthology.orchestra.run.smithi001.stdout: "pool": 1, 2024-09-17T02:20:42.086 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": ".mgr", 2024-09-17T02:20:42.086 INFO:teuthology.orchestra.run.smithi001.stdout: "create_time": "2024-09-17T02:20:03.416336+0000", 2024-09-17T02:20:42.086 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-17T02:20:42.086 INFO:teuthology.orchestra.run.smithi001.stdout: "flags_names": "hashpspool", 2024-09-17T02:20:42.086 INFO:teuthology.orchestra.run.smithi001.stdout: "type": 1, 2024-09-17T02:20:42.086 INFO:teuthology.orchestra.run.smithi001.stdout: "size": 2, 2024-09-17T02:20:42.086 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": 1, 2024-09-17T02:20:42.086 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_rule": 0, 2024-09-17T02:20:42.086 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:20:42.086 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:20:42.087 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:20:42.087 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:20:42.087 INFO:teuthology.orchestra.run.smithi001.stdout: "is_stretch_pool": false, 2024-09-17T02:20:42.087 INFO:teuthology.orchestra.run.smithi001.stdout: "object_hash": 2, 2024-09-17T02:20:42.087 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:20:42.087 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": 1, 2024-09-17T02:20:42.087 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num": 1, 2024-09-17T02:20:42.087 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num_target": 1, 2024-09-17T02:20:42.087 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_target": 1, 2024-09-17T02:20:42.087 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_pending": 1, 2024-09-17T02:20:42.087 INFO:teuthology.orchestra.run.smithi001.stdout: "last_pg_merge_meta": { 2024-09-17T02:20:42.087 INFO:teuthology.orchestra.run.smithi001.stdout: "source_pgid": "0.0", 2024-09-17T02:20:42.088 INFO:teuthology.orchestra.run.smithi001.stdout: "ready_epoch": 0, 2024-09-17T02:20:42.088 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_started": 0, 2024-09-17T02:20:42.088 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_clean": 0, 2024-09-17T02:20:42.088 INFO:teuthology.orchestra.run.smithi001.stdout: "source_version": "0'0", 2024-09-17T02:20:42.088 INFO:teuthology.orchestra.run.smithi001.stdout: "target_version": "0'0" 2024-09-17T02:20:42.088 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.088 INFO:teuthology.orchestra.run.smithi001.stdout: "last_change": "12", 2024-09-17T02:20:42.088 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend": "0", 2024-09-17T02:20:42.088 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:20:42.088 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:20:42.088 INFO:teuthology.orchestra.run.smithi001.stdout: "auid": 0, 2024-09-17T02:20:42.088 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:20:42.088 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_seq": 0, 2024-09-17T02:20:42.089 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_epoch": 0, 2024-09-17T02:20:42.089 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_snaps": [], 2024-09-17T02:20:42.089 INFO:teuthology.orchestra.run.smithi001.stdout: "removed_snaps": "[]", 2024-09-17T02:20:42.089 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_bytes": 0, 2024-09-17T02:20:42.089 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_objects": 0, 2024-09-17T02:20:42.089 INFO:teuthology.orchestra.run.smithi001.stdout: "tiers": [], 2024-09-17T02:20:42.089 INFO:teuthology.orchestra.run.smithi001.stdout: "tier_of": -1, 2024-09-17T02:20:42.089 INFO:teuthology.orchestra.run.smithi001.stdout: "read_tier": -1, 2024-09-17T02:20:42.089 INFO:teuthology.orchestra.run.smithi001.stdout: "write_tier": -1, 2024-09-17T02:20:42.089 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_mode": "none", 2024-09-17T02:20:42.089 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_bytes": 0, 2024-09-17T02:20:42.089 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_objects": 0, 2024-09-17T02:20:42.089 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:20:42.090 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:20:42.090 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:20:42.090 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_flush_age": 0, 2024-09-17T02:20:42.090 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_evict_age": 0, 2024-09-17T02:20:42.090 INFO:teuthology.orchestra.run.smithi001.stdout: "erasure_code_profile": "", 2024-09-17T02:20:42.090 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_params": { 2024-09-17T02:20:42.090 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "none" 2024-09-17T02:20:42.090 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.090 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_period": 0, 2024-09-17T02:20:42.090 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_count": 0, 2024-09-17T02:20:42.090 INFO:teuthology.orchestra.run.smithi001.stdout: "use_gmt_hitset": true, 2024-09-17T02:20:42.090 INFO:teuthology.orchestra.run.smithi001.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:20:42.090 INFO:teuthology.orchestra.run.smithi001.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:20:42.090 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:20:42.091 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:20:42.091 INFO:teuthology.orchestra.run.smithi001.stdout: "grade_table": [], 2024-09-17T02:20:42.091 INFO:teuthology.orchestra.run.smithi001.stdout: "stripe_width": 0, 2024-09-17T02:20:42.091 INFO:teuthology.orchestra.run.smithi001.stdout: "expected_num_objects": 0, 2024-09-17T02:20:42.091 INFO:teuthology.orchestra.run.smithi001.stdout: "fast_read": false, 2024-09-17T02:20:42.091 INFO:teuthology.orchestra.run.smithi001.stdout: "options": { 2024-09-17T02:20:42.091 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_max": 32, 2024-09-17T02:20:42.091 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_min": 1 2024-09-17T02:20:42.091 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.091 INFO:teuthology.orchestra.run.smithi001.stdout: "application_metadata": { 2024-09-17T02:20:42.091 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": {} 2024-09-17T02:20:42.091 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.091 INFO:teuthology.orchestra.run.smithi001.stdout: "read_balance": { 2024-09-17T02:20:42.092 INFO:teuthology.orchestra.run.smithi001.stdout: "score_type": "Fair distribution", 2024-09-17T02:20:42.092 INFO:teuthology.orchestra.run.smithi001.stdout: "score_acting": 2.9900000095367432, 2024-09-17T02:20:42.092 INFO:teuthology.orchestra.run.smithi001.stdout: "score_stable": 2.9900000095367432, 2024-09-17T02:20:42.092 INFO:teuthology.orchestra.run.smithi001.stdout: "optimal_score": 0.67000001668930054, 2024-09-17T02:20:42.092 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_acting": 2, 2024-09-17T02:20:42.092 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_stable": 2, 2024-09-17T02:20:42.092 INFO:teuthology.orchestra.run.smithi001.stdout: "primary_affinity_weighted": 0.79247540235519409, 2024-09-17T02:20:42.092 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity": 0.79000002145767212, 2024-09-17T02:20:42.092 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity_weighted": 0.79000002145767212 2024-09-17T02:20:42.092 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:20:42.092 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.092 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.092 INFO:teuthology.orchestra.run.smithi001.stdout: "pool": 2, 2024-09-17T02:20:42.093 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": "rbd", 2024-09-17T02:20:42.093 INFO:teuthology.orchestra.run.smithi001.stdout: "create_time": "2024-09-17T02:20:08.718296+0000", 2024-09-17T02:20:42.093 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 8193, 2024-09-17T02:20:42.093 INFO:teuthology.orchestra.run.smithi001.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-17T02:20:42.093 INFO:teuthology.orchestra.run.smithi001.stdout: "type": 1, 2024-09-17T02:20:42.093 INFO:teuthology.orchestra.run.smithi001.stdout: "size": 2, 2024-09-17T02:20:42.093 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": 1, 2024-09-17T02:20:42.093 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_rule": 0, 2024-09-17T02:20:42.093 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:20:42.093 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:20:42.094 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:20:42.094 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:20:42.094 INFO:teuthology.orchestra.run.smithi001.stdout: "is_stretch_pool": false, 2024-09-17T02:20:42.094 INFO:teuthology.orchestra.run.smithi001.stdout: "object_hash": 2, 2024-09-17T02:20:42.094 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:20:42.094 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": 8, 2024-09-17T02:20:42.094 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num": 8, 2024-09-17T02:20:42.094 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num_target": 8, 2024-09-17T02:20:42.094 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_target": 8, 2024-09-17T02:20:42.094 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_pending": 8, 2024-09-17T02:20:42.094 INFO:teuthology.orchestra.run.smithi001.stdout: "last_pg_merge_meta": { 2024-09-17T02:20:42.094 INFO:teuthology.orchestra.run.smithi001.stdout: "source_pgid": "0.0", 2024-09-17T02:20:42.095 INFO:teuthology.orchestra.run.smithi001.stdout: "ready_epoch": 0, 2024-09-17T02:20:42.095 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_started": 0, 2024-09-17T02:20:42.095 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_clean": 0, 2024-09-17T02:20:42.095 INFO:teuthology.orchestra.run.smithi001.stdout: "source_version": "0'0", 2024-09-17T02:20:42.095 INFO:teuthology.orchestra.run.smithi001.stdout: "target_version": "0'0" 2024-09-17T02:20:42.095 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.095 INFO:teuthology.orchestra.run.smithi001.stdout: "last_change": "16", 2024-09-17T02:20:42.095 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend": "0", 2024-09-17T02:20:42.095 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:20:42.095 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:20:42.095 INFO:teuthology.orchestra.run.smithi001.stdout: "auid": 0, 2024-09-17T02:20:42.095 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:20:42.096 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_seq": 2, 2024-09-17T02:20:42.096 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_epoch": 16, 2024-09-17T02:20:42.096 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_snaps": [], 2024-09-17T02:20:42.096 INFO:teuthology.orchestra.run.smithi001.stdout: "removed_snaps": "[]", 2024-09-17T02:20:42.096 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_bytes": 0, 2024-09-17T02:20:42.096 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_objects": 0, 2024-09-17T02:20:42.096 INFO:teuthology.orchestra.run.smithi001.stdout: "tiers": [], 2024-09-17T02:20:42.096 INFO:teuthology.orchestra.run.smithi001.stdout: "tier_of": -1, 2024-09-17T02:20:42.096 INFO:teuthology.orchestra.run.smithi001.stdout: "read_tier": -1, 2024-09-17T02:20:42.096 INFO:teuthology.orchestra.run.smithi001.stdout: "write_tier": -1, 2024-09-17T02:20:42.096 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_mode": "none", 2024-09-17T02:20:42.096 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_bytes": 0, 2024-09-17T02:20:42.096 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_objects": 0, 2024-09-17T02:20:42.097 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:20:42.097 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:20:42.097 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:20:42.097 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_flush_age": 0, 2024-09-17T02:20:42.097 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_evict_age": 0, 2024-09-17T02:20:42.097 INFO:teuthology.orchestra.run.smithi001.stdout: "erasure_code_profile": "", 2024-09-17T02:20:42.097 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_params": { 2024-09-17T02:20:42.097 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "none" 2024-09-17T02:20:42.097 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.097 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_period": 0, 2024-09-17T02:20:42.097 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_count": 0, 2024-09-17T02:20:42.097 INFO:teuthology.orchestra.run.smithi001.stdout: "use_gmt_hitset": true, 2024-09-17T02:20:42.097 INFO:teuthology.orchestra.run.smithi001.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:20:42.098 INFO:teuthology.orchestra.run.smithi001.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:20:42.098 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:20:42.098 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:20:42.098 INFO:teuthology.orchestra.run.smithi001.stdout: "grade_table": [], 2024-09-17T02:20:42.098 INFO:teuthology.orchestra.run.smithi001.stdout: "stripe_width": 0, 2024-09-17T02:20:42.098 INFO:teuthology.orchestra.run.smithi001.stdout: "expected_num_objects": 0, 2024-09-17T02:20:42.098 INFO:teuthology.orchestra.run.smithi001.stdout: "fast_read": false, 2024-09-17T02:20:42.098 INFO:teuthology.orchestra.run.smithi001.stdout: "options": {}, 2024-09-17T02:20:42.098 INFO:teuthology.orchestra.run.smithi001.stdout: "application_metadata": { 2024-09-17T02:20:42.098 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd": {} 2024-09-17T02:20:42.098 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.098 INFO:teuthology.orchestra.run.smithi001.stdout: "read_balance": { 2024-09-17T02:20:42.098 INFO:teuthology.orchestra.run.smithi001.stdout: "score_type": "Fair distribution", 2024-09-17T02:20:42.098 INFO:teuthology.orchestra.run.smithi001.stdout: "score_acting": 1.5, 2024-09-17T02:20:42.099 INFO:teuthology.orchestra.run.smithi001.stdout: "score_stable": 1.5, 2024-09-17T02:20:42.099 INFO:teuthology.orchestra.run.smithi001.stdout: "optimal_score": 1, 2024-09-17T02:20:42.099 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_acting": 1.5, 2024-09-17T02:20:42.099 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_stable": 1.5, 2024-09-17T02:20:42.099 INFO:teuthology.orchestra.run.smithi001.stdout: "primary_affinity_weighted": 0.79247540235519409, 2024-09-17T02:20:42.099 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity": 0.79000002145767212, 2024-09-17T02:20:42.099 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity_weighted": 0.79000002145767212 2024-09-17T02:20:42.099 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:20:42.099 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.099 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.099 INFO:teuthology.orchestra.run.smithi001.stdout: "pool": 3, 2024-09-17T02:20:42.100 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": "cephfs_metadata", 2024-09-17T02:20:42.100 INFO:teuthology.orchestra.run.smithi001.stdout: "create_time": "2024-09-17T02:20:13.566396+0000", 2024-09-17T02:20:42.100 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-17T02:20:42.100 INFO:teuthology.orchestra.run.smithi001.stdout: "flags_names": "hashpspool", 2024-09-17T02:20:42.100 INFO:teuthology.orchestra.run.smithi001.stdout: "type": 1, 2024-09-17T02:20:42.100 INFO:teuthology.orchestra.run.smithi001.stdout: "size": 2, 2024-09-17T02:20:42.100 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": 1, 2024-09-17T02:20:42.100 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_rule": 0, 2024-09-17T02:20:42.100 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:20:42.100 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:20:42.100 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:20:42.100 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:20:42.100 INFO:teuthology.orchestra.run.smithi001.stdout: "is_stretch_pool": false, 2024-09-17T02:20:42.100 INFO:teuthology.orchestra.run.smithi001.stdout: "object_hash": 2, 2024-09-17T02:20:42.101 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:20:42.101 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": 32, 2024-09-17T02:20:42.101 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num": 32, 2024-09-17T02:20:42.101 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num_target": 32, 2024-09-17T02:20:42.101 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_target": 32, 2024-09-17T02:20:42.101 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_pending": 32, 2024-09-17T02:20:42.101 INFO:teuthology.orchestra.run.smithi001.stdout: "last_pg_merge_meta": { 2024-09-17T02:20:42.101 INFO:teuthology.orchestra.run.smithi001.stdout: "source_pgid": "0.0", 2024-09-17T02:20:42.101 INFO:teuthology.orchestra.run.smithi001.stdout: "ready_epoch": 0, 2024-09-17T02:20:42.101 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_started": 0, 2024-09-17T02:20:42.101 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_clean": 0, 2024-09-17T02:20:42.101 INFO:teuthology.orchestra.run.smithi001.stdout: "source_version": "0'0", 2024-09-17T02:20:42.101 INFO:teuthology.orchestra.run.smithi001.stdout: "target_version": "0'0" 2024-09-17T02:20:42.102 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.102 INFO:teuthology.orchestra.run.smithi001.stdout: "last_change": "19", 2024-09-17T02:20:42.102 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend": "0", 2024-09-17T02:20:42.102 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:20:42.102 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:20:42.102 INFO:teuthology.orchestra.run.smithi001.stdout: "auid": 0, 2024-09-17T02:20:42.102 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:20:42.102 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_seq": 0, 2024-09-17T02:20:42.102 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_epoch": 0, 2024-09-17T02:20:42.102 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_snaps": [], 2024-09-17T02:20:42.102 INFO:teuthology.orchestra.run.smithi001.stdout: "removed_snaps": "[]", 2024-09-17T02:20:42.102 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_bytes": 0, 2024-09-17T02:20:42.102 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_objects": 0, 2024-09-17T02:20:42.103 INFO:teuthology.orchestra.run.smithi001.stdout: "tiers": [], 2024-09-17T02:20:42.103 INFO:teuthology.orchestra.run.smithi001.stdout: "tier_of": -1, 2024-09-17T02:20:42.103 INFO:teuthology.orchestra.run.smithi001.stdout: "read_tier": -1, 2024-09-17T02:20:42.103 INFO:teuthology.orchestra.run.smithi001.stdout: "write_tier": -1, 2024-09-17T02:20:42.103 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_mode": "none", 2024-09-17T02:20:42.103 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_bytes": 0, 2024-09-17T02:20:42.103 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_objects": 0, 2024-09-17T02:20:42.103 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:20:42.103 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:20:42.103 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:20:42.103 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_flush_age": 0, 2024-09-17T02:20:42.103 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_evict_age": 0, 2024-09-17T02:20:42.103 INFO:teuthology.orchestra.run.smithi001.stdout: "erasure_code_profile": "", 2024-09-17T02:20:42.103 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_params": { 2024-09-17T02:20:42.104 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "none" 2024-09-17T02:20:42.104 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.104 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_period": 0, 2024-09-17T02:20:42.104 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_count": 0, 2024-09-17T02:20:42.104 INFO:teuthology.orchestra.run.smithi001.stdout: "use_gmt_hitset": true, 2024-09-17T02:20:42.104 INFO:teuthology.orchestra.run.smithi001.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:20:42.104 INFO:teuthology.orchestra.run.smithi001.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:20:42.104 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:20:42.104 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:20:42.104 INFO:teuthology.orchestra.run.smithi001.stdout: "grade_table": [], 2024-09-17T02:20:42.104 INFO:teuthology.orchestra.run.smithi001.stdout: "stripe_width": 0, 2024-09-17T02:20:42.104 INFO:teuthology.orchestra.run.smithi001.stdout: "expected_num_objects": 0, 2024-09-17T02:20:42.104 INFO:teuthology.orchestra.run.smithi001.stdout: "fast_read": false, 2024-09-17T02:20:42.104 INFO:teuthology.orchestra.run.smithi001.stdout: "options": { 2024-09-17T02:20:42.105 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscale_bias": 4, 2024-09-17T02:20:42.105 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_min": 16, 2024-09-17T02:20:42.105 INFO:teuthology.orchestra.run.smithi001.stdout: "recovery_priority": 5 2024-09-17T02:20:42.105 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.105 INFO:teuthology.orchestra.run.smithi001.stdout: "application_metadata": { 2024-09-17T02:20:42.105 INFO:teuthology.orchestra.run.smithi001.stdout: "cephfs": { 2024-09-17T02:20:42.105 INFO:teuthology.orchestra.run.smithi001.stdout: "metadata": "cephfs" 2024-09-17T02:20:42.105 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:20:42.105 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.105 INFO:teuthology.orchestra.run.smithi001.stdout: "read_balance": { 2024-09-17T02:20:42.105 INFO:teuthology.orchestra.run.smithi001.stdout: "score_type": "Fair distribution", 2024-09-17T02:20:42.105 INFO:teuthology.orchestra.run.smithi001.stdout: "score_acting": 1.4099999666213989, 2024-09-17T02:20:42.105 INFO:teuthology.orchestra.run.smithi001.stdout: "score_stable": 1.4099999666213989, 2024-09-17T02:20:42.105 INFO:teuthology.orchestra.run.smithi001.stdout: "optimal_score": 1, 2024-09-17T02:20:42.106 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_acting": 1.4099999666213989, 2024-09-17T02:20:42.106 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_stable": 1.4099999666213989, 2024-09-17T02:20:42.106 INFO:teuthology.orchestra.run.smithi001.stdout: "primary_affinity_weighted": 0.79247540235519409, 2024-09-17T02:20:42.106 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity": 0.79000002145767212, 2024-09-17T02:20:42.106 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity_weighted": 0.79000002145767212 2024-09-17T02:20:42.106 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:20:42.106 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.106 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.106 INFO:teuthology.orchestra.run.smithi001.stdout: "pool": 4, 2024-09-17T02:20:42.106 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": "cephfs_data", 2024-09-17T02:20:42.106 INFO:teuthology.orchestra.run.smithi001.stdout: "create_time": "2024-09-17T02:20:14.902662+0000", 2024-09-17T02:20:42.106 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-17T02:20:42.106 INFO:teuthology.orchestra.run.smithi001.stdout: "flags_names": "hashpspool", 2024-09-17T02:20:42.106 INFO:teuthology.orchestra.run.smithi001.stdout: "type": 1, 2024-09-17T02:20:42.107 INFO:teuthology.orchestra.run.smithi001.stdout: "size": 2, 2024-09-17T02:20:42.107 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": 1, 2024-09-17T02:20:42.107 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_rule": 0, 2024-09-17T02:20:42.107 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:20:42.107 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:20:42.107 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:20:42.107 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:20:42.107 INFO:teuthology.orchestra.run.smithi001.stdout: "is_stretch_pool": false, 2024-09-17T02:20:42.107 INFO:teuthology.orchestra.run.smithi001.stdout: "object_hash": 2, 2024-09-17T02:20:42.107 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:20:42.107 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": 64, 2024-09-17T02:20:42.107 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num": 64, 2024-09-17T02:20:42.107 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num_target": 64, 2024-09-17T02:20:42.107 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_target": 64, 2024-09-17T02:20:42.108 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_pending": 64, 2024-09-17T02:20:42.108 INFO:teuthology.orchestra.run.smithi001.stdout: "last_pg_merge_meta": { 2024-09-17T02:20:42.108 INFO:teuthology.orchestra.run.smithi001.stdout: "source_pgid": "0.0", 2024-09-17T02:20:42.108 INFO:teuthology.orchestra.run.smithi001.stdout: "ready_epoch": 0, 2024-09-17T02:20:42.108 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_started": 0, 2024-09-17T02:20:42.108 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_clean": 0, 2024-09-17T02:20:42.108 INFO:teuthology.orchestra.run.smithi001.stdout: "source_version": "0'0", 2024-09-17T02:20:42.108 INFO:teuthology.orchestra.run.smithi001.stdout: "target_version": "0'0" 2024-09-17T02:20:42.108 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.108 INFO:teuthology.orchestra.run.smithi001.stdout: "last_change": "20", 2024-09-17T02:20:42.108 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend": "0", 2024-09-17T02:20:42.108 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:20:42.108 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:20:42.108 INFO:teuthology.orchestra.run.smithi001.stdout: "auid": 0, 2024-09-17T02:20:42.109 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:20:42.109 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_seq": 0, 2024-09-17T02:20:42.109 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_epoch": 0, 2024-09-17T02:20:42.109 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_snaps": [], 2024-09-17T02:20:42.109 INFO:teuthology.orchestra.run.smithi001.stdout: "removed_snaps": "[]", 2024-09-17T02:20:42.109 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_bytes": 0, 2024-09-17T02:20:42.109 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_objects": 0, 2024-09-17T02:20:42.109 INFO:teuthology.orchestra.run.smithi001.stdout: "tiers": [], 2024-09-17T02:20:42.109 INFO:teuthology.orchestra.run.smithi001.stdout: "tier_of": -1, 2024-09-17T02:20:42.109 INFO:teuthology.orchestra.run.smithi001.stdout: "read_tier": -1, 2024-09-17T02:20:42.109 INFO:teuthology.orchestra.run.smithi001.stdout: "write_tier": -1, 2024-09-17T02:20:42.109 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_mode": "none", 2024-09-17T02:20:42.109 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_bytes": 0, 2024-09-17T02:20:42.109 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_objects": 0, 2024-09-17T02:20:42.110 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:20:42.110 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:20:42.110 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:20:42.110 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_flush_age": 0, 2024-09-17T02:20:42.110 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_evict_age": 0, 2024-09-17T02:20:42.110 INFO:teuthology.orchestra.run.smithi001.stdout: "erasure_code_profile": "", 2024-09-17T02:20:42.110 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_params": { 2024-09-17T02:20:42.110 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "none" 2024-09-17T02:20:42.110 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.110 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_period": 0, 2024-09-17T02:20:42.110 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_count": 0, 2024-09-17T02:20:42.110 INFO:teuthology.orchestra.run.smithi001.stdout: "use_gmt_hitset": true, 2024-09-17T02:20:42.110 INFO:teuthology.orchestra.run.smithi001.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:20:42.111 INFO:teuthology.orchestra.run.smithi001.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:20:42.111 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:20:42.111 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:20:42.111 INFO:teuthology.orchestra.run.smithi001.stdout: "grade_table": [], 2024-09-17T02:20:42.111 INFO:teuthology.orchestra.run.smithi001.stdout: "stripe_width": 0, 2024-09-17T02:20:42.111 INFO:teuthology.orchestra.run.smithi001.stdout: "expected_num_objects": 0, 2024-09-17T02:20:42.111 INFO:teuthology.orchestra.run.smithi001.stdout: "fast_read": false, 2024-09-17T02:20:42.111 INFO:teuthology.orchestra.run.smithi001.stdout: "options": { 2024-09-17T02:20:42.111 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_min": 64, 2024-09-17T02:20:42.111 INFO:teuthology.orchestra.run.smithi001.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T02:20:42.111 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.111 INFO:teuthology.orchestra.run.smithi001.stdout: "application_metadata": { 2024-09-17T02:20:42.111 INFO:teuthology.orchestra.run.smithi001.stdout: "cephfs": { 2024-09-17T02:20:42.111 INFO:teuthology.orchestra.run.smithi001.stdout: "data": "cephfs" 2024-09-17T02:20:42.112 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:20:42.112 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.112 INFO:teuthology.orchestra.run.smithi001.stdout: "read_balance": { 2024-09-17T02:20:42.112 INFO:teuthology.orchestra.run.smithi001.stdout: "score_type": "Fair distribution", 2024-09-17T02:20:42.112 INFO:teuthology.orchestra.run.smithi001.stdout: "score_acting": 1.2200000286102295, 2024-09-17T02:20:42.112 INFO:teuthology.orchestra.run.smithi001.stdout: "score_stable": 1.2200000286102295, 2024-09-17T02:20:42.112 INFO:teuthology.orchestra.run.smithi001.stdout: "optimal_score": 1, 2024-09-17T02:20:42.112 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_acting": 1.2200000286102295, 2024-09-17T02:20:42.112 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_stable": 1.2200000286102295, 2024-09-17T02:20:42.112 INFO:teuthology.orchestra.run.smithi001.stdout: "primary_affinity_weighted": 0.79247540235519409, 2024-09-17T02:20:42.112 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity": 0.79000002145767212, 2024-09-17T02:20:42.112 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity_weighted": 0.79000002145767212 2024-09-17T02:20:42.113 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:20:42.113 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.113 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.113 INFO:teuthology.orchestra.run.smithi001.stdout: "pool": 5, 2024-09-17T02:20:42.113 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": "unique_pool_0", 2024-09-17T02:20:42.113 INFO:teuthology.orchestra.run.smithi001.stdout: "create_time": "2024-09-17T02:20:30.517004+0000", 2024-09-17T02:20:42.113 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-17T02:20:42.113 INFO:teuthology.orchestra.run.smithi001.stdout: "flags_names": "hashpspool", 2024-09-17T02:20:42.113 INFO:teuthology.orchestra.run.smithi001.stdout: "type": 1, 2024-09-17T02:20:42.113 INFO:teuthology.orchestra.run.smithi001.stdout: "size": 2, 2024-09-17T02:20:42.113 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": 1, 2024-09-17T02:20:42.113 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_rule": 0, 2024-09-17T02:20:42.113 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:20:42.114 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:20:42.114 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:20:42.114 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:20:42.114 INFO:teuthology.orchestra.run.smithi001.stdout: "is_stretch_pool": false, 2024-09-17T02:20:42.114 INFO:teuthology.orchestra.run.smithi001.stdout: "object_hash": 2, 2024-09-17T02:20:42.114 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:20:42.114 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": 16, 2024-09-17T02:20:42.114 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num": 16, 2024-09-17T02:20:42.114 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num_target": 16, 2024-09-17T02:20:42.114 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_target": 16, 2024-09-17T02:20:42.114 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_pending": 16, 2024-09-17T02:20:42.114 INFO:teuthology.orchestra.run.smithi001.stdout: "last_pg_merge_meta": { 2024-09-17T02:20:42.114 INFO:teuthology.orchestra.run.smithi001.stdout: "source_pgid": "0.0", 2024-09-17T02:20:42.114 INFO:teuthology.orchestra.run.smithi001.stdout: "ready_epoch": 0, 2024-09-17T02:20:42.115 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_started": 0, 2024-09-17T02:20:42.115 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_clean": 0, 2024-09-17T02:20:42.115 INFO:teuthology.orchestra.run.smithi001.stdout: "source_version": "0'0", 2024-09-17T02:20:42.115 INFO:teuthology.orchestra.run.smithi001.stdout: "target_version": "0'0" 2024-09-17T02:20:42.115 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.115 INFO:teuthology.orchestra.run.smithi001.stdout: "last_change": "24", 2024-09-17T02:20:42.115 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend": "0", 2024-09-17T02:20:42.115 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:20:42.115 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:20:42.115 INFO:teuthology.orchestra.run.smithi001.stdout: "auid": 0, 2024-09-17T02:20:42.115 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:20:42.115 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_seq": 0, 2024-09-17T02:20:42.115 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_epoch": 0, 2024-09-17T02:20:42.115 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_snaps": [], 2024-09-17T02:20:42.116 INFO:teuthology.orchestra.run.smithi001.stdout: "removed_snaps": "[]", 2024-09-17T02:20:42.116 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_bytes": 0, 2024-09-17T02:20:42.116 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_objects": 0, 2024-09-17T02:20:42.116 INFO:teuthology.orchestra.run.smithi001.stdout: "tiers": [], 2024-09-17T02:20:42.116 INFO:teuthology.orchestra.run.smithi001.stdout: "tier_of": -1, 2024-09-17T02:20:42.116 INFO:teuthology.orchestra.run.smithi001.stdout: "read_tier": -1, 2024-09-17T02:20:42.116 INFO:teuthology.orchestra.run.smithi001.stdout: "write_tier": -1, 2024-09-17T02:20:42.116 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_mode": "none", 2024-09-17T02:20:42.116 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_bytes": 0, 2024-09-17T02:20:42.116 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_objects": 0, 2024-09-17T02:20:42.116 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:20:42.116 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:20:42.116 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:20:42.117 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_flush_age": 0, 2024-09-17T02:20:42.117 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_evict_age": 0, 2024-09-17T02:20:42.117 INFO:teuthology.orchestra.run.smithi001.stdout: "erasure_code_profile": "", 2024-09-17T02:20:42.117 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_params": { 2024-09-17T02:20:42.117 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "none" 2024-09-17T02:20:42.117 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.117 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_period": 0, 2024-09-17T02:20:42.117 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_count": 0, 2024-09-17T02:20:42.117 INFO:teuthology.orchestra.run.smithi001.stdout: "use_gmt_hitset": true, 2024-09-17T02:20:42.117 INFO:teuthology.orchestra.run.smithi001.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:20:42.118 INFO:teuthology.orchestra.run.smithi001.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:20:42.118 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:20:42.118 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:20:42.118 INFO:teuthology.orchestra.run.smithi001.stdout: "grade_table": [], 2024-09-17T02:20:42.118 INFO:teuthology.orchestra.run.smithi001.stdout: "stripe_width": 0, 2024-09-17T02:20:42.118 INFO:teuthology.orchestra.run.smithi001.stdout: "expected_num_objects": 0, 2024-09-17T02:20:42.118 INFO:teuthology.orchestra.run.smithi001.stdout: "fast_read": false, 2024-09-17T02:20:42.118 INFO:teuthology.orchestra.run.smithi001.stdout: "options": {}, 2024-09-17T02:20:42.118 INFO:teuthology.orchestra.run.smithi001.stdout: "application_metadata": { 2024-09-17T02:20:42.118 INFO:teuthology.orchestra.run.smithi001.stdout: "rados": {} 2024-09-17T02:20:42.118 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.118 INFO:teuthology.orchestra.run.smithi001.stdout: "read_balance": { 2024-09-17T02:20:42.118 INFO:teuthology.orchestra.run.smithi001.stdout: "score_type": "Fair distribution", 2024-09-17T02:20:42.118 INFO:teuthology.orchestra.run.smithi001.stdout: "score_acting": 1.309999942779541, 2024-09-17T02:20:42.119 INFO:teuthology.orchestra.run.smithi001.stdout: "score_stable": 1.309999942779541, 2024-09-17T02:20:42.119 INFO:teuthology.orchestra.run.smithi001.stdout: "optimal_score": 1, 2024-09-17T02:20:42.119 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_acting": 1.309999942779541, 2024-09-17T02:20:42.119 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_stable": 1.309999942779541, 2024-09-17T02:20:42.119 INFO:teuthology.orchestra.run.smithi001.stdout: "primary_affinity_weighted": 0.79247540235519409, 2024-09-17T02:20:42.119 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity": 0.79000002145767212, 2024-09-17T02:20:42.119 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity_weighted": 0.79000002145767212 2024-09-17T02:20:42.119 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:20:42.119 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:20:42.119 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-17T02:20:42.119 INFO:teuthology.orchestra.run.smithi001.stdout: "osds": [ 2024-09-17T02:20:42.119 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.119 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 0, 2024-09-17T02:20:42.119 INFO:teuthology.orchestra.run.smithi001.stdout: "uuid": "fae746a8-754d-4e52-9819-004ebb0d6886", 2024-09-17T02:20:42.120 INFO:teuthology.orchestra.run.smithi001.stdout: "up": 1, 2024-09-17T02:20:42.120 INFO:teuthology.orchestra.run.smithi001.stdout: "in": 1, 2024-09-17T02:20:42.120 INFO:teuthology.orchestra.run.smithi001.stdout: "weight": 1, 2024-09-17T02:20:42.120 INFO:teuthology.orchestra.run.smithi001.stdout: "primary_affinity": 0.3774261474609375, 2024-09-17T02:20:42.120 INFO:teuthology.orchestra.run.smithi001.stdout: "last_clean_begin": 0, 2024-09-17T02:20:42.120 INFO:teuthology.orchestra.run.smithi001.stdout: "last_clean_end": 0, 2024-09-17T02:20:42.120 INFO:teuthology.orchestra.run.smithi001.stdout: "up_from": 9, 2024-09-17T02:20:42.120 INFO:teuthology.orchestra.run.smithi001.stdout: "up_thru": 22, 2024-09-17T02:20:42.120 INFO:teuthology.orchestra.run.smithi001.stdout: "down_at": 0, 2024-09-17T02:20:42.120 INFO:teuthology.orchestra.run.smithi001.stdout: "lost_at": 0, 2024-09-17T02:20:42.120 INFO:teuthology.orchestra.run.smithi001.stdout: "public_addrs": { 2024-09-17T02:20:42.120 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:20:42.120 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.120 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:20:42.121 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.32:6800", 2024-09-17T02:20:42.121 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2347677104 2024-09-17T02:20:42.121 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.121 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.121 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:20:42.121 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.32:6801", 2024-09-17T02:20:42.121 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2347677104 2024-09-17T02:20:42.121 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:20:42.121 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:42.121 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.121 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_addrs": { 2024-09-17T02:20:42.121 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:20:42.121 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.122 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:20:42.122 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.32:6802", 2024-09-17T02:20:42.122 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2347677104 2024-09-17T02:20:42.122 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.122 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.122 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:20:42.122 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.32:6803", 2024-09-17T02:20:42.122 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2347677104 2024-09-17T02:20:42.122 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:20:42.122 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:42.122 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.122 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_back_addrs": { 2024-09-17T02:20:42.122 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:20:42.123 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.123 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:20:42.123 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.32:6806", 2024-09-17T02:20:42.123 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2347677104 2024-09-17T02:20:42.123 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.123 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.123 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:20:42.123 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.32:6807", 2024-09-17T02:20:42.123 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2347677104 2024-09-17T02:20:42.123 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:20:42.123 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:42.123 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.123 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_front_addrs": { 2024-09-17T02:20:42.124 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:20:42.124 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.124 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:20:42.124 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.32:6804", 2024-09-17T02:20:42.124 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2347677104 2024-09-17T02:20:42.124 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.124 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.124 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:20:42.124 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.32:6805", 2024-09-17T02:20:42.124 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2347677104 2024-09-17T02:20:42.124 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:20:42.124 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:42.124 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.125 INFO:teuthology.orchestra.run.smithi001.stdout: "public_addr": "172.21.15.32:6801/2347677104", 2024-09-17T02:20:42.125 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_addr": "172.21.15.32:6803/2347677104", 2024-09-17T02:20:42.125 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_back_addr": "172.21.15.32:6807/2347677104", 2024-09-17T02:20:42.125 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_front_addr": "172.21.15.32:6805/2347677104", 2024-09-17T02:20:42.125 INFO:teuthology.orchestra.run.smithi001.stdout: "state": [ 2024-09-17T02:20:42.125 INFO:teuthology.orchestra.run.smithi001.stdout: "exists", 2024-09-17T02:20:42.125 INFO:teuthology.orchestra.run.smithi001.stdout: "up" 2024-09-17T02:20:42.125 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:42.125 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.125 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.126 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 1, 2024-09-17T02:20:42.126 INFO:teuthology.orchestra.run.smithi001.stdout: "uuid": "c9397688-80ca-4c21-b80d-1740194c389d", 2024-09-17T02:20:42.126 INFO:teuthology.orchestra.run.smithi001.stdout: "up": 1, 2024-09-17T02:20:42.126 INFO:teuthology.orchestra.run.smithi001.stdout: "in": 1, 2024-09-17T02:20:42.126 INFO:teuthology.orchestra.run.smithi001.stdout: "weight": 1, 2024-09-17T02:20:42.126 INFO:teuthology.orchestra.run.smithi001.stdout: "primary_affinity": 1, 2024-09-17T02:20:42.126 INFO:teuthology.orchestra.run.smithi001.stdout: "last_clean_begin": 0, 2024-09-17T02:20:42.126 INFO:teuthology.orchestra.run.smithi001.stdout: "last_clean_end": 0, 2024-09-17T02:20:42.126 INFO:teuthology.orchestra.run.smithi001.stdout: "up_from": 8, 2024-09-17T02:20:42.126 INFO:teuthology.orchestra.run.smithi001.stdout: "up_thru": 26, 2024-09-17T02:20:42.126 INFO:teuthology.orchestra.run.smithi001.stdout: "down_at": 0, 2024-09-17T02:20:42.126 INFO:teuthology.orchestra.run.smithi001.stdout: "lost_at": 0, 2024-09-17T02:20:42.126 INFO:teuthology.orchestra.run.smithi001.stdout: "public_addrs": { 2024-09-17T02:20:42.127 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:20:42.127 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.127 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:20:42.127 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.153:6800", 2024-09-17T02:20:42.127 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1905904204 2024-09-17T02:20:42.127 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.127 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.127 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:20:42.127 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.153:6801", 2024-09-17T02:20:42.127 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1905904204 2024-09-17T02:20:42.127 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:20:42.127 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:42.127 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.128 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_addrs": { 2024-09-17T02:20:42.128 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:20:42.128 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.128 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:20:42.128 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.153:6802", 2024-09-17T02:20:42.128 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1905904204 2024-09-17T02:20:42.128 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.128 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.128 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:20:42.128 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.153:6803", 2024-09-17T02:20:42.128 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1905904204 2024-09-17T02:20:42.128 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:20:42.128 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:42.129 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.129 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_back_addrs": { 2024-09-17T02:20:42.129 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:20:42.129 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.129 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:20:42.129 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.153:6806", 2024-09-17T02:20:42.129 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1905904204 2024-09-17T02:20:42.129 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.129 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.129 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:20:42.129 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.153:6807", 2024-09-17T02:20:42.129 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1905904204 2024-09-17T02:20:42.129 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:20:42.129 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:42.130 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.130 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_front_addrs": { 2024-09-17T02:20:42.130 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:20:42.130 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.130 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:20:42.130 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.153:6804", 2024-09-17T02:20:42.130 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1905904204 2024-09-17T02:20:42.130 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.130 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.130 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:20:42.130 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.153:6805", 2024-09-17T02:20:42.130 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1905904204 2024-09-17T02:20:42.130 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:20:42.131 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:42.131 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.131 INFO:teuthology.orchestra.run.smithi001.stdout: "public_addr": "172.21.15.153:6801/1905904204", 2024-09-17T02:20:42.131 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_addr": "172.21.15.153:6803/1905904204", 2024-09-17T02:20:42.131 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_back_addr": "172.21.15.153:6807/1905904204", 2024-09-17T02:20:42.131 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_front_addr": "172.21.15.153:6805/1905904204", 2024-09-17T02:20:42.131 INFO:teuthology.orchestra.run.smithi001.stdout: "state": [ 2024-09-17T02:20:42.131 INFO:teuthology.orchestra.run.smithi001.stdout: "exists", 2024-09-17T02:20:42.131 INFO:teuthology.orchestra.run.smithi001.stdout: "up" 2024-09-17T02:20:42.131 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:42.131 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.131 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.131 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 2, 2024-09-17T02:20:42.131 INFO:teuthology.orchestra.run.smithi001.stdout: "uuid": "6d8c01a8-b657-4abc-a624-2b35ef0512ea", 2024-09-17T02:20:42.132 INFO:teuthology.orchestra.run.smithi001.stdout: "up": 1, 2024-09-17T02:20:42.132 INFO:teuthology.orchestra.run.smithi001.stdout: "in": 1, 2024-09-17T02:20:42.132 INFO:teuthology.orchestra.run.smithi001.stdout: "weight": 1, 2024-09-17T02:20:42.132 INFO:teuthology.orchestra.run.smithi001.stdout: "primary_affinity": 1, 2024-09-17T02:20:42.132 INFO:teuthology.orchestra.run.smithi001.stdout: "last_clean_begin": 0, 2024-09-17T02:20:42.132 INFO:teuthology.orchestra.run.smithi001.stdout: "last_clean_end": 0, 2024-09-17T02:20:42.132 INFO:teuthology.orchestra.run.smithi001.stdout: "up_from": 8, 2024-09-17T02:20:42.132 INFO:teuthology.orchestra.run.smithi001.stdout: "up_thru": 26, 2024-09-17T02:20:42.132 INFO:teuthology.orchestra.run.smithi001.stdout: "down_at": 0, 2024-09-17T02:20:42.132 INFO:teuthology.orchestra.run.smithi001.stdout: "lost_at": 0, 2024-09-17T02:20:42.132 INFO:teuthology.orchestra.run.smithi001.stdout: "public_addrs": { 2024-09-17T02:20:42.132 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:20:42.132 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.133 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:20:42.133 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.164:6800", 2024-09-17T02:20:42.133 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 603659517 2024-09-17T02:20:42.133 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.133 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.133 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:20:42.133 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.164:6801", 2024-09-17T02:20:42.133 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 603659517 2024-09-17T02:20:42.133 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:20:42.133 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:42.133 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.133 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_addrs": { 2024-09-17T02:20:42.133 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:20:42.133 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.134 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:20:42.134 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.164:6802", 2024-09-17T02:20:42.134 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 603659517 2024-09-17T02:20:42.134 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.134 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.134 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:20:42.134 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.164:6803", 2024-09-17T02:20:42.134 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 603659517 2024-09-17T02:20:42.134 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:20:42.134 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:42.134 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.134 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_back_addrs": { 2024-09-17T02:20:42.134 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:20:42.134 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.134 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:20:42.135 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.164:6806", 2024-09-17T02:20:42.135 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 603659517 2024-09-17T02:20:42.135 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.135 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.135 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:20:42.135 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.164:6807", 2024-09-17T02:20:42.135 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 603659517 2024-09-17T02:20:42.135 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:20:42.135 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:42.135 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.135 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_front_addrs": { 2024-09-17T02:20:42.135 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:20:42.135 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.135 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:20:42.136 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.164:6804", 2024-09-17T02:20:42.136 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 603659517 2024-09-17T02:20:42.136 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.136 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.136 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:20:42.136 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.164:6805", 2024-09-17T02:20:42.136 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 603659517 2024-09-17T02:20:42.136 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:20:42.136 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:42.136 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.136 INFO:teuthology.orchestra.run.smithi001.stdout: "public_addr": "172.21.15.164:6801/603659517", 2024-09-17T02:20:42.136 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_addr": "172.21.15.164:6803/603659517", 2024-09-17T02:20:42.136 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_back_addr": "172.21.15.164:6807/603659517", 2024-09-17T02:20:42.137 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_front_addr": "172.21.15.164:6805/603659517", 2024-09-17T02:20:42.137 INFO:teuthology.orchestra.run.smithi001.stdout: "state": [ 2024-09-17T02:20:42.137 INFO:teuthology.orchestra.run.smithi001.stdout: "exists", 2024-09-17T02:20:42.137 INFO:teuthology.orchestra.run.smithi001.stdout: "up" 2024-09-17T02:20:42.137 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:20:42.137 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:20:42.137 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-17T02:20:42.137 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_xinfo": [ 2024-09-17T02:20:42.137 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.137 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 0, 2024-09-17T02:20:42.137 INFO:teuthology.orchestra.run.smithi001.stdout: "down_stamp": "0.000000", 2024-09-17T02:20:42.137 INFO:teuthology.orchestra.run.smithi001.stdout: "laggy_probability": 0, 2024-09-17T02:20:42.137 INFO:teuthology.orchestra.run.smithi001.stdout: "laggy_interval": 0, 2024-09-17T02:20:42.138 INFO:teuthology.orchestra.run.smithi001.stdout: "features": 4540701547738038271, 2024-09-17T02:20:42.138 INFO:teuthology.orchestra.run.smithi001.stdout: "old_weight": 0, 2024-09-17T02:20:42.138 INFO:teuthology.orchestra.run.smithi001.stdout: "last_purged_snaps_scrub": "2024-09-17T02:20:00.476482+0000", 2024-09-17T02:20:42.138 INFO:teuthology.orchestra.run.smithi001.stdout: "dead_epoch": 0 2024-09-17T02:20:42.138 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.138 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.138 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 1, 2024-09-17T02:20:42.138 INFO:teuthology.orchestra.run.smithi001.stdout: "down_stamp": "0.000000", 2024-09-17T02:20:42.138 INFO:teuthology.orchestra.run.smithi001.stdout: "laggy_probability": 0, 2024-09-17T02:20:42.138 INFO:teuthology.orchestra.run.smithi001.stdout: "laggy_interval": 0, 2024-09-17T02:20:42.138 INFO:teuthology.orchestra.run.smithi001.stdout: "features": 4540701547738038271, 2024-09-17T02:20:42.139 INFO:teuthology.orchestra.run.smithi001.stdout: "old_weight": 0, 2024-09-17T02:20:42.139 INFO:teuthology.orchestra.run.smithi001.stdout: "last_purged_snaps_scrub": "2024-09-17T02:20:00.250903+0000", 2024-09-17T02:20:42.139 INFO:teuthology.orchestra.run.smithi001.stdout: "dead_epoch": 0 2024-09-17T02:20:42.139 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.139 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:20:42.139 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 2, 2024-09-17T02:20:42.139 INFO:teuthology.orchestra.run.smithi001.stdout: "down_stamp": "0.000000", 2024-09-17T02:20:42.139 INFO:teuthology.orchestra.run.smithi001.stdout: "laggy_probability": 0, 2024-09-17T02:20:42.139 INFO:teuthology.orchestra.run.smithi001.stdout: "laggy_interval": 0, 2024-09-17T02:20:42.139 INFO:teuthology.orchestra.run.smithi001.stdout: "features": 4540701547738038271, 2024-09-17T02:20:42.139 INFO:teuthology.orchestra.run.smithi001.stdout: "old_weight": 0, 2024-09-17T02:20:42.139 INFO:teuthology.orchestra.run.smithi001.stdout: "last_purged_snaps_scrub": "2024-09-17T02:20:00.326430+0000", 2024-09-17T02:20:42.139 INFO:teuthology.orchestra.run.smithi001.stdout: "dead_epoch": 0 2024-09-17T02:20:42.140 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:20:42.140 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-17T02:20:42.140 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_upmap": [], 2024-09-17T02:20:42.140 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_upmap_items": [], 2024-09-17T02:20:42.140 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_upmap_primaries": [], 2024-09-17T02:20:42.140 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_temp": [], 2024-09-17T02:20:42.140 INFO:teuthology.orchestra.run.smithi001.stdout: "primary_temp": [], 2024-09-17T02:20:42.140 INFO:teuthology.orchestra.run.smithi001.stdout: "blocklist": {}, 2024-09-17T02:20:42.140 INFO:teuthology.orchestra.run.smithi001.stdout: "range_blocklist": {}, 2024-09-17T02:20:42.140 INFO:teuthology.orchestra.run.smithi001.stdout: "erasure_code_profiles": { 2024-09-17T02:20:42.141 INFO:teuthology.orchestra.run.smithi001.stdout: "default": { 2024-09-17T02:20:42.141 INFO:teuthology.orchestra.run.smithi001.stdout: "crush-failure-domain": "osd", 2024-09-17T02:20:42.141 INFO:teuthology.orchestra.run.smithi001.stdout: "k": "2", 2024-09-17T02:20:42.141 INFO:teuthology.orchestra.run.smithi001.stdout: "m": "1", 2024-09-17T02:20:42.141 INFO:teuthology.orchestra.run.smithi001.stdout: "plugin": "jerasure", 2024-09-17T02:20:42.141 INFO:teuthology.orchestra.run.smithi001.stdout: "technique": "reed_sol_van" 2024-09-17T02:20:42.141 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:20:42.141 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:20:42.141 INFO:teuthology.orchestra.run.smithi001.stdout: "removed_snaps_queue": [], 2024-09-17T02:20:42.141 INFO:teuthology.orchestra.run.smithi001.stdout: "new_removed_snaps": [], 2024-09-17T02:20:42.141 INFO:teuthology.orchestra.run.smithi001.stdout: "new_purged_snaps": [], 2024-09-17T02:20:42.141 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_node_flags": {}, 2024-09-17T02:20:42.141 INFO:teuthology.orchestra.run.smithi001.stdout: "device_class_flags": {}, 2024-09-17T02:20:42.142 INFO:teuthology.orchestra.run.smithi001.stdout: "stretch_mode": { 2024-09-17T02:20:42.142 INFO:teuthology.orchestra.run.smithi001.stdout: "stretch_mode_enabled": false, 2024-09-17T02:20:42.142 INFO:teuthology.orchestra.run.smithi001.stdout: "stretch_bucket_count": 0, 2024-09-17T02:20:42.142 INFO:teuthology.orchestra.run.smithi001.stdout: "degraded_stretch_mode": 0, 2024-09-17T02:20:42.142 INFO:teuthology.orchestra.run.smithi001.stdout: "recovering_stretch_mode": 0, 2024-09-17T02:20:42.142 INFO:teuthology.orchestra.run.smithi001.stdout: "stretch_mode_bucket": 0 2024-09-17T02:20:42.142 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:20:42.142 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-17T02:20:42.143 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:20:42.145 INFO:tasks.thrashosds.thrasher:j is {'epoch': 28, 'fsid': '37cd4495-4915-41f4-bad2-2394cbe235f3', 'created': '2024-09-17T02:19:52.516342+0000', 'modified': '2024-09-17T02:20:39.693121+0000', 'last_up_change': '2024-09-17T02:20:02.422255+0000', 'last_in_change': '2024-09-17T02:19:54.329423+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T02:20:03.416336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.7924754023551941, 'average_primary_affinity': 0.7900000214576721, 'average_primary_affinity_weighted': 0.7900000214576721}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-17T02:20:08.718296+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 16, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.7924754023551941, 'average_primary_affinity': 0.7900000214576721, 'average_primary_affinity_weighted': 0.7900000214576721}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-17T02:20:13.566396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.409999966621399, 'score_stable': 1.409999966621399, 'optimal_score': 1, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 0.7924754023551941, 'average_primary_affinity': 0.7900000214576721, 'average_primary_affinity_weighted': 0.7900000214576721}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-17T02:20:14.902662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.2200000286102295, 'score_stable': 1.2200000286102295, 'optimal_score': 1, 'raw_score_acting': 1.2200000286102295, 'raw_score_stable': 1.2200000286102295, 'primary_affinity_weighted': 0.7924754023551941, 'average_primary_affinity': 0.7900000214576721, 'average_primary_affinity_weighted': 0.7900000214576721}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-09-17T02:20:30.517004+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 0.7924754023551941, 'average_primary_affinity': 0.7900000214576721, 'average_primary_affinity_weighted': 0.7900000214576721}}], 'osds': [{'osd': 0, 'uuid': 'fae746a8-754d-4e52-9819-004ebb0d6886', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.3774261474609375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6800', 'nonce': 2347677104}, {'type': 'v1', 'addr': '172.21.15.32:6801', 'nonce': 2347677104}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6802', 'nonce': 2347677104}, {'type': 'v1', 'addr': '172.21.15.32:6803', 'nonce': 2347677104}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6806', 'nonce': 2347677104}, {'type': 'v1', 'addr': '172.21.15.32:6807', 'nonce': 2347677104}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6804', 'nonce': 2347677104}, {'type': 'v1', 'addr': '172.21.15.32:6805', 'nonce': 2347677104}]}, 'public_addr': '172.21.15.32:6801/2347677104', 'cluster_addr': '172.21.15.32:6803/2347677104', 'heartbeat_back_addr': '172.21.15.32:6807/2347677104', 'heartbeat_front_addr': '172.21.15.32:6805/2347677104', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'c9397688-80ca-4c21-b80d-1740194c389d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 26, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6800', 'nonce': 1905904204}, {'type': 'v1', 'addr': '172.21.15.153:6801', 'nonce': 1905904204}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6802', 'nonce': 1905904204}, {'type': 'v1', 'addr': '172.21.15.153:6803', 'nonce': 1905904204}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6806', 'nonce': 1905904204}, {'type': 'v1', 'addr': '172.21.15.153:6807', 'nonce': 1905904204}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6804', 'nonce': 1905904204}, {'type': 'v1', 'addr': '172.21.15.153:6805', 'nonce': 1905904204}]}, 'public_addr': '172.21.15.153:6801/1905904204', 'cluster_addr': '172.21.15.153:6803/1905904204', 'heartbeat_back_addr': '172.21.15.153:6807/1905904204', 'heartbeat_front_addr': '172.21.15.153:6805/1905904204', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '6d8c01a8-b657-4abc-a624-2b35ef0512ea', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 26, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6800', 'nonce': 603659517}, {'type': 'v1', 'addr': '172.21.15.164:6801', 'nonce': 603659517}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6802', 'nonce': 603659517}, {'type': 'v1', 'addr': '172.21.15.164:6803', 'nonce': 603659517}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6806', 'nonce': 603659517}, {'type': 'v1', 'addr': '172.21.15.164:6807', 'nonce': 603659517}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6804', 'nonce': 603659517}, {'type': 'v1', 'addr': '172.21.15.164:6805', 'nonce': 603659517}]}, 'public_addr': '172.21.15.164:6801/603659517', 'cluster_addr': '172.21.15.164:6803/603659517', 'heartbeat_back_addr': '172.21.15.164:6807/603659517', 'heartbeat_front_addr': '172.21.15.164:6805/603659517', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T02:20:00.476482+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T02:20:00.250903+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T02:20:00.326430+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-17T02:20:42.145 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:20:42.146 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:42.145+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:42.245 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:42.245+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:42.309 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:20:42.309 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-17T02:20:42.309 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-09-17T02:20:42.309 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-09-17T02:20:42.309 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:20:42.334 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:20:42.346 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:42.352+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:42.448 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:42.452+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:42.543 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:20:42.543 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-09-17T02:20:42.543 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-09-17T02:20:42.543 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-17T02:20:42.543 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.543 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-17T02:20:42.543 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:20:42.544 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.087495468999997, 2024-09-17T02:20:42.544 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.15597325500000001, 2024-09-17T02:20:42.544 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.544 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.544 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:42.544 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:42.544 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4164", 2024-09-17T02:20:42.544 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/201892753", 2024-09-17T02:20:42.544 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 1 2024-09-17T02:20:42.544 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.544 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.544 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.544 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.545 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:20:42.545 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.545 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.545 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.545 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.545 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:20:42.545 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.545 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.545 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.545 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.545 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458359+0000", 2024-09-17T02:20:42.545 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3929999999999998e-06 2024-09-17T02:20:42.545 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.546 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.546 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.546 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458373+0000", 2024-09-17T02:20:42.546 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4103e-05 2024-09-17T02:20:42.546 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.546 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.546 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.546 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458397+0000", 2024-09-17T02:20:42.546 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.438e-05 2024-09-17T02:20:42.546 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.546 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.546 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.546 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458421+0000", 2024-09-17T02:20:42.547 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3655999999999998e-05 2024-09-17T02:20:42.547 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.547 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.547 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:42.547 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458529+0000", 2024-09-17T02:20:42.547 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010752900000000001 2024-09-17T02:20:42.547 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.547 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.547 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:20:42.547 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458542+0000", 2024-09-17T02:20:42.547 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2986999999999999e-05 2024-09-17T02:20:42.547 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.547 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.548 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:42.548 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.611050+0000", 2024-09-17T02:20:42.548 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.1525087 2024-09-17T02:20:42.548 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.548 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.548 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:42.548 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.611529+0000", 2024-09-17T02:20:42.548 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00047844899999999999 2024-09-17T02:20:42.548 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.548 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.548 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:42.548 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.612061+0000", 2024-09-17T02:20:42.549 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00053230300000000003 2024-09-17T02:20:42.549 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.549 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.549 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:42.549 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.613451+0000", 2024-09-17T02:20:42.549 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0013897250000000001 2024-09-17T02:20:42.549 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.549 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.549 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:42.549 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614168+0000", 2024-09-17T02:20:42.549 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00071692499999999998 2024-09-17T02:20:42.549 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.549 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.549 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:42.550 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614265+0000", 2024-09-17T02:20:42.550 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7589000000000004e-05 2024-09-17T02:20:42.550 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.550 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.550 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:42.550 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614330+0000", 2024-09-17T02:20:42.550 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4516000000000004e-05 2024-09-17T02:20:42.550 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.550 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.550 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.550 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.550 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.550 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4164.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-17T02:20:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:04.966730+0000", 2024-09-17T02:20:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 37.579122087999998, 2024-09-17T02:20:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.024160772, 2024-09-17T02:20:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4164", 2024-09-17T02:20:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/201892753", 2024-09-17T02:20:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 117 2024-09-17T02:20:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.966730+0000", 2024-09-17T02:20:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.966730+0000", 2024-09-17T02:20:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.966731+0000", 2024-09-17T02:20:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5000000000000002e-07 2024-09-17T02:20:42.553 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.553 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.553 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.553 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.966736+0000", 2024-09-17T02:20:42.553 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3900000000000001e-06 2024-09-17T02:20:42.553 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.553 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.553 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.553 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.966746+0000", 2024-09-17T02:20:42.553 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4960000000000002e-06 2024-09-17T02:20:42.553 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.553 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.553 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.554 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.966753+0000", 2024-09-17T02:20:42.554 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0770000000000002e-06 2024-09-17T02:20:42.554 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.554 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.554 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:42.554 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.988554+0000", 2024-09-17T02:20:42.554 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.021801503999999999 2024-09-17T02:20:42.554 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.554 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.554 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:42.554 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.988813+0000", 2024-09-17T02:20:42.554 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000258514 2024-09-17T02:20:42.554 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.554 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.555 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:42.555 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.989188+0000", 2024-09-17T02:20:42.555 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000375767 2024-09-17T02:20:42.555 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.555 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.555 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:42.555 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.990403+0000", 2024-09-17T02:20:42.555 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001214487 2024-09-17T02:20:42.555 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.555 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.555 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:42.555 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.990696+0000", 2024-09-17T02:20:42.555 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029352499999999999 2024-09-17T02:20:42.555 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.556 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.556 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:42.556 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.990782+0000", 2024-09-17T02:20:42.556 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5389000000000005e-05 2024-09-17T02:20:42.556 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.556 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.556 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:42.556 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.990891+0000", 2024-09-17T02:20:42.556 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000108873 2024-09-17T02:20:42.556 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.556 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.556 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.556 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.556 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.557 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:42.557 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556145+0000", 2024-09-17T02:20:42.557 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.989707166999999, 2024-09-17T02:20:42.557 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.025052441000000002, 2024-09-17T02:20:42.557 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.557 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.557 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:42.557 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.557 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.557 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.557 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556145+0000", 2024-09-17T02:20:42.557 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.557 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.558 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.558 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.558 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556145+0000", 2024-09-17T02:20:42.558 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.558 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.558 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.558 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.558 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556148+0000", 2024-09-17T02:20:42.558 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4400000000000001e-06 2024-09-17T02:20:42.558 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.558 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.558 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.558 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556185+0000", 2024-09-17T02:20:42.558 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6603000000000002e-05 2024-09-17T02:20:42.559 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.559 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.559 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.559 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556220+0000", 2024-09-17T02:20:42.559 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5065999999999999e-05 2024-09-17T02:20:42.559 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.559 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.559 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.559 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556244+0000", 2024-09-17T02:20:42.559 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3937000000000001e-05 2024-09-17T02:20:42.559 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.559 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.559 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:42.560 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556378+0000", 2024-09-17T02:20:42.560 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000134129 2024-09-17T02:20:42.560 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.560 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.560 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:42.560 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556573+0000", 2024-09-17T02:20:42.560 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000195038 2024-09-17T02:20:42.560 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.560 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.560 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:42.560 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556765+0000", 2024-09-17T02:20:42.560 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019188199999999999 2024-09-17T02:20:42.560 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.560 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.561 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:42.561 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562153+0000", 2024-09-17T02:20:42.561 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0053883220000000001 2024-09-17T02:20:42.561 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.561 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.561 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:42.561 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.580640+0000", 2024-09-17T02:20:42.561 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018487145 2024-09-17T02:20:42.561 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.561 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.561 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:42.561 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.580791+0000", 2024-09-17T02:20:42.561 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015011899999999999 2024-09-17T02:20:42.561 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.562 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.562 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:42.562 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.581197+0000", 2024-09-17T02:20:42.562 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00040675999999999999 2024-09-17T02:20:42.562 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.562 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.562 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.562 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.562 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.562 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:42.562 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:20:42.562 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.989564350999999, 2024-09-17T02:20:42.562 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029713927000000001, 2024-09-17T02:20:42.563 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.563 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.563 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:42.563 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.563 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.563 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.563 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:20:42.563 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.563 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.563 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.563 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.563 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:20:42.563 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.563 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.564 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.564 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.564 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556289+0000", 2024-09-17T02:20:42.564 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.513e-06 2024-09-17T02:20:42.564 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.564 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.564 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.564 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556298+0000", 2024-09-17T02:20:42.564 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1630000000000002e-06 2024-09-17T02:20:42.564 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.564 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.564 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.564 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556318+0000", 2024-09-17T02:20:42.565 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9389999999999999e-05 2024-09-17T02:20:42.565 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.565 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.565 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.565 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556332+0000", 2024-09-17T02:20:42.565 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4506e-05 2024-09-17T02:20:42.565 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.565 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.565 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:42.565 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557304+0000", 2024-09-17T02:20:42.565 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00097169699999999999 2024-09-17T02:20:42.565 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.565 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.565 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:42.566 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557507+0000", 2024-09-17T02:20:42.566 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000203191 2024-09-17T02:20:42.566 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.566 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.566 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:42.566 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557838+0000", 2024-09-17T02:20:42.566 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033061100000000002 2024-09-17T02:20:42.566 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.566 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.566 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:42.566 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562171+0000", 2024-09-17T02:20:42.566 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043329229999999998 2024-09-17T02:20:42.566 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.566 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.567 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:42.567 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585737+0000", 2024-09-17T02:20:42.567 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023565915 2024-09-17T02:20:42.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.567 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.567 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:42.567 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585884+0000", 2024-09-17T02:20:42.567 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014744199999999999 2024-09-17T02:20:42.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.567 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.567 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:42.567 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586002+0000", 2024-09-17T02:20:42.567 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000117576 2024-09-17T02:20:42.567 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.568 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.568 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.568 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.568 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.568 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:42.568 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:20:42.568 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.989472378999999, 2024-09-17T02:20:42.568 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030933694000000001, 2024-09-17T02:20:42.568 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.568 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.568 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:42.568 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.568 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.569 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.569 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:20:42.569 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.569 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.569 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.569 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.569 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:20:42.569 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.569 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.569 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.569 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.569 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556381+0000", 2024-09-17T02:20:42.569 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2100000000000001e-06 2024-09-17T02:20:42.569 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.570 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.570 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.570 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556389+0000", 2024-09-17T02:20:42.570 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5539999999999998e-06 2024-09-17T02:20:42.570 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.570 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.570 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.570 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556408+0000", 2024-09-17T02:20:42.570 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8623000000000001e-05 2024-09-17T02:20:42.570 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556427+0000", 2024-09-17T02:20:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8566000000000001e-05 2024-09-17T02:20:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558741+0000", 2024-09-17T02:20:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023144390000000002 2024-09-17T02:20:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:42.571 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559040+0000", 2024-09-17T02:20:42.572 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029912100000000001 2024-09-17T02:20:42.572 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.572 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.572 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:42.572 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559222+0000", 2024-09-17T02:20:42.572 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018211200000000001 2024-09-17T02:20:42.572 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.572 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.572 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:42.572 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.566648+0000", 2024-09-17T02:20:42.572 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074257560000000004 2024-09-17T02:20:42.572 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.572 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.573 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:42.573 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587109+0000", 2024-09-17T02:20:42.573 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.020460685999999999 2024-09-17T02:20:42.573 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.573 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.573 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:42.573 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587232+0000", 2024-09-17T02:20:42.573 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123325 2024-09-17T02:20:42.573 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.573 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.573 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:42.573 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587313+0000", 2024-09-17T02:20:42.573 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1302000000000002e-05 2024-09-17T02:20:42.573 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.574 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.574 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.574 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.574 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.574 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:42.574 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:20:42.574 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.989406933000001, 2024-09-17T02:20:42.574 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031045538000000001, 2024-09-17T02:20:42.574 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.574 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.574 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:42.574 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.574 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.574 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.575 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:20:42.575 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.575 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.575 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.575 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.575 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:20:42.575 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.575 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.575 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.575 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.575 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556446+0000", 2024-09-17T02:20:42.575 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.26e-06 2024-09-17T02:20:42.575 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.575 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.576 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.576 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556454+0000", 2024-09-17T02:20:42.576 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1640000000000004e-06 2024-09-17T02:20:42.576 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.576 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.576 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.576 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556471+0000", 2024-09-17T02:20:42.576 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7586000000000001e-05 2024-09-17T02:20:42.576 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.576 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.576 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.576 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556485+0000", 2024-09-17T02:20:42.576 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3523000000000001e-05 2024-09-17T02:20:42.577 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.577 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.577 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:42.577 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559899+0000", 2024-09-17T02:20:42.577 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0034142140000000001 2024-09-17T02:20:42.577 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.577 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.577 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:42.577 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.560104+0000", 2024-09-17T02:20:42.577 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00020539199999999999 2024-09-17T02:20:42.577 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.577 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.578 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:42.578 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.560400+0000", 2024-09-17T02:20:42.578 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029612099999999999 2024-09-17T02:20:42.578 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.578 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.578 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:42.578 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.568427+0000", 2024-09-17T02:20:42.578 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0080262909999999996 2024-09-17T02:20:42.578 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.578 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.578 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:42.578 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587377+0000", 2024-09-17T02:20:42.578 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018950765000000001 2024-09-17T02:20:42.578 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.579 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.579 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:42.579 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587445+0000", 2024-09-17T02:20:42.579 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.724e-05 2024-09-17T02:20:42.579 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.579 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.579 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:42.579 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587491+0000", 2024-09-17T02:20:42.579 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5982000000000001e-05 2024-09-17T02:20:42.579 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.579 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.579 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.579 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.579 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.580 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:42.580 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:20:42.580 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.989344162999998, 2024-09-17T02:20:42.580 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031435547000000001, 2024-09-17T02:20:42.580 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.580 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.580 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:42.580 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.580 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.580 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.580 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:20:42.580 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.580 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.581 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.581 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.581 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:20:42.581 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.581 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.581 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.581 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.581 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556509+0000", 2024-09-17T02:20:42.581 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.06e-06 2024-09-17T02:20:42.581 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.581 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.581 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.581 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556515+0000", 2024-09-17T02:20:42.581 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1029999999999998e-06 2024-09-17T02:20:42.582 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.582 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.582 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.582 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556532+0000", 2024-09-17T02:20:42.582 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7054e-05 2024-09-17T02:20:42.582 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.582 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.582 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.582 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556545+0000", 2024-09-17T02:20:42.582 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3023000000000001e-05 2024-09-17T02:20:42.582 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.582 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.582 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:42.582 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561016+0000", 2024-09-17T02:20:42.583 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044705150000000004 2024-09-17T02:20:42.583 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.583 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.583 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:42.583 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561316+0000", 2024-09-17T02:20:42.583 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000299895 2024-09-17T02:20:42.583 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.583 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.583 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:42.583 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561651+0000", 2024-09-17T02:20:42.583 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033519300000000001 2024-09-17T02:20:42.583 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.583 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.584 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:42.584 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571105+0000", 2024-09-17T02:20:42.584 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094540539999999999 2024-09-17T02:20:42.584 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.584 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.584 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:42.584 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587628+0000", 2024-09-17T02:20:42.584 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016522819000000001 2024-09-17T02:20:42.584 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.584 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.584 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:42.584 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587770+0000", 2024-09-17T02:20:42.584 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000142352 2024-09-17T02:20:42.585 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.585 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.585 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:42.585 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587943+0000", 2024-09-17T02:20:42.585 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017347900000000001 2024-09-17T02:20:42.585 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.585 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.585 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.585 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.585 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.585 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:42.586 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:20:42.586 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.989288432999999, 2024-09-17T02:20:42.586 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031809104999999997, 2024-09-17T02:20:42.586 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.586 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.586 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:42.586 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.586 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.586 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.586 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:20:42.586 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.586 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.586 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.586 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:20:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556565+0000", 2024-09-17T02:20:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.116e-06 2024-09-17T02:20:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556572+0000", 2024-09-17T02:20:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0230000000000004e-06 2024-09-17T02:20:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.588 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.588 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556588+0000", 2024-09-17T02:20:42.588 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6643e-05 2024-09-17T02:20:42.588 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.588 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.588 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.588 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556606+0000", 2024-09-17T02:20:42.588 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7159999999999998e-05 2024-09-17T02:20:42.588 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.588 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.588 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:42.588 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562712+0000", 2024-09-17T02:20:42.588 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0061061630000000004 2024-09-17T02:20:42.589 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.589 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.589 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:42.589 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562919+0000", 2024-09-17T02:20:42.589 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000207309 2024-09-17T02:20:42.589 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.589 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.589 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:42.589 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563264+0000", 2024-09-17T02:20:42.589 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00034490699999999998 2024-09-17T02:20:42.589 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.589 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.589 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:42.589 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571812+0000", 2024-09-17T02:20:42.590 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0085477810000000008 2024-09-17T02:20:42.590 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.590 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.590 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:42.590 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588094+0000", 2024-09-17T02:20:42.590 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016282443000000001 2024-09-17T02:20:42.590 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.590 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.590 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:42.590 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588275+0000", 2024-09-17T02:20:42.590 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018058700000000001 2024-09-17T02:20:42.590 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.590 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.590 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:42.591 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588373+0000", 2024-09-17T02:20:42.591 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7973000000000005e-05 2024-09-17T02:20:42.591 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.591 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.591 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.591 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.591 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.591 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:42.591 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:20:42.591 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.989230333999998, 2024-09-17T02:20:42.591 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031950544999999997, 2024-09-17T02:20:42.591 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.591 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.591 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:42.592 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.592 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.592 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.592 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:20:42.592 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.592 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.592 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.592 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.592 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:20:42.592 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.592 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.592 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.592 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.593 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556623+0000", 2024-09-17T02:20:42.593 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.04e-06 2024-09-17T02:20:42.593 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.593 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.593 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.593 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556631+0000", 2024-09-17T02:20:42.593 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1529999999999997e-06 2024-09-17T02:20:42.593 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.593 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.593 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.593 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556648+0000", 2024-09-17T02:20:42.593 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6583999999999999e-05 2024-09-17T02:20:42.593 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.594 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.594 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.594 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556661+0000", 2024-09-17T02:20:42.594 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3203e-05 2024-09-17T02:20:42.594 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.594 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.594 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:42.594 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564413+0000", 2024-09-17T02:20:42.594 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0077523100000000001 2024-09-17T02:20:42.594 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.594 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.594 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:42.594 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.565841+0000", 2024-09-17T02:20:42.594 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014276320000000001 2024-09-17T02:20:42.595 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.595 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.595 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:42.595 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.566131+0000", 2024-09-17T02:20:42.595 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029043800000000001 2024-09-17T02:20:42.595 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.595 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.595 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:42.595 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572353+0000", 2024-09-17T02:20:42.595 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.006222399 2024-09-17T02:20:42.595 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.595 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.595 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:42.595 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588452+0000", 2024-09-17T02:20:42.596 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016098635 2024-09-17T02:20:42.596 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.596 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.596 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:42.596 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588520+0000", 2024-09-17T02:20:42.596 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8040000000000006e-05 2024-09-17T02:20:42.596 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.596 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.596 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:42.596 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588572+0000", 2024-09-17T02:20:42.596 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2111000000000003e-05 2024-09-17T02:20:42.596 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.596 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.597 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.597 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.597 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.597 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:42.597 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:20:42.597 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.989133167999999, 2024-09-17T02:20:42.597 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.032187205000000003, 2024-09-17T02:20:42.597 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.597 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.597 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:42.597 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.597 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.597 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.597 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:20:42.598 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.598 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.598 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.598 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.598 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:20:42.598 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.598 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.598 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.598 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.598 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556727+0000", 2024-09-17T02:20:42.598 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3000000000000002e-06 2024-09-17T02:20:42.598 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.598 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.598 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.598 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556736+0000", 2024-09-17T02:20:42.599 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4300000000000006e-06 2024-09-17T02:20:42.599 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.599 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.599 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.599 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556755+0000", 2024-09-17T02:20:42.599 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9700000000000001e-05 2024-09-17T02:20:42.599 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.599 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.599 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.599 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556771+0000", 2024-09-17T02:20:42.599 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5213e-05 2024-09-17T02:20:42.599 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.600 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.600 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:42.600 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571184+0000", 2024-09-17T02:20:42.600 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014413888999999999 2024-09-17T02:20:42.600 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.600 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.600 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:42.600 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571302+0000", 2024-09-17T02:20:42.600 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011794900000000001 2024-09-17T02:20:42.600 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.600 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.600 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:42.600 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571494+0000", 2024-09-17T02:20:42.601 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000191168 2024-09-17T02:20:42.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.601 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.601 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:42.601 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.573775+0000", 2024-09-17T02:20:42.601 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002281656 2024-09-17T02:20:42.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.601 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.601 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:42.601 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588668+0000", 2024-09-17T02:20:42.601 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014892699000000001 2024-09-17T02:20:42.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.602 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.602 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:42.602 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588813+0000", 2024-09-17T02:20:42.602 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014530700000000001 2024-09-17T02:20:42.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.602 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.602 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:42.602 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588906+0000", 2024-09-17T02:20:42.602 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2893999999999995e-05 2024-09-17T02:20:42.602 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.602 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.602 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.603 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.603 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.603 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:42.603 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556790+0000", 2024-09-17T02:20:42.603 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.989062438000001, 2024-09-17T02:20:42.603 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.027122670000000002, 2024-09-17T02:20:42.603 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.603 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.603 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:42.603 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.603 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.603 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.603 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556790+0000", 2024-09-17T02:20:42.603 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.604 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.604 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.604 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.604 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556790+0000", 2024-09-17T02:20:42.604 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.604 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.604 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.604 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.604 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556791+0000", 2024-09-17T02:20:42.604 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.063e-06 2024-09-17T02:20:42.604 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.604 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.605 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.605 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556797+0000", 2024-09-17T02:20:42.605 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0530000000000003e-06 2024-09-17T02:20:42.605 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.605 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.605 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.605 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556814+0000", 2024-09-17T02:20:42.605 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7567e-05 2024-09-17T02:20:42.605 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.605 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.605 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.605 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556827+0000", 2024-09-17T02:20:42.605 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3026e-05 2024-09-17T02:20:42.606 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.606 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.606 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:42.606 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556981+0000", 2024-09-17T02:20:42.606 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000153299 2024-09-17T02:20:42.606 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.606 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.606 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:42.606 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557252+0000", 2024-09-17T02:20:42.606 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00027129399999999999 2024-09-17T02:20:42.606 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.606 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.606 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:42.607 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557564+0000", 2024-09-17T02:20:42.607 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000311615 2024-09-17T02:20:42.607 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.607 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.607 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:42.607 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.568194+0000", 2024-09-17T02:20:42.607 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010630175 2024-09-17T02:20:42.607 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.607 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.607 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:42.607 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.583636+0000", 2024-09-17T02:20:42.607 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015442256999999999 2024-09-17T02:20:42.607 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.608 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.608 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:42.608 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.583758+0000", 2024-09-17T02:20:42.608 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000121692 2024-09-17T02:20:42.608 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.608 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.608 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:42.608 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.583912+0000", 2024-09-17T02:20:42.608 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015462900000000001 2024-09-17T02:20:42.608 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.608 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.608 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.609 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.609 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.609 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:42.609 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:20:42.609 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.988992003, 2024-09-17T02:20:42.609 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028815922000000001, 2024-09-17T02:20:42.609 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.609 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.609 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:42.609 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.609 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.609 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.609 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:20:42.609 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.610 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.610 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.610 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.610 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:20:42.610 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.610 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.610 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.610 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.610 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556861+0000", 2024-09-17T02:20:42.610 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.08e-06 2024-09-17T02:20:42.610 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.610 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.610 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.611 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556867+0000", 2024-09-17T02:20:42.611 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.207e-06 2024-09-17T02:20:42.611 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.611 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.611 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.611 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556886+0000", 2024-09-17T02:20:42.611 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9137e-05 2024-09-17T02:20:42.611 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.611 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.611 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.611 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556900+0000", 2024-09-17T02:20:42.611 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3253e-05 2024-09-17T02:20:42.611 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.611 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.612 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:42.612 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558301+0000", 2024-09-17T02:20:42.612 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014008320000000001 2024-09-17T02:20:42.612 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.612 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.612 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:42.612 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558564+0000", 2024-09-17T02:20:42.612 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000263238 2024-09-17T02:20:42.612 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.612 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.612 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:42.612 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558905+0000", 2024-09-17T02:20:42.612 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000341534 2024-09-17T02:20:42.612 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.613 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.613 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:42.613 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.568208+0000", 2024-09-17T02:20:42.613 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0093023689999999996 2024-09-17T02:20:42.613 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.613 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.613 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:42.613 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585379+0000", 2024-09-17T02:20:42.613 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017171091999999999 2024-09-17T02:20:42.613 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.613 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.613 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:42.613 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585509+0000", 2024-09-17T02:20:42.614 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013036100000000001 2024-09-17T02:20:42.614 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.614 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.614 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:42.614 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585676+0000", 2024-09-17T02:20:42.614 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016681899999999999 2024-09-17T02:20:42.614 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.614 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.614 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.614 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.614 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.614 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:42.614 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:20:42.615 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.988934736000001, 2024-09-17T02:20:42.615 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030862568, 2024-09-17T02:20:42.615 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.615 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.615 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:42.615 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.615 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.615 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.615 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:20:42.615 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.615 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.615 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.615 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.616 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:20:42.616 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.616 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.616 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.616 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.616 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556918+0000", 2024-09-17T02:20:42.616 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0529999999999999e-06 2024-09-17T02:20:42.616 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.616 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.616 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.616 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556925+0000", 2024-09-17T02:20:42.616 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.6939999999999998e-06 2024-09-17T02:20:42.616 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.617 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.617 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.617 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556942+0000", 2024-09-17T02:20:42.617 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6803000000000002e-05 2024-09-17T02:20:42.617 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.617 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.617 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.617 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556955+0000", 2024-09-17T02:20:42.617 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2659e-05 2024-09-17T02:20:42.617 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.617 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.617 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:42.617 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558237+0000", 2024-09-17T02:20:42.618 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001282804 2024-09-17T02:20:42.618 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.618 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.618 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:42.618 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558495+0000", 2024-09-17T02:20:42.618 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000257178 2024-09-17T02:20:42.618 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.618 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.618 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:42.618 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562168+0000", 2024-09-17T02:20:42.618 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0036737110000000001 2024-09-17T02:20:42.618 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.618 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.618 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:42.619 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.570855+0000", 2024-09-17T02:20:42.619 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0086868729999999995 2024-09-17T02:20:42.619 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.619 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.619 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:42.619 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587568+0000", 2024-09-17T02:20:42.619 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016712444999999999 2024-09-17T02:20:42.619 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.619 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.619 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:42.619 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587677+0000", 2024-09-17T02:20:42.619 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000109879 2024-09-17T02:20:42.619 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.619 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.620 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:42.620 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587780+0000", 2024-09-17T02:20:42.620 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000102469 2024-09-17T02:20:42.620 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.620 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.620 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.620 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.620 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.620 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:42.620 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:20:42.620 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.988852604000002, 2024-09-17T02:20:42.620 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031005751000000002, 2024-09-17T02:20:42.620 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.621 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.621 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:42.621 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.621 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.621 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.621 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:20:42.621 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.621 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.621 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.621 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.621 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:20:42.621 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.622 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.622 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.622 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557001+0000", 2024-09-17T02:20:42.622 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.237e-06 2024-09-17T02:20:42.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.622 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.622 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.622 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557007+0000", 2024-09-17T02:20:42.622 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7270000000000001e-06 2024-09-17T02:20:42.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.622 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.622 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.623 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557025+0000", 2024-09-17T02:20:42.623 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7689999999999998e-05 2024-09-17T02:20:42.623 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.623 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.623 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.623 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557039+0000", 2024-09-17T02:20:42.623 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.385e-05 2024-09-17T02:20:42.623 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.623 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.623 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:42.623 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563783+0000", 2024-09-17T02:20:42.623 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0067437110000000003 2024-09-17T02:20:42.623 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.623 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.624 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:42.624 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564031+0000", 2024-09-17T02:20:42.624 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00024871799999999999 2024-09-17T02:20:42.624 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.624 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.624 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:42.624 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564518+0000", 2024-09-17T02:20:42.624 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00048708999999999997 2024-09-17T02:20:42.624 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.624 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.624 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:42.624 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572375+0000", 2024-09-17T02:20:42.624 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078564780000000001 2024-09-17T02:20:42.625 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.625 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.625 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:42.625 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587862+0000", 2024-09-17T02:20:42.625 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015486837999999999 2024-09-17T02:20:42.625 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.625 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.625 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:42.625 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587954+0000", 2024-09-17T02:20:42.625 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1766000000000002e-05 2024-09-17T02:20:42.625 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.625 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.625 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:42.626 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588005+0000", 2024-09-17T02:20:42.626 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1646e-05 2024-09-17T02:20:42.626 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.626 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.626 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.626 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.626 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.626 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:42.626 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:20:42.626 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.988708308, 2024-09-17T02:20:42.626 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029554871999999999, 2024-09-17T02:20:42.626 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.626 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:20:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:20:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.627 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557145+0000", 2024-09-17T02:20:42.628 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.263e-06 2024-09-17T02:20:42.628 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.628 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.628 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.628 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557151+0000", 2024-09-17T02:20:42.628 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1040000000000003e-06 2024-09-17T02:20:42.628 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.628 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.628 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.628 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557168+0000", 2024-09-17T02:20:42.628 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7289999999999999e-05 2024-09-17T02:20:42.628 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.628 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.629 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.629 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557182+0000", 2024-09-17T02:20:42.629 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.325e-05 2024-09-17T02:20:42.629 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.629 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.629 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:42.629 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564102+0000", 2024-09-17T02:20:42.629 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069199860000000004 2024-09-17T02:20:42.629 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.629 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.629 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:42.629 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564438+0000", 2024-09-17T02:20:42.629 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033651800000000001 2024-09-17T02:20:42.630 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.630 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.630 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:42.630 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.565422+0000", 2024-09-17T02:20:42.630 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00098332499999999995 2024-09-17T02:20:42.630 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.630 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.630 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:42.630 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572361+0000", 2024-09-17T02:20:42.630 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069392630000000002 2024-09-17T02:20:42.630 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.630 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.630 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:42.630 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586567+0000", 2024-09-17T02:20:42.631 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014206107000000001 2024-09-17T02:20:42.631 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.631 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.631 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:42.631 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586643+0000", 2024-09-17T02:20:42.631 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5673000000000005e-05 2024-09-17T02:20:42.631 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.631 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.631 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:42.631 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586699+0000", 2024-09-17T02:20:42.631 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6093e-05 2024-09-17T02:20:42.631 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.631 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.631 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.632 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.632 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.632 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:42.632 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557197+0000", 2024-09-17T02:20:42.632 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.988654627999999, 2024-09-17T02:20:42.632 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.027462931999999999, 2024-09-17T02:20:42.632 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.632 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.632 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:42.632 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.632 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.632 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.632 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557197+0000", 2024-09-17T02:20:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557197+0000", 2024-09-17T02:20:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557198+0000", 2024-09-17T02:20:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.8599999999999997e-07 2024-09-17T02:20:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.634 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557204+0000", 2024-09-17T02:20:42.634 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8200000000000002e-06 2024-09-17T02:20:42.634 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.634 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.634 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.634 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557223+0000", 2024-09-17T02:20:42.634 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8536999999999999e-05 2024-09-17T02:20:42.634 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.634 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.634 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.634 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557239+0000", 2024-09-17T02:20:42.634 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6725999999999999e-05 2024-09-17T02:20:42.634 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.635 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.635 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:42.635 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557373+0000", 2024-09-17T02:20:42.635 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000133199 2024-09-17T02:20:42.635 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.635 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.635 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:42.635 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557655+0000", 2024-09-17T02:20:42.635 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00028230799999999999 2024-09-17T02:20:42.635 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.635 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.635 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:42.635 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557941+0000", 2024-09-17T02:20:42.636 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00028569100000000003 2024-09-17T02:20:42.636 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.636 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.636 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:42.636 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562956+0000", 2024-09-17T02:20:42.636 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050156109999999997 2024-09-17T02:20:42.636 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.636 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.636 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:42.636 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.584452+0000", 2024-09-17T02:20:42.636 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.021496107 2024-09-17T02:20:42.636 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.636 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.636 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:42.637 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.584561+0000", 2024-09-17T02:20:42.637 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000108934 2024-09-17T02:20:42.637 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.637 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.637 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:42.637 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.584660+0000", 2024-09-17T02:20:42.637 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.9112999999999998e-05 2024-09-17T02:20:42.637 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.637 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.637 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.637 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.637 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.638 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:42.638 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:20:42.638 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.988574616000001, 2024-09-17T02:20:42.638 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029800569999999998, 2024-09-17T02:20:42.638 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.638 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.638 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:42.638 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.638 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.638 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.638 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:20:42.638 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.638 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.639 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.639 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.639 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:20:42.639 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.639 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.639 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.639 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.639 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557279+0000", 2024-09-17T02:20:42.639 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.497e-06 2024-09-17T02:20:42.639 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.639 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.639 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.639 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557287+0000", 2024-09-17T02:20:42.639 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9030000000000004e-06 2024-09-17T02:20:42.640 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.640 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.640 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.640 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557306+0000", 2024-09-17T02:20:42.640 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9394000000000001e-05 2024-09-17T02:20:42.640 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.640 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.640 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.640 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557323+0000", 2024-09-17T02:20:42.640 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6299000000000001e-05 2024-09-17T02:20:42.640 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.640 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.640 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:42.641 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.570931+0000", 2024-09-17T02:20:42.641 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013608841999999999 2024-09-17T02:20:42.641 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.641 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.641 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:42.641 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571250+0000", 2024-09-17T02:20:42.641 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031817400000000001 2024-09-17T02:20:42.641 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.641 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.641 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:42.641 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571559+0000", 2024-09-17T02:20:42.641 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000309835 2024-09-17T02:20:42.641 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.641 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.642 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:42.642 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.574161+0000", 2024-09-17T02:20:42.642 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002601543 2024-09-17T02:20:42.642 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.642 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.642 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:42.642 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586866+0000", 2024-09-17T02:20:42.642 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012704968000000001 2024-09-17T02:20:42.642 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.642 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.643 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:42.643 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586987+0000", 2024-09-17T02:20:42.643 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000121369 2024-09-17T02:20:42.643 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.643 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.643 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:42.643 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587078+0000", 2024-09-17T02:20:42.643 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0746000000000002e-05 2024-09-17T02:20:42.643 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.643 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.643 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.643 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.643 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.644 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:42.644 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:20:42.644 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.988508972999998, 2024-09-17T02:20:42.644 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029936054, 2024-09-17T02:20:42.644 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.644 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.644 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:42.644 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.644 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.644 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.644 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:20:42.644 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.644 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.645 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.645 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.645 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:20:42.645 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.645 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.645 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.645 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.645 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557344+0000", 2024-09-17T02:20:42.645 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.347e-06 2024-09-17T02:20:42.645 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.645 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.645 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.645 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557351+0000", 2024-09-17T02:20:42.646 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5560000000000004e-06 2024-09-17T02:20:42.646 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.646 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.646 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.646 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557369+0000", 2024-09-17T02:20:42.646 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7703e-05 2024-09-17T02:20:42.646 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.646 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.646 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.646 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557382+0000", 2024-09-17T02:20:42.646 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3664e-05 2024-09-17T02:20:42.646 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.646 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.646 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:42.647 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558997+0000", 2024-09-17T02:20:42.647 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0016147970000000001 2024-09-17T02:20:42.647 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.647 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.647 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:42.647 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559236+0000", 2024-09-17T02:20:42.647 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00023900200000000001 2024-09-17T02:20:42.647 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.647 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.647 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:42.647 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559547+0000", 2024-09-17T02:20:42.647 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031132399999999998 2024-09-17T02:20:42.647 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.647 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.648 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:42.648 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563130+0000", 2024-09-17T02:20:42.648 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003582989 2024-09-17T02:20:42.648 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.648 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.648 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:42.648 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587069+0000", 2024-09-17T02:20:42.648 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023938496 2024-09-17T02:20:42.648 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.648 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.648 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:42.648 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587192+0000", 2024-09-17T02:20:42.648 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123514 2024-09-17T02:20:42.649 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.649 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.649 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:42.649 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587279+0000", 2024-09-17T02:20:42.649 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6662000000000005e-05 2024-09-17T02:20:42.649 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.649 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.649 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.649 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.649 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.649 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:42.649 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:20:42.649 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.988451087000001, 2024-09-17T02:20:42.649 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030490703000000001, 2024-09-17T02:20:42.650 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.650 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.650 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:42.650 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.650 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.650 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.650 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:20:42.650 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.650 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.650 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.650 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:20:42.650 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.651 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.651 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557403+0000", 2024-09-17T02:20:42.651 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.77e-06 2024-09-17T02:20:42.651 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.651 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.651 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557412+0000", 2024-09-17T02:20:42.651 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4099999999999997e-06 2024-09-17T02:20:42.651 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.651 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.651 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557431+0000", 2024-09-17T02:20:42.652 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9177e-05 2024-09-17T02:20:42.652 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.652 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.652 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557444+0000", 2024-09-17T02:20:42.652 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2999999999999999e-05 2024-09-17T02:20:42.652 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.652 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:42.652 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557722+0000", 2024-09-17T02:20:42.652 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00027760699999999997 2024-09-17T02:20:42.652 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.653 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:42.653 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557991+0000", 2024-09-17T02:20:42.653 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00026892499999999999 2024-09-17T02:20:42.653 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.653 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.653 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:42.653 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558265+0000", 2024-09-17T02:20:42.653 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000274524 2024-09-17T02:20:42.653 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.653 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.653 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:42.653 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564270+0000", 2024-09-17T02:20:42.653 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060045339999999997 2024-09-17T02:20:42.654 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.654 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.654 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:42.654 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587701+0000", 2024-09-17T02:20:42.654 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023431285999999999 2024-09-17T02:20:42.654 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.654 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.654 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:42.654 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587803+0000", 2024-09-17T02:20:42.654 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000101371 2024-09-17T02:20:42.654 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.654 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.654 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:42.654 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587892+0000", 2024-09-17T02:20:42.655 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9098999999999995e-05 2024-09-17T02:20:42.655 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.655 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.655 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.655 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.655 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.655 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:42.655 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:20:42.655 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.988369491, 2024-09-17T02:20:42.655 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029886725999999999, 2024-09-17T02:20:42.655 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:42.655 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:42.655 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:20:42.655 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:42.656 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.656 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:42.656 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:20:42.656 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.656 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.656 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.656 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:42.656 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:20:42.656 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:42.656 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.656 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.656 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:42.656 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557484+0000", 2024-09-17T02:20:42.656 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.26e-06 2024-09-17T02:20:42.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.657 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.657 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:42.657 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557489+0000", 2024-09-17T02:20:42.657 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2530000000000004e-06 2024-09-17T02:20:42.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.657 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.657 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:42.657 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557507+0000", 2024-09-17T02:20:42.657 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7473999999999999e-05 2024-09-17T02:20:42.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.657 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.657 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.657 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557524+0000", 2024-09-17T02:20:42.658 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7912999999999999e-05 2024-09-17T02:20:42.658 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.658 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.658 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:42.658 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572428+0000", 2024-09-17T02:20:42.658 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014903451999999999 2024-09-17T02:20:42.658 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.658 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.658 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:42.658 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572589+0000", 2024-09-17T02:20:42.658 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000161299 2024-09-17T02:20:42.658 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:42.658 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:42.658 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:42.659 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587369+0000", 2024-09-17T02:20:42.659 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014780075 2024-09-17T02:20:42.659 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.659 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.659 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.659 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:42.659 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:42.659 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:20:42.661 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:42.664+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:42.663 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:20:42.664 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:20:42.666 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-17T02:20:42.667 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":46,"stamp":"2024-09-17T02:20:41.350816+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":937823133,"num_objects":14327,"num_object_clones":0,"num_object_copies":28654,"num_objects_missing_on_primary":0,"num_objects_missing":3,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14327,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":14551,"num_write_kb":918740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14500,"ondisk_log_size":14500,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":213788,"kb_used_data":111904,"kb_used_omap":4,"kb_used_meta":101819,"kb_avail":282901732,"statfs":{"total":289910292480,"available":289691373568,"internally_reserved":0,"allocated":114589696,"data_stored":1820276682,"data_compressed":1566166,"data_compressed_allocated":113750016,"data_compressed_original":1819967488,"omap_allocated":4785,"internal_metadata":104262991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,5,3,6],"upper_bound":16},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":884736000,"num_objects":13500,"num_object_clones":0,"num_object_copies":27000,"num_objects_missing_on_primary":0,"num_objects_missing":3,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13500,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13500,"num_write_kb":864000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001776"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T02:20:37.704393+0000","last_change":"2024-09-17T02:20:16.577643+0000","last_active":"2024-09-17T02:20:37.704393+0000","last_peered":"2024-09-17T02:20:37.704393+0000","last_clean":"2024-09-17T02:20:37.704393+0000","last_became_active":"2024-09-17T02:20:16.576566+0000","last_became_peered":"2024-09-17T02:20:16.576566+0000","last_unstale":"2024-09-17T02:20:37.704393+0000","last_undegraded":"2024-09-17T02:20:37.704393+0000","last_fullsized":"2024-09-17T02:20:37.704393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:34.971816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":3,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-17T02:20:36.696728+0000","last_change":"2024-09-17T02:20:36.696728+0000","last_active":"2024-09-17T02:20:15.524398+0000","last_peered":"2024-09-17T02:20:15.524398+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:20:36.696728+0000","last_undegraded":"2024-09-17T02:20:36.696728+0000","last_fullsized":"2024-09-17T02:20:36.696728+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.696716+0000","last_change":"2024-09-17T02:20:16.582493+0000","last_active":"2024-09-17T02:20:36.696716+0000","last_peered":"2024-09-17T02:20:36.696716+0000","last_clean":"2024-09-17T02:20:36.696716+0000","last_became_active":"2024-09-17T02:20:16.581463+0000","last_became_peered":"2024-09-17T02:20:16.581463+0000","last_unstale":"2024-09-17T02:20:36.696716+0000","last_undegraded":"2024-09-17T02:20:36.696716+0000","last_fullsized":"2024-09-17T02:20:36.696716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:12.134652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695599+0000","last_change":"2024-09-17T02:20:16.568747+0000","last_active":"2024-09-17T02:20:36.695599+0000","last_peered":"2024-09-17T02:20:36.695599+0000","last_clean":"2024-09-17T02:20:36.695599+0000","last_became_active":"2024-09-17T02:20:16.566795+0000","last_became_peered":"2024-09-17T02:20:16.566795+0000","last_unstale":"2024-09-17T02:20:36.695599+0000","last_undegraded":"2024-09-17T02:20:36.695599+0000","last_fullsized":"2024-09-17T02:20:36.695599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:51.799644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":3,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-17T02:20:36.695614+0000","last_change":"2024-09-17T02:20:36.695614+0000","last_active":"2024-09-17T02:20:15.524398+0000","last_peered":"2024-09-17T02:20:15.524398+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:20:36.695614+0000","last_undegraded":"2024-09-17T02:20:36.695614+0000","last_fullsized":"2024-09-17T02:20:36.695614+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695117+0000","last_change":"2024-09-17T02:20:16.568765+0000","last_active":"2024-09-17T02:20:36.695117+0000","last_peered":"2024-09-17T02:20:36.695117+0000","last_clean":"2024-09-17T02:20:36.695117+0000","last_became_active":"2024-09-17T02:20:16.564108+0000","last_became_peered":"2024-09-17T02:20:16.564108+0000","last_unstale":"2024-09-17T02:20:36.695117+0000","last_undegraded":"2024-09-17T02:20:36.695117+0000","last_fullsized":"2024-09-17T02:20:36.695117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:26.782410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.694750+0000","last_change":"2024-09-17T02:20:16.563357+0000","last_active":"2024-09-17T02:20:36.694750+0000","last_peered":"2024-09-17T02:20:36.694750+0000","last_clean":"2024-09-17T02:20:36.694750+0000","last_became_active":"2024-09-17T02:20:16.562276+0000","last_became_peered":"2024-09-17T02:20:16.562276+0000","last_unstale":"2024-09-17T02:20:36.694750+0000","last_undegraded":"2024-09-17T02:20:36.694750+0000","last_fullsized":"2024-09-17T02:20:36.694750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:47.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695189+0000","last_change":"2024-09-17T02:20:16.568482+0000","last_active":"2024-09-17T02:20:36.695189+0000","last_peered":"2024-09-17T02:20:36.695189+0000","last_clean":"2024-09-17T02:20:36.695189+0000","last_became_active":"2024-09-17T02:20:16.565416+0000","last_became_peered":"2024-09-17T02:20:16.565416+0000","last_unstale":"2024-09-17T02:20:36.695189+0000","last_undegraded":"2024-09-17T02:20:36.695189+0000","last_fullsized":"2024-09-17T02:20:36.695189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:13.574859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695711+0000","last_change":"2024-09-17T02:20:16.584665+0000","last_active":"2024-09-17T02:20:36.695711+0000","last_peered":"2024-09-17T02:20:36.695711+0000","last_clean":"2024-09-17T02:20:36.695711+0000","last_became_active":"2024-09-17T02:20:16.580797+0000","last_became_peered":"2024-09-17T02:20:16.580797+0000","last_unstale":"2024-09-17T02:20:36.695711+0000","last_undegraded":"2024-09-17T02:20:36.695711+0000","last_fullsized":"2024-09-17T02:20:36.695711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:47.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T02:20:37.704323+0000","last_change":"2024-09-17T02:20:16.577666+0000","last_active":"2024-09-17T02:20:37.704323+0000","last_peered":"2024-09-17T02:20:37.704323+0000","last_clean":"2024-09-17T02:20:37.704323+0000","last_became_active":"2024-09-17T02:20:16.574914+0000","last_became_peered":"2024-09-17T02:20:16.574914+0000","last_unstale":"2024-09-17T02:20:37.704323+0000","last_undegraded":"2024-09-17T02:20:37.704323+0000","last_fullsized":"2024-09-17T02:20:37.704323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:48.730100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.696739+0000","last_change":"2024-09-17T02:20:16.565609+0000","last_active":"2024-09-17T02:20:36.696739+0000","last_peered":"2024-09-17T02:20:36.696739+0000","last_clean":"2024-09-17T02:20:36.696739+0000","last_became_active":"2024-09-17T02:20:16.564092+0000","last_became_peered":"2024-09-17T02:20:16.564092+0000","last_unstale":"2024-09-17T02:20:36.696739+0000","last_undegraded":"2024-09-17T02:20:36.696739+0000","last_fullsized":"2024-09-17T02:20:36.696739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:40.921595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":3,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-17T02:20:36.695390+0000","last_change":"2024-09-17T02:20:36.695390+0000","last_active":"2024-09-17T02:20:15.524398+0000","last_peered":"2024-09-17T02:20:15.524398+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:20:36.695390+0000","last_undegraded":"2024-09-17T02:20:36.695390+0000","last_fullsized":"2024-09-17T02:20:36.695390+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":3,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-17T02:20:36.696882+0000","last_change":"2024-09-17T02:20:36.696882+0000","last_active":"2024-09-17T02:20:15.524398+0000","last_peered":"2024-09-17T02:20:15.524398+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:20:36.696882+0000","last_undegraded":"2024-09-17T02:20:36.696882+0000","last_fullsized":"2024-09-17T02:20:36.696882+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.694724+0000","last_change":"2024-09-17T02:20:16.563197+0000","last_active":"2024-09-17T02:20:36.694724+0000","last_peered":"2024-09-17T02:20:36.694724+0000","last_clean":"2024-09-17T02:20:36.694724+0000","last_became_active":"2024-09-17T02:20:16.561221+0000","last_became_peered":"2024-09-17T02:20:16.561221+0000","last_unstale":"2024-09-17T02:20:36.694724+0000","last_undegraded":"2024-09-17T02:20:36.694724+0000","last_fullsized":"2024-09-17T02:20:36.694724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:43.309196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.694851+0000","last_change":"2024-09-17T02:20:16.581305+0000","last_active":"2024-09-17T02:20:36.694851+0000","last_peered":"2024-09-17T02:20:36.694851+0000","last_clean":"2024-09-17T02:20:36.694851+0000","last_became_active":"2024-09-17T02:20:16.580377+0000","last_became_peered":"2024-09-17T02:20:16.580377+0000","last_unstale":"2024-09-17T02:20:36.694851+0000","last_undegraded":"2024-09-17T02:20:36.694851+0000","last_fullsized":"2024-09-17T02:20:36.694851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:43.454908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695222+0000","last_change":"2024-09-17T02:20:16.562686+0000","last_active":"2024-09-17T02:20:36.695222+0000","last_peered":"2024-09-17T02:20:36.695222+0000","last_clean":"2024-09-17T02:20:36.695222+0000","last_became_active":"2024-09-17T02:20:16.561446+0000","last_became_peered":"2024-09-17T02:20:16.561446+0000","last_unstale":"2024-09-17T02:20:36.695222+0000","last_undegraded":"2024-09-17T02:20:36.695222+0000","last_fullsized":"2024-09-17T02:20:36.695222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:22.801598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.696199+0000","last_change":"2024-09-17T02:20:16.563482+0000","last_active":"2024-09-17T02:20:36.696199+0000","last_peered":"2024-09-17T02:20:36.696199+0000","last_clean":"2024-09-17T02:20:36.696199+0000","last_became_active":"2024-09-17T02:20:16.562735+0000","last_became_peered":"2024-09-17T02:20:16.562735+0000","last_unstale":"2024-09-17T02:20:36.696199+0000","last_undegraded":"2024-09-17T02:20:36.696199+0000","last_fullsized":"2024-09-17T02:20:36.696199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:10.315951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":3,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-17T02:20:36.698267+0000","last_change":"2024-09-17T02:20:36.698267+0000","last_active":"2024-09-17T02:20:15.524398+0000","last_peered":"2024-09-17T02:20:15.524398+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:20:36.698267+0000","last_undegraded":"2024-09-17T02:20:36.698267+0000","last_fullsized":"2024-09-17T02:20:36.698267+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695504+0000","last_change":"2024-09-17T02:20:16.586950+0000","last_active":"2024-09-17T02:20:36.695504+0000","last_peered":"2024-09-17T02:20:36.695504+0000","last_clean":"2024-09-17T02:20:36.695504+0000","last_became_active":"2024-09-17T02:20:16.586281+0000","last_became_peered":"2024-09-17T02:20:16.586281+0000","last_unstale":"2024-09-17T02:20:36.695504+0000","last_undegraded":"2024-09-17T02:20:36.695504+0000","last_fullsized":"2024-09-17T02:20:36.695504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:22.801598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695733+0000","last_change":"2024-09-17T02:20:16.570514+0000","last_active":"2024-09-17T02:20:36.695733+0000","last_peered":"2024-09-17T02:20:36.695733+0000","last_clean":"2024-09-17T02:20:36.695733+0000","last_became_active":"2024-09-17T02:20:16.567156+0000","last_became_peered":"2024-09-17T02:20:16.567156+0000","last_unstale":"2024-09-17T02:20:36.695733+0000","last_undegraded":"2024-09-17T02:20:36.695733+0000","last_fullsized":"2024-09-17T02:20:36.695733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:51.596077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695968+0000","last_change":"2024-09-17T02:20:16.571275+0000","last_active":"2024-09-17T02:20:36.695968+0000","last_peered":"2024-09-17T02:20:36.695968+0000","last_clean":"2024-09-17T02:20:36.695968+0000","last_became_active":"2024-09-17T02:20:16.569751+0000","last_became_peered":"2024-09-17T02:20:16.569751+0000","last_unstale":"2024-09-17T02:20:36.695968+0000","last_undegraded":"2024-09-17T02:20:36.695968+0000","last_fullsized":"2024-09-17T02:20:36.695968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:41.362905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T02:20:37.701723+0000","last_change":"2024-09-17T02:20:16.567109+0000","last_active":"2024-09-17T02:20:37.701723+0000","last_peered":"2024-09-17T02:20:37.701723+0000","last_clean":"2024-09-17T02:20:37.701723+0000","last_became_active":"2024-09-17T02:20:16.564753+0000","last_became_peered":"2024-09-17T02:20:16.564753+0000","last_unstale":"2024-09-17T02:20:37.701723+0000","last_undegraded":"2024-09-17T02:20:37.701723+0000","last_fullsized":"2024-09-17T02:20:37.701723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:01.888476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.694953+0000","last_change":"2024-09-17T02:20:16.558778+0000","last_active":"2024-09-17T02:20:36.694953+0000","last_peered":"2024-09-17T02:20:36.694953+0000","last_clean":"2024-09-17T02:20:36.694953+0000","last_became_active":"2024-09-17T02:20:16.557967+0000","last_became_peered":"2024-09-17T02:20:16.557967+0000","last_unstale":"2024-09-17T02:20:36.694953+0000","last_undegraded":"2024-09-17T02:20:36.694953+0000","last_fullsized":"2024-09-17T02:20:36.694953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:40.577627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":3,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-17T02:20:36.695289+0000","last_change":"2024-09-17T02:20:36.695289+0000","last_active":"2024-09-17T02:20:15.524398+0000","last_peered":"2024-09-17T02:20:15.524398+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:20:36.695289+0000","last_undegraded":"2024-09-17T02:20:36.695289+0000","last_fullsized":"2024-09-17T02:20:36.695289+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T02:20:37.704532+0000","last_change":"2024-09-17T02:20:16.573189+0000","last_active":"2024-09-17T02:20:37.704532+0000","last_peered":"2024-09-17T02:20:37.704532+0000","last_clean":"2024-09-17T02:20:37.704532+0000","last_became_active":"2024-09-17T02:20:16.570669+0000","last_became_peered":"2024-09-17T02:20:16.570669+0000","last_unstale":"2024-09-17T02:20:37.704532+0000","last_undegraded":"2024-09-17T02:20:37.704532+0000","last_fullsized":"2024-09-17T02:20:37.704532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:52.753219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.696999+0000","last_change":"2024-09-17T02:20:16.581076+0000","last_active":"2024-09-17T02:20:36.696999+0000","last_peered":"2024-09-17T02:20:36.696999+0000","last_clean":"2024-09-17T02:20:36.696999+0000","last_became_active":"2024-09-17T02:20:16.579989+0000","last_became_peered":"2024-09-17T02:20:16.579989+0000","last_unstale":"2024-09-17T02:20:36.696999+0000","last_undegraded":"2024-09-17T02:20:36.696999+0000","last_fullsized":"2024-09-17T02:20:36.696999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:43.454908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.696825+0000","last_change":"2024-09-17T02:20:16.582808+0000","last_active":"2024-09-17T02:20:36.696825+0000","last_peered":"2024-09-17T02:20:36.696825+0000","last_clean":"2024-09-17T02:20:36.696825+0000","last_became_active":"2024-09-17T02:20:16.581358+0000","last_became_peered":"2024-09-17T02:20:16.581358+0000","last_unstale":"2024-09-17T02:20:36.696825+0000","last_undegraded":"2024-09-17T02:20:36.696825+0000","last_fullsized":"2024-09-17T02:20:36.696825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:26.441162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":3,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-17T02:20:36.696049+0000","last_change":"2024-09-17T02:20:36.696049+0000","last_active":"2024-09-17T02:20:15.524398+0000","last_peered":"2024-09-17T02:20:15.524398+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:20:36.696049+0000","last_undegraded":"2024-09-17T02:20:36.696049+0000","last_fullsized":"2024-09-17T02:20:36.696049+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.696486+0000","last_change":"2024-09-17T02:20:16.581125+0000","last_active":"2024-09-17T02:20:36.696486+0000","last_peered":"2024-09-17T02:20:36.696486+0000","last_clean":"2024-09-17T02:20:36.696486+0000","last_became_active":"2024-09-17T02:20:16.580393+0000","last_became_peered":"2024-09-17T02:20:16.580393+0000","last_unstale":"2024-09-17T02:20:36.696486+0000","last_undegraded":"2024-09-17T02:20:36.696486+0000","last_fullsized":"2024-09-17T02:20:36.696486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:24.706394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T02:20:37.705186+0000","last_change":"2024-09-17T02:20:16.565220+0000","last_active":"2024-09-17T02:20:37.705186+0000","last_peered":"2024-09-17T02:20:37.705186+0000","last_clean":"2024-09-17T02:20:37.705186+0000","last_became_active":"2024-09-17T02:20:16.562419+0000","last_became_peered":"2024-09-17T02:20:16.562419+0000","last_unstale":"2024-09-17T02:20:37.705186+0000","last_undegraded":"2024-09-17T02:20:37.705186+0000","last_fullsized":"2024-09-17T02:20:37.705186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:03.961277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695089+0000","last_change":"2024-09-17T02:20:16.579408+0000","last_active":"2024-09-17T02:20:36.695089+0000","last_peered":"2024-09-17T02:20:36.695089+0000","last_clean":"2024-09-17T02:20:36.695089+0000","last_became_active":"2024-09-17T02:20:16.577202+0000","last_became_peered":"2024-09-17T02:20:16.577202+0000","last_unstale":"2024-09-17T02:20:36.695089+0000","last_undegraded":"2024-09-17T02:20:36.695089+0000","last_fullsized":"2024-09-17T02:20:36.695089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:20.414231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695306+0000","last_change":"2024-09-17T02:20:16.570810+0000","last_active":"2024-09-17T02:20:36.695306+0000","last_peered":"2024-09-17T02:20:36.695306+0000","last_clean":"2024-09-17T02:20:36.695306+0000","last_became_active":"2024-09-17T02:20:16.569273+0000","last_became_peered":"2024-09-17T02:20:16.569273+0000","last_unstale":"2024-09-17T02:20:36.695306+0000","last_undegraded":"2024-09-17T02:20:36.695306+0000","last_fullsized":"2024-09-17T02:20:36.695306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:42.123535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":3,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-17T02:20:36.696618+0000","last_change":"2024-09-17T02:20:36.696618+0000","last_active":"2024-09-17T02:20:15.524398+0000","last_peered":"2024-09-17T02:20:15.524398+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:20:36.696618+0000","last_undegraded":"2024-09-17T02:20:36.696618+0000","last_fullsized":"2024-09-17T02:20:36.696618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.696071+0000","last_change":"2024-09-17T02:20:15.559935+0000","last_active":"2024-09-17T02:20:36.696071+0000","last_peered":"2024-09-17T02:20:36.696071+0000","last_clean":"2024-09-17T02:20:36.696071+0000","last_became_active":"2024-09-17T02:20:15.559413+0000","last_became_peered":"2024-09-17T02:20:15.559413+0000","last_unstale":"2024-09-17T02:20:36.696071+0000","last_undegraded":"2024-09-17T02:20:36.696071+0000","last_fullsized":"2024-09-17T02:20:36.696071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:52.985837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T02:20:37.705780+0000","last_change":"2024-09-17T02:20:16.581819+0000","last_active":"2024-09-17T02:20:37.705780+0000","last_peered":"2024-09-17T02:20:37.705780+0000","last_clean":"2024-09-17T02:20:37.705780+0000","last_became_active":"2024-09-17T02:20:16.577168+0000","last_became_peered":"2024-09-17T02:20:16.577168+0000","last_unstale":"2024-09-17T02:20:37.705780+0000","last_undegraded":"2024-09-17T02:20:37.705780+0000","last_fullsized":"2024-09-17T02:20:37.705780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:47.756576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.696034+0000","last_change":"2024-09-17T02:20:15.550890+0000","last_active":"2024-09-17T02:20:36.696034+0000","last_peered":"2024-09-17T02:20:36.696034+0000","last_clean":"2024-09-17T02:20:36.696034+0000","last_became_active":"2024-09-17T02:20:15.550077+0000","last_became_peered":"2024-09-17T02:20:15.550077+0000","last_unstale":"2024-09-17T02:20:36.696034+0000","last_undegraded":"2024-09-17T02:20:36.696034+0000","last_fullsized":"2024-09-17T02:20:36.696034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:36.119249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.698571+0000","last_change":"2024-09-17T02:20:16.581457+0000","last_active":"2024-09-17T02:20:36.698571+0000","last_peered":"2024-09-17T02:20:36.698571+0000","last_clean":"2024-09-17T02:20:36.698571+0000","last_became_active":"2024-09-17T02:20:16.579428+0000","last_became_peered":"2024-09-17T02:20:16.579428+0000","last_unstale":"2024-09-17T02:20:36.698571+0000","last_undegraded":"2024-09-17T02:20:36.698571+0000","last_fullsized":"2024-09-17T02:20:36.698571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:55.083688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T02:20:37.702396+0000","last_change":"2024-09-17T02:20:15.569442+0000","last_active":"2024-09-17T02:20:37.702396+0000","last_peered":"2024-09-17T02:20:37.702396+0000","last_clean":"2024-09-17T02:20:37.702396+0000","last_became_active":"2024-09-17T02:20:15.567946+0000","last_became_peered":"2024-09-17T02:20:15.567946+0000","last_unstale":"2024-09-17T02:20:37.702396+0000","last_undegraded":"2024-09-17T02:20:37.702396+0000","last_fullsized":"2024-09-17T02:20:37.702396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:55.866388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695718+0000","last_change":"2024-09-17T02:20:16.579779+0000","last_active":"2024-09-17T02:20:36.695718+0000","last_peered":"2024-09-17T02:20:36.695718+0000","last_clean":"2024-09-17T02:20:36.695718+0000","last_became_active":"2024-09-17T02:20:16.576734+0000","last_became_peered":"2024-09-17T02:20:16.576734+0000","last_unstale":"2024-09-17T02:20:36.695718+0000","last_undegraded":"2024-09-17T02:20:36.695718+0000","last_fullsized":"2024-09-17T02:20:36.695718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:26.782410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695617+0000","last_change":"2024-09-17T02:20:15.559245+0000","last_active":"2024-09-17T02:20:36.695617+0000","last_peered":"2024-09-17T02:20:36.695617+0000","last_clean":"2024-09-17T02:20:36.695617+0000","last_became_active":"2024-09-17T02:20:15.558518+0000","last_became_peered":"2024-09-17T02:20:15.558518+0000","last_unstale":"2024-09-17T02:20:36.695617+0000","last_undegraded":"2024-09-17T02:20:36.695617+0000","last_fullsized":"2024-09-17T02:20:36.695617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:52.783635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"26'822","reported_seq":838,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.714646+0000","last_change":"2024-09-17T02:20:31.673149+0000","last_active":"2024-09-17T02:20:36.714646+0000","last_peered":"2024-09-17T02:20:36.714646+0000","last_clean":"2024-09-17T02:20:36.714646+0000","last_became_active":"2024-09-17T02:20:31.671595+0000","last_became_peered":"2024-09-17T02:20:31.671595+0000","last_unstale":"2024-09-17T02:20:36.714646+0000","last_undegraded":"2024-09-17T02:20:36.714646+0000","last_fullsized":"2024-09-17T02:20:36.714646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:37:51.675707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53870592,"num_objects":822,"num_object_clones":0,"num_object_copies":1644,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":822,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":52608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.696070+0000","last_change":"2024-09-17T02:20:15.559110+0000","last_active":"2024-09-17T02:20:36.696070+0000","last_peered":"2024-09-17T02:20:36.696070+0000","last_clean":"2024-09-17T02:20:36.696070+0000","last_became_active":"2024-09-17T02:20:15.558285+0000","last_became_peered":"2024-09-17T02:20:15.558285+0000","last_unstale":"2024-09-17T02:20:36.696070+0000","last_undegraded":"2024-09-17T02:20:36.696070+0000","last_fullsized":"2024-09-17T02:20:36.696070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:15.782658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":3,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-17T02:20:36.694838+0000","last_change":"2024-09-17T02:20:36.694838+0000","last_active":"2024-09-17T02:20:15.524398+0000","last_peered":"2024-09-17T02:20:15.524398+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:20:36.694838+0000","last_undegraded":"2024-09-17T02:20:36.694838+0000","last_fullsized":"2024-09-17T02:20:36.694838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"25'918","reported_seq":932,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-17T02:20:36.695996+0000","last_change":"2024-09-17T02:20:37.419470+0000","last_active":"2024-09-17T02:20:37.419470+0000","last_peered":"2024-09-17T02:20:36.695996+0000","last_clean":"2024-09-17T02:20:36.695996+0000","last_became_active":"2024-09-17T02:20:31.669091+0000","last_became_peered":"2024-09-17T02:20:31.669091+0000","last_unstale":"2024-09-17T02:20:36.695996+0000","last_undegraded":"2024-09-17T02:20:36.695996+0000","last_fullsized":"2024-09-17T02:20:36.695996+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60162048,"num_objects":918,"num_object_clones":0,"num_object_copies":1836,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":918,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":918,"num_write_kb":58752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T02:20:37.705347+0000","last_change":"2024-09-17T02:20:15.568414+0000","last_active":"2024-09-17T02:20:37.705347+0000","last_peered":"2024-09-17T02:20:37.705347+0000","last_clean":"2024-09-17T02:20:37.705347+0000","last_became_active":"2024-09-17T02:20:15.567596+0000","last_became_peered":"2024-09-17T02:20:15.567596+0000","last_unstale":"2024-09-17T02:20:37.705347+0000","last_undegraded":"2024-09-17T02:20:37.705347+0000","last_fullsized":"2024-09-17T02:20:37.705347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:11.356699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":3,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-17T02:20:36.695617+0000","last_change":"2024-09-17T02:20:36.695617+0000","last_active":"2024-09-17T02:20:15.524398+0000","last_peered":"2024-09-17T02:20:15.524398+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:20:36.695617+0000","last_undegraded":"2024-09-17T02:20:36.695617+0000","last_fullsized":"2024-09-17T02:20:36.695617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"27'981","reported_seq":999,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T02:20:38.430383+0000","last_change":"2024-09-17T02:20:31.671691+0000","last_active":"2024-09-17T02:20:38.430383+0000","last_peered":"2024-09-17T02:20:38.430383+0000","last_clean":"2024-09-17T02:20:38.430383+0000","last_became_active":"2024-09-17T02:20:31.670982+0000","last_became_peered":"2024-09-17T02:20:31.670982+0000","last_unstale":"2024-09-17T02:20:38.430383+0000","last_undegraded":"2024-09-17T02:20:38.430383+0000","last_fullsized":"2024-09-17T02:20:38.430383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":981,"log_dups_size":0,"ondisk_log_size":981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:42.646226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64290816,"num_objects":981,"num_object_clones":0,"num_object_copies":1962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":981,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":981,"num_write_kb":62784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.697020+0000","last_change":"2024-09-17T02:20:15.559767+0000","last_active":"2024-09-17T02:20:36.697020+0000","last_peered":"2024-09-17T02:20:36.697020+0000","last_clean":"2024-09-17T02:20:36.697020+0000","last_became_active":"2024-09-17T02:20:15.558888+0000","last_became_peered":"2024-09-17T02:20:15.558888+0000","last_unstale":"2024-09-17T02:20:36.697020+0000","last_undegraded":"2024-09-17T02:20:36.697020+0000","last_fullsized":"2024-09-17T02:20:36.697020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:09.831510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.694844+0000","last_change":"2024-09-17T02:20:16.565632+0000","last_active":"2024-09-17T02:20:36.694844+0000","last_peered":"2024-09-17T02:20:36.694844+0000","last_clean":"2024-09-17T02:20:36.694844+0000","last_became_active":"2024-09-17T02:20:16.563630+0000","last_became_peered":"2024-09-17T02:20:16.563630+0000","last_unstale":"2024-09-17T02:20:36.694844+0000","last_undegraded":"2024-09-17T02:20:36.694844+0000","last_fullsized":"2024-09-17T02:20:36.694844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:05.049317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"26'903","reported_seq":919,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.711223+0000","last_change":"2024-09-17T02:20:31.666487+0000","last_active":"2024-09-17T02:20:36.711223+0000","last_peered":"2024-09-17T02:20:36.711223+0000","last_clean":"2024-09-17T02:20:36.711223+0000","last_became_active":"2024-09-17T02:20:31.665775+0000","last_became_peered":"2024-09-17T02:20:31.665775+0000","last_unstale":"2024-09-17T02:20:36.711223+0000","last_undegraded":"2024-09-17T02:20:36.711223+0000","last_fullsized":"2024-09-17T02:20:36.711223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:57:45.009348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59179008,"num_objects":903,"num_object_clones":0,"num_object_copies":1806,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":903,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":903,"num_write_kb":57792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.696390+0000","last_change":"2024-09-17T02:20:15.562539+0000","last_active":"2024-09-17T02:20:36.696390+0000","last_peered":"2024-09-17T02:20:36.696390+0000","last_clean":"2024-09-17T02:20:36.696390+0000","last_became_active":"2024-09-17T02:20:15.561801+0000","last_became_peered":"2024-09-17T02:20:15.561801+0000","last_unstale":"2024-09-17T02:20:36.696390+0000","last_undegraded":"2024-09-17T02:20:36.696390+0000","last_fullsized":"2024-09-17T02:20:36.696390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:15.848081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.696634+0000","last_change":"2024-09-17T02:20:16.578474+0000","last_active":"2024-09-17T02:20:36.696634+0000","last_peered":"2024-09-17T02:20:36.696634+0000","last_clean":"2024-09-17T02:20:36.696634+0000","last_became_active":"2024-09-17T02:20:16.576264+0000","last_became_peered":"2024-09-17T02:20:16.576264+0000","last_unstale":"2024-09-17T02:20:36.696634+0000","last_undegraded":"2024-09-17T02:20:36.696634+0000","last_fullsized":"2024-09-17T02:20:36.696634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:48.313282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"25'859","reported_seq":874,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-17T02:20:36.689345+0000","last_change":"2024-09-17T02:20:37.420964+0000","last_active":"2024-09-17T02:20:37.420964+0000","last_peered":"2024-09-17T02:20:36.689345+0000","last_clean":"2024-09-17T02:20:36.689345+0000","last_became_active":"2024-09-17T02:20:31.669825+0000","last_became_peered":"2024-09-17T02:20:31.669825+0000","last_unstale":"2024-09-17T02:20:36.689345+0000","last_undegraded":"2024-09-17T02:20:36.689345+0000","last_fullsized":"2024-09-17T02:20:36.689345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":859,"log_dups_size":0,"ondisk_log_size":859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56295424,"num_objects":859,"num_object_clones":0,"num_object_copies":1718,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":859,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":859,"num_write_kb":54976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.696880+0000","last_change":"2024-09-17T02:20:15.551986+0000","last_active":"2024-09-17T02:20:36.696880+0000","last_peered":"2024-09-17T02:20:36.696880+0000","last_clean":"2024-09-17T02:20:36.696880+0000","last_became_active":"2024-09-17T02:20:15.550418+0000","last_became_peered":"2024-09-17T02:20:15.550418+0000","last_unstale":"2024-09-17T02:20:36.696880+0000","last_undegraded":"2024-09-17T02:20:36.696880+0000","last_fullsized":"2024-09-17T02:20:36.696880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:17.866665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.696107+0000","last_change":"2024-09-17T02:20:16.570845+0000","last_active":"2024-09-17T02:20:36.696107+0000","last_peered":"2024-09-17T02:20:36.696107+0000","last_clean":"2024-09-17T02:20:36.696107+0000","last_became_active":"2024-09-17T02:20:16.568862+0000","last_became_peered":"2024-09-17T02:20:16.568862+0000","last_unstale":"2024-09-17T02:20:36.696107+0000","last_undegraded":"2024-09-17T02:20:36.696107+0000","last_fullsized":"2024-09-17T02:20:36.696107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:30.715391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"26'883","reported_seq":899,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.731933+0000","last_change":"2024-09-17T02:20:31.669260+0000","last_active":"2024-09-17T02:20:36.731933+0000","last_peered":"2024-09-17T02:20:36.731933+0000","last_clean":"2024-09-17T02:20:36.731933+0000","last_became_active":"2024-09-17T02:20:31.668017+0000","last_became_peered":"2024-09-17T02:20:31.668017+0000","last_unstale":"2024-09-17T02:20:36.731933+0000","last_undegraded":"2024-09-17T02:20:36.731933+0000","last_fullsized":"2024-09-17T02:20:36.731933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":883,"log_dups_size":0,"ondisk_log_size":883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:32.347658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57868288,"num_objects":883,"num_object_clones":0,"num_object_copies":1766,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":883,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":883,"num_write_kb":56512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695146+0000","last_change":"2024-09-17T02:20:15.559849+0000","last_active":"2024-09-17T02:20:36.695146+0000","last_peered":"2024-09-17T02:20:36.695146+0000","last_clean":"2024-09-17T02:20:36.695146+0000","last_became_active":"2024-09-17T02:20:15.559431+0000","last_became_peered":"2024-09-17T02:20:15.559431+0000","last_unstale":"2024-09-17T02:20:36.695146+0000","last_undegraded":"2024-09-17T02:20:36.695146+0000","last_fullsized":"2024-09-17T02:20:36.695146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:31.933850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.696896+0000","last_change":"2024-09-17T02:20:16.586434+0000","last_active":"2024-09-17T02:20:36.696896+0000","last_peered":"2024-09-17T02:20:36.696896+0000","last_clean":"2024-09-17T02:20:36.696896+0000","last_became_active":"2024-09-17T02:20:16.585466+0000","last_became_peered":"2024-09-17T02:20:16.585466+0000","last_unstale":"2024-09-17T02:20:36.696896+0000","last_undegraded":"2024-09-17T02:20:36.696896+0000","last_fullsized":"2024-09-17T02:20:36.696896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:57:29.891850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"26'834","reported_seq":850,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.726050+0000","last_change":"2024-09-17T02:20:31.674087+0000","last_active":"2024-09-17T02:20:36.726050+0000","last_peered":"2024-09-17T02:20:36.726050+0000","last_clean":"2024-09-17T02:20:36.726050+0000","last_became_active":"2024-09-17T02:20:31.673495+0000","last_became_peered":"2024-09-17T02:20:31.673495+0000","last_unstale":"2024-09-17T02:20:36.726050+0000","last_undegraded":"2024-09-17T02:20:36.726050+0000","last_fullsized":"2024-09-17T02:20:36.726050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:19.606217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54657024,"num_objects":834,"num_object_clones":0,"num_object_copies":1668,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":834,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":834,"num_write_kb":53376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":3,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-17T02:20:36.696119+0000","last_change":"2024-09-17T02:20:36.696119+0000","last_active":"2024-09-17T02:20:14.516708+0000","last_peered":"2024-09-17T02:20:14.516708+0000","last_clean":"2024-09-17T02:20:14.516708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:20:36.696119+0000","last_undegraded":"2024-09-17T02:20:36.696119+0000","last_fullsized":"2024-09-17T02:20:36.696119+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695674+0000","last_change":"2024-09-17T02:20:16.582353+0000","last_active":"2024-09-17T02:20:36.695674+0000","last_peered":"2024-09-17T02:20:36.695674+0000","last_clean":"2024-09-17T02:20:36.695674+0000","last_became_active":"2024-09-17T02:20:16.581462+0000","last_became_peered":"2024-09-17T02:20:16.581462+0000","last_unstale":"2024-09-17T02:20:36.695674+0000","last_undegraded":"2024-09-17T02:20:36.695674+0000","last_fullsized":"2024-09-17T02:20:36.695674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:44.023284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"27'1026","reported_seq":1043,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T02:20:38.434347+0000","last_change":"2024-09-17T02:20:31.672194+0000","last_active":"2024-09-17T02:20:38.434347+0000","last_peered":"2024-09-17T02:20:38.434347+0000","last_clean":"2024-09-17T02:20:38.434347+0000","last_became_active":"2024-09-17T02:20:31.671763+0000","last_became_peered":"2024-09-17T02:20:31.671763+0000","last_unstale":"2024-09-17T02:20:38.434347+0000","last_undegraded":"2024-09-17T02:20:38.434347+0000","last_fullsized":"2024-09-17T02:20:38.434347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":1026,"log_dups_size":0,"ondisk_log_size":1026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:07.301574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67239936,"num_objects":1026,"num_object_clones":0,"num_object_copies":2052,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1026,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1026,"num_write_kb":65664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":3,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-17T02:20:36.697728+0000","last_change":"2024-09-17T02:20:36.697728+0000","last_active":"2024-09-17T02:20:14.516708+0000","last_peered":"2024-09-17T02:20:14.516708+0000","last_clean":"2024-09-17T02:20:14.516708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:20:36.697728+0000","last_undegraded":"2024-09-17T02:20:36.697728+0000","last_fullsized":"2024-09-17T02:20:36.697728+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695831+0000","last_change":"2024-09-17T02:20:16.583084+0000","last_active":"2024-09-17T02:20:36.695831+0000","last_peered":"2024-09-17T02:20:36.695831+0000","last_clean":"2024-09-17T02:20:36.695831+0000","last_became_active":"2024-09-17T02:20:16.582326+0000","last_became_peered":"2024-09-17T02:20:16.582326+0000","last_unstale":"2024-09-17T02:20:36.695831+0000","last_undegraded":"2024-09-17T02:20:36.695831+0000","last_fullsized":"2024-09-17T02:20:36.695831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:05.049317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"27'951","reported_seq":969,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T02:20:38.433245+0000","last_change":"2024-09-17T02:20:31.669953+0000","last_active":"2024-09-17T02:20:38.433245+0000","last_peered":"2024-09-17T02:20:38.433245+0000","last_clean":"2024-09-17T02:20:38.433245+0000","last_became_active":"2024-09-17T02:20:31.669173+0000","last_became_peered":"2024-09-17T02:20:31.669173+0000","last_unstale":"2024-09-17T02:20:38.433245+0000","last_undegraded":"2024-09-17T02:20:38.433245+0000","last_fullsized":"2024-09-17T02:20:38.433245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":951,"log_dups_size":0,"ondisk_log_size":951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:41:24.031323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62324736,"num_objects":951,"num_object_clones":0,"num_object_copies":1902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":951,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":951,"num_write_kb":60864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":236,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.696024+0000","last_change":"2024-09-17T02:20:04.612894+0000","last_active":"2024-09-17T02:20:36.696024+0000","last_peered":"2024-09-17T02:20:36.696024+0000","last_clean":"2024-09-17T02:20:36.696024+0000","last_became_active":"2024-09-17T02:20:04.610517+0000","last_became_peered":"2024-09-17T02:20:04.610517+0000","last_unstale":"2024-09-17T02:20:36.696024+0000","last_undegraded":"2024-09-17T02:20:36.696024+0000","last_fullsized":"2024-09-17T02:20:36.696024+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_clean_scrub_stamp":"2024-09-17T02:20:03.432050+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:51.879303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.696289+0000","last_change":"2024-09-17T02:20:12.513513+0000","last_active":"2024-09-17T02:20:36.696289+0000","last_peered":"2024-09-17T02:20:36.696289+0000","last_clean":"2024-09-17T02:20:36.696289+0000","last_became_active":"2024-09-17T02:20:10.504616+0000","last_became_peered":"2024-09-17T02:20:10.504616+0000","last_unstale":"2024-09-17T02:20:36.696289+0000","last_undegraded":"2024-09-17T02:20:36.696289+0000","last_fullsized":"2024-09-17T02:20:36.696289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:13.341611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001517832,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.696949+0000","last_change":"2024-09-17T02:20:15.560646+0000","last_active":"2024-09-17T02:20:36.696949+0000","last_peered":"2024-09-17T02:20:36.696949+0000","last_clean":"2024-09-17T02:20:36.696949+0000","last_became_active":"2024-09-17T02:20:15.559104+0000","last_became_peered":"2024-09-17T02:20:15.559104+0000","last_unstale":"2024-09-17T02:20:36.696949+0000","last_undegraded":"2024-09-17T02:20:36.696949+0000","last_fullsized":"2024-09-17T02:20:36.696949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:44.299986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.696960+0000","last_change":"2024-09-17T02:20:16.585522+0000","last_active":"2024-09-17T02:20:36.696960+0000","last_peered":"2024-09-17T02:20:36.696960+0000","last_clean":"2024-09-17T02:20:36.696960+0000","last_became_active":"2024-09-17T02:20:16.584520+0000","last_became_peered":"2024-09-17T02:20:16.584520+0000","last_unstale":"2024-09-17T02:20:36.696960+0000","last_undegraded":"2024-09-17T02:20:36.696960+0000","last_fullsized":"2024-09-17T02:20:36.696960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:14.123192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"26'908","reported_seq":924,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.723281+0000","last_change":"2024-09-17T02:20:31.675261+0000","last_active":"2024-09-17T02:20:36.723281+0000","last_peered":"2024-09-17T02:20:36.723281+0000","last_clean":"2024-09-17T02:20:36.723281+0000","last_became_active":"2024-09-17T02:20:31.674677+0000","last_became_peered":"2024-09-17T02:20:31.674677+0000","last_unstale":"2024-09-17T02:20:36.723281+0000","last_undegraded":"2024-09-17T02:20:36.723281+0000","last_fullsized":"2024-09-17T02:20:36.723281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:01:59.368049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59506688,"num_objects":908,"num_object_clones":0,"num_object_copies":1816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":908,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":58112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695897+0000","last_change":"2024-09-17T02:20:12.512798+0000","last_active":"2024-09-17T02:20:36.695897+0000","last_peered":"2024-09-17T02:20:36.695897+0000","last_clean":"2024-09-17T02:20:36.695897+0000","last_became_active":"2024-09-17T02:20:10.502115+0000","last_became_peered":"2024-09-17T02:20:10.502115+0000","last_unstale":"2024-09-17T02:20:36.695897+0000","last_undegraded":"2024-09-17T02:20:36.695897+0000","last_fullsized":"2024-09-17T02:20:36.695897+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:17.554878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083467700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695357+0000","last_change":"2024-09-17T02:20:15.551632+0000","last_active":"2024-09-17T02:20:36.695357+0000","last_peered":"2024-09-17T02:20:36.695357+0000","last_clean":"2024-09-17T02:20:36.695357+0000","last_became_active":"2024-09-17T02:20:15.551062+0000","last_became_peered":"2024-09-17T02:20:15.551062+0000","last_unstale":"2024-09-17T02:20:36.695357+0000","last_undegraded":"2024-09-17T02:20:36.695357+0000","last_fullsized":"2024-09-17T02:20:36.695357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:55.295518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T02:20:37.704580+0000","last_change":"2024-09-17T02:20:16.571568+0000","last_active":"2024-09-17T02:20:37.704580+0000","last_peered":"2024-09-17T02:20:37.704580+0000","last_clean":"2024-09-17T02:20:37.704580+0000","last_became_active":"2024-09-17T02:20:16.570622+0000","last_became_peered":"2024-09-17T02:20:16.570622+0000","last_unstale":"2024-09-17T02:20:37.704580+0000","last_undegraded":"2024-09-17T02:20:37.704580+0000","last_fullsized":"2024-09-17T02:20:37.704580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:57.083446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"26'882","reported_seq":898,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.698845+0000","last_change":"2024-09-17T02:20:31.669013+0000","last_active":"2024-09-17T02:20:36.698845+0000","last_peered":"2024-09-17T02:20:36.698845+0000","last_clean":"2024-09-17T02:20:36.698845+0000","last_became_active":"2024-09-17T02:20:31.667964+0000","last_became_peered":"2024-09-17T02:20:31.667964+0000","last_unstale":"2024-09-17T02:20:36.698845+0000","last_undegraded":"2024-09-17T02:20:36.698845+0000","last_fullsized":"2024-09-17T02:20:36.698845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:34.130523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57802752,"num_objects":882,"num_object_clones":0,"num_object_copies":1764,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":882,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":882,"num_write_kb":56448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695551+0000","last_change":"2024-09-17T02:20:12.511823+0000","last_active":"2024-09-17T02:20:36.695551+0000","last_peered":"2024-09-17T02:20:36.695551+0000","last_clean":"2024-09-17T02:20:36.695551+0000","last_became_active":"2024-09-17T02:20:10.497164+0000","last_became_peered":"2024-09-17T02:20:10.497164+0000","last_unstale":"2024-09-17T02:20:36.695551+0000","last_undegraded":"2024-09-17T02:20:36.695551+0000","last_fullsized":"2024-09-17T02:20:36.695551+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:21.242753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081052700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":3,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-17T02:20:36.694935+0000","last_change":"2024-09-17T02:20:36.694935+0000","last_active":"2024-09-17T02:20:14.516708+0000","last_peered":"2024-09-17T02:20:14.516708+0000","last_clean":"2024-09-17T02:20:14.516708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:20:36.694935+0000","last_undegraded":"2024-09-17T02:20:36.694935+0000","last_fullsized":"2024-09-17T02:20:36.694935+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695862+0000","last_change":"2024-09-17T02:20:16.578902+0000","last_active":"2024-09-17T02:20:36.695862+0000","last_peered":"2024-09-17T02:20:36.695862+0000","last_clean":"2024-09-17T02:20:36.695862+0000","last_became_active":"2024-09-17T02:20:16.576512+0000","last_became_peered":"2024-09-17T02:20:16.576512+0000","last_unstale":"2024-09-17T02:20:36.695862+0000","last_undegraded":"2024-09-17T02:20:36.695862+0000","last_fullsized":"2024-09-17T02:20:36.695862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:29.757455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"26'868","reported_seq":884,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695293+0000","last_change":"2024-09-17T02:20:31.669982+0000","last_active":"2024-09-17T02:20:36.695293+0000","last_peered":"2024-09-17T02:20:36.695293+0000","last_clean":"2024-09-17T02:20:36.695293+0000","last_became_active":"2024-09-17T02:20:31.669185+0000","last_became_peered":"2024-09-17T02:20:31.669185+0000","last_unstale":"2024-09-17T02:20:36.695293+0000","last_undegraded":"2024-09-17T02:20:36.695293+0000","last_fullsized":"2024-09-17T02:20:36.695293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:57:10.062557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56885248,"num_objects":868,"num_object_clones":0,"num_object_copies":1736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":868,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":868,"num_write_kb":55552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695453+0000","last_change":"2024-09-17T02:20:12.512742+0000","last_active":"2024-09-17T02:20:36.695453+0000","last_peered":"2024-09-17T02:20:36.695453+0000","last_clean":"2024-09-17T02:20:36.695453+0000","last_became_active":"2024-09-17T02:20:10.503622+0000","last_became_peered":"2024-09-17T02:20:10.503622+0000","last_unstale":"2024-09-17T02:20:36.695453+0000","last_undegraded":"2024-09-17T02:20:36.695453+0000","last_fullsized":"2024-09-17T02:20:36.695453+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:36.226043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078085399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.696273+0000","last_change":"2024-09-17T02:20:15.562840+0000","last_active":"2024-09-17T02:20:36.696273+0000","last_peered":"2024-09-17T02:20:36.696273+0000","last_clean":"2024-09-17T02:20:36.696273+0000","last_became_active":"2024-09-17T02:20:15.562177+0000","last_became_peered":"2024-09-17T02:20:15.562177+0000","last_unstale":"2024-09-17T02:20:36.696273+0000","last_undegraded":"2024-09-17T02:20:36.696273+0000","last_fullsized":"2024-09-17T02:20:36.696273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:39.709524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.697066+0000","last_change":"2024-09-17T02:20:16.580184+0000","last_active":"2024-09-17T02:20:36.697066+0000","last_peered":"2024-09-17T02:20:36.697066+0000","last_clean":"2024-09-17T02:20:36.697066+0000","last_became_active":"2024-09-17T02:20:16.578343+0000","last_became_peered":"2024-09-17T02:20:16.578343+0000","last_unstale":"2024-09-17T02:20:36.697066+0000","last_undegraded":"2024-09-17T02:20:36.697066+0000","last_fullsized":"2024-09-17T02:20:36.697066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:42.123535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"26'905","reported_seq":921,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.703633+0000","last_change":"2024-09-17T02:20:31.670302+0000","last_active":"2024-09-17T02:20:36.703633+0000","last_peered":"2024-09-17T02:20:36.703633+0000","last_clean":"2024-09-17T02:20:36.703633+0000","last_became_active":"2024-09-17T02:20:31.669504+0000","last_became_peered":"2024-09-17T02:20:31.669504+0000","last_unstale":"2024-09-17T02:20:36.703633+0000","last_undegraded":"2024-09-17T02:20:36.703633+0000","last_fullsized":"2024-09-17T02:20:36.703633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":905,"log_dups_size":0,"ondisk_log_size":905,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:29.240691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59310080,"num_objects":905,"num_object_clones":0,"num_object_copies":1810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":905,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":905,"num_write_kb":57920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.697108+0000","last_change":"2024-09-17T02:20:15.562922+0000","last_active":"2024-09-17T02:20:36.697108+0000","last_peered":"2024-09-17T02:20:36.697108+0000","last_clean":"2024-09-17T02:20:36.697108+0000","last_became_active":"2024-09-17T02:20:15.562138+0000","last_became_peered":"2024-09-17T02:20:15.562138+0000","last_unstale":"2024-09-17T02:20:36.697108+0000","last_undegraded":"2024-09-17T02:20:36.697108+0000","last_fullsized":"2024-09-17T02:20:36.697108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:00.819275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.697136+0000","last_change":"2024-09-17T02:20:12.511838+0000","last_active":"2024-09-17T02:20:36.697136+0000","last_peered":"2024-09-17T02:20:36.697136+0000","last_clean":"2024-09-17T02:20:36.697136+0000","last_became_active":"2024-09-17T02:20:10.497049+0000","last_became_peered":"2024-09-17T02:20:10.497049+0000","last_unstale":"2024-09-17T02:20:36.697136+0000","last_undegraded":"2024-09-17T02:20:36.697136+0000","last_fullsized":"2024-09-17T02:20:36.697136+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:54.446484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079701100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T02:20:37.701769+0000","last_change":"2024-09-17T02:20:16.571485+0000","last_active":"2024-09-17T02:20:37.701769+0000","last_peered":"2024-09-17T02:20:37.701769+0000","last_clean":"2024-09-17T02:20:37.701769+0000","last_became_active":"2024-09-17T02:20:16.567570+0000","last_became_peered":"2024-09-17T02:20:16.567570+0000","last_unstale":"2024-09-17T02:20:37.701769+0000","last_undegraded":"2024-09-17T02:20:37.701769+0000","last_fullsized":"2024-09-17T02:20:37.701769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:14.228385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"26'867","reported_seq":883,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.706097+0000","last_change":"2024-09-17T02:20:31.671886+0000","last_active":"2024-09-17T02:20:36.706097+0000","last_peered":"2024-09-17T02:20:36.706097+0000","last_clean":"2024-09-17T02:20:36.706097+0000","last_became_active":"2024-09-17T02:20:31.671023+0000","last_became_peered":"2024-09-17T02:20:31.671023+0000","last_unstale":"2024-09-17T02:20:36.706097+0000","last_undegraded":"2024-09-17T02:20:36.706097+0000","last_fullsized":"2024-09-17T02:20:36.706097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:45.956857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56819712,"num_objects":867,"num_object_clones":0,"num_object_copies":1734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":867,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":867,"num_write_kb":55488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.697016+0000","last_change":"2024-09-17T02:20:15.559252+0000","last_active":"2024-09-17T02:20:36.697016+0000","last_peered":"2024-09-17T02:20:36.697016+0000","last_clean":"2024-09-17T02:20:36.697016+0000","last_became_active":"2024-09-17T02:20:15.557667+0000","last_became_peered":"2024-09-17T02:20:15.557667+0000","last_unstale":"2024-09-17T02:20:36.697016+0000","last_undegraded":"2024-09-17T02:20:36.697016+0000","last_fullsized":"2024-09-17T02:20:36.697016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:01.292626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T02:20:37.706307+0000","last_change":"2024-09-17T02:20:12.661034+0000","last_active":"2024-09-17T02:20:37.706307+0000","last_peered":"2024-09-17T02:20:37.706307+0000","last_clean":"2024-09-17T02:20:37.706307+0000","last_became_active":"2024-09-17T02:20:10.497829+0000","last_became_peered":"2024-09-17T02:20:10.497829+0000","last_unstale":"2024-09-17T02:20:37.706307+0000","last_undegraded":"2024-09-17T02:20:37.706307+0000","last_fullsized":"2024-09-17T02:20:37.706307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:46:27.427685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096944700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":3,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-17T02:20:36.695727+0000","last_change":"2024-09-17T02:20:36.695727+0000","last_active":"2024-09-17T02:20:15.524398+0000","last_peered":"2024-09-17T02:20:15.524398+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:20:36.695727+0000","last_undegraded":"2024-09-17T02:20:36.695727+0000","last_fullsized":"2024-09-17T02:20:36.695727+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"26'857","reported_seq":873,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.700114+0000","last_change":"2024-09-17T02:20:31.671335+0000","last_active":"2024-09-17T02:20:36.700114+0000","last_peered":"2024-09-17T02:20:36.700114+0000","last_clean":"2024-09-17T02:20:36.700114+0000","last_became_active":"2024-09-17T02:20:31.670650+0000","last_became_peered":"2024-09-17T02:20:31.670650+0000","last_unstale":"2024-09-17T02:20:36.700114+0000","last_undegraded":"2024-09-17T02:20:36.700114+0000","last_fullsized":"2024-09-17T02:20:36.700114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:09.843149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56164352,"num_objects":857,"num_object_clones":0,"num_object_copies":1714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":857,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":857,"num_write_kb":54848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.696302+0000","last_change":"2024-09-17T02:20:15.558961+0000","last_active":"2024-09-17T02:20:36.696302+0000","last_peered":"2024-09-17T02:20:36.696302+0000","last_clean":"2024-09-17T02:20:36.696302+0000","last_became_active":"2024-09-17T02:20:15.558299+0000","last_became_peered":"2024-09-17T02:20:15.558299+0000","last_unstale":"2024-09-17T02:20:36.696302+0000","last_undegraded":"2024-09-17T02:20:36.696302+0000","last_fullsized":"2024-09-17T02:20:36.696302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:39.709524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.698671+0000","last_change":"2024-09-17T02:20:12.512481+0000","last_active":"2024-09-17T02:20:36.698671+0000","last_peered":"2024-09-17T02:20:36.698671+0000","last_clean":"2024-09-17T02:20:36.698671+0000","last_became_active":"2024-09-17T02:20:10.497021+0000","last_became_peered":"2024-09-17T02:20:10.497021+0000","last_unstale":"2024-09-17T02:20:36.698671+0000","last_undegraded":"2024-09-17T02:20:36.698671+0000","last_fullsized":"2024-09-17T02:20:36.698671+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:41.167283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001400079,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.696824+0000","last_change":"2024-09-17T02:20:16.560687+0000","last_active":"2024-09-17T02:20:36.696824+0000","last_peered":"2024-09-17T02:20:36.696824+0000","last_clean":"2024-09-17T02:20:36.696824+0000","last_became_active":"2024-09-17T02:20:16.559758+0000","last_became_peered":"2024-09-17T02:20:16.559758+0000","last_unstale":"2024-09-17T02:20:36.696824+0000","last_undegraded":"2024-09-17T02:20:36.696824+0000","last_fullsized":"2024-09-17T02:20:36.696824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:54:33.088375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"25'837","reported_seq":851,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-17T02:20:36.676188+0000","last_change":"2024-09-17T02:20:37.419329+0000","last_active":"2024-09-17T02:20:37.419329+0000","last_peered":"2024-09-17T02:20:36.676188+0000","last_clean":"2024-09-17T02:20:36.676188+0000","last_became_active":"2024-09-17T02:20:31.667742+0000","last_became_peered":"2024-09-17T02:20:31.667742+0000","last_unstale":"2024-09-17T02:20:36.676188+0000","last_undegraded":"2024-09-17T02:20:36.676188+0000","last_fullsized":"2024-09-17T02:20:36.676188+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54853632,"num_objects":837,"num_object_clones":0,"num_object_copies":1674,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":837,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":837,"num_write_kb":53568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.698625+0000","last_change":"2024-09-17T02:20:15.551758+0000","last_active":"2024-09-17T02:20:36.698625+0000","last_peered":"2024-09-17T02:20:36.698625+0000","last_clean":"2024-09-17T02:20:36.698625+0000","last_became_active":"2024-09-17T02:20:15.550353+0000","last_became_peered":"2024-09-17T02:20:15.550353+0000","last_unstale":"2024-09-17T02:20:36.698625+0000","last_undegraded":"2024-09-17T02:20:36.698625+0000","last_fullsized":"2024-09-17T02:20:36.698625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:04.229911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.696200+0000","last_change":"2024-09-17T02:20:12.513530+0000","last_active":"2024-09-17T02:20:36.696200+0000","last_peered":"2024-09-17T02:20:36.696200+0000","last_clean":"2024-09-17T02:20:36.696200+0000","last_became_active":"2024-09-17T02:20:10.502692+0000","last_became_peered":"2024-09-17T02:20:10.502692+0000","last_unstale":"2024-09-17T02:20:36.696200+0000","last_undegraded":"2024-09-17T02:20:36.696200+0000","last_fullsized":"2024-09-17T02:20:36.696200+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:53.004641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015329009999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T02:20:37.702097+0000","last_change":"2024-09-17T02:20:16.575882+0000","last_active":"2024-09-17T02:20:37.702097+0000","last_peered":"2024-09-17T02:20:37.702097+0000","last_clean":"2024-09-17T02:20:37.702097+0000","last_became_active":"2024-09-17T02:20:16.573968+0000","last_became_peered":"2024-09-17T02:20:16.573968+0000","last_unstale":"2024-09-17T02:20:37.702097+0000","last_undegraded":"2024-09-17T02:20:37.702097+0000","last_fullsized":"2024-09-17T02:20:37.702097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:18.090082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695846+0000","last_change":"2024-09-17T02:20:16.582881+0000","last_active":"2024-09-17T02:20:36.695846+0000","last_peered":"2024-09-17T02:20:36.695846+0000","last_clean":"2024-09-17T02:20:36.695846+0000","last_became_active":"2024-09-17T02:20:16.580985+0000","last_became_peered":"2024-09-17T02:20:16.580985+0000","last_unstale":"2024-09-17T02:20:36.695846+0000","last_undegraded":"2024-09-17T02:20:36.695846+0000","last_fullsized":"2024-09-17T02:20:36.695846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:10.315951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.696319+0000","last_change":"2024-09-17T02:20:15.558925+0000","last_active":"2024-09-17T02:20:36.696319+0000","last_peered":"2024-09-17T02:20:36.696319+0000","last_clean":"2024-09-17T02:20:36.696319+0000","last_became_active":"2024-09-17T02:20:15.558174+0000","last_became_peered":"2024-09-17T02:20:15.558174+0000","last_unstale":"2024-09-17T02:20:36.696319+0000","last_undegraded":"2024-09-17T02:20:36.696319+0000","last_fullsized":"2024-09-17T02:20:36.696319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:55.639841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695832+0000","last_change":"2024-09-17T02:20:16.579411+0000","last_active":"2024-09-17T02:20:36.695832+0000","last_peered":"2024-09-17T02:20:36.695832+0000","last_clean":"2024-09-17T02:20:36.695832+0000","last_became_active":"2024-09-17T02:20:16.576294+0000","last_became_peered":"2024-09-17T02:20:16.576294+0000","last_unstale":"2024-09-17T02:20:36.695832+0000","last_undegraded":"2024-09-17T02:20:36.695832+0000","last_fullsized":"2024-09-17T02:20:36.695832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:41:31.822425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-17T02:20:36.697234+0000","last_change":"2024-09-17T02:20:36.697234+0000","last_active":"2024-09-17T02:20:36.697234+0000","last_peered":"2024-09-17T02:20:16.576162+0000","last_clean":"2024-09-17T02:20:16.576162+0000","last_became_active":"2024-09-17T02:20:15.567405+0000","last_became_peered":"2024-09-17T02:20:15.567405+0000","last_unstale":"2024-09-17T02:20:36.697234+0000","last_undegraded":"2024-09-17T02:20:36.697234+0000","last_fullsized":"2024-09-17T02:20:36.697234+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695838+0000","last_change":"2024-09-17T02:20:15.562827+0000","last_active":"2024-09-17T02:20:36.695838+0000","last_peered":"2024-09-17T02:20:36.695838+0000","last_clean":"2024-09-17T02:20:36.695838+0000","last_became_active":"2024-09-17T02:20:15.562073+0000","last_became_peered":"2024-09-17T02:20:15.562073+0000","last_unstale":"2024-09-17T02:20:36.695838+0000","last_undegraded":"2024-09-17T02:20:36.695838+0000","last_fullsized":"2024-09-17T02:20:36.695838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:17.866665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695104+0000","last_change":"2024-09-17T02:20:16.577670+0000","last_active":"2024-09-17T02:20:36.695104+0000","last_peered":"2024-09-17T02:20:36.695104+0000","last_clean":"2024-09-17T02:20:36.695104+0000","last_became_active":"2024-09-17T02:20:16.575082+0000","last_became_peered":"2024-09-17T02:20:16.575082+0000","last_unstale":"2024-09-17T02:20:36.695104+0000","last_undegraded":"2024-09-17T02:20:36.695104+0000","last_fullsized":"2024-09-17T02:20:36.695104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:21.356437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.696133+0000","last_change":"2024-09-17T02:20:15.555513+0000","last_active":"2024-09-17T02:20:36.696133+0000","last_peered":"2024-09-17T02:20:36.696133+0000","last_clean":"2024-09-17T02:20:36.696133+0000","last_became_active":"2024-09-17T02:20:15.554256+0000","last_became_peered":"2024-09-17T02:20:15.554256+0000","last_unstale":"2024-09-17T02:20:36.696133+0000","last_undegraded":"2024-09-17T02:20:36.696133+0000","last_fullsized":"2024-09-17T02:20:36.696133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:52.985837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.696670+0000","last_change":"2024-09-17T02:20:16.577803+0000","last_active":"2024-09-17T02:20:36.696670+0000","last_peered":"2024-09-17T02:20:36.696670+0000","last_clean":"2024-09-17T02:20:36.696670+0000","last_became_active":"2024-09-17T02:20:16.576640+0000","last_became_peered":"2024-09-17T02:20:16.576640+0000","last_unstale":"2024-09-17T02:20:36.696670+0000","last_undegraded":"2024-09-17T02:20:36.696670+0000","last_fullsized":"2024-09-17T02:20:36.696670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:07.190169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T02:20:37.704667+0000","last_change":"2024-09-17T02:20:16.571738+0000","last_active":"2024-09-17T02:20:37.704667+0000","last_peered":"2024-09-17T02:20:37.704667+0000","last_clean":"2024-09-17T02:20:37.704667+0000","last_became_active":"2024-09-17T02:20:16.568615+0000","last_became_peered":"2024-09-17T02:20:16.568615+0000","last_unstale":"2024-09-17T02:20:37.704667+0000","last_undegraded":"2024-09-17T02:20:37.704667+0000","last_fullsized":"2024-09-17T02:20:37.704667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:42.931361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.696946+0000","last_change":"2024-09-17T02:20:15.558467+0000","last_active":"2024-09-17T02:20:36.696946+0000","last_peered":"2024-09-17T02:20:36.696946+0000","last_clean":"2024-09-17T02:20:36.696946+0000","last_became_active":"2024-09-17T02:20:15.557186+0000","last_became_peered":"2024-09-17T02:20:15.557186+0000","last_unstale":"2024-09-17T02:20:36.696946+0000","last_undegraded":"2024-09-17T02:20:36.696946+0000","last_fullsized":"2024-09-17T02:20:36.696946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:56.879445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.697100+0000","last_change":"2024-09-17T02:20:16.577527+0000","last_active":"2024-09-17T02:20:36.697100+0000","last_peered":"2024-09-17T02:20:36.697100+0000","last_clean":"2024-09-17T02:20:36.697100+0000","last_became_active":"2024-09-17T02:20:16.574761+0000","last_became_peered":"2024-09-17T02:20:16.574761+0000","last_unstale":"2024-09-17T02:20:36.697100+0000","last_undegraded":"2024-09-17T02:20:36.697100+0000","last_fullsized":"2024-09-17T02:20:36.697100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:43.309196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695236+0000","last_change":"2024-09-17T02:20:15.552417+0000","last_active":"2024-09-17T02:20:36.695236+0000","last_peered":"2024-09-17T02:20:36.695236+0000","last_clean":"2024-09-17T02:20:36.695236+0000","last_became_active":"2024-09-17T02:20:15.551609+0000","last_became_peered":"2024-09-17T02:20:15.551609+0000","last_unstale":"2024-09-17T02:20:36.695236+0000","last_undegraded":"2024-09-17T02:20:36.695236+0000","last_fullsized":"2024-09-17T02:20:36.695236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:15.782658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T02:20:37.704207+0000","last_change":"2024-09-17T02:20:16.591978+0000","last_active":"2024-09-17T02:20:37.704207+0000","last_peered":"2024-09-17T02:20:37.704207+0000","last_clean":"2024-09-17T02:20:37.704207+0000","last_became_active":"2024-09-17T02:20:16.591378+0000","last_became_peered":"2024-09-17T02:20:16.591378+0000","last_unstale":"2024-09-17T02:20:37.704207+0000","last_undegraded":"2024-09-17T02:20:37.704207+0000","last_fullsized":"2024-09-17T02:20:37.704207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:44.489118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":3,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-17T02:20:36.696620+0000","last_change":"2024-09-17T02:20:36.696620+0000","last_active":"2024-09-17T02:20:14.516708+0000","last_peered":"2024-09-17T02:20:14.516708+0000","last_clean":"2024-09-17T02:20:14.516708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:20:36.696620+0000","last_undegraded":"2024-09-17T02:20:36.696620+0000","last_fullsized":"2024-09-17T02:20:36.696620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":3,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-17T02:20:36.696562+0000","last_change":"2024-09-17T02:20:36.696562+0000","last_active":"2024-09-17T02:20:15.524398+0000","last_peered":"2024-09-17T02:20:15.524398+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:20:36.696562+0000","last_undegraded":"2024-09-17T02:20:36.696562+0000","last_fullsized":"2024-09-17T02:20:36.696562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T02:20:37.703205+0000","last_change":"2024-09-17T02:20:15.568883+0000","last_active":"2024-09-17T02:20:37.703205+0000","last_peered":"2024-09-17T02:20:37.703205+0000","last_clean":"2024-09-17T02:20:37.703205+0000","last_became_active":"2024-09-17T02:20:15.567980+0000","last_became_peered":"2024-09-17T02:20:15.567980+0000","last_unstale":"2024-09-17T02:20:37.703205+0000","last_undegraded":"2024-09-17T02:20:37.703205+0000","last_fullsized":"2024-09-17T02:20:37.703205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:04.059900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695526+0000","last_change":"2024-09-17T02:20:16.568209+0000","last_active":"2024-09-17T02:20:36.695526+0000","last_peered":"2024-09-17T02:20:36.695526+0000","last_clean":"2024-09-17T02:20:36.695526+0000","last_became_active":"2024-09-17T02:20:16.566585+0000","last_became_peered":"2024-09-17T02:20:16.566585+0000","last_unstale":"2024-09-17T02:20:36.695526+0000","last_undegraded":"2024-09-17T02:20:36.695526+0000","last_fullsized":"2024-09-17T02:20:36.695526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:44:59.713633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.696208+0000","last_change":"2024-09-17T02:20:15.558296+0000","last_active":"2024-09-17T02:20:36.696208+0000","last_peered":"2024-09-17T02:20:36.696208+0000","last_clean":"2024-09-17T02:20:36.696208+0000","last_became_active":"2024-09-17T02:20:15.557520+0000","last_became_peered":"2024-09-17T02:20:15.557520+0000","last_unstale":"2024-09-17T02:20:36.696208+0000","last_undegraded":"2024-09-17T02:20:36.696208+0000","last_fullsized":"2024-09-17T02:20:36.696208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:04.229911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.694967+0000","last_change":"2024-09-17T02:20:16.568334+0000","last_active":"2024-09-17T02:20:36.694967+0000","last_peered":"2024-09-17T02:20:36.694967+0000","last_clean":"2024-09-17T02:20:36.694967+0000","last_became_active":"2024-09-17T02:20:16.566982+0000","last_became_peered":"2024-09-17T02:20:16.566982+0000","last_unstale":"2024-09-17T02:20:36.694967+0000","last_undegraded":"2024-09-17T02:20:36.694967+0000","last_fullsized":"2024-09-17T02:20:36.694967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:55.083688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":13,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-17T02:20:36.696541+0000","last_change":"2024-09-17T02:20:36.696541+0000","last_active":"2024-09-17T02:20:36.696541+0000","last_peered":"2024-09-17T02:20:16.576543+0000","last_clean":"2024-09-17T02:20:16.576543+0000","last_became_active":"2024-09-17T02:20:15.569106+0000","last_became_peered":"2024-09-17T02:20:15.569106+0000","last_unstale":"2024-09-17T02:20:36.696541+0000","last_undegraded":"2024-09-17T02:20:36.696541+0000","last_fullsized":"2024-09-17T02:20:36.696541+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T02:20:37.703100+0000","last_change":"2024-09-17T02:20:16.570456+0000","last_active":"2024-09-17T02:20:37.703100+0000","last_peered":"2024-09-17T02:20:37.703100+0000","last_clean":"2024-09-17T02:20:37.703100+0000","last_became_active":"2024-09-17T02:20:16.568095+0000","last_became_peered":"2024-09-17T02:20:16.568095+0000","last_unstale":"2024-09-17T02:20:37.703100+0000","last_undegraded":"2024-09-17T02:20:37.703100+0000","last_fullsized":"2024-09-17T02:20:37.703100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:58.329169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.698439+0000","last_change":"2024-09-17T02:20:15.560293+0000","last_active":"2024-09-17T02:20:36.698439+0000","last_peered":"2024-09-17T02:20:36.698439+0000","last_clean":"2024-09-17T02:20:36.698439+0000","last_became_active":"2024-09-17T02:20:15.559074+0000","last_became_peered":"2024-09-17T02:20:15.559074+0000","last_unstale":"2024-09-17T02:20:36.698439+0000","last_undegraded":"2024-09-17T02:20:36.698439+0000","last_fullsized":"2024-09-17T02:20:36.698439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:55.639841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695919+0000","last_change":"2024-09-17T02:20:16.570950+0000","last_active":"2024-09-17T02:20:36.695919+0000","last_peered":"2024-09-17T02:20:36.695919+0000","last_clean":"2024-09-17T02:20:36.695919+0000","last_became_active":"2024-09-17T02:20:16.569496+0000","last_became_peered":"2024-09-17T02:20:16.569496+0000","last_unstale":"2024-09-17T02:20:36.695919+0000","last_undegraded":"2024-09-17T02:20:36.695919+0000","last_fullsized":"2024-09-17T02:20:36.695919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:29.757455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T02:20:36.695977+0000","last_change":"2024-09-17T02:20:15.544675+0000","last_active":"2024-09-17T02:20:36.695977+0000","last_peered":"2024-09-17T02:20:36.695977+0000","last_clean":"2024-09-17T02:20:36.695977+0000","last_became_active":"2024-09-17T02:20:15.544213+0000","last_became_peered":"2024-09-17T02:20:15.544213+0000","last_unstale":"2024-09-17T02:20:36.695977+0000","last_undegraded":"2024-09-17T02:20:36.695977+0000","last_fullsized":"2024-09-17T02:20:36.695977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:31.933850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":937230336,"num_objects":14301,"num_object_clones":0,"num_object_copies":28602,"num_objects_missing_on_primary":0,"num_objects_missing":3,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14301,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14301,"num_write_kb":915264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":118779904,"data_stored":1900478464,"data_compressed":1621724,"data_compressed_allocated":118779904,"data_compressed_original":1900478464,"omap_allocated":0,"internal_metadata":0},"log_size":14301,"ondisk_log_size":14301,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705675,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70656,"kb_used_data":31148,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94301184,"statfs":{"total":96636764160,"available":96564412416,"internally_reserved":0,"allocated":31895552,"data_stored":505833810,"data_compressed":438148,"data_compressed_allocated":31608832,"data_compressed_original":505724928,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,4],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738379,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66252,"kb_used_data":35064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94305588,"statfs":{"total":96636764160,"available":96568922112,"internally_reserved":0,"allocated":35905536,"data_stored":569797581,"data_compressed":492714,"data_compressed_allocated":35606528,"data_compressed_original":569688064,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,4,3,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738378,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76880,"kb_used_data":45692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94294960,"statfs":{"total":96636764160,"available":96558039040,"internally_reserved":0,"allocated":46788608,"data_stored":744645291,"data_compressed":635304,"data_compressed_allocated":46534656,"data_compressed_original":744554496,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36675584,"data_stored":586809344,"data_compressed":500815,"data_compressed_allocated":36675584,"data_compressed_original":586809344,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":46534656,"data_stored":744554496,"data_compressed":635304,"data_compressed_allocated":46534656,"data_compressed_original":744554496,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":35569664,"data_stored":569114624,"data_compressed":485605,"data_compressed_allocated":35569664,"data_compressed_original":569114624,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T02:20:42.672 INFO:tasks.thrashosds.thrasher:Setting 4.1 to [0, 2, 1] 2024-09-17T02:20:42.672 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.1', '0', '2', '1'] 2024-09-17T02:20:42.672 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.1 0 2 1 2024-09-17T02:20:42.709 INFO:teuthology.orchestra.run.smithi001.stderr:noscrub is set 2024-09-17T02:20:42.761 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:42.764+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:42.768 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 10 16 29221 29205 182.51 178.938 0.00256741 0.00547382 2024-09-17T02:20:42.842 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:20:42.842 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:20:42.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.842 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:29440 5.4 5:2fae3e1a:::benchmark_data_smithi001_23533_object29439:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-17T02:20:42.842 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.846779+0000", 2024-09-17T02:20:42.842 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.001993136, 2024-09-17T02:20:42.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020205069999999999, 2024-09-17T02:20:42.843 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:42.843 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:42.843 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:42.843 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:42.843 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:42.843 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:42.843 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 29440 2024-09-17T02:20:42.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.843 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:42.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:42.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.846779+0000", 2024-09-17T02:20:42.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:42.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:42.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.846779+0000", 2024-09-17T02:20:42.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:42.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:42.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.846780+0000", 2024-09-17T02:20:42.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6400000000000001e-07 2024-09-17T02:20:42.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:42.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.846861+0000", 2024-09-17T02:20:42.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0692000000000006e-05 2024-09-17T02:20:42.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:42.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.846872+0000", 2024-09-17T02:20:42.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1555e-05 2024-09-17T02:20:42.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.846880+0000", 2024-09-17T02:20:42.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5499999999999997e-06 2024-09-17T02:20:42.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:42.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.847946+0000", 2024-09-17T02:20:42.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001066439 2024-09-17T02:20:42.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:42.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.848088+0000", 2024-09-17T02:20:42.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014186 2024-09-17T02:20:42.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:42.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.848240+0000", 2024-09-17T02:20:42.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000151259 2024-09-17T02:20:42.847 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:42.847 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:42.847 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:42.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.847 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:29437 5.d e29/26 5:bf6adb53:::benchmark_data_smithi001_23533_object29436:head v 29'1854, mlcod=29'1851)", 2024-09-17T02:20:42.847 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.847808+0000", 2024-09-17T02:20:42.847 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00096432500000000003, 2024-09-17T02:20:42.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010770300000000001, 2024-09-17T02:20:42.847 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:42.847 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:42.847 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:42.847 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:42.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:42.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.847808+0000", 2024-09-17T02:20:42.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:42.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:42.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.847808+0000", 2024-09-17T02:20:42.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:42.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:42.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.847809+0000", 2024-09-17T02:20:42.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2300000000000001e-07 2024-09-17T02:20:42.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:42.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.847866+0000", 2024-09-17T02:20:42.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7197999999999997e-05 2024-09-17T02:20:42.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:42.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.847877+0000", 2024-09-17T02:20:42.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0392e-05 2024-09-17T02:20:42.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.847883+0000", 2024-09-17T02:20:42.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7290000000000003e-06 2024-09-17T02:20:42.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:42.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.847927+0000", 2024-09-17T02:20:42.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4171000000000001e-05 2024-09-17T02:20:42.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:42.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.847942+0000", 2024-09-17T02:20:42.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4278e-05 2024-09-17T02:20:42.850 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:42.850 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:42.850 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:42.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.851 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:29427 5.4 e29/22)", 2024-09-17T02:20:42.851 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.848584+0000", 2024-09-17T02:20:42.851 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00018871200000000001, 2024-09-17T02:20:42.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044361800000000001, 2024-09-17T02:20:42.851 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:42.851 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:42.851 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:20:42.851 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:42.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:42.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.848584+0000", 2024-09-17T02:20:42.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:42.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:42.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.848584+0000", 2024-09-17T02:20:42.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:42.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:42.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.848584+0000", 2024-09-17T02:20:42.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4999999999999998e-07 2024-09-17T02:20:42.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:42.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.848587+0000", 2024-09-17T02:20:42.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.044e-06 2024-09-17T02:20:42.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:42.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.848596+0000", 2024-09-17T02:20:42.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9940000000000006e-06 2024-09-17T02:20:42.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.848601+0000", 2024-09-17T02:20:42.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1510000000000003e-06 2024-09-17T02:20:42.853 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:42.853 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:42.853 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:42.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.854 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:29443 5.d e29/26)", 2024-09-17T02:20:42.854 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.848941+0000", 2024-09-17T02:20:42.854 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4294967295.9998317, 2024-09-17T02:20:42.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014052699999999999, 2024-09-17T02:20:42.854 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:42.854 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:42.854 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:20:42.854 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:42.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:42.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.848941+0000", 2024-09-17T02:20:42.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:42.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:42.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.848941+0000", 2024-09-17T02:20:42.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:42.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:42.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.848941+0000", 2024-09-17T02:20:42.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9200000000000001e-07 2024-09-17T02:20:42.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:42.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.849015+0000", 2024-09-17T02:20:42.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3530999999999998e-05 2024-09-17T02:20:42.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:42.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.849024+0000", 2024-09-17T02:20:42.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4020000000000008e-06 2024-09-17T02:20:42.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.849032+0000", 2024-09-17T02:20:42.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7889999999999995e-06 2024-09-17T02:20:42.856 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:42.856 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:42.856 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:42.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.857 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:29427 5.4 5:28087daf:::benchmark_data_smithi001_23533_object29426:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-17T02:20:42.857 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.843512+0000", 2024-09-17T02:20:42.857 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0052606399999999996, 2024-09-17T02:20:42.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056333060000000003, 2024-09-17T02:20:42.857 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:42.857 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:42.857 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:42.857 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:42.857 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:42.857 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:42.857 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 29427 2024-09-17T02:20:42.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.857 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:42.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:42.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.843512+0000", 2024-09-17T02:20:42.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:42.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:42.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.843512+0000", 2024-09-17T02:20:42.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:42.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:42.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.843513+0000", 2024-09-17T02:20:42.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6700000000000002e-07 2024-09-17T02:20:42.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:42.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.843562+0000", 2024-09-17T02:20:42.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9033000000000003e-05 2024-09-17T02:20:42.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:42.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.843584+0000", 2024-09-17T02:20:42.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1696e-05 2024-09-17T02:20:42.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.843599+0000", 2024-09-17T02:20:42.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5413999999999998e-05 2024-09-17T02:20:42.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:42.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.843974+0000", 2024-09-17T02:20:42.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037538900000000001 2024-09-17T02:20:42.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:42.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.844057+0000", 2024-09-17T02:20:42.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2418999999999998e-05 2024-09-17T02:20:42.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:42.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.844139+0000", 2024-09-17T02:20:42.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2367000000000006e-05 2024-09-17T02:20:42.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:42.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.845405+0000", 2024-09-17T02:20:42.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012658700000000001 2024-09-17T02:20:42.861 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:42.861 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:42.861 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:42.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.861 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:29439 5.4 5:25fcdfcf:::benchmark_data_smithi001_23533_object29438:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-17T02:20:42.861 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.846655+0000", 2024-09-17T02:20:42.861 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0021171749999999998, 2024-09-17T02:20:42.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025837080000000001, 2024-09-17T02:20:42.862 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:42.862 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:42.862 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:42.862 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:42.862 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:42.862 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:42.862 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 29439 2024-09-17T02:20:42.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.862 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:42.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:42.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.846655+0000", 2024-09-17T02:20:42.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:42.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:42.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.846655+0000", 2024-09-17T02:20:42.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:42.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:42.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.846656+0000", 2024-09-17T02:20:42.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6400000000000002e-07 2024-09-17T02:20:42.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:42.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.846717+0000", 2024-09-17T02:20:42.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0646999999999997e-05 2024-09-17T02:20:42.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:42.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.846725+0000", 2024-09-17T02:20:42.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3250000000000008e-06 2024-09-17T02:20:42.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:42.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.846731+0000", 2024-09-17T02:20:42.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3169999999999998e-06 2024-09-17T02:20:42.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:42.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.846780+0000", 2024-09-17T02:20:42.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9008000000000002e-05 2024-09-17T02:20:42.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:42.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.846900+0000", 2024-09-17T02:20:42.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000119201 2024-09-17T02:20:42.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:42.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.846980+0000", 2024-09-17T02:20:42.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0584e-05 2024-09-17T02:20:42.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:42.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:42.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:42.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.849184+0000", 2024-09-17T02:20:42.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022035800000000001 2024-09-17T02:20:42.866 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:42.866 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:42.866 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:42.866 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:42.866 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:20:42.866 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 6 2024-09-17T02:20:42.866 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:20:42.867 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:20:42.868 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:42.869+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:42.968 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:42.971+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:43.012 INFO:teuthology.orchestra.run.smithi001.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-09-17T02:20:43.019 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T02:20:43.019 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-09-17T02:20:43.069 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:43.069+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:43.076 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:20:43.077 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:20:43.077 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:20:43.077 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:20:43.077 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:20:43.097 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:20:43.172 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:43.173+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:43.257 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:20:43.257 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:20:43.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:20:43.258 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:20:43.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.258 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:43.258 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:20:43.258 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.705805773000002, 2024-09-17T02:20:43.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035535028000000003, 2024-09-17T02:20:43.258 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:43.258 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:43.258 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:43.259 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:43.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:43.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:20:43.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:43.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:20:43.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:43.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556550+0000", 2024-09-17T02:20:43.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3500000000000001e-06 2024-09-17T02:20:43.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:43.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556566+0000", 2024-09-17T02:20:43.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5440000000000001e-05 2024-09-17T02:20:43.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:43.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556594+0000", 2024-09-17T02:20:43.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8552999999999999e-05 2024-09-17T02:20:43.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556618+0000", 2024-09-17T02:20:43.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3207e-05 2024-09-17T02:20:43.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:43.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578337+0000", 2024-09-17T02:20:43.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021719517000000001 2024-09-17T02:20:43.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:43.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578655+0000", 2024-09-17T02:20:43.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031837800000000002 2024-09-17T02:20:43.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:43.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.581374+0000", 2024-09-17T02:20:43.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002718238 2024-09-17T02:20:43.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:43.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587083+0000", 2024-09-17T02:20:43.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005708912 2024-09-17T02:20:43.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:43.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591823+0000", 2024-09-17T02:20:43.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047406080000000003 2024-09-17T02:20:43.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:43.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591972+0000", 2024-09-17T02:20:43.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014874199999999999 2024-09-17T02:20:43.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:43.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592082+0000", 2024-09-17T02:20:43.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110083 2024-09-17T02:20:43.264 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.264 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:43.264 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.265 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:43.265 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:20:43.265 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.704864285999999, 2024-09-17T02:20:43.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035128756999999997, 2024-09-17T02:20:43.265 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:43.265 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:43.265 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:43.265 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:43.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:43.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:20:43.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:43.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:20:43.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:43.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557491+0000", 2024-09-17T02:20:43.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.88e-06 2024-09-17T02:20:43.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:43.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557504+0000", 2024-09-17T02:20:43.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2864000000000001e-05 2024-09-17T02:20:43.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:43.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557535+0000", 2024-09-17T02:20:43.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0916e-05 2024-09-17T02:20:43.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557561+0000", 2024-09-17T02:20:43.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5602999999999999e-05 2024-09-17T02:20:43.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:43.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582290+0000", 2024-09-17T02:20:43.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024729729999999998 2024-09-17T02:20:43.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:43.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582642+0000", 2024-09-17T02:20:43.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035143499999999999 2024-09-17T02:20:43.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:43.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582959+0000", 2024-09-17T02:20:43.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031747399999999999 2024-09-17T02:20:43.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:43.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587302+0000", 2024-09-17T02:20:43.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043425169999999997 2024-09-17T02:20:43.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:43.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592391+0000", 2024-09-17T02:20:43.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050895799999999998 2024-09-17T02:20:43.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:43.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592516+0000", 2024-09-17T02:20:43.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012420500000000001 2024-09-17T02:20:43.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:43.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592617+0000", 2024-09-17T02:20:43.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010155299999999999 2024-09-17T02:20:43.272 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.272 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:43.272 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.272 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:43.273 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:20:43.273 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.704759787, 2024-09-17T02:20:43.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034796066, 2024-09-17T02:20:43.273 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:43.273 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:43.273 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:43.273 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:43.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:43.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:20:43.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:43.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:20:43.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:43.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557594+0000", 2024-09-17T02:20:43.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3769999999999999e-06 2024-09-17T02:20:43.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:43.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557683+0000", 2024-09-17T02:20:43.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8896999999999999e-05 2024-09-17T02:20:43.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:43.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557707+0000", 2024-09-17T02:20:43.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3839e-05 2024-09-17T02:20:43.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557730+0000", 2024-09-17T02:20:43.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3047000000000001e-05 2024-09-17T02:20:43.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:43.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582329+0000", 2024-09-17T02:20:43.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024599283999999999 2024-09-17T02:20:43.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:43.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582624+0000", 2024-09-17T02:20:43.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000294462 2024-09-17T02:20:43.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:43.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582936+0000", 2024-09-17T02:20:43.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031223399999999999 2024-09-17T02:20:43.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:43.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587347+0000", 2024-09-17T02:20:43.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044110340000000003 2024-09-17T02:20:43.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:43.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592165+0000", 2024-09-17T02:20:43.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048176699999999996 2024-09-17T02:20:43.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:43.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592311+0000", 2024-09-17T02:20:43.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014661899999999999 2024-09-17T02:20:43.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:43.281 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592389+0000", 2024-09-17T02:20:43.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7602999999999995e-05 2024-09-17T02:20:43.281 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.281 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:43.281 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.282 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:43.282 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:20:43.282 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.70424216, 2024-09-17T02:20:43.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034457472000000003, 2024-09-17T02:20:43.282 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:43.282 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:43.282 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:43.282 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:43.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:43.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:20:43.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:43.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:20:43.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:43.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558113+0000", 2024-09-17T02:20:43.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1639999999999999e-06 2024-09-17T02:20:43.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:43.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558125+0000", 2024-09-17T02:20:43.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2269999999999999e-05 2024-09-17T02:20:43.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:43.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558458+0000", 2024-09-17T02:20:43.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033322700000000001 2024-09-17T02:20:43.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558488+0000", 2024-09-17T02:20:43.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.951e-05 2024-09-17T02:20:43.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:43.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584514+0000", 2024-09-17T02:20:43.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026025721000000002 2024-09-17T02:20:43.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:43.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584781+0000", 2024-09-17T02:20:43.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000267142 2024-09-17T02:20:43.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:43.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585078+0000", 2024-09-17T02:20:43.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029738799999999999 2024-09-17T02:20:43.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:43.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588045+0000", 2024-09-17T02:20:43.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029673759999999999 2024-09-17T02:20:43.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:43.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592454+0000", 2024-09-17T02:20:43.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044090209999999999 2024-09-17T02:20:43.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:43.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592520+0000", 2024-09-17T02:20:43.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6032999999999996e-05 2024-09-17T02:20:43.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:43.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592568+0000", 2024-09-17T02:20:43.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7620000000000001e-05 2024-09-17T02:20:43.288 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.288 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:43.288 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.289 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:43.289 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:20:43.289 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.703781909, 2024-09-17T02:20:43.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031603266999999997, 2024-09-17T02:20:43.289 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:43.289 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:43.289 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:43.289 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:43.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:43.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:20:43.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:43.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:20:43.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:43.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558573+0000", 2024-09-17T02:20:43.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0660000000000002e-06 2024-09-17T02:20:43.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:43.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558585+0000", 2024-09-17T02:20:43.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1596999999999999e-05 2024-09-17T02:20:43.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:43.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558612+0000", 2024-09-17T02:20:43.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7115999999999999e-05 2024-09-17T02:20:43.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558631+0000", 2024-09-17T02:20:43.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9519999999999999e-05 2024-09-17T02:20:43.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:43.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558783+0000", 2024-09-17T02:20:43.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152025 2024-09-17T02:20:43.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-17T02:20:43.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558798+0000", 2024-09-17T02:20:43.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4966999999999999e-05 2024-09-17T02:20:43.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:43.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.572871+0000", 2024-09-17T02:20:43.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014072782000000001 2024-09-17T02:20:43.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:43.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573153+0000", 2024-09-17T02:20:43.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028214499999999998 2024-09-17T02:20:43.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:43.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573432+0000", 2024-09-17T02:20:43.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027932100000000002 2024-09-17T02:20:43.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:43.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582279+0000", 2024-09-17T02:20:43.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0088463310000000007 2024-09-17T02:20:43.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:43.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.589902+0000", 2024-09-17T02:20:43.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0076236050000000003 2024-09-17T02:20:43.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:43.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.589997+0000", 2024-09-17T02:20:43.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4456000000000005e-05 2024-09-17T02:20:43.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:43.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590174+0000", 2024-09-17T02:20:43.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000177336 2024-09-17T02:20:43.296 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.296 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:43.297 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.297 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:43.297 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:20:43.297 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.703678664000002, 2024-09-17T02:20:43.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031899064999999997, 2024-09-17T02:20:43.297 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:43.297 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:43.297 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:43.297 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:43.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:43.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:20:43.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:43.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:20:43.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:43.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558676+0000", 2024-09-17T02:20:43.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.39e-06 2024-09-17T02:20:43.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:43.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558686+0000", 2024-09-17T02:20:43.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.022e-05 2024-09-17T02:20:43.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:43.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558708+0000", 2024-09-17T02:20:43.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2249999999999999e-05 2024-09-17T02:20:43.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558725+0000", 2024-09-17T02:20:43.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7387000000000001e-05 2024-09-17T02:20:43.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:43.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558940+0000", 2024-09-17T02:20:43.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021453800000000001 2024-09-17T02:20:43.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting_for_map not empty", 2024-09-17T02:20:43.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558951+0000", 2024-09-17T02:20:43.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1303e-05 2024-09-17T02:20:43.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:43.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576237+0000", 2024-09-17T02:20:43.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017285723999999999 2024-09-17T02:20:43.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:43.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576454+0000", 2024-09-17T02:20:43.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021673800000000001 2024-09-17T02:20:43.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:43.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576932+0000", 2024-09-17T02:20:43.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047792700000000001 2024-09-17T02:20:43.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:43.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585689+0000", 2024-09-17T02:20:43.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0087572880000000002 2024-09-17T02:20:43.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:43.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590287+0000", 2024-09-17T02:20:43.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045978060000000003 2024-09-17T02:20:43.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:43.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590447+0000", 2024-09-17T02:20:43.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000160719 2024-09-17T02:20:43.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:43.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590573+0000", 2024-09-17T02:20:43.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012577500000000001 2024-09-17T02:20:43.303 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.303 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:43.303 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.303 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:43.304 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:20:43.304 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.703600693999999, 2024-09-17T02:20:43.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034114029999999997, 2024-09-17T02:20:43.304 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:43.304 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:43.304 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:43.304 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:43.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:43.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:20:43.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:43.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:20:43.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:43.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558753+0000", 2024-09-17T02:20:43.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2699999999999999e-06 2024-09-17T02:20:43.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:43.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558769+0000", 2024-09-17T02:20:43.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5906e-05 2024-09-17T02:20:43.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:43.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558791+0000", 2024-09-17T02:20:43.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1342999999999999e-05 2024-09-17T02:20:43.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558806+0000", 2024-09-17T02:20:43.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5829999999999999e-05 2024-09-17T02:20:43.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:43.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584906+0000", 2024-09-17T02:20:43.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026099273999999999 2024-09-17T02:20:43.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:43.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585158+0000", 2024-09-17T02:20:43.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025194600000000002 2024-09-17T02:20:43.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:43.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585368+0000", 2024-09-17T02:20:43.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210068 2024-09-17T02:20:43.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:43.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588098+0000", 2024-09-17T02:20:43.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002730522 2024-09-17T02:20:43.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:43.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592680+0000", 2024-09-17T02:20:43.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045816019999999997 2024-09-17T02:20:43.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:43.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592774+0000", 2024-09-17T02:20:43.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3726000000000004e-05 2024-09-17T02:20:43.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:43.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592866+0000", 2024-09-17T02:20:43.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2542999999999998e-05 2024-09-17T02:20:43.309 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.309 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:43.309 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.309 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:43.309 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:20:43.309 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.703524390999998, 2024-09-17T02:20:43.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031407875000000002, 2024-09-17T02:20:43.310 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:43.310 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:43.310 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:43.310 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:43.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:43.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:20:43.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:43.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:20:43.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:43.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558830+0000", 2024-09-17T02:20:43.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3599999999999999e-06 2024-09-17T02:20:43.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:43.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558835+0000", 2024-09-17T02:20:43.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6130000000000003e-06 2024-09-17T02:20:43.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:43.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558853+0000", 2024-09-17T02:20:43.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8099999999999999e-05 2024-09-17T02:20:43.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558869+0000", 2024-09-17T02:20:43.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.59e-05 2024-09-17T02:20:43.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:43.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560437+0000", 2024-09-17T02:20:43.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015677989999999999 2024-09-17T02:20:43.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-17T02:20:43.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560453+0000", 2024-09-17T02:20:43.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.535e-05 2024-09-17T02:20:43.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:43.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562422+0000", 2024-09-17T02:20:43.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00196934 2024-09-17T02:20:43.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:43.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562773+0000", 2024-09-17T02:20:43.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035152399999999998 2024-09-17T02:20:43.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:43.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590236+0000", 2024-09-17T02:20:43.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.027462889000000001 2024-09-17T02:20:43.314 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.314 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:43.314 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.315 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:6 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'1, mlcod=0'0)", 2024-09-17T02:20:43.315 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.559725+0000", 2024-09-17T02:20:43.315 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.702627394, 2024-09-17T02:20:43.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015153534999999999, 2024-09-17T02:20:43.315 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:43.315 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:43.315 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:43.315 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:43.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:43.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559725+0000", 2024-09-17T02:20:43.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:43.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559725+0000", 2024-09-17T02:20:43.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:43.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559726+0000", 2024-09-17T02:20:43.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1699999999999997e-07 2024-09-17T02:20:43.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:43.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559736+0000", 2024-09-17T02:20:43.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8360000000000004e-06 2024-09-17T02:20:43.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:43.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559760+0000", 2024-09-17T02:20:43.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4130000000000001e-05 2024-09-17T02:20:43.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559778+0000", 2024-09-17T02:20:43.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7623000000000001e-05 2024-09-17T02:20:43.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:43.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.561459+0000", 2024-09-17T02:20:43.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001681552 2024-09-17T02:20:43.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:43.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.561506+0000", 2024-09-17T02:20:43.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6260000000000001e-05 2024-09-17T02:20:43.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:43.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.574779+0000", 2024-09-17T02:20:43.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013273691000000001 2024-09-17T02:20:43.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:43.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.574879+0000", 2024-09-17T02:20:43.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9625999999999998e-05 2024-09-17T02:20:43.319 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.319 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:43.319 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.319 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:43.319 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.560079+0000", 2024-09-17T02:20:43.319 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.702273896000001, 2024-09-17T02:20:43.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016073831, 2024-09-17T02:20:43.320 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:43.320 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:43.320 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:43.320 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:43.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:43.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560079+0000", 2024-09-17T02:20:43.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:43.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560079+0000", 2024-09-17T02:20:43.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:43.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560081+0000", 2024-09-17T02:20:43.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.266e-06 2024-09-17T02:20:43.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:43.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560090+0000", 2024-09-17T02:20:43.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2129999999999997e-06 2024-09-17T02:20:43.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:43.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560119+0000", 2024-09-17T02:20:43.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8932999999999999e-05 2024-09-17T02:20:43.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.322 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560145+0000", 2024-09-17T02:20:43.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6020000000000002e-05 2024-09-17T02:20:43.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.322 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:43.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.561833+0000", 2024-09-17T02:20:43.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016875659999999999 2024-09-17T02:20:43.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:43.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562199+0000", 2024-09-17T02:20:43.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036619000000000002 2024-09-17T02:20:43.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:43.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576153+0000", 2024-09-17T02:20:43.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013953643 2024-09-17T02:20:43.323 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.323 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:43.323 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.324 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:18 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'1, mlcod=0'0)", 2024-09-17T02:20:43.324 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.567765+0000", 2024-09-17T02:20:43.324 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.694587831, 2024-09-17T02:20:43.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014868306, 2024-09-17T02:20:43.324 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:43.324 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:43.324 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:43.324 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:43.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:43.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.567765+0000", 2024-09-17T02:20:43.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:43.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.567765+0000", 2024-09-17T02:20:43.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:43.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.567766+0000", 2024-09-17T02:20:43.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.13e-06 2024-09-17T02:20:43.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:43.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.567811+0000", 2024-09-17T02:20:43.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5361999999999997e-05 2024-09-17T02:20:43.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:43.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.567867+0000", 2024-09-17T02:20:43.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5083000000000001e-05 2024-09-17T02:20:43.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.567885+0000", 2024-09-17T02:20:43.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8827000000000001e-05 2024-09-17T02:20:43.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:43.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570145+0000", 2024-09-17T02:20:43.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002259708 2024-09-17T02:20:43.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:43.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570187+0000", 2024-09-17T02:20:43.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2410000000000002e-05 2024-09-17T02:20:43.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:43.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582543+0000", 2024-09-17T02:20:43.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012356015999999999 2024-09-17T02:20:43.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:43.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582633+0000", 2024-09-17T02:20:43.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9770000000000003e-05 2024-09-17T02:20:43.328 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.328 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:43.328 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.328 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:24 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'1, mlcod=0'0)", 2024-09-17T02:20:43.328 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.568621+0000", 2024-09-17T02:20:43.328 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.693731794000001, 2024-09-17T02:20:43.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015593332, 2024-09-17T02:20:43.328 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:43.329 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:43.329 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:43.329 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:43.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:43.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568621+0000", 2024-09-17T02:20:43.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:43.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568621+0000", 2024-09-17T02:20:43.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:43.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568622+0000", 2024-09-17T02:20:43.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1570000000000001e-06 2024-09-17T02:20:43.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:43.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568633+0000", 2024-09-17T02:20:43.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1093e-05 2024-09-17T02:20:43.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:43.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568654+0000", 2024-09-17T02:20:43.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1132999999999999e-05 2024-09-17T02:20:43.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568670+0000", 2024-09-17T02:20:43.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5307000000000001e-05 2024-09-17T02:20:43.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:43.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570935+0000", 2024-09-17T02:20:43.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022651609999999999 2024-09-17T02:20:43.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:43.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570980+0000", 2024-09-17T02:20:43.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5170000000000003e-05 2024-09-17T02:20:43.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:43.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584128+0000", 2024-09-17T02:20:43.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013148388 2024-09-17T02:20:43.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:43.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584214+0000", 2024-09-17T02:20:43.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5922999999999997e-05 2024-09-17T02:20:43.333 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.333 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:43.333 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.333 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:25 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'2, mlcod=0'0)", 2024-09-17T02:20:43.333 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.568721+0000", 2024-09-17T02:20:43.333 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.693631878000001, 2024-09-17T02:20:43.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015657030999999998, 2024-09-17T02:20:43.333 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:43.333 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:43.333 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:43.333 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:43.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:43.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568721+0000", 2024-09-17T02:20:43.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:43.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568721+0000", 2024-09-17T02:20:43.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:43.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568722+0000", 2024-09-17T02:20:43.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5600000000000004e-07 2024-09-17T02:20:43.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:43.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568742+0000", 2024-09-17T02:20:43.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0506999999999999e-05 2024-09-17T02:20:43.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:43.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568762+0000", 2024-09-17T02:20:43.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9423e-05 2024-09-17T02:20:43.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568777+0000", 2024-09-17T02:20:43.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5457000000000001e-05 2024-09-17T02:20:43.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:43.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.571705+0000", 2024-09-17T02:20:43.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029280130000000001 2024-09-17T02:20:43.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:43.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.571787+0000", 2024-09-17T02:20:43.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1509999999999997e-05 2024-09-17T02:20:43.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:43.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584296+0000", 2024-09-17T02:20:43.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012509398999999999 2024-09-17T02:20:43.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:43.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584378+0000", 2024-09-17T02:20:43.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1866000000000005e-05 2024-09-17T02:20:43.337 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.337 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:43.337 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.338 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:7 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'2, mlcod=0'0)", 2024-09-17T02:20:43.338 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.569013+0000", 2024-09-17T02:20:43.338 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.693339956999999, 2024-09-17T02:20:43.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015831576999999999, 2024-09-17T02:20:43.338 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:43.338 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:43.338 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:43.338 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:43.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:43.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569013+0000", 2024-09-17T02:20:43.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:43.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569013+0000", 2024-09-17T02:20:43.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:43.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569014+0000", 2024-09-17T02:20:43.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6000000000000002e-07 2024-09-17T02:20:43.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:43.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569024+0000", 2024-09-17T02:20:43.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8369999999999992e-06 2024-09-17T02:20:43.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:43.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570016+0000", 2024-09-17T02:20:43.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00099277000000000002 2024-09-17T02:20:43.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570040+0000", 2024-09-17T02:20:43.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3790000000000001e-05 2024-09-17T02:20:43.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:43.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570154+0000", 2024-09-17T02:20:43.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113689 2024-09-17T02:20:43.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:43.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570208+0000", 2024-09-17T02:20:43.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4305999999999998e-05 2024-09-17T02:20:43.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:43.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.583286+0000", 2024-09-17T02:20:43.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013077945000000001 2024-09-17T02:20:43.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:43.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584844+0000", 2024-09-17T02:20:43.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015583800000000001 2024-09-17T02:20:43.342 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.342 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:43.342 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.342 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:2 3.f e19/17 3:f1f69726:::400.00000000:head v 19'1, mlcod=0'0)", 2024-09-17T02:20:43.342 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.570080+0000", 2024-09-17T02:20:43.342 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.692272827, 2024-09-17T02:20:43.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014452469000000001, 2024-09-17T02:20:43.343 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:43.343 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:43.343 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:43.343 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:43.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:43.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570080+0000", 2024-09-17T02:20:43.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:43.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570080+0000", 2024-09-17T02:20:43.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:43.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570081+0000", 2024-09-17T02:20:43.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.333e-06 2024-09-17T02:20:43.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:43.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570142+0000", 2024-09-17T02:20:43.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0919999999999999e-05 2024-09-17T02:20:43.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:43.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570167+0000", 2024-09-17T02:20:43.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4576e-05 2024-09-17T02:20:43.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570180+0000", 2024-09-17T02:20:43.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3444e-05 2024-09-17T02:20:43.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:43.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573011+0000", 2024-09-17T02:20:43.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028309170000000001 2024-09-17T02:20:43.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:43.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573052+0000", 2024-09-17T02:20:43.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1285999999999997e-05 2024-09-17T02:20:43.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:43.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584432+0000", 2024-09-17T02:20:43.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011379837 2024-09-17T02:20:43.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:43.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584532+0000", 2024-09-17T02:20:43.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010015599999999999 2024-09-17T02:20:43.347 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.347 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:43.347 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.348 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:1247 5.e 5:771d49ed:::benchmark_data_smithi001_23533_object1246:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:43.348 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:33.170545+0000", 2024-09-17T02:20:43.348 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 10.091807901999999, 2024-09-17T02:20:43.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014510571999999999, 2024-09-17T02:20:43.348 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:43.348 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:43.348 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:43.348 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:43.348 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:43.348 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:43.348 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1247 2024-09-17T02:20:43.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.349 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:43.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:43.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170545+0000", 2024-09-17T02:20:43.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:43.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170545+0000", 2024-09-17T02:20:43.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:43.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170546+0000", 2024-09-17T02:20:43.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.037e-06 2024-09-17T02:20:43.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:43.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170606+0000", 2024-09-17T02:20:43.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9914000000000003e-05 2024-09-17T02:20:43.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:43.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170621+0000", 2024-09-17T02:20:43.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5011000000000001e-05 2024-09-17T02:20:43.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170628+0000", 2024-09-17T02:20:43.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3989999999999998e-06 2024-09-17T02:20:43.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:43.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170703+0000", 2024-09-17T02:20:43.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5082999999999999e-05 2024-09-17T02:20:43.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:43.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170860+0000", 2024-09-17T02:20:43.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015699600000000001 2024-09-17T02:20:43.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:43.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170991+0000", 2024-09-17T02:20:43.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013087900000000001 2024-09-17T02:20:43.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:43.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.172129+0000", 2024-09-17T02:20:43.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001137826 2024-09-17T02:20:43.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:43.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.184962+0000", 2024-09-17T02:20:43.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012832582 2024-09-17T02:20:43.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:43.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.185000+0000", 2024-09-17T02:20:43.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8444e-05 2024-09-17T02:20:43.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:43.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.185055+0000", 2024-09-17T02:20:43.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5401e-05 2024-09-17T02:20:43.354 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.354 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:43.354 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.354 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:1248 5.e 5:7f482265:::benchmark_data_smithi001_23533_object1247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:43.354 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:33.170647+0000", 2024-09-17T02:20:43.354 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 10.091705474999999, 2024-09-17T02:20:43.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015727534000000001, 2024-09-17T02:20:43.354 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:43.354 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:43.354 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:43.354 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:43.355 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:43.355 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:43.355 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1248 2024-09-17T02:20:43.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.355 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:43.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:43.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170647+0000", 2024-09-17T02:20:43.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:43.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170647+0000", 2024-09-17T02:20:43.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:43.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170648+0000", 2024-09-17T02:20:43.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4000000000000002e-07 2024-09-17T02:20:43.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:43.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170691+0000", 2024-09-17T02:20:43.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2722000000000002e-05 2024-09-17T02:20:43.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:43.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170699+0000", 2024-09-17T02:20:43.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1540000000000002e-06 2024-09-17T02:20:43.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170704+0000", 2024-09-17T02:20:43.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1290000000000004e-06 2024-09-17T02:20:43.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:43.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.171489+0000", 2024-09-17T02:20:43.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00078564599999999998 2024-09-17T02:20:43.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:43.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.171653+0000", 2024-09-17T02:20:43.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163027 2024-09-17T02:20:43.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:43.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.171797+0000", 2024-09-17T02:20:43.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000144828 2024-09-17T02:20:43.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:43.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.172344+0000", 2024-09-17T02:20:43.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054687599999999996 2024-09-17T02:20:43.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:43.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.186281+0000", 2024-09-17T02:20:43.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013936755 2024-09-17T02:20:43.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:43.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.186338+0000", 2024-09-17T02:20:43.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6598000000000003e-05 2024-09-17T02:20:43.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:43.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.186375+0000", 2024-09-17T02:20:43.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7258999999999997e-05 2024-09-17T02:20:43.360 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.360 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:43.360 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.360 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28720 5.f e28/22 5:f8a7aea5:::benchmark_data_smithi001_23533_object28719:head v 28'1756, mlcod=28'1754)", 2024-09-17T02:20:43.360 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:20:43.360 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.69223289399999999, 2024-09-17T02:20:43.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033308717000000002, 2024-09-17T02:20:43.360 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:43.360 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:43.361 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:43.361 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:43.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:43.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:20:43.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:43.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:20:43.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:43.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570121+0000", 2024-09-17T02:20:43.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4e-07 2024-09-17T02:20:43.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:43.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570208+0000", 2024-09-17T02:20:43.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6945000000000002e-05 2024-09-17T02:20:43.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:43.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570222+0000", 2024-09-17T02:20:43.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4541e-05 2024-09-17T02:20:43.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570232+0000", 2024-09-17T02:20:43.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3039999999999994e-06 2024-09-17T02:20:43.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:43.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570273+0000", 2024-09-17T02:20:43.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1950999999999999e-05 2024-09-17T02:20:43.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:43.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570286+0000", 2024-09-17T02:20:43.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2268e-05 2024-09-17T02:20:43.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:43.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603312+0000", 2024-09-17T02:20:43.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033026405000000002 2024-09-17T02:20:43.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:43.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603429+0000", 2024-09-17T02:20:43.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116463 2024-09-17T02:20:43.364 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.364 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:43.365 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.365 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28721 5.a e28/22 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head v 28'1872, mlcod=28'1869)", 2024-09-17T02:20:43.365 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:20:43.365 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.69208938799999997, 2024-09-17T02:20:43.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033539817999999999, 2024-09-17T02:20:43.365 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:43.365 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:43.365 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:43.365 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:43.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:43.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:20:43.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:43.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:20:43.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:43.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570264+0000", 2024-09-17T02:20:43.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0999999999999997e-07 2024-09-17T02:20:43.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:43.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570299+0000", 2024-09-17T02:20:43.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4876999999999998e-05 2024-09-17T02:20:43.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:43.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570310+0000", 2024-09-17T02:20:43.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0958000000000001e-05 2024-09-17T02:20:43.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570316+0000", 2024-09-17T02:20:43.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.485e-06 2024-09-17T02:20:43.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:43.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598947+0000", 2024-09-17T02:20:43.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.028631058000000001 2024-09-17T02:20:43.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:43.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598969+0000", 2024-09-17T02:20:43.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2005999999999999e-05 2024-09-17T02:20:43.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:43.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.602638+0000", 2024-09-17T02:20:43.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036690339999999998 2024-09-17T02:20:43.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:43.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603803+0000", 2024-09-17T02:20:43.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00116559 2024-09-17T02:20:43.369 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.369 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:43.369 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.369 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28723 5.f e28/22 5:f1a2a8f6:::benchmark_data_smithi001_23533_object28722:head v 28'1757, mlcod=28'1754)", 2024-09-17T02:20:43.369 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.571446+0000", 2024-09-17T02:20:43.369 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.69090706000000002, 2024-09-17T02:20:43.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.032047203000000003, 2024-09-17T02:20:43.370 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:43.370 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:43.370 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:43.370 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:43.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:43.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571446+0000", 2024-09-17T02:20:43.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:43.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571446+0000", 2024-09-17T02:20:43.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:43.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:43.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571447+0000", 2024-09-17T02:20:43.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0979999999999999e-06 2024-09-17T02:20:43.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:43.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571554+0000", 2024-09-17T02:20:43.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107464 2024-09-17T02:20:43.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:43.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598891+0000", 2024-09-17T02:20:43.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.027336905000000002 2024-09-17T02:20:43.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598905+0000", 2024-09-17T02:20:43.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:20:43.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:43.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.600343+0000", 2024-09-17T02:20:43.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014382100000000001 2024-09-17T02:20:43.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:43.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.600387+0000", 2024-09-17T02:20:43.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3398e-05 2024-09-17T02:20:43.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:43.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603443+0000", 2024-09-17T02:20:43.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030562250000000001 2024-09-17T02:20:43.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:43.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:43.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:43.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603493+0000", 2024-09-17T02:20:43.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9820000000000001e-05 2024-09-17T02:20:43.373 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.374 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:43.374 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.374 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:43.374 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:43.374 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:20:43.375 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:20:43.376 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:43.379+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:43.476 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:43.480+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:43.535 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:20:43.535 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:20:43.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.535 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:31410 5.3 5:ccf79b42:::benchmark_data_smithi001_23533_object31409:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-17T02:20:43.535 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:43.537961+0000", 2024-09-17T02:20:43.535 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0023063319999999999, 2024-09-17T02:20:43.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023260540000000001, 2024-09-17T02:20:43.536 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:43.536 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:43.536 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:43.536 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:43.536 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:43.536 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:43.536 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 31410 2024-09-17T02:20:43.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.536 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:43.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:43.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.537961+0000", 2024-09-17T02:20:43.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:43.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:43.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.537961+0000", 2024-09-17T02:20:43.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:43.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:43.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.537961+0000", 2024-09-17T02:20:43.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4799999999999998e-07 2024-09-17T02:20:43.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:43.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.538053+0000", 2024-09-17T02:20:43.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1188999999999997e-05 2024-09-17T02:20:43.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:43.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.538060+0000", 2024-09-17T02:20:43.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7849999999999992e-06 2024-09-17T02:20:43.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.538066+0000", 2024-09-17T02:20:43.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9610000000000002e-06 2024-09-17T02:20:43.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:43.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.538103+0000", 2024-09-17T02:20:43.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6205999999999999e-05 2024-09-17T02:20:43.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:43.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.538181+0000", 2024-09-17T02:20:43.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8060999999999997e-05 2024-09-17T02:20:43.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:43.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.538257+0000", 2024-09-17T02:20:43.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6711999999999993e-05 2024-09-17T02:20:43.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:43.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.540051+0000", 2024-09-17T02:20:43.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001793631 2024-09-17T02:20:43.540 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:43.540 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:43.540 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:43.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.540 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:31406 5.1 e29/22 5:8bcafa9f:::benchmark_data_smithi001_23533_object31405:head v 29'1903, mlcod=29'1900)", 2024-09-17T02:20:43.540 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:43.538213+0000", 2024-09-17T02:20:43.540 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0020540469999999998, 2024-09-17T02:20:43.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021239219999999999, 2024-09-17T02:20:43.541 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:43.541 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:43.541 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:43.541 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:43.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:43.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.538213+0000", 2024-09-17T02:20:43.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:43.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:43.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.538213+0000", 2024-09-17T02:20:43.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:43.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:43.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.538214+0000", 2024-09-17T02:20:43.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4899999999999995e-07 2024-09-17T02:20:43.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:43.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.538282+0000", 2024-09-17T02:20:43.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8734999999999998e-05 2024-09-17T02:20:43.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:43.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.538306+0000", 2024-09-17T02:20:43.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3084000000000001e-05 2024-09-17T02:20:43.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.538314+0000", 2024-09-17T02:20:43.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1659999999999994e-06 2024-09-17T02:20:43.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:43.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.538359+0000", 2024-09-17T02:20:43.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5457000000000002e-05 2024-09-17T02:20:43.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:43.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.538376+0000", 2024-09-17T02:20:43.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6812000000000001e-05 2024-09-17T02:20:43.544 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:43.544 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:43.544 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:43.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.544 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:31409 5.b e29/22 5:d4208858:::benchmark_data_smithi001_23533_object31408:head v 29'1913, mlcod=29'1911)", 2024-09-17T02:20:43.544 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:43.538404+0000", 2024-09-17T02:20:43.544 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00186331, 2024-09-17T02:20:43.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019849300000000002, 2024-09-17T02:20:43.544 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:43.545 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:43.545 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:43.545 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:43.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:43.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.538404+0000", 2024-09-17T02:20:43.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:43.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:43.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.538404+0000", 2024-09-17T02:20:43.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:43.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:43.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.538404+0000", 2024-09-17T02:20:43.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4300000000000003e-07 2024-09-17T02:20:43.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:43.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.538468+0000", 2024-09-17T02:20:43.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3121999999999996e-05 2024-09-17T02:20:43.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:43.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.538477+0000", 2024-09-17T02:20:43.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6139999999999998e-06 2024-09-17T02:20:43.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.538484+0000", 2024-09-17T02:20:43.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6460000000000004e-06 2024-09-17T02:20:43.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:43.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.538532+0000", 2024-09-17T02:20:43.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8606000000000002e-05 2024-09-17T02:20:43.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:43.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.538549+0000", 2024-09-17T02:20:43.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6059e-05 2024-09-17T02:20:43.548 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:43.548 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:43.548 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:43.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.548 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:31413 5.8 5:1bc5d29a:::benchmark_data_smithi001_23533_object31412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-17T02:20:43.548 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:43.539956+0000", 2024-09-17T02:20:43.549 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00031112300000000001, 2024-09-17T02:20:43.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00047677499999999997, 2024-09-17T02:20:43.549 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:43.549 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:43.549 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:43.549 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:43.549 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:43.549 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:43.549 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 31413 2024-09-17T02:20:43.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.549 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:43.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:43.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.539956+0000", 2024-09-17T02:20:43.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:43.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:43.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.539956+0000", 2024-09-17T02:20:43.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:43.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:43.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.539957+0000", 2024-09-17T02:20:43.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0070000000000001e-06 2024-09-17T02:20:43.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:43.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.539992+0000", 2024-09-17T02:20:43.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4916000000000002e-05 2024-09-17T02:20:43.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:43.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.540004+0000", 2024-09-17T02:20:43.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1861999999999999e-05 2024-09-17T02:20:43.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.540011+0000", 2024-09-17T02:20:43.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.131e-06 2024-09-17T02:20:43.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:43.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.540059+0000", 2024-09-17T02:20:43.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8303000000000002e-05 2024-09-17T02:20:43.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:43.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.540179+0000", 2024-09-17T02:20:43.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011950700000000001 2024-09-17T02:20:43.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:43.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.540268+0000", 2024-09-17T02:20:43.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8857999999999995e-05 2024-09-17T02:20:43.553 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:43.553 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:43.553 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:43.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.553 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:31414 5.8 5.e56423a8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-17T02:20:43.553 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:43.540229+0000", 2024-09-17T02:20:43.553 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.7947000000000001e-05, 2024-09-17T02:20:43.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00026889699999999998, 2024-09-17T02:20:43.553 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:43.553 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:43.553 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:20:43.553 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:43.554 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:43.554 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:43.554 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 31414 2024-09-17T02:20:43.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.554 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:43.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:43.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.540229+0000", 2024-09-17T02:20:43.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:43.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:43.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.540229+0000", 2024-09-17T02:20:43.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:43.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:43.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.540230+0000", 2024-09-17T02:20:43.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0200000000000001e-07 2024-09-17T02:20:43.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:43.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.540327+0000", 2024-09-17T02:20:43.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7324999999999994e-05 2024-09-17T02:20:43.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:43.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.540334+0000", 2024-09-17T02:20:43.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2289999999999997e-06 2024-09-17T02:20:43.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.540339+0000", 2024-09-17T02:20:43.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9740000000000001e-06 2024-09-17T02:20:43.556 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:43.556 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:43.556 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:43.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.557 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:31415 5.8 5.cf1dc068 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-17T02:20:43.557 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:43.540351+0000", 2024-09-17T02:20:43.557 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9999166, 2024-09-17T02:20:43.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020121200000000001, 2024-09-17T02:20:43.557 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:43.557 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:43.557 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:20:43.557 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:43.557 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:43.557 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:43.557 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 31415 2024-09-17T02:20:43.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.557 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:43.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:43.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.540351+0000", 2024-09-17T02:20:43.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:43.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:43.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.540351+0000", 2024-09-17T02:20:43.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:43.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:43.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.540351+0000", 2024-09-17T02:20:43.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9700000000000002e-07 2024-09-17T02:20:43.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:43.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.540377+0000", 2024-09-17T02:20:43.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5901000000000002e-05 2024-09-17T02:20:43.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:43.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.540383+0000", 2024-09-17T02:20:43.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.285e-06 2024-09-17T02:20:43.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.540387+0000", 2024-09-17T02:20:43.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.484e-06 2024-09-17T02:20:43.560 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:43.560 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:43.560 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:43.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.560 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:31416 5.3 5:ca37d7d4:::benchmark_data_smithi001_23533_object31415:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-17T02:20:43.560 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:43.540395+0000", 2024-09-17T02:20:43.560 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9998722, 2024-09-17T02:20:43.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021606800000000001, 2024-09-17T02:20:43.560 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:43.560 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:43.560 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:43.561 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:43.561 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:43.561 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:43.561 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 31416 2024-09-17T02:20:43.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.561 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:43.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:43.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.540395+0000", 2024-09-17T02:20:43.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:43.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:43.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.540395+0000", 2024-09-17T02:20:43.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:43.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:43.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.540395+0000", 2024-09-17T02:20:43.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9000000000000002e-07 2024-09-17T02:20:43.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:43.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.540450+0000", 2024-09-17T02:20:43.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4725999999999997e-05 2024-09-17T02:20:43.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:43.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.540457+0000", 2024-09-17T02:20:43.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5649999999999998e-06 2024-09-17T02:20:43.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.540460+0000", 2024-09-17T02:20:43.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5449999999999999e-06 2024-09-17T02:20:43.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:43.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.540500+0000", 2024-09-17T02:20:43.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9993000000000001e-05 2024-09-17T02:20:43.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:43.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.540593+0000", 2024-09-17T02:20:43.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2669000000000003e-05 2024-09-17T02:20:43.564 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:43.564 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:43.564 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:43.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.564 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:31400 5.8 5:18d74a65:::benchmark_data_smithi001_23533_object31399:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-17T02:20:43.564 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:43.533558+0000", 2024-09-17T02:20:43.564 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0067089699999999999, 2024-09-17T02:20:43.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0071130569999999999, 2024-09-17T02:20:43.564 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:43.565 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:43.565 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:43.565 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:43.565 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:43.565 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:43.565 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 31400 2024-09-17T02:20:43.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.565 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:43.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:43.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.533558+0000", 2024-09-17T02:20:43.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:43.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.566 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:43.566 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.533558+0000", 2024-09-17T02:20:43.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:43.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.566 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:43.566 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.533559+0000", 2024-09-17T02:20:43.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7399999999999998e-07 2024-09-17T02:20:43.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.566 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:43.566 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.533635+0000", 2024-09-17T02:20:43.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6415000000000006e-05 2024-09-17T02:20:43.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:43.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.533644+0000", 2024-09-17T02:20:43.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3379999999999994e-06 2024-09-17T02:20:43.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.533650+0000", 2024-09-17T02:20:43.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8860000000000001e-06 2024-09-17T02:20:43.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:43.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.536402+0000", 2024-09-17T02:20:43.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027519279999999998 2024-09-17T02:20:43.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:43.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.536532+0000", 2024-09-17T02:20:43.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012989300000000001 2024-09-17T02:20:43.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:43.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.536675+0000", 2024-09-17T02:20:43.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014262300000000001 2024-09-17T02:20:43.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:43.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.538879+0000", 2024-09-17T02:20:43.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002203923 2024-09-17T02:20:43.569 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:43.569 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:43.569 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:43.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.569 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:31403 5.a 5:535be1d9:::benchmark_data_smithi001_23533_object31402:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-17T02:20:43.569 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:43.533659+0000", 2024-09-17T02:20:43.569 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0066078550000000002, 2024-09-17T02:20:43.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070561369999999997, 2024-09-17T02:20:43.569 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:43.570 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:43.570 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:43.570 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:43.570 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:43.570 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:43.570 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 31403 2024-09-17T02:20:43.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.570 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:43.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:43.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.533659+0000", 2024-09-17T02:20:43.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:43.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:43.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.533659+0000", 2024-09-17T02:20:43.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:43.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:43.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.533660+0000", 2024-09-17T02:20:43.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2900000000000004e-07 2024-09-17T02:20:43.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:43.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.533690+0000", 2024-09-17T02:20:43.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9938999999999999e-05 2024-09-17T02:20:43.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:43.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.533708+0000", 2024-09-17T02:20:43.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8138000000000002e-05 2024-09-17T02:20:43.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.533716+0000", 2024-09-17T02:20:43.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8420000000000005e-06 2024-09-17T02:20:43.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:43.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.536351+0000", 2024-09-17T02:20:43.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026349640000000001 2024-09-17T02:20:43.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:43.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.536423+0000", 2024-09-17T02:20:43.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2480999999999999e-05 2024-09-17T02:20:43.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:43.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.536503+0000", 2024-09-17T02:20:43.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9474000000000005e-05 2024-09-17T02:20:43.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:43.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.539054+0000", 2024-09-17T02:20:43.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00255156 2024-09-17T02:20:43.574 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:43.574 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:43.574 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:43.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.574 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:31404 5.e e29/22 5:79e430f4:::benchmark_data_smithi001_23533_object31403:head v 29'2001, mlcod=29'1999)", 2024-09-17T02:20:43.574 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:43.536243+0000", 2024-09-17T02:20:43.575 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0040244599999999997, 2024-09-17T02:20:43.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045146789999999997, 2024-09-17T02:20:43.575 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:43.575 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:43.575 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:43.575 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:43.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:43.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.536243+0000", 2024-09-17T02:20:43.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:43.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:43.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.536243+0000", 2024-09-17T02:20:43.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:43.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:43.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.536243+0000", 2024-09-17T02:20:43.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5999999999999999e-07 2024-09-17T02:20:43.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:43.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.536308+0000", 2024-09-17T02:20:43.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5221000000000005e-05 2024-09-17T02:20:43.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:43.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.536314+0000", 2024-09-17T02:20:43.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.339e-06 2024-09-17T02:20:43.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.536317+0000", 2024-09-17T02:20:43.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5269999999999999e-06 2024-09-17T02:20:43.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:43.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.536359+0000", 2024-09-17T02:20:43.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2314999999999997e-05 2024-09-17T02:20:43.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:43.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.536375+0000", 2024-09-17T02:20:43.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5512e-05 2024-09-17T02:20:43.578 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:43.578 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:43.578 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:43.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.578 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:31408 5.a 5:52d52d7f:::benchmark_data_smithi001_23533_object31407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-17T02:20:43.578 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:43.537810+0000", 2024-09-17T02:20:43.578 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0024575090000000001, 2024-09-17T02:20:43.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002983486, 2024-09-17T02:20:43.578 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:43.579 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:43.579 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:43.579 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:43.579 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:43.579 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:43.579 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 31408 2024-09-17T02:20:43.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.579 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:43.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:43.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.537810+0000", 2024-09-17T02:20:43.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:43.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:43.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.537810+0000", 2024-09-17T02:20:43.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:43.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:43.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.537811+0000", 2024-09-17T02:20:43.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3689999999999999e-06 2024-09-17T02:20:43.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:43.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.537933+0000", 2024-09-17T02:20:43.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122433 2024-09-17T02:20:43.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:43.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.537942+0000", 2024-09-17T02:20:43.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7639999999999994e-06 2024-09-17T02:20:43.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:43.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.537947+0000", 2024-09-17T02:20:43.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9799999999999998e-06 2024-09-17T02:20:43.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.582 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:43.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.537993+0000", 2024-09-17T02:20:43.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6152000000000001e-05 2024-09-17T02:20:43.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.582 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:43.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.538104+0000", 2024-09-17T02:20:43.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000110834 2024-09-17T02:20:43.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.582 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:43.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.538177+0000", 2024-09-17T02:20:43.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3292000000000002e-05 2024-09-17T02:20:43.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:43.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:43.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:43.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.540132+0000", 2024-09-17T02:20:43.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00195436 2024-09-17T02:20:43.583 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:43.583 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:43.583 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:43.583 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:43.583 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:20:43.583 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 11 2024-09-17T02:20:43.583 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:20:43.584 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:20:43.585 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:43.588+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:43.586 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:20:43.685 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:43.688+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:43.745 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:20:43.745 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:20:43.745 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:20:43.745 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:20:43.745 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:20:43.757 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:20:43.757 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:20:43.766 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:20:43.768 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 11 16 32046 32030 181.968 176.562 0.0109823 0.00548959 2024-09-17T02:20:43.777 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:20:43.777 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:20:43.786 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:43.792+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:43.796 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:20:43.796 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:20:43.887 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:43.891+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:43.925 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:43.925 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:43.946 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:20:43.990 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:43.995+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:44.089 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:44.091+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:44.111 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:44.111 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:44.136 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:20:44.191 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:44.196+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:44.292 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:44.293+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:44.294 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:44.294 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:44.316 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:20:44.392 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:44.395+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:44.493 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:44.496+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:44.519 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:44.519 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:44.540 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:20:44.595 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:44.599+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:44.695 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:44.696 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:44.696 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:44.699+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:44.716 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:20:44.736 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T02:20:44.768 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 12 16 34715 34699 180.704 166.812 0.00774181 0.00552842 2024-09-17T02:20:44.797 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:44.799+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:44.868 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:44.868 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:44.889 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:20:44.898 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:44.897+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:44.999 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:45.001+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:45.052 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:45.052 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:45.072 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:20:45.102 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:45.108+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:45.203 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:45.205+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:45.226 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:45.226 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:45.248 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:20:45.305 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:45.308+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:45.404 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:45.404 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:45.405 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:45.407+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:45.426 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:20:45.514 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:45.519+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:45.607 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:45.611+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:45.626 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:45.626 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:45.647 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:20:45.708 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:45.711+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:45.732 INFO:teuthology.orchestra.run.smithi001.stderr:nodeep-scrub is set 2024-09-17T02:20:45.768 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 13 16 37341 37325 179.427 164.125 0.0040037 0.0055686 2024-09-17T02:20:45.806 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:45.807 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:45.810 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:45.816+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:45.814 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:20:45.829 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:20:45.911 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:45.909+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:45.984 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:20:45.984 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:20:45.988 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:45.988 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:46.003 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:20:46.003 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:20:46.012 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:20:46.012 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:46.013+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:46.023 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:20:46.023 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:20:46.112 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:46.115+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:46.211 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:20:46.211 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-09-17T02:20:46.211 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-09-17T02:20:46.211 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-17T02:20:46.211 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.211 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-17T02:20:46.211 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:20:46.211 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.755069994999999, 2024-09-17T02:20:46.211 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.15597325500000001, 2024-09-17T02:20:46.211 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:46.212 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:46.212 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.212 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:46.212 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4164", 2024-09-17T02:20:46.212 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/201892753", 2024-09-17T02:20:46.212 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 1 2024-09-17T02:20:46.212 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.212 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:46.212 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.212 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:46.212 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:20:46.212 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.212 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.213 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.213 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:46.213 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:20:46.213 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.213 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.213 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.213 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:46.213 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458359+0000", 2024-09-17T02:20:46.213 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3929999999999998e-06 2024-09-17T02:20:46.213 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.213 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.213 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:46.213 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458373+0000", 2024-09-17T02:20:46.214 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4103e-05 2024-09-17T02:20:46.214 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.214 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.214 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:46.214 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458397+0000", 2024-09-17T02:20:46.214 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.438e-05 2024-09-17T02:20:46.214 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.214 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.214 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.214 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458421+0000", 2024-09-17T02:20:46.214 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3655999999999998e-05 2024-09-17T02:20:46.214 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.214 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.215 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:46.215 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458529+0000", 2024-09-17T02:20:46.215 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010752900000000001 2024-09-17T02:20:46.215 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.215 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.215 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:20:46.215 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458542+0000", 2024-09-17T02:20:46.215 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2986999999999999e-05 2024-09-17T02:20:46.215 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.215 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.215 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:46.215 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.611050+0000", 2024-09-17T02:20:46.215 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.1525087 2024-09-17T02:20:46.216 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.216 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.216 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:46.216 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.611529+0000", 2024-09-17T02:20:46.216 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00047844899999999999 2024-09-17T02:20:46.216 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.216 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.216 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:46.216 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.612061+0000", 2024-09-17T02:20:46.216 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00053230300000000003 2024-09-17T02:20:46.216 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.216 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.216 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:46.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.613451+0000", 2024-09-17T02:20:46.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0013897250000000001 2024-09-17T02:20:46.217 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.217 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.217 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614168+0000", 2024-09-17T02:20:46.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00071692499999999998 2024-09-17T02:20:46.217 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.217 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.217 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:46.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614265+0000", 2024-09-17T02:20:46.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7589000000000004e-05 2024-09-17T02:20:46.218 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.218 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.218 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:46.218 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614330+0000", 2024-09-17T02:20:46.218 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4516000000000004e-05 2024-09-17T02:20:46.218 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.218 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:46.218 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.218 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.218 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.218 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:46.218 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:20:46.218 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.657138877000001, 2024-09-17T02:20:46.219 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029713927000000001, 2024-09-17T02:20:46.219 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:46.219 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:46.219 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.219 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:46.219 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.219 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:46.219 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:20:46.219 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.219 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.219 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.219 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:46.219 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:20:46.220 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.220 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.220 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.220 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:46.220 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556289+0000", 2024-09-17T02:20:46.220 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.513e-06 2024-09-17T02:20:46.220 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.220 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.220 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:46.220 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556298+0000", 2024-09-17T02:20:46.220 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1630000000000002e-06 2024-09-17T02:20:46.220 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.220 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.221 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:46.221 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556318+0000", 2024-09-17T02:20:46.221 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9389999999999999e-05 2024-09-17T02:20:46.221 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.221 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.221 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.221 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556332+0000", 2024-09-17T02:20:46.221 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4506e-05 2024-09-17T02:20:46.221 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.221 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.221 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:46.221 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557304+0000", 2024-09-17T02:20:46.222 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00097169699999999999 2024-09-17T02:20:46.222 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.222 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.222 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:46.222 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557507+0000", 2024-09-17T02:20:46.222 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000203191 2024-09-17T02:20:46.222 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.222 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.222 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:46.222 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557838+0000", 2024-09-17T02:20:46.222 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033061100000000002 2024-09-17T02:20:46.222 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.222 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.223 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:46.223 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562171+0000", 2024-09-17T02:20:46.223 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043329229999999998 2024-09-17T02:20:46.223 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.223 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.223 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.223 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585737+0000", 2024-09-17T02:20:46.223 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023565915 2024-09-17T02:20:46.223 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.223 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.223 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:46.223 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585884+0000", 2024-09-17T02:20:46.223 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014744199999999999 2024-09-17T02:20:46.223 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.223 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.224 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:46.224 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586002+0000", 2024-09-17T02:20:46.224 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000117576 2024-09-17T02:20:46.224 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.224 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:46.224 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.224 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.224 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.224 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:46.224 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:20:46.224 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.657046905000001, 2024-09-17T02:20:46.224 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030933694000000001, 2024-09-17T02:20:46.224 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:46.224 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:46.225 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.225 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:46.225 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.225 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:46.225 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:20:46.225 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.225 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.225 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.225 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:46.225 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:20:46.225 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.225 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.225 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.226 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:46.226 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556381+0000", 2024-09-17T02:20:46.226 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2100000000000001e-06 2024-09-17T02:20:46.226 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.226 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.226 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:46.226 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556389+0000", 2024-09-17T02:20:46.226 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5539999999999998e-06 2024-09-17T02:20:46.226 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.226 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.226 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:46.226 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556408+0000", 2024-09-17T02:20:46.226 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8623000000000001e-05 2024-09-17T02:20:46.226 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.227 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.227 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.227 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556427+0000", 2024-09-17T02:20:46.227 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8566000000000001e-05 2024-09-17T02:20:46.227 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.227 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.227 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:46.227 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558741+0000", 2024-09-17T02:20:46.227 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023144390000000002 2024-09-17T02:20:46.227 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.227 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.227 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:46.227 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559040+0000", 2024-09-17T02:20:46.227 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029912100000000001 2024-09-17T02:20:46.228 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.228 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.228 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:46.228 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559222+0000", 2024-09-17T02:20:46.228 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018211200000000001 2024-09-17T02:20:46.228 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.228 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.228 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:46.228 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.566648+0000", 2024-09-17T02:20:46.228 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074257560000000004 2024-09-17T02:20:46.228 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.228 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.228 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.228 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587109+0000", 2024-09-17T02:20:46.229 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.020460685999999999 2024-09-17T02:20:46.229 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.229 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.229 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:46.229 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587232+0000", 2024-09-17T02:20:46.229 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123325 2024-09-17T02:20:46.229 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.229 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.229 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:46.229 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587313+0000", 2024-09-17T02:20:46.229 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1302000000000002e-05 2024-09-17T02:20:46.229 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.229 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:46.230 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.230 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.230 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.230 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:46.230 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:20:46.230 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.656981459000001, 2024-09-17T02:20:46.230 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031045538000000001, 2024-09-17T02:20:46.230 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:46.230 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:46.230 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.230 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:46.230 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.231 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:46.231 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:20:46.231 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.231 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.231 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.231 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:46.231 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:20:46.231 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.231 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.231 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.231 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:46.231 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556446+0000", 2024-09-17T02:20:46.232 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.26e-06 2024-09-17T02:20:46.232 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.232 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.232 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:46.232 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556454+0000", 2024-09-17T02:20:46.232 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1640000000000004e-06 2024-09-17T02:20:46.232 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.232 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.232 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:46.232 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556471+0000", 2024-09-17T02:20:46.232 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7586000000000001e-05 2024-09-17T02:20:46.232 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.232 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.233 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.233 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556485+0000", 2024-09-17T02:20:46.233 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3523000000000001e-05 2024-09-17T02:20:46.233 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.233 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.233 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:46.233 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559899+0000", 2024-09-17T02:20:46.233 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0034142140000000001 2024-09-17T02:20:46.233 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.233 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.233 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:46.233 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.560104+0000", 2024-09-17T02:20:46.233 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00020539199999999999 2024-09-17T02:20:46.234 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.234 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.234 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:46.234 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.560400+0000", 2024-09-17T02:20:46.234 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029612099999999999 2024-09-17T02:20:46.234 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.234 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.234 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:46.234 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.568427+0000", 2024-09-17T02:20:46.234 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0080262909999999996 2024-09-17T02:20:46.234 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.234 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.235 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.235 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587377+0000", 2024-09-17T02:20:46.235 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018950765000000001 2024-09-17T02:20:46.235 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.235 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.235 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:46.235 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587445+0000", 2024-09-17T02:20:46.235 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.724e-05 2024-09-17T02:20:46.235 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.235 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.235 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:46.235 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587491+0000", 2024-09-17T02:20:46.235 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5982000000000001e-05 2024-09-17T02:20:46.236 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.236 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:46.236 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.236 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.236 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.236 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:46.236 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:20:46.236 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.656918689000001, 2024-09-17T02:20:46.236 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031435547000000001, 2024-09-17T02:20:46.236 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:46.236 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:46.236 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.236 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:46.237 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.237 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:46.237 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:20:46.237 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.237 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.237 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.237 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:46.237 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:20:46.237 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.237 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.237 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.237 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:46.238 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556509+0000", 2024-09-17T02:20:46.238 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.06e-06 2024-09-17T02:20:46.238 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.238 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.238 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:46.238 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556515+0000", 2024-09-17T02:20:46.238 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1029999999999998e-06 2024-09-17T02:20:46.238 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.238 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.238 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:46.238 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556532+0000", 2024-09-17T02:20:46.238 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7054e-05 2024-09-17T02:20:46.238 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.238 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.239 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.239 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556545+0000", 2024-09-17T02:20:46.239 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3023000000000001e-05 2024-09-17T02:20:46.239 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.239 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.239 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:46.239 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561016+0000", 2024-09-17T02:20:46.239 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044705150000000004 2024-09-17T02:20:46.239 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.239 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.239 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:46.239 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561316+0000", 2024-09-17T02:20:46.239 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000299895 2024-09-17T02:20:46.239 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.240 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.240 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:46.240 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561651+0000", 2024-09-17T02:20:46.240 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033519300000000001 2024-09-17T02:20:46.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.240 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.240 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:46.240 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571105+0000", 2024-09-17T02:20:46.240 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094540539999999999 2024-09-17T02:20:46.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.240 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.240 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.240 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587628+0000", 2024-09-17T02:20:46.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016522819000000001 2024-09-17T02:20:46.241 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:46.241 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587770+0000", 2024-09-17T02:20:46.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000142352 2024-09-17T02:20:46.241 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:46.241 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587943+0000", 2024-09-17T02:20:46.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017347900000000001 2024-09-17T02:20:46.241 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.241 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:46.242 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.242 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.242 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.242 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:46.242 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:20:46.242 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.656862959000001, 2024-09-17T02:20:46.242 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031809104999999997, 2024-09-17T02:20:46.242 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:46.242 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:46.242 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.242 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:46.242 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.242 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:46.243 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:20:46.243 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.243 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.243 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.243 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:46.243 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:20:46.243 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.243 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.243 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.243 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:46.243 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556565+0000", 2024-09-17T02:20:46.244 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.116e-06 2024-09-17T02:20:46.244 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.244 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:46.244 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556572+0000", 2024-09-17T02:20:46.244 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0230000000000004e-06 2024-09-17T02:20:46.244 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.244 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:46.244 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556588+0000", 2024-09-17T02:20:46.244 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6643e-05 2024-09-17T02:20:46.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556606+0000", 2024-09-17T02:20:46.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7159999999999998e-05 2024-09-17T02:20:46.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:46.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562712+0000", 2024-09-17T02:20:46.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0061061630000000004 2024-09-17T02:20:46.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:46.246 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562919+0000", 2024-09-17T02:20:46.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000207309 2024-09-17T02:20:46.246 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.246 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.246 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:46.246 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563264+0000", 2024-09-17T02:20:46.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00034490699999999998 2024-09-17T02:20:46.246 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.246 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.246 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:46.246 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571812+0000", 2024-09-17T02:20:46.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0085477810000000008 2024-09-17T02:20:46.247 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.247 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.247 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.247 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588094+0000", 2024-09-17T02:20:46.247 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016282443000000001 2024-09-17T02:20:46.247 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.247 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.247 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:46.247 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588275+0000", 2024-09-17T02:20:46.247 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018058700000000001 2024-09-17T02:20:46.247 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.247 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.247 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:46.248 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588373+0000", 2024-09-17T02:20:46.248 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7973000000000005e-05 2024-09-17T02:20:46.248 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.248 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:46.248 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.248 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.248 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.248 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:46.248 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:20:46.248 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.656804860000001, 2024-09-17T02:20:46.248 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031950544999999997, 2024-09-17T02:20:46.248 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:46.248 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:46.249 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.249 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:46.249 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.249 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:46.249 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:20:46.249 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.249 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.249 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.249 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:46.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:20:46.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.250 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.250 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:46.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556623+0000", 2024-09-17T02:20:46.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.04e-06 2024-09-17T02:20:46.250 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.250 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:46.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556631+0000", 2024-09-17T02:20:46.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1529999999999997e-06 2024-09-17T02:20:46.250 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.251 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:46.251 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556648+0000", 2024-09-17T02:20:46.251 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6583999999999999e-05 2024-09-17T02:20:46.251 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.251 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.251 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556661+0000", 2024-09-17T02:20:46.251 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3203e-05 2024-09-17T02:20:46.251 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.251 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:46.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564413+0000", 2024-09-17T02:20:46.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0077523100000000001 2024-09-17T02:20:46.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.252 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.252 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:46.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.565841+0000", 2024-09-17T02:20:46.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014276320000000001 2024-09-17T02:20:46.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.252 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.252 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:46.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.566131+0000", 2024-09-17T02:20:46.253 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029043800000000001 2024-09-17T02:20:46.253 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.253 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.253 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:46.253 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572353+0000", 2024-09-17T02:20:46.253 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.006222399 2024-09-17T02:20:46.253 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.253 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.253 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.253 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588452+0000", 2024-09-17T02:20:46.253 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016098635 2024-09-17T02:20:46.253 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.253 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.254 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:46.254 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588520+0000", 2024-09-17T02:20:46.254 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8040000000000006e-05 2024-09-17T02:20:46.254 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.254 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.254 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:46.254 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588572+0000", 2024-09-17T02:20:46.254 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2111000000000003e-05 2024-09-17T02:20:46.254 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.254 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:46.254 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.254 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.254 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.255 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:46.255 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:20:46.255 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.656707694000001, 2024-09-17T02:20:46.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.032187205000000003, 2024-09-17T02:20:46.255 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:46.255 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:46.255 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.255 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:46.255 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.255 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:46.255 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:20:46.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.256 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.256 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:46.256 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:20:46.256 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.256 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.256 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:46.256 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556727+0000", 2024-09-17T02:20:46.256 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3000000000000002e-06 2024-09-17T02:20:46.256 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:46.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556736+0000", 2024-09-17T02:20:46.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4300000000000006e-06 2024-09-17T02:20:46.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:46.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556755+0000", 2024-09-17T02:20:46.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9700000000000001e-05 2024-09-17T02:20:46.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556771+0000", 2024-09-17T02:20:46.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5213e-05 2024-09-17T02:20:46.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.258 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.258 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:46.258 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571184+0000", 2024-09-17T02:20:46.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014413888999999999 2024-09-17T02:20:46.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.258 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.258 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:46.258 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571302+0000", 2024-09-17T02:20:46.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011794900000000001 2024-09-17T02:20:46.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.258 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.258 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:46.259 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571494+0000", 2024-09-17T02:20:46.259 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000191168 2024-09-17T02:20:46.259 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.259 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.259 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:46.259 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.573775+0000", 2024-09-17T02:20:46.259 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002281656 2024-09-17T02:20:46.259 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.259 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.259 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.259 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588668+0000", 2024-09-17T02:20:46.259 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014892699000000001 2024-09-17T02:20:46.259 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.260 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:46.260 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588813+0000", 2024-09-17T02:20:46.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014530700000000001 2024-09-17T02:20:46.260 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.260 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:46.260 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588906+0000", 2024-09-17T02:20:46.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2893999999999995e-05 2024-09-17T02:20:46.260 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.260 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:46.260 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.261 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.261 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.261 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:46.261 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:20:46.261 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.656566528999999, 2024-09-17T02:20:46.261 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028815922000000001, 2024-09-17T02:20:46.261 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:46.261 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:46.261 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.261 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:46.261 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.261 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:46.261 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:20:46.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.262 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.262 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:46.262 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:20:46.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.262 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.262 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:46.262 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556861+0000", 2024-09-17T02:20:46.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.08e-06 2024-09-17T02:20:46.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.262 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.262 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:46.262 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556867+0000", 2024-09-17T02:20:46.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.207e-06 2024-09-17T02:20:46.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.263 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:46.263 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556886+0000", 2024-09-17T02:20:46.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9137e-05 2024-09-17T02:20:46.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.263 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.263 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556900+0000", 2024-09-17T02:20:46.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3253e-05 2024-09-17T02:20:46.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.264 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:46.264 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558301+0000", 2024-09-17T02:20:46.264 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014008320000000001 2024-09-17T02:20:46.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.264 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:46.264 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558564+0000", 2024-09-17T02:20:46.264 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000263238 2024-09-17T02:20:46.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.264 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:46.264 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558905+0000", 2024-09-17T02:20:46.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000341534 2024-09-17T02:20:46.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.265 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:46.265 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.568208+0000", 2024-09-17T02:20:46.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0093023689999999996 2024-09-17T02:20:46.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.265 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.265 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585379+0000", 2024-09-17T02:20:46.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017171091999999999 2024-09-17T02:20:46.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:46.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585509+0000", 2024-09-17T02:20:46.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013036100000000001 2024-09-17T02:20:46.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:46.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585676+0000", 2024-09-17T02:20:46.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016681899999999999 2024-09-17T02:20:46.266 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.266 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:46.266 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.267 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:46.267 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:20:46.267 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.656509262, 2024-09-17T02:20:46.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030862568, 2024-09-17T02:20:46.267 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:46.267 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:46.267 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.267 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:46.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.267 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:46.267 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:20:46.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:46.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:20:46.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:46.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556918+0000", 2024-09-17T02:20:46.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0529999999999999e-06 2024-09-17T02:20:46.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:46.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556925+0000", 2024-09-17T02:20:46.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.6939999999999998e-06 2024-09-17T02:20:46.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:46.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556942+0000", 2024-09-17T02:20:46.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6803000000000002e-05 2024-09-17T02:20:46.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556955+0000", 2024-09-17T02:20:46.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2659e-05 2024-09-17T02:20:46.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:46.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558237+0000", 2024-09-17T02:20:46.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001282804 2024-09-17T02:20:46.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:46.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558495+0000", 2024-09-17T02:20:46.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000257178 2024-09-17T02:20:46.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:46.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562168+0000", 2024-09-17T02:20:46.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0036737110000000001 2024-09-17T02:20:46.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:46.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.570855+0000", 2024-09-17T02:20:46.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0086868729999999995 2024-09-17T02:20:46.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587568+0000", 2024-09-17T02:20:46.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016712444999999999 2024-09-17T02:20:46.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:46.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587677+0000", 2024-09-17T02:20:46.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000109879 2024-09-17T02:20:46.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:46.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587780+0000", 2024-09-17T02:20:46.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000102469 2024-09-17T02:20:46.272 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.272 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:46.272 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.273 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:46.273 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:20:46.273 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.656427130000001, 2024-09-17T02:20:46.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031005751000000002, 2024-09-17T02:20:46.273 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:46.273 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:46.273 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.273 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:46.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.273 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:46.273 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:20:46.274 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.274 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.274 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:46.274 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:20:46.274 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.274 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.274 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:46.274 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557001+0000", 2024-09-17T02:20:46.274 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.237e-06 2024-09-17T02:20:46.274 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:46.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557007+0000", 2024-09-17T02:20:46.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7270000000000001e-06 2024-09-17T02:20:46.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:46.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557025+0000", 2024-09-17T02:20:46.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7689999999999998e-05 2024-09-17T02:20:46.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557039+0000", 2024-09-17T02:20:46.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.385e-05 2024-09-17T02:20:46.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:46.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563783+0000", 2024-09-17T02:20:46.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0067437110000000003 2024-09-17T02:20:46.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:46.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564031+0000", 2024-09-17T02:20:46.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00024871799999999999 2024-09-17T02:20:46.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:46.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564518+0000", 2024-09-17T02:20:46.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00048708999999999997 2024-09-17T02:20:46.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:46.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572375+0000", 2024-09-17T02:20:46.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078564780000000001 2024-09-17T02:20:46.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587862+0000", 2024-09-17T02:20:46.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015486837999999999 2024-09-17T02:20:46.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:46.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587954+0000", 2024-09-17T02:20:46.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1766000000000002e-05 2024-09-17T02:20:46.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:46.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588005+0000", 2024-09-17T02:20:46.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1646e-05 2024-09-17T02:20:46.279 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.279 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:46.279 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.279 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:46.279 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:20:46.279 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.656282833999999, 2024-09-17T02:20:46.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029554871999999999, 2024-09-17T02:20:46.279 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:46.279 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:46.279 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.280 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:46.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.280 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:46.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:20:46.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.280 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.280 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:46.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:20:46.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.280 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.281 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:46.281 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557145+0000", 2024-09-17T02:20:46.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.263e-06 2024-09-17T02:20:46.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.281 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:46.281 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557151+0000", 2024-09-17T02:20:46.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1040000000000003e-06 2024-09-17T02:20:46.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.281 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:46.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557168+0000", 2024-09-17T02:20:46.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7289999999999999e-05 2024-09-17T02:20:46.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557182+0000", 2024-09-17T02:20:46.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.325e-05 2024-09-17T02:20:46.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:46.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564102+0000", 2024-09-17T02:20:46.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069199860000000004 2024-09-17T02:20:46.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:46.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564438+0000", 2024-09-17T02:20:46.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033651800000000001 2024-09-17T02:20:46.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:46.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.565422+0000", 2024-09-17T02:20:46.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00098332499999999995 2024-09-17T02:20:46.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:46.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572361+0000", 2024-09-17T02:20:46.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069392630000000002 2024-09-17T02:20:46.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586567+0000", 2024-09-17T02:20:46.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014206107000000001 2024-09-17T02:20:46.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:46.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586643+0000", 2024-09-17T02:20:46.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5673000000000005e-05 2024-09-17T02:20:46.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:46.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586699+0000", 2024-09-17T02:20:46.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6093e-05 2024-09-17T02:20:46.285 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.285 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:46.285 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.285 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:46.285 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:20:46.285 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.656149142, 2024-09-17T02:20:46.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029800569999999998, 2024-09-17T02:20:46.285 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:46.285 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:46.286 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.286 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:46.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.286 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:46.286 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:20:46.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.286 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.286 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:46.286 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:20:46.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.286 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:46.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557279+0000", 2024-09-17T02:20:46.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.497e-06 2024-09-17T02:20:46.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:46.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557287+0000", 2024-09-17T02:20:46.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9030000000000004e-06 2024-09-17T02:20:46.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:46.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557306+0000", 2024-09-17T02:20:46.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9394000000000001e-05 2024-09-17T02:20:46.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557323+0000", 2024-09-17T02:20:46.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6299000000000001e-05 2024-09-17T02:20:46.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:46.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.570931+0000", 2024-09-17T02:20:46.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013608841999999999 2024-09-17T02:20:46.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:46.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571250+0000", 2024-09-17T02:20:46.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031817400000000001 2024-09-17T02:20:46.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:46.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571559+0000", 2024-09-17T02:20:46.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000309835 2024-09-17T02:20:46.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:46.290 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.574161+0000", 2024-09-17T02:20:46.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002601543 2024-09-17T02:20:46.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.290 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.290 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586866+0000", 2024-09-17T02:20:46.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012704968000000001 2024-09-17T02:20:46.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.290 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:46.290 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586987+0000", 2024-09-17T02:20:46.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000121369 2024-09-17T02:20:46.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:46.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587078+0000", 2024-09-17T02:20:46.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0746000000000002e-05 2024-09-17T02:20:46.291 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.291 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:46.291 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.291 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:46.291 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:20:46.291 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.656083499000001, 2024-09-17T02:20:46.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029936054, 2024-09-17T02:20:46.291 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:46.292 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:46.292 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.292 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:46.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:46.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:20:46.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:46.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:20:46.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:46.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557344+0000", 2024-09-17T02:20:46.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.347e-06 2024-09-17T02:20:46.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:46.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557351+0000", 2024-09-17T02:20:46.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5560000000000004e-06 2024-09-17T02:20:46.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:46.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557369+0000", 2024-09-17T02:20:46.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7703e-05 2024-09-17T02:20:46.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557382+0000", 2024-09-17T02:20:46.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3664e-05 2024-09-17T02:20:46.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:46.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558997+0000", 2024-09-17T02:20:46.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0016147970000000001 2024-09-17T02:20:46.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:46.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559236+0000", 2024-09-17T02:20:46.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00023900200000000001 2024-09-17T02:20:46.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:46.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559547+0000", 2024-09-17T02:20:46.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031132399999999998 2024-09-17T02:20:46.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:46.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563130+0000", 2024-09-17T02:20:46.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003582989 2024-09-17T02:20:46.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587069+0000", 2024-09-17T02:20:46.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023938496 2024-09-17T02:20:46.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:46.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587192+0000", 2024-09-17T02:20:46.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123514 2024-09-17T02:20:46.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:46.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587279+0000", 2024-09-17T02:20:46.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6662000000000005e-05 2024-09-17T02:20:46.297 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.297 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:46.297 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.297 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:46.297 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:20:46.298 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.656025613000001, 2024-09-17T02:20:46.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030490703000000001, 2024-09-17T02:20:46.298 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:46.298 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:46.298 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.298 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:46.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:46.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:20:46.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:46.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:20:46.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:46.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557403+0000", 2024-09-17T02:20:46.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.77e-06 2024-09-17T02:20:46.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:46.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557412+0000", 2024-09-17T02:20:46.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4099999999999997e-06 2024-09-17T02:20:46.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:46.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557431+0000", 2024-09-17T02:20:46.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9177e-05 2024-09-17T02:20:46.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557444+0000", 2024-09-17T02:20:46.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2999999999999999e-05 2024-09-17T02:20:46.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:46.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557722+0000", 2024-09-17T02:20:46.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00027760699999999997 2024-09-17T02:20:46.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:46.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557991+0000", 2024-09-17T02:20:46.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00026892499999999999 2024-09-17T02:20:46.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:46.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558265+0000", 2024-09-17T02:20:46.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000274524 2024-09-17T02:20:46.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:46.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564270+0000", 2024-09-17T02:20:46.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060045339999999997 2024-09-17T02:20:46.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587701+0000", 2024-09-17T02:20:46.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023431285999999999 2024-09-17T02:20:46.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:46.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587803+0000", 2024-09-17T02:20:46.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000101371 2024-09-17T02:20:46.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:46.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587892+0000", 2024-09-17T02:20:46.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9098999999999995e-05 2024-09-17T02:20:46.303 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.303 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:46.303 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.303 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:46.304 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:20:46.304 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.655944016999999, 2024-09-17T02:20:46.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029886725999999999, 2024-09-17T02:20:46.304 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:46.304 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:46.304 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:20:46.304 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:46.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:46.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:20:46.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:46.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:20:46.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:46.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557484+0000", 2024-09-17T02:20:46.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.26e-06 2024-09-17T02:20:46.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:46.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557489+0000", 2024-09-17T02:20:46.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2530000000000004e-06 2024-09-17T02:20:46.306 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:46.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557507+0000", 2024-09-17T02:20:46.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7473999999999999e-05 2024-09-17T02:20:46.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557524+0000", 2024-09-17T02:20:46.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7912999999999999e-05 2024-09-17T02:20:46.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:46.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572428+0000", 2024-09-17T02:20:46.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014903451999999999 2024-09-17T02:20:46.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:46.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572589+0000", 2024-09-17T02:20:46.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000161299 2024-09-17T02:20:46.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:46.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587369+0000", 2024-09-17T02:20:46.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014780075 2024-09-17T02:20:46.308 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.308 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:46.308 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.309 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28720 5.f 5:f8a7aea5:::benchmark_data_smithi001_23533_object28719:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:46.309 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:20:46.309 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 3.645639702, 2024-09-17T02:20:46.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.033978608, 2024-09-17T02:20:46.309 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:46.309 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:46.309 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.309 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:46.309 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:46.309 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:46.309 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28720 2024-09-17T02:20:46.310 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.310 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:46.310 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.310 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:46.310 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:20:46.310 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.310 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.310 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.310 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:46.310 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:20:46.310 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.310 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.310 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.310 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:46.311 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:20:46.311 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3200000000000005e-07 2024-09-17T02:20:46.311 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.311 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:46.311 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567856+0000", 2024-09-17T02:20:46.311 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8596000000000005e-05 2024-09-17T02:20:46.311 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.311 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:46.311 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567864+0000", 2024-09-17T02:20:46.311 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6040000000000004e-06 2024-09-17T02:20:46.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.312 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.312 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567867+0000", 2024-09-17T02:20:46.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7929999999999999e-06 2024-09-17T02:20:46.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.312 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:46.312 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567896+0000", 2024-09-17T02:20:46.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8444000000000001e-05 2024-09-17T02:20:46.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.312 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:46.313 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567983+0000", 2024-09-17T02:20:46.313 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7498999999999997e-05 2024-09-17T02:20:46.313 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.313 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.313 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:46.313 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568078+0000", 2024-09-17T02:20:46.313 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5050999999999995e-05 2024-09-17T02:20:46.313 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.313 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.313 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:46.313 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573091+0000", 2024-09-17T02:20:46.313 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050124599999999998 2024-09-17T02:20:46.313 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.314 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601705+0000", 2024-09-17T02:20:46.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028614298999999999 2024-09-17T02:20:46.314 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:46.314 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601741+0000", 2024-09-17T02:20:46.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5329e-05 2024-09-17T02:20:46.314 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:46.314 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601766+0000", 2024-09-17T02:20:46.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5001e-05 2024-09-17T02:20:46.315 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.315 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:46.315 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.315 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28723 5.f 5:f1a2a8f6:::benchmark_data_smithi001_23533_object28722:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:46.315 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:20:46.315 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 3.6453610219999999, 2024-09-17T02:20:46.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.033805288000000003, 2024-09-17T02:20:46.315 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:46.315 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:46.315 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.315 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:46.316 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:46.316 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:46.316 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28723 2024-09-17T02:20:46.316 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.316 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:46.316 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.316 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:46.316 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:20:46.316 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.316 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.316 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.316 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:46.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:20:46.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:46.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568067+0000", 2024-09-17T02:20:46.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6700000000000002e-07 2024-09-17T02:20:46.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:46.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568121+0000", 2024-09-17T02:20:46.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4286000000000002e-05 2024-09-17T02:20:46.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.318 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:46.318 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568131+0000", 2024-09-17T02:20:46.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0288e-05 2024-09-17T02:20:46.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.318 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.318 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568139+0000", 2024-09-17T02:20:46.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5399999999999998e-06 2024-09-17T02:20:46.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.318 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:46.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569194+0000", 2024-09-17T02:20:46.319 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0010557100000000001 2024-09-17T02:20:46.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.319 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.319 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:46.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569298+0000", 2024-09-17T02:20:46.319 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000103491 2024-09-17T02:20:46.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.319 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.319 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:46.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569428+0000", 2024-09-17T02:20:46.319 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013050599999999999 2024-09-17T02:20:46.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.320 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.320 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:46.320 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573124+0000", 2024-09-17T02:20:46.320 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0036956810000000001 2024-09-17T02:20:46.320 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.320 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.320 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.320 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601801+0000", 2024-09-17T02:20:46.320 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028676667999999999 2024-09-17T02:20:46.320 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.320 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.320 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:46.321 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601835+0000", 2024-09-17T02:20:46.321 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4347000000000002e-05 2024-09-17T02:20:46.321 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.321 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.321 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:46.321 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601871+0000", 2024-09-17T02:20:46.321 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5803999999999998e-05 2024-09-17T02:20:46.321 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.321 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:46.321 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.322 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.322 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.322 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28729 5.9 5:9e3b1489:::benchmark_data_smithi001_23533_object28728:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:46.322 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:20:46.322 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 3.6437423710000001, 2024-09-17T02:20:46.322 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.032738525999999997, 2024-09-17T02:20:46.322 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:46.324 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:46.324 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.324 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:46.324 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:46.324 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:46.324 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28729 2024-09-17T02:20:46.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.324 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:46.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:46.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:20:46.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.325 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:46.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:20:46.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.325 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:46.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569685+0000", 2024-09-17T02:20:46.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8599999999999996e-07 2024-09-17T02:20:46.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.325 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:46.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569725+0000", 2024-09-17T02:20:46.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0144000000000001e-05 2024-09-17T02:20:46.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.326 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:46.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569737+0000", 2024-09-17T02:20:46.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1752e-05 2024-09-17T02:20:46.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.326 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569745+0000", 2024-09-17T02:20:46.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6420000000000007e-06 2024-09-17T02:20:46.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:46.327 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569801+0000", 2024-09-17T02:20:46.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6110000000000003e-05 2024-09-17T02:20:46.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:46.327 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569944+0000", 2024-09-17T02:20:46.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014361500000000001 2024-09-17T02:20:46.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:46.327 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.570234+0000", 2024-09-17T02:20:46.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00028927899999999998 2024-09-17T02:20:46.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.328 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:46.328 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572606+0000", 2024-09-17T02:20:46.328 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023725529999999999 2024-09-17T02:20:46.328 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.328 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.328 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602361+0000", 2024-09-17T02:20:46.328 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029755031000000001 2024-09-17T02:20:46.328 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.328 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:46.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602397+0000", 2024-09-17T02:20:46.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5509000000000002e-05 2024-09-17T02:20:46.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.329 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:46.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602423+0000", 2024-09-17T02:20:46.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5905e-05 2024-09-17T02:20:46.329 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.329 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:46.329 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.329 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28734 5.f 5:f1a63647:::benchmark_data_smithi001_23533_object28733:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:46.330 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:20:46.330 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 3.6420198849999998, 2024-09-17T02:20:46.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.034441100000000002, 2024-09-17T02:20:46.330 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:46.330 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:46.330 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.330 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:46.330 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:46.330 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:46.330 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28734 2024-09-17T02:20:46.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.330 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:46.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:46.331 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:20:46.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.331 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:46.331 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:20:46.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:46.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.331 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:46.331 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571408+0000", 2024-09-17T02:20:46.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.8899999999999998e-07 2024-09-17T02:20:46.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.332 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.332 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:46.332 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571464+0000", 2024-09-17T02:20:46.332 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6546999999999999e-05 2024-09-17T02:20:46.332 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.332 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.332 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:46.332 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571474+0000", 2024-09-17T02:20:46.332 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0348e-05 2024-09-17T02:20:46.332 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.332 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.332 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.333 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571480+0000", 2024-09-17T02:20:46.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.366e-06 2024-09-17T02:20:46.333 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.333 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:46.333 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572097+0000", 2024-09-17T02:20:46.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061710599999999997 2024-09-17T02:20:46.333 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.333 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:46.334 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572172+0000", 2024-09-17T02:20:46.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4658000000000002e-05 2024-09-17T02:20:46.334 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.334 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.334 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:46.334 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572247+0000", 2024-09-17T02:20:46.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5766000000000006e-05 2024-09-17T02:20:46.334 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.334 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.334 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:46.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573819+0000", 2024-09-17T02:20:46.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015713649999999999 2024-09-17T02:20:46.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605762+0000", 2024-09-17T02:20:46.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031943304999999998 2024-09-17T02:20:46.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:46.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605808+0000", 2024-09-17T02:20:46.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5776999999999999e-05 2024-09-17T02:20:46.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:46.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:46.336 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:46.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605848+0000", 2024-09-17T02:20:46.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9972999999999998e-05 2024-09-17T02:20:46.336 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.336 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:46.336 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.336 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:46.336 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:46.336 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:20:46.338 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:20:46.339 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:46.339+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:46.438 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:46.436+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:46.495 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:20:46.495 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:20:46.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.495 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:39309 5.e 5:76a0c2d1:::benchmark_data_smithi001_23533_object39308:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:46.495 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:46.499324+0000", 2024-09-17T02:20:46.495 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0021603149999999999, 2024-09-17T02:20:46.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002190483, 2024-09-17T02:20:46.495 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:46.495 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:46.495 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:46.495 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:46.496 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:46.496 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:46.496 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 39309 2024-09-17T02:20:46.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.496 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:46.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:46.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.499324+0000", 2024-09-17T02:20:46.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:46.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.499324+0000", 2024-09-17T02:20:46.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:46.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.499325+0000", 2024-09-17T02:20:46.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7700000000000004e-07 2024-09-17T02:20:46.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:46.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.499506+0000", 2024-09-17T02:20:46.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018088499999999999 2024-09-17T02:20:46.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:46.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.499515+0000", 2024-09-17T02:20:46.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5950000000000005e-06 2024-09-17T02:20:46.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.499522+0000", 2024-09-17T02:20:46.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4860000000000002e-06 2024-09-17T02:20:46.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.499566+0000", 2024-09-17T02:20:46.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3711999999999998e-05 2024-09-17T02:20:46.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:46.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.499662+0000", 2024-09-17T02:20:46.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6904999999999995e-05 2024-09-17T02:20:46.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:46.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.499748+0000", 2024-09-17T02:20:46.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5309999999999995e-05 2024-09-17T02:20:46.499 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.499 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:46.499 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.500 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:39313 5.b 5:d2126182:::benchmark_data_smithi001_23533_object39312:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:46.500 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:46.499680+0000", 2024-09-17T02:20:46.500 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00180437, 2024-09-17T02:20:46.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019244069999999999, 2024-09-17T02:20:46.500 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:46.500 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:46.500 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:46.500 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:46.500 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:46.501 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:46.501 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 39313 2024-09-17T02:20:46.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.501 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:46.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:46.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.499680+0000", 2024-09-17T02:20:46.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:46.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.499680+0000", 2024-09-17T02:20:46.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:46.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.499681+0000", 2024-09-17T02:20:46.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9599999999999999e-07 2024-09-17T02:20:46.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:46.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.499764+0000", 2024-09-17T02:20:46.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3154999999999999e-05 2024-09-17T02:20:46.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:46.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.499774+0000", 2024-09-17T02:20:46.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0338e-05 2024-09-17T02:20:46.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.499781+0000", 2024-09-17T02:20:46.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5370000000000003e-06 2024-09-17T02:20:46.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.499838+0000", 2024-09-17T02:20:46.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7046999999999998e-05 2024-09-17T02:20:46.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:46.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.499969+0000", 2024-09-17T02:20:46.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013173500000000001 2024-09-17T02:20:46.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:46.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.500096+0000", 2024-09-17T02:20:46.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012679400000000001 2024-09-17T02:20:46.504 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.504 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:46.504 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.505 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:39311 5.8 e30/26 5:14ab1e89:::benchmark_data_smithi001_23533_object39310:head v 30'2492, mlcod=30'2490)", 2024-09-17T02:20:46.505 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:46.499975+0000", 2024-09-17T02:20:46.505 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0015098729999999999, 2024-09-17T02:20:46.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00171499, 2024-09-17T02:20:46.505 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:46.505 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:46.505 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:46.505 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:46.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:46.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.499975+0000", 2024-09-17T02:20:46.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:46.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.499975+0000", 2024-09-17T02:20:46.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:46.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.499975+0000", 2024-09-17T02:20:46.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5899999999999995e-07 2024-09-17T02:20:46.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:46.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.500068+0000", 2024-09-17T02:20:46.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2458000000000001e-05 2024-09-17T02:20:46.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:46.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.500076+0000", 2024-09-17T02:20:46.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.388e-06 2024-09-17T02:20:46.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.500082+0000", 2024-09-17T02:20:46.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9460000000000003e-06 2024-09-17T02:20:46.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.500135+0000", 2024-09-17T02:20:46.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2750000000000001e-05 2024-09-17T02:20:46.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:46.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.500156+0000", 2024-09-17T02:20:46.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0956999999999999e-05 2024-09-17T02:20:46.509 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.509 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:46.509 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.509 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:39310 5.f e30/22 5:f0cfa29d:::benchmark_data_smithi001_23533_object39309:head v 30'2417, mlcod=30'2415)", 2024-09-17T02:20:46.509 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:46.500096+0000", 2024-09-17T02:20:46.509 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0013883319999999999, 2024-09-17T02:20:46.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016545939999999999, 2024-09-17T02:20:46.510 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:46.510 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:46.510 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:46.510 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:46.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:46.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.500096+0000", 2024-09-17T02:20:46.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:46.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.500096+0000", 2024-09-17T02:20:46.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:46.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.500097+0000", 2024-09-17T02:20:46.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0100000000000004e-07 2024-09-17T02:20:46.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:46.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.500184+0000", 2024-09-17T02:20:46.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6879000000000006e-05 2024-09-17T02:20:46.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:46.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.500198+0000", 2024-09-17T02:20:46.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4202000000000001e-05 2024-09-17T02:20:46.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.500202+0000", 2024-09-17T02:20:46.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.25e-06 2024-09-17T02:20:46.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.500272+0000", 2024-09-17T02:20:46.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0124999999999997e-05 2024-09-17T02:20:46.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:46.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.500289+0000", 2024-09-17T02:20:46.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6447e-05 2024-09-17T02:20:46.513 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.513 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:46.513 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.513 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:39314 5.0 e30/26 5:0acacddf:::benchmark_data_smithi001_23533_object39313:head v 30'2387, mlcod=30'2385)", 2024-09-17T02:20:46.514 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:46.500677+0000", 2024-09-17T02:20:46.514 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00080728799999999997, 2024-09-17T02:20:46.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011393239999999999, 2024-09-17T02:20:46.514 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:46.514 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:46.514 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:46.514 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:46.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:46.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.500677+0000", 2024-09-17T02:20:46.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:46.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.500677+0000", 2024-09-17T02:20:46.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:46.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.500678+0000", 2024-09-17T02:20:46.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.47e-07 2024-09-17T02:20:46.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:46.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.500725+0000", 2024-09-17T02:20:46.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6575e-05 2024-09-17T02:20:46.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:46.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.500739+0000", 2024-09-17T02:20:46.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4021e-05 2024-09-17T02:20:46.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.500746+0000", 2024-09-17T02:20:46.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4019999999999996e-06 2024-09-17T02:20:46.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.501441+0000", 2024-09-17T02:20:46.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000695015 2024-09-17T02:20:46.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:46.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:46.501461+0000", 2024-09-17T02:20:46.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9919e-05 2024-09-17T02:20:46.517 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.517 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:46.517 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.517 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.517 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:20:46.518 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 5 2024-09-17T02:20:46.518 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:20:46.519 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:20:46.562 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:46.567+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:46.641 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:46.640+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:46.673 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:20:46.673 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:20:46.673 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:20:46.673 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:20:46.673 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:20:46.694 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:20:46.742 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:46.743+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:46.769 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 14 15 40028 40013 178.61 168 0.00919614 0.00559392 2024-09-17T02:20:46.845 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:46.847+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:46.893 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:20:46.894 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:20:46.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:20:46.894 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:20:46.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.894 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:46.894 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:20:46.894 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.342313421, 2024-09-17T02:20:46.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035535028000000003, 2024-09-17T02:20:46.894 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:46.894 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:46.894 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.894 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:46.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:46.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:20:46.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:46.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:20:46.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:46.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556550+0000", 2024-09-17T02:20:46.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3500000000000001e-06 2024-09-17T02:20:46.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:46.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556566+0000", 2024-09-17T02:20:46.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5440000000000001e-05 2024-09-17T02:20:46.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:46.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556594+0000", 2024-09-17T02:20:46.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8552999999999999e-05 2024-09-17T02:20:46.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556618+0000", 2024-09-17T02:20:46.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3207e-05 2024-09-17T02:20:46.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578337+0000", 2024-09-17T02:20:46.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021719517000000001 2024-09-17T02:20:46.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:46.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578655+0000", 2024-09-17T02:20:46.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031837800000000002 2024-09-17T02:20:46.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:46.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.581374+0000", 2024-09-17T02:20:46.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002718238 2024-09-17T02:20:46.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:46.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587083+0000", 2024-09-17T02:20:46.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005708912 2024-09-17T02:20:46.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591823+0000", 2024-09-17T02:20:46.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047406080000000003 2024-09-17T02:20:46.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:46.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591972+0000", 2024-09-17T02:20:46.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014874199999999999 2024-09-17T02:20:46.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:46.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592082+0000", 2024-09-17T02:20:46.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110083 2024-09-17T02:20:46.899 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.899 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:46.899 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.900 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:46.900 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:20:46.900 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.341371934000001, 2024-09-17T02:20:46.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035128756999999997, 2024-09-17T02:20:46.900 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:46.900 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:46.900 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.900 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:46.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:46.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:20:46.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:46.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:20:46.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:46.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557491+0000", 2024-09-17T02:20:46.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.88e-06 2024-09-17T02:20:46.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:46.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557504+0000", 2024-09-17T02:20:46.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2864000000000001e-05 2024-09-17T02:20:46.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:46.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557535+0000", 2024-09-17T02:20:46.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0916e-05 2024-09-17T02:20:46.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557561+0000", 2024-09-17T02:20:46.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5602999999999999e-05 2024-09-17T02:20:46.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582290+0000", 2024-09-17T02:20:46.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024729729999999998 2024-09-17T02:20:46.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:46.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582642+0000", 2024-09-17T02:20:46.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035143499999999999 2024-09-17T02:20:46.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:46.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582959+0000", 2024-09-17T02:20:46.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031747399999999999 2024-09-17T02:20:46.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:46.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587302+0000", 2024-09-17T02:20:46.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043425169999999997 2024-09-17T02:20:46.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592391+0000", 2024-09-17T02:20:46.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050895799999999998 2024-09-17T02:20:46.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:46.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592516+0000", 2024-09-17T02:20:46.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012420500000000001 2024-09-17T02:20:46.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:46.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592617+0000", 2024-09-17T02:20:46.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010155299999999999 2024-09-17T02:20:46.906 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.906 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:46.906 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.906 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:46.906 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:20:46.906 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.341267434999999, 2024-09-17T02:20:46.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034796066, 2024-09-17T02:20:46.906 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:46.906 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:46.907 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.907 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:46.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:46.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:20:46.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:46.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:20:46.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:46.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557594+0000", 2024-09-17T02:20:46.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3769999999999999e-06 2024-09-17T02:20:46.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:46.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557683+0000", 2024-09-17T02:20:46.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8896999999999999e-05 2024-09-17T02:20:46.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:46.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557707+0000", 2024-09-17T02:20:46.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3839e-05 2024-09-17T02:20:46.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557730+0000", 2024-09-17T02:20:46.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3047000000000001e-05 2024-09-17T02:20:46.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582329+0000", 2024-09-17T02:20:46.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024599283999999999 2024-09-17T02:20:46.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:46.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582624+0000", 2024-09-17T02:20:46.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000294462 2024-09-17T02:20:46.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:46.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582936+0000", 2024-09-17T02:20:46.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031223399999999999 2024-09-17T02:20:46.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:46.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587347+0000", 2024-09-17T02:20:46.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044110340000000003 2024-09-17T02:20:46.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592165+0000", 2024-09-17T02:20:46.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048176699999999996 2024-09-17T02:20:46.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:46.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592311+0000", 2024-09-17T02:20:46.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014661899999999999 2024-09-17T02:20:46.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:46.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592389+0000", 2024-09-17T02:20:46.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7602999999999995e-05 2024-09-17T02:20:46.911 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.912 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:46.912 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.912 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:46.912 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:20:46.912 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.340749807999998, 2024-09-17T02:20:46.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034457472000000003, 2024-09-17T02:20:46.912 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:46.912 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:46.912 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.912 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:46.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:46.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:20:46.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:46.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:20:46.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:46.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558113+0000", 2024-09-17T02:20:46.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1639999999999999e-06 2024-09-17T02:20:46.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:46.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558125+0000", 2024-09-17T02:20:46.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2269999999999999e-05 2024-09-17T02:20:46.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:46.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558458+0000", 2024-09-17T02:20:46.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033322700000000001 2024-09-17T02:20:46.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558488+0000", 2024-09-17T02:20:46.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.951e-05 2024-09-17T02:20:46.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584514+0000", 2024-09-17T02:20:46.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026025721000000002 2024-09-17T02:20:46.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:46.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584781+0000", 2024-09-17T02:20:46.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000267142 2024-09-17T02:20:46.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:46.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585078+0000", 2024-09-17T02:20:46.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029738799999999999 2024-09-17T02:20:46.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:46.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588045+0000", 2024-09-17T02:20:46.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029673759999999999 2024-09-17T02:20:46.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592454+0000", 2024-09-17T02:20:46.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044090209999999999 2024-09-17T02:20:46.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:46.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592520+0000", 2024-09-17T02:20:46.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6032999999999996e-05 2024-09-17T02:20:46.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:46.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592568+0000", 2024-09-17T02:20:46.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7620000000000001e-05 2024-09-17T02:20:46.917 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.917 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:46.917 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.918 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:46.918 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:20:46.918 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.340289556999998, 2024-09-17T02:20:46.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031603266999999997, 2024-09-17T02:20:46.918 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:46.918 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:46.918 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.918 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:46.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:46.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:20:46.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:46.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:20:46.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:46.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558573+0000", 2024-09-17T02:20:46.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0660000000000002e-06 2024-09-17T02:20:46.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:46.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558585+0000", 2024-09-17T02:20:46.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1596999999999999e-05 2024-09-17T02:20:46.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:46.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558612+0000", 2024-09-17T02:20:46.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7115999999999999e-05 2024-09-17T02:20:46.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558631+0000", 2024-09-17T02:20:46.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9519999999999999e-05 2024-09-17T02:20:46.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558783+0000", 2024-09-17T02:20:46.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152025 2024-09-17T02:20:46.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-17T02:20:46.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558798+0000", 2024-09-17T02:20:46.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4966999999999999e-05 2024-09-17T02:20:46.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.572871+0000", 2024-09-17T02:20:46.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014072782000000001 2024-09-17T02:20:46.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:46.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573153+0000", 2024-09-17T02:20:46.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028214499999999998 2024-09-17T02:20:46.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:46.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573432+0000", 2024-09-17T02:20:46.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027932100000000002 2024-09-17T02:20:46.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:46.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582279+0000", 2024-09-17T02:20:46.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0088463310000000007 2024-09-17T02:20:46.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.589902+0000", 2024-09-17T02:20:46.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0076236050000000003 2024-09-17T02:20:46.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:46.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.589997+0000", 2024-09-17T02:20:46.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4456000000000005e-05 2024-09-17T02:20:46.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:46.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590174+0000", 2024-09-17T02:20:46.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000177336 2024-09-17T02:20:46.923 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.923 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:46.923 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.924 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:46.924 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:20:46.924 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.340186312, 2024-09-17T02:20:46.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031899064999999997, 2024-09-17T02:20:46.924 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:46.924 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:46.924 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.924 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:46.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:46.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:20:46.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:46.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:20:46.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:46.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558676+0000", 2024-09-17T02:20:46.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.39e-06 2024-09-17T02:20:46.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:46.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558686+0000", 2024-09-17T02:20:46.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.022e-05 2024-09-17T02:20:46.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:46.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558708+0000", 2024-09-17T02:20:46.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2249999999999999e-05 2024-09-17T02:20:46.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558725+0000", 2024-09-17T02:20:46.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7387000000000001e-05 2024-09-17T02:20:46.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558940+0000", 2024-09-17T02:20:46.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021453800000000001 2024-09-17T02:20:46.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting_for_map not empty", 2024-09-17T02:20:46.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558951+0000", 2024-09-17T02:20:46.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1303e-05 2024-09-17T02:20:46.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576237+0000", 2024-09-17T02:20:46.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017285723999999999 2024-09-17T02:20:46.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:46.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576454+0000", 2024-09-17T02:20:46.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021673800000000001 2024-09-17T02:20:46.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:46.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576932+0000", 2024-09-17T02:20:46.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047792700000000001 2024-09-17T02:20:46.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:46.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585689+0000", 2024-09-17T02:20:46.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0087572880000000002 2024-09-17T02:20:46.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590287+0000", 2024-09-17T02:20:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045978060000000003 2024-09-17T02:20:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590447+0000", 2024-09-17T02:20:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000160719 2024-09-17T02:20:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590573+0000", 2024-09-17T02:20:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012577500000000001 2024-09-17T02:20:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:20:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.340108342000001, 2024-09-17T02:20:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034114029999999997, 2024-09-17T02:20:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:20:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:20:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558753+0000", 2024-09-17T02:20:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2699999999999999e-06 2024-09-17T02:20:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:46.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558769+0000", 2024-09-17T02:20:46.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5906e-05 2024-09-17T02:20:46.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:46.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558791+0000", 2024-09-17T02:20:46.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1342999999999999e-05 2024-09-17T02:20:46.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558806+0000", 2024-09-17T02:20:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5829999999999999e-05 2024-09-17T02:20:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584906+0000", 2024-09-17T02:20:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026099273999999999 2024-09-17T02:20:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585158+0000", 2024-09-17T02:20:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025194600000000002 2024-09-17T02:20:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585368+0000", 2024-09-17T02:20:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210068 2024-09-17T02:20:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588098+0000", 2024-09-17T02:20:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002730522 2024-09-17T02:20:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592680+0000", 2024-09-17T02:20:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045816019999999997 2024-09-17T02:20:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592774+0000", 2024-09-17T02:20:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3726000000000004e-05 2024-09-17T02:20:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592866+0000", 2024-09-17T02:20:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2542999999999998e-05 2024-09-17T02:20:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.936 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:46.936 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:20:46.936 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.340032039, 2024-09-17T02:20:46.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031407875000000002, 2024-09-17T02:20:46.936 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:46.936 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:46.936 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:46.936 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:46.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:46.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:20:46.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:20:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558830+0000", 2024-09-17T02:20:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3599999999999999e-06 2024-09-17T02:20:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558835+0000", 2024-09-17T02:20:46.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6130000000000003e-06 2024-09-17T02:20:46.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:46.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558853+0000", 2024-09-17T02:20:46.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8099999999999999e-05 2024-09-17T02:20:46.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558869+0000", 2024-09-17T02:20:46.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.59e-05 2024-09-17T02:20:46.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560437+0000", 2024-09-17T02:20:46.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015677989999999999 2024-09-17T02:20:46.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-17T02:20:46.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560453+0000", 2024-09-17T02:20:46.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.535e-05 2024-09-17T02:20:46.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562422+0000", 2024-09-17T02:20:46.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00196934 2024-09-17T02:20:46.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:46.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562773+0000", 2024-09-17T02:20:46.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035152399999999998 2024-09-17T02:20:46.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:46.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590236+0000", 2024-09-17T02:20:46.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.027462889000000001 2024-09-17T02:20:46.940 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.940 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:46.940 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.941 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:6 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'1, mlcod=0'0)", 2024-09-17T02:20:46.941 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.559725+0000", 2024-09-17T02:20:46.941 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.339135041999999, 2024-09-17T02:20:46.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015153534999999999, 2024-09-17T02:20:46.941 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:46.941 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:46.941 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.941 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:46.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:46.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559725+0000", 2024-09-17T02:20:46.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:46.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559725+0000", 2024-09-17T02:20:46.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:46.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559726+0000", 2024-09-17T02:20:46.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1699999999999997e-07 2024-09-17T02:20:46.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:46.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559736+0000", 2024-09-17T02:20:46.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8360000000000004e-06 2024-09-17T02:20:46.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:46.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559760+0000", 2024-09-17T02:20:46.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4130000000000001e-05 2024-09-17T02:20:46.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559778+0000", 2024-09-17T02:20:46.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7623000000000001e-05 2024-09-17T02:20:46.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.561459+0000", 2024-09-17T02:20:46.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001681552 2024-09-17T02:20:46.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:46.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.561506+0000", 2024-09-17T02:20:46.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6260000000000001e-05 2024-09-17T02:20:46.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:46.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.574779+0000", 2024-09-17T02:20:46.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013273691000000001 2024-09-17T02:20:46.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:46.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.574879+0000", 2024-09-17T02:20:46.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9625999999999998e-05 2024-09-17T02:20:46.945 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.945 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:46.945 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.945 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:46.945 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.560079+0000", 2024-09-17T02:20:46.945 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.338781544, 2024-09-17T02:20:46.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016073831, 2024-09-17T02:20:46.945 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:46.946 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:46.946 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:46.946 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:46.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:46.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560079+0000", 2024-09-17T02:20:46.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:46.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560079+0000", 2024-09-17T02:20:46.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:46.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560081+0000", 2024-09-17T02:20:46.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.266e-06 2024-09-17T02:20:46.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:46.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560090+0000", 2024-09-17T02:20:46.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2129999999999997e-06 2024-09-17T02:20:46.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:46.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560119+0000", 2024-09-17T02:20:46.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8932999999999999e-05 2024-09-17T02:20:46.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560145+0000", 2024-09-17T02:20:46.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6020000000000002e-05 2024-09-17T02:20:46.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.561833+0000", 2024-09-17T02:20:46.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016875659999999999 2024-09-17T02:20:46.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:46.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562199+0000", 2024-09-17T02:20:46.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036619000000000002 2024-09-17T02:20:46.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:46.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576153+0000", 2024-09-17T02:20:46.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013953643 2024-09-17T02:20:46.949 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.949 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:46.949 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.949 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:18 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'1, mlcod=0'0)", 2024-09-17T02:20:46.950 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.567765+0000", 2024-09-17T02:20:46.950 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.331095478999998, 2024-09-17T02:20:46.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014868306, 2024-09-17T02:20:46.950 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:46.950 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:46.950 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.950 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:46.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:46.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.567765+0000", 2024-09-17T02:20:46.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:46.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.567765+0000", 2024-09-17T02:20:46.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:46.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.567766+0000", 2024-09-17T02:20:46.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.13e-06 2024-09-17T02:20:46.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:46.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.567811+0000", 2024-09-17T02:20:46.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5361999999999997e-05 2024-09-17T02:20:46.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:46.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.567867+0000", 2024-09-17T02:20:46.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5083000000000001e-05 2024-09-17T02:20:46.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.567885+0000", 2024-09-17T02:20:46.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8827000000000001e-05 2024-09-17T02:20:46.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570145+0000", 2024-09-17T02:20:46.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002259708 2024-09-17T02:20:46.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:46.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570187+0000", 2024-09-17T02:20:46.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2410000000000002e-05 2024-09-17T02:20:46.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:46.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582543+0000", 2024-09-17T02:20:46.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012356015999999999 2024-09-17T02:20:46.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:46.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582633+0000", 2024-09-17T02:20:46.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9770000000000003e-05 2024-09-17T02:20:46.954 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.954 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:46.954 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.954 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:24 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'1, mlcod=0'0)", 2024-09-17T02:20:46.954 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.568621+0000", 2024-09-17T02:20:46.954 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.330239442, 2024-09-17T02:20:46.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015593332, 2024-09-17T02:20:46.954 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:46.954 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:46.955 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.955 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:46.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:46.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568621+0000", 2024-09-17T02:20:46.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:46.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568621+0000", 2024-09-17T02:20:46.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:46.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568622+0000", 2024-09-17T02:20:46.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1570000000000001e-06 2024-09-17T02:20:46.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:46.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568633+0000", 2024-09-17T02:20:46.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1093e-05 2024-09-17T02:20:46.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:46.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568654+0000", 2024-09-17T02:20:46.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1132999999999999e-05 2024-09-17T02:20:46.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568670+0000", 2024-09-17T02:20:46.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5307000000000001e-05 2024-09-17T02:20:46.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570935+0000", 2024-09-17T02:20:46.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022651609999999999 2024-09-17T02:20:46.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:46.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570980+0000", 2024-09-17T02:20:46.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5170000000000003e-05 2024-09-17T02:20:46.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:46.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584128+0000", 2024-09-17T02:20:46.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013148388 2024-09-17T02:20:46.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:46.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584214+0000", 2024-09-17T02:20:46.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5922999999999997e-05 2024-09-17T02:20:46.958 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.958 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:46.958 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.959 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:25 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'2, mlcod=0'0)", 2024-09-17T02:20:46.959 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.568721+0000", 2024-09-17T02:20:46.959 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.330139526, 2024-09-17T02:20:46.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015657030999999998, 2024-09-17T02:20:46.959 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:46.959 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:46.959 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.960 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:46.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:46.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568721+0000", 2024-09-17T02:20:46.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:46.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568721+0000", 2024-09-17T02:20:46.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:46.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568722+0000", 2024-09-17T02:20:46.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5600000000000004e-07 2024-09-17T02:20:46.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:46.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568742+0000", 2024-09-17T02:20:46.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0506999999999999e-05 2024-09-17T02:20:46.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:46.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568762+0000", 2024-09-17T02:20:46.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9423e-05 2024-09-17T02:20:46.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568777+0000", 2024-09-17T02:20:46.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5457000000000001e-05 2024-09-17T02:20:46.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.571705+0000", 2024-09-17T02:20:46.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029280130000000001 2024-09-17T02:20:46.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:46.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.571787+0000", 2024-09-17T02:20:46.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1509999999999997e-05 2024-09-17T02:20:46.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:46.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584296+0000", 2024-09-17T02:20:46.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012509398999999999 2024-09-17T02:20:46.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:46.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584378+0000", 2024-09-17T02:20:46.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1866000000000005e-05 2024-09-17T02:20:46.963 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.963 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:46.963 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.964 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:7 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'2, mlcod=0'0)", 2024-09-17T02:20:46.964 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.569013+0000", 2024-09-17T02:20:46.964 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.329847605000001, 2024-09-17T02:20:46.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015831576999999999, 2024-09-17T02:20:46.964 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:46.964 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:46.964 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.964 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:46.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:46.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569013+0000", 2024-09-17T02:20:46.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:46.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569013+0000", 2024-09-17T02:20:46.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:46.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569014+0000", 2024-09-17T02:20:46.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6000000000000002e-07 2024-09-17T02:20:46.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:46.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569024+0000", 2024-09-17T02:20:46.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8369999999999992e-06 2024-09-17T02:20:46.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:46.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570016+0000", 2024-09-17T02:20:46.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00099277000000000002 2024-09-17T02:20:46.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570040+0000", 2024-09-17T02:20:46.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3790000000000001e-05 2024-09-17T02:20:46.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570154+0000", 2024-09-17T02:20:46.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113689 2024-09-17T02:20:46.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:46.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570208+0000", 2024-09-17T02:20:46.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4305999999999998e-05 2024-09-17T02:20:46.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:46.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.583286+0000", 2024-09-17T02:20:46.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013077945000000001 2024-09-17T02:20:46.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:46.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584844+0000", 2024-09-17T02:20:46.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015583800000000001 2024-09-17T02:20:46.968 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.968 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:46.968 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.968 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:2 3.f e19/17 3:f1f69726:::400.00000000:head v 19'1, mlcod=0'0)", 2024-09-17T02:20:46.968 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.570080+0000", 2024-09-17T02:20:46.968 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.328780474999999, 2024-09-17T02:20:46.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014452469000000001, 2024-09-17T02:20:46.968 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:46.969 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:46.969 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.969 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:46.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:46.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570080+0000", 2024-09-17T02:20:46.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:46.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570080+0000", 2024-09-17T02:20:46.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:46.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570081+0000", 2024-09-17T02:20:46.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.333e-06 2024-09-17T02:20:46.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:46.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570142+0000", 2024-09-17T02:20:46.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0919999999999999e-05 2024-09-17T02:20:46.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:46.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570167+0000", 2024-09-17T02:20:46.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4576e-05 2024-09-17T02:20:46.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570180+0000", 2024-09-17T02:20:46.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3444e-05 2024-09-17T02:20:46.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573011+0000", 2024-09-17T02:20:46.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028309170000000001 2024-09-17T02:20:46.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:46.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573052+0000", 2024-09-17T02:20:46.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1285999999999997e-05 2024-09-17T02:20:46.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:46.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584432+0000", 2024-09-17T02:20:46.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011379837 2024-09-17T02:20:46.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:46.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584532+0000", 2024-09-17T02:20:46.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010015599999999999 2024-09-17T02:20:46.972 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.972 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:46.973 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.973 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:1247 5.e 5:771d49ed:::benchmark_data_smithi001_23533_object1246:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:46.973 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:33.170545+0000", 2024-09-17T02:20:46.973 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.72831555, 2024-09-17T02:20:46.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014510571999999999, 2024-09-17T02:20:46.973 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:46.973 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:46.973 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.973 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:46.973 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:46.973 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:46.974 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1247 2024-09-17T02:20:46.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.974 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:46.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:46.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170545+0000", 2024-09-17T02:20:46.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:46.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170545+0000", 2024-09-17T02:20:46.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:46.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170546+0000", 2024-09-17T02:20:46.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.037e-06 2024-09-17T02:20:46.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:46.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170606+0000", 2024-09-17T02:20:46.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9914000000000003e-05 2024-09-17T02:20:46.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:46.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170621+0000", 2024-09-17T02:20:46.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5011000000000001e-05 2024-09-17T02:20:46.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170628+0000", 2024-09-17T02:20:46.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3989999999999998e-06 2024-09-17T02:20:46.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170703+0000", 2024-09-17T02:20:46.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5082999999999999e-05 2024-09-17T02:20:46.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:46.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170860+0000", 2024-09-17T02:20:46.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015699600000000001 2024-09-17T02:20:46.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:46.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170991+0000", 2024-09-17T02:20:46.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013087900000000001 2024-09-17T02:20:46.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:46.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.172129+0000", 2024-09-17T02:20:46.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001137826 2024-09-17T02:20:46.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.184962+0000", 2024-09-17T02:20:46.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012832582 2024-09-17T02:20:46.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:46.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.185000+0000", 2024-09-17T02:20:46.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8444e-05 2024-09-17T02:20:46.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:46.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.185055+0000", 2024-09-17T02:20:46.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5401e-05 2024-09-17T02:20:46.978 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.979 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:46.979 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.979 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:1248 5.e 5:7f482265:::benchmark_data_smithi001_23533_object1247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:46.979 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:33.170647+0000", 2024-09-17T02:20:46.979 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.728213123, 2024-09-17T02:20:46.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015727534000000001, 2024-09-17T02:20:46.979 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:46.979 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:46.979 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.979 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:46.979 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:46.979 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:46.980 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1248 2024-09-17T02:20:46.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.980 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:46.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:46.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170647+0000", 2024-09-17T02:20:46.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:46.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170647+0000", 2024-09-17T02:20:46.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:46.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170648+0000", 2024-09-17T02:20:46.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4000000000000002e-07 2024-09-17T02:20:46.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:46.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170691+0000", 2024-09-17T02:20:46.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2722000000000002e-05 2024-09-17T02:20:46.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:46.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170699+0000", 2024-09-17T02:20:46.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1540000000000002e-06 2024-09-17T02:20:46.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170704+0000", 2024-09-17T02:20:46.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1290000000000004e-06 2024-09-17T02:20:46.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.171489+0000", 2024-09-17T02:20:46.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00078564599999999998 2024-09-17T02:20:46.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:46.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.171653+0000", 2024-09-17T02:20:46.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163027 2024-09-17T02:20:46.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:46.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.171797+0000", 2024-09-17T02:20:46.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000144828 2024-09-17T02:20:46.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:46.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.172344+0000", 2024-09-17T02:20:46.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054687599999999996 2024-09-17T02:20:46.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:46.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.186281+0000", 2024-09-17T02:20:46.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013936755 2024-09-17T02:20:46.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:46.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.186338+0000", 2024-09-17T02:20:46.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6598000000000003e-05 2024-09-17T02:20:46.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:46.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.186375+0000", 2024-09-17T02:20:46.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7258999999999997e-05 2024-09-17T02:20:46.985 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.985 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:46.985 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.985 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28720 5.f e28/22 5:f8a7aea5:::benchmark_data_smithi001_23533_object28719:head v 28'1756, mlcod=28'1754)", 2024-09-17T02:20:46.985 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:20:46.985 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.3287405420000002, 2024-09-17T02:20:46.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033308717000000002, 2024-09-17T02:20:46.985 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:46.985 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:46.985 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.985 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:46.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:46.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:20:46.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:46.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:20:46.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:46.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570121+0000", 2024-09-17T02:20:46.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4e-07 2024-09-17T02:20:46.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:46.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570208+0000", 2024-09-17T02:20:46.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6945000000000002e-05 2024-09-17T02:20:46.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:46.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570222+0000", 2024-09-17T02:20:46.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4541e-05 2024-09-17T02:20:46.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570232+0000", 2024-09-17T02:20:46.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3039999999999994e-06 2024-09-17T02:20:46.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570273+0000", 2024-09-17T02:20:46.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1950999999999999e-05 2024-09-17T02:20:46.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:46.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570286+0000", 2024-09-17T02:20:46.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2268e-05 2024-09-17T02:20:46.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:46.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603312+0000", 2024-09-17T02:20:46.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033026405000000002 2024-09-17T02:20:46.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:46.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603429+0000", 2024-09-17T02:20:46.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116463 2024-09-17T02:20:46.989 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.989 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:46.989 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.990 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28721 5.a e28/22 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head v 28'1872, mlcod=28'1869)", 2024-09-17T02:20:46.990 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:20:46.990 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.3285970359999997, 2024-09-17T02:20:46.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033539817999999999, 2024-09-17T02:20:46.990 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:46.990 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:46.990 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.990 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:46.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:46.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:20:46.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:46.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:20:46.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:46.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570264+0000", 2024-09-17T02:20:46.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0999999999999997e-07 2024-09-17T02:20:46.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:46.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570299+0000", 2024-09-17T02:20:46.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4876999999999998e-05 2024-09-17T02:20:46.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:46.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570310+0000", 2024-09-17T02:20:46.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0958000000000001e-05 2024-09-17T02:20:46.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570316+0000", 2024-09-17T02:20:46.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.485e-06 2024-09-17T02:20:46.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598947+0000", 2024-09-17T02:20:46.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.028631058000000001 2024-09-17T02:20:46.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:46.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598969+0000", 2024-09-17T02:20:46.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2005999999999999e-05 2024-09-17T02:20:46.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:46.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.602638+0000", 2024-09-17T02:20:46.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036690339999999998 2024-09-17T02:20:46.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:46.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603803+0000", 2024-09-17T02:20:46.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00116559 2024-09-17T02:20:46.994 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.994 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:46.994 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.994 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28723 5.f e28/22 5:f1a2a8f6:::benchmark_data_smithi001_23533_object28722:head v 28'1757, mlcod=28'1754)", 2024-09-17T02:20:46.994 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.571446+0000", 2024-09-17T02:20:46.994 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.3274147080000001, 2024-09-17T02:20:46.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.032047203000000003, 2024-09-17T02:20:46.994 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:46.994 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:46.994 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:46.995 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:46.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:46.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571446+0000", 2024-09-17T02:20:46.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:46.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571446+0000", 2024-09-17T02:20:46.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:46.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:46.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571447+0000", 2024-09-17T02:20:46.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0979999999999999e-06 2024-09-17T02:20:46.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:46.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571554+0000", 2024-09-17T02:20:46.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107464 2024-09-17T02:20:46.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:46.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598891+0000", 2024-09-17T02:20:46.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.027336905000000002 2024-09-17T02:20:46.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:46.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598905+0000", 2024-09-17T02:20:46.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:20:46.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:46.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.600343+0000", 2024-09-17T02:20:46.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014382100000000001 2024-09-17T02:20:46.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:46.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.600387+0000", 2024-09-17T02:20:46.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3398e-05 2024-09-17T02:20:46.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:46.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603443+0000", 2024-09-17T02:20:46.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030562250000000001 2024-09-17T02:20:46.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:46.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:46.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:46.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603493+0000", 2024-09-17T02:20:46.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9820000000000001e-05 2024-09-17T02:20:46.998 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.998 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:46.998 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.998 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:46.998 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:46.998 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:20:47.000 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:20:47.000 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:47.000+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:47.100 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:47.103+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:47.154 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:20:47.154 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:20:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:41011 5.c 5:3148176d:::benchmark_data_smithi001_23533_object41010:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.153065+0000", 2024-09-17T02:20:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0058892390000000001, 2024-09-17T02:20:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0059091309999999998, 2024-09-17T02:20:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 41011 2024-09-17T02:20:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.153065+0000", 2024-09-17T02:20:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.153065+0000", 2024-09-17T02:20:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.153066+0000", 2024-09-17T02:20:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0800000000000004e-07 2024-09-17T02:20:47.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.153097+0000", 2024-09-17T02:20:47.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1384000000000003e-05 2024-09-17T02:20:47.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.153106+0000", 2024-09-17T02:20:47.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0210000000000005e-06 2024-09-17T02:20:47.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.153122+0000", 2024-09-17T02:20:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5820000000000001e-05 2024-09-17T02:20:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.153169+0000", 2024-09-17T02:20:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.672e-05 2024-09-17T02:20:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.153275+0000", 2024-09-17T02:20:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0001061 2024-09-17T02:20:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.153366+0000", 2024-09-17T02:20:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1626000000000007e-05 2024-09-17T02:20:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.158019+0000", 2024-09-17T02:20:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046521740000000002 2024-09-17T02:20:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:41013 5.3 5:cea71ccf:::benchmark_data_smithi001_23533_object41012:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.154174+0000", 2024-09-17T02:20:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0047804709999999997, 2024-09-17T02:20:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048515900000000002, 2024-09-17T02:20:47.160 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.160 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.160 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:47.160 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:47.160 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:47.160 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:47.160 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 41013 2024-09-17T02:20:47.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.160 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.154174+0000", 2024-09-17T02:20:47.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.154174+0000", 2024-09-17T02:20:47.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.154175+0000", 2024-09-17T02:20:47.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.16e-07 2024-09-17T02:20:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.154253+0000", 2024-09-17T02:20:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7758999999999999e-05 2024-09-17T02:20:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.154264+0000", 2024-09-17T02:20:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1537e-05 2024-09-17T02:20:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.154272+0000", 2024-09-17T02:20:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1699999999999997e-06 2024-09-17T02:20:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.154326+0000", 2024-09-17T02:20:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3902e-05 2024-09-17T02:20:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.154455+0000", 2024-09-17T02:20:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012856099999999999 2024-09-17T02:20:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.154586+0000", 2024-09-17T02:20:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013169200000000001 2024-09-17T02:20:47.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:47.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.157377+0000", 2024-09-17T02:20:47.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002790762 2024-09-17T02:20:47.164 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.164 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.164 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.164 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:41014 5.3 5:c1832955:::benchmark_data_smithi001_23533_object41013:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:47.164 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.154288+0000", 2024-09-17T02:20:47.164 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0046663659999999999, 2024-09-17T02:20:47.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047807539999999999, 2024-09-17T02:20:47.165 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.165 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.165 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:47.165 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:47.165 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:47.165 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:47.165 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 41014 2024-09-17T02:20:47.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.165 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.154288+0000", 2024-09-17T02:20:47.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.154288+0000", 2024-09-17T02:20:47.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.154289+0000", 2024-09-17T02:20:47.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0500000000000004e-07 2024-09-17T02:20:47.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.154329+0000", 2024-09-17T02:20:47.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0927000000000003e-05 2024-09-17T02:20:47.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.154338+0000", 2024-09-17T02:20:47.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8200000000000003e-06 2024-09-17T02:20:47.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.154344+0000", 2024-09-17T02:20:47.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7729999999999996e-06 2024-09-17T02:20:47.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.156051+0000", 2024-09-17T02:20:47.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001707439 2024-09-17T02:20:47.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.156164+0000", 2024-09-17T02:20:47.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011236 2024-09-17T02:20:47.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:47.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.156244+0000", 2024-09-17T02:20:47.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0564999999999999e-05 2024-09-17T02:20:47.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:47.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.158503+0000", 2024-09-17T02:20:47.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022588399999999998 2024-09-17T02:20:47.168 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.168 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.168 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.169 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:41015 5.3 5:c8242c57:::benchmark_data_smithi001_23533_object41014:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:47.169 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.154364+0000", 2024-09-17T02:20:47.169 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.004590663, 2024-09-17T02:20:47.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047476769999999996, 2024-09-17T02:20:47.169 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.169 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.169 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:47.169 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:47.169 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:47.169 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:47.169 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 41015 2024-09-17T02:20:47.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.170 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.154364+0000", 2024-09-17T02:20:47.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.154364+0000", 2024-09-17T02:20:47.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.154364+0000", 2024-09-17T02:20:47.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2099999999999996e-07 2024-09-17T02:20:47.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.154465+0000", 2024-09-17T02:20:47.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010057599999999999 2024-09-17T02:20:47.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.154473+0000", 2024-09-17T02:20:47.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5399999999999996e-06 2024-09-17T02:20:47.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.154480+0000", 2024-09-17T02:20:47.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.088e-06 2024-09-17T02:20:47.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.157416+0000", 2024-09-17T02:20:47.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029360689999999999 2024-09-17T02:20:47.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.157522+0000", 2024-09-17T02:20:47.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010624 2024-09-17T02:20:47.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:47.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.157614+0000", 2024-09-17T02:20:47.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2026000000000003e-05 2024-09-17T02:20:47.173 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.173 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.173 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.173 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:41017 5.c 5:3f24430d:::benchmark_data_smithi001_23533_object41016:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:47.173 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.154913+0000", 2024-09-17T02:20:47.173 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0040416230000000003, 2024-09-17T02:20:47.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004236475, 2024-09-17T02:20:47.173 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.173 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.174 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:47.174 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:47.174 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:47.174 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:47.174 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 41017 2024-09-17T02:20:47.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.174 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.154913+0000", 2024-09-17T02:20:47.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.154913+0000", 2024-09-17T02:20:47.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.154914+0000", 2024-09-17T02:20:47.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0720000000000001e-06 2024-09-17T02:20:47.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.154983+0000", 2024-09-17T02:20:47.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9146000000000005e-05 2024-09-17T02:20:47.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.154996+0000", 2024-09-17T02:20:47.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2622e-05 2024-09-17T02:20:47.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.155003+0000", 2024-09-17T02:20:47.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1600000000000001e-06 2024-09-17T02:20:47.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.155060+0000", 2024-09-17T02:20:47.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6783000000000002e-05 2024-09-17T02:20:47.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.155242+0000", 2024-09-17T02:20:47.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018269200000000001 2024-09-17T02:20:47.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:47.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.155364+0000", 2024-09-17T02:20:47.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012192 2024-09-17T02:20:47.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:47.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.158028+0000", 2024-09-17T02:20:47.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026638320000000001 2024-09-17T02:20:47.178 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.178 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.178 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.178 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:41018 5.c 5:3b1f5f4f:::benchmark_data_smithi001_23533_object41017:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:47.178 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.156157+0000", 2024-09-17T02:20:47.178 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0027971020000000001, 2024-09-17T02:20:47.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030324620000000001, 2024-09-17T02:20:47.178 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.178 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.178 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:47.178 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:47.179 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:47.179 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:47.179 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 41018 2024-09-17T02:20:47.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.179 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.156157+0000", 2024-09-17T02:20:47.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.156157+0000", 2024-09-17T02:20:47.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.156158+0000", 2024-09-17T02:20:47.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5700000000000001e-07 2024-09-17T02:20:47.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.156186+0000", 2024-09-17T02:20:47.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7997e-05 2024-09-17T02:20:47.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.156198+0000", 2024-09-17T02:20:47.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1916000000000001e-05 2024-09-17T02:20:47.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.156206+0000", 2024-09-17T02:20:47.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6340000000000001e-06 2024-09-17T02:20:47.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.156787+0000", 2024-09-17T02:20:47.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00058162700000000003 2024-09-17T02:20:47.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.156867+0000", 2024-09-17T02:20:47.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9404000000000001e-05 2024-09-17T02:20:47.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:47.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.156955+0000", 2024-09-17T02:20:47.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8321999999999999e-05 2024-09-17T02:20:47.182 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.182 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.182 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.182 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:41019 5.c 5:3c238b55:::benchmark_data_smithi001_23533_object41018:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:47.182 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.156266+0000", 2024-09-17T02:20:47.182 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0026886219999999999, 2024-09-17T02:20:47.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029646550000000001, 2024-09-17T02:20:47.183 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.183 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.183 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:47.183 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:47.183 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:47.183 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:47.183 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 41019 2024-09-17T02:20:47.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.183 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.156266+0000", 2024-09-17T02:20:47.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.156266+0000", 2024-09-17T02:20:47.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.156266+0000", 2024-09-17T02:20:47.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4499999999999996e-07 2024-09-17T02:20:47.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.156389+0000", 2024-09-17T02:20:47.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122383 2024-09-17T02:20:47.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.156401+0000", 2024-09-17T02:20:47.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2131e-05 2024-09-17T02:20:47.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.156408+0000", 2024-09-17T02:20:47.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3379999999999999e-06 2024-09-17T02:20:47.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.158047+0000", 2024-09-17T02:20:47.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016390969999999999 2024-09-17T02:20:47.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.158175+0000", 2024-09-17T02:20:47.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012763499999999999 2024-09-17T02:20:47.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:47.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.158329+0000", 2024-09-17T02:20:47.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015402999999999999 2024-09-17T02:20:47.187 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.187 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.187 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.187 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:41021 5.6 5:6f2cffff:::benchmark_data_smithi001_23533_object41020:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:47.187 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.156505+0000", 2024-09-17T02:20:47.187 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0024489009999999999, 2024-09-17T02:20:47.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002783897, 2024-09-17T02:20:47.187 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.187 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.187 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:47.187 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:47.188 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:47.188 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:47.188 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 41021 2024-09-17T02:20:47.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.188 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.156505+0000", 2024-09-17T02:20:47.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.156505+0000", 2024-09-17T02:20:47.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.156506+0000", 2024-09-17T02:20:47.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0100000000000004e-07 2024-09-17T02:20:47.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.156569+0000", 2024-09-17T02:20:47.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3041999999999997e-05 2024-09-17T02:20:47.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.156579+0000", 2024-09-17T02:20:47.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5060000000000001e-06 2024-09-17T02:20:47.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.156586+0000", 2024-09-17T02:20:47.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4819999999999997e-06 2024-09-17T02:20:47.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.156640+0000", 2024-09-17T02:20:47.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3977000000000002e-05 2024-09-17T02:20:47.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.156790+0000", 2024-09-17T02:20:47.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014946100000000001 2024-09-17T02:20:47.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:47.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.156936+0000", 2024-09-17T02:20:47.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000146043 2024-09-17T02:20:47.192 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.192 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.192 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.192 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4466.0:41011 5.c e30/22)", 2024-09-17T02:20:47.192 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.158407+0000", 2024-09-17T02:20:47.192 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00054741299999999996, 2024-09-17T02:20:47.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000921768, 2024-09-17T02:20:47.193 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.193 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.193 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:20:47.193 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.158407+0000", 2024-09-17T02:20:47.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.158407+0000", 2024-09-17T02:20:47.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.158408+0000", 2024-09-17T02:20:47.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5599999999999995e-07 2024-09-17T02:20:47.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.158411+0000", 2024-09-17T02:20:47.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.681e-06 2024-09-17T02:20:47.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.158421+0000", 2024-09-17T02:20:47.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4879999999999996e-06 2024-09-17T02:20:47.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.158427+0000", 2024-09-17T02:20:47.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.618e-06 2024-09-17T02:20:47.195 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.195 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.195 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.195 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4466.0:41013 5.3 e30/22 ondisk, result = 0)", 2024-09-17T02:20:47.196 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.159199+0000", 2024-09-17T02:20:47.196 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9997559, 2024-09-17T02:20:47.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000157326, 2024-09-17T02:20:47.196 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.196 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.196 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:47.196 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159199+0000", 2024-09-17T02:20:47.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159199+0000", 2024-09-17T02:20:47.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159199+0000", 2024-09-17T02:20:47.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1100000000000002e-07 2024-09-17T02:20:47.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159201+0000", 2024-09-17T02:20:47.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2299999999999998e-06 2024-09-17T02:20:47.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159209+0000", 2024-09-17T02:20:47.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9850000000000006e-06 2024-09-17T02:20:47.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159214+0000", 2024-09-17T02:20:47.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4660000000000001e-06 2024-09-17T02:20:47.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159259+0000", 2024-09-17T02:20:47.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5090999999999999e-05 2024-09-17T02:20:47.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159267+0000", 2024-09-17T02:20:47.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2840000000000006e-06 2024-09-17T02:20:47.199 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.199 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.199 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.199 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:41024 5.5 5:ae7cfca4:::benchmark_data_smithi001_23533_object41023:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:47.200 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.159122+0000", 2024-09-17T02:20:47.200 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9998326, 2024-09-17T02:20:47.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028157600000000002, 2024-09-17T02:20:47.200 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.200 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.200 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-17T02:20:47.200 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:47.200 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:47.200 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:47.200 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 41024 2024-09-17T02:20:47.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.200 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159122+0000", 2024-09-17T02:20:47.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159122+0000", 2024-09-17T02:20:47.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159123+0000", 2024-09-17T02:20:47.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4099999999999998e-07 2024-09-17T02:20:47.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159234+0000", 2024-09-17T02:20:47.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111134 2024-09-17T02:20:47.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159244+0000", 2024-09-17T02:20:47.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6609999999999995e-06 2024-09-17T02:20:47.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159250+0000", 2024-09-17T02:20:47.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7959999999999998e-06 2024-09-17T02:20:47.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159313+0000", 2024-09-17T02:20:47.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2693000000000004e-05 2024-09-17T02:20:47.203 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.203 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.203 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.203 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4466.0:41014 5.3 e30/22 ondisk, result = 0)", 2024-09-17T02:20:47.203 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.159238+0000", 2024-09-17T02:20:47.204 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9997163, 2024-09-17T02:20:47.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022597900000000001, 2024-09-17T02:20:47.204 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.204 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.204 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:47.204 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159238+0000", 2024-09-17T02:20:47.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159238+0000", 2024-09-17T02:20:47.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159239+0000", 2024-09-17T02:20:47.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8099999999999998e-07 2024-09-17T02:20:47.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159241+0000", 2024-09-17T02:20:47.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.024e-06 2024-09-17T02:20:47.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159246+0000", 2024-09-17T02:20:47.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5439999999999998e-06 2024-09-17T02:20:47.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159251+0000", 2024-09-17T02:20:47.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7559999999999999e-06 2024-09-17T02:20:47.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159401+0000", 2024-09-17T02:20:47.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014950400000000001 2024-09-17T02:20:47.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159408+0000", 2024-09-17T02:20:47.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5270000000000001e-06 2024-09-17T02:20:47.207 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.207 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.207 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.207 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:41025 5.5 5.85c2edb5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:47.207 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.159290+0000", 2024-09-17T02:20:47.207 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9996643, 2024-09-17T02:20:47.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024065600000000001, 2024-09-17T02:20:47.208 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.208 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.208 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:20:47.208 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:47.208 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:47.208 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:47.208 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 41025 2024-09-17T02:20:47.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.208 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159290+0000", 2024-09-17T02:20:47.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159290+0000", 2024-09-17T02:20:47.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159290+0000", 2024-09-17T02:20:47.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0100000000000005e-07 2024-09-17T02:20:47.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159343+0000", 2024-09-17T02:20:47.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2256000000000002e-05 2024-09-17T02:20:47.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159349+0000", 2024-09-17T02:20:47.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9429999999999997e-06 2024-09-17T02:20:47.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159353+0000", 2024-09-17T02:20:47.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1389999999999997e-06 2024-09-17T02:20:47.210 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.210 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.210 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.211 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4466.0:41021 5.6 e30/22)", 2024-09-17T02:20:47.211 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.159389+0000", 2024-09-17T02:20:47.211 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9995656, 2024-09-17T02:20:47.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000193511, 2024-09-17T02:20:47.211 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.211 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.211 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-17T02:20:47.211 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159389+0000", 2024-09-17T02:20:47.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159389+0000", 2024-09-17T02:20:47.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159389+0000", 2024-09-17T02:20:47.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8799999999999998e-07 2024-09-17T02:20:47.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159392+0000", 2024-09-17T02:20:47.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0110000000000001e-06 2024-09-17T02:20:47.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159400+0000", 2024-09-17T02:20:47.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4200000000000001e-06 2024-09-17T02:20:47.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159405+0000", 2024-09-17T02:20:47.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0139999999999998e-06 2024-09-17T02:20:47.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159442+0000", 2024-09-17T02:20:47.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7858000000000002e-05 2024-09-17T02:20:47.214 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.214 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.214 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.214 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:41026 5.c 5:3724a03f:::benchmark_data_smithi001_23533_object41025:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:47.214 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.159366+0000", 2024-09-17T02:20:47.214 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.999588, 2024-09-17T02:20:47.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028144200000000002, 2024-09-17T02:20:47.214 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.215 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.215 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-17T02:20:47.215 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:47.215 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:47.215 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:47.215 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 41026 2024-09-17T02:20:47.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.215 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159366+0000", 2024-09-17T02:20:47.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159366+0000", 2024-09-17T02:20:47.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159367+0000", 2024-09-17T02:20:47.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9900000000000001e-07 2024-09-17T02:20:47.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159452+0000", 2024-09-17T02:20:47.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5122000000000003e-05 2024-09-17T02:20:47.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159460+0000", 2024-09-17T02:20:47.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4239999999999993e-06 2024-09-17T02:20:47.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159472+0000", 2024-09-17T02:20:47.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2320999999999999e-05 2024-09-17T02:20:47.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159615+0000", 2024-09-17T02:20:47.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014202299999999999 2024-09-17T02:20:47.218 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.218 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.218 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.218 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:41022 5.b e30/22 5:d38a5074:::benchmark_data_smithi001_23533_object41021:head v 30'2499, mlcod=30'2497)", 2024-09-17T02:20:47.218 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.159507+0000", 2024-09-17T02:20:47.218 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9994473, 2024-09-17T02:20:47.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000198638, 2024-09-17T02:20:47.218 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.218 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.219 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:47.219 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159507+0000", 2024-09-17T02:20:47.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159507+0000", 2024-09-17T02:20:47.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159508+0000", 2024-09-17T02:20:47.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5199999999999998e-07 2024-09-17T02:20:47.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159530+0000", 2024-09-17T02:20:47.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2917000000000001e-05 2024-09-17T02:20:47.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159535+0000", 2024-09-17T02:20:47.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7990000000000001e-06 2024-09-17T02:20:47.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159540+0000", 2024-09-17T02:20:47.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6349999999999997e-06 2024-09-17T02:20:47.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159578+0000", 2024-09-17T02:20:47.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8136999999999998e-05 2024-09-17T02:20:47.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159598+0000", 2024-09-17T02:20:47.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0196000000000001e-05 2024-09-17T02:20:47.222 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.222 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.222 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.222 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:41027 5.8 5:1c6a754b:::benchmark_data_smithi001_23533_object41026:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:47.222 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.159487+0000", 2024-09-17T02:20:47.222 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9994669, 2024-09-17T02:20:47.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027517500000000001, 2024-09-17T02:20:47.222 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.222 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.222 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-17T02:20:47.222 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:47.223 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:47.223 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:47.223 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 41027 2024-09-17T02:20:47.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.223 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159487+0000", 2024-09-17T02:20:47.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159487+0000", 2024-09-17T02:20:47.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159488+0000", 2024-09-17T02:20:47.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9999999999999998e-07 2024-09-17T02:20:47.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159600+0000", 2024-09-17T02:20:47.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011252 2024-09-17T02:20:47.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159609+0000", 2024-09-17T02:20:47.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5720000000000003e-06 2024-09-17T02:20:47.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159614+0000", 2024-09-17T02:20:47.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.451e-06 2024-09-17T02:20:47.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159661+0000", 2024-09-17T02:20:47.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6909000000000001e-05 2024-09-17T02:20:47.225 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.225 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.226 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.226 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4466.0:41017 5.c e30/22)", 2024-09-17T02:20:47.226 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.159748+0000", 2024-09-17T02:20:47.226 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9992061, 2024-09-17T02:20:47.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5953999999999999e-05, 2024-09-17T02:20:47.226 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.226 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.226 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:20:47.226 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159748+0000", 2024-09-17T02:20:47.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159748+0000", 2024-09-17T02:20:47.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159749+0000", 2024-09-17T02:20:47.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3200000000000001e-07 2024-09-17T02:20:47.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159751+0000", 2024-09-17T02:20:47.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5380000000000001e-06 2024-09-17T02:20:47.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159758+0000", 2024-09-17T02:20:47.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3999999999999997e-06 2024-09-17T02:20:47.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159762+0000", 2024-09-17T02:20:47.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9169999999999997e-06 2024-09-17T02:20:47.228 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.228 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.229 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.229 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4466.0:41018 5.c e30/22)", 2024-09-17T02:20:47.229 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.159782+0000", 2024-09-17T02:20:47.229 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9991722, 2024-09-17T02:20:47.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1494000000000004e-05, 2024-09-17T02:20:47.229 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.229 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.229 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:20:47.229 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159782+0000", 2024-09-17T02:20:47.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159782+0000", 2024-09-17T02:20:47.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159783+0000", 2024-09-17T02:20:47.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.27e-07 2024-09-17T02:20:47.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159785+0000", 2024-09-17T02:20:47.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3920000000000001e-06 2024-09-17T02:20:47.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159789+0000", 2024-09-17T02:20:47.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8990000000000003e-06 2024-09-17T02:20:47.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.159792+0000", 2024-09-17T02:20:47.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7920000000000001e-06 2024-09-17T02:20:47.231 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.232 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.232 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.232 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.232 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:20:47.232 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 19 2024-09-17T02:20:47.232 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:20:47.233 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:20:47.234 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:47.232+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:47.334 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:47.339+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:47.387 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:20:47.387 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:20:47.388 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:20:47.388 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:20:47.388 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:20:47.409 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:20:47.451 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:47.455+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:47.536 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:47.539+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:47.607 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:20:47.608 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:20:47.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:20:47.608 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:20:47.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.608 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:47.608 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:20:47.608 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.049439866, 2024-09-17T02:20:47.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021799929999999999, 2024-09-17T02:20:47.608 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.608 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.609 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:47.609 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.609 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:20:47.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.609 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:20:47.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562007+0000", 2024-09-17T02:20:47.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6260000000000001e-06 2024-09-17T02:20:47.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562021+0000", 2024-09-17T02:20:47.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4440000000000001e-05 2024-09-17T02:20:47.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562053+0000", 2024-09-17T02:20:47.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2159000000000002e-05 2024-09-17T02:20:47.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562076+0000", 2024-09-17T02:20:47.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2926999999999999e-05 2024-09-17T02:20:47.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562218+0000", 2024-09-17T02:20:47.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000141726 2024-09-17T02:20:47.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562506+0000", 2024-09-17T02:20:47.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028752399999999999 2024-09-17T02:20:47.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:47.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562830+0000", 2024-09-17T02:20:47.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032427399999999999 2024-09-17T02:20:47.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:47.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566900+0000", 2024-09-17T02:20:47.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040705660000000003 2024-09-17T02:20:47.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:47.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583581+0000", 2024-09-17T02:20:47.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016680210000000001 2024-09-17T02:20:47.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:47.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583704+0000", 2024-09-17T02:20:47.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012289899999999999 2024-09-17T02:20:47.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:47.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583803+0000", 2024-09-17T02:20:47.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9579000000000003e-05 2024-09-17T02:20:47.613 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.614 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.614 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.614 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:47.614 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:20:47.614 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.049312654000001, 2024-09-17T02:20:47.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022056035000000002, 2024-09-17T02:20:47.614 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.614 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.614 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:47.614 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:20:47.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:20:47.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562132+0000", 2024-09-17T02:20:47.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6300000000000001e-06 2024-09-17T02:20:47.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562142+0000", 2024-09-17T02:20:47.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.022e-05 2024-09-17T02:20:47.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562164+0000", 2024-09-17T02:20:47.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2002999999999999e-05 2024-09-17T02:20:47.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562180+0000", 2024-09-17T02:20:47.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5930000000000002e-05 2024-09-17T02:20:47.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563517+0000", 2024-09-17T02:20:47.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001336776 2024-09-17T02:20:47.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563635+0000", 2024-09-17T02:20:47.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117976 2024-09-17T02:20:47.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:47.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563819+0000", 2024-09-17T02:20:47.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018411499999999999 2024-09-17T02:20:47.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:47.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566977+0000", 2024-09-17T02:20:47.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031575990000000001 2024-09-17T02:20:47.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:47.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583917+0000", 2024-09-17T02:20:47.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016940093999999999 2024-09-17T02:20:47.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:47.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584066+0000", 2024-09-17T02:20:47.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000149746 2024-09-17T02:20:47.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:47.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584186+0000", 2024-09-17T02:20:47.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011994600000000001 2024-09-17T02:20:47.619 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.619 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.619 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.620 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:47.620 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:20:47.620 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.049131942999999, 2024-09-17T02:20:47.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023664803000000002, 2024-09-17T02:20:47.620 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.620 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.620 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:47.620 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:20:47.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:20:47.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562313+0000", 2024-09-17T02:20:47.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.764e-06 2024-09-17T02:20:47.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562323+0000", 2024-09-17T02:20:47.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0166000000000001e-05 2024-09-17T02:20:47.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562343+0000", 2024-09-17T02:20:47.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9633999999999999e-05 2024-09-17T02:20:47.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562367+0000", 2024-09-17T02:20:47.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4556e-05 2024-09-17T02:20:47.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563777+0000", 2024-09-17T02:20:47.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014102330000000001 2024-09-17T02:20:47.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563969+0000", 2024-09-17T02:20:47.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000191361 2024-09-17T02:20:47.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:47.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564148+0000", 2024-09-17T02:20:47.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017934599999999999 2024-09-17T02:20:47.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:47.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566989+0000", 2024-09-17T02:20:47.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028407010000000002 2024-09-17T02:20:47.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:47.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585770+0000", 2024-09-17T02:20:47.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018781566999999999 2024-09-17T02:20:47.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:47.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585874+0000", 2024-09-17T02:20:47.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103489 2024-09-17T02:20:47.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:47.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585976+0000", 2024-09-17T02:20:47.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101986 2024-09-17T02:20:47.625 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.625 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.625 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.625 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:47.625 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:20:47.626 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.049049062999998, 2024-09-17T02:20:47.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024118555999999999, 2024-09-17T02:20:47.626 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.626 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.626 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:47.626 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:20:47.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:20:47.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562395+0000", 2024-09-17T02:20:47.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3969999999999999e-06 2024-09-17T02:20:47.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562405+0000", 2024-09-17T02:20:47.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4229999999999994e-06 2024-09-17T02:20:47.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562427+0000", 2024-09-17T02:20:47.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759999999999998e-05 2024-09-17T02:20:47.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562444+0000", 2024-09-17T02:20:47.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7019000000000001e-05 2024-09-17T02:20:47.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564681+0000", 2024-09-17T02:20:47.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022376929999999998 2024-09-17T02:20:47.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564887+0000", 2024-09-17T02:20:47.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000206178 2024-09-17T02:20:47.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:47.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565230+0000", 2024-09-17T02:20:47.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034233499999999998 2024-09-17T02:20:47.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:47.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567000+0000", 2024-09-17T02:20:47.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017706390000000001 2024-09-17T02:20:47.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:47.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586126+0000", 2024-09-17T02:20:47.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019125672 2024-09-17T02:20:47.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:47.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586314+0000", 2024-09-17T02:20:47.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018740200000000001 2024-09-17T02:20:47.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:47.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586513+0000", 2024-09-17T02:20:47.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019903799999999999 2024-09-17T02:20:47.631 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.631 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.631 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.631 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:47.631 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:20:47.631 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.048974390000001, 2024-09-17T02:20:47.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021940779000000001, 2024-09-17T02:20:47.631 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.631 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.631 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:47.632 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:20:47.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:20:47.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562470+0000", 2024-09-17T02:20:47.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5030000000000001e-06 2024-09-17T02:20:47.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562478+0000", 2024-09-17T02:20:47.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.157e-06 2024-09-17T02:20:47.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562496+0000", 2024-09-17T02:20:47.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7876e-05 2024-09-17T02:20:47.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562511+0000", 2024-09-17T02:20:47.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5067e-05 2024-09-17T02:20:47.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564628+0000", 2024-09-17T02:20:47.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021171860000000001 2024-09-17T02:20:47.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564838+0000", 2024-09-17T02:20:47.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000209283 2024-09-17T02:20:47.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:47.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565078+0000", 2024-09-17T02:20:47.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024075100000000001 2024-09-17T02:20:47.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:47.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567012+0000", 2024-09-17T02:20:47.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019331050000000001 2024-09-17T02:20:47.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:47.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584289+0000", 2024-09-17T02:20:47.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017277464999999999 2024-09-17T02:20:47.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:47.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584363+0000", 2024-09-17T02:20:47.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3852999999999999e-05 2024-09-17T02:20:47.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:47.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584409+0000", 2024-09-17T02:20:47.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6533000000000003e-05 2024-09-17T02:20:47.636 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.637 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.637 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.637 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:47.637 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:20:47.637 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.048911001, 2024-09-17T02:20:47.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020580694, 2024-09-17T02:20:47.637 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.637 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.637 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:47.637 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:20:47.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:20:47.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562533+0000", 2024-09-17T02:20:47.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3239999999999999e-06 2024-09-17T02:20:47.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562541+0000", 2024-09-17T02:20:47.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3529999999999997e-06 2024-09-17T02:20:47.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562559+0000", 2024-09-17T02:20:47.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8306000000000001e-05 2024-09-17T02:20:47.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562572+0000", 2024-09-17T02:20:47.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2993000000000001e-05 2024-09-17T02:20:47.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563230+0000", 2024-09-17T02:20:47.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00065806899999999995 2024-09-17T02:20:47.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563510+0000", 2024-09-17T02:20:47.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028016400000000001 2024-09-17T02:20:47.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:47.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563677+0000", 2024-09-17T02:20:47.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000166243 2024-09-17T02:20:47.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:47.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566312+0000", 2024-09-17T02:20:47.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026351349999999998 2024-09-17T02:20:47.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:47.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.582943+0000", 2024-09-17T02:20:47.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016631781000000002 2024-09-17T02:20:47.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:47.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583035+0000", 2024-09-17T02:20:47.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1682999999999996e-05 2024-09-17T02:20:47.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:47.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583113+0000", 2024-09-17T02:20:47.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7643000000000002e-05 2024-09-17T02:20:47.642 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.643 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.643 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.643 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:47.643 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:20:47.643 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.048803940999999, 2024-09-17T02:20:47.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020802284000000001, 2024-09-17T02:20:47.643 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.643 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.643 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:47.643 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:20:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:20:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562640+0000", 2024-09-17T02:20:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.37e-06 2024-09-17T02:20:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562648+0000", 2024-09-17T02:20:47.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.576e-06 2024-09-17T02:20:47.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562668+0000", 2024-09-17T02:20:47.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0397000000000001e-05 2024-09-17T02:20:47.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562690+0000", 2024-09-17T02:20:47.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1713e-05 2024-09-17T02:20:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564290+0000", 2024-09-17T02:20:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001599397 2024-09-17T02:20:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564527+0000", 2024-09-17T02:20:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023731199999999999 2024-09-17T02:20:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583441+0000", 2024-09-17T02:20:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018914519000000001 2024-09-17T02:20:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:20:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.048728866000001, 2024-09-17T02:20:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021867154, 2024-09-17T02:20:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:20:47.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:20:47.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562716+0000", 2024-09-17T02:20:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.384e-06 2024-09-17T02:20:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562726+0000", 2024-09-17T02:20:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.04e-05 2024-09-17T02:20:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562745+0000", 2024-09-17T02:20:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8770000000000002e-05 2024-09-17T02:20:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562759+0000", 2024-09-17T02:20:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4392999999999999e-05 2024-09-17T02:20:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565882+0000", 2024-09-17T02:20:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031227659999999999 2024-09-17T02:20:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566217+0000", 2024-09-17T02:20:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033498000000000002 2024-09-17T02:20:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:47.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584581+0000", 2024-09-17T02:20:47.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018364460999999999 2024-09-17T02:20:47.651 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.651 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.651 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.651 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:47.651 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562778+0000", 2024-09-17T02:20:47.651 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.048664728999999, 2024-09-17T02:20:47.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018969949, 2024-09-17T02:20:47.651 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.652 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.652 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:47.652 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562778+0000", 2024-09-17T02:20:47.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562778+0000", 2024-09-17T02:20:47.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562779+0000", 2024-09-17T02:20:47.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0470000000000001e-06 2024-09-17T02:20:47.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562798+0000", 2024-09-17T02:20:47.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8723e-05 2024-09-17T02:20:47.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562819+0000", 2024-09-17T02:20:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1192999999999999e-05 2024-09-17T02:20:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562834+0000", 2024-09-17T02:20:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4619e-05 2024-09-17T02:20:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562977+0000", 2024-09-17T02:20:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014338900000000001 2024-09-17T02:20:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563366+0000", 2024-09-17T02:20:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038909399999999999 2024-09-17T02:20:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.581748+0000", 2024-09-17T02:20:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018381884000000001 2024-09-17T02:20:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:1227 5.3 5:c07fff60:::benchmark_data_smithi001_23533_object1226:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.165009+0000", 2024-09-17T02:20:47.656 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.446434164999999, 2024-09-17T02:20:47.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016027434, 2024-09-17T02:20:47.656 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.656 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.656 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:47.656 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:47.656 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:47.656 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:47.656 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1227 2024-09-17T02:20:47.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.656 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165009+0000", 2024-09-17T02:20:47.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165009+0000", 2024-09-17T02:20:47.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165010+0000", 2024-09-17T02:20:47.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9800000000000003e-07 2024-09-17T02:20:47.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165045+0000", 2024-09-17T02:20:47.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5231999999999997e-05 2024-09-17T02:20:47.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165053+0000", 2024-09-17T02:20:47.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9289999999999998e-06 2024-09-17T02:20:47.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165058+0000", 2024-09-17T02:20:47.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6689999999999997e-06 2024-09-17T02:20:47.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165611+0000", 2024-09-17T02:20:47.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00055364200000000002 2024-09-17T02:20:47.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165764+0000", 2024-09-17T02:20:47.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000153132 2024-09-17T02:20:47.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:47.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166112+0000", 2024-09-17T02:20:47.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034738599999999998 2024-09-17T02:20:47.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:47.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168392+0000", 2024-09-17T02:20:47.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022802809999999999 2024-09-17T02:20:47.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:47.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.180931+0000", 2024-09-17T02:20:47.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012538785 2024-09-17T02:20:47.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.180994+0000", 2024-09-17T02:20:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3477000000000002e-05 2024-09-17T02:20:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181036+0000", 2024-09-17T02:20:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2103e-05 2024-09-17T02:20:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:26132 5.c 5:3ae49ef5:::benchmark_data_smithi001_23533_object26131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:47.662 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:41.688378+0000", 2024-09-17T02:20:47.662 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.9230646470000003, 2024-09-17T02:20:47.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017107691000000001, 2024-09-17T02:20:47.662 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.662 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.662 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:47.662 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:47.662 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:47.662 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:47.662 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 26132 2024-09-17T02:20:47.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.662 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688378+0000", 2024-09-17T02:20:47.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688378+0000", 2024-09-17T02:20:47.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688379+0000", 2024-09-17T02:20:47.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.048e-06 2024-09-17T02:20:47.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688407+0000", 2024-09-17T02:20:47.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7271e-05 2024-09-17T02:20:47.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688418+0000", 2024-09-17T02:20:47.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1333e-05 2024-09-17T02:20:47.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688433+0000", 2024-09-17T02:20:47.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4764e-05 2024-09-17T02:20:47.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688971+0000", 2024-09-17T02:20:47.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00053786399999999999 2024-09-17T02:20:47.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.689087+0000", 2024-09-17T02:20:47.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000116385 2024-09-17T02:20:47.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:47.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.689226+0000", 2024-09-17T02:20:47.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013938199999999999 2024-09-17T02:20:47.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:47.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.691077+0000", 2024-09-17T02:20:47.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001850806 2024-09-17T02:20:47.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:47.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.705392+0000", 2024-09-17T02:20:47.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014315006999999999 2024-09-17T02:20:47.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:47.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.705449+0000", 2024-09-17T02:20:47.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7101000000000001e-05 2024-09-17T02:20:47.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:47.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.705486+0000", 2024-09-17T02:20:47.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6730000000000002e-05 2024-09-17T02:20:47.667 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.667 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.668 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.668 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:26133 5.5 5:a365a85e:::benchmark_data_smithi001_23533_object26132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:47.668 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:41.688741+0000", 2024-09-17T02:20:47.668 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.9227023790000004, 2024-09-17T02:20:47.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015492462, 2024-09-17T02:20:47.668 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.668 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.668 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:47.668 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:47.668 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:47.668 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:47.669 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 26133 2024-09-17T02:20:47.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.669 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688741+0000", 2024-09-17T02:20:47.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688741+0000", 2024-09-17T02:20:47.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688741+0000", 2024-09-17T02:20:47.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9100000000000003e-07 2024-09-17T02:20:47.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688847+0000", 2024-09-17T02:20:47.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105612 2024-09-17T02:20:47.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688855+0000", 2024-09-17T02:20:47.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8359999999999992e-06 2024-09-17T02:20:47.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688860+0000", 2024-09-17T02:20:47.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6990000000000002e-06 2024-09-17T02:20:47.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688957+0000", 2024-09-17T02:20:47.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7384000000000001e-05 2024-09-17T02:20:47.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.689088+0000", 2024-09-17T02:20:47.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013131199999999999 2024-09-17T02:20:47.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:47.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.689211+0000", 2024-09-17T02:20:47.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012225499999999999 2024-09-17T02:20:47.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:47.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.691078+0000", 2024-09-17T02:20:47.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018674780000000001 2024-09-17T02:20:47.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:47.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.704135+0000", 2024-09-17T02:20:47.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013057302999999999 2024-09-17T02:20:47.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:47.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.704198+0000", 2024-09-17T02:20:47.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2551999999999993e-05 2024-09-17T02:20:47.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:47.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.704233+0000", 2024-09-17T02:20:47.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5240000000000001e-05 2024-09-17T02:20:47.674 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.674 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.674 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.674 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:47.674 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:20:47.674 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.0429799590000002, 2024-09-17T02:20:47.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:20:47.674 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.674 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.675 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:47.675 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:47.675 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:47.675 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:47.675 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:20:47.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.675 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:20:47.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:20:47.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:20:47.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:20:47.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:20:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:20:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:20:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:20:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:20:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:20:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:20:47.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:20:47.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:20:47.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:20:47.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:20:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:20:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:20:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:20:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:20:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:20:47.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:47.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:20:47.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:20:47.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:47.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:20:47.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:20:47.680 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.680 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.680 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.681 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:47.681 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:20:47.681 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.0390777089999998, 2024-09-17T02:20:47.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:20:47.681 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.681 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.681 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:47.681 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:47.681 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:47.681 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:47.681 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:20:47.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:20:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:20:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:20:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:20:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:20:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:20:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:20:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:20:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:20:47.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:20:47.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:20:47.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:20:47.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:20:47.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:20:47.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:47.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:20:47.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:20:47.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:47.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:20:47.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:20:47.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:47.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:20:47.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:20:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:20:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:20:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:20:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:20:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:31663 5.8 5:18a4daab:::benchmark_data_smithi001_23533_object31662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-17T02:20:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:43.631605+0000", 2024-09-17T02:20:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.9798380579999999, 2024-09-17T02:20:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017528834, 2024-09-17T02:20:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 31663 2024-09-17T02:20:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631605+0000", 2024-09-17T02:20:47.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631605+0000", 2024-09-17T02:20:47.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631606+0000", 2024-09-17T02:20:47.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:20:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631633+0000", 2024-09-17T02:20:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7455999999999999e-05 2024-09-17T02:20:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631640+0000", 2024-09-17T02:20:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8140000000000003e-06 2024-09-17T02:20:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631644+0000", 2024-09-17T02:20:47.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4790000000000001e-06 2024-09-17T02:20:47.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.636150+0000", 2024-09-17T02:20:47.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004506431 2024-09-17T02:20:47.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.636299+0000", 2024-09-17T02:20:47.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014900499999999999 2024-09-17T02:20:47.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:47.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.636448+0000", 2024-09-17T02:20:47.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000149087 2024-09-17T02:20:47.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:47.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.639522+0000", 2024-09-17T02:20:47.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030734600000000001 2024-09-17T02:20:47.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:47.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.649032+0000", 2024-09-17T02:20:47.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0095109129999999993 2024-09-17T02:20:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.649096+0000", 2024-09-17T02:20:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3702999999999996e-05 2024-09-17T02:20:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.649134+0000", 2024-09-17T02:20:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7706000000000001e-05 2024-09-17T02:20:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.693 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:40722 5.5 5:ac1614e8:::benchmark_data_smithi001_23533_object40721:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:47.693 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.032445+0000", 2024-09-17T02:20:47.693 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.57899788200000002, 2024-09-17T02:20:47.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015387025, 2024-09-17T02:20:47.693 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.693 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.693 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:47.693 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:47.693 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:47.693 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:47.693 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 40722 2024-09-17T02:20:47.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.693 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032445+0000", 2024-09-17T02:20:47.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032445+0000", 2024-09-17T02:20:47.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032446+0000", 2024-09-17T02:20:47.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5199999999999996e-07 2024-09-17T02:20:47.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032615+0000", 2024-09-17T02:20:47.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016943700000000001 2024-09-17T02:20:47.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032653+0000", 2024-09-17T02:20:47.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7706000000000001e-05 2024-09-17T02:20:47.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032671+0000", 2024-09-17T02:20:47.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8099999999999999e-05 2024-09-17T02:20:47.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.034226+0000", 2024-09-17T02:20:47.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001555117 2024-09-17T02:20:47.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.034353+0000", 2024-09-17T02:20:47.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012684799999999999 2024-09-17T02:20:47.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:47.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.034488+0000", 2024-09-17T02:20:47.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013460699999999999 2024-09-17T02:20:47.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:47.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.036330+0000", 2024-09-17T02:20:47.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001842394 2024-09-17T02:20:47.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.047724+0000", 2024-09-17T02:20:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011394025 2024-09-17T02:20:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.047794+0000", 2024-09-17T02:20:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9678000000000006e-05 2024-09-17T02:20:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.047832+0000", 2024-09-17T02:20:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8461000000000003e-05 2024-09-17T02:20:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.699 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.699 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:40723 5.6 5:643b6373:::benchmark_data_smithi001_23533_object40722:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:47.699 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.032685+0000", 2024-09-17T02:20:47.699 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.57875844499999995, 2024-09-17T02:20:47.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015122314, 2024-09-17T02:20:47.699 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.699 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.699 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:47.699 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:47.699 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:47.699 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:47.699 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 40723 2024-09-17T02:20:47.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.700 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032685+0000", 2024-09-17T02:20:47.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032685+0000", 2024-09-17T02:20:47.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032685+0000", 2024-09-17T02:20:47.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2200000000000004e-07 2024-09-17T02:20:47.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032730+0000", 2024-09-17T02:20:47.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4536999999999997e-05 2024-09-17T02:20:47.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032738+0000", 2024-09-17T02:20:47.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7689999999999996e-06 2024-09-17T02:20:47.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032743+0000", 2024-09-17T02:20:47.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5470000000000004e-06 2024-09-17T02:20:47.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032821+0000", 2024-09-17T02:20:47.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7614999999999995e-05 2024-09-17T02:20:47.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032973+0000", 2024-09-17T02:20:47.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015190399999999999 2024-09-17T02:20:47.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:47.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.033150+0000", 2024-09-17T02:20:47.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017728899999999999 2024-09-17T02:20:47.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:47.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.035449+0000", 2024-09-17T02:20:47.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022994080000000002 2024-09-17T02:20:47.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:47.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.047706+0000", 2024-09-17T02:20:47.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012256769000000001 2024-09-17T02:20:47.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:47.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.047769+0000", 2024-09-17T02:20:47.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2497999999999997e-05 2024-09-17T02:20:47.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:47.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.047807+0000", 2024-09-17T02:20:47.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8355999999999997e-05 2024-09-17T02:20:47.704 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.704 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:40725 5.0 5:00adeb50:::benchmark_data_smithi001_23533_object40724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.032768+0000", 2024-09-17T02:20:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.57867554099999996, 2024-09-17T02:20:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015538547, 2024-09-17T02:20:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 40725 2024-09-17T02:20:47.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.706 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032768+0000", 2024-09-17T02:20:47.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032768+0000", 2024-09-17T02:20:47.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032768+0000", 2024-09-17T02:20:47.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0100000000000005e-07 2024-09-17T02:20:47.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032795+0000", 2024-09-17T02:20:47.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6690999999999999e-05 2024-09-17T02:20:47.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032802+0000", 2024-09-17T02:20:47.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0469999999999996e-06 2024-09-17T02:20:47.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032807+0000", 2024-09-17T02:20:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3859999999999998e-06 2024-09-17T02:20:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032851+0000", 2024-09-17T02:20:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4051000000000002e-05 2024-09-17T02:20:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032971+0000", 2024-09-17T02:20:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000119824 2024-09-17T02:20:47.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:47.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.033084+0000", 2024-09-17T02:20:47.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000112496 2024-09-17T02:20:47.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:47.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.036163+0000", 2024-09-17T02:20:47.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030790610000000001 2024-09-17T02:20:47.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:47.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.048228+0000", 2024-09-17T02:20:47.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012065243999999999 2024-09-17T02:20:47.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:47.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.048274+0000", 2024-09-17T02:20:47.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5756e-05 2024-09-17T02:20:47.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:47.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.048306+0000", 2024-09-17T02:20:47.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2490000000000002e-05 2024-09-17T02:20:47.710 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.710 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.711 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.711 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:40734 5.3 5:c50da8da:::benchmark_data_smithi001_23533_object40733:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:47.711 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.037293+0000", 2024-09-17T02:20:47.711 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.57415048099999999, 2024-09-17T02:20:47.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015846585999999999, 2024-09-17T02:20:47.711 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.711 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.711 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:47.711 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:47.711 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:47.711 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 40734 2024-09-17T02:20:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037293+0000", 2024-09-17T02:20:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037293+0000", 2024-09-17T02:20:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037293+0000", 2024-09-17T02:20:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.61e-07 2024-09-17T02:20:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037420+0000", 2024-09-17T02:20:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012655300000000001 2024-09-17T02:20:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037428+0000", 2024-09-17T02:20:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.354e-06 2024-09-17T02:20:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037447+0000", 2024-09-17T02:20:47.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8374000000000001e-05 2024-09-17T02:20:47.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.038148+0000", 2024-09-17T02:20:47.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00070088699999999997 2024-09-17T02:20:47.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.038267+0000", 2024-09-17T02:20:47.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011923500000000001 2024-09-17T02:20:47.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:47.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.038382+0000", 2024-09-17T02:20:47.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011549599999999999 2024-09-17T02:20:47.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:47.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.051916+0000", 2024-09-17T02:20:47.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013533315000000001 2024-09-17T02:20:47.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:47.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.053054+0000", 2024-09-17T02:20:47.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001138053 2024-09-17T02:20:47.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:47.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.053101+0000", 2024-09-17T02:20:47.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7437e-05 2024-09-17T02:20:47.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:47.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.053139+0000", 2024-09-17T02:20:47.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8121000000000003e-05 2024-09-17T02:20:47.716 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.716 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.717 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.717 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:40737 5.8 5:1ce68324:::benchmark_data_smithi001_23533_object40736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:47.717 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.037456+0000", 2024-09-17T02:20:47.717 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.57398751199999998, 2024-09-17T02:20:47.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016032277000000001, 2024-09-17T02:20:47.717 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:47.717 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:47.717 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:47.717 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:47.717 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:47.717 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 40737 2024-09-17T02:20:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037456+0000", 2024-09-17T02:20:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037456+0000", 2024-09-17T02:20:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:47.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037456+0000", 2024-09-17T02:20:47.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2300000000000001e-07 2024-09-17T02:20:47.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:47.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037514+0000", 2024-09-17T02:20:47.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8094000000000003e-05 2024-09-17T02:20:47.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:47.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.047514+0000", 2024-09-17T02:20:47.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0099994690000000004 2024-09-17T02:20:47.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.047521+0000", 2024-09-17T02:20:47.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9160000000000004e-06 2024-09-17T02:20:47.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:47.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.047578+0000", 2024-09-17T02:20:47.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7482000000000003e-05 2024-09-17T02:20:47.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:47.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.047717+0000", 2024-09-17T02:20:47.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138517 2024-09-17T02:20:47.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:47.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.047867+0000", 2024-09-17T02:20:47.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015047899999999999 2024-09-17T02:20:47.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:47.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.051283+0000", 2024-09-17T02:20:47.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003415689 2024-09-17T02:20:47.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:47.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.053364+0000", 2024-09-17T02:20:47.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020809050000000001 2024-09-17T02:20:47.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:47.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.053410+0000", 2024-09-17T02:20:47.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6062e-05 2024-09-17T02:20:47.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:47.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:47.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:47.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.053488+0000", 2024-09-17T02:20:47.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8140999999999996e-05 2024-09-17T02:20:47.723 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.723 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.723 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.723 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:47.724 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:47.724 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:20:47.725 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:20:47.726 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:47.727+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:47.757 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T02:20:47.769 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 15 16 42575 42559 177.31 159.125 0.00384831 0.00563361 2024-09-17T02:20:47.826 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:47.824+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:47.886 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:20:47.887 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-17T02:20:47.887 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.887 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:42857 5.7 5:ebfac478:::benchmark_data_smithi001_23533_object42856:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:47.887 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:47.886837+0000", 2024-09-17T02:20:47.887 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0045478189999999998, 2024-09-17T02:20:47.887 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045676579999999996, 2024-09-17T02:20:47.887 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:47.887 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:47.887 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:47.887 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:47.887 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:47.887 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:47.887 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 42857 2024-09-17T02:20:47.888 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.888 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:47.888 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.888 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:47.888 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.886837+0000", 2024-09-17T02:20:47.888 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:47.888 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.888 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.888 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:47.888 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.886837+0000", 2024-09-17T02:20:47.888 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:47.888 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.888 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.888 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:47.889 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.886837+0000", 2024-09-17T02:20:47.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.879999999999999e-07 2024-09-17T02:20:47.889 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.889 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.889 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:47.889 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.886933+0000", 2024-09-17T02:20:47.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5237999999999999e-05 2024-09-17T02:20:47.889 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.889 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.889 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:47.889 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.886944+0000", 2024-09-17T02:20:47.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1637999999999999e-05 2024-09-17T02:20:47.889 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.889 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.890 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.890 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.886953+0000", 2024-09-17T02:20:47.890 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6119999999999999e-06 2024-09-17T02:20:47.890 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.890 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.890 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:47.890 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.887005+0000", 2024-09-17T02:20:47.890 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1993999999999997e-05 2024-09-17T02:20:47.890 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.890 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.890 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:47.890 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.887142+0000", 2024-09-17T02:20:47.890 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013720200000000001 2024-09-17T02:20:47.891 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.891 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.891 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:47.891 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.887278+0000", 2024-09-17T02:20:47.891 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013542099999999999 2024-09-17T02:20:47.891 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.891 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.891 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:47.891 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.890753+0000", 2024-09-17T02:20:47.891 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0034757730000000001 2024-09-17T02:20:47.891 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:47.891 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:47.892 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:47.892 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.892 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.892 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:42861 5.f 5:fa89a445:::benchmark_data_smithi001_23533_object42860:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:47.892 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:47.887240+0000", 2024-09-17T02:20:47.892 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0041447200000000002, 2024-09-17T02:20:47.892 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004214949, 2024-09-17T02:20:47.892 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:47.892 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:47.892 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:47.892 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:47.892 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:47.892 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:47.893 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 42861 2024-09-17T02:20:47.893 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.893 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:47.893 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.893 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:47.893 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.887240+0000", 2024-09-17T02:20:47.893 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:47.893 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.893 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.893 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:47.893 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.887240+0000", 2024-09-17T02:20:47.893 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:47.893 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.893 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.894 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:47.894 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.887240+0000", 2024-09-17T02:20:47.894 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7899999999999998e-07 2024-09-17T02:20:47.894 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.894 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.894 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:47.894 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.887279+0000", 2024-09-17T02:20:47.894 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8999999999999999e-05 2024-09-17T02:20:47.894 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.894 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.894 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:47.894 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.887289+0000", 2024-09-17T02:20:47.894 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0056e-05 2024-09-17T02:20:47.894 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.895 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.895 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.895 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.887296+0000", 2024-09-17T02:20:47.895 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4649999999999999e-06 2024-09-17T02:20:47.895 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.895 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.895 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:47.895 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.888894+0000", 2024-09-17T02:20:47.895 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015980460000000001 2024-09-17T02:20:47.895 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.895 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.895 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:47.895 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.888975+0000", 2024-09-17T02:20:47.895 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1458999999999994e-05 2024-09-17T02:20:47.896 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.896 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.896 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:47.896 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.889065+0000", 2024-09-17T02:20:47.896 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9771000000000005e-05 2024-09-17T02:20:47.896 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.896 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.896 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:47.896 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.890768+0000", 2024-09-17T02:20:47.896 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0017025899999999999 2024-09-17T02:20:47.896 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:47.896 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:47.896 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:47.897 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.897 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.897 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:42863 5.1 5:833cf005:::benchmark_data_smithi001_23533_object42862:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:47.897 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:47.887357+0000", 2024-09-17T02:20:47.897 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0040268719999999999, 2024-09-17T02:20:47.897 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004140866, 2024-09-17T02:20:47.897 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:47.897 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:47.897 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:47.897 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:47.897 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:47.897 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:47.897 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 42863 2024-09-17T02:20:47.898 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.898 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:47.898 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.898 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:47.898 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.887357+0000", 2024-09-17T02:20:47.898 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:47.898 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.898 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.898 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:47.898 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.887357+0000", 2024-09-17T02:20:47.898 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:47.898 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.898 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.898 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:47.899 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.887358+0000", 2024-09-17T02:20:47.899 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7700000000000004e-07 2024-09-17T02:20:47.899 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.899 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.899 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:47.899 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.887400+0000", 2024-09-17T02:20:47.899 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2055000000000003e-05 2024-09-17T02:20:47.899 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.899 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.899 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:47.899 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.887409+0000", 2024-09-17T02:20:47.899 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6770000000000001e-06 2024-09-17T02:20:47.899 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.900 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.900 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.900 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.887424+0000", 2024-09-17T02:20:47.900 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5187999999999999e-05 2024-09-17T02:20:47.900 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.900 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.900 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:47.900 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.887483+0000", 2024-09-17T02:20:47.900 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9215000000000001e-05 2024-09-17T02:20:47.900 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.900 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.900 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:47.900 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.887628+0000", 2024-09-17T02:20:47.901 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014424300000000001 2024-09-17T02:20:47.901 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.901 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.901 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:47.901 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.887828+0000", 2024-09-17T02:20:47.901 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000200593 2024-09-17T02:20:47.901 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.901 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.901 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:47.901 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.890732+0000", 2024-09-17T02:20:47.901 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0029034769999999998 2024-09-17T02:20:47.901 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:47.901 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:47.902 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:47.902 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.902 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.902 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:42866 5.7 5:e9bb104c:::benchmark_data_smithi001_23533_object42865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:47.902 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:47.889156+0000", 2024-09-17T02:20:47.902 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0022285349999999998, 2024-09-17T02:20:47.902 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023856509999999999, 2024-09-17T02:20:47.902 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:47.902 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:47.902 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:47.902 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:47.902 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:47.902 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:47.903 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 42866 2024-09-17T02:20:47.903 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.903 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:47.903 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.903 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:47.903 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.889156+0000", 2024-09-17T02:20:47.903 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:47.903 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.903 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.903 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:47.903 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.889156+0000", 2024-09-17T02:20:47.903 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:47.903 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.903 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.904 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:47.904 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.889157+0000", 2024-09-17T02:20:47.904 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.091e-06 2024-09-17T02:20:47.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.904 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.904 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:47.904 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.889203+0000", 2024-09-17T02:20:47.904 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6238e-05 2024-09-17T02:20:47.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.904 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.904 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:47.904 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.889214+0000", 2024-09-17T02:20:47.904 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0891e-05 2024-09-17T02:20:47.905 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.905 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.905 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.905 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.889221+0000", 2024-09-17T02:20:47.905 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1509999999999998e-06 2024-09-17T02:20:47.905 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.905 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.905 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:47.905 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.889270+0000", 2024-09-17T02:20:47.905 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8971000000000003e-05 2024-09-17T02:20:47.905 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.905 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.905 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:47.906 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.889382+0000", 2024-09-17T02:20:47.906 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011213399999999999 2024-09-17T02:20:47.906 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.906 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.906 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:47.906 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.889471+0000", 2024-09-17T02:20:47.906 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9036999999999995e-05 2024-09-17T02:20:47.906 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:47.906 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:47.906 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:47.906 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.906 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.906 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:42869 5.5 e30/22 5:ae37fe6d:::benchmark_data_smithi001_23533_object42868:head v 30'2697, mlcod=30'2695)", 2024-09-17T02:20:47.906 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:47.891073+0000", 2024-09-17T02:20:47.907 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.00031104400000000001, 2024-09-17T02:20:47.907 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00050519699999999998, 2024-09-17T02:20:47.907 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:47.907 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:47.907 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:20:47.907 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:47.907 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.907 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:47.907 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.891073+0000", 2024-09-17T02:20:47.907 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:47.907 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.907 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.907 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:47.907 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.891073+0000", 2024-09-17T02:20:47.908 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:47.908 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.908 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.908 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:47.908 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.891074+0000", 2024-09-17T02:20:47.908 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8299999999999997e-07 2024-09-17T02:20:47.908 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.908 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.908 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:47.908 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.891138+0000", 2024-09-17T02:20:47.908 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4183999999999994e-05 2024-09-17T02:20:47.908 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.908 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.908 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:47.909 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.891145+0000", 2024-09-17T02:20:47.909 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7410000000000003e-06 2024-09-17T02:20:47.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.909 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:47.909 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.891152+0000", 2024-09-17T02:20:47.909 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9949999999999999e-06 2024-09-17T02:20:47.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.909 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:47.909 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.891208+0000", 2024-09-17T02:20:47.909 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.613e-05 2024-09-17T02:20:47.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:47.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:47.910 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:47.910 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:47.891227+0000", 2024-09-17T02:20:47.910 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8847000000000001e-05 2024-09-17T02:20:47.910 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:47.910 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:47.910 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:47.910 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:47.910 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-09-17T02:20:47.910 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 5 2024-09-17T02:20:47.910 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:20:47.911 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:20:47.926 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:47.931+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:48.020 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-17T02:20:48.020 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T02:20:48.021 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-09-17T02:20:48.021 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-09-17T02:20:48.028 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:48.031+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:48.041 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:20:48.123 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:20:48.123 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-17T02:20:48.123 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-09-17T02:20:48.123 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-09-17T02:20:48.123 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:20:48.128 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:48.131+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:48.145 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:20:48.205 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-09-17T02:20:48.213 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:20:48.213 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:20:48.229 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:48.231+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:48.232 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:20:48.233 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:20:48.251 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:20:48.252 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:20:48.302 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:48.302 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:48.322 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:20:48.330 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:48.328+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:48.366 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-09-17T02:20:48.431 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:48.432+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:48.475 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:48.475 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:48.495 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:20:48.538 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:48.543+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:48.633 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:48.635+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:48.654 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:48.654 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:48.675 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:20:48.734 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:48.732+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:48.754 INFO:teuthology.orchestra.run.smithi001.stderr:noscrub is unset 2024-09-17T02:20:48.769 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 16 16 45138 45122 176.239 160.188 0.00771832 0.00566956 2024-09-17T02:20:48.834 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:48.832+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:48.879 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:48.879 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:48.901 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:20:48.935 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:48.939+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:49.036 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:49.039+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:49.054 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:49.054 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:49.074 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:20:49.137 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:49.139+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:49.238 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:49.236+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:49.273 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:49.274 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:49.295 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:20:49.340 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:49.343+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:49.441 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:49.443+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:49.449 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:49.449 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:49.471 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:20:49.540 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:49.543+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:49.629 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:49.629 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:49.642 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:49.643+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:49.652 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:20:49.744 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:49.740+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:49.769 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 17 16 47526 47510 174.65 149.25 0.00723588 0.00572036 2024-09-17T02:20:49.817 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:49.817 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:49.837 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:20:49.881 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:49.880+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:49.945 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:49.947+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:50.037 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:50.037 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:50.045 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:50.048+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:50.056 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:20:50.147 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:50.152+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:50.226 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:50.226 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:50.247 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:20:50.248 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:50.252+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:50.271 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:20:50.348 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:50.352+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:50.403 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:50.403 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:50.425 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:20:50.439 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:20:50.439 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:20:50.448 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:50.452+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:50.459 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:20:50.459 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:20:50.477 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:20:50.477 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:20:50.549 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:50.551+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:50.587 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:20:50.587 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:20:50.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:20:50.587 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:20:50.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.587 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:50.587 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:20:50.587 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.035415092000001, 2024-09-17T02:20:50.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035535028000000003, 2024-09-17T02:20:50.587 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:50.587 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:50.588 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:50.588 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:50.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:50.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:20:50.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:50.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:20:50.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:50.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556550+0000", 2024-09-17T02:20:50.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3500000000000001e-06 2024-09-17T02:20:50.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:50.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556566+0000", 2024-09-17T02:20:50.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5440000000000001e-05 2024-09-17T02:20:50.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:50.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556594+0000", 2024-09-17T02:20:50.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8552999999999999e-05 2024-09-17T02:20:50.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556618+0000", 2024-09-17T02:20:50.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3207e-05 2024-09-17T02:20:50.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:50.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578337+0000", 2024-09-17T02:20:50.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021719517000000001 2024-09-17T02:20:50.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:50.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578655+0000", 2024-09-17T02:20:50.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031837800000000002 2024-09-17T02:20:50.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:50.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.581374+0000", 2024-09-17T02:20:50.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002718238 2024-09-17T02:20:50.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:50.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587083+0000", 2024-09-17T02:20:50.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005708912 2024-09-17T02:20:50.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:50.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591823+0000", 2024-09-17T02:20:50.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047406080000000003 2024-09-17T02:20:50.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:50.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591972+0000", 2024-09-17T02:20:50.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014874199999999999 2024-09-17T02:20:50.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:50.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592082+0000", 2024-09-17T02:20:50.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110083 2024-09-17T02:20:50.593 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.593 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:50.593 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.593 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:50.593 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:20:50.593 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.034473605000002, 2024-09-17T02:20:50.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035128756999999997, 2024-09-17T02:20:50.594 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:50.594 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:50.594 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:50.594 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:50.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:50.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:20:50.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:50.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:20:50.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:50.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557491+0000", 2024-09-17T02:20:50.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.88e-06 2024-09-17T02:20:50.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:50.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557504+0000", 2024-09-17T02:20:50.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2864000000000001e-05 2024-09-17T02:20:50.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:50.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557535+0000", 2024-09-17T02:20:50.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0916e-05 2024-09-17T02:20:50.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557561+0000", 2024-09-17T02:20:50.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5602999999999999e-05 2024-09-17T02:20:50.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:50.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582290+0000", 2024-09-17T02:20:50.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024729729999999998 2024-09-17T02:20:50.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:50.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582642+0000", 2024-09-17T02:20:50.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035143499999999999 2024-09-17T02:20:50.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:50.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582959+0000", 2024-09-17T02:20:50.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031747399999999999 2024-09-17T02:20:50.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:50.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587302+0000", 2024-09-17T02:20:50.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043425169999999997 2024-09-17T02:20:50.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:50.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592391+0000", 2024-09-17T02:20:50.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050895799999999998 2024-09-17T02:20:50.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:50.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592516+0000", 2024-09-17T02:20:50.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012420500000000001 2024-09-17T02:20:50.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:50.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592617+0000", 2024-09-17T02:20:50.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010155299999999999 2024-09-17T02:20:50.599 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.599 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:50.599 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.600 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:50.600 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:20:50.600 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.034369106, 2024-09-17T02:20:50.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034796066, 2024-09-17T02:20:50.600 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:50.600 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:50.600 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:50.600 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:50.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:50.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:20:50.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:50.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:20:50.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:50.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557594+0000", 2024-09-17T02:20:50.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3769999999999999e-06 2024-09-17T02:20:50.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:50.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557683+0000", 2024-09-17T02:20:50.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8896999999999999e-05 2024-09-17T02:20:50.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:50.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557707+0000", 2024-09-17T02:20:50.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3839e-05 2024-09-17T02:20:50.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557730+0000", 2024-09-17T02:20:50.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3047000000000001e-05 2024-09-17T02:20:50.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:50.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582329+0000", 2024-09-17T02:20:50.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024599283999999999 2024-09-17T02:20:50.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:50.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582624+0000", 2024-09-17T02:20:50.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000294462 2024-09-17T02:20:50.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:50.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582936+0000", 2024-09-17T02:20:50.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031223399999999999 2024-09-17T02:20:50.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:50.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587347+0000", 2024-09-17T02:20:50.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044110340000000003 2024-09-17T02:20:50.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:50.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592165+0000", 2024-09-17T02:20:50.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048176699999999996 2024-09-17T02:20:50.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:50.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592311+0000", 2024-09-17T02:20:50.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014661899999999999 2024-09-17T02:20:50.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:50.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592389+0000", 2024-09-17T02:20:50.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7602999999999995e-05 2024-09-17T02:20:50.605 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.606 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:50.606 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.606 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:50.606 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:20:50.606 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.033851478999999, 2024-09-17T02:20:50.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034457472000000003, 2024-09-17T02:20:50.606 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:50.607 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:50.607 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:50.607 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:50.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:50.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:20:50.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:50.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:20:50.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:50.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558113+0000", 2024-09-17T02:20:50.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1639999999999999e-06 2024-09-17T02:20:50.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:50.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558125+0000", 2024-09-17T02:20:50.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2269999999999999e-05 2024-09-17T02:20:50.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:50.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558458+0000", 2024-09-17T02:20:50.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033322700000000001 2024-09-17T02:20:50.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558488+0000", 2024-09-17T02:20:50.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.951e-05 2024-09-17T02:20:50.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:50.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584514+0000", 2024-09-17T02:20:50.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026025721000000002 2024-09-17T02:20:50.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:50.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584781+0000", 2024-09-17T02:20:50.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000267142 2024-09-17T02:20:50.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:50.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585078+0000", 2024-09-17T02:20:50.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029738799999999999 2024-09-17T02:20:50.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:50.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588045+0000", 2024-09-17T02:20:50.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029673759999999999 2024-09-17T02:20:50.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:50.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592454+0000", 2024-09-17T02:20:50.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044090209999999999 2024-09-17T02:20:50.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:50.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592520+0000", 2024-09-17T02:20:50.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6032999999999996e-05 2024-09-17T02:20:50.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:50.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592568+0000", 2024-09-17T02:20:50.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7620000000000001e-05 2024-09-17T02:20:50.612 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.612 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:50.612 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.612 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:50.612 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:20:50.612 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.033391227999999, 2024-09-17T02:20:50.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031603266999999997, 2024-09-17T02:20:50.612 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:50.612 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:50.612 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:50.613 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:50.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:50.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:20:50.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:50.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:20:50.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:50.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558573+0000", 2024-09-17T02:20:50.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0660000000000002e-06 2024-09-17T02:20:50.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:50.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558585+0000", 2024-09-17T02:20:50.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1596999999999999e-05 2024-09-17T02:20:50.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:50.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558612+0000", 2024-09-17T02:20:50.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7115999999999999e-05 2024-09-17T02:20:50.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558631+0000", 2024-09-17T02:20:50.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9519999999999999e-05 2024-09-17T02:20:50.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:50.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558783+0000", 2024-09-17T02:20:50.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152025 2024-09-17T02:20:50.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-17T02:20:50.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558798+0000", 2024-09-17T02:20:50.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4966999999999999e-05 2024-09-17T02:20:50.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:50.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.572871+0000", 2024-09-17T02:20:50.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014072782000000001 2024-09-17T02:20:50.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:50.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573153+0000", 2024-09-17T02:20:50.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028214499999999998 2024-09-17T02:20:50.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:50.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573432+0000", 2024-09-17T02:20:50.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027932100000000002 2024-09-17T02:20:50.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:50.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582279+0000", 2024-09-17T02:20:50.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0088463310000000007 2024-09-17T02:20:50.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:50.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.589902+0000", 2024-09-17T02:20:50.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0076236050000000003 2024-09-17T02:20:50.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:50.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.589997+0000", 2024-09-17T02:20:50.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4456000000000005e-05 2024-09-17T02:20:50.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:50.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590174+0000", 2024-09-17T02:20:50.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000177336 2024-09-17T02:20:50.619 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.619 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:50.619 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.619 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:50.619 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:20:50.619 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.033287983000001, 2024-09-17T02:20:50.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031899064999999997, 2024-09-17T02:20:50.619 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:50.619 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:50.619 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:50.619 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:50.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:50.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:20:50.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:50.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:20:50.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:50.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558676+0000", 2024-09-17T02:20:50.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.39e-06 2024-09-17T02:20:50.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:50.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558686+0000", 2024-09-17T02:20:50.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.022e-05 2024-09-17T02:20:50.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:50.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558708+0000", 2024-09-17T02:20:50.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2249999999999999e-05 2024-09-17T02:20:50.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558725+0000", 2024-09-17T02:20:50.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7387000000000001e-05 2024-09-17T02:20:50.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:50.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558940+0000", 2024-09-17T02:20:50.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021453800000000001 2024-09-17T02:20:50.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting_for_map not empty", 2024-09-17T02:20:50.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558951+0000", 2024-09-17T02:20:50.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1303e-05 2024-09-17T02:20:50.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:50.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576237+0000", 2024-09-17T02:20:50.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017285723999999999 2024-09-17T02:20:50.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:50.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576454+0000", 2024-09-17T02:20:50.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021673800000000001 2024-09-17T02:20:50.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:50.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576932+0000", 2024-09-17T02:20:50.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047792700000000001 2024-09-17T02:20:50.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:50.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585689+0000", 2024-09-17T02:20:50.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0087572880000000002 2024-09-17T02:20:50.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:50.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590287+0000", 2024-09-17T02:20:50.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045978060000000003 2024-09-17T02:20:50.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:50.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590447+0000", 2024-09-17T02:20:50.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000160719 2024-09-17T02:20:50.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:50.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590573+0000", 2024-09-17T02:20:50.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012577500000000001 2024-09-17T02:20:50.627 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.627 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:50.627 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.627 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:50.627 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:20:50.628 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.033210013000001, 2024-09-17T02:20:50.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034114029999999997, 2024-09-17T02:20:50.628 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:50.628 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:50.628 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:50.628 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:50.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:50.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:20:50.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:50.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:20:50.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:50.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558753+0000", 2024-09-17T02:20:50.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2699999999999999e-06 2024-09-17T02:20:50.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:50.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558769+0000", 2024-09-17T02:20:50.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5906e-05 2024-09-17T02:20:50.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:50.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558791+0000", 2024-09-17T02:20:50.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1342999999999999e-05 2024-09-17T02:20:50.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558806+0000", 2024-09-17T02:20:50.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5829999999999999e-05 2024-09-17T02:20:50.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:50.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584906+0000", 2024-09-17T02:20:50.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026099273999999999 2024-09-17T02:20:50.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:50.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585158+0000", 2024-09-17T02:20:50.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025194600000000002 2024-09-17T02:20:50.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:50.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585368+0000", 2024-09-17T02:20:50.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210068 2024-09-17T02:20:50.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:50.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588098+0000", 2024-09-17T02:20:50.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002730522 2024-09-17T02:20:50.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:50.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592680+0000", 2024-09-17T02:20:50.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045816019999999997 2024-09-17T02:20:50.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:50.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592774+0000", 2024-09-17T02:20:50.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3726000000000004e-05 2024-09-17T02:20:50.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:50.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592866+0000", 2024-09-17T02:20:50.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2542999999999998e-05 2024-09-17T02:20:50.633 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.633 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:50.633 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.634 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:50.634 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:20:50.634 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.033133710000001, 2024-09-17T02:20:50.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031407875000000002, 2024-09-17T02:20:50.634 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:50.634 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:50.634 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:50.634 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:50.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:50.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:20:50.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:50.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:20:50.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:50.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558830+0000", 2024-09-17T02:20:50.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3599999999999999e-06 2024-09-17T02:20:50.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:50.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558835+0000", 2024-09-17T02:20:50.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6130000000000003e-06 2024-09-17T02:20:50.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:50.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558853+0000", 2024-09-17T02:20:50.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8099999999999999e-05 2024-09-17T02:20:50.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558869+0000", 2024-09-17T02:20:50.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.59e-05 2024-09-17T02:20:50.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:50.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560437+0000", 2024-09-17T02:20:50.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015677989999999999 2024-09-17T02:20:50.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-17T02:20:50.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560453+0000", 2024-09-17T02:20:50.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.535e-05 2024-09-17T02:20:50.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:50.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562422+0000", 2024-09-17T02:20:50.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00196934 2024-09-17T02:20:50.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:50.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562773+0000", 2024-09-17T02:20:50.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035152399999999998 2024-09-17T02:20:50.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:50.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590236+0000", 2024-09-17T02:20:50.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.027462889000000001 2024-09-17T02:20:50.638 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.638 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:50.638 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.639 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:6 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'1, mlcod=0'0)", 2024-09-17T02:20:50.639 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.559725+0000", 2024-09-17T02:20:50.639 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.032236713000003, 2024-09-17T02:20:50.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015153534999999999, 2024-09-17T02:20:50.639 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:50.639 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:50.639 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:50.639 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:50.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:50.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559725+0000", 2024-09-17T02:20:50.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:50.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559725+0000", 2024-09-17T02:20:50.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:50.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559726+0000", 2024-09-17T02:20:50.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1699999999999997e-07 2024-09-17T02:20:50.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:50.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559736+0000", 2024-09-17T02:20:50.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8360000000000004e-06 2024-09-17T02:20:50.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:50.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559760+0000", 2024-09-17T02:20:50.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4130000000000001e-05 2024-09-17T02:20:50.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559778+0000", 2024-09-17T02:20:50.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7623000000000001e-05 2024-09-17T02:20:50.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:50.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.561459+0000", 2024-09-17T02:20:50.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001681552 2024-09-17T02:20:50.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:50.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.561506+0000", 2024-09-17T02:20:50.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6260000000000001e-05 2024-09-17T02:20:50.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:50.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.574779+0000", 2024-09-17T02:20:50.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013273691000000001 2024-09-17T02:20:50.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:50.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.574879+0000", 2024-09-17T02:20:50.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9625999999999998e-05 2024-09-17T02:20:50.643 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.643 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:50.643 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.644 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:50.644 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.560079+0000", 2024-09-17T02:20:50.644 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.031883215000001, 2024-09-17T02:20:50.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016073831, 2024-09-17T02:20:50.644 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:50.644 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:50.644 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:50.644 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:50.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:50.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560079+0000", 2024-09-17T02:20:50.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:50.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560079+0000", 2024-09-17T02:20:50.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:50.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560081+0000", 2024-09-17T02:20:50.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.266e-06 2024-09-17T02:20:50.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:50.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560090+0000", 2024-09-17T02:20:50.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2129999999999997e-06 2024-09-17T02:20:50.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:50.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560119+0000", 2024-09-17T02:20:50.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8932999999999999e-05 2024-09-17T02:20:50.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560145+0000", 2024-09-17T02:20:50.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6020000000000002e-05 2024-09-17T02:20:50.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:50.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.561833+0000", 2024-09-17T02:20:50.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016875659999999999 2024-09-17T02:20:50.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:50.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562199+0000", 2024-09-17T02:20:50.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036619000000000002 2024-09-17T02:20:50.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:50.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576153+0000", 2024-09-17T02:20:50.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013953643 2024-09-17T02:20:50.648 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.648 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:50.648 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.648 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:24 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'1, mlcod=0'0)", 2024-09-17T02:20:50.648 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.568621+0000", 2024-09-17T02:20:50.648 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.023341113000001, 2024-09-17T02:20:50.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015593332, 2024-09-17T02:20:50.648 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:50.648 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:50.649 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:50.649 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:50.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:50.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568621+0000", 2024-09-17T02:20:50.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:50.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568621+0000", 2024-09-17T02:20:50.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:50.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568622+0000", 2024-09-17T02:20:50.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1570000000000001e-06 2024-09-17T02:20:50.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:50.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568633+0000", 2024-09-17T02:20:50.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1093e-05 2024-09-17T02:20:50.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:50.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568654+0000", 2024-09-17T02:20:50.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1132999999999999e-05 2024-09-17T02:20:50.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568670+0000", 2024-09-17T02:20:50.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5307000000000001e-05 2024-09-17T02:20:50.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:50.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570935+0000", 2024-09-17T02:20:50.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022651609999999999 2024-09-17T02:20:50.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:50.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570980+0000", 2024-09-17T02:20:50.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5170000000000003e-05 2024-09-17T02:20:50.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:50.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584128+0000", 2024-09-17T02:20:50.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013148388 2024-09-17T02:20:50.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:50.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584214+0000", 2024-09-17T02:20:50.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5922999999999997e-05 2024-09-17T02:20:50.653 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.653 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:50.653 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.653 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:25 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'2, mlcod=0'0)", 2024-09-17T02:20:50.653 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.568721+0000", 2024-09-17T02:20:50.653 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.023241196999997, 2024-09-17T02:20:50.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015657030999999998, 2024-09-17T02:20:50.653 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:50.653 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:50.653 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:50.654 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:50.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:50.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568721+0000", 2024-09-17T02:20:50.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:50.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568721+0000", 2024-09-17T02:20:50.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:50.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568722+0000", 2024-09-17T02:20:50.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5600000000000004e-07 2024-09-17T02:20:50.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:50.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568742+0000", 2024-09-17T02:20:50.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0506999999999999e-05 2024-09-17T02:20:50.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:50.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568762+0000", 2024-09-17T02:20:50.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9423e-05 2024-09-17T02:20:50.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568777+0000", 2024-09-17T02:20:50.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5457000000000001e-05 2024-09-17T02:20:50.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:50.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.571705+0000", 2024-09-17T02:20:50.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029280130000000001 2024-09-17T02:20:50.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:50.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.571787+0000", 2024-09-17T02:20:50.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1509999999999997e-05 2024-09-17T02:20:50.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:50.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584296+0000", 2024-09-17T02:20:50.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012509398999999999 2024-09-17T02:20:50.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:50.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584378+0000", 2024-09-17T02:20:50.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1866000000000005e-05 2024-09-17T02:20:50.657 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.657 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:50.658 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.658 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:7 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'2, mlcod=0'0)", 2024-09-17T02:20:50.658 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.569013+0000", 2024-09-17T02:20:50.658 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.022949275999999, 2024-09-17T02:20:50.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015831576999999999, 2024-09-17T02:20:50.658 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:50.658 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:50.658 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:50.658 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:50.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:50.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569013+0000", 2024-09-17T02:20:50.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:50.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569013+0000", 2024-09-17T02:20:50.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:50.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569014+0000", 2024-09-17T02:20:50.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6000000000000002e-07 2024-09-17T02:20:50.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:50.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569024+0000", 2024-09-17T02:20:50.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8369999999999992e-06 2024-09-17T02:20:50.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:50.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570016+0000", 2024-09-17T02:20:50.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00099277000000000002 2024-09-17T02:20:50.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570040+0000", 2024-09-17T02:20:50.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3790000000000001e-05 2024-09-17T02:20:50.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:50.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570154+0000", 2024-09-17T02:20:50.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113689 2024-09-17T02:20:50.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:50.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570208+0000", 2024-09-17T02:20:50.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4305999999999998e-05 2024-09-17T02:20:50.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:50.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.583286+0000", 2024-09-17T02:20:50.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013077945000000001 2024-09-17T02:20:50.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:50.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584844+0000", 2024-09-17T02:20:50.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015583800000000001 2024-09-17T02:20:50.662 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.662 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:50.662 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.662 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:1248 5.e 5:7f482265:::benchmark_data_smithi001_23533_object1247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:50.662 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:33.170647+0000", 2024-09-17T02:20:50.662 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.421314794000001, 2024-09-17T02:20:50.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015727534000000001, 2024-09-17T02:20:50.662 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:50.663 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:50.663 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:50.663 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:50.663 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:50.663 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:50.663 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1248 2024-09-17T02:20:50.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.663 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:50.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:50.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170647+0000", 2024-09-17T02:20:50.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:50.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170647+0000", 2024-09-17T02:20:50.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:50.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170648+0000", 2024-09-17T02:20:50.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4000000000000002e-07 2024-09-17T02:20:50.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:50.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170691+0000", 2024-09-17T02:20:50.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2722000000000002e-05 2024-09-17T02:20:50.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:50.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170699+0000", 2024-09-17T02:20:50.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1540000000000002e-06 2024-09-17T02:20:50.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170704+0000", 2024-09-17T02:20:50.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1290000000000004e-06 2024-09-17T02:20:50.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:50.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.171489+0000", 2024-09-17T02:20:50.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00078564599999999998 2024-09-17T02:20:50.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:50.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.171653+0000", 2024-09-17T02:20:50.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163027 2024-09-17T02:20:50.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:50.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.171797+0000", 2024-09-17T02:20:50.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000144828 2024-09-17T02:20:50.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:50.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.172344+0000", 2024-09-17T02:20:50.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054687599999999996 2024-09-17T02:20:50.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:50.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.186281+0000", 2024-09-17T02:20:50.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013936755 2024-09-17T02:20:50.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:50.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.186338+0000", 2024-09-17T02:20:50.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6598000000000003e-05 2024-09-17T02:20:50.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:50.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.186375+0000", 2024-09-17T02:20:50.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7258999999999997e-05 2024-09-17T02:20:50.668 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.668 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:50.668 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.668 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28720 5.f e28/22 5:f8a7aea5:::benchmark_data_smithi001_23533_object28719:head v 28'1756, mlcod=28'1754)", 2024-09-17T02:20:50.668 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:20:50.669 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.0218422129999993, 2024-09-17T02:20:50.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033308717000000002, 2024-09-17T02:20:50.669 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:50.669 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:50.669 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:50.669 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:50.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:50.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:20:50.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:50.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:20:50.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:50.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570121+0000", 2024-09-17T02:20:50.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4e-07 2024-09-17T02:20:50.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:50.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570208+0000", 2024-09-17T02:20:50.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6945000000000002e-05 2024-09-17T02:20:50.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:50.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570222+0000", 2024-09-17T02:20:50.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4541e-05 2024-09-17T02:20:50.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570232+0000", 2024-09-17T02:20:50.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3039999999999994e-06 2024-09-17T02:20:50.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:50.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570273+0000", 2024-09-17T02:20:50.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1950999999999999e-05 2024-09-17T02:20:50.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:50.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570286+0000", 2024-09-17T02:20:50.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2268e-05 2024-09-17T02:20:50.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:50.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603312+0000", 2024-09-17T02:20:50.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033026405000000002 2024-09-17T02:20:50.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:50.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603429+0000", 2024-09-17T02:20:50.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116463 2024-09-17T02:20:50.673 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.673 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:50.673 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.673 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28721 5.a e28/22 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head v 28'1872, mlcod=28'1869)", 2024-09-17T02:20:50.674 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:20:50.674 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.0216987070000005, 2024-09-17T02:20:50.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033539817999999999, 2024-09-17T02:20:50.674 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:50.674 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:50.674 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:50.674 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:50.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:50.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:20:50.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:50.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:20:50.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:50.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570264+0000", 2024-09-17T02:20:50.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0999999999999997e-07 2024-09-17T02:20:50.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:50.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570299+0000", 2024-09-17T02:20:50.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4876999999999998e-05 2024-09-17T02:20:50.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:50.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570310+0000", 2024-09-17T02:20:50.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0958000000000001e-05 2024-09-17T02:20:50.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570316+0000", 2024-09-17T02:20:50.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.485e-06 2024-09-17T02:20:50.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:50.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598947+0000", 2024-09-17T02:20:50.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.028631058000000001 2024-09-17T02:20:50.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:50.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598969+0000", 2024-09-17T02:20:50.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2005999999999999e-05 2024-09-17T02:20:50.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:50.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.602638+0000", 2024-09-17T02:20:50.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036690339999999998 2024-09-17T02:20:50.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:50.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603803+0000", 2024-09-17T02:20:50.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00116559 2024-09-17T02:20:50.678 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.678 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:50.678 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.678 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28723 5.f e28/22 5:f1a2a8f6:::benchmark_data_smithi001_23533_object28722:head v 28'1757, mlcod=28'1754)", 2024-09-17T02:20:50.679 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.571446+0000", 2024-09-17T02:20:50.679 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.020516379, 2024-09-17T02:20:50.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.032047203000000003, 2024-09-17T02:20:50.679 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:50.679 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:50.679 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:50.679 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:50.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:50.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571446+0000", 2024-09-17T02:20:50.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:50.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571446+0000", 2024-09-17T02:20:50.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:50.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571447+0000", 2024-09-17T02:20:50.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0979999999999999e-06 2024-09-17T02:20:50.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:50.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571554+0000", 2024-09-17T02:20:50.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107464 2024-09-17T02:20:50.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:50.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598891+0000", 2024-09-17T02:20:50.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.027336905000000002 2024-09-17T02:20:50.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598905+0000", 2024-09-17T02:20:50.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:20:50.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:50.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.600343+0000", 2024-09-17T02:20:50.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014382100000000001 2024-09-17T02:20:50.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:50.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.600387+0000", 2024-09-17T02:20:50.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3398e-05 2024-09-17T02:20:50.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:50.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603443+0000", 2024-09-17T02:20:50.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030562250000000001 2024-09-17T02:20:50.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:50.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603493+0000", 2024-09-17T02:20:50.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9820000000000001e-05 2024-09-17T02:20:50.683 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.683 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:50.683 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.683 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:40724 5.e 5:78fee04a:::benchmark_data_smithi001_23533_object40723:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:50.683 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:47.033267+0000", 2024-09-17T02:20:50.683 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.5586947929999999, 2024-09-17T02:20:50.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015687298999999998, 2024-09-17T02:20:50.684 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:50.684 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:50.684 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:50.684 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:50.684 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:50.684 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:50.684 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 40724 2024-09-17T02:20:50.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.684 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:50.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:50.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033267+0000", 2024-09-17T02:20:50.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:50.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033267+0000", 2024-09-17T02:20:50.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:50.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033268+0000", 2024-09-17T02:20:50.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.119e-06 2024-09-17T02:20:50.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:50.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033371+0000", 2024-09-17T02:20:50.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010283100000000001 2024-09-17T02:20:50.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:50.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033382+0000", 2024-09-17T02:20:50.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0655e-05 2024-09-17T02:20:50.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033389+0000", 2024-09-17T02:20:50.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2880000000000004e-06 2024-09-17T02:20:50.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:50.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033467+0000", 2024-09-17T02:20:50.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8091999999999997e-05 2024-09-17T02:20:50.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:50.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033660+0000", 2024-09-17T02:20:50.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019242799999999999 2024-09-17T02:20:50.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:50.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033807+0000", 2024-09-17T02:20:50.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000147436 2024-09-17T02:20:50.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:50.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.035370+0000", 2024-09-17T02:20:50.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001563257 2024-09-17T02:20:50.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:50.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.048889+0000", 2024-09-17T02:20:50.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013518835 2024-09-17T02:20:50.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:50.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.048925+0000", 2024-09-17T02:20:50.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5645000000000002e-05 2024-09-17T02:20:50.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:50.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.048955+0000", 2024-09-17T02:20:50.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9713000000000002e-05 2024-09-17T02:20:50.689 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.689 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:50.689 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.690 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:40730 5.b 5:d64b1dc0:::benchmark_data_smithi001_23533_object40729:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:50.690 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:20:50.690 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.5541945410000002, 2024-09-17T02:20:50.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016675972000000001, 2024-09-17T02:20:50.690 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:50.690 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:50.690 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:50.690 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:50.690 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:50.690 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:50.690 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 40730 2024-09-17T02:20:50.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.690 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:50.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:50.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:20:50.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:50.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:20:50.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:50.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:20:50.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5700000000000002e-07 2024-09-17T02:20:50.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:50.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037813+0000", 2024-09-17T02:20:50.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4880999999999999e-05 2024-09-17T02:20:50.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:50.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037820+0000", 2024-09-17T02:20:50.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.34e-06 2024-09-17T02:20:50.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037825+0000", 2024-09-17T02:20:50.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1420000000000003e-06 2024-09-17T02:20:50.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:50.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.039167+0000", 2024-09-17T02:20:50.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013427529999999999 2024-09-17T02:20:50.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:50.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.039293+0000", 2024-09-17T02:20:50.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000125248 2024-09-17T02:20:50.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:50.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.039442+0000", 2024-09-17T02:20:50.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014929799999999999 2024-09-17T02:20:50.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:50.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.041694+0000", 2024-09-17T02:20:50.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002252324 2024-09-17T02:20:50.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:50.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054324+0000", 2024-09-17T02:20:50.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012629782000000001 2024-09-17T02:20:50.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:50.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054393+0000", 2024-09-17T02:20:50.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9295999999999995e-05 2024-09-17T02:20:50.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:50.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054444+0000", 2024-09-17T02:20:50.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0250999999999997e-05 2024-09-17T02:20:50.695 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.696 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:50.696 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.696 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:40735 5.b 5:df8fd62b:::benchmark_data_smithi001_23533_object40734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:50.696 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:47.038253+0000", 2024-09-17T02:20:50.696 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.5537088409999997, 2024-09-17T02:20:50.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016368369000000001, 2024-09-17T02:20:50.696 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:50.696 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:50.696 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:50.696 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:50.697 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:50.697 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:50.697 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 40735 2024-09-17T02:20:50.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.697 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:50.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:50.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038253+0000", 2024-09-17T02:20:50.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:50.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038253+0000", 2024-09-17T02:20:50.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:50.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:50.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038254+0000", 2024-09-17T02:20:50.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.23e-07 2024-09-17T02:20:50.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:50.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038420+0000", 2024-09-17T02:20:50.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016617499999999999 2024-09-17T02:20:50.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:50.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038432+0000", 2024-09-17T02:20:50.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1406000000000001e-05 2024-09-17T02:20:50.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038439+0000", 2024-09-17T02:20:50.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7200000000000006e-06 2024-09-17T02:20:50.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:50.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.040422+0000", 2024-09-17T02:20:50.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019828530000000001 2024-09-17T02:20:50.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:50.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.040581+0000", 2024-09-17T02:20:50.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159238 2024-09-17T02:20:50.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:50.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.040744+0000", 2024-09-17T02:20:50.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016255800000000001 2024-09-17T02:20:50.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:50.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.041971+0000", 2024-09-17T02:20:50.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001226551 2024-09-17T02:20:50.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:50.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054500+0000", 2024-09-17T02:20:50.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012529676 2024-09-17T02:20:50.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:50.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054570+0000", 2024-09-17T02:20:50.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9253999999999998e-05 2024-09-17T02:20:50.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:50.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:50.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:50.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054622+0000", 2024-09-17T02:20:50.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2114999999999998e-05 2024-09-17T02:20:50.702 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.702 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:50.702 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.702 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:50.702 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:50.702 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:20:50.704 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:20:50.704 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:50.707+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:50.770 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 18 16 49902 49886 173.197 148.5 0.00553642 0.00576886 2024-09-17T02:20:50.780 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T02:20:50.804 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:50.807+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:50.858 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:20:50.859 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:20:50.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.859 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:50096 5.e e31/22 5:7091218e:::benchmark_data_smithi001_23533_object50095:head v 31'3186, mlcod=31'3183)", 2024-09-17T02:20:50.859 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:50.859364+0000", 2024-09-17T02:20:50.859 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0041604090000000003, 2024-09-17T02:20:50.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041761949999999997, 2024-09-17T02:20:50.859 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:50.859 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:50.859 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:50.859 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:50.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:50.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.859364+0000", 2024-09-17T02:20:50.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:50.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:50.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.859364+0000", 2024-09-17T02:20:50.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:50.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:50.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.859365+0000", 2024-09-17T02:20:50.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4199999999999995e-07 2024-09-17T02:20:50.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:50.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.859441+0000", 2024-09-17T02:20:50.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6505e-05 2024-09-17T02:20:50.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:50.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.859451+0000", 2024-09-17T02:20:50.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1009999999999998e-06 2024-09-17T02:20:50.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.859463+0000", 2024-09-17T02:20:50.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2266000000000001e-05 2024-09-17T02:20:50.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:50.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.859604+0000", 2024-09-17T02:20:50.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014122599999999999 2024-09-17T02:20:50.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:50.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.859621+0000", 2024-09-17T02:20:50.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7138000000000001e-05 2024-09-17T02:20:50.862 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:50100 5.1 e31/22 5:8063b55c:::benchmark_data_smithi001_23533_object50099:head v 31'3037, mlcod=31'3035)", 2024-09-17T02:20:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:50.859612+0000", 2024-09-17T02:20:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0039125059999999996, 2024-09-17T02:20:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039656140000000001, 2024-09-17T02:20:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:50.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.859612+0000", 2024-09-17T02:20:50.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:50.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:50.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.859612+0000", 2024-09-17T02:20:50.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:50.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:50.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.859613+0000", 2024-09-17T02:20:50.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9699999999999996e-07 2024-09-17T02:20:50.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:50.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.859666+0000", 2024-09-17T02:20:50.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3711000000000001e-05 2024-09-17T02:20:50.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:50.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.859673+0000", 2024-09-17T02:20:50.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4540000000000004e-06 2024-09-17T02:20:50.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.859678+0000", 2024-09-17T02:20:50.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0270000000000003e-06 2024-09-17T02:20:50.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:50.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.859720+0000", 2024-09-17T02:20:50.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2187000000000001e-05 2024-09-17T02:20:50.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:50.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.859733+0000", 2024-09-17T02:20:50.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2951e-05 2024-09-17T02:20:50.866 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:50.866 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:50.866 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:50.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.867 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:50102 5.5 5:abdd9716:::benchmark_data_smithi001_23533_object50101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-17T02:20:50.867 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:50.861137+0000", 2024-09-17T02:20:50.867 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0023873200000000001, 2024-09-17T02:20:50.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024919529999999999, 2024-09-17T02:20:50.867 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:50.867 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:50.867 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:50.867 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:50.867 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:50.867 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:50.867 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 50102 2024-09-17T02:20:50.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.868 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:50.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:50.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.861137+0000", 2024-09-17T02:20:50.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:50.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:50.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.861137+0000", 2024-09-17T02:20:50.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:50.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:50.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.861139+0000", 2024-09-17T02:20:50.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.24e-06 2024-09-17T02:20:50.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:50.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.861233+0000", 2024-09-17T02:20:50.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4852000000000006e-05 2024-09-17T02:20:50.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:50.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.861247+0000", 2024-09-17T02:20:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3529999999999999e-05 2024-09-17T02:20:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.861255+0000", 2024-09-17T02:20:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7559999999999999e-06 2024-09-17T02:20:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.861300+0000", 2024-09-17T02:20:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5197000000000001e-05 2024-09-17T02:20:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:50.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.861390+0000", 2024-09-17T02:20:50.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9757000000000001e-05 2024-09-17T02:20:50.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:50.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.861468+0000", 2024-09-17T02:20:50.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8039000000000003e-05 2024-09-17T02:20:50.871 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:50.871 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:50.871 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:50.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.871 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:50103 5.5 5:afc558e0:::benchmark_data_smithi001_23533_object50102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-17T02:20:50.871 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:50.861293+0000", 2024-09-17T02:20:50.872 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0022320320000000001, 2024-09-17T02:20:50.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023775010000000002, 2024-09-17T02:20:50.872 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:50.872 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:50.872 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:50.872 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:50.872 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:50.872 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:50.872 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 50103 2024-09-17T02:20:50.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.872 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:50.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:50.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.861293+0000", 2024-09-17T02:20:50.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:50.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:50.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.861293+0000", 2024-09-17T02:20:50.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:50.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:50.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.861293+0000", 2024-09-17T02:20:50.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4000000000000001e-07 2024-09-17T02:20:50.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:50.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.861394+0000", 2024-09-17T02:20:50.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010097100000000001 2024-09-17T02:20:50.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.861406+0000", 2024-09-17T02:20:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1798e-05 2024-09-17T02:20:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.861413+0000", 2024-09-17T02:20:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8199999999999999e-06 2024-09-17T02:20:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.862810+0000", 2024-09-17T02:20:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001396844 2024-09-17T02:20:50.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:50.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.862948+0000", 2024-09-17T02:20:50.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000137985 2024-09-17T02:20:50.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:50.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863060+0000", 2024-09-17T02:20:50.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000112421 2024-09-17T02:20:50.876 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:50.876 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:50.877 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:50.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.877 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:50104 5.8 5:14de7e7c:::benchmark_data_smithi001_23533_object50103:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-17T02:20:50.877 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:50.861426+0000", 2024-09-17T02:20:50.877 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0020990829999999999, 2024-09-17T02:20:50.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022852739999999999, 2024-09-17T02:20:50.877 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:50.877 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:50.877 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:50.877 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:50.877 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:50.877 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 50104 2024-09-17T02:20:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.861426+0000", 2024-09-17T02:20:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.861426+0000", 2024-09-17T02:20:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:50.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.861426+0000", 2024-09-17T02:20:50.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8299999999999997e-07 2024-09-17T02:20:50.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:50.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.861452+0000", 2024-09-17T02:20:50.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6111000000000001e-05 2024-09-17T02:20:50.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:50.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.861460+0000", 2024-09-17T02:20:50.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1680000000000004e-06 2024-09-17T02:20:50.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.861467+0000", 2024-09-17T02:20:50.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1010000000000003e-06 2024-09-17T02:20:50.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:50.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.861510+0000", 2024-09-17T02:20:50.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2485999999999999e-05 2024-09-17T02:20:50.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:50.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.861604+0000", 2024-09-17T02:20:50.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4063999999999999e-05 2024-09-17T02:20:50.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:50.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.861681+0000", 2024-09-17T02:20:50.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7318999999999996e-05 2024-09-17T02:20:50.881 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:50.881 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:50.881 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:50.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.881 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:50105 5.2 e31/22 5:482b3c79:::benchmark_data_smithi001_23533_object50104:head v 31'3165, mlcod=31'3163)", 2024-09-17T02:20:50.881 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:50.862182+0000", 2024-09-17T02:20:50.881 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001342228, 2024-09-17T02:20:50.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001566682, 2024-09-17T02:20:50.882 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:50.882 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:50.882 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:50.882 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:50.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:50.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.862182+0000", 2024-09-17T02:20:50.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:50.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:50.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.862182+0000", 2024-09-17T02:20:50.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:50.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:50.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.862183+0000", 2024-09-17T02:20:50.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0200000000000002e-07 2024-09-17T02:20:50.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:50.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.862240+0000", 2024-09-17T02:20:50.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7018000000000002e-05 2024-09-17T02:20:50.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:50.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.862251+0000", 2024-09-17T02:20:50.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1374e-05 2024-09-17T02:20:50.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.862258+0000", 2024-09-17T02:20:50.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2439999999999998e-06 2024-09-17T02:20:50.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:50.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.862308+0000", 2024-09-17T02:20:50.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0807000000000003e-05 2024-09-17T02:20:50.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:50.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.862330+0000", 2024-09-17T02:20:50.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1739e-05 2024-09-17T02:20:50.885 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:50.885 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:50.885 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:50.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.885 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:50108 5.a 5:5e16a111:::benchmark_data_smithi001_23533_object50107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-17T02:20:50.885 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:50.863473+0000", 2024-09-17T02:20:50.885 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.1391000000000003e-05, 2024-09-17T02:20:50.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030895599999999999, 2024-09-17T02:20:50.885 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:50.886 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:50.886 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:50.886 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:50.886 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:50.886 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:50.886 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 50108 2024-09-17T02:20:50.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.886 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:50.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:50.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863473+0000", 2024-09-17T02:20:50.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:50.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:50.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863473+0000", 2024-09-17T02:20:50.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:50.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:50.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863474+0000", 2024-09-17T02:20:50.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9699999999999995e-07 2024-09-17T02:20:50.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:50.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863506+0000", 2024-09-17T02:20:50.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1489000000000003e-05 2024-09-17T02:20:50.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:50.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863514+0000", 2024-09-17T02:20:50.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1450000000000008e-06 2024-09-17T02:20:50.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863519+0000", 2024-09-17T02:20:50.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9880000000000004e-06 2024-09-17T02:20:50.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:50.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863567+0000", 2024-09-17T02:20:50.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8757000000000001e-05 2024-09-17T02:20:50.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:50.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863684+0000", 2024-09-17T02:20:50.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117056 2024-09-17T02:20:50.889 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:50.889 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:50.889 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:50.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.890 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:50107 5.e e31/22 5:7cbe4023:::benchmark_data_smithi001_23533_object50106:head v 31'3187, mlcod=31'3183)", 2024-09-17T02:20:50.890 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:50.863547+0000", 2024-09-17T02:20:50.890 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9999776, 2024-09-17T02:20:50.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027177499999999998, 2024-09-17T02:20:50.890 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:50.890 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:50.890 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:50.890 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:50.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:50.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863547+0000", 2024-09-17T02:20:50.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:50.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:50.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863547+0000", 2024-09-17T02:20:50.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:50.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:50.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863547+0000", 2024-09-17T02:20:50.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0199999999999998e-07 2024-09-17T02:20:50.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:50.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863568+0000", 2024-09-17T02:20:50.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0998000000000001e-05 2024-09-17T02:20:50.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:50.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863573+0000", 2024-09-17T02:20:50.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.887e-06 2024-09-17T02:20:50.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863577+0000", 2024-09-17T02:20:50.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4769999999999999e-06 2024-09-17T02:20:50.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:50.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863616+0000", 2024-09-17T02:20:50.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9913000000000002e-05 2024-09-17T02:20:50.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:50.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863633+0000", 2024-09-17T02:20:50.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6688999999999999e-05 2024-09-17T02:20:50.893 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:50.893 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:50.893 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:50.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.894 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4466.0:50104 5.8 e31/26)", 2024-09-17T02:20:50.894 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:50.863614+0000", 2024-09-17T02:20:50.894 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9999104, 2024-09-17T02:20:50.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024295299999999999, 2024-09-17T02:20:50.894 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:50.894 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:50.894 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-17T02:20:50.894 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:50.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:50.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863614+0000", 2024-09-17T02:20:50.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:50.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:50.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863614+0000", 2024-09-17T02:20:50.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:50.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:50.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863615+0000", 2024-09-17T02:20:50.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3099999999999999e-07 2024-09-17T02:20:50.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:50.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863617+0000", 2024-09-17T02:20:50.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.131e-06 2024-09-17T02:20:50.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:50.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863623+0000", 2024-09-17T02:20:50.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7690000000000002e-06 2024-09-17T02:20:50.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863627+0000", 2024-09-17T02:20:50.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4070000000000003e-06 2024-09-17T02:20:50.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:50.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863860+0000", 2024-09-17T02:20:50.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000232864 2024-09-17T02:20:50.897 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:50.897 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:50.897 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:50.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.897 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:50109 5.0 5.c9362590 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-17T02:20:50.897 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:50.863533+0000", 2024-09-17T02:20:50.897 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9999914, 2024-09-17T02:20:50.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00037889599999999999, 2024-09-17T02:20:50.898 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:50.898 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:50.898 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:20:50.898 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:50.898 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:50.898 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:50.898 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 50109 2024-09-17T02:20:50.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.898 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:50.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:50.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863533+0000", 2024-09-17T02:20:50.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:50.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:50.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863533+0000", 2024-09-17T02:20:50.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:50.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:50.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863533+0000", 2024-09-17T02:20:50.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.72e-07 2024-09-17T02:20:50.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:50.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863698+0000", 2024-09-17T02:20:50.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016478200000000001 2024-09-17T02:20:50.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:50.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863706+0000", 2024-09-17T02:20:50.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0779999999999996e-06 2024-09-17T02:20:50.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863712+0000", 2024-09-17T02:20:50.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8610000000000003e-06 2024-09-17T02:20:50.901 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:50.901 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:50.901 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:50.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.901 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:50098 5.8 5:1de72e00:::benchmark_data_smithi001_23533_object50097:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-17T02:20:50.901 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:50.858902+0000", 2024-09-17T02:20:50.901 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0046223000000000002, 2024-09-17T02:20:50.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050479089999999997, 2024-09-17T02:20:50.901 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:50.901 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:50.901 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:50.901 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:50.901 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:50.902 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:50.902 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 50098 2024-09-17T02:20:50.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.902 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:50.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:50.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.858902+0000", 2024-09-17T02:20:50.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:50.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:50.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.858902+0000", 2024-09-17T02:20:50.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:50.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:50.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.858904+0000", 2024-09-17T02:20:50.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.195e-06 2024-09-17T02:20:50.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:50.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.858985+0000", 2024-09-17T02:20:50.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1136000000000004e-05 2024-09-17T02:20:50.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:50.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.858999+0000", 2024-09-17T02:20:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3903999999999999e-05 2024-09-17T02:20:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.859008+0000", 2024-09-17T02:20:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9600000000000006e-06 2024-09-17T02:20:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.859062+0000", 2024-09-17T02:20:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4246000000000002e-05 2024-09-17T02:20:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:50.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.859195+0000", 2024-09-17T02:20:50.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013310899999999999 2024-09-17T02:20:50.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:50.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.859340+0000", 2024-09-17T02:20:50.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000144683 2024-09-17T02:20:50.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:50.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:50.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:50.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:50.863822+0000", 2024-09-17T02:20:50.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044824169999999998 2024-09-17T02:20:50.905 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:50.906 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:50.906 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:50.906 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:50.906 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:20:50.906 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 11 2024-09-17T02:20:50.906 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:20:50.907 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:20:50.908 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:50.911+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:51.008 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:51.012+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:51.105 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:20:51.105 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:20:51.105 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:20:51.105 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:20:51.105 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:20:51.109 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:51.111+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:51.126 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:20:51.210 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:51.212+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:51.283 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:20:51.283 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:20:51.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:20:51.283 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:20:51.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.283 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:51.283 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:20:51.284 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.724931449000003, 2024-09-17T02:20:51.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021799929999999999, 2024-09-17T02:20:51.284 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:51.284 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:51.284 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.284 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:51.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:51.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:20:51.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:51.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:20:51.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:51.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562007+0000", 2024-09-17T02:20:51.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6260000000000001e-06 2024-09-17T02:20:51.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:51.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562021+0000", 2024-09-17T02:20:51.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4440000000000001e-05 2024-09-17T02:20:51.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:51.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562053+0000", 2024-09-17T02:20:51.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2159000000000002e-05 2024-09-17T02:20:51.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562076+0000", 2024-09-17T02:20:51.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2926999999999999e-05 2024-09-17T02:20:51.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:51.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562218+0000", 2024-09-17T02:20:51.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000141726 2024-09-17T02:20:51.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:51.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562506+0000", 2024-09-17T02:20:51.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028752399999999999 2024-09-17T02:20:51.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:51.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562830+0000", 2024-09-17T02:20:51.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032427399999999999 2024-09-17T02:20:51.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:51.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566900+0000", 2024-09-17T02:20:51.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040705660000000003 2024-09-17T02:20:51.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583581+0000", 2024-09-17T02:20:51.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016680210000000001 2024-09-17T02:20:51.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:51.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583704+0000", 2024-09-17T02:20:51.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012289899999999999 2024-09-17T02:20:51.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:51.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583803+0000", 2024-09-17T02:20:51.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9579000000000003e-05 2024-09-17T02:20:51.289 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.289 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:51.289 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.289 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:51.289 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:20:51.289 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.724804237000001, 2024-09-17T02:20:51.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022056035000000002, 2024-09-17T02:20:51.290 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:51.290 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:51.290 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.290 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:51.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:51.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:20:51.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:51.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:20:51.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:51.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562132+0000", 2024-09-17T02:20:51.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6300000000000001e-06 2024-09-17T02:20:51.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:51.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562142+0000", 2024-09-17T02:20:51.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.022e-05 2024-09-17T02:20:51.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:51.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562164+0000", 2024-09-17T02:20:51.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2002999999999999e-05 2024-09-17T02:20:51.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562180+0000", 2024-09-17T02:20:51.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5930000000000002e-05 2024-09-17T02:20:51.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:51.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563517+0000", 2024-09-17T02:20:51.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001336776 2024-09-17T02:20:51.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:51.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563635+0000", 2024-09-17T02:20:51.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117976 2024-09-17T02:20:51.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:51.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563819+0000", 2024-09-17T02:20:51.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018411499999999999 2024-09-17T02:20:51.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:51.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566977+0000", 2024-09-17T02:20:51.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031575990000000001 2024-09-17T02:20:51.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583917+0000", 2024-09-17T02:20:51.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016940093999999999 2024-09-17T02:20:51.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:51.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584066+0000", 2024-09-17T02:20:51.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000149746 2024-09-17T02:20:51.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:51.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584186+0000", 2024-09-17T02:20:51.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011994600000000001 2024-09-17T02:20:51.295 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.295 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:51.295 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.295 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:51.295 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:20:51.295 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.724623526000002, 2024-09-17T02:20:51.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023664803000000002, 2024-09-17T02:20:51.296 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:51.296 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:51.296 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.296 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:51.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:51.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:20:51.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:51.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:20:51.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:51.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562313+0000", 2024-09-17T02:20:51.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.764e-06 2024-09-17T02:20:51.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:51.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562323+0000", 2024-09-17T02:20:51.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0166000000000001e-05 2024-09-17T02:20:51.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:51.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562343+0000", 2024-09-17T02:20:51.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9633999999999999e-05 2024-09-17T02:20:51.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562367+0000", 2024-09-17T02:20:51.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4556e-05 2024-09-17T02:20:51.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:51.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563777+0000", 2024-09-17T02:20:51.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014102330000000001 2024-09-17T02:20:51.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:51.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563969+0000", 2024-09-17T02:20:51.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000191361 2024-09-17T02:20:51.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:51.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564148+0000", 2024-09-17T02:20:51.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017934599999999999 2024-09-17T02:20:51.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:51.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566989+0000", 2024-09-17T02:20:51.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028407010000000002 2024-09-17T02:20:51.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585770+0000", 2024-09-17T02:20:51.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018781566999999999 2024-09-17T02:20:51.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:51.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585874+0000", 2024-09-17T02:20:51.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103489 2024-09-17T02:20:51.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:51.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585976+0000", 2024-09-17T02:20:51.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101986 2024-09-17T02:20:51.301 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.301 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:51.301 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.301 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:51.301 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:20:51.301 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.724540646000001, 2024-09-17T02:20:51.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024118555999999999, 2024-09-17T02:20:51.301 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:51.302 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:51.302 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.302 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:51.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:51.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:20:51.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:51.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:20:51.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:51.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562395+0000", 2024-09-17T02:20:51.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3969999999999999e-06 2024-09-17T02:20:51.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:51.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562405+0000", 2024-09-17T02:20:51.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4229999999999994e-06 2024-09-17T02:20:51.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:51.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562427+0000", 2024-09-17T02:20:51.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759999999999998e-05 2024-09-17T02:20:51.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562444+0000", 2024-09-17T02:20:51.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7019000000000001e-05 2024-09-17T02:20:51.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:51.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564681+0000", 2024-09-17T02:20:51.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022376929999999998 2024-09-17T02:20:51.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:51.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564887+0000", 2024-09-17T02:20:51.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000206178 2024-09-17T02:20:51.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:51.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565230+0000", 2024-09-17T02:20:51.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034233499999999998 2024-09-17T02:20:51.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:51.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567000+0000", 2024-09-17T02:20:51.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017706390000000001 2024-09-17T02:20:51.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586126+0000", 2024-09-17T02:20:51.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019125672 2024-09-17T02:20:51.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:51.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586314+0000", 2024-09-17T02:20:51.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018740200000000001 2024-09-17T02:20:51.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:51.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586513+0000", 2024-09-17T02:20:51.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019903799999999999 2024-09-17T02:20:51.307 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.307 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:51.307 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.307 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:51.308 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:20:51.308 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.724465973000001, 2024-09-17T02:20:51.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021940779000000001, 2024-09-17T02:20:51.308 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:51.308 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:51.308 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.308 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:51.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:51.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:20:51.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:51.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:20:51.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:51.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562470+0000", 2024-09-17T02:20:51.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5030000000000001e-06 2024-09-17T02:20:51.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:51.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562478+0000", 2024-09-17T02:20:51.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.157e-06 2024-09-17T02:20:51.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:51.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562496+0000", 2024-09-17T02:20:51.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7876e-05 2024-09-17T02:20:51.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562511+0000", 2024-09-17T02:20:51.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5067e-05 2024-09-17T02:20:51.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:51.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564628+0000", 2024-09-17T02:20:51.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021171860000000001 2024-09-17T02:20:51.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:51.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564838+0000", 2024-09-17T02:20:51.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000209283 2024-09-17T02:20:51.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:51.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565078+0000", 2024-09-17T02:20:51.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024075100000000001 2024-09-17T02:20:51.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:51.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567012+0000", 2024-09-17T02:20:51.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019331050000000001 2024-09-17T02:20:51.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584289+0000", 2024-09-17T02:20:51.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017277464999999999 2024-09-17T02:20:51.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:51.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584363+0000", 2024-09-17T02:20:51.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3852999999999999e-05 2024-09-17T02:20:51.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:51.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584409+0000", 2024-09-17T02:20:51.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6533000000000003e-05 2024-09-17T02:20:51.313 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.313 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:51.313 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.314 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:51.314 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:20:51.314 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.724402584000003, 2024-09-17T02:20:51.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020580694, 2024-09-17T02:20:51.314 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:51.314 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:51.314 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.314 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:51.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:51.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:20:51.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:51.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:20:51.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:51.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562533+0000", 2024-09-17T02:20:51.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3239999999999999e-06 2024-09-17T02:20:51.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:51.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562541+0000", 2024-09-17T02:20:51.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3529999999999997e-06 2024-09-17T02:20:51.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:51.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562559+0000", 2024-09-17T02:20:51.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8306000000000001e-05 2024-09-17T02:20:51.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562572+0000", 2024-09-17T02:20:51.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2993000000000001e-05 2024-09-17T02:20:51.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:51.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563230+0000", 2024-09-17T02:20:51.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00065806899999999995 2024-09-17T02:20:51.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:51.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563510+0000", 2024-09-17T02:20:51.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028016400000000001 2024-09-17T02:20:51.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:51.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563677+0000", 2024-09-17T02:20:51.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000166243 2024-09-17T02:20:51.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:51.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566312+0000", 2024-09-17T02:20:51.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026351349999999998 2024-09-17T02:20:51.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.582943+0000", 2024-09-17T02:20:51.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016631781000000002 2024-09-17T02:20:51.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:51.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583035+0000", 2024-09-17T02:20:51.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1682999999999996e-05 2024-09-17T02:20:51.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:51.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583113+0000", 2024-09-17T02:20:51.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7643000000000002e-05 2024-09-17T02:20:51.319 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.319 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:51.319 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.319 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:51.319 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:20:51.319 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.724295523999999, 2024-09-17T02:20:51.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020802284000000001, 2024-09-17T02:20:51.320 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:51.320 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:51.320 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:51.320 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:51.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:51.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:20:51.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:51.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:20:51.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:51.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562640+0000", 2024-09-17T02:20:51.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.37e-06 2024-09-17T02:20:51.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:51.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562648+0000", 2024-09-17T02:20:51.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.576e-06 2024-09-17T02:20:51.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:51.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562668+0000", 2024-09-17T02:20:51.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0397000000000001e-05 2024-09-17T02:20:51.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562690+0000", 2024-09-17T02:20:51.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1713e-05 2024-09-17T02:20:51.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:51.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564290+0000", 2024-09-17T02:20:51.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001599397 2024-09-17T02:20:51.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:51.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564527+0000", 2024-09-17T02:20:51.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023731199999999999 2024-09-17T02:20:51.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:51.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583441+0000", 2024-09-17T02:20:51.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018914519000000001 2024-09-17T02:20:51.323 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.323 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:51.324 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.324 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:51.324 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:20:51.324 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.724220449000001, 2024-09-17T02:20:51.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021867154, 2024-09-17T02:20:51.324 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:51.324 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:51.324 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:51.324 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:51.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:51.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:20:51.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:51.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:20:51.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:51.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562716+0000", 2024-09-17T02:20:51.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.384e-06 2024-09-17T02:20:51.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:51.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562726+0000", 2024-09-17T02:20:51.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.04e-05 2024-09-17T02:20:51.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:51.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562745+0000", 2024-09-17T02:20:51.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8770000000000002e-05 2024-09-17T02:20:51.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562759+0000", 2024-09-17T02:20:51.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4392999999999999e-05 2024-09-17T02:20:51.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:51.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565882+0000", 2024-09-17T02:20:51.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031227659999999999 2024-09-17T02:20:51.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:51.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566217+0000", 2024-09-17T02:20:51.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033498000000000002 2024-09-17T02:20:51.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:51.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584581+0000", 2024-09-17T02:20:51.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018364460999999999 2024-09-17T02:20:51.328 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.328 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:51.328 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.328 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:51.328 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562778+0000", 2024-09-17T02:20:51.328 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.724156311999998, 2024-09-17T02:20:51.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018969949, 2024-09-17T02:20:51.328 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:51.328 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:51.328 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:51.329 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:51.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:51.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562778+0000", 2024-09-17T02:20:51.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:51.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562778+0000", 2024-09-17T02:20:51.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:51.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562779+0000", 2024-09-17T02:20:51.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0470000000000001e-06 2024-09-17T02:20:51.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:51.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562798+0000", 2024-09-17T02:20:51.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8723e-05 2024-09-17T02:20:51.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:51.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562819+0000", 2024-09-17T02:20:51.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1192999999999999e-05 2024-09-17T02:20:51.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562834+0000", 2024-09-17T02:20:51.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4619e-05 2024-09-17T02:20:51.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:51.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562977+0000", 2024-09-17T02:20:51.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014338900000000001 2024-09-17T02:20:51.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:51.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563366+0000", 2024-09-17T02:20:51.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038909399999999999 2024-09-17T02:20:51.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:51.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.581748+0000", 2024-09-17T02:20:51.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018381884000000001 2024-09-17T02:20:51.332 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.332 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:51.333 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.333 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:1227 5.3 5:c07fff60:::benchmark_data_smithi001_23533_object1226:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:51.333 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.165009+0000", 2024-09-17T02:20:51.333 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.121925747999999, 2024-09-17T02:20:51.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016027434, 2024-09-17T02:20:51.333 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:51.333 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:51.333 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.333 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:51.333 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:51.333 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:51.333 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1227 2024-09-17T02:20:51.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.334 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:51.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:51.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165009+0000", 2024-09-17T02:20:51.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:51.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165009+0000", 2024-09-17T02:20:51.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:51.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165010+0000", 2024-09-17T02:20:51.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9800000000000003e-07 2024-09-17T02:20:51.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:51.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165045+0000", 2024-09-17T02:20:51.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5231999999999997e-05 2024-09-17T02:20:51.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:51.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165053+0000", 2024-09-17T02:20:51.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9289999999999998e-06 2024-09-17T02:20:51.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165058+0000", 2024-09-17T02:20:51.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6689999999999997e-06 2024-09-17T02:20:51.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:51.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165611+0000", 2024-09-17T02:20:51.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00055364200000000002 2024-09-17T02:20:51.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:51.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165764+0000", 2024-09-17T02:20:51.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000153132 2024-09-17T02:20:51.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:51.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166112+0000", 2024-09-17T02:20:51.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034738599999999998 2024-09-17T02:20:51.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:51.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168392+0000", 2024-09-17T02:20:51.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022802809999999999 2024-09-17T02:20:51.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.180931+0000", 2024-09-17T02:20:51.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012538785 2024-09-17T02:20:51.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:51.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.180994+0000", 2024-09-17T02:20:51.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3477000000000002e-05 2024-09-17T02:20:51.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:51.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181036+0000", 2024-09-17T02:20:51.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2103e-05 2024-09-17T02:20:51.339 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.339 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:51.339 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.339 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:26132 5.c 5:3ae49ef5:::benchmark_data_smithi001_23533_object26131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:51.339 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:41.688378+0000", 2024-09-17T02:20:51.339 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.5985562299999998, 2024-09-17T02:20:51.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017107691000000001, 2024-09-17T02:20:51.339 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:51.339 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:51.339 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.339 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:51.340 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:51.340 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:51.340 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 26132 2024-09-17T02:20:51.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.340 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:51.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:51.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688378+0000", 2024-09-17T02:20:51.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:51.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688378+0000", 2024-09-17T02:20:51.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:51.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688379+0000", 2024-09-17T02:20:51.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.048e-06 2024-09-17T02:20:51.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:51.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688407+0000", 2024-09-17T02:20:51.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7271e-05 2024-09-17T02:20:51.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:51.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688418+0000", 2024-09-17T02:20:51.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1333e-05 2024-09-17T02:20:51.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688433+0000", 2024-09-17T02:20:51.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4764e-05 2024-09-17T02:20:51.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:51.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688971+0000", 2024-09-17T02:20:51.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00053786399999999999 2024-09-17T02:20:51.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:51.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.689087+0000", 2024-09-17T02:20:51.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000116385 2024-09-17T02:20:51.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:51.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.689226+0000", 2024-09-17T02:20:51.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013938199999999999 2024-09-17T02:20:51.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:51.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.691077+0000", 2024-09-17T02:20:51.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001850806 2024-09-17T02:20:51.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.705392+0000", 2024-09-17T02:20:51.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014315006999999999 2024-09-17T02:20:51.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:51.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.705449+0000", 2024-09-17T02:20:51.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7101000000000001e-05 2024-09-17T02:20:51.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:51.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.705486+0000", 2024-09-17T02:20:51.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6730000000000002e-05 2024-09-17T02:20:51.345 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.345 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:51.345 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.345 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:26133 5.5 5:a365a85e:::benchmark_data_smithi001_23533_object26132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:51.345 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:41.688741+0000", 2024-09-17T02:20:51.345 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.5981939619999999, 2024-09-17T02:20:51.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015492462, 2024-09-17T02:20:51.345 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:51.346 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:51.346 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.346 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:51.346 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:51.346 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:51.346 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 26133 2024-09-17T02:20:51.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.346 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:51.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:51.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688741+0000", 2024-09-17T02:20:51.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:51.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688741+0000", 2024-09-17T02:20:51.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:51.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688741+0000", 2024-09-17T02:20:51.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9100000000000003e-07 2024-09-17T02:20:51.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:51.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688847+0000", 2024-09-17T02:20:51.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105612 2024-09-17T02:20:51.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:51.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688855+0000", 2024-09-17T02:20:51.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8359999999999992e-06 2024-09-17T02:20:51.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688860+0000", 2024-09-17T02:20:51.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6990000000000002e-06 2024-09-17T02:20:51.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:51.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688957+0000", 2024-09-17T02:20:51.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7384000000000001e-05 2024-09-17T02:20:51.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:51.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.689088+0000", 2024-09-17T02:20:51.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013131199999999999 2024-09-17T02:20:51.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:51.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.689211+0000", 2024-09-17T02:20:51.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012225499999999999 2024-09-17T02:20:51.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:51.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.691078+0000", 2024-09-17T02:20:51.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018674780000000001 2024-09-17T02:20:51.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.704135+0000", 2024-09-17T02:20:51.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013057302999999999 2024-09-17T02:20:51.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:51.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.704198+0000", 2024-09-17T02:20:51.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2551999999999993e-05 2024-09-17T02:20:51.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:51.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.704233+0000", 2024-09-17T02:20:51.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5240000000000001e-05 2024-09-17T02:20:51.351 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.351 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:51.351 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.351 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:51.351 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:20:51.352 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7184715419999996, 2024-09-17T02:20:51.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:20:51.352 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:51.352 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:51.352 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.352 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:51.352 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:51.352 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:51.352 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:20:51.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.352 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:51.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:51.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:20:51.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:51.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:20:51.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:51.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:20:51.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:20:51.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:51.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:20:51.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:20:51.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:51.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:20:51.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:20:51.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:20:51.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:20:51.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:51.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:20:51.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:20:51.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:51.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:20:51.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:20:51.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:51.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:20:51.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:20:51.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:51.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:20:51.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:20:51.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:20:51.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:20:51.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:51.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:20:51.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:20:51.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:51.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:20:51.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:20:51.358 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.358 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:51.358 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.358 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:51.358 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:20:51.358 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7145692920000002, 2024-09-17T02:20:51.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:20:51.358 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:51.358 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:51.358 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.358 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:51.358 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:51.359 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:51.359 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:20:51.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.359 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:51.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:51.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:20:51.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:51.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:20:51.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:51.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:20:51.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:20:51.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:51.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:20:51.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:20:51.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:51.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:20:51.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:20:51.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:20:51.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:20:51.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:51.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:20:51.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:20:51.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:51.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:20:51.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:20:51.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:51.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:20:51.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:20:51.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:51.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:20:51.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:20:51.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:20:51.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:20:51.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:51.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:20:51.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:20:51.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:51.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:20:51.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:20:51.364 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.364 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:51.364 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.364 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:31663 5.8 5:18a4daab:::benchmark_data_smithi001_23533_object31662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-17T02:20:51.364 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:43.631605+0000", 2024-09-17T02:20:51.365 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.6553296409999998, 2024-09-17T02:20:51.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017528834, 2024-09-17T02:20:51.365 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:51.365 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:51.365 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.365 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:51.365 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:51.365 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:51.365 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 31663 2024-09-17T02:20:51.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.365 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:51.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:51.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631605+0000", 2024-09-17T02:20:51.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:51.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631605+0000", 2024-09-17T02:20:51.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:51.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631606+0000", 2024-09-17T02:20:51.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:20:51.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:51.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631633+0000", 2024-09-17T02:20:51.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7455999999999999e-05 2024-09-17T02:20:51.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:51.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631640+0000", 2024-09-17T02:20:51.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8140000000000003e-06 2024-09-17T02:20:51.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631644+0000", 2024-09-17T02:20:51.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4790000000000001e-06 2024-09-17T02:20:51.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:51.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.636150+0000", 2024-09-17T02:20:51.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004506431 2024-09-17T02:20:51.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:51.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.636299+0000", 2024-09-17T02:20:51.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014900499999999999 2024-09-17T02:20:51.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:51.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.636448+0000", 2024-09-17T02:20:51.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000149087 2024-09-17T02:20:51.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.639522+0000", 2024-09-17T02:20:51.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030734600000000001 2024-09-17T02:20:51.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:51.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.649032+0000", 2024-09-17T02:20:51.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0095109129999999993 2024-09-17T02:20:51.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:51.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.649096+0000", 2024-09-17T02:20:51.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3702999999999996e-05 2024-09-17T02:20:51.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:51.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.649134+0000", 2024-09-17T02:20:51.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7706000000000001e-05 2024-09-17T02:20:51.371 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.371 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:51.371 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.371 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:40722 5.5 5:ac1614e8:::benchmark_data_smithi001_23533_object40721:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:51.371 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.032445+0000", 2024-09-17T02:20:51.371 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.2544894649999998, 2024-09-17T02:20:51.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015387025, 2024-09-17T02:20:51.371 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:51.371 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:51.371 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.371 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:51.372 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:51.372 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:51.372 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 40722 2024-09-17T02:20:51.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.372 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:51.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:51.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032445+0000", 2024-09-17T02:20:51.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:51.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032445+0000", 2024-09-17T02:20:51.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:51.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032446+0000", 2024-09-17T02:20:51.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5199999999999996e-07 2024-09-17T02:20:51.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:51.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032615+0000", 2024-09-17T02:20:51.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016943700000000001 2024-09-17T02:20:51.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:51.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032653+0000", 2024-09-17T02:20:51.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7706000000000001e-05 2024-09-17T02:20:51.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032671+0000", 2024-09-17T02:20:51.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8099999999999999e-05 2024-09-17T02:20:51.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:51.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.034226+0000", 2024-09-17T02:20:51.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001555117 2024-09-17T02:20:51.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:51.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.034353+0000", 2024-09-17T02:20:51.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012684799999999999 2024-09-17T02:20:51.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:51.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.034488+0000", 2024-09-17T02:20:51.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013460699999999999 2024-09-17T02:20:51.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:51.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.036330+0000", 2024-09-17T02:20:51.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001842394 2024-09-17T02:20:51.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.047724+0000", 2024-09-17T02:20:51.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011394025 2024-09-17T02:20:51.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:51.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.047794+0000", 2024-09-17T02:20:51.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9678000000000006e-05 2024-09-17T02:20:51.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:51.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.047832+0000", 2024-09-17T02:20:51.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8461000000000003e-05 2024-09-17T02:20:51.377 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.377 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:51.378 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.378 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:40725 5.0 5:00adeb50:::benchmark_data_smithi001_23533_object40724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:51.378 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.032768+0000", 2024-09-17T02:20:51.378 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.2541671240000003, 2024-09-17T02:20:51.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015538547, 2024-09-17T02:20:51.378 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:51.378 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:51.378 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.378 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:51.378 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:51.378 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:51.379 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 40725 2024-09-17T02:20:51.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.379 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:51.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:51.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032768+0000", 2024-09-17T02:20:51.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:51.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032768+0000", 2024-09-17T02:20:51.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:51.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032768+0000", 2024-09-17T02:20:51.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0100000000000005e-07 2024-09-17T02:20:51.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:51.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032795+0000", 2024-09-17T02:20:51.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6690999999999999e-05 2024-09-17T02:20:51.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:51.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032802+0000", 2024-09-17T02:20:51.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0469999999999996e-06 2024-09-17T02:20:51.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032807+0000", 2024-09-17T02:20:51.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3859999999999998e-06 2024-09-17T02:20:51.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:51.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032851+0000", 2024-09-17T02:20:51.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4051000000000002e-05 2024-09-17T02:20:51.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:51.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032971+0000", 2024-09-17T02:20:51.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000119824 2024-09-17T02:20:51.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:51.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.033084+0000", 2024-09-17T02:20:51.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000112496 2024-09-17T02:20:51.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:51.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.036163+0000", 2024-09-17T02:20:51.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030790610000000001 2024-09-17T02:20:51.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.048228+0000", 2024-09-17T02:20:51.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012065243999999999 2024-09-17T02:20:51.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:51.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.048274+0000", 2024-09-17T02:20:51.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5756e-05 2024-09-17T02:20:51.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:51.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.048306+0000", 2024-09-17T02:20:51.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2490000000000002e-05 2024-09-17T02:20:51.384 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.384 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:51.384 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.384 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:40734 5.3 5:c50da8da:::benchmark_data_smithi001_23533_object40733:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:51.384 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.037293+0000", 2024-09-17T02:20:51.384 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.2496420639999997, 2024-09-17T02:20:51.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015846585999999999, 2024-09-17T02:20:51.384 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:51.385 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:51.385 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.385 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:51.385 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:51.385 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:51.385 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 40734 2024-09-17T02:20:51.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.385 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:51.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:51.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037293+0000", 2024-09-17T02:20:51.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:51.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037293+0000", 2024-09-17T02:20:51.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:51.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037293+0000", 2024-09-17T02:20:51.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.61e-07 2024-09-17T02:20:51.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:51.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037420+0000", 2024-09-17T02:20:51.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012655300000000001 2024-09-17T02:20:51.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:51.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037428+0000", 2024-09-17T02:20:51.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.354e-06 2024-09-17T02:20:51.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037447+0000", 2024-09-17T02:20:51.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8374000000000001e-05 2024-09-17T02:20:51.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:51.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.038148+0000", 2024-09-17T02:20:51.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00070088699999999997 2024-09-17T02:20:51.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:51.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.038267+0000", 2024-09-17T02:20:51.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011923500000000001 2024-09-17T02:20:51.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:51.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.038382+0000", 2024-09-17T02:20:51.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011549599999999999 2024-09-17T02:20:51.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.051916+0000", 2024-09-17T02:20:51.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013533315000000001 2024-09-17T02:20:51.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:51.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.053054+0000", 2024-09-17T02:20:51.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001138053 2024-09-17T02:20:51.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:51.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.053101+0000", 2024-09-17T02:20:51.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7437e-05 2024-09-17T02:20:51.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:51.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.053139+0000", 2024-09-17T02:20:51.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8121000000000003e-05 2024-09-17T02:20:51.390 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.390 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:51.390 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.391 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:40737 5.8 5:1ce68324:::benchmark_data_smithi001_23533_object40736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:51.391 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.037456+0000", 2024-09-17T02:20:51.391 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.2494790949999999, 2024-09-17T02:20:51.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016032277000000001, 2024-09-17T02:20:51.391 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:51.391 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:51.391 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.391 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:51.391 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:51.391 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:51.392 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 40737 2024-09-17T02:20:51.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.392 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:51.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:51.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037456+0000", 2024-09-17T02:20:51.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:51.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037456+0000", 2024-09-17T02:20:51.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:51.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037456+0000", 2024-09-17T02:20:51.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2300000000000001e-07 2024-09-17T02:20:51.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:51.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037514+0000", 2024-09-17T02:20:51.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8094000000000003e-05 2024-09-17T02:20:51.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:51.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.047514+0000", 2024-09-17T02:20:51.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0099994690000000004 2024-09-17T02:20:51.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.047521+0000", 2024-09-17T02:20:51.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9160000000000004e-06 2024-09-17T02:20:51.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:51.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.047578+0000", 2024-09-17T02:20:51.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7482000000000003e-05 2024-09-17T02:20:51.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:51.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.047717+0000", 2024-09-17T02:20:51.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138517 2024-09-17T02:20:51.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:51.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.047867+0000", 2024-09-17T02:20:51.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015047899999999999 2024-09-17T02:20:51.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.051283+0000", 2024-09-17T02:20:51.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003415689 2024-09-17T02:20:51.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:51.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.053364+0000", 2024-09-17T02:20:51.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020809050000000001 2024-09-17T02:20:51.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:51.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.053410+0000", 2024-09-17T02:20:51.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6062e-05 2024-09-17T02:20:51.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:51.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.053488+0000", 2024-09-17T02:20:51.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8140999999999996e-05 2024-09-17T02:20:51.397 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.397 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:51.397 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.397 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:43563 5.2 e30/22 5:4cd85cc9:::benchmark_data_smithi001_23533_object43562:head v 30'2742, mlcod=30'2739)", 2024-09-17T02:20:51.397 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:48.159930+0000", 2024-09-17T02:20:51.397 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.127004425, 2024-09-17T02:20:51.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015974195, 2024-09-17T02:20:51.397 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:51.397 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:51.397 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.397 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:51.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:51.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:48.159930+0000", 2024-09-17T02:20:51.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:51.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:48.159930+0000", 2024-09-17T02:20:51.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:51.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:51.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:48.159931+0000", 2024-09-17T02:20:51.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3600000000000003e-07 2024-09-17T02:20:51.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:51.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:48.159963+0000", 2024-09-17T02:20:51.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2356e-05 2024-09-17T02:20:51.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:51.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:48.159973+0000", 2024-09-17T02:20:51.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3770000000000002e-06 2024-09-17T02:20:51.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:48.159980+0000", 2024-09-17T02:20:51.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9600000000000003e-06 2024-09-17T02:20:51.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:51.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:48.160051+0000", 2024-09-17T02:20:51.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0970999999999995e-05 2024-09-17T02:20:51.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:51.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:48.160076+0000", 2024-09-17T02:20:51.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5669000000000001e-05 2024-09-17T02:20:51.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:51.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:48.175871+0000", 2024-09-17T02:20:51.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01579492 2024-09-17T02:20:51.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:51.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:51.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:51.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:48.175904+0000", 2024-09-17T02:20:51.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3306000000000003e-05 2024-09-17T02:20:51.401 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.401 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:51.401 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.401 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:51.401 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:51.401 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:20:51.403 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:51.407+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:51.403 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:20:51.504 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:51.507+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:51.565 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:20:51.565 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-17T02:20:51.565 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.565 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:51750 5.2 5:4ef06fb6:::benchmark_data_smithi001_23533_object51749:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-17T02:20:51.565 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:51.565816+0000", 2024-09-17T02:20:51.565 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0029930450000000002, 2024-09-17T02:20:51.565 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0030133260000000002, 2024-09-17T02:20:51.565 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:51.566 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:51.566 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:51.566 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:51.566 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:51.566 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:51.566 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 51750 2024-09-17T02:20:51.566 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.566 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:51.566 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.566 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:51.566 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.565816+0000", 2024-09-17T02:20:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.565816+0000", 2024-09-17T02:20:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.565817+0000", 2024-09-17T02:20:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1620000000000001e-06 2024-09-17T02:20:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.567 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.565922+0000", 2024-09-17T02:20:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010469 2024-09-17T02:20:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.565934+0000", 2024-09-17T02:20:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2160999999999999e-05 2024-09-17T02:20:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.565942+0000", 2024-09-17T02:20:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.627e-06 2024-09-17T02:20:51.568 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.569 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.569 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:51.569 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.566007+0000", 2024-09-17T02:20:51.569 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5865999999999996e-05 2024-09-17T02:20:51.569 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.569 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.569 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:51.569 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.566157+0000", 2024-09-17T02:20:51.569 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000149946 2024-09-17T02:20:51.569 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.569 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.569 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:51.569 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.566308+0000", 2024-09-17T02:20:51.570 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015076600000000001 2024-09-17T02:20:51.570 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.570 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.570 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:51.570 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568569+0000", 2024-09-17T02:20:51.570 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022603699999999998 2024-09-17T02:20:51.570 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.570 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:51.570 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.570 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.570 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.570 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:51755 5.d 5:bec85197:::benchmark_data_smithi001_23533_object51754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-17T02:20:51.571 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:51.568603+0000", 2024-09-17T02:20:51.571 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.00020633500000000001, 2024-09-17T02:20:51.571 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00030281999999999998, 2024-09-17T02:20:51.571 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:51.571 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:51.571 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "reached pg", 2024-09-17T02:20:51.571 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:51.571 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:51.571 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:51.571 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 51755 2024-09-17T02:20:51.571 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.571 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:51.572 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.572 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:51.572 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568603+0000", 2024-09-17T02:20:51.572 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.572 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.572 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.572 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:51.572 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568603+0000", 2024-09-17T02:20:51.572 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.572 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.572 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.573 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:51.573 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568604+0000", 2024-09-17T02:20:51.573 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1909999999999999e-06 2024-09-17T02:20:51.573 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.573 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.573 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:51.573 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568746+0000", 2024-09-17T02:20:51.573 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014166 2024-09-17T02:20:51.573 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.573 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.573 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:51.573 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568755+0000", 2024-09-17T02:20:51.573 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1409999999999994e-06 2024-09-17T02:20:51.574 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.574 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.574 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.574 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568760+0000", 2024-09-17T02:20:51.574 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.259e-06 2024-09-17T02:20:51.574 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.574 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.574 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:51.574 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568824+0000", 2024-09-17T02:20:51.574 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3830000000000004e-05 2024-09-17T02:20:51.574 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.574 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:51.575 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.575 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.575 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.575 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:51756 5.2 5:444d1be8:::benchmark_data_smithi001_23533_object51755:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-17T02:20:51.575 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:51.568777+0000", 2024-09-17T02:20:51.575 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 3.2338000000000001e-05, 2024-09-17T02:20:51.575 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019694999999999999, 2024-09-17T02:20:51.575 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:51.575 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:51.575 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "reached pg", 2024-09-17T02:20:51.575 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:51.575 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:51.575 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:51.576 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 51756 2024-09-17T02:20:51.576 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.576 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:51.576 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.576 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:51.576 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568777+0000", 2024-09-17T02:20:51.576 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.576 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.576 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.576 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:51.576 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568777+0000", 2024-09-17T02:20:51.576 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.577 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.577 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.577 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:51.577 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568778+0000", 2024-09-17T02:20:51.577 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.33e-07 2024-09-17T02:20:51.577 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.577 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.577 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:51.577 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568826+0000", 2024-09-17T02:20:51.577 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8294999999999998e-05 2024-09-17T02:20:51.577 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.577 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.577 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:51.578 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568836+0000", 2024-09-17T02:20:51.578 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0227000000000001e-05 2024-09-17T02:20:51.578 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.578 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.578 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.578 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568842+0000", 2024-09-17T02:20:51.578 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9739999999999999e-06 2024-09-17T02:20:51.578 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.578 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.578 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:51.578 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568889+0000", 2024-09-17T02:20:51.578 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7200000000000002e-05 2024-09-17T02:20:51.578 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.578 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:51.579 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.579 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.579 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.579 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(client.4466.0:51747 5.f e31/22)", 2024-09-17T02:20:51.579 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:51.568866+0000", 2024-09-17T02:20:51.579 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4294967295.9999428, 2024-09-17T02:20:51.579 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000191366, 2024-09-17T02:20:51.579 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:51.579 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:51.579 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "queued for pg", 2024-09-17T02:20:51.579 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:51.579 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.579 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:51.579 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568866+0000", 2024-09-17T02:20:51.579 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.580 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.580 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.580 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:51.580 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568866+0000", 2024-09-17T02:20:51.580 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.580 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.580 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.580 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:51.580 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568867+0000", 2024-09-17T02:20:51.580 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4799999999999997e-07 2024-09-17T02:20:51.580 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.580 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.580 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:51.581 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568871+0000", 2024-09-17T02:20:51.581 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4189999999999998e-06 2024-09-17T02:20:51.581 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.581 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.581 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:51.581 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568885+0000", 2024-09-17T02:20:51.581 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4518000000000001e-05 2024-09-17T02:20:51.581 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.581 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.581 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.581 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568893+0000", 2024-09-17T02:20:51.581 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2169999999999994e-06 2024-09-17T02:20:51.581 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.581 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:51.582 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.582 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.582 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.582 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:51757 5.2 5.68bab8d2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-17T02:20:51.582 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:51.568857+0000", 2024-09-17T02:20:51.582 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4294967295.9999523, 2024-09-17T02:20:51.582 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00025695200000000002, 2024-09-17T02:20:51.582 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:51.582 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:51.582 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "queued for pg", 2024-09-17T02:20:51.582 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:51.582 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:51.582 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:51.583 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 51757 2024-09-17T02:20:51.583 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.583 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:51.583 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.583 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:51.583 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568857+0000", 2024-09-17T02:20:51.583 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.583 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.583 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.583 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:51.583 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568857+0000", 2024-09-17T02:20:51.583 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.583 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.583 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.584 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:51.584 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568857+0000", 2024-09-17T02:20:51.584 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6100000000000001e-07 2024-09-17T02:20:51.584 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.584 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.584 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:51.584 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568905+0000", 2024-09-17T02:20:51.584 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7542e-05 2024-09-17T02:20:51.584 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.584 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.584 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:51.584 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568915+0000", 2024-09-17T02:20:51.584 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0124e-05 2024-09-17T02:20:51.585 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.585 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.585 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.585 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568921+0000", 2024-09-17T02:20:51.585 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4450000000000001e-06 2024-09-17T02:20:51.585 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.585 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:51.585 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.585 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.585 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.585 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:51758 5.1 5:84db468c:::benchmark_data_smithi001_23533_object51757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-17T02:20:51.585 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:51.568932+0000", 2024-09-17T02:20:51.585 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4294967295.9998775, 2024-09-17T02:20:51.586 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00024425599999999999, 2024-09-17T02:20:51.586 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:51.586 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:51.586 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "reached pg", 2024-09-17T02:20:51.586 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:51.586 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:51.586 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:51.586 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 51758 2024-09-17T02:20:51.586 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.586 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:51.586 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.586 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:51.586 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568932+0000", 2024-09-17T02:20:51.587 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.587 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.587 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.587 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:51.587 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568932+0000", 2024-09-17T02:20:51.587 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.587 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.587 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.587 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:51.587 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.568932+0000", 2024-09-17T02:20:51.587 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3799999999999997e-07 2024-09-17T02:20:51.587 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.587 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.587 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:51.588 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.569032+0000", 2024-09-17T02:20:51.588 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.9654000000000005e-05 2024-09-17T02:20:51.588 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.588 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.588 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:51.588 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.569042+0000", 2024-09-17T02:20:51.588 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.061e-05 2024-09-17T02:20:51.588 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.588 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.588 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.588 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.569050+0000", 2024-09-17T02:20:51.588 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4869999999999996e-06 2024-09-17T02:20:51.588 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.589 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.589 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:51.589 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.569095+0000", 2024-09-17T02:20:51.589 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5071999999999998e-05 2024-09-17T02:20:51.589 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.589 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:51.589 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.589 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.589 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.589 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:51747 5.f 5:ffa11af0:::benchmark_data_smithi001_23533_object51746:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-17T02:20:51.589 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:51.564023+0000", 2024-09-17T02:20:51.589 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.004786106, 2024-09-17T02:20:51.589 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.005213835, 2024-09-17T02:20:51.589 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:51.590 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:51.590 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.590 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:51.590 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:51.590 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:51.590 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 51747 2024-09-17T02:20:51.590 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.590 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:51.590 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.590 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:51.590 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.564023+0000", 2024-09-17T02:20:51.590 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.590 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.590 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.591 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:51.591 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.564023+0000", 2024-09-17T02:20:51.591 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.591 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.591 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.591 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:51.591 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.564023+0000", 2024-09-17T02:20:51.591 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.68e-07 2024-09-17T02:20:51.591 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.591 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.591 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:51.591 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.564059+0000", 2024-09-17T02:20:51.591 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5119e-05 2024-09-17T02:20:51.592 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.592 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.592 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:51.592 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.564068+0000", 2024-09-17T02:20:51.592 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5200000000000003e-06 2024-09-17T02:20:51.592 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.592 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.592 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.592 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.564073+0000", 2024-09-17T02:20:51.592 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3210000000000004e-06 2024-09-17T02:20:51.592 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.592 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.593 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:51.593 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.566963+0000", 2024-09-17T02:20:51.593 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028892119999999999 2024-09-17T02:20:51.593 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.593 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.593 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:51.593 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.567075+0000", 2024-09-17T02:20:51.593 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112544 2024-09-17T02:20:51.593 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.593 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.593 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:51.593 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.567206+0000", 2024-09-17T02:20:51.593 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013032899999999999 2024-09-17T02:20:51.594 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.594 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.594 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.594 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.569121+0000", 2024-09-17T02:20:51.594 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0019151350000000001 2024-09-17T02:20:51.594 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.594 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.594 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:51.594 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.569137+0000", 2024-09-17T02:20:51.594 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6739999999999999e-05 2024-09-17T02:20:51.594 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.594 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.594 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:51.595 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.569209+0000", 2024-09-17T02:20:51.595 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1210000000000004e-05 2024-09-17T02:20:51.595 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.595 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.595 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:51.595 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:51.569237+0000", 2024-09-17T02:20:51.595 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8136999999999998e-05 2024-09-17T02:20:51.595 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.595 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:51.595 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.595 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.595 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-09-17T02:20:51.595 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 7 2024-09-17T02:20:51.595 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:20:51.597 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:20:51.605 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:51.607+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:51.705 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:51.707+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:51.755 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:20:51.755 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-17T02:20:51.755 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-09-17T02:20:51.756 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-09-17T02:20:51.756 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:20:51.761 INFO:teuthology.orchestra.run.smithi001.stderr:nodeep-scrub is unset 2024-09-17T02:20:51.769 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 19 16 52247 52231 171.794 146.562 0.00873784 0.00581591 2024-09-17T02:20:51.779 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:20:51.806 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:51.811+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:51.908 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:51.912+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:51.934 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:20:51.935 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-09-17T02:20:51.935 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-09-17T02:20:51.935 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-17T02:20:51.935 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.935 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-17T02:20:51.935 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:20:51.935 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 47.478991352000001, 2024-09-17T02:20:51.935 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.15597325500000001, 2024-09-17T02:20:51.935 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:51.935 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:51.935 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.935 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:51.935 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4164", 2024-09-17T02:20:51.936 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/201892753", 2024-09-17T02:20:51.936 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 1 2024-09-17T02:20:51.936 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.936 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:51.936 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.936 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:51.936 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:20:51.936 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.936 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.936 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.936 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:51.936 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:20:51.936 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.936 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.937 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.937 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:51.937 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458359+0000", 2024-09-17T02:20:51.937 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3929999999999998e-06 2024-09-17T02:20:51.937 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.937 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.937 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:51.937 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458373+0000", 2024-09-17T02:20:51.937 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4103e-05 2024-09-17T02:20:51.937 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.937 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.937 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:51.937 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458397+0000", 2024-09-17T02:20:51.938 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.438e-05 2024-09-17T02:20:51.938 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.938 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.938 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.938 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458421+0000", 2024-09-17T02:20:51.938 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3655999999999998e-05 2024-09-17T02:20:51.938 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.938 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.938 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:51.938 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458529+0000", 2024-09-17T02:20:51.938 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010752900000000001 2024-09-17T02:20:51.938 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.938 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.938 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:20:51.939 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458542+0000", 2024-09-17T02:20:51.939 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2986999999999999e-05 2024-09-17T02:20:51.939 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.939 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.939 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:51.939 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.611050+0000", 2024-09-17T02:20:51.939 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.1525087 2024-09-17T02:20:51.939 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.939 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.939 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:51.939 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.611529+0000", 2024-09-17T02:20:51.939 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00047844899999999999 2024-09-17T02:20:51.939 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.940 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.940 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:51.940 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.612061+0000", 2024-09-17T02:20:51.940 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00053230300000000003 2024-09-17T02:20:51.940 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.940 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.940 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:51.940 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.613451+0000", 2024-09-17T02:20:51.940 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0013897250000000001 2024-09-17T02:20:51.940 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.940 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.940 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.941 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614168+0000", 2024-09-17T02:20:51.941 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00071692499999999998 2024-09-17T02:20:51.941 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.941 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.941 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:51.941 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614265+0000", 2024-09-17T02:20:51.941 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7589000000000004e-05 2024-09-17T02:20:51.941 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.941 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.941 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:51.941 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614330+0000", 2024-09-17T02:20:51.941 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4516000000000004e-05 2024-09-17T02:20:51.941 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.942 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:51.942 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.942 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.942 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.942 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:51.942 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:20:51.942 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 35.381060234000003, 2024-09-17T02:20:51.942 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029713927000000001, 2024-09-17T02:20:51.942 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:51.942 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:51.942 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.942 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:51.942 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.943 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:51.943 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:20:51.943 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.943 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.943 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.943 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:51.943 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:20:51.943 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.943 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.943 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.943 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:51.943 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556289+0000", 2024-09-17T02:20:51.944 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.513e-06 2024-09-17T02:20:51.944 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.944 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.944 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:51.944 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556298+0000", 2024-09-17T02:20:51.944 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1630000000000002e-06 2024-09-17T02:20:51.944 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.944 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.944 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:51.944 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556318+0000", 2024-09-17T02:20:51.944 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9389999999999999e-05 2024-09-17T02:20:51.944 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.944 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.944 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.945 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556332+0000", 2024-09-17T02:20:51.945 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4506e-05 2024-09-17T02:20:51.945 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.945 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.945 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:51.945 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557304+0000", 2024-09-17T02:20:51.945 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00097169699999999999 2024-09-17T02:20:51.945 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.945 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.945 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:51.945 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557507+0000", 2024-09-17T02:20:51.945 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000203191 2024-09-17T02:20:51.945 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.946 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.946 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:51.946 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557838+0000", 2024-09-17T02:20:51.946 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033061100000000002 2024-09-17T02:20:51.946 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.946 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.946 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:51.946 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562171+0000", 2024-09-17T02:20:51.946 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043329229999999998 2024-09-17T02:20:51.946 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.946 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.946 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.946 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585737+0000", 2024-09-17T02:20:51.947 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023565915 2024-09-17T02:20:51.947 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.947 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.947 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:51.947 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585884+0000", 2024-09-17T02:20:51.947 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014744199999999999 2024-09-17T02:20:51.947 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.947 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.947 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:51.947 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586002+0000", 2024-09-17T02:20:51.947 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000117576 2024-09-17T02:20:51.947 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.947 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:51.948 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.948 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.948 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.948 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:51.948 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:20:51.948 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 35.380968262000003, 2024-09-17T02:20:51.948 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030933694000000001, 2024-09-17T02:20:51.948 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:51.948 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:51.948 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.948 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:51.948 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.948 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:51.949 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:20:51.949 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.949 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.949 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.949 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:51.949 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:20:51.949 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.949 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.949 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.949 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:51.949 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556381+0000", 2024-09-17T02:20:51.949 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2100000000000001e-06 2024-09-17T02:20:51.949 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.950 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.950 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:51.950 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556389+0000", 2024-09-17T02:20:51.950 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5539999999999998e-06 2024-09-17T02:20:51.950 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.950 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.950 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:51.950 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556408+0000", 2024-09-17T02:20:51.950 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8623000000000001e-05 2024-09-17T02:20:51.950 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.950 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.950 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.950 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556427+0000", 2024-09-17T02:20:51.951 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8566000000000001e-05 2024-09-17T02:20:51.951 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.951 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.951 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:51.951 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558741+0000", 2024-09-17T02:20:51.951 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023144390000000002 2024-09-17T02:20:51.951 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.951 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.951 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:51.951 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559040+0000", 2024-09-17T02:20:51.951 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029912100000000001 2024-09-17T02:20:51.951 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.951 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.952 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:51.952 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559222+0000", 2024-09-17T02:20:51.952 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018211200000000001 2024-09-17T02:20:51.952 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.952 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.952 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:51.952 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.566648+0000", 2024-09-17T02:20:51.952 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074257560000000004 2024-09-17T02:20:51.952 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.952 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.952 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.952 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587109+0000", 2024-09-17T02:20:51.952 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.020460685999999999 2024-09-17T02:20:51.953 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.953 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.953 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:51.953 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587232+0000", 2024-09-17T02:20:51.953 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123325 2024-09-17T02:20:51.953 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.953 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.953 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:51.953 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587313+0000", 2024-09-17T02:20:51.953 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1302000000000002e-05 2024-09-17T02:20:51.953 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.953 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:51.953 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.954 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.954 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.954 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:51.954 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:20:51.954 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 35.380902816000003, 2024-09-17T02:20:51.954 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031045538000000001, 2024-09-17T02:20:51.954 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:51.954 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:51.954 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.954 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:51.954 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.954 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:51.954 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:20:51.955 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.955 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.955 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.955 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:51.955 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:20:51.955 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.955 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.955 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.955 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:51.955 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556446+0000", 2024-09-17T02:20:51.955 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.26e-06 2024-09-17T02:20:51.955 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.955 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.956 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:51.956 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556454+0000", 2024-09-17T02:20:51.956 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1640000000000004e-06 2024-09-17T02:20:51.956 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.956 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.956 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:51.956 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556471+0000", 2024-09-17T02:20:51.956 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7586000000000001e-05 2024-09-17T02:20:51.956 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.956 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.956 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.956 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556485+0000", 2024-09-17T02:20:51.957 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3523000000000001e-05 2024-09-17T02:20:51.957 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.957 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.957 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:51.957 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559899+0000", 2024-09-17T02:20:51.957 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0034142140000000001 2024-09-17T02:20:51.957 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.957 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.957 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:51.957 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.560104+0000", 2024-09-17T02:20:51.957 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00020539199999999999 2024-09-17T02:20:51.957 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.957 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.957 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:51.958 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.560400+0000", 2024-09-17T02:20:51.958 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029612099999999999 2024-09-17T02:20:51.958 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.958 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.958 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:51.958 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.568427+0000", 2024-09-17T02:20:51.958 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0080262909999999996 2024-09-17T02:20:51.958 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.958 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.958 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.958 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587377+0000", 2024-09-17T02:20:51.958 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018950765000000001 2024-09-17T02:20:51.958 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.958 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.959 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:51.959 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587445+0000", 2024-09-17T02:20:51.959 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.724e-05 2024-09-17T02:20:51.959 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.959 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.959 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:51.959 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587491+0000", 2024-09-17T02:20:51.959 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5982000000000001e-05 2024-09-17T02:20:51.959 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.959 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:51.959 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.959 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.959 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.959 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:51.960 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:20:51.960 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 35.380840046000003, 2024-09-17T02:20:51.960 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031435547000000001, 2024-09-17T02:20:51.960 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:51.960 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:51.960 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.960 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:51.960 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.960 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:51.960 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:20:51.960 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.960 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.960 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.961 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:51.961 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:20:51.961 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.961 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.961 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.961 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:51.961 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556509+0000", 2024-09-17T02:20:51.961 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.06e-06 2024-09-17T02:20:51.961 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.961 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.961 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:51.961 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556515+0000", 2024-09-17T02:20:51.961 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1029999999999998e-06 2024-09-17T02:20:51.962 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.962 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.962 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:51.962 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556532+0000", 2024-09-17T02:20:51.962 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7054e-05 2024-09-17T02:20:51.962 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.962 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.962 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.962 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556545+0000", 2024-09-17T02:20:51.962 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3023000000000001e-05 2024-09-17T02:20:51.962 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.962 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.962 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:51.962 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561016+0000", 2024-09-17T02:20:51.963 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044705150000000004 2024-09-17T02:20:51.963 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.963 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.963 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:51.963 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561316+0000", 2024-09-17T02:20:51.963 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000299895 2024-09-17T02:20:51.963 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.963 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.963 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:51.963 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561651+0000", 2024-09-17T02:20:51.963 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033519300000000001 2024-09-17T02:20:51.963 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.963 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.963 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:51.964 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571105+0000", 2024-09-17T02:20:51.964 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094540539999999999 2024-09-17T02:20:51.964 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.964 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.964 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.964 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587628+0000", 2024-09-17T02:20:51.964 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016522819000000001 2024-09-17T02:20:51.964 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.964 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.964 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:51.964 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587770+0000", 2024-09-17T02:20:51.964 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000142352 2024-09-17T02:20:51.964 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.965 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.965 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:51.965 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587943+0000", 2024-09-17T02:20:51.965 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017347900000000001 2024-09-17T02:20:51.965 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.965 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:51.965 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.965 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.965 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.965 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:51.965 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:20:51.965 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 35.380784316000003, 2024-09-17T02:20:51.965 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031809104999999997, 2024-09-17T02:20:51.965 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:51.966 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:51.966 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.966 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:51.966 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.966 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:51.966 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:20:51.966 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.966 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.966 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.966 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:51.966 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:20:51.966 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.966 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.966 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.967 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:51.967 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556565+0000", 2024-09-17T02:20:51.967 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.116e-06 2024-09-17T02:20:51.967 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.967 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.967 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:51.967 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556572+0000", 2024-09-17T02:20:51.967 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0230000000000004e-06 2024-09-17T02:20:51.967 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.967 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.967 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:51.967 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556588+0000", 2024-09-17T02:20:51.967 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6643e-05 2024-09-17T02:20:51.967 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.968 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.968 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.968 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556606+0000", 2024-09-17T02:20:51.968 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7159999999999998e-05 2024-09-17T02:20:51.968 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.968 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.968 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:51.968 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562712+0000", 2024-09-17T02:20:51.968 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0061061630000000004 2024-09-17T02:20:51.968 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.968 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.968 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:51.968 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562919+0000", 2024-09-17T02:20:51.968 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000207309 2024-09-17T02:20:51.969 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.969 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.969 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:51.969 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563264+0000", 2024-09-17T02:20:51.969 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00034490699999999998 2024-09-17T02:20:51.969 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.969 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.969 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:51.969 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571812+0000", 2024-09-17T02:20:51.969 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0085477810000000008 2024-09-17T02:20:51.969 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.969 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.969 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.969 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588094+0000", 2024-09-17T02:20:51.970 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016282443000000001 2024-09-17T02:20:51.970 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.970 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.970 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:51.970 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588275+0000", 2024-09-17T02:20:51.970 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018058700000000001 2024-09-17T02:20:51.970 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.970 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.970 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:51.970 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588373+0000", 2024-09-17T02:20:51.970 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7973000000000005e-05 2024-09-17T02:20:51.970 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.970 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:51.970 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.971 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.971 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.971 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:51.971 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:20:51.971 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 35.380726217000003, 2024-09-17T02:20:51.971 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031950544999999997, 2024-09-17T02:20:51.971 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:51.971 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:51.971 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.971 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:51.971 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.971 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:51.971 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:20:51.972 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.972 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.972 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.972 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:51.972 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:20:51.972 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.972 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.972 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.972 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:51.972 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556623+0000", 2024-09-17T02:20:51.972 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.04e-06 2024-09-17T02:20:51.972 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.972 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.973 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:51.973 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556631+0000", 2024-09-17T02:20:51.973 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1529999999999997e-06 2024-09-17T02:20:51.973 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.973 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.973 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:51.973 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556648+0000", 2024-09-17T02:20:51.973 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6583999999999999e-05 2024-09-17T02:20:51.973 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.973 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.973 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.973 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556661+0000", 2024-09-17T02:20:51.973 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3203e-05 2024-09-17T02:20:51.974 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.974 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.974 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:51.974 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564413+0000", 2024-09-17T02:20:51.974 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0077523100000000001 2024-09-17T02:20:51.974 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.974 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.974 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:51.974 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.565841+0000", 2024-09-17T02:20:51.974 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014276320000000001 2024-09-17T02:20:51.974 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.974 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.974 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:51.974 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.566131+0000", 2024-09-17T02:20:51.975 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029043800000000001 2024-09-17T02:20:51.975 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.975 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.975 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:51.975 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572353+0000", 2024-09-17T02:20:51.975 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.006222399 2024-09-17T02:20:51.975 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.975 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.975 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.975 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588452+0000", 2024-09-17T02:20:51.975 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016098635 2024-09-17T02:20:51.975 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.975 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.975 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:51.976 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588520+0000", 2024-09-17T02:20:51.976 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8040000000000006e-05 2024-09-17T02:20:51.976 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.976 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.976 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:51.976 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588572+0000", 2024-09-17T02:20:51.976 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2111000000000003e-05 2024-09-17T02:20:51.976 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.976 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:51.976 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.976 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.976 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.976 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:51.977 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:20:51.977 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 35.380629051, 2024-09-17T02:20:51.977 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.032187205000000003, 2024-09-17T02:20:51.977 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:51.977 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:51.977 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.977 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:51.977 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.977 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:51.977 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:20:51.977 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.977 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.977 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.978 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:51.978 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:20:51.978 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.978 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.978 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.978 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:51.978 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556727+0000", 2024-09-17T02:20:51.978 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3000000000000002e-06 2024-09-17T02:20:51.978 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.978 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.978 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:51.978 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556736+0000", 2024-09-17T02:20:51.978 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4300000000000006e-06 2024-09-17T02:20:51.979 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.979 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.979 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:51.979 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556755+0000", 2024-09-17T02:20:51.979 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9700000000000001e-05 2024-09-17T02:20:51.979 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.979 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.979 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.979 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556771+0000", 2024-09-17T02:20:51.979 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5213e-05 2024-09-17T02:20:51.979 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.979 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.979 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:51.979 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571184+0000", 2024-09-17T02:20:51.980 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014413888999999999 2024-09-17T02:20:51.980 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.980 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.980 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:51.980 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571302+0000", 2024-09-17T02:20:51.980 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011794900000000001 2024-09-17T02:20:51.980 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.980 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.980 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:51.980 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571494+0000", 2024-09-17T02:20:51.980 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000191168 2024-09-17T02:20:51.980 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.980 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.981 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:51.981 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.573775+0000", 2024-09-17T02:20:51.981 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002281656 2024-09-17T02:20:51.981 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.981 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.981 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.981 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588668+0000", 2024-09-17T02:20:51.981 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014892699000000001 2024-09-17T02:20:51.981 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.981 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.981 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:51.981 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588813+0000", 2024-09-17T02:20:51.981 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014530700000000001 2024-09-17T02:20:51.982 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.982 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.982 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:51.982 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588906+0000", 2024-09-17T02:20:51.982 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2893999999999995e-05 2024-09-17T02:20:51.982 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.982 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:51.982 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.982 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.982 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.982 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:51.982 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:20:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 35.380487885999997, 2024-09-17T02:20:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028815922000000001, 2024-09-17T02:20:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:20:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:20:51.984 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.984 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.984 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.984 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:51.984 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556861+0000", 2024-09-17T02:20:51.984 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.08e-06 2024-09-17T02:20:51.984 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.984 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.984 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:51.984 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556867+0000", 2024-09-17T02:20:51.984 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.207e-06 2024-09-17T02:20:51.984 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.985 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.985 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:51.985 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556886+0000", 2024-09-17T02:20:51.985 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9137e-05 2024-09-17T02:20:51.985 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.985 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.985 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.985 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556900+0000", 2024-09-17T02:20:51.985 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3253e-05 2024-09-17T02:20:51.985 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.985 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.985 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:51.986 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558301+0000", 2024-09-17T02:20:51.986 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014008320000000001 2024-09-17T02:20:51.986 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.986 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.986 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:51.986 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558564+0000", 2024-09-17T02:20:51.986 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000263238 2024-09-17T02:20:51.986 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.986 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.986 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:51.986 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558905+0000", 2024-09-17T02:20:51.986 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000341534 2024-09-17T02:20:51.986 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.987 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.987 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:51.987 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.568208+0000", 2024-09-17T02:20:51.987 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0093023689999999996 2024-09-17T02:20:51.987 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.987 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.987 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.987 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585379+0000", 2024-09-17T02:20:51.987 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017171091999999999 2024-09-17T02:20:51.987 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.987 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.987 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:51.987 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585509+0000", 2024-09-17T02:20:51.988 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013036100000000001 2024-09-17T02:20:51.988 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.988 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.988 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:51.988 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585676+0000", 2024-09-17T02:20:51.988 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016681899999999999 2024-09-17T02:20:51.988 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.988 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:51.988 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.988 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.988 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.988 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:51.988 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:20:51.989 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 35.380430619000002, 2024-09-17T02:20:51.989 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030862568, 2024-09-17T02:20:51.989 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:51.989 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:51.989 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.989 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:51.989 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.989 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:51.989 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:20:51.989 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.989 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.989 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.989 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:51.990 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:20:51.990 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.990 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.990 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.990 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:51.990 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556918+0000", 2024-09-17T02:20:51.990 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0529999999999999e-06 2024-09-17T02:20:51.990 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.990 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.990 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:51.990 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556925+0000", 2024-09-17T02:20:51.990 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.6939999999999998e-06 2024-09-17T02:20:51.990 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.990 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.991 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:51.991 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556942+0000", 2024-09-17T02:20:51.991 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6803000000000002e-05 2024-09-17T02:20:51.991 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.991 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.991 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.991 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556955+0000", 2024-09-17T02:20:51.991 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2659e-05 2024-09-17T02:20:51.991 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.991 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.991 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:51.991 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558237+0000", 2024-09-17T02:20:51.991 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001282804 2024-09-17T02:20:51.992 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.992 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.992 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:51.992 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558495+0000", 2024-09-17T02:20:51.992 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000257178 2024-09-17T02:20:51.992 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.992 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.992 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:51.992 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562168+0000", 2024-09-17T02:20:51.992 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0036737110000000001 2024-09-17T02:20:51.992 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.992 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.992 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:51.993 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.570855+0000", 2024-09-17T02:20:51.993 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0086868729999999995 2024-09-17T02:20:51.993 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.993 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.993 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.993 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587568+0000", 2024-09-17T02:20:51.993 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016712444999999999 2024-09-17T02:20:51.993 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.993 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.993 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:51.993 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587677+0000", 2024-09-17T02:20:51.993 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000109879 2024-09-17T02:20:51.993 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.994 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.994 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:51.994 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587780+0000", 2024-09-17T02:20:51.994 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000102469 2024-09-17T02:20:51.994 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.994 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:51.994 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:51.994 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.994 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.994 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:51.994 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:20:51.994 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 35.380348486999999, 2024-09-17T02:20:51.994 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031005751000000002, 2024-09-17T02:20:51.994 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:51.995 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:51.995 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:51.995 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:51.995 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.995 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:51.995 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:20:51.995 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.995 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.995 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.995 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:51.995 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:20:51.995 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:51.995 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.995 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.996 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:51.996 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557001+0000", 2024-09-17T02:20:51.996 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.237e-06 2024-09-17T02:20:51.996 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.996 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.996 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:51.996 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557007+0000", 2024-09-17T02:20:51.996 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7270000000000001e-06 2024-09-17T02:20:51.996 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.996 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.996 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:51.996 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557025+0000", 2024-09-17T02:20:51.996 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7689999999999998e-05 2024-09-17T02:20:51.997 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.997 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.997 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:51.997 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557039+0000", 2024-09-17T02:20:51.997 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.385e-05 2024-09-17T02:20:51.997 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.997 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.997 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:51.997 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563783+0000", 2024-09-17T02:20:51.997 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0067437110000000003 2024-09-17T02:20:51.997 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.997 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.997 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:51.998 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564031+0000", 2024-09-17T02:20:51.998 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00024871799999999999 2024-09-17T02:20:51.998 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.998 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.998 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:51.998 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564518+0000", 2024-09-17T02:20:51.998 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00048708999999999997 2024-09-17T02:20:51.998 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.998 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.998 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:51.998 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572375+0000", 2024-09-17T02:20:51.998 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078564780000000001 2024-09-17T02:20:51.998 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.999 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.999 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:51.999 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587862+0000", 2024-09-17T02:20:51.999 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015486837999999999 2024-09-17T02:20:51.999 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.999 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.999 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:51.999 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587954+0000", 2024-09-17T02:20:51.999 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1766000000000002e-05 2024-09-17T02:20:51.999 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:51.999 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:51.999 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:51.999 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588005+0000", 2024-09-17T02:20:51.999 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1646e-05 2024-09-17T02:20:52.000 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:52.000 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:52.000 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:52.000 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.000 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.000 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:52.000 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:20:52.000 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 35.380204190999997, 2024-09-17T02:20:52.000 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029554871999999999, 2024-09-17T02:20:52.000 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:52.000 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:52.000 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:52.000 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:52.001 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.001 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:52.001 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:20:52.001 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:52.001 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.001 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.001 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:52.001 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:20:52.001 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:52.001 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.001 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.001 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:52.001 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557145+0000", 2024-09-17T02:20:52.002 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.263e-06 2024-09-17T02:20:52.002 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.002 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.002 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:52.002 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557151+0000", 2024-09-17T02:20:52.002 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1040000000000003e-06 2024-09-17T02:20:52.002 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.002 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.002 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:52.002 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557168+0000", 2024-09-17T02:20:52.002 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7289999999999999e-05 2024-09-17T02:20:52.002 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.002 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.002 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.003 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557182+0000", 2024-09-17T02:20:52.003 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.325e-05 2024-09-17T02:20:52.003 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.003 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.003 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:52.003 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564102+0000", 2024-09-17T02:20:52.003 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069199860000000004 2024-09-17T02:20:52.003 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.003 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.003 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:52.003 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564438+0000", 2024-09-17T02:20:52.003 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033651800000000001 2024-09-17T02:20:52.003 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.003 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.004 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:52.004 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.565422+0000", 2024-09-17T02:20:52.004 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00098332499999999995 2024-09-17T02:20:52.004 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.004 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.004 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:52.004 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572361+0000", 2024-09-17T02:20:52.004 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069392630000000002 2024-09-17T02:20:52.004 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.004 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.004 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:52.004 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586567+0000", 2024-09-17T02:20:52.004 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014206107000000001 2024-09-17T02:20:52.004 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.005 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.005 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:52.005 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586643+0000", 2024-09-17T02:20:52.005 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5673000000000005e-05 2024-09-17T02:20:52.005 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.005 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.005 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:52.005 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586699+0000", 2024-09-17T02:20:52.005 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6093e-05 2024-09-17T02:20:52.005 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:52.005 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:52.005 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:52.005 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.006 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.006 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:52.006 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:20:52.006 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 35.380070498999999, 2024-09-17T02:20:52.006 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029800569999999998, 2024-09-17T02:20:52.006 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:52.006 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:52.006 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:52.006 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:52.006 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.006 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:52.006 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:20:52.006 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:52.007 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.007 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.007 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:52.007 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:20:52.007 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:52.007 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.007 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.007 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:52.007 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557279+0000", 2024-09-17T02:20:52.007 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.497e-06 2024-09-17T02:20:52.007 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.007 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.007 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:52.008 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557287+0000", 2024-09-17T02:20:52.008 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9030000000000004e-06 2024-09-17T02:20:52.008 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.008 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.008 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:52.008 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557306+0000", 2024-09-17T02:20:52.008 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9394000000000001e-05 2024-09-17T02:20:52.008 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.008 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.008 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.008 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557323+0000", 2024-09-17T02:20:52.008 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6299000000000001e-05 2024-09-17T02:20:52.008 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.008 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.009 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:52.009 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.570931+0000", 2024-09-17T02:20:52.009 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013608841999999999 2024-09-17T02:20:52.009 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.009 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.009 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:52.009 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571250+0000", 2024-09-17T02:20:52.009 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031817400000000001 2024-09-17T02:20:52.009 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.009 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.009 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:52.009 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571559+0000", 2024-09-17T02:20:52.010 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000309835 2024-09-17T02:20:52.010 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.010 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.010 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:52.010 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.574161+0000", 2024-09-17T02:20:52.010 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002601543 2024-09-17T02:20:52.010 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.010 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.010 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:52.011 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586866+0000", 2024-09-17T02:20:52.011 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012704968000000001 2024-09-17T02:20:52.011 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.011 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.011 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:52.011 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586987+0000", 2024-09-17T02:20:52.011 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000121369 2024-09-17T02:20:52.011 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.011 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.011 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:52.011 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587078+0000", 2024-09-17T02:20:52.011 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0746000000000002e-05 2024-09-17T02:20:52.011 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:52.011 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:52.012 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:52.012 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.012 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.012 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:52.012 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:20:52.012 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 35.380004855999999, 2024-09-17T02:20:52.012 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029936054, 2024-09-17T02:20:52.012 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:52.012 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:52.012 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:52.012 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:52.012 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.012 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:52.013 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:20:52.013 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:52.013 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.013 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.013 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:52.013 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:20:52.013 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:52.013 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.013 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.013 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:52.013 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557344+0000", 2024-09-17T02:20:52.013 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.347e-06 2024-09-17T02:20:52.013 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.013 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.013 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:52.014 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557351+0000", 2024-09-17T02:20:52.014 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5560000000000004e-06 2024-09-17T02:20:52.014 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.014 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.014 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:52.014 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557369+0000", 2024-09-17T02:20:52.014 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7703e-05 2024-09-17T02:20:52.014 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.014 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.014 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.014 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557382+0000", 2024-09-17T02:20:52.014 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3664e-05 2024-09-17T02:20:52.014 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.014 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.015 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:52.015 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558997+0000", 2024-09-17T02:20:52.015 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0016147970000000001 2024-09-17T02:20:52.015 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.015 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.015 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:52.015 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559236+0000", 2024-09-17T02:20:52.015 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00023900200000000001 2024-09-17T02:20:52.015 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.015 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.015 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:52.015 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559547+0000", 2024-09-17T02:20:52.015 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031132399999999998 2024-09-17T02:20:52.016 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.016 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.016 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:52.016 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563130+0000", 2024-09-17T02:20:52.016 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003582989 2024-09-17T02:20:52.016 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.016 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.016 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:52.016 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587069+0000", 2024-09-17T02:20:52.016 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023938496 2024-09-17T02:20:52.016 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.016 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.016 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:52.016 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587192+0000", 2024-09-17T02:20:52.017 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123514 2024-09-17T02:20:52.017 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.017 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.017 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:52.017 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587279+0000", 2024-09-17T02:20:52.017 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6662000000000005e-05 2024-09-17T02:20:52.017 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:52.017 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:52.017 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:52.017 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.017 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.017 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:52.017 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:20:52.018 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 35.379946969999999, 2024-09-17T02:20:52.018 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030490703000000001, 2024-09-17T02:20:52.018 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:52.018 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:52.018 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:52.018 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:52.018 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.018 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:52.018 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:20:52.018 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:52.018 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.018 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.018 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:52.019 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:20:52.019 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:52.019 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.019 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.019 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:52.019 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557403+0000", 2024-09-17T02:20:52.019 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.77e-06 2024-09-17T02:20:52.019 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.019 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.019 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:52.019 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557412+0000", 2024-09-17T02:20:52.019 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4099999999999997e-06 2024-09-17T02:20:52.019 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.019 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.020 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:52.020 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557431+0000", 2024-09-17T02:20:52.020 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9177e-05 2024-09-17T02:20:52.020 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.020 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.020 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.020 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557444+0000", 2024-09-17T02:20:52.020 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2999999999999999e-05 2024-09-17T02:20:52.020 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.020 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.020 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:52.020 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557722+0000", 2024-09-17T02:20:52.020 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00027760699999999997 2024-09-17T02:20:52.020 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.021 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.021 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:52.021 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557991+0000", 2024-09-17T02:20:52.021 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00026892499999999999 2024-09-17T02:20:52.021 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.021 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.021 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:52.021 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558265+0000", 2024-09-17T02:20:52.021 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000274524 2024-09-17T02:20:52.021 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.021 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.021 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:52.022 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564270+0000", 2024-09-17T02:20:52.022 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060045339999999997 2024-09-17T02:20:52.022 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.022 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.022 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:52.022 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587701+0000", 2024-09-17T02:20:52.022 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023431285999999999 2024-09-17T02:20:52.022 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.022 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.022 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:52.022 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587803+0000", 2024-09-17T02:20:52.022 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000101371 2024-09-17T02:20:52.022 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.022 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.022 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:52.023 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587892+0000", 2024-09-17T02:20:52.023 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9098999999999995e-05 2024-09-17T02:20:52.023 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:52.023 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:52.023 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:52.023 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.023 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.023 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:52.023 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:20:52.023 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 35.379865373999998, 2024-09-17T02:20:52.023 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029886725999999999, 2024-09-17T02:20:52.023 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:52.023 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:52.024 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:20:52.024 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:52.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.024 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:52.024 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:20:52.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:52.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.024 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:52.024 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:20:52.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:52.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:52.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557484+0000", 2024-09-17T02:20:52.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.26e-06 2024-09-17T02:20:52.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:52.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557489+0000", 2024-09-17T02:20:52.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2530000000000004e-06 2024-09-17T02:20:52.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:52.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557507+0000", 2024-09-17T02:20:52.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7473999999999999e-05 2024-09-17T02:20:52.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557524+0000", 2024-09-17T02:20:52.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7912999999999999e-05 2024-09-17T02:20:52.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:52.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572428+0000", 2024-09-17T02:20:52.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014903451999999999 2024-09-17T02:20:52.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:52.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572589+0000", 2024-09-17T02:20:52.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000161299 2024-09-17T02:20:52.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.027 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:52.027 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587369+0000", 2024-09-17T02:20:52.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014780075 2024-09-17T02:20:52.027 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:52.027 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:52.027 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:52.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.027 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28720 5.f 5:f8a7aea5:::benchmark_data_smithi001_23533_object28719:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:52.027 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:20:52.028 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 9.3695610590000005, 2024-09-17T02:20:52.028 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.033978608, 2024-09-17T02:20:52.028 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:52.028 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:52.028 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:52.028 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:52.028 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:52.028 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:52.028 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28720 2024-09-17T02:20:52.028 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.028 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:52.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.028 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:52.028 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:20:52.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:52.029 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.029 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.029 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:52.029 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:20:52.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:52.029 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.029 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.029 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:52.029 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:20:52.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3200000000000005e-07 2024-09-17T02:20:52.029 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.029 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.029 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:52.030 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567856+0000", 2024-09-17T02:20:52.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8596000000000005e-05 2024-09-17T02:20:52.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.030 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.030 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:52.030 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567864+0000", 2024-09-17T02:20:52.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6040000000000004e-06 2024-09-17T02:20:52.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.030 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.030 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.030 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567867+0000", 2024-09-17T02:20:52.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7929999999999999e-06 2024-09-17T02:20:52.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:52.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567896+0000", 2024-09-17T02:20:52.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8444000000000001e-05 2024-09-17T02:20:52.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:52.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567983+0000", 2024-09-17T02:20:52.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7498999999999997e-05 2024-09-17T02:20:52.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:52.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568078+0000", 2024-09-17T02:20:52.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5050999999999995e-05 2024-09-17T02:20:52.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:52.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573091+0000", 2024-09-17T02:20:52.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050124599999999998 2024-09-17T02:20:52.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:52.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601705+0000", 2024-09-17T02:20:52.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028614298999999999 2024-09-17T02:20:52.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:52.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601741+0000", 2024-09-17T02:20:52.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5329e-05 2024-09-17T02:20:52.033 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.033 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:52.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601766+0000", 2024-09-17T02:20:52.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5001e-05 2024-09-17T02:20:52.033 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:52.033 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:52.033 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:52.033 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.033 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28723 5.f 5:f1a2a8f6:::benchmark_data_smithi001_23533_object28722:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:52.033 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:20:52.034 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 9.3692823789999995, 2024-09-17T02:20:52.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.033805288000000003, 2024-09-17T02:20:52.034 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:52.034 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:52.034 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:52.034 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:52.034 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:52.034 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:52.034 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28723 2024-09-17T02:20:52.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.034 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:52.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.034 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:52.034 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:20:52.035 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:52.035 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.035 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.035 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:52.035 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:20:52.035 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:52.035 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.035 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.035 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:52.035 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568067+0000", 2024-09-17T02:20:52.035 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6700000000000002e-07 2024-09-17T02:20:52.035 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.035 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.036 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:52.036 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568121+0000", 2024-09-17T02:20:52.036 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4286000000000002e-05 2024-09-17T02:20:52.036 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.036 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.036 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:52.036 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568131+0000", 2024-09-17T02:20:52.036 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0288e-05 2024-09-17T02:20:52.036 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.036 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.036 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.036 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568139+0000", 2024-09-17T02:20:52.036 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5399999999999998e-06 2024-09-17T02:20:52.036 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:52.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569194+0000", 2024-09-17T02:20:52.037 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0010557100000000001 2024-09-17T02:20:52.037 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:52.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569298+0000", 2024-09-17T02:20:52.037 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000103491 2024-09-17T02:20:52.037 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:52.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569428+0000", 2024-09-17T02:20:52.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013050599999999999 2024-09-17T02:20:52.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:52.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573124+0000", 2024-09-17T02:20:52.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0036956810000000001 2024-09-17T02:20:52.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:52.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601801+0000", 2024-09-17T02:20:52.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028676667999999999 2024-09-17T02:20:52.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.039 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:52.039 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601835+0000", 2024-09-17T02:20:52.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4347000000000002e-05 2024-09-17T02:20:52.039 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.039 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:52.039 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601871+0000", 2024-09-17T02:20:52.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5803999999999998e-05 2024-09-17T02:20:52.039 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:52.039 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:52.039 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:52.039 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.039 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28729 5.9 5:9e3b1489:::benchmark_data_smithi001_23533_object28728:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:52.040 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:20:52.040 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 9.3676637280000001, 2024-09-17T02:20:52.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.032738525999999997, 2024-09-17T02:20:52.040 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:52.040 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:52.040 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:52.040 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:52.040 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:52.040 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:52.040 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28729 2024-09-17T02:20:52.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.040 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:52.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.041 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:52.041 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:20:52.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:52.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.041 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:52.041 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:20:52.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:52.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.041 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:52.041 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569685+0000", 2024-09-17T02:20:52.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8599999999999996e-07 2024-09-17T02:20:52.042 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:52.042 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569725+0000", 2024-09-17T02:20:52.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0144000000000001e-05 2024-09-17T02:20:52.042 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:52.042 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569737+0000", 2024-09-17T02:20:52.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1752e-05 2024-09-17T02:20:52.042 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569745+0000", 2024-09-17T02:20:52.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6420000000000007e-06 2024-09-17T02:20:52.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:52.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569801+0000", 2024-09-17T02:20:52.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6110000000000003e-05 2024-09-17T02:20:52.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:52.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569944+0000", 2024-09-17T02:20:52.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014361500000000001 2024-09-17T02:20:52.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.044 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:52.044 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.570234+0000", 2024-09-17T02:20:52.044 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00028927899999999998 2024-09-17T02:20:52.044 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.044 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:52.044 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572606+0000", 2024-09-17T02:20:52.044 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023725529999999999 2024-09-17T02:20:52.044 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.044 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:52.044 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602361+0000", 2024-09-17T02:20:52.044 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029755031000000001 2024-09-17T02:20:52.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:52.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602397+0000", 2024-09-17T02:20:52.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5509000000000002e-05 2024-09-17T02:20:52.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:52.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602423+0000", 2024-09-17T02:20:52.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5905e-05 2024-09-17T02:20:52.045 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:52.045 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:52.045 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:52.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.046 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.046 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28734 5.f 5:f1a63647:::benchmark_data_smithi001_23533_object28733:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:52.046 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:20:52.046 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 9.3659412419999999, 2024-09-17T02:20:52.046 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.034441100000000002, 2024-09-17T02:20:52.046 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:52.046 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:52.046 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:52.046 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:52.046 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:52.046 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:52.046 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28734 2024-09-17T02:20:52.046 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.046 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:52.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:52.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:20:52.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:52.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:52.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:20:52.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:52.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:52.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571408+0000", 2024-09-17T02:20:52.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.8899999999999998e-07 2024-09-17T02:20:52.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:52.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571464+0000", 2024-09-17T02:20:52.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6546999999999999e-05 2024-09-17T02:20:52.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:52.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571474+0000", 2024-09-17T02:20:52.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0348e-05 2024-09-17T02:20:52.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571480+0000", 2024-09-17T02:20:52.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.366e-06 2024-09-17T02:20:52.049 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.049 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:52.049 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572097+0000", 2024-09-17T02:20:52.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061710599999999997 2024-09-17T02:20:52.049 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.049 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:52.049 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572172+0000", 2024-09-17T02:20:52.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4658000000000002e-05 2024-09-17T02:20:52.049 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.049 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:52.050 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572247+0000", 2024-09-17T02:20:52.050 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5766000000000006e-05 2024-09-17T02:20:52.050 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.050 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:52.050 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573819+0000", 2024-09-17T02:20:52.050 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015713649999999999 2024-09-17T02:20:52.050 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.050 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:52.050 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605762+0000", 2024-09-17T02:20:52.050 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031943304999999998 2024-09-17T02:20:52.050 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:52.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605808+0000", 2024-09-17T02:20:52.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5776999999999999e-05 2024-09-17T02:20:52.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:52.051 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:52.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:52.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605848+0000", 2024-09-17T02:20:52.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9972999999999998e-05 2024-09-17T02:20:52.051 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:52.051 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:52.051 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:52.051 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:52.051 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:52.051 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:20:52.053 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:20:52.054 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:52.055+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:52.153 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:52.155+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:52.212 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:20:52.212 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:20:52.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.212 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:53253 5.4 5:20f0a2ae:::benchmark_data_smithi001_23533_object53252:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-17T02:20:52.213 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:52.211091+0000", 2024-09-17T02:20:52.213 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0073250549999999996, 2024-09-17T02:20:52.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073464359999999996, 2024-09-17T02:20:52.213 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.213 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.213 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:52.213 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:52.213 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:52.213 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:52.213 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 53253 2024-09-17T02:20:52.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.213 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.211091+0000", 2024-09-17T02:20:52.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.211091+0000", 2024-09-17T02:20:52.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.211091+0000", 2024-09-17T02:20:52.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9900000000000001e-07 2024-09-17T02:20:52.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.211126+0000", 2024-09-17T02:20:52.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4555999999999999e-05 2024-09-17T02:20:52.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.211133+0000", 2024-09-17T02:20:52.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3780000000000003e-06 2024-09-17T02:20:52.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.211137+0000", 2024-09-17T02:20:52.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6839999999999998e-06 2024-09-17T02:20:52.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.211204+0000", 2024-09-17T02:20:52.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7139999999999998e-05 2024-09-17T02:20:52.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.211345+0000", 2024-09-17T02:20:52.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014108400000000001 2024-09-17T02:20:52.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:52.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.211491+0000", 2024-09-17T02:20:52.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000145795 2024-09-17T02:20:52.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:52.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.215611+0000", 2024-09-17T02:20:52.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041205189999999996 2024-09-17T02:20:52.217 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.217 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.217 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.218 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:53256 5.4 5:2e47682e:::benchmark_data_smithi001_23533_object53255:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-17T02:20:52.218 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:52.211907+0000", 2024-09-17T02:20:52.218 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0065090089999999996, 2024-09-17T02:20:52.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0065918289999999996, 2024-09-17T02:20:52.218 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.218 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.218 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:52.218 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:52.218 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:52.218 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:52.218 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 53256 2024-09-17T02:20:52.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.218 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.211907+0000", 2024-09-17T02:20:52.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.211907+0000", 2024-09-17T02:20:52.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.211908+0000", 2024-09-17T02:20:52.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3099999999999997e-07 2024-09-17T02:20:52.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.211991+0000", 2024-09-17T02:20:52.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3553000000000005e-05 2024-09-17T02:20:52.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.212001+0000", 2024-09-17T02:20:52.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7520000000000008e-06 2024-09-17T02:20:52.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.212006+0000", 2024-09-17T02:20:52.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8790000000000002e-06 2024-09-17T02:20:52.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.213453+0000", 2024-09-17T02:20:52.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014476230000000001 2024-09-17T02:20:52.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.213603+0000", 2024-09-17T02:20:52.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000150104 2024-09-17T02:20:52.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:52.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.213781+0000", 2024-09-17T02:20:52.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000177419 2024-09-17T02:20:52.222 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.222 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.222 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.222 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:53261 5.4 5:2da89bc7:::benchmark_data_smithi001_23533_object53260:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-17T02:20:52.222 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:52.213954+0000", 2024-09-17T02:20:52.222 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0044622289999999998, 2024-09-17T02:20:52.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046058669999999996, 2024-09-17T02:20:52.223 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.223 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.223 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:52.223 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:52.223 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:52.223 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:52.223 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 53261 2024-09-17T02:20:52.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.223 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.213954+0000", 2024-09-17T02:20:52.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.213954+0000", 2024-09-17T02:20:52.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.213954+0000", 2024-09-17T02:20:52.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7000000000000004e-07 2024-09-17T02:20:52.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214093+0000", 2024-09-17T02:20:52.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013887900000000001 2024-09-17T02:20:52.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214104+0000", 2024-09-17T02:20:52.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0298e-05 2024-09-17T02:20:52.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214108+0000", 2024-09-17T02:20:52.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9529999999999998e-06 2024-09-17T02:20:52.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.216611+0000", 2024-09-17T02:20:52.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025029750000000002 2024-09-17T02:20:52.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.216865+0000", 2024-09-17T02:20:52.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025365300000000001 2024-09-17T02:20:52.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:52.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.217010+0000", 2024-09-17T02:20:52.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000144711 2024-09-17T02:20:52.227 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.227 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.227 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.227 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:53258 5.8 e32/26 5:1244cf18:::benchmark_data_smithi001_23533_object53257:head v 32'3368, mlcod=32'3366)", 2024-09-17T02:20:52.227 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:52.214483+0000", 2024-09-17T02:20:52.227 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0039328319999999998, 2024-09-17T02:20:52.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041184689999999996, 2024-09-17T02:20:52.227 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.227 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.227 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:52.227 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214483+0000", 2024-09-17T02:20:52.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214483+0000", 2024-09-17T02:20:52.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214483+0000", 2024-09-17T02:20:52.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.91e-07 2024-09-17T02:20:52.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214546+0000", 2024-09-17T02:20:52.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2680000000000003e-05 2024-09-17T02:20:52.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214552+0000", 2024-09-17T02:20:52.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0360000000000003e-06 2024-09-17T02:20:52.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214556+0000", 2024-09-17T02:20:52.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.861e-06 2024-09-17T02:20:52.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214591+0000", 2024-09-17T02:20:52.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4715000000000002e-05 2024-09-17T02:20:52.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214603+0000", 2024-09-17T02:20:52.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.256e-05 2024-09-17T02:20:52.230 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.230 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.231 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.231 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:53259 5.9 e32/22 5:992bba41:::benchmark_data_smithi001_23533_object53258:head v 32'3326, mlcod=32'3324)", 2024-09-17T02:20:52.231 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:52.214641+0000", 2024-09-17T02:20:52.231 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0037746810000000002, 2024-09-17T02:20:52.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003992013, 2024-09-17T02:20:52.231 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.231 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.231 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:52.231 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214641+0000", 2024-09-17T02:20:52.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214641+0000", 2024-09-17T02:20:52.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214642+0000", 2024-09-17T02:20:52.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8899999999999998e-07 2024-09-17T02:20:52.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214743+0000", 2024-09-17T02:20:52.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101017 2024-09-17T02:20:52.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214771+0000", 2024-09-17T02:20:52.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8285000000000001e-05 2024-09-17T02:20:52.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214791+0000", 2024-09-17T02:20:52.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9902999999999999e-05 2024-09-17T02:20:52.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214851+0000", 2024-09-17T02:20:52.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0358e-05 2024-09-17T02:20:52.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214873+0000", 2024-09-17T02:20:52.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1852e-05 2024-09-17T02:20:52.235 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.235 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.235 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.235 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:53267 5.b 5:d3b03591:::benchmark_data_smithi001_23533_object53266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-17T02:20:52.235 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:52.214678+0000", 2024-09-17T02:20:52.235 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0037376699999999998, 2024-09-17T02:20:52.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039886180000000002, 2024-09-17T02:20:52.235 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.235 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.235 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:52.235 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:52.236 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:52.236 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:52.236 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 53267 2024-09-17T02:20:52.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.236 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214678+0000", 2024-09-17T02:20:52.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214678+0000", 2024-09-17T02:20:52.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214679+0000", 2024-09-17T02:20:52.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7000000000000003e-07 2024-09-17T02:20:52.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214796+0000", 2024-09-17T02:20:52.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011737 2024-09-17T02:20:52.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214837+0000", 2024-09-17T02:20:52.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0608000000000002e-05 2024-09-17T02:20:52.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214848+0000", 2024-09-17T02:20:52.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0771000000000001e-05 2024-09-17T02:20:52.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214929+0000", 2024-09-17T02:20:52.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1180000000000005e-05 2024-09-17T02:20:52.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.215089+0000", 2024-09-17T02:20:52.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016039400000000001 2024-09-17T02:20:52.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:52.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.215253+0000", 2024-09-17T02:20:52.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016359299999999999 2024-09-17T02:20:52.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:52.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.218529+0000", 2024-09-17T02:20:52.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032762920000000001 2024-09-17T02:20:52.240 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.240 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.240 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.240 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:53265 5.0 e32/26 5:0406740d:::benchmark_data_smithi001_23533_object53264:head v 32'3309, mlcod=32'3307)", 2024-09-17T02:20:52.240 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:52.214900+0000", 2024-09-17T02:20:52.240 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0035161609999999999, 2024-09-17T02:20:52.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038083230000000002, 2024-09-17T02:20:52.240 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.240 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.240 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:52.241 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214900+0000", 2024-09-17T02:20:52.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214900+0000", 2024-09-17T02:20:52.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214900+0000", 2024-09-17T02:20:52.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.75e-07 2024-09-17T02:20:52.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214932+0000", 2024-09-17T02:20:52.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2248e-05 2024-09-17T02:20:52.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214940+0000", 2024-09-17T02:20:52.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4580000000000004e-06 2024-09-17T02:20:52.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214944+0000", 2024-09-17T02:20:52.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9670000000000003e-06 2024-09-17T02:20:52.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214984+0000", 2024-09-17T02:20:52.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0472999999999997e-05 2024-09-17T02:20:52.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.214997+0000", 2024-09-17T02:20:52.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.275e-05 2024-09-17T02:20:52.244 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.244 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.244 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.244 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:53268 5.8 e32/26 5:1c1b0135:::benchmark_data_smithi001_23533_object53267:head v 32'3369, mlcod=32'3366)", 2024-09-17T02:20:52.244 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:52.216465+0000", 2024-09-17T02:20:52.244 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00195043, 2024-09-17T02:20:52.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022765300000000001, 2024-09-17T02:20:52.244 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.244 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.244 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:52.244 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.216465+0000", 2024-09-17T02:20:52.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.216465+0000", 2024-09-17T02:20:52.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.216466+0000", 2024-09-17T02:20:52.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4000000000000001e-07 2024-09-17T02:20:52.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.216536+0000", 2024-09-17T02:20:52.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0081999999999997e-05 2024-09-17T02:20:52.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.216548+0000", 2024-09-17T02:20:52.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1855000000000001e-05 2024-09-17T02:20:52.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.216556+0000", 2024-09-17T02:20:52.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7519999999999996e-06 2024-09-17T02:20:52.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.217148+0000", 2024-09-17T02:20:52.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059229400000000005 2024-09-17T02:20:52.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:52.217165+0000", 2024-09-17T02:20:52.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6883000000000001e-05 2024-09-17T02:20:52.247 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.247 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.248 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.248 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.248 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:20:52.248 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 8 2024-09-17T02:20:52.248 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:20:52.249 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:20:52.254 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:52.255+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:52.354 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:52.359+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:52.405 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:20:52.405 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:20:52.405 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:20:52.405 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:20:52.405 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:20:52.427 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:20:52.455 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:52.459+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:52.496 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:20:52.556 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:52.559+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:52.583 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:20:52.583 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:20:52.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:20:52.583 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:20:52.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.584 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:52.584 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:20:52.584 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.031150803000003, 2024-09-17T02:20:52.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035535028000000003, 2024-09-17T02:20:52.584 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.584 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.584 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:52.584 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:20:52.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:20:52.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556550+0000", 2024-09-17T02:20:52.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3500000000000001e-06 2024-09-17T02:20:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556566+0000", 2024-09-17T02:20:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5440000000000001e-05 2024-09-17T02:20:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556594+0000", 2024-09-17T02:20:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8552999999999999e-05 2024-09-17T02:20:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556618+0000", 2024-09-17T02:20:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3207e-05 2024-09-17T02:20:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578337+0000", 2024-09-17T02:20:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021719517000000001 2024-09-17T02:20:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578655+0000", 2024-09-17T02:20:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031837800000000002 2024-09-17T02:20:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.581374+0000", 2024-09-17T02:20:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002718238 2024-09-17T02:20:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587083+0000", 2024-09-17T02:20:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005708912 2024-09-17T02:20:52.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:52.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591823+0000", 2024-09-17T02:20:52.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047406080000000003 2024-09-17T02:20:52.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:52.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591972+0000", 2024-09-17T02:20:52.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014874199999999999 2024-09-17T02:20:52.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:52.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592082+0000", 2024-09-17T02:20:52.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110083 2024-09-17T02:20:52.590 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.590 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.590 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.590 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:52.590 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:20:52.590 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.030209315999997, 2024-09-17T02:20:52.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035128756999999997, 2024-09-17T02:20:52.590 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.591 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.591 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:52.591 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:20:52.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:20:52.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557491+0000", 2024-09-17T02:20:52.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.88e-06 2024-09-17T02:20:52.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557504+0000", 2024-09-17T02:20:52.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2864000000000001e-05 2024-09-17T02:20:52.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557535+0000", 2024-09-17T02:20:52.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0916e-05 2024-09-17T02:20:52.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557561+0000", 2024-09-17T02:20:52.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5602999999999999e-05 2024-09-17T02:20:52.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582290+0000", 2024-09-17T02:20:52.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024729729999999998 2024-09-17T02:20:52.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582642+0000", 2024-09-17T02:20:52.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035143499999999999 2024-09-17T02:20:52.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:52.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582959+0000", 2024-09-17T02:20:52.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031747399999999999 2024-09-17T02:20:52.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:52.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587302+0000", 2024-09-17T02:20:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043425169999999997 2024-09-17T02:20:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592391+0000", 2024-09-17T02:20:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050895799999999998 2024-09-17T02:20:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592516+0000", 2024-09-17T02:20:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012420500000000001 2024-09-17T02:20:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592617+0000", 2024-09-17T02:20:52.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010155299999999999 2024-09-17T02:20:52.596 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.596 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.596 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.596 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:52.596 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:20:52.596 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.030104817000002, 2024-09-17T02:20:52.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034796066, 2024-09-17T02:20:52.596 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.596 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.596 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:20:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:20:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557594+0000", 2024-09-17T02:20:52.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3769999999999999e-06 2024-09-17T02:20:52.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557683+0000", 2024-09-17T02:20:52.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8896999999999999e-05 2024-09-17T02:20:52.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557707+0000", 2024-09-17T02:20:52.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3839e-05 2024-09-17T02:20:52.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557730+0000", 2024-09-17T02:20:52.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3047000000000001e-05 2024-09-17T02:20:52.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582329+0000", 2024-09-17T02:20:52.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024599283999999999 2024-09-17T02:20:52.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582624+0000", 2024-09-17T02:20:52.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000294462 2024-09-17T02:20:52.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:52.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582936+0000", 2024-09-17T02:20:52.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031223399999999999 2024-09-17T02:20:52.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:52.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587347+0000", 2024-09-17T02:20:52.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044110340000000003 2024-09-17T02:20:52.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:52.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592165+0000", 2024-09-17T02:20:52.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048176699999999996 2024-09-17T02:20:52.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:52.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592311+0000", 2024-09-17T02:20:52.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014661899999999999 2024-09-17T02:20:52.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:52.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592389+0000", 2024-09-17T02:20:52.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7602999999999995e-05 2024-09-17T02:20:52.602 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.602 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.602 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.602 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:52.602 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:20:52.602 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.029587190000001, 2024-09-17T02:20:52.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034457472000000003, 2024-09-17T02:20:52.602 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.602 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:20:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:20:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558113+0000", 2024-09-17T02:20:52.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1639999999999999e-06 2024-09-17T02:20:52.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558125+0000", 2024-09-17T02:20:52.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2269999999999999e-05 2024-09-17T02:20:52.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558458+0000", 2024-09-17T02:20:52.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033322700000000001 2024-09-17T02:20:52.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558488+0000", 2024-09-17T02:20:52.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.951e-05 2024-09-17T02:20:52.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584514+0000", 2024-09-17T02:20:52.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026025721000000002 2024-09-17T02:20:52.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584781+0000", 2024-09-17T02:20:52.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000267142 2024-09-17T02:20:52.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:52.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585078+0000", 2024-09-17T02:20:52.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029738799999999999 2024-09-17T02:20:52.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:52.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588045+0000", 2024-09-17T02:20:52.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029673759999999999 2024-09-17T02:20:52.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:52.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592454+0000", 2024-09-17T02:20:52.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044090209999999999 2024-09-17T02:20:52.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:52.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592520+0000", 2024-09-17T02:20:52.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6032999999999996e-05 2024-09-17T02:20:52.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:52.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592568+0000", 2024-09-17T02:20:52.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7620000000000001e-05 2024-09-17T02:20:52.608 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.608 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.608 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.608 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:52.608 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:20:52.608 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.029126939000001, 2024-09-17T02:20:52.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031603266999999997, 2024-09-17T02:20:52.608 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.608 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.608 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:52.608 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:20:52.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:20:52.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558573+0000", 2024-09-17T02:20:52.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0660000000000002e-06 2024-09-17T02:20:52.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558585+0000", 2024-09-17T02:20:52.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1596999999999999e-05 2024-09-17T02:20:52.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558612+0000", 2024-09-17T02:20:52.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7115999999999999e-05 2024-09-17T02:20:52.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558631+0000", 2024-09-17T02:20:52.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9519999999999999e-05 2024-09-17T02:20:52.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558783+0000", 2024-09-17T02:20:52.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152025 2024-09-17T02:20:52.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-17T02:20:52.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558798+0000", 2024-09-17T02:20:52.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4966999999999999e-05 2024-09-17T02:20:52.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.572871+0000", 2024-09-17T02:20:52.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014072782000000001 2024-09-17T02:20:52.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573153+0000", 2024-09-17T02:20:52.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028214499999999998 2024-09-17T02:20:52.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:52.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573432+0000", 2024-09-17T02:20:52.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027932100000000002 2024-09-17T02:20:52.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:52.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582279+0000", 2024-09-17T02:20:52.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0088463310000000007 2024-09-17T02:20:52.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:52.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.589902+0000", 2024-09-17T02:20:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0076236050000000003 2024-09-17T02:20:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.589997+0000", 2024-09-17T02:20:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4456000000000005e-05 2024-09-17T02:20:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590174+0000", 2024-09-17T02:20:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000177336 2024-09-17T02:20:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.616 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:52.616 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:20:52.616 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.029023694000003, 2024-09-17T02:20:52.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031899064999999997, 2024-09-17T02:20:52.616 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.616 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.616 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:52.616 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:20:52.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:20:52.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558676+0000", 2024-09-17T02:20:52.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.39e-06 2024-09-17T02:20:52.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558686+0000", 2024-09-17T02:20:52.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.022e-05 2024-09-17T02:20:52.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558708+0000", 2024-09-17T02:20:52.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2249999999999999e-05 2024-09-17T02:20:52.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558725+0000", 2024-09-17T02:20:52.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7387000000000001e-05 2024-09-17T02:20:52.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558940+0000", 2024-09-17T02:20:52.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021453800000000001 2024-09-17T02:20:52.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting_for_map not empty", 2024-09-17T02:20:52.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558951+0000", 2024-09-17T02:20:52.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1303e-05 2024-09-17T02:20:52.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576237+0000", 2024-09-17T02:20:52.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017285723999999999 2024-09-17T02:20:52.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576454+0000", 2024-09-17T02:20:52.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021673800000000001 2024-09-17T02:20:52.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:52.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576932+0000", 2024-09-17T02:20:52.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047792700000000001 2024-09-17T02:20:52.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:52.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585689+0000", 2024-09-17T02:20:52.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0087572880000000002 2024-09-17T02:20:52.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:52.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590287+0000", 2024-09-17T02:20:52.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045978060000000003 2024-09-17T02:20:52.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:52.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590447+0000", 2024-09-17T02:20:52.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000160719 2024-09-17T02:20:52.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:52.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590573+0000", 2024-09-17T02:20:52.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012577500000000001 2024-09-17T02:20:52.622 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.622 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.622 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.623 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:52.623 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:20:52.623 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.028945724000003, 2024-09-17T02:20:52.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034114029999999997, 2024-09-17T02:20:52.623 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.623 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.623 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:52.623 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:20:52.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:20:52.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558753+0000", 2024-09-17T02:20:52.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2699999999999999e-06 2024-09-17T02:20:52.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558769+0000", 2024-09-17T02:20:52.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5906e-05 2024-09-17T02:20:52.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558791+0000", 2024-09-17T02:20:52.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1342999999999999e-05 2024-09-17T02:20:52.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558806+0000", 2024-09-17T02:20:52.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5829999999999999e-05 2024-09-17T02:20:52.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584906+0000", 2024-09-17T02:20:52.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026099273999999999 2024-09-17T02:20:52.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585158+0000", 2024-09-17T02:20:52.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025194600000000002 2024-09-17T02:20:52.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:52.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585368+0000", 2024-09-17T02:20:52.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210068 2024-09-17T02:20:52.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:52.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588098+0000", 2024-09-17T02:20:52.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002730522 2024-09-17T02:20:52.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:52.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592680+0000", 2024-09-17T02:20:52.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045816019999999997 2024-09-17T02:20:52.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:52.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592774+0000", 2024-09-17T02:20:52.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3726000000000004e-05 2024-09-17T02:20:52.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:52.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592866+0000", 2024-09-17T02:20:52.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2542999999999998e-05 2024-09-17T02:20:52.628 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.628 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.628 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.629 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:52.629 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:20:52.629 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.028869421000003, 2024-09-17T02:20:52.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031407875000000002, 2024-09-17T02:20:52.629 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.629 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.629 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:52.629 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:20:52.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:20:52.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558830+0000", 2024-09-17T02:20:52.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3599999999999999e-06 2024-09-17T02:20:52.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558835+0000", 2024-09-17T02:20:52.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6130000000000003e-06 2024-09-17T02:20:52.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558853+0000", 2024-09-17T02:20:52.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8099999999999999e-05 2024-09-17T02:20:52.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558869+0000", 2024-09-17T02:20:52.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.59e-05 2024-09-17T02:20:52.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560437+0000", 2024-09-17T02:20:52.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015677989999999999 2024-09-17T02:20:52.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-17T02:20:52.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560453+0000", 2024-09-17T02:20:52.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.535e-05 2024-09-17T02:20:52.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562422+0000", 2024-09-17T02:20:52.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00196934 2024-09-17T02:20:52.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562773+0000", 2024-09-17T02:20:52.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035152399999999998 2024-09-17T02:20:52.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:52.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590236+0000", 2024-09-17T02:20:52.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.027462889000000001 2024-09-17T02:20:52.633 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.633 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.634 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.634 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:6 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'1, mlcod=0'0)", 2024-09-17T02:20:52.634 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.559725+0000", 2024-09-17T02:20:52.634 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.027972423999998, 2024-09-17T02:20:52.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015153534999999999, 2024-09-17T02:20:52.634 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.634 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.634 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:52.634 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559725+0000", 2024-09-17T02:20:52.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559725+0000", 2024-09-17T02:20:52.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559726+0000", 2024-09-17T02:20:52.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1699999999999997e-07 2024-09-17T02:20:52.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559736+0000", 2024-09-17T02:20:52.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8360000000000004e-06 2024-09-17T02:20:52.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559760+0000", 2024-09-17T02:20:52.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4130000000000001e-05 2024-09-17T02:20:52.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.559778+0000", 2024-09-17T02:20:52.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7623000000000001e-05 2024-09-17T02:20:52.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.561459+0000", 2024-09-17T02:20:52.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001681552 2024-09-17T02:20:52.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.561506+0000", 2024-09-17T02:20:52.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6260000000000001e-05 2024-09-17T02:20:52.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.574779+0000", 2024-09-17T02:20:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013273691000000001 2024-09-17T02:20:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.574879+0000", 2024-09-17T02:20:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9625999999999998e-05 2024-09-17T02:20:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:52.639 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.560079+0000", 2024-09-17T02:20:52.639 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.027618926000002, 2024-09-17T02:20:52.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016073831, 2024-09-17T02:20:52.639 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.639 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.639 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:52.639 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560079+0000", 2024-09-17T02:20:52.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560079+0000", 2024-09-17T02:20:52.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560081+0000", 2024-09-17T02:20:52.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.266e-06 2024-09-17T02:20:52.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560090+0000", 2024-09-17T02:20:52.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2129999999999997e-06 2024-09-17T02:20:52.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560119+0000", 2024-09-17T02:20:52.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8932999999999999e-05 2024-09-17T02:20:52.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560145+0000", 2024-09-17T02:20:52.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6020000000000002e-05 2024-09-17T02:20:52.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.561833+0000", 2024-09-17T02:20:52.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016875659999999999 2024-09-17T02:20:52.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562199+0000", 2024-09-17T02:20:52.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036619000000000002 2024-09-17T02:20:52.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:52.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576153+0000", 2024-09-17T02:20:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013953643 2024-09-17T02:20:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:24 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'1, mlcod=0'0)", 2024-09-17T02:20:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.568621+0000", 2024-09-17T02:20:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.019076824000003, 2024-09-17T02:20:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015593332, 2024-09-17T02:20:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:52.644 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568621+0000", 2024-09-17T02:20:52.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568621+0000", 2024-09-17T02:20:52.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568622+0000", 2024-09-17T02:20:52.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1570000000000001e-06 2024-09-17T02:20:52.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568633+0000", 2024-09-17T02:20:52.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1093e-05 2024-09-17T02:20:52.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568654+0000", 2024-09-17T02:20:52.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1132999999999999e-05 2024-09-17T02:20:52.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568670+0000", 2024-09-17T02:20:52.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5307000000000001e-05 2024-09-17T02:20:52.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570935+0000", 2024-09-17T02:20:52.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022651609999999999 2024-09-17T02:20:52.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570980+0000", 2024-09-17T02:20:52.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5170000000000003e-05 2024-09-17T02:20:52.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:52.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584128+0000", 2024-09-17T02:20:52.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013148388 2024-09-17T02:20:52.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:52.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584214+0000", 2024-09-17T02:20:52.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5922999999999997e-05 2024-09-17T02:20:52.647 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.647 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.648 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.648 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:25 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'2, mlcod=0'0)", 2024-09-17T02:20:52.648 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.568721+0000", 2024-09-17T02:20:52.648 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.018976907999999, 2024-09-17T02:20:52.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015657030999999998, 2024-09-17T02:20:52.648 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.648 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.648 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:52.648 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568721+0000", 2024-09-17T02:20:52.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568721+0000", 2024-09-17T02:20:52.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568722+0000", 2024-09-17T02:20:52.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5600000000000004e-07 2024-09-17T02:20:52.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568742+0000", 2024-09-17T02:20:52.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0506999999999999e-05 2024-09-17T02:20:52.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568762+0000", 2024-09-17T02:20:52.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9423e-05 2024-09-17T02:20:52.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568777+0000", 2024-09-17T02:20:52.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5457000000000001e-05 2024-09-17T02:20:52.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.571705+0000", 2024-09-17T02:20:52.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029280130000000001 2024-09-17T02:20:52.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.571787+0000", 2024-09-17T02:20:52.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1509999999999997e-05 2024-09-17T02:20:52.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:52.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584296+0000", 2024-09-17T02:20:52.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012509398999999999 2024-09-17T02:20:52.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:52.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584378+0000", 2024-09-17T02:20:52.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1866000000000005e-05 2024-09-17T02:20:52.652 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.652 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.652 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.653 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:7 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'2, mlcod=0'0)", 2024-09-17T02:20:52.653 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.569013+0000", 2024-09-17T02:20:52.653 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.018684987, 2024-09-17T02:20:52.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015831576999999999, 2024-09-17T02:20:52.653 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.653 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.653 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:52.653 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569013+0000", 2024-09-17T02:20:52.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569013+0000", 2024-09-17T02:20:52.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569014+0000", 2024-09-17T02:20:52.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6000000000000002e-07 2024-09-17T02:20:52.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569024+0000", 2024-09-17T02:20:52.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8369999999999992e-06 2024-09-17T02:20:52.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570016+0000", 2024-09-17T02:20:52.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00099277000000000002 2024-09-17T02:20:52.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570040+0000", 2024-09-17T02:20:52.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3790000000000001e-05 2024-09-17T02:20:52.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570154+0000", 2024-09-17T02:20:52.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113689 2024-09-17T02:20:52.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570208+0000", 2024-09-17T02:20:52.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4305999999999998e-05 2024-09-17T02:20:52.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.583286+0000", 2024-09-17T02:20:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013077945000000001 2024-09-17T02:20:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584844+0000", 2024-09-17T02:20:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015583800000000001 2024-09-17T02:20:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.658 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:1248 5.e 5:7f482265:::benchmark_data_smithi001_23533_object1247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:52.658 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:33.170647+0000", 2024-09-17T02:20:52.658 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.417050504999999, 2024-09-17T02:20:52.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015727534000000001, 2024-09-17T02:20:52.658 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.658 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.658 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:52.658 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:52.658 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:52.658 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:52.658 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1248 2024-09-17T02:20:52.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.658 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170647+0000", 2024-09-17T02:20:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170647+0000", 2024-09-17T02:20:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170648+0000", 2024-09-17T02:20:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4000000000000002e-07 2024-09-17T02:20:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170691+0000", 2024-09-17T02:20:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2722000000000002e-05 2024-09-17T02:20:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170699+0000", 2024-09-17T02:20:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1540000000000002e-06 2024-09-17T02:20:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170704+0000", 2024-09-17T02:20:52.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1290000000000004e-06 2024-09-17T02:20:52.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.171489+0000", 2024-09-17T02:20:52.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00078564599999999998 2024-09-17T02:20:52.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.171653+0000", 2024-09-17T02:20:52.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163027 2024-09-17T02:20:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.171797+0000", 2024-09-17T02:20:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000144828 2024-09-17T02:20:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.172344+0000", 2024-09-17T02:20:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054687599999999996 2024-09-17T02:20:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:52.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.186281+0000", 2024-09-17T02:20:52.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013936755 2024-09-17T02:20:52.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:52.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.186338+0000", 2024-09-17T02:20:52.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6598000000000003e-05 2024-09-17T02:20:52.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:52.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.186375+0000", 2024-09-17T02:20:52.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7258999999999997e-05 2024-09-17T02:20:52.663 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28720 5.f e28/22 5:f8a7aea5:::benchmark_data_smithi001_23533_object28719:head v 28'1756, mlcod=28'1754)", 2024-09-17T02:20:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:20:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 10.017577923999999, 2024-09-17T02:20:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033308717000000002, 2024-09-17T02:20:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:20:52.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:20:52.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570121+0000", 2024-09-17T02:20:52.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4e-07 2024-09-17T02:20:52.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570208+0000", 2024-09-17T02:20:52.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6945000000000002e-05 2024-09-17T02:20:52.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570222+0000", 2024-09-17T02:20:52.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4541e-05 2024-09-17T02:20:52.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570232+0000", 2024-09-17T02:20:52.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3039999999999994e-06 2024-09-17T02:20:52.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570273+0000", 2024-09-17T02:20:52.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1950999999999999e-05 2024-09-17T02:20:52.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570286+0000", 2024-09-17T02:20:52.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2268e-05 2024-09-17T02:20:52.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:52.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603312+0000", 2024-09-17T02:20:52.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033026405000000002 2024-09-17T02:20:52.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:52.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603429+0000", 2024-09-17T02:20:52.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116463 2024-09-17T02:20:52.670 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.670 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.670 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.670 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28721 5.a e28/22 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head v 28'1872, mlcod=28'1869)", 2024-09-17T02:20:52.671 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:20:52.671 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 10.017434418000001, 2024-09-17T02:20:52.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033539817999999999, 2024-09-17T02:20:52.671 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.671 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.671 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:52.671 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:20:52.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:20:52.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570264+0000", 2024-09-17T02:20:52.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0999999999999997e-07 2024-09-17T02:20:52.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570299+0000", 2024-09-17T02:20:52.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4876999999999998e-05 2024-09-17T02:20:52.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570310+0000", 2024-09-17T02:20:52.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0958000000000001e-05 2024-09-17T02:20:52.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570316+0000", 2024-09-17T02:20:52.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.485e-06 2024-09-17T02:20:52.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598947+0000", 2024-09-17T02:20:52.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.028631058000000001 2024-09-17T02:20:52.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598969+0000", 2024-09-17T02:20:52.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2005999999999999e-05 2024-09-17T02:20:52.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:52.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.602638+0000", 2024-09-17T02:20:52.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036690339999999998 2024-09-17T02:20:52.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:52.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603803+0000", 2024-09-17T02:20:52.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00116559 2024-09-17T02:20:52.675 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.675 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.675 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.675 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28723 5.f e28/22 5:f1a2a8f6:::benchmark_data_smithi001_23533_object28722:head v 28'1757, mlcod=28'1754)", 2024-09-17T02:20:52.675 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.571446+0000", 2024-09-17T02:20:52.675 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 10.01625209, 2024-09-17T02:20:52.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.032047203000000003, 2024-09-17T02:20:52.675 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.675 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.676 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:52.676 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571446+0000", 2024-09-17T02:20:52.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571446+0000", 2024-09-17T02:20:52.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571447+0000", 2024-09-17T02:20:52.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0979999999999999e-06 2024-09-17T02:20:52.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571554+0000", 2024-09-17T02:20:52.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107464 2024-09-17T02:20:52.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598891+0000", 2024-09-17T02:20:52.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.027336905000000002 2024-09-17T02:20:52.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598905+0000", 2024-09-17T02:20:52.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:20:52.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.600343+0000", 2024-09-17T02:20:52.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014382100000000001 2024-09-17T02:20:52.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.600387+0000", 2024-09-17T02:20:52.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3398e-05 2024-09-17T02:20:52.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:52.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603443+0000", 2024-09-17T02:20:52.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030562250000000001 2024-09-17T02:20:52.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:52.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603493+0000", 2024-09-17T02:20:52.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9820000000000001e-05 2024-09-17T02:20:52.680 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.680 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.680 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.680 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:40724 5.e 5:78fee04a:::benchmark_data_smithi001_23533_object40723:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:52.680 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:47.033267+0000", 2024-09-17T02:20:52.680 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.5544305039999999, 2024-09-17T02:20:52.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015687298999999998, 2024-09-17T02:20:52.681 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.681 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.681 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:52.681 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:52.681 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:52.681 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:52.681 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 40724 2024-09-17T02:20:52.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.681 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033267+0000", 2024-09-17T02:20:52.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033267+0000", 2024-09-17T02:20:52.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033268+0000", 2024-09-17T02:20:52.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.119e-06 2024-09-17T02:20:52.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033371+0000", 2024-09-17T02:20:52.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010283100000000001 2024-09-17T02:20:52.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033382+0000", 2024-09-17T02:20:52.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0655e-05 2024-09-17T02:20:52.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033389+0000", 2024-09-17T02:20:52.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2880000000000004e-06 2024-09-17T02:20:52.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033467+0000", 2024-09-17T02:20:52.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8091999999999997e-05 2024-09-17T02:20:52.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033660+0000", 2024-09-17T02:20:52.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019242799999999999 2024-09-17T02:20:52.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:52.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033807+0000", 2024-09-17T02:20:52.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000147436 2024-09-17T02:20:52.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:52.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.035370+0000", 2024-09-17T02:20:52.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001563257 2024-09-17T02:20:52.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:52.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.048889+0000", 2024-09-17T02:20:52.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013518835 2024-09-17T02:20:52.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:52.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.048925+0000", 2024-09-17T02:20:52.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5645000000000002e-05 2024-09-17T02:20:52.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:52.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.048955+0000", 2024-09-17T02:20:52.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9713000000000002e-05 2024-09-17T02:20:52.686 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.687 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.687 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.687 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:40730 5.b 5:d64b1dc0:::benchmark_data_smithi001_23533_object40729:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:52.687 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:20:52.687 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.5499302520000002, 2024-09-17T02:20:52.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016675972000000001, 2024-09-17T02:20:52.687 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.687 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.687 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:52.687 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:52.687 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:52.688 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:52.688 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 40730 2024-09-17T02:20:52.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.688 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:20:52.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:20:52.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:20:52.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5700000000000002e-07 2024-09-17T02:20:52.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037813+0000", 2024-09-17T02:20:52.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4880999999999999e-05 2024-09-17T02:20:52.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037820+0000", 2024-09-17T02:20:52.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.34e-06 2024-09-17T02:20:52.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037825+0000", 2024-09-17T02:20:52.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1420000000000003e-06 2024-09-17T02:20:52.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.039167+0000", 2024-09-17T02:20:52.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013427529999999999 2024-09-17T02:20:52.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.039293+0000", 2024-09-17T02:20:52.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000125248 2024-09-17T02:20:52.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:52.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.039442+0000", 2024-09-17T02:20:52.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014929799999999999 2024-09-17T02:20:52.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:52.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.041694+0000", 2024-09-17T02:20:52.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002252324 2024-09-17T02:20:52.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:52.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054324+0000", 2024-09-17T02:20:52.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012629782000000001 2024-09-17T02:20:52.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:52.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054393+0000", 2024-09-17T02:20:52.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9295999999999995e-05 2024-09-17T02:20:52.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:52.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054444+0000", 2024-09-17T02:20:52.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0250999999999997e-05 2024-09-17T02:20:52.693 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.693 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.693 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.693 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:40735 5.b 5:df8fd62b:::benchmark_data_smithi001_23533_object40734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:52.693 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:47.038253+0000", 2024-09-17T02:20:52.693 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.5494445519999998, 2024-09-17T02:20:52.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016368369000000001, 2024-09-17T02:20:52.694 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:52.694 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:52.694 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:52.694 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:52.694 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:52.694 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:52.694 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 40735 2024-09-17T02:20:52.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.694 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:52.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:52.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038253+0000", 2024-09-17T02:20:52.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:52.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038253+0000", 2024-09-17T02:20:52.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:52.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:52.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038254+0000", 2024-09-17T02:20:52.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.23e-07 2024-09-17T02:20:52.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:52.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038420+0000", 2024-09-17T02:20:52.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016617499999999999 2024-09-17T02:20:52.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:52.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038432+0000", 2024-09-17T02:20:52.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1406000000000001e-05 2024-09-17T02:20:52.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:52.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038439+0000", 2024-09-17T02:20:52.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7200000000000006e-06 2024-09-17T02:20:52.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:52.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.040422+0000", 2024-09-17T02:20:52.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019828530000000001 2024-09-17T02:20:52.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:52.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.040581+0000", 2024-09-17T02:20:52.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159238 2024-09-17T02:20:52.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:52.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.040744+0000", 2024-09-17T02:20:52.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016255800000000001 2024-09-17T02:20:52.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:52.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.041971+0000", 2024-09-17T02:20:52.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001226551 2024-09-17T02:20:52.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:52.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054500+0000", 2024-09-17T02:20:52.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012529676 2024-09-17T02:20:52.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:52.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054570+0000", 2024-09-17T02:20:52.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9253999999999998e-05 2024-09-17T02:20:52.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:52.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:52.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:52.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054622+0000", 2024-09-17T02:20:52.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2114999999999998e-05 2024-09-17T02:20:52.699 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.699 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.699 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.699 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:52.699 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:52.699 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:20:52.701 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:20:52.701 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:52.703+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:52.701 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:20:52.702 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:20:52.702 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:20:52.702 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:20:52.703 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:20:52.703 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:20:52.770 INFO:tasks.radosbench.radosbench.0.smithi001.stdout:2024-09-17T02:20:52.773910+0000 min lat: 0.00147149 max lat: 1.0293 avg lat: 0.00585914 2024-09-17T02:20:52.770 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-17T02:20:52.770 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 20 16 54594 54578 170.538 146.688 0.00894512 0.00585914 2024-09-17T02:20:52.801 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:52.803+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:52.863 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:52.863 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:52.885 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:20:52.902 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:52.907+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:53.004 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:53.007+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:53.082 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:53.083 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:53.102 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:20:53.104 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:53.107+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:53.205 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:53.208+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:53.254 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:53.254 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:53.275 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:20:53.306 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:53.307+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:53.406 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:53.408+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:53.434 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:53.435 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:53.455 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:20:53.507 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:53.511+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:53.531 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-17T02:20:53.532 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T02:20:53.532 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-17T02:20:53.532 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-17T02:20:53.532 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-17T02:20:53.532 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-17T02:20:53.610 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:53.612+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:53.662 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:53.662 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:53.687 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:20:53.709 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:53.711+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:53.709 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:20:53.709 INFO:teuthology.orchestra.run.smithi164.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-17T02:20:53.709 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:20:53.770 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 21 16 56729 56713 168.771 133.438 0.0105416 0.00592034 2024-09-17T02:20:53.787 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T02:20:53.809 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:53.812+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:53.869 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:53.869 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:53.892 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:20:53.910 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:53.911+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:54.011 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:54.015+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:54.046 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:54.046 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:54.068 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:20:54.115 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:54.119+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:54.212 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:54.215+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:54.217 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:54.217 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:54.239 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:20:54.313 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:54.315+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:54.414 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:54.415+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:54.443 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:54.444 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:54.465 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:20:54.515 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:54.519+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:54.616 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:54.619+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:54.628 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:54.628 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:54.649 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:20:54.714 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:20:54.718 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:54.719+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:54.770 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 22 16 58933 58917 167.36 137.75 0.00882095 0.00596991 2024-09-17T02:20:54.777 INFO:teuthology.orchestra.run.smithi001.stderr:noscrub is set 2024-09-17T02:20:54.808 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:54.808 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:54.819 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:54.823+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:54.830 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:20:54.881 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:20:54.882 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:20:54.901 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:20:54.901 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:20:54.920 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:20:54.920 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:20:54.921 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:54.923+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:54.986 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:20:54.987 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:20:54.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:20:54.987 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:20:54.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:54.987 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:54.987 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:20:54.987 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 38.427968155000002, 2024-09-17T02:20:54.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021799929999999999, 2024-09-17T02:20:54.987 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:54.987 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:54.987 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:54.987 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:54.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:54.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:54.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:20:54.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:54.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:54.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:54.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:54.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:20:54.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:54.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:54.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:54.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:54.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562007+0000", 2024-09-17T02:20:54.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6260000000000001e-06 2024-09-17T02:20:54.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:54.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:54.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:54.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562021+0000", 2024-09-17T02:20:54.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4440000000000001e-05 2024-09-17T02:20:54.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:54.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:54.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:54.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562053+0000", 2024-09-17T02:20:54.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2159000000000002e-05 2024-09-17T02:20:54.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:54.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:54.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:54.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562076+0000", 2024-09-17T02:20:54.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2926999999999999e-05 2024-09-17T02:20:54.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:54.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:54.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:54.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562218+0000", 2024-09-17T02:20:54.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000141726 2024-09-17T02:20:54.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:54.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:54.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:54.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562506+0000", 2024-09-17T02:20:54.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028752399999999999 2024-09-17T02:20:54.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:54.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:54.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:54.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562830+0000", 2024-09-17T02:20:54.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032427399999999999 2024-09-17T02:20:54.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:54.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:54.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:54.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566900+0000", 2024-09-17T02:20:54.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040705660000000003 2024-09-17T02:20:54.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:54.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:54.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:54.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583581+0000", 2024-09-17T02:20:54.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016680210000000001 2024-09-17T02:20:54.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:54.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:54.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:54.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583704+0000", 2024-09-17T02:20:54.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012289899999999999 2024-09-17T02:20:54.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:54.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:54.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:54.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583803+0000", 2024-09-17T02:20:54.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9579000000000003e-05 2024-09-17T02:20:54.994 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:54.994 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:54.994 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:54.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:54.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:54.994 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:54.994 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:20:54.994 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 38.427840943, 2024-09-17T02:20:54.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022056035000000002, 2024-09-17T02:20:54.994 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:54.994 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:54.994 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:54.994 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:54.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:54.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:54.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:20:54.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:54.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:54.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:54.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:54.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:20:54.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:54.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:54.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:54.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:54.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562132+0000", 2024-09-17T02:20:54.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6300000000000001e-06 2024-09-17T02:20:54.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:54.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:54.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:54.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562142+0000", 2024-09-17T02:20:54.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.022e-05 2024-09-17T02:20:54.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:54.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:54.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:54.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562164+0000", 2024-09-17T02:20:54.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2002999999999999e-05 2024-09-17T02:20:54.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:54.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:54.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:54.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562180+0000", 2024-09-17T02:20:54.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5930000000000002e-05 2024-09-17T02:20:54.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:54.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:54.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:54.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563517+0000", 2024-09-17T02:20:54.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001336776 2024-09-17T02:20:54.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:54.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:54.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:54.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563635+0000", 2024-09-17T02:20:54.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117976 2024-09-17T02:20:54.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:54.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:54.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:54.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563819+0000", 2024-09-17T02:20:54.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018411499999999999 2024-09-17T02:20:54.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:54.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:54.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:54.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566977+0000", 2024-09-17T02:20:54.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031575990000000001 2024-09-17T02:20:54.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:54.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:54.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:54.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583917+0000", 2024-09-17T02:20:54.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016940093999999999 2024-09-17T02:20:54.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:54.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:55.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584066+0000", 2024-09-17T02:20:55.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000149746 2024-09-17T02:20:55.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:55.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584186+0000", 2024-09-17T02:20:55.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011994600000000001 2024-09-17T02:20:55.001 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.001 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:55.001 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.002 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:55.002 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:20:55.002 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 38.427660232000001, 2024-09-17T02:20:55.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023664803000000002, 2024-09-17T02:20:55.003 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:55.003 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:55.003 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:55.003 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:55.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:55.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:20:55.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:55.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:20:55.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:55.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562313+0000", 2024-09-17T02:20:55.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.764e-06 2024-09-17T02:20:55.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:55.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562323+0000", 2024-09-17T02:20:55.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0166000000000001e-05 2024-09-17T02:20:55.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:55.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562343+0000", 2024-09-17T02:20:55.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9633999999999999e-05 2024-09-17T02:20:55.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:55.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562367+0000", 2024-09-17T02:20:55.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4556e-05 2024-09-17T02:20:55.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:55.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563777+0000", 2024-09-17T02:20:55.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014102330000000001 2024-09-17T02:20:55.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:55.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563969+0000", 2024-09-17T02:20:55.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000191361 2024-09-17T02:20:55.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:55.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564148+0000", 2024-09-17T02:20:55.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017934599999999999 2024-09-17T02:20:55.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:55.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566989+0000", 2024-09-17T02:20:55.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028407010000000002 2024-09-17T02:20:55.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:55.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585770+0000", 2024-09-17T02:20:55.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018781566999999999 2024-09-17T02:20:55.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:55.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585874+0000", 2024-09-17T02:20:55.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103489 2024-09-17T02:20:55.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:55.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585976+0000", 2024-09-17T02:20:55.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101986 2024-09-17T02:20:55.008 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.008 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:55.008 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.008 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:55.008 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:20:55.008 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 38.427577352, 2024-09-17T02:20:55.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024118555999999999, 2024-09-17T02:20:55.009 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:55.009 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:55.009 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:55.009 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:55.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:55.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:20:55.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:55.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:20:55.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:55.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562395+0000", 2024-09-17T02:20:55.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3969999999999999e-06 2024-09-17T02:20:55.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:55.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562405+0000", 2024-09-17T02:20:55.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4229999999999994e-06 2024-09-17T02:20:55.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:55.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562427+0000", 2024-09-17T02:20:55.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759999999999998e-05 2024-09-17T02:20:55.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:55.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562444+0000", 2024-09-17T02:20:55.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7019000000000001e-05 2024-09-17T02:20:55.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:55.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564681+0000", 2024-09-17T02:20:55.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022376929999999998 2024-09-17T02:20:55.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:55.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564887+0000", 2024-09-17T02:20:55.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000206178 2024-09-17T02:20:55.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:55.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565230+0000", 2024-09-17T02:20:55.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034233499999999998 2024-09-17T02:20:55.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:55.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567000+0000", 2024-09-17T02:20:55.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017706390000000001 2024-09-17T02:20:55.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:55.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586126+0000", 2024-09-17T02:20:55.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019125672 2024-09-17T02:20:55.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:55.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586314+0000", 2024-09-17T02:20:55.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018740200000000001 2024-09-17T02:20:55.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:55.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586513+0000", 2024-09-17T02:20:55.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019903799999999999 2024-09-17T02:20:55.014 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.014 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:55.014 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.015 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:55.015 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:20:55.015 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 38.427502679, 2024-09-17T02:20:55.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021940779000000001, 2024-09-17T02:20:55.015 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:55.015 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:55.015 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:55.015 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:55.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:55.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:20:55.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:55.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:20:55.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:55.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562470+0000", 2024-09-17T02:20:55.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5030000000000001e-06 2024-09-17T02:20:55.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:55.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562478+0000", 2024-09-17T02:20:55.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.157e-06 2024-09-17T02:20:55.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:55.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562496+0000", 2024-09-17T02:20:55.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7876e-05 2024-09-17T02:20:55.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:55.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562511+0000", 2024-09-17T02:20:55.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5067e-05 2024-09-17T02:20:55.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:55.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564628+0000", 2024-09-17T02:20:55.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021171860000000001 2024-09-17T02:20:55.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:55.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564838+0000", 2024-09-17T02:20:55.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000209283 2024-09-17T02:20:55.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:55.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565078+0000", 2024-09-17T02:20:55.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024075100000000001 2024-09-17T02:20:55.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:55.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567012+0000", 2024-09-17T02:20:55.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019331050000000001 2024-09-17T02:20:55.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:55.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584289+0000", 2024-09-17T02:20:55.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017277464999999999 2024-09-17T02:20:55.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:55.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584363+0000", 2024-09-17T02:20:55.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3852999999999999e-05 2024-09-17T02:20:55.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:55.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584409+0000", 2024-09-17T02:20:55.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6533000000000003e-05 2024-09-17T02:20:55.020 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.020 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:55.020 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.020 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:55.021 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:20:55.021 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 38.427439290000002, 2024-09-17T02:20:55.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020580694, 2024-09-17T02:20:55.021 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:55.021 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:55.021 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:55.021 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:55.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:55.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:20:55.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:55.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:20:55.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:55.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562533+0000", 2024-09-17T02:20:55.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3239999999999999e-06 2024-09-17T02:20:55.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:55.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562541+0000", 2024-09-17T02:20:55.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3529999999999997e-06 2024-09-17T02:20:55.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:55.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562559+0000", 2024-09-17T02:20:55.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8306000000000001e-05 2024-09-17T02:20:55.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:55.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562572+0000", 2024-09-17T02:20:55.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2993000000000001e-05 2024-09-17T02:20:55.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:55.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563230+0000", 2024-09-17T02:20:55.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00065806899999999995 2024-09-17T02:20:55.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:55.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563510+0000", 2024-09-17T02:20:55.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028016400000000001 2024-09-17T02:20:55.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:55.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563677+0000", 2024-09-17T02:20:55.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000166243 2024-09-17T02:20:55.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:55.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566312+0000", 2024-09-17T02:20:55.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026351349999999998 2024-09-17T02:20:55.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:55.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.582943+0000", 2024-09-17T02:20:55.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016631781000000002 2024-09-17T02:20:55.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:55.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583035+0000", 2024-09-17T02:20:55.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1682999999999996e-05 2024-09-17T02:20:55.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:55.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583113+0000", 2024-09-17T02:20:55.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7643000000000002e-05 2024-09-17T02:20:55.026 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.026 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:55.026 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.026 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:55.026 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:20:55.026 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 38.427332229999998, 2024-09-17T02:20:55.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020802284000000001, 2024-09-17T02:20:55.026 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:55.026 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:55.027 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:55.027 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:55.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:55.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:20:55.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:55.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:20:55.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:55.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562640+0000", 2024-09-17T02:20:55.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.37e-06 2024-09-17T02:20:55.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:55.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562648+0000", 2024-09-17T02:20:55.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.576e-06 2024-09-17T02:20:55.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:55.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562668+0000", 2024-09-17T02:20:55.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0397000000000001e-05 2024-09-17T02:20:55.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:55.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562690+0000", 2024-09-17T02:20:55.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1713e-05 2024-09-17T02:20:55.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:55.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564290+0000", 2024-09-17T02:20:55.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001599397 2024-09-17T02:20:55.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:55.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564527+0000", 2024-09-17T02:20:55.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023731199999999999 2024-09-17T02:20:55.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:55.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583441+0000", 2024-09-17T02:20:55.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018914519000000001 2024-09-17T02:20:55.030 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.030 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:55.030 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.030 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:55.030 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:20:55.030 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 38.427257154999999, 2024-09-17T02:20:55.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021867154, 2024-09-17T02:20:55.031 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:55.031 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:55.031 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:55.031 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:55.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:55.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:20:55.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:55.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:20:55.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:55.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562716+0000", 2024-09-17T02:20:55.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.384e-06 2024-09-17T02:20:55.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:55.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562726+0000", 2024-09-17T02:20:55.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.04e-05 2024-09-17T02:20:55.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:55.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562745+0000", 2024-09-17T02:20:55.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8770000000000002e-05 2024-09-17T02:20:55.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:55.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562759+0000", 2024-09-17T02:20:55.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4392999999999999e-05 2024-09-17T02:20:55.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:55.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565882+0000", 2024-09-17T02:20:55.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031227659999999999 2024-09-17T02:20:55.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:55.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566217+0000", 2024-09-17T02:20:55.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033498000000000002 2024-09-17T02:20:55.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:55.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584581+0000", 2024-09-17T02:20:55.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018364460999999999 2024-09-17T02:20:55.035 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.035 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:55.035 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.035 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:55.035 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562778+0000", 2024-09-17T02:20:55.035 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 38.427193017999997, 2024-09-17T02:20:55.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018969949, 2024-09-17T02:20:55.035 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:55.035 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:55.035 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:55.036 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:55.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:55.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562778+0000", 2024-09-17T02:20:55.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:55.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562778+0000", 2024-09-17T02:20:55.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:55.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562779+0000", 2024-09-17T02:20:55.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0470000000000001e-06 2024-09-17T02:20:55.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:55.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562798+0000", 2024-09-17T02:20:55.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8723e-05 2024-09-17T02:20:55.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:55.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562819+0000", 2024-09-17T02:20:55.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1192999999999999e-05 2024-09-17T02:20:55.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:55.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562834+0000", 2024-09-17T02:20:55.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4619e-05 2024-09-17T02:20:55.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:55.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562977+0000", 2024-09-17T02:20:55.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014338900000000001 2024-09-17T02:20:55.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:55.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563366+0000", 2024-09-17T02:20:55.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038909399999999999 2024-09-17T02:20:55.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:55.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.581748+0000", 2024-09-17T02:20:55.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018381884000000001 2024-09-17T02:20:55.039 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.039 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:55.039 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.040 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:1227 5.3 5:c07fff60:::benchmark_data_smithi001_23533_object1226:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:55.040 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:33.165009+0000", 2024-09-17T02:20:55.040 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.824962454000001, 2024-09-17T02:20:55.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016027434, 2024-09-17T02:20:55.040 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:55.040 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:55.040 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:55.040 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:55.040 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:55.040 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:55.040 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1227 2024-09-17T02:20:55.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.040 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:55.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:55.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165009+0000", 2024-09-17T02:20:55.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:55.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165009+0000", 2024-09-17T02:20:55.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:55.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165010+0000", 2024-09-17T02:20:55.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9800000000000003e-07 2024-09-17T02:20:55.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:55.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165045+0000", 2024-09-17T02:20:55.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5231999999999997e-05 2024-09-17T02:20:55.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:55.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165053+0000", 2024-09-17T02:20:55.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9289999999999998e-06 2024-09-17T02:20:55.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:55.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165058+0000", 2024-09-17T02:20:55.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6689999999999997e-06 2024-09-17T02:20:55.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:55.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165611+0000", 2024-09-17T02:20:55.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00055364200000000002 2024-09-17T02:20:55.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:55.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.165764+0000", 2024-09-17T02:20:55.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000153132 2024-09-17T02:20:55.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:55.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.166112+0000", 2024-09-17T02:20:55.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034738599999999998 2024-09-17T02:20:55.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:55.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.168392+0000", 2024-09-17T02:20:55.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022802809999999999 2024-09-17T02:20:55.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:55.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.180931+0000", 2024-09-17T02:20:55.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012538785 2024-09-17T02:20:55.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:55.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.180994+0000", 2024-09-17T02:20:55.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3477000000000002e-05 2024-09-17T02:20:55.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:55.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:33.181036+0000", 2024-09-17T02:20:55.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2103e-05 2024-09-17T02:20:55.047 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.047 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:55.047 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.047 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:26132 5.c 5:3ae49ef5:::benchmark_data_smithi001_23533_object26131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:55.047 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:41.688378+0000", 2024-09-17T02:20:55.047 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.301592936, 2024-09-17T02:20:55.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017107691000000001, 2024-09-17T02:20:55.047 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:55.047 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:55.047 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:55.047 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:55.047 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:55.048 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:55.048 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 26132 2024-09-17T02:20:55.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.048 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:55.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:55.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688378+0000", 2024-09-17T02:20:55.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:55.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688378+0000", 2024-09-17T02:20:55.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:55.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688379+0000", 2024-09-17T02:20:55.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.048e-06 2024-09-17T02:20:55.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:55.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688407+0000", 2024-09-17T02:20:55.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7271e-05 2024-09-17T02:20:55.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:55.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688418+0000", 2024-09-17T02:20:55.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1333e-05 2024-09-17T02:20:55.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:55.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688433+0000", 2024-09-17T02:20:55.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4764e-05 2024-09-17T02:20:55.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:55.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688971+0000", 2024-09-17T02:20:55.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00053786399999999999 2024-09-17T02:20:55.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:55.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.689087+0000", 2024-09-17T02:20:55.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000116385 2024-09-17T02:20:55.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:55.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.689226+0000", 2024-09-17T02:20:55.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013938199999999999 2024-09-17T02:20:55.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:55.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.691077+0000", 2024-09-17T02:20:55.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001850806 2024-09-17T02:20:55.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:55.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.705392+0000", 2024-09-17T02:20:55.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014315006999999999 2024-09-17T02:20:55.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:55.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.705449+0000", 2024-09-17T02:20:55.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7101000000000001e-05 2024-09-17T02:20:55.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:55.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.705486+0000", 2024-09-17T02:20:55.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6730000000000002e-05 2024-09-17T02:20:55.053 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.053 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:55.053 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.053 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:26133 5.5 5:a365a85e:::benchmark_data_smithi001_23533_object26132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:55.053 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:41.688741+0000", 2024-09-17T02:20:55.053 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.301230668000001, 2024-09-17T02:20:55.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015492462, 2024-09-17T02:20:55.054 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:55.054 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:55.054 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:55.054 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:55.054 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:55.054 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:55.054 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 26133 2024-09-17T02:20:55.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.054 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:55.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:55.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688741+0000", 2024-09-17T02:20:55.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:55.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688741+0000", 2024-09-17T02:20:55.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:55.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688741+0000", 2024-09-17T02:20:55.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9100000000000003e-07 2024-09-17T02:20:55.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:55.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688847+0000", 2024-09-17T02:20:55.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105612 2024-09-17T02:20:55.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:55.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688855+0000", 2024-09-17T02:20:55.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8359999999999992e-06 2024-09-17T02:20:55.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:55.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688860+0000", 2024-09-17T02:20:55.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6990000000000002e-06 2024-09-17T02:20:55.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:55.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688957+0000", 2024-09-17T02:20:55.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7384000000000001e-05 2024-09-17T02:20:55.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:55.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.689088+0000", 2024-09-17T02:20:55.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013131199999999999 2024-09-17T02:20:55.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:55.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.689211+0000", 2024-09-17T02:20:55.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012225499999999999 2024-09-17T02:20:55.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:55.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.691078+0000", 2024-09-17T02:20:55.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018674780000000001 2024-09-17T02:20:55.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:55.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.704135+0000", 2024-09-17T02:20:55.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013057302999999999 2024-09-17T02:20:55.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:55.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.704198+0000", 2024-09-17T02:20:55.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2551999999999993e-05 2024-09-17T02:20:55.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:55.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.704233+0000", 2024-09-17T02:20:55.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5240000000000001e-05 2024-09-17T02:20:55.059 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.059 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:55.059 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.060 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:55.060 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:20:55.060 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.421508248, 2024-09-17T02:20:55.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:20:55.060 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:55.060 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:55.060 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:55.060 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:55.060 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:55.060 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:55.060 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:20:55.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.061 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:55.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:55.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:20:55.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:55.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:20:55.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:55.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:20:55.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:20:55.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:55.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:20:55.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:20:55.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:55.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:20:55.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:20:55.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:55.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:20:55.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:20:55.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:55.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:20:55.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:20:55.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:55.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:20:55.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:20:55.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:55.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:20:55.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:20:55.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:55.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:20:55.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:20:55.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:55.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:20:55.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:20:55.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:55.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:20:55.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:20:55.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:55.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:20:55.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:20:55.066 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.066 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:55.066 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.066 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:55.066 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:20:55.066 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.417605997999999, 2024-09-17T02:20:55.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:20:55.066 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:55.066 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:55.066 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:55.067 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:55.067 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:55.067 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:55.067 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:20:55.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.067 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:55.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:55.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:20:55.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:55.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:20:55.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:55.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:20:55.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:20:55.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:55.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:20:55.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:20:55.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:55.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:20:55.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:20:55.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:55.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:20:55.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:20:55.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:55.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:20:55.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:20:55.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:55.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:20:55.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:20:55.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:55.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:20:55.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:20:55.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:55.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:20:55.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:20:55.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:55.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:20:55.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:20:55.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:55.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:20:55.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:20:55.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:55.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:20:55.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:20:55.072 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.072 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:55.072 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.072 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:31663 5.8 5:18a4daab:::benchmark_data_smithi001_23533_object31662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-17T02:20:55.072 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:43.631605+0000", 2024-09-17T02:20:55.073 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 11.358366347, 2024-09-17T02:20:55.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017528834, 2024-09-17T02:20:55.073 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:55.073 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:55.073 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:55.073 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:55.073 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:55.073 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:55.073 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 31663 2024-09-17T02:20:55.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.073 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:55.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:55.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631605+0000", 2024-09-17T02:20:55.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:55.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631605+0000", 2024-09-17T02:20:55.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:55.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631606+0000", 2024-09-17T02:20:55.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:20:55.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:55.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631633+0000", 2024-09-17T02:20:55.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7455999999999999e-05 2024-09-17T02:20:55.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:55.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631640+0000", 2024-09-17T02:20:55.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8140000000000003e-06 2024-09-17T02:20:55.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:55.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631644+0000", 2024-09-17T02:20:55.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4790000000000001e-06 2024-09-17T02:20:55.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:55.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.636150+0000", 2024-09-17T02:20:55.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004506431 2024-09-17T02:20:55.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:55.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.636299+0000", 2024-09-17T02:20:55.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014900499999999999 2024-09-17T02:20:55.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:55.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.636448+0000", 2024-09-17T02:20:55.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000149087 2024-09-17T02:20:55.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:55.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.639522+0000", 2024-09-17T02:20:55.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030734600000000001 2024-09-17T02:20:55.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:55.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.649032+0000", 2024-09-17T02:20:55.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0095109129999999993 2024-09-17T02:20:55.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:55.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.649096+0000", 2024-09-17T02:20:55.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3702999999999996e-05 2024-09-17T02:20:55.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:55.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.649134+0000", 2024-09-17T02:20:55.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7706000000000001e-05 2024-09-17T02:20:55.078 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.078 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:55.079 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.079 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:40722 5.5 5:ac1614e8:::benchmark_data_smithi001_23533_object40721:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:55.079 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.032445+0000", 2024-09-17T02:20:55.079 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.9575261709999996, 2024-09-17T02:20:55.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015387025, 2024-09-17T02:20:55.079 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:55.079 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:55.080 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:55.080 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:55.080 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:55.080 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:55.080 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 40722 2024-09-17T02:20:55.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.080 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:55.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:55.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032445+0000", 2024-09-17T02:20:55.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:55.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032445+0000", 2024-09-17T02:20:55.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:55.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032446+0000", 2024-09-17T02:20:55.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5199999999999996e-07 2024-09-17T02:20:55.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:55.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032615+0000", 2024-09-17T02:20:55.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016943700000000001 2024-09-17T02:20:55.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:55.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032653+0000", 2024-09-17T02:20:55.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7706000000000001e-05 2024-09-17T02:20:55.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:55.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032671+0000", 2024-09-17T02:20:55.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8099999999999999e-05 2024-09-17T02:20:55.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:55.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.034226+0000", 2024-09-17T02:20:55.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001555117 2024-09-17T02:20:55.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:55.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.034353+0000", 2024-09-17T02:20:55.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012684799999999999 2024-09-17T02:20:55.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:55.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.034488+0000", 2024-09-17T02:20:55.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013460699999999999 2024-09-17T02:20:55.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:55.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.036330+0000", 2024-09-17T02:20:55.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001842394 2024-09-17T02:20:55.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:55.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.047724+0000", 2024-09-17T02:20:55.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011394025 2024-09-17T02:20:55.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:55.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.047794+0000", 2024-09-17T02:20:55.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9678000000000006e-05 2024-09-17T02:20:55.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:55.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.047832+0000", 2024-09-17T02:20:55.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8461000000000003e-05 2024-09-17T02:20:55.085 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.085 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:55.085 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.086 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:40725 5.0 5:00adeb50:::benchmark_data_smithi001_23533_object40724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:55.086 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.032768+0000", 2024-09-17T02:20:55.086 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.9572038300000001, 2024-09-17T02:20:55.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015538547, 2024-09-17T02:20:55.086 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:55.086 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:55.086 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:55.086 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:55.087 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:55.087 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:55.087 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 40725 2024-09-17T02:20:55.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.087 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:55.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:55.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032768+0000", 2024-09-17T02:20:55.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:55.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032768+0000", 2024-09-17T02:20:55.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:55.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032768+0000", 2024-09-17T02:20:55.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0100000000000005e-07 2024-09-17T02:20:55.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:55.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032795+0000", 2024-09-17T02:20:55.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6690999999999999e-05 2024-09-17T02:20:55.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:55.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032802+0000", 2024-09-17T02:20:55.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0469999999999996e-06 2024-09-17T02:20:55.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:55.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032807+0000", 2024-09-17T02:20:55.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3859999999999998e-06 2024-09-17T02:20:55.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:55.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032851+0000", 2024-09-17T02:20:55.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4051000000000002e-05 2024-09-17T02:20:55.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:55.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.032971+0000", 2024-09-17T02:20:55.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000119824 2024-09-17T02:20:55.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:55.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.033084+0000", 2024-09-17T02:20:55.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000112496 2024-09-17T02:20:55.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:55.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.036163+0000", 2024-09-17T02:20:55.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030790610000000001 2024-09-17T02:20:55.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:55.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.048228+0000", 2024-09-17T02:20:55.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012065243999999999 2024-09-17T02:20:55.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:55.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.048274+0000", 2024-09-17T02:20:55.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5756e-05 2024-09-17T02:20:55.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:55.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.048306+0000", 2024-09-17T02:20:55.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2490000000000002e-05 2024-09-17T02:20:55.093 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.093 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:55.093 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.093 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:40734 5.3 5:c50da8da:::benchmark_data_smithi001_23533_object40733:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:55.093 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.037293+0000", 2024-09-17T02:20:55.093 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.9526787700000003, 2024-09-17T02:20:55.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015846585999999999, 2024-09-17T02:20:55.093 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:55.093 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:55.094 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:55.094 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:55.094 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:55.094 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:55.094 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 40734 2024-09-17T02:20:55.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.094 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:55.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:55.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037293+0000", 2024-09-17T02:20:55.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:55.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037293+0000", 2024-09-17T02:20:55.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:55.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037293+0000", 2024-09-17T02:20:55.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.61e-07 2024-09-17T02:20:55.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:55.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037420+0000", 2024-09-17T02:20:55.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012655300000000001 2024-09-17T02:20:55.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:55.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037428+0000", 2024-09-17T02:20:55.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.354e-06 2024-09-17T02:20:55.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:55.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037447+0000", 2024-09-17T02:20:55.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8374000000000001e-05 2024-09-17T02:20:55.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:55.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.038148+0000", 2024-09-17T02:20:55.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00070088699999999997 2024-09-17T02:20:55.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:55.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.038267+0000", 2024-09-17T02:20:55.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011923500000000001 2024-09-17T02:20:55.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:55.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.038382+0000", 2024-09-17T02:20:55.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011549599999999999 2024-09-17T02:20:55.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:55.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.051916+0000", 2024-09-17T02:20:55.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013533315000000001 2024-09-17T02:20:55.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:55.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.053054+0000", 2024-09-17T02:20:55.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001138053 2024-09-17T02:20:55.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:55.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.053101+0000", 2024-09-17T02:20:55.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7437e-05 2024-09-17T02:20:55.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:55.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.053139+0000", 2024-09-17T02:20:55.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8121000000000003e-05 2024-09-17T02:20:55.100 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.100 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:55.100 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.100 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:40737 5.8 5:1ce68324:::benchmark_data_smithi001_23533_object40736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:55.100 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:47.037456+0000", 2024-09-17T02:20:55.100 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.9525158009999997, 2024-09-17T02:20:55.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016032277000000001, 2024-09-17T02:20:55.100 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:55.100 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:55.100 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:55.101 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:55.101 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:55.101 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:55.101 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 40737 2024-09-17T02:20:55.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.101 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:55.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:55.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037456+0000", 2024-09-17T02:20:55.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:55.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037456+0000", 2024-09-17T02:20:55.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:55.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037456+0000", 2024-09-17T02:20:55.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2300000000000001e-07 2024-09-17T02:20:55.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:55.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.037514+0000", 2024-09-17T02:20:55.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8094000000000003e-05 2024-09-17T02:20:55.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:55.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.047514+0000", 2024-09-17T02:20:55.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0099994690000000004 2024-09-17T02:20:55.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:55.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.047521+0000", 2024-09-17T02:20:55.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9160000000000004e-06 2024-09-17T02:20:55.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:55.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.047578+0000", 2024-09-17T02:20:55.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7482000000000003e-05 2024-09-17T02:20:55.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:55.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.047717+0000", 2024-09-17T02:20:55.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138517 2024-09-17T02:20:55.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:55.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.047867+0000", 2024-09-17T02:20:55.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015047899999999999 2024-09-17T02:20:55.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:55.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.051283+0000", 2024-09-17T02:20:55.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003415689 2024-09-17T02:20:55.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:20:55.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.053364+0000", 2024-09-17T02:20:55.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020809050000000001 2024-09-17T02:20:55.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:55.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.053410+0000", 2024-09-17T02:20:55.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6062e-05 2024-09-17T02:20:55.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:55.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:47.053488+0000", 2024-09-17T02:20:55.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8140999999999996e-05 2024-09-17T02:20:55.106 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.106 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:55.106 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.106 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:43563 5.2 e30/22 5:4cd85cc9:::benchmark_data_smithi001_23533_object43562:head v 30'2742, mlcod=30'2739)", 2024-09-17T02:20:55.106 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:48.159930+0000", 2024-09-17T02:20:55.106 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 6.8300411309999998, 2024-09-17T02:20:55.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015974195, 2024-09-17T02:20:55.106 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:55.107 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:55.107 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:55.107 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:55.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:55.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:48.159930+0000", 2024-09-17T02:20:55.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:55.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:48.159930+0000", 2024-09-17T02:20:55.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:55.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:55.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:48.159931+0000", 2024-09-17T02:20:55.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3600000000000003e-07 2024-09-17T02:20:55.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:55.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:48.159963+0000", 2024-09-17T02:20:55.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2356e-05 2024-09-17T02:20:55.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:55.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:48.159973+0000", 2024-09-17T02:20:55.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3770000000000002e-06 2024-09-17T02:20:55.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:55.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:48.159980+0000", 2024-09-17T02:20:55.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9600000000000003e-06 2024-09-17T02:20:55.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:55.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:48.160051+0000", 2024-09-17T02:20:55.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0970999999999995e-05 2024-09-17T02:20:55.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:55.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:48.160076+0000", 2024-09-17T02:20:55.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5669000000000001e-05 2024-09-17T02:20:55.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:20:55.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:48.175871+0000", 2024-09-17T02:20:55.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01579492 2024-09-17T02:20:55.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:55.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:55.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:20:55.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:48.175904+0000", 2024-09-17T02:20:55.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3306000000000003e-05 2024-09-17T02:20:55.110 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.110 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:55.110 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.111 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:55.111 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:55.111 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:20:55.112 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:20:55.113 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:55.115+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:55.213 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:55.216+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:55.281 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:20:55.281 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-17T02:20:55.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.281 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:59974 5.1 5:8d0630d3:::benchmark_data_smithi001_23533_object59973:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-17T02:20:55.281 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:55.272465+0000", 2024-09-17T02:20:55.281 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0057201559999999997, 2024-09-17T02:20:55.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057491340000000004, 2024-09-17T02:20:55.281 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:55.282 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:55.282 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:55.282 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:55.282 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:55.282 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:55.282 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 59974 2024-09-17T02:20:55.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.282 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:55.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:55.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.272465+0000", 2024-09-17T02:20:55.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:55.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:55.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.272465+0000", 2024-09-17T02:20:55.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:55.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:55.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.272466+0000", 2024-09-17T02:20:55.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.175e-06 2024-09-17T02:20:55.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:55.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.272522+0000", 2024-09-17T02:20:55.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.5195999999999998e-05 2024-09-17T02:20:55.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:55.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.272534+0000", 2024-09-17T02:20:55.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2432999999999999e-05 2024-09-17T02:20:55.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:55.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.272542+0000", 2024-09-17T02:20:55.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4069999999999993e-06 2024-09-17T02:20:55.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:55.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.272586+0000", 2024-09-17T02:20:55.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3371000000000002e-05 2024-09-17T02:20:55.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:55.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.272699+0000", 2024-09-17T02:20:55.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112969 2024-09-17T02:20:55.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:55.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.272788+0000", 2024-09-17T02:20:55.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9177000000000004e-05 2024-09-17T02:20:55.286 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:55.286 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:55.286 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:55.286 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.286 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:59975 5.9 5:97006b2a:::benchmark_data_smithi001_23533_object59974:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-17T02:20:55.286 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:55.272566+0000", 2024-09-17T02:20:55.286 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.005619537, 2024-09-17T02:20:55.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057444310000000004, 2024-09-17T02:20:55.286 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:55.286 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:55.286 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:55.287 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:55.287 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:55.287 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:55.287 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 59975 2024-09-17T02:20:55.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.287 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:55.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:55.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.272566+0000", 2024-09-17T02:20:55.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:55.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:55.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.272566+0000", 2024-09-17T02:20:55.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:55.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:55.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.272566+0000", 2024-09-17T02:20:55.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9800000000000003e-07 2024-09-17T02:20:55.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:55.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.272599+0000", 2024-09-17T02:20:55.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2778999999999999e-05 2024-09-17T02:20:55.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:55.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.272608+0000", 2024-09-17T02:20:55.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2939999999999994e-06 2024-09-17T02:20:55.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:55.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.272615+0000", 2024-09-17T02:20:55.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2009999999999996e-06 2024-09-17T02:20:55.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.290 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:55.290 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.272670+0000", 2024-09-17T02:20:55.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4913000000000001e-05 2024-09-17T02:20:55.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:55.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.272797+0000", 2024-09-17T02:20:55.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012714000000000001 2024-09-17T02:20:55.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:55.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.272928+0000", 2024-09-17T02:20:55.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013093100000000001 2024-09-17T02:20:55.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:55.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.276055+0000", 2024-09-17T02:20:55.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0031270970000000001 2024-09-17T02:20:55.292 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:55.292 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:55.292 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:55.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.292 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:59981 5.2 5:448e8f90:::benchmark_data_smithi001_23533_object59980:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-17T02:20:55.292 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:55.275323+0000", 2024-09-17T02:20:55.292 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0028619829999999998, 2024-09-17T02:20:55.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003067415, 2024-09-17T02:20:55.292 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:55.293 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:55.293 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:55.293 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:55.293 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:55.293 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:55.293 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 59981 2024-09-17T02:20:55.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.293 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:55.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:55.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.275323+0000", 2024-09-17T02:20:55.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:55.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:55.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.275323+0000", 2024-09-17T02:20:55.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:55.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:55.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.275325+0000", 2024-09-17T02:20:55.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2699999999999999e-06 2024-09-17T02:20:55.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:55.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.275433+0000", 2024-09-17T02:20:55.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000108639 2024-09-17T02:20:55.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:55.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.275448+0000", 2024-09-17T02:20:55.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4371e-05 2024-09-17T02:20:55.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:55.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.275455+0000", 2024-09-17T02:20:55.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8129999999999996e-06 2024-09-17T02:20:55.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:55.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.275497+0000", 2024-09-17T02:20:55.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1492999999999997e-05 2024-09-17T02:20:55.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:55.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.275593+0000", 2024-09-17T02:20:55.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6161000000000003e-05 2024-09-17T02:20:55.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:55.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.275741+0000", 2024-09-17T02:20:55.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000147396 2024-09-17T02:20:55.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:55.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.277996+0000", 2024-09-17T02:20:55.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022553220000000001 2024-09-17T02:20:55.297 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:55.297 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:55.297 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:55.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.297 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:59985 5.1 5:8417ed9b:::benchmark_data_smithi001_23533_object59984:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-17T02:20:55.297 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:55.275670+0000", 2024-09-17T02:20:55.297 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.002515509, 2024-09-17T02:20:55.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002800037, 2024-09-17T02:20:55.297 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:55.297 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:55.298 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:55.298 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:55.298 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:55.298 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:55.298 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 59985 2024-09-17T02:20:55.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.298 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:55.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:55.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.275670+0000", 2024-09-17T02:20:55.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:55.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:55.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.275670+0000", 2024-09-17T02:20:55.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:55.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:55.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.275671+0000", 2024-09-17T02:20:55.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4799999999999997e-07 2024-09-17T02:20:55.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:55.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.275879+0000", 2024-09-17T02:20:55.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000208715 2024-09-17T02:20:55.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:55.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.275921+0000", 2024-09-17T02:20:55.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1687000000000003e-05 2024-09-17T02:20:55.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:55.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.275930+0000", 2024-09-17T02:20:55.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7499999999999992e-06 2024-09-17T02:20:55.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:55.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.275983+0000", 2024-09-17T02:20:55.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3430999999999997e-05 2024-09-17T02:20:55.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:55.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.276139+0000", 2024-09-17T02:20:55.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000155647 2024-09-17T02:20:55.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:55.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.276272+0000", 2024-09-17T02:20:55.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000132669 2024-09-17T02:20:55.302 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:55.302 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:55.302 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:55.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.302 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:59982 5.5 e33/22 5:ada1f001:::benchmark_data_smithi001_23533_object59981:head v 33'3773, mlcod=33'3771)", 2024-09-17T02:20:55.302 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:55.277614+0000", 2024-09-17T02:20:55.302 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.00057171700000000002, 2024-09-17T02:20:55.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00092437499999999996, 2024-09-17T02:20:55.302 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:55.302 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:55.302 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:20:55.303 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:55.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:55.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.277614+0000", 2024-09-17T02:20:55.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:55.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:55.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.277614+0000", 2024-09-17T02:20:55.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:55.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:55.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.277614+0000", 2024-09-17T02:20:55.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7499999999999999e-07 2024-09-17T02:20:55.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:55.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.277648+0000", 2024-09-17T02:20:55.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3374000000000003e-05 2024-09-17T02:20:55.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:55.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.277657+0000", 2024-09-17T02:20:55.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6180000000000001e-06 2024-09-17T02:20:55.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:55.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.277667+0000", 2024-09-17T02:20:55.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2860000000000005e-06 2024-09-17T02:20:55.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:55.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.277727+0000", 2024-09-17T02:20:55.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0322999999999998e-05 2024-09-17T02:20:55.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:55.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.277744+0000", 2024-09-17T02:20:55.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7045999999999999e-05 2024-09-17T02:20:55.306 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:55.306 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:55.306 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:55.306 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.306 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:59983 5.3 e33/22 5:ce685dd4:::benchmark_data_smithi001_23533_object59982:head v 33'3783, mlcod=33'3781)", 2024-09-17T02:20:55.306 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:55.277691+0000", 2024-09-17T02:20:55.306 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.00049483600000000002, 2024-09-17T02:20:55.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00090348999999999996, 2024-09-17T02:20:55.307 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:55.307 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:55.307 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:20:55.307 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:55.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:55.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.277691+0000", 2024-09-17T02:20:55.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:55.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:55.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.277691+0000", 2024-09-17T02:20:55.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:55.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:55.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.277691+0000", 2024-09-17T02:20:55.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.22e-07 2024-09-17T02:20:55.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:55.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.277720+0000", 2024-09-17T02:20:55.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9286e-05 2024-09-17T02:20:55.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:55.309 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.277731+0000", 2024-09-17T02:20:55.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1195e-05 2024-09-17T02:20:55.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.309 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:55.309 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.277737+0000", 2024-09-17T02:20:55.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1869999999999996e-06 2024-09-17T02:20:55.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.309 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:55.309 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.277790+0000", 2024-09-17T02:20:55.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3947999999999999e-05 2024-09-17T02:20:55.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.310 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.310 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:55.310 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.277802+0000", 2024-09-17T02:20:55.310 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1933000000000001e-05 2024-09-17T02:20:55.865 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:55.865 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:55.865 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:55.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.866 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:59988 5.2 5:41b4d456:::benchmark_data_smithi001_23533_object59987:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-17T02:20:55.866 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:55.278178+0000", 2024-09-17T02:20:55.866 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 7.7069999999999992e-06, 2024-09-17T02:20:55.866 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00047513900000000002, 2024-09-17T02:20:55.866 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:55.866 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:55.866 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:55.866 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:55.866 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:55.866 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:55.866 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 59988 2024-09-17T02:20:55.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.867 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:55.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:55.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.278178+0000", 2024-09-17T02:20:55.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:55.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:55.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.278178+0000", 2024-09-17T02:20:55.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:55.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.868 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:55.868 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.278179+0000", 2024-09-17T02:20:55.868 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6500000000000008e-07 2024-09-17T02:20:55.868 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.868 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.868 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:55.868 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.278232+0000", 2024-09-17T02:20:55.868 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3269000000000001e-05 2024-09-17T02:20:55.868 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.868 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.868 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:55.868 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.278245+0000", 2024-09-17T02:20:55.868 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3157e-05 2024-09-17T02:20:55.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:55.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.278251+0000", 2024-09-17T02:20:55.869 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6899999999999997e-06 2024-09-17T02:20:55.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:55.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.278301+0000", 2024-09-17T02:20:55.869 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0018999999999997e-05 2024-09-17T02:20:55.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:55.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.278426+0000", 2024-09-17T02:20:55.870 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012517800000000001 2024-09-17T02:20:55.870 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:55.870 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:55.870 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:55.870 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:55.278563+0000", 2024-09-17T02:20:55.870 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013726799999999999 2024-09-17T02:20:55.870 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:55.870 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:55.870 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:55.870 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:55.870 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-09-17T02:20:55.870 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 7 2024-09-17T02:20:55.870 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:20:55.871 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 23 16 61113 61097 166.007 136.25 0.00575139 0.00601913 2024-09-17T02:20:55.872 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:20:55.873 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:55.875+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:55.972 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:55.976+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:56.068 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:20:56.068 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-17T02:20:56.068 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-09-17T02:20:56.068 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-09-17T02:20:56.068 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:20:56.073 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:56.075+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:56.090 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:20:56.174 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:56.175+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:56.275 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:56.279+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:56.290 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:20:56.290 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-09-17T02:20:56.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-09-17T02:20:56.290 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-17T02:20:56.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.290 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-17T02:20:56.290 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:20:56.290 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 51.833996079000002, 2024-09-17T02:20:56.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.15597325500000001, 2024-09-17T02:20:56.290 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:56.291 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:56.291 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:56.291 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:56.291 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4164", 2024-09-17T02:20:56.291 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/201892753", 2024-09-17T02:20:56.291 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 1 2024-09-17T02:20:56.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.291 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:56.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:56.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:20:56.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:56.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:20:56.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:56.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458359+0000", 2024-09-17T02:20:56.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3929999999999998e-06 2024-09-17T02:20:56.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:56.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458373+0000", 2024-09-17T02:20:56.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4103e-05 2024-09-17T02:20:56.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:56.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458397+0000", 2024-09-17T02:20:56.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.438e-05 2024-09-17T02:20:56.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458421+0000", 2024-09-17T02:20:56.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3655999999999998e-05 2024-09-17T02:20:56.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:56.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458529+0000", 2024-09-17T02:20:56.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010752900000000001 2024-09-17T02:20:56.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:20:56.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458542+0000", 2024-09-17T02:20:56.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2986999999999999e-05 2024-09-17T02:20:56.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:56.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.611050+0000", 2024-09-17T02:20:56.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.1525087 2024-09-17T02:20:56.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:56.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.611529+0000", 2024-09-17T02:20:56.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00047844899999999999 2024-09-17T02:20:56.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:56.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.612061+0000", 2024-09-17T02:20:56.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00053230300000000003 2024-09-17T02:20:56.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:56.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.613451+0000", 2024-09-17T02:20:56.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0013897250000000001 2024-09-17T02:20:56.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:56.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614168+0000", 2024-09-17T02:20:56.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00071692499999999998 2024-09-17T02:20:56.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:56.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614265+0000", 2024-09-17T02:20:56.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7589000000000004e-05 2024-09-17T02:20:56.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:56.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614330+0000", 2024-09-17T02:20:56.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4516000000000004e-05 2024-09-17T02:20:56.297 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.298 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:56.298 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.298 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:56.298 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:20:56.298 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 39.736064960999997, 2024-09-17T02:20:56.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029713927000000001, 2024-09-17T02:20:56.298 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:56.298 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:56.298 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:56.298 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:56.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:56.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:20:56.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:56.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:20:56.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:56.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556289+0000", 2024-09-17T02:20:56.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.513e-06 2024-09-17T02:20:56.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:56.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556298+0000", 2024-09-17T02:20:56.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1630000000000002e-06 2024-09-17T02:20:56.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:56.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556318+0000", 2024-09-17T02:20:56.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9389999999999999e-05 2024-09-17T02:20:56.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556332+0000", 2024-09-17T02:20:56.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4506e-05 2024-09-17T02:20:56.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:56.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557304+0000", 2024-09-17T02:20:56.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00097169699999999999 2024-09-17T02:20:56.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:56.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557507+0000", 2024-09-17T02:20:56.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000203191 2024-09-17T02:20:56.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:56.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557838+0000", 2024-09-17T02:20:56.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033061100000000002 2024-09-17T02:20:56.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:56.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562171+0000", 2024-09-17T02:20:56.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043329229999999998 2024-09-17T02:20:56.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:56.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585737+0000", 2024-09-17T02:20:56.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023565915 2024-09-17T02:20:56.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:56.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585884+0000", 2024-09-17T02:20:56.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014744199999999999 2024-09-17T02:20:56.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:56.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586002+0000", 2024-09-17T02:20:56.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000117576 2024-09-17T02:20:56.304 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.304 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:56.304 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.304 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:56.305 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:20:56.305 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 39.735972988999997, 2024-09-17T02:20:56.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030933694000000001, 2024-09-17T02:20:56.305 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:56.305 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:56.305 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:56.305 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:56.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:56.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:20:56.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:56.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:20:56.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.306 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:56.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556381+0000", 2024-09-17T02:20:56.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2100000000000001e-06 2024-09-17T02:20:56.306 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:56.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556389+0000", 2024-09-17T02:20:56.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5539999999999998e-06 2024-09-17T02:20:56.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:56.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556408+0000", 2024-09-17T02:20:56.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8623000000000001e-05 2024-09-17T02:20:56.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556427+0000", 2024-09-17T02:20:56.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8566000000000001e-05 2024-09-17T02:20:56.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:56.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558741+0000", 2024-09-17T02:20:56.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023144390000000002 2024-09-17T02:20:56.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:56.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559040+0000", 2024-09-17T02:20:56.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029912100000000001 2024-09-17T02:20:56.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:56.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559222+0000", 2024-09-17T02:20:56.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018211200000000001 2024-09-17T02:20:56.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.309 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:56.309 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.566648+0000", 2024-09-17T02:20:56.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074257560000000004 2024-09-17T02:20:56.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.309 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:56.309 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587109+0000", 2024-09-17T02:20:56.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.020460685999999999 2024-09-17T02:20:56.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.309 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:56.309 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587232+0000", 2024-09-17T02:20:56.310 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123325 2024-09-17T02:20:56.310 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.310 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.310 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:56.310 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587313+0000", 2024-09-17T02:20:56.310 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1302000000000002e-05 2024-09-17T02:20:56.310 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.310 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:56.310 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.310 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.310 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.310 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:56.310 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:20:56.310 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 39.735907543000003, 2024-09-17T02:20:56.311 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031045538000000001, 2024-09-17T02:20:56.311 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:56.311 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:56.311 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:56.311 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:56.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.311 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:56.311 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:20:56.311 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.311 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.311 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:56.311 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:20:56.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.312 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:56.312 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556446+0000", 2024-09-17T02:20:56.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.26e-06 2024-09-17T02:20:56.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.312 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:56.312 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556454+0000", 2024-09-17T02:20:56.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1640000000000004e-06 2024-09-17T02:20:56.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.312 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:56.313 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556471+0000", 2024-09-17T02:20:56.313 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7586000000000001e-05 2024-09-17T02:20:56.313 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.313 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.313 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.313 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556485+0000", 2024-09-17T02:20:56.313 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3523000000000001e-05 2024-09-17T02:20:56.313 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.313 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.313 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:56.313 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559899+0000", 2024-09-17T02:20:56.313 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0034142140000000001 2024-09-17T02:20:56.313 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:56.314 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.560104+0000", 2024-09-17T02:20:56.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00020539199999999999 2024-09-17T02:20:56.314 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:56.314 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.560400+0000", 2024-09-17T02:20:56.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029612099999999999 2024-09-17T02:20:56.314 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:56.314 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.568427+0000", 2024-09-17T02:20:56.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0080262909999999996 2024-09-17T02:20:56.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.315 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:56.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587377+0000", 2024-09-17T02:20:56.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018950765000000001 2024-09-17T02:20:56.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.315 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:56.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587445+0000", 2024-09-17T02:20:56.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.724e-05 2024-09-17T02:20:56.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.315 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:56.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587491+0000", 2024-09-17T02:20:56.316 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5982000000000001e-05 2024-09-17T02:20:56.316 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.316 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:56.316 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.316 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.316 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.316 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:56.316 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:20:56.316 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 39.735844772999997, 2024-09-17T02:20:56.316 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031435547000000001, 2024-09-17T02:20:56.316 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:56.316 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:56.316 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:56.317 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:56.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:56.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:20:56.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:56.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:20:56.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:56.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556509+0000", 2024-09-17T02:20:56.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.06e-06 2024-09-17T02:20:56.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.318 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:56.318 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556515+0000", 2024-09-17T02:20:56.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1029999999999998e-06 2024-09-17T02:20:56.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.318 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:56.318 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556532+0000", 2024-09-17T02:20:56.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7054e-05 2024-09-17T02:20:56.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.319 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556545+0000", 2024-09-17T02:20:56.319 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3023000000000001e-05 2024-09-17T02:20:56.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.319 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.319 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:56.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561016+0000", 2024-09-17T02:20:56.319 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044705150000000004 2024-09-17T02:20:56.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.319 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.319 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:56.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561316+0000", 2024-09-17T02:20:56.319 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000299895 2024-09-17T02:20:56.320 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.320 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.320 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:56.320 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561651+0000", 2024-09-17T02:20:56.320 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033519300000000001 2024-09-17T02:20:56.320 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.320 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.320 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:56.320 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571105+0000", 2024-09-17T02:20:56.320 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094540539999999999 2024-09-17T02:20:56.320 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.320 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.321 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:56.321 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587628+0000", 2024-09-17T02:20:56.321 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016522819000000001 2024-09-17T02:20:56.321 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.321 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.321 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:56.321 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587770+0000", 2024-09-17T02:20:56.321 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000142352 2024-09-17T02:20:56.321 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.321 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.321 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:56.321 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587943+0000", 2024-09-17T02:20:56.322 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017347900000000001 2024-09-17T02:20:56.322 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.322 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:56.322 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.322 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.322 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.322 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:56.322 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:20:56.322 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 39.735789042999997, 2024-09-17T02:20:56.322 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031809104999999997, 2024-09-17T02:20:56.322 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:56.322 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:56.322 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:56.323 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:56.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:56.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:20:56.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.323 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:56.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:20:56.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.323 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:56.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556565+0000", 2024-09-17T02:20:56.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.116e-06 2024-09-17T02:20:56.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:56.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556572+0000", 2024-09-17T02:20:56.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0230000000000004e-06 2024-09-17T02:20:56.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:56.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556588+0000", 2024-09-17T02:20:56.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6643e-05 2024-09-17T02:20:56.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.325 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556606+0000", 2024-09-17T02:20:56.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7159999999999998e-05 2024-09-17T02:20:56.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.325 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:56.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562712+0000", 2024-09-17T02:20:56.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0061061630000000004 2024-09-17T02:20:56.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.325 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:56.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562919+0000", 2024-09-17T02:20:56.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000207309 2024-09-17T02:20:56.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.326 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:56.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563264+0000", 2024-09-17T02:20:56.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00034490699999999998 2024-09-17T02:20:56.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.326 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:56.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571812+0000", 2024-09-17T02:20:56.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0085477810000000008 2024-09-17T02:20:56.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:56.327 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588094+0000", 2024-09-17T02:20:56.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016282443000000001 2024-09-17T02:20:56.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:56.327 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588275+0000", 2024-09-17T02:20:56.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018058700000000001 2024-09-17T02:20:56.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:56.327 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588373+0000", 2024-09-17T02:20:56.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7973000000000005e-05 2024-09-17T02:20:56.328 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.328 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:56.328 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.328 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.328 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:56.328 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:20:56.328 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 39.735730943999997, 2024-09-17T02:20:56.328 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031950544999999997, 2024-09-17T02:20:56.328 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:56.328 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:56.328 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:56.328 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:56.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.329 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:56.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:20:56.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.329 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:56.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:20:56.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.329 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:56.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556623+0000", 2024-09-17T02:20:56.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.04e-06 2024-09-17T02:20:56.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:56.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556631+0000", 2024-09-17T02:20:56.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1529999999999997e-06 2024-09-17T02:20:56.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:56.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556648+0000", 2024-09-17T02:20:56.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6583999999999999e-05 2024-09-17T02:20:56.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.331 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.331 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556661+0000", 2024-09-17T02:20:56.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3203e-05 2024-09-17T02:20:56.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.331 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:56.331 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564413+0000", 2024-09-17T02:20:56.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0077523100000000001 2024-09-17T02:20:56.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.331 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:56.331 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.565841+0000", 2024-09-17T02:20:56.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014276320000000001 2024-09-17T02:20:56.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.332 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.332 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:56.332 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.566131+0000", 2024-09-17T02:20:56.332 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029043800000000001 2024-09-17T02:20:56.332 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.332 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.332 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:56.332 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572353+0000", 2024-09-17T02:20:56.332 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.006222399 2024-09-17T02:20:56.333 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.333 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:56.333 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588452+0000", 2024-09-17T02:20:56.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016098635 2024-09-17T02:20:56.333 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.333 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:56.333 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588520+0000", 2024-09-17T02:20:56.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8040000000000006e-05 2024-09-17T02:20:56.333 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.333 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:56.334 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588572+0000", 2024-09-17T02:20:56.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2111000000000003e-05 2024-09-17T02:20:56.334 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.334 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:56.334 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.334 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.334 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.334 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:56.334 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:20:56.334 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 39.735633778, 2024-09-17T02:20:56.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.032187205000000003, 2024-09-17T02:20:56.334 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:56.335 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:56.335 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:56.335 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:56.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:56.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:20:56.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:56.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:20:56.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.336 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:56.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556727+0000", 2024-09-17T02:20:56.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3000000000000002e-06 2024-09-17T02:20:56.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.336 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:56.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556736+0000", 2024-09-17T02:20:56.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4300000000000006e-06 2024-09-17T02:20:56.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.336 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:56.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556755+0000", 2024-09-17T02:20:56.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9700000000000001e-05 2024-09-17T02:20:56.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.337 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556771+0000", 2024-09-17T02:20:56.337 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5213e-05 2024-09-17T02:20:56.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:56.337 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571184+0000", 2024-09-17T02:20:56.337 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014413888999999999 2024-09-17T02:20:56.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:56.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571302+0000", 2024-09-17T02:20:56.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011794900000000001 2024-09-17T02:20:56.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:56.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571494+0000", 2024-09-17T02:20:56.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000191168 2024-09-17T02:20:56.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:56.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.573775+0000", 2024-09-17T02:20:56.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002281656 2024-09-17T02:20:56.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:56.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588668+0000", 2024-09-17T02:20:56.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014892699000000001 2024-09-17T02:20:56.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:56.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588813+0000", 2024-09-17T02:20:56.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014530700000000001 2024-09-17T02:20:56.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:56.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588906+0000", 2024-09-17T02:20:56.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2893999999999995e-05 2024-09-17T02:20:56.340 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.340 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:56.340 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.340 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.340 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:56.340 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:20:56.340 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 39.735492612999998, 2024-09-17T02:20:56.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028815922000000001, 2024-09-17T02:20:56.340 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:56.340 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:56.340 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:56.340 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:56.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:56.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:20:56.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:56.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:20:56.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:56.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556861+0000", 2024-09-17T02:20:56.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.08e-06 2024-09-17T02:20:56.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:56.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556867+0000", 2024-09-17T02:20:56.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.207e-06 2024-09-17T02:20:56.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:56.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556886+0000", 2024-09-17T02:20:56.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9137e-05 2024-09-17T02:20:56.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556900+0000", 2024-09-17T02:20:56.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3253e-05 2024-09-17T02:20:56.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:56.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558301+0000", 2024-09-17T02:20:56.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014008320000000001 2024-09-17T02:20:56.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:56.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558564+0000", 2024-09-17T02:20:56.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000263238 2024-09-17T02:20:56.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:56.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558905+0000", 2024-09-17T02:20:56.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000341534 2024-09-17T02:20:56.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:56.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.568208+0000", 2024-09-17T02:20:56.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0093023689999999996 2024-09-17T02:20:56.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:56.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585379+0000", 2024-09-17T02:20:56.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017171091999999999 2024-09-17T02:20:56.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:56.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585509+0000", 2024-09-17T02:20:56.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013036100000000001 2024-09-17T02:20:56.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:56.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585676+0000", 2024-09-17T02:20:56.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016681899999999999 2024-09-17T02:20:56.345 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.345 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:56.346 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.346 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.346 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:56.346 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:20:56.346 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 39.735435346000003, 2024-09-17T02:20:56.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030862568, 2024-09-17T02:20:56.346 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:56.346 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:56.346 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:56.348 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:56.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.348 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:56.348 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:20:56.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.348 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.348 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:56.348 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:20:56.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.348 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:56.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556918+0000", 2024-09-17T02:20:56.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0529999999999999e-06 2024-09-17T02:20:56.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:56.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556925+0000", 2024-09-17T02:20:56.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.6939999999999998e-06 2024-09-17T02:20:56.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:56.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556942+0000", 2024-09-17T02:20:56.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6803000000000002e-05 2024-09-17T02:20:56.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556955+0000", 2024-09-17T02:20:56.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2659e-05 2024-09-17T02:20:56.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:56.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558237+0000", 2024-09-17T02:20:56.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001282804 2024-09-17T02:20:56.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:56.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558495+0000", 2024-09-17T02:20:56.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000257178 2024-09-17T02:20:56.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:56.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562168+0000", 2024-09-17T02:20:56.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0036737110000000001 2024-09-17T02:20:56.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:56.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.570855+0000", 2024-09-17T02:20:56.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0086868729999999995 2024-09-17T02:20:56.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:56.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587568+0000", 2024-09-17T02:20:56.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016712444999999999 2024-09-17T02:20:56.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:56.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587677+0000", 2024-09-17T02:20:56.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000109879 2024-09-17T02:20:56.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:56.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587780+0000", 2024-09-17T02:20:56.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000102469 2024-09-17T02:20:56.352 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.353 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:56.353 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.353 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.353 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:56.353 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:20:56.353 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 39.735353214, 2024-09-17T02:20:56.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031005751000000002, 2024-09-17T02:20:56.353 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:56.353 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:56.353 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:56.353 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:56.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:56.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:20:56.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:56.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:20:56.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:56.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557001+0000", 2024-09-17T02:20:56.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.237e-06 2024-09-17T02:20:56.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:56.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557007+0000", 2024-09-17T02:20:56.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7270000000000001e-06 2024-09-17T02:20:56.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:56.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557025+0000", 2024-09-17T02:20:56.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7689999999999998e-05 2024-09-17T02:20:56.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557039+0000", 2024-09-17T02:20:56.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.385e-05 2024-09-17T02:20:56.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.356 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:56.356 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563783+0000", 2024-09-17T02:20:56.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0067437110000000003 2024-09-17T02:20:56.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.356 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:56.356 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564031+0000", 2024-09-17T02:20:56.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00024871799999999999 2024-09-17T02:20:56.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.356 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:56.357 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564518+0000", 2024-09-17T02:20:56.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00048708999999999997 2024-09-17T02:20:56.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.357 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:56.357 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572375+0000", 2024-09-17T02:20:56.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078564780000000001 2024-09-17T02:20:56.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.357 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:56.357 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587862+0000", 2024-09-17T02:20:56.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015486837999999999 2024-09-17T02:20:56.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:56.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587954+0000", 2024-09-17T02:20:56.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1766000000000002e-05 2024-09-17T02:20:56.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:56.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588005+0000", 2024-09-17T02:20:56.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1646e-05 2024-09-17T02:20:56.358 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.358 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:56.358 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.359 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:56.359 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:20:56.359 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 39.735208917999998, 2024-09-17T02:20:56.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029554871999999999, 2024-09-17T02:20:56.359 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:56.359 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:56.359 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:56.359 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:56.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:56.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:20:56.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:56.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:20:56.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:56.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557145+0000", 2024-09-17T02:20:56.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.263e-06 2024-09-17T02:20:56.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:56.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557151+0000", 2024-09-17T02:20:56.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1040000000000003e-06 2024-09-17T02:20:56.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:56.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557168+0000", 2024-09-17T02:20:56.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7289999999999999e-05 2024-09-17T02:20:56.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.362 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557182+0000", 2024-09-17T02:20:56.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.325e-05 2024-09-17T02:20:56.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.362 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:56.362 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564102+0000", 2024-09-17T02:20:56.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069199860000000004 2024-09-17T02:20:56.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.362 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:56.362 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564438+0000", 2024-09-17T02:20:56.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033651800000000001 2024-09-17T02:20:56.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:56.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.565422+0000", 2024-09-17T02:20:56.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00098332499999999995 2024-09-17T02:20:56.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:56.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572361+0000", 2024-09-17T02:20:56.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069392630000000002 2024-09-17T02:20:56.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:56.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586567+0000", 2024-09-17T02:20:56.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014206107000000001 2024-09-17T02:20:56.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:56.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586643+0000", 2024-09-17T02:20:56.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5673000000000005e-05 2024-09-17T02:20:56.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:56.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586699+0000", 2024-09-17T02:20:56.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6093e-05 2024-09-17T02:20:56.364 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.364 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:56.364 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.365 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:56.365 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:20:56.365 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 39.735075225999999, 2024-09-17T02:20:56.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029800569999999998, 2024-09-17T02:20:56.365 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:56.365 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:56.365 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:56.365 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:56.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:56.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:20:56.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:56.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:20:56.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:56.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557279+0000", 2024-09-17T02:20:56.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.497e-06 2024-09-17T02:20:56.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:56.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557287+0000", 2024-09-17T02:20:56.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9030000000000004e-06 2024-09-17T02:20:56.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:56.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557306+0000", 2024-09-17T02:20:56.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9394000000000001e-05 2024-09-17T02:20:56.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557323+0000", 2024-09-17T02:20:56.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6299000000000001e-05 2024-09-17T02:20:56.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.368 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:56.368 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.570931+0000", 2024-09-17T02:20:56.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013608841999999999 2024-09-17T02:20:56.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.368 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:56.368 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571250+0000", 2024-09-17T02:20:56.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031817400000000001 2024-09-17T02:20:56.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.368 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:56.368 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571559+0000", 2024-09-17T02:20:56.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000309835 2024-09-17T02:20:56.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:56.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.574161+0000", 2024-09-17T02:20:56.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002601543 2024-09-17T02:20:56.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:56.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586866+0000", 2024-09-17T02:20:56.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012704968000000001 2024-09-17T02:20:56.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:56.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586987+0000", 2024-09-17T02:20:56.370 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000121369 2024-09-17T02:20:56.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:56.370 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587078+0000", 2024-09-17T02:20:56.370 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0746000000000002e-05 2024-09-17T02:20:56.370 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.370 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:56.370 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.370 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:56.370 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:20:56.371 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 39.735009583, 2024-09-17T02:20:56.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029936054, 2024-09-17T02:20:56.371 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:56.371 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:56.371 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:56.371 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:56.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:56.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:20:56.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:56.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:20:56.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.372 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:56.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557344+0000", 2024-09-17T02:20:56.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.347e-06 2024-09-17T02:20:56.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.372 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:56.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557351+0000", 2024-09-17T02:20:56.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5560000000000004e-06 2024-09-17T02:20:56.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.373 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:56.373 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557369+0000", 2024-09-17T02:20:56.373 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7703e-05 2024-09-17T02:20:56.373 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.373 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.373 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.373 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557382+0000", 2024-09-17T02:20:56.373 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3664e-05 2024-09-17T02:20:56.373 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.373 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.373 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:56.373 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558997+0000", 2024-09-17T02:20:56.373 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0016147970000000001 2024-09-17T02:20:56.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.374 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:56.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559236+0000", 2024-09-17T02:20:56.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00023900200000000001 2024-09-17T02:20:56.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.374 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:56.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559547+0000", 2024-09-17T02:20:56.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031132399999999998 2024-09-17T02:20:56.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.374 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:56.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563130+0000", 2024-09-17T02:20:56.375 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003582989 2024-09-17T02:20:56.375 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.375 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.375 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:56.375 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587069+0000", 2024-09-17T02:20:56.375 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023938496 2024-09-17T02:20:56.375 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.375 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.375 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:56.375 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587192+0000", 2024-09-17T02:20:56.375 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123514 2024-09-17T02:20:56.375 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.375 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.376 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:56.376 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587279+0000", 2024-09-17T02:20:56.376 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6662000000000005e-05 2024-09-17T02:20:56.376 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.376 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:56.376 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.376 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.376 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.376 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:56.376 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:20:56.376 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 39.734951697, 2024-09-17T02:20:56.376 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030490703000000001, 2024-09-17T02:20:56.376 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:56.376 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:56.377 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:56.377 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:56.377 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.377 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:56.377 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:20:56.377 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.377 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.377 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.377 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:56.377 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:20:56.377 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.377 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.377 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.378 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:56.378 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557403+0000", 2024-09-17T02:20:56.378 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.77e-06 2024-09-17T02:20:56.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.378 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.378 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:56.378 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557412+0000", 2024-09-17T02:20:56.378 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4099999999999997e-06 2024-09-17T02:20:56.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.378 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.378 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:56.378 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557431+0000", 2024-09-17T02:20:56.378 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9177e-05 2024-09-17T02:20:56.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.379 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.379 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.379 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557444+0000", 2024-09-17T02:20:56.379 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2999999999999999e-05 2024-09-17T02:20:56.379 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.379 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.379 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:56.379 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557722+0000", 2024-09-17T02:20:56.379 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00027760699999999997 2024-09-17T02:20:56.379 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.379 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.379 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:56.379 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557991+0000", 2024-09-17T02:20:56.380 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00026892499999999999 2024-09-17T02:20:56.380 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.380 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.380 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:56.380 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558265+0000", 2024-09-17T02:20:56.380 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000274524 2024-09-17T02:20:56.380 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.380 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.380 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:56.380 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564270+0000", 2024-09-17T02:20:56.380 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060045339999999997 2024-09-17T02:20:56.380 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.380 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.381 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:56.381 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587701+0000", 2024-09-17T02:20:56.381 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023431285999999999 2024-09-17T02:20:56.381 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.381 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.381 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:56.381 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587803+0000", 2024-09-17T02:20:56.381 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000101371 2024-09-17T02:20:56.381 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.381 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.381 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:56.381 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587892+0000", 2024-09-17T02:20:56.382 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9098999999999995e-05 2024-09-17T02:20:56.382 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.382 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:56.382 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.382 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.382 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.382 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:56.382 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:20:56.382 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 39.734870100999998, 2024-09-17T02:20:56.382 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029886725999999999, 2024-09-17T02:20:56.382 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:56.382 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:56.382 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:20:56.382 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:56.383 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.383 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:56.383 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:20:56.383 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.383 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.383 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.383 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:56.383 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:20:56.383 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.383 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.383 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.383 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:56.383 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557484+0000", 2024-09-17T02:20:56.383 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.26e-06 2024-09-17T02:20:56.384 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.384 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.384 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:56.384 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557489+0000", 2024-09-17T02:20:56.384 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2530000000000004e-06 2024-09-17T02:20:56.384 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.384 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.384 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:56.384 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557507+0000", 2024-09-17T02:20:56.384 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7473999999999999e-05 2024-09-17T02:20:56.384 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.384 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.385 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.385 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557524+0000", 2024-09-17T02:20:56.385 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7912999999999999e-05 2024-09-17T02:20:56.385 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.385 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.385 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:56.385 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572428+0000", 2024-09-17T02:20:56.385 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014903451999999999 2024-09-17T02:20:56.385 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.385 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.385 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:56.385 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572589+0000", 2024-09-17T02:20:56.386 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000161299 2024-09-17T02:20:56.386 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.386 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.386 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:56.386 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587369+0000", 2024-09-17T02:20:56.386 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014780075 2024-09-17T02:20:56.386 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.386 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:56.386 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.386 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.386 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.386 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28720 5.f 5:f8a7aea5:::benchmark_data_smithi001_23533_object28719:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:56.386 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:20:56.387 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 13.724565785999999, 2024-09-17T02:20:56.387 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.033978608, 2024-09-17T02:20:56.387 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:56.387 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:56.387 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:56.387 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:56.387 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:56.387 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:56.387 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28720 2024-09-17T02:20:56.387 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.387 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:56.387 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.387 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:56.387 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:20:56.388 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.388 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.388 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.388 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:56.388 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:20:56.388 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.388 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.388 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.388 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:56.388 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:20:56.388 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3200000000000005e-07 2024-09-17T02:20:56.388 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.388 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.389 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:56.389 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567856+0000", 2024-09-17T02:20:56.389 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8596000000000005e-05 2024-09-17T02:20:56.389 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.389 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.389 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:56.389 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567864+0000", 2024-09-17T02:20:56.389 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6040000000000004e-06 2024-09-17T02:20:56.389 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.389 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.389 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.389 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567867+0000", 2024-09-17T02:20:56.389 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7929999999999999e-06 2024-09-17T02:20:56.390 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.390 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.390 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:56.390 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567896+0000", 2024-09-17T02:20:56.390 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8444000000000001e-05 2024-09-17T02:20:56.390 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.390 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.390 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:56.390 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567983+0000", 2024-09-17T02:20:56.390 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7498999999999997e-05 2024-09-17T02:20:56.390 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.390 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.390 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:56.390 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568078+0000", 2024-09-17T02:20:56.391 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5050999999999995e-05 2024-09-17T02:20:56.391 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.391 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.391 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:56.391 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573091+0000", 2024-09-17T02:20:56.391 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050124599999999998 2024-09-17T02:20:56.391 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.391 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.391 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:56.391 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601705+0000", 2024-09-17T02:20:56.391 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028614298999999999 2024-09-17T02:20:56.391 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.391 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.392 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:56.392 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601741+0000", 2024-09-17T02:20:56.392 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5329e-05 2024-09-17T02:20:56.392 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.392 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.392 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:56.392 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601766+0000", 2024-09-17T02:20:56.392 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5001e-05 2024-09-17T02:20:56.392 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.392 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:56.392 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.392 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.392 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.393 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28723 5.f 5:f1a2a8f6:::benchmark_data_smithi001_23533_object28722:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:56.393 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:20:56.393 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 13.724287106, 2024-09-17T02:20:56.393 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.033805288000000003, 2024-09-17T02:20:56.393 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:56.393 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:56.393 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:56.393 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:56.393 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:56.393 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:56.393 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28723 2024-09-17T02:20:56.393 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.393 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:56.394 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.394 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:56.394 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:20:56.394 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.394 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.394 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.394 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:56.394 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:20:56.394 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.394 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.394 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.394 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:56.394 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568067+0000", 2024-09-17T02:20:56.395 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6700000000000002e-07 2024-09-17T02:20:56.395 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.395 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.395 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:56.395 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568121+0000", 2024-09-17T02:20:56.395 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4286000000000002e-05 2024-09-17T02:20:56.395 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.395 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.395 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:56.395 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568131+0000", 2024-09-17T02:20:56.395 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0288e-05 2024-09-17T02:20:56.395 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.395 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.396 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.396 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568139+0000", 2024-09-17T02:20:56.396 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5399999999999998e-06 2024-09-17T02:20:56.396 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.396 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.396 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:56.396 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569194+0000", 2024-09-17T02:20:56.396 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0010557100000000001 2024-09-17T02:20:56.396 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.396 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.396 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:56.396 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569298+0000", 2024-09-17T02:20:56.396 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000103491 2024-09-17T02:20:56.397 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.397 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.397 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:56.397 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569428+0000", 2024-09-17T02:20:56.397 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013050599999999999 2024-09-17T02:20:56.397 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.397 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.397 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:56.397 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573124+0000", 2024-09-17T02:20:56.397 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0036956810000000001 2024-09-17T02:20:56.397 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.397 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.397 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:56.398 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601801+0000", 2024-09-17T02:20:56.398 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028676667999999999 2024-09-17T02:20:56.398 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.398 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.398 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:56.398 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601835+0000", 2024-09-17T02:20:56.398 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4347000000000002e-05 2024-09-17T02:20:56.398 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.398 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.398 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:56.398 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601871+0000", 2024-09-17T02:20:56.398 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5803999999999998e-05 2024-09-17T02:20:56.398 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.399 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:56.399 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.399 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.399 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.399 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28729 5.9 5:9e3b1489:::benchmark_data_smithi001_23533_object28728:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:56.399 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:20:56.399 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 13.722668455000001, 2024-09-17T02:20:56.399 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.032738525999999997, 2024-09-17T02:20:56.399 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:56.399 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:56.399 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:56.399 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:56.399 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:56.399 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:56.400 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28729 2024-09-17T02:20:56.400 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.400 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:56.400 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.400 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:56.400 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:20:56.400 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.400 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.400 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.400 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:56.400 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:20:56.400 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.401 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.401 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.401 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:56.401 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569685+0000", 2024-09-17T02:20:56.401 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8599999999999996e-07 2024-09-17T02:20:56.401 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.401 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.401 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:56.401 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569725+0000", 2024-09-17T02:20:56.401 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0144000000000001e-05 2024-09-17T02:20:56.401 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.401 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.401 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:56.401 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569737+0000", 2024-09-17T02:20:56.402 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1752e-05 2024-09-17T02:20:56.402 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.402 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.402 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.402 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569745+0000", 2024-09-17T02:20:56.402 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6420000000000007e-06 2024-09-17T02:20:56.402 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.402 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.402 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:56.402 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569801+0000", 2024-09-17T02:20:56.402 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6110000000000003e-05 2024-09-17T02:20:56.402 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.402 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.403 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:56.403 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569944+0000", 2024-09-17T02:20:56.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014361500000000001 2024-09-17T02:20:56.403 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.403 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.403 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:56.403 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.570234+0000", 2024-09-17T02:20:56.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00028927899999999998 2024-09-17T02:20:56.403 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.403 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.403 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:56.403 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572606+0000", 2024-09-17T02:20:56.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023725529999999999 2024-09-17T02:20:56.403 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:56.404 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602361+0000", 2024-09-17T02:20:56.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029755031000000001 2024-09-17T02:20:56.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:56.404 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602397+0000", 2024-09-17T02:20:56.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5509000000000002e-05 2024-09-17T02:20:56.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:56.404 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602423+0000", 2024-09-17T02:20:56.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5905e-05 2024-09-17T02:20:56.405 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.405 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:56.405 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.405 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.405 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28734 5.f 5:f1a63647:::benchmark_data_smithi001_23533_object28733:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:20:56.405 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:20:56.405 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 13.720945969000001, 2024-09-17T02:20:56.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.034441100000000002, 2024-09-17T02:20:56.405 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:56.405 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:56.405 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:56.405 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:56.406 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:56.406 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:56.406 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28734 2024-09-17T02:20:56.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.406 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:56.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:56.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:20:56.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:56.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:20:56.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:56.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.407 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:56.407 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571408+0000", 2024-09-17T02:20:56.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.8899999999999998e-07 2024-09-17T02:20:56.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.407 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:56.407 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571464+0000", 2024-09-17T02:20:56.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6546999999999999e-05 2024-09-17T02:20:56.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.407 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:56.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571474+0000", 2024-09-17T02:20:56.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0348e-05 2024-09-17T02:20:56.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571480+0000", 2024-09-17T02:20:56.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.366e-06 2024-09-17T02:20:56.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:56.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572097+0000", 2024-09-17T02:20:56.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061710599999999997 2024-09-17T02:20:56.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:56.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572172+0000", 2024-09-17T02:20:56.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4658000000000002e-05 2024-09-17T02:20:56.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:56.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572247+0000", 2024-09-17T02:20:56.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5766000000000006e-05 2024-09-17T02:20:56.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:56.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573819+0000", 2024-09-17T02:20:56.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015713649999999999 2024-09-17T02:20:56.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.410 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:56.410 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605762+0000", 2024-09-17T02:20:56.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031943304999999998 2024-09-17T02:20:56.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.410 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:56.410 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605808+0000", 2024-09-17T02:20:56.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5776999999999999e-05 2024-09-17T02:20:56.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:56.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:56.410 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:56.410 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605848+0000", 2024-09-17T02:20:56.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9972999999999998e-05 2024-09-17T02:20:56.411 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.411 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:56.411 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.411 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:56.411 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:56.411 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:20:56.412 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:56.416+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:56.413 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:20:56.513 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:56.515+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:56.574 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:20:56.574 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:20:56.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.574 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:62879 5.d e33/26 5:b0d1adc9:::benchmark_data_smithi001_23533_object62878:head v 33'3927, mlcod=33'3925)", 2024-09-17T02:20:56.574 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:56.576141+0000", 2024-09-17T02:20:56.574 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.003749034, 2024-09-17T02:20:56.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037721690000000001, 2024-09-17T02:20:56.574 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:56.574 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:56.575 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:56.575 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:56.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:56.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.576141+0000", 2024-09-17T02:20:56.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:56.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:56.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.576141+0000", 2024-09-17T02:20:56.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:56.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:56.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.576142+0000", 2024-09-17T02:20:56.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5300000000000003e-07 2024-09-17T02:20:56.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:56.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.576223+0000", 2024-09-17T02:20:56.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1086000000000003e-05 2024-09-17T02:20:56.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:56.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.576233+0000", 2024-09-17T02:20:56.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6309999999999998e-06 2024-09-17T02:20:56.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.576238+0000", 2024-09-17T02:20:56.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8230000000000002e-06 2024-09-17T02:20:56.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:56.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.576299+0000", 2024-09-17T02:20:56.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1698000000000005e-05 2024-09-17T02:20:56.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:56.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.576320+0000", 2024-09-17T02:20:56.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1047999999999999e-05 2024-09-17T02:20:56.578 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:56.578 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:56.578 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:56.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.578 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:62882 5.4 5:2f8a7137:::benchmark_data_smithi001_23533_object62881:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-17T02:20:56.578 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:56.576284+0000", 2024-09-17T02:20:56.578 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.003606808, 2024-09-17T02:20:56.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037085849999999999, 2024-09-17T02:20:56.578 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:56.578 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:56.579 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:56.579 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:56.579 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:56.579 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:56.579 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 62882 2024-09-17T02:20:56.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.579 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:56.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:56.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.576284+0000", 2024-09-17T02:20:56.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:56.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:56.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.576284+0000", 2024-09-17T02:20:56.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:56.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:56.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.576285+0000", 2024-09-17T02:20:56.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.37e-06 2024-09-17T02:20:56.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:56.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.576326+0000", 2024-09-17T02:20:56.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1220000000000002e-05 2024-09-17T02:20:56.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:56.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.576335+0000", 2024-09-17T02:20:56.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1279999999999997e-06 2024-09-17T02:20:56.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.576341+0000", 2024-09-17T02:20:56.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3430000000000003e-06 2024-09-17T02:20:56.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:56.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.578049+0000", 2024-09-17T02:20:56.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001708874 2024-09-17T02:20:56.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:56.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.578189+0000", 2024-09-17T02:20:56.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013960900000000001 2024-09-17T02:20:56.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:56.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.578329+0000", 2024-09-17T02:20:56.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014013900000000001 2024-09-17T02:20:56.582 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:56.583 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:56.583 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:56.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.583 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:62883 5.b 5:dd8e39c5:::benchmark_data_smithi001_23533_object62882:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-17T02:20:56.583 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:56.576358+0000", 2024-09-17T02:20:56.583 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0035325249999999999, 2024-09-17T02:20:56.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037246710000000001, 2024-09-17T02:20:56.583 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:56.583 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:56.583 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:56.583 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:56.583 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:56.584 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:56.584 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 62883 2024-09-17T02:20:56.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.584 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:56.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:56.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.576358+0000", 2024-09-17T02:20:56.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:56.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:56.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.576358+0000", 2024-09-17T02:20:56.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:56.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:56.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.576358+0000", 2024-09-17T02:20:56.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1900000000000003e-07 2024-09-17T02:20:56.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:56.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.576398+0000", 2024-09-17T02:20:56.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9372000000000002e-05 2024-09-17T02:20:56.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:56.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.576405+0000", 2024-09-17T02:20:56.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1749999999999999e-06 2024-09-17T02:20:56.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.576410+0000", 2024-09-17T02:20:56.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.006e-06 2024-09-17T02:20:56.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:56.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.576477+0000", 2024-09-17T02:20:56.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7256999999999997e-05 2024-09-17T02:20:56.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:56.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.576610+0000", 2024-09-17T02:20:56.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013290700000000001 2024-09-17T02:20:56.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:56.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.576702+0000", 2024-09-17T02:20:56.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1747000000000001e-05 2024-09-17T02:20:56.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:56.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.579229+0000", 2024-09-17T02:20:56.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025273959999999999 2024-09-17T02:20:56.588 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:56.588 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:56.588 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:56.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.588 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:62881 5.0 e33/26 5:046b9ca8:::benchmark_data_smithi001_23533_object62880:head v 33'3934, mlcod=33'3930)", 2024-09-17T02:20:56.588 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:56.577740+0000", 2024-09-17T02:20:56.588 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0021503899999999999, 2024-09-17T02:20:56.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024219580000000001, 2024-09-17T02:20:56.588 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:56.588 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:56.588 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:56.588 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:56.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:56.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.577740+0000", 2024-09-17T02:20:56.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:56.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:56.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.577740+0000", 2024-09-17T02:20:56.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:56.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:56.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.577741+0000", 2024-09-17T02:20:56.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6700000000000003e-07 2024-09-17T02:20:56.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:56.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.577831+0000", 2024-09-17T02:20:56.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9949000000000002e-05 2024-09-17T02:20:56.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:56.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.577839+0000", 2024-09-17T02:20:56.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.867e-06 2024-09-17T02:20:56.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.577855+0000", 2024-09-17T02:20:56.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5812e-05 2024-09-17T02:20:56.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:56.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.577900+0000", 2024-09-17T02:20:56.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4409000000000001e-05 2024-09-17T02:20:56.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:56.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.577920+0000", 2024-09-17T02:20:56.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0356999999999998e-05 2024-09-17T02:20:56.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:56.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.580128+0000", 2024-09-17T02:20:56.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022080429999999998 2024-09-17T02:20:56.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:56.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.580162+0000", 2024-09-17T02:20:56.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3853999999999998e-05 2024-09-17T02:20:56.592 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:56.592 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:56.592 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:56.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.593 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:62886 5.e 5:75bc61f2:::benchmark_data_smithi001_23533_object62885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-17T02:20:56.593 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:56.578597+0000", 2024-09-17T02:20:56.593 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0012933829999999999, 2024-09-17T02:20:56.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016385989999999999, 2024-09-17T02:20:56.593 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:56.593 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:56.593 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:56.593 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:56.593 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:56.593 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:56.594 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 62886 2024-09-17T02:20:56.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.594 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:56.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:56.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.578597+0000", 2024-09-17T02:20:56.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:56.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:56.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.578597+0000", 2024-09-17T02:20:56.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:56.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:56.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.578598+0000", 2024-09-17T02:20:56.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.207e-06 2024-09-17T02:20:56.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:56.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.578645+0000", 2024-09-17T02:20:56.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6553e-05 2024-09-17T02:20:56.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:56.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.578659+0000", 2024-09-17T02:20:56.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.419e-05 2024-09-17T02:20:56.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.578673+0000", 2024-09-17T02:20:56.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4443e-05 2024-09-17T02:20:56.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:56.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.579966+0000", 2024-09-17T02:20:56.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001292814 2024-09-17T02:20:56.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:56.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.580165+0000", 2024-09-17T02:20:56.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019904800000000001 2024-09-17T02:20:56.597 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:56.597 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:56.597 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:56.597 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:56.597 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:20:56.597 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 5 2024-09-17T02:20:56.597 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:20:56.598 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:20:56.614 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:56.615+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:56.715 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:56.719+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:56.756 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:20:56.756 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:20:56.756 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:20:56.757 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:20:56.757 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:20:56.770 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 24 16 63308 63292 164.806 137.188 0.0153824 0.00606262 2024-09-17T02:20:56.777 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:20:56.804 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T02:20:56.816 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:56.820+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:56.917 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:56.920+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:56.937 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:20:56.937 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:20:56.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:20:56.937 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:20:56.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.937 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:56.937 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:20:56.937 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.384820750000003, 2024-09-17T02:20:56.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035535028000000003, 2024-09-17T02:20:56.938 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:56.938 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:56.938 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:56.938 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:56.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:56.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:20:56.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:56.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:56.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:20:56.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:56.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:56.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556550+0000", 2024-09-17T02:20:56.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3500000000000001e-06 2024-09-17T02:20:56.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:56.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556566+0000", 2024-09-17T02:20:56.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5440000000000001e-05 2024-09-17T02:20:56.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:56.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556594+0000", 2024-09-17T02:20:56.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8552999999999999e-05 2024-09-17T02:20:56.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556618+0000", 2024-09-17T02:20:56.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3207e-05 2024-09-17T02:20:56.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:56.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578337+0000", 2024-09-17T02:20:56.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021719517000000001 2024-09-17T02:20:56.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:56.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578655+0000", 2024-09-17T02:20:56.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031837800000000002 2024-09-17T02:20:56.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:56.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.581374+0000", 2024-09-17T02:20:56.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002718238 2024-09-17T02:20:56.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:56.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587083+0000", 2024-09-17T02:20:56.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005708912 2024-09-17T02:20:56.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:56.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591823+0000", 2024-09-17T02:20:56.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047406080000000003 2024-09-17T02:20:56.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:56.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591972+0000", 2024-09-17T02:20:56.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014874199999999999 2024-09-17T02:20:56.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:56.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592082+0000", 2024-09-17T02:20:56.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110083 2024-09-17T02:20:56.943 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:56.943 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:56.943 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:56.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.943 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:56.944 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:20:56.944 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.383879262999997, 2024-09-17T02:20:56.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035128756999999997, 2024-09-17T02:20:56.944 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:56.944 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:56.944 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:56.944 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:56.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:56.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:20:56.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:56.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:56.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:20:56.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:56.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:56.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557491+0000", 2024-09-17T02:20:56.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.88e-06 2024-09-17T02:20:56.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:56.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557504+0000", 2024-09-17T02:20:56.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2864000000000001e-05 2024-09-17T02:20:56.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:56.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557535+0000", 2024-09-17T02:20:56.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0916e-05 2024-09-17T02:20:56.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557561+0000", 2024-09-17T02:20:56.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5602999999999999e-05 2024-09-17T02:20:56.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:56.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582290+0000", 2024-09-17T02:20:56.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024729729999999998 2024-09-17T02:20:56.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:56.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582642+0000", 2024-09-17T02:20:56.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035143499999999999 2024-09-17T02:20:56.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:56.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582959+0000", 2024-09-17T02:20:56.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031747399999999999 2024-09-17T02:20:56.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:56.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587302+0000", 2024-09-17T02:20:56.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043425169999999997 2024-09-17T02:20:56.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:56.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592391+0000", 2024-09-17T02:20:56.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050895799999999998 2024-09-17T02:20:56.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:56.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592516+0000", 2024-09-17T02:20:56.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012420500000000001 2024-09-17T02:20:56.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:56.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592617+0000", 2024-09-17T02:20:56.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010155299999999999 2024-09-17T02:20:56.949 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:56.949 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:56.949 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:56.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.950 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:56.950 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:20:56.950 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.383774764000002, 2024-09-17T02:20:56.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034796066, 2024-09-17T02:20:56.950 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:56.950 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:56.950 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:56.950 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:56.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:56.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:20:56.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:56.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:56.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:20:56.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:56.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:56.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557594+0000", 2024-09-17T02:20:56.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3769999999999999e-06 2024-09-17T02:20:56.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:56.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557683+0000", 2024-09-17T02:20:56.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8896999999999999e-05 2024-09-17T02:20:56.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:56.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557707+0000", 2024-09-17T02:20:56.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3839e-05 2024-09-17T02:20:56.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557730+0000", 2024-09-17T02:20:56.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3047000000000001e-05 2024-09-17T02:20:56.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:56.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582329+0000", 2024-09-17T02:20:56.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024599283999999999 2024-09-17T02:20:56.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:56.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582624+0000", 2024-09-17T02:20:56.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000294462 2024-09-17T02:20:56.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:56.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582936+0000", 2024-09-17T02:20:56.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031223399999999999 2024-09-17T02:20:56.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:56.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587347+0000", 2024-09-17T02:20:56.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044110340000000003 2024-09-17T02:20:56.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:56.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592165+0000", 2024-09-17T02:20:56.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048176699999999996 2024-09-17T02:20:56.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:56.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592311+0000", 2024-09-17T02:20:56.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014661899999999999 2024-09-17T02:20:56.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:56.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592389+0000", 2024-09-17T02:20:56.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7602999999999995e-05 2024-09-17T02:20:56.959 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:56.959 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:56.959 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:56.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.959 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:56.959 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:20:56.959 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.383257137000001, 2024-09-17T02:20:56.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034457472000000003, 2024-09-17T02:20:56.959 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:56.960 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:56.960 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:56.960 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:56.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:56.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:20:56.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:56.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:56.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:20:56.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:56.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:56.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558113+0000", 2024-09-17T02:20:56.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1639999999999999e-06 2024-09-17T02:20:56.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:56.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558125+0000", 2024-09-17T02:20:56.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2269999999999999e-05 2024-09-17T02:20:56.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:56.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558458+0000", 2024-09-17T02:20:56.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033322700000000001 2024-09-17T02:20:56.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558488+0000", 2024-09-17T02:20:56.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.951e-05 2024-09-17T02:20:56.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:56.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584514+0000", 2024-09-17T02:20:56.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026025721000000002 2024-09-17T02:20:56.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:56.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584781+0000", 2024-09-17T02:20:56.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000267142 2024-09-17T02:20:56.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:56.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585078+0000", 2024-09-17T02:20:56.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029738799999999999 2024-09-17T02:20:56.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:56.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588045+0000", 2024-09-17T02:20:56.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029673759999999999 2024-09-17T02:20:56.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:56.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592454+0000", 2024-09-17T02:20:56.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044090209999999999 2024-09-17T02:20:56.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:56.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592520+0000", 2024-09-17T02:20:56.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6032999999999996e-05 2024-09-17T02:20:56.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:56.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592568+0000", 2024-09-17T02:20:56.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7620000000000001e-05 2024-09-17T02:20:56.970 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:56.970 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:56.970 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:56.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.970 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:56.970 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:20:56.971 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.382796886000001, 2024-09-17T02:20:56.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031603266999999997, 2024-09-17T02:20:56.971 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:56.971 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:56.971 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:56.971 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:56.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:56.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:20:56.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:56.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:56.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:20:56.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:56.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:56.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558573+0000", 2024-09-17T02:20:56.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0660000000000002e-06 2024-09-17T02:20:56.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:56.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558585+0000", 2024-09-17T02:20:56.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1596999999999999e-05 2024-09-17T02:20:56.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:56.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558612+0000", 2024-09-17T02:20:56.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7115999999999999e-05 2024-09-17T02:20:56.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558631+0000", 2024-09-17T02:20:56.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9519999999999999e-05 2024-09-17T02:20:56.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:56.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558783+0000", 2024-09-17T02:20:56.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152025 2024-09-17T02:20:56.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-17T02:20:56.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558798+0000", 2024-09-17T02:20:56.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4966999999999999e-05 2024-09-17T02:20:56.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:56.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.572871+0000", 2024-09-17T02:20:56.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014072782000000001 2024-09-17T02:20:56.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:56.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573153+0000", 2024-09-17T02:20:56.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028214499999999998 2024-09-17T02:20:56.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:56.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573432+0000", 2024-09-17T02:20:56.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027932100000000002 2024-09-17T02:20:56.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:56.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582279+0000", 2024-09-17T02:20:56.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0088463310000000007 2024-09-17T02:20:56.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:56.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.589902+0000", 2024-09-17T02:20:56.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0076236050000000003 2024-09-17T02:20:56.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:56.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.589997+0000", 2024-09-17T02:20:56.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4456000000000005e-05 2024-09-17T02:20:56.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:56.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590174+0000", 2024-09-17T02:20:56.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000177336 2024-09-17T02:20:56.981 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:56.981 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:56.981 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:56.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.982 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:56.982 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:20:56.982 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.382693641000003, 2024-09-17T02:20:56.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031899064999999997, 2024-09-17T02:20:56.982 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:56.982 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:56.982 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:56.982 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:56.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:56.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:20:56.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:56.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:56.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:20:56.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:56.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:56.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558676+0000", 2024-09-17T02:20:56.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.39e-06 2024-09-17T02:20:56.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:56.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558686+0000", 2024-09-17T02:20:56.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.022e-05 2024-09-17T02:20:56.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:56.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558708+0000", 2024-09-17T02:20:56.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2249999999999999e-05 2024-09-17T02:20:56.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558725+0000", 2024-09-17T02:20:56.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7387000000000001e-05 2024-09-17T02:20:56.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:56.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558940+0000", 2024-09-17T02:20:56.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021453800000000001 2024-09-17T02:20:56.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting_for_map not empty", 2024-09-17T02:20:56.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558951+0000", 2024-09-17T02:20:56.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1303e-05 2024-09-17T02:20:56.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:56.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576237+0000", 2024-09-17T02:20:56.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017285723999999999 2024-09-17T02:20:56.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:56.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576454+0000", 2024-09-17T02:20:56.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021673800000000001 2024-09-17T02:20:56.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:56.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576932+0000", 2024-09-17T02:20:56.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047792700000000001 2024-09-17T02:20:56.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:56.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585689+0000", 2024-09-17T02:20:56.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0087572880000000002 2024-09-17T02:20:56.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:56.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590287+0000", 2024-09-17T02:20:56.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045978060000000003 2024-09-17T02:20:56.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:56.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590447+0000", 2024-09-17T02:20:56.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000160719 2024-09-17T02:20:56.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:56.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590573+0000", 2024-09-17T02:20:56.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012577500000000001 2024-09-17T02:20:56.988 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:56.988 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:56.988 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:56.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.988 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:56.988 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:20:56.988 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.382615671000003, 2024-09-17T02:20:56.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034114029999999997, 2024-09-17T02:20:56.988 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:56.988 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:56.988 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:56.989 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:56.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:56.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:20:56.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:56.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:56.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:20:56.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:56.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:56.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558753+0000", 2024-09-17T02:20:56.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2699999999999999e-06 2024-09-17T02:20:56.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:56.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558769+0000", 2024-09-17T02:20:56.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5906e-05 2024-09-17T02:20:56.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:56.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558791+0000", 2024-09-17T02:20:56.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1342999999999999e-05 2024-09-17T02:20:56.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558806+0000", 2024-09-17T02:20:56.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5829999999999999e-05 2024-09-17T02:20:56.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:56.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584906+0000", 2024-09-17T02:20:56.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026099273999999999 2024-09-17T02:20:56.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:56.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585158+0000", 2024-09-17T02:20:56.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025194600000000002 2024-09-17T02:20:56.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:56.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585368+0000", 2024-09-17T02:20:56.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210068 2024-09-17T02:20:56.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:56.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588098+0000", 2024-09-17T02:20:56.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002730522 2024-09-17T02:20:56.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:56.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592680+0000", 2024-09-17T02:20:56.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045816019999999997 2024-09-17T02:20:56.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:56.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592774+0000", 2024-09-17T02:20:56.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3726000000000004e-05 2024-09-17T02:20:56.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:56.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592866+0000", 2024-09-17T02:20:56.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2542999999999998e-05 2024-09-17T02:20:56.994 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:56.994 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:56.994 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:56.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.994 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:56.994 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:20:56.994 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.382539368000003, 2024-09-17T02:20:56.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031407875000000002, 2024-09-17T02:20:56.994 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:56.994 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:56.995 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:56.995 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:56.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:56.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:20:56.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:56.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:56.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:20:56.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:56.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:56.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558830+0000", 2024-09-17T02:20:56.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3599999999999999e-06 2024-09-17T02:20:56.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:56.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558835+0000", 2024-09-17T02:20:56.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6130000000000003e-06 2024-09-17T02:20:56.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:56.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558853+0000", 2024-09-17T02:20:56.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8099999999999999e-05 2024-09-17T02:20:56.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:56.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558869+0000", 2024-09-17T02:20:56.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.59e-05 2024-09-17T02:20:56.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:56.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560437+0000", 2024-09-17T02:20:56.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015677989999999999 2024-09-17T02:20:56.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-17T02:20:56.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560453+0000", 2024-09-17T02:20:56.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.535e-05 2024-09-17T02:20:56.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:56.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562422+0000", 2024-09-17T02:20:56.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00196934 2024-09-17T02:20:56.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:56.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562773+0000", 2024-09-17T02:20:56.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035152399999999998 2024-09-17T02:20:56.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:56.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590236+0000", 2024-09-17T02:20:56.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.027462889000000001 2024-09-17T02:20:56.999 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:56.999 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:56.999 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:56.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:56.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:56.999 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:57.000 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.560079+0000", 2024-09-17T02:20:57.000 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.381288873000003, 2024-09-17T02:20:57.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016073831, 2024-09-17T02:20:57.000 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:57.000 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:57.000 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:20:57.000 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:57.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:57.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560079+0000", 2024-09-17T02:20:57.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:57.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:57.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560079+0000", 2024-09-17T02:20:57.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:57.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:57.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560081+0000", 2024-09-17T02:20:57.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.266e-06 2024-09-17T02:20:57.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:57.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560090+0000", 2024-09-17T02:20:57.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2129999999999997e-06 2024-09-17T02:20:57.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:57.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560119+0000", 2024-09-17T02:20:57.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8932999999999999e-05 2024-09-17T02:20:57.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:57.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560145+0000", 2024-09-17T02:20:57.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6020000000000002e-05 2024-09-17T02:20:57.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:57.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.561833+0000", 2024-09-17T02:20:57.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016875659999999999 2024-09-17T02:20:57.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:57.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562199+0000", 2024-09-17T02:20:57.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036619000000000002 2024-09-17T02:20:57.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:57.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576153+0000", 2024-09-17T02:20:57.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013953643 2024-09-17T02:20:57.004 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:57.004 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:57.004 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:57.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.004 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:24 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'1, mlcod=0'0)", 2024-09-17T02:20:57.004 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.568621+0000", 2024-09-17T02:20:57.004 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.372746771000003, 2024-09-17T02:20:57.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015593332, 2024-09-17T02:20:57.004 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:57.005 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:57.005 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:57.005 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:57.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:57.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568621+0000", 2024-09-17T02:20:57.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:57.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:57.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568621+0000", 2024-09-17T02:20:57.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:57.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:57.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568622+0000", 2024-09-17T02:20:57.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1570000000000001e-06 2024-09-17T02:20:57.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:57.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568633+0000", 2024-09-17T02:20:57.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1093e-05 2024-09-17T02:20:57.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:57.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568654+0000", 2024-09-17T02:20:57.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1132999999999999e-05 2024-09-17T02:20:57.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:57.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568670+0000", 2024-09-17T02:20:57.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5307000000000001e-05 2024-09-17T02:20:57.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:57.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570935+0000", 2024-09-17T02:20:57.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022651609999999999 2024-09-17T02:20:57.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:57.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570980+0000", 2024-09-17T02:20:57.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5170000000000003e-05 2024-09-17T02:20:57.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:57.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584128+0000", 2024-09-17T02:20:57.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013148388 2024-09-17T02:20:57.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:57.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584214+0000", 2024-09-17T02:20:57.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5922999999999997e-05 2024-09-17T02:20:57.008 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:57.009 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:57.009 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:57.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.009 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:25 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'2, mlcod=0'0)", 2024-09-17T02:20:57.009 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.568721+0000", 2024-09-17T02:20:57.009 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.372646854999999, 2024-09-17T02:20:57.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015657030999999998, 2024-09-17T02:20:57.009 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:57.009 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:57.009 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:57.009 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:57.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:57.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568721+0000", 2024-09-17T02:20:57.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:57.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:57.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568721+0000", 2024-09-17T02:20:57.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:57.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:57.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568722+0000", 2024-09-17T02:20:57.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5600000000000004e-07 2024-09-17T02:20:57.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:57.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568742+0000", 2024-09-17T02:20:57.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0506999999999999e-05 2024-09-17T02:20:57.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:57.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568762+0000", 2024-09-17T02:20:57.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9423e-05 2024-09-17T02:20:57.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:57.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568777+0000", 2024-09-17T02:20:57.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5457000000000001e-05 2024-09-17T02:20:57.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:57.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.571705+0000", 2024-09-17T02:20:57.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029280130000000001 2024-09-17T02:20:57.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:57.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.571787+0000", 2024-09-17T02:20:57.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1509999999999997e-05 2024-09-17T02:20:57.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:57.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584296+0000", 2024-09-17T02:20:57.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012509398999999999 2024-09-17T02:20:57.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:57.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584378+0000", 2024-09-17T02:20:57.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1866000000000005e-05 2024-09-17T02:20:57.013 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:57.013 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:57.014 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:57.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.014 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:7 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'2, mlcod=0'0)", 2024-09-17T02:20:57.014 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.569013+0000", 2024-09-17T02:20:57.014 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.372354934000001, 2024-09-17T02:20:57.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015831576999999999, 2024-09-17T02:20:57.014 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:57.014 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:57.014 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:57.014 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:57.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:57.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569013+0000", 2024-09-17T02:20:57.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:57.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:57.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569013+0000", 2024-09-17T02:20:57.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:57.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:57.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569014+0000", 2024-09-17T02:20:57.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6000000000000002e-07 2024-09-17T02:20:57.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:57.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569024+0000", 2024-09-17T02:20:57.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8369999999999992e-06 2024-09-17T02:20:57.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:57.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570016+0000", 2024-09-17T02:20:57.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00099277000000000002 2024-09-17T02:20:57.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:57.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570040+0000", 2024-09-17T02:20:57.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3790000000000001e-05 2024-09-17T02:20:57.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:57.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570154+0000", 2024-09-17T02:20:57.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113689 2024-09-17T02:20:57.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:57.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570208+0000", 2024-09-17T02:20:57.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4305999999999998e-05 2024-09-17T02:20:57.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:57.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.583286+0000", 2024-09-17T02:20:57.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013077945000000001 2024-09-17T02:20:57.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:57.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584844+0000", 2024-09-17T02:20:57.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015583800000000001 2024-09-17T02:20:57.019 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:57.019 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:57.019 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:57.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.019 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:1248 5.e 5:7f482265:::benchmark_data_smithi001_23533_object1247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:20:57.019 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:33.170647+0000", 2024-09-17T02:20:57.019 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 23.770720451999999, 2024-09-17T02:20:57.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015727534000000001, 2024-09-17T02:20:57.020 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:57.020 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:57.020 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:57.020 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:57.020 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:57.020 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:57.020 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1248 2024-09-17T02:20:57.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.020 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:57.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:57.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170647+0000", 2024-09-17T02:20:57.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:57.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:57.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170647+0000", 2024-09-17T02:20:57.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:57.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:57.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170648+0000", 2024-09-17T02:20:57.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4000000000000002e-07 2024-09-17T02:20:57.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:57.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170691+0000", 2024-09-17T02:20:57.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2722000000000002e-05 2024-09-17T02:20:57.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:57.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170699+0000", 2024-09-17T02:20:57.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1540000000000002e-06 2024-09-17T02:20:57.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:57.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170704+0000", 2024-09-17T02:20:57.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1290000000000004e-06 2024-09-17T02:20:57.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:57.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.171489+0000", 2024-09-17T02:20:57.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00078564599999999998 2024-09-17T02:20:57.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:57.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.171653+0000", 2024-09-17T02:20:57.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163027 2024-09-17T02:20:57.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:57.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.171797+0000", 2024-09-17T02:20:57.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000144828 2024-09-17T02:20:57.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:57.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.172344+0000", 2024-09-17T02:20:57.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054687599999999996 2024-09-17T02:20:57.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:57.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.186281+0000", 2024-09-17T02:20:57.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013936755 2024-09-17T02:20:57.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:57.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.186338+0000", 2024-09-17T02:20:57.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6598000000000003e-05 2024-09-17T02:20:57.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:57.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.186375+0000", 2024-09-17T02:20:57.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7258999999999997e-05 2024-09-17T02:20:57.026 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:57.026 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:57.026 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:57.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.026 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28720 5.f e28/22 5:f8a7aea5:::benchmark_data_smithi001_23533_object28719:head v 28'1756, mlcod=28'1754)", 2024-09-17T02:20:57.026 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:20:57.026 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.371247871, 2024-09-17T02:20:57.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033308717000000002, 2024-09-17T02:20:57.027 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:57.027 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:57.027 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:57.027 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:57.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:57.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:20:57.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:57.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:57.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:20:57.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:57.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:57.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570121+0000", 2024-09-17T02:20:57.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4e-07 2024-09-17T02:20:57.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:57.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570208+0000", 2024-09-17T02:20:57.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6945000000000002e-05 2024-09-17T02:20:57.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:57.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570222+0000", 2024-09-17T02:20:57.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4541e-05 2024-09-17T02:20:57.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:57.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570232+0000", 2024-09-17T02:20:57.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3039999999999994e-06 2024-09-17T02:20:57.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:57.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570273+0000", 2024-09-17T02:20:57.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1950999999999999e-05 2024-09-17T02:20:57.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:57.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570286+0000", 2024-09-17T02:20:57.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2268e-05 2024-09-17T02:20:57.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:57.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603312+0000", 2024-09-17T02:20:57.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033026405000000002 2024-09-17T02:20:57.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:57.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603429+0000", 2024-09-17T02:20:57.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116463 2024-09-17T02:20:57.031 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:57.031 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:57.031 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:57.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.031 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28721 5.a e28/22 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head v 28'1872, mlcod=28'1869)", 2024-09-17T02:20:57.031 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:20:57.031 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.371104365000001, 2024-09-17T02:20:57.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033539817999999999, 2024-09-17T02:20:57.031 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:57.032 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:57.032 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:57.032 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:57.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:57.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:20:57.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:57.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:57.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:20:57.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:57.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:57.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570264+0000", 2024-09-17T02:20:57.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0999999999999997e-07 2024-09-17T02:20:57.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:57.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570299+0000", 2024-09-17T02:20:57.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4876999999999998e-05 2024-09-17T02:20:57.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:57.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570310+0000", 2024-09-17T02:20:57.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0958000000000001e-05 2024-09-17T02:20:57.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:57.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570316+0000", 2024-09-17T02:20:57.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.485e-06 2024-09-17T02:20:57.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:57.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598947+0000", 2024-09-17T02:20:57.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.028631058000000001 2024-09-17T02:20:57.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:57.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598969+0000", 2024-09-17T02:20:57.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2005999999999999e-05 2024-09-17T02:20:57.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:57.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.602638+0000", 2024-09-17T02:20:57.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036690339999999998 2024-09-17T02:20:57.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:57.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603803+0000", 2024-09-17T02:20:57.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00116559 2024-09-17T02:20:57.035 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:57.036 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:57.036 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:57.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.036 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28723 5.f e28/22 5:f1a2a8f6:::benchmark_data_smithi001_23533_object28722:head v 28'1757, mlcod=28'1754)", 2024-09-17T02:20:57.036 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.571446+0000", 2024-09-17T02:20:57.036 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.369922037, 2024-09-17T02:20:57.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.032047203000000003, 2024-09-17T02:20:57.036 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:57.036 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:57.036 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:57.036 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:57.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:57.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571446+0000", 2024-09-17T02:20:57.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:57.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:57.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571446+0000", 2024-09-17T02:20:57.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:57.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:57.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571447+0000", 2024-09-17T02:20:57.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0979999999999999e-06 2024-09-17T02:20:57.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:57.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571554+0000", 2024-09-17T02:20:57.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107464 2024-09-17T02:20:57.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:57.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598891+0000", 2024-09-17T02:20:57.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.027336905000000002 2024-09-17T02:20:57.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:57.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598905+0000", 2024-09-17T02:20:57.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:20:57.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:57.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.600343+0000", 2024-09-17T02:20:57.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014382100000000001 2024-09-17T02:20:57.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:57.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.600387+0000", 2024-09-17T02:20:57.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3398e-05 2024-09-17T02:20:57.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:57.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603443+0000", 2024-09-17T02:20:57.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030562250000000001 2024-09-17T02:20:57.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:57.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603493+0000", 2024-09-17T02:20:57.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9820000000000001e-05 2024-09-17T02:20:57.040 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:57.040 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:57.040 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:57.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.041 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:40724 5.e 5:78fee04a:::benchmark_data_smithi001_23533_object40723:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:57.041 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:47.033267+0000", 2024-09-17T02:20:57.041 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.9081004509999993, 2024-09-17T02:20:57.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015687298999999998, 2024-09-17T02:20:57.041 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:57.041 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:57.041 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:57.041 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:57.041 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:57.041 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:57.041 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 40724 2024-09-17T02:20:57.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.041 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:57.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:57.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033267+0000", 2024-09-17T02:20:57.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:57.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:57.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033267+0000", 2024-09-17T02:20:57.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:57.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:57.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033268+0000", 2024-09-17T02:20:57.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.119e-06 2024-09-17T02:20:57.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:57.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033371+0000", 2024-09-17T02:20:57.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010283100000000001 2024-09-17T02:20:57.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:57.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033382+0000", 2024-09-17T02:20:57.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0655e-05 2024-09-17T02:20:57.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:57.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033389+0000", 2024-09-17T02:20:57.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2880000000000004e-06 2024-09-17T02:20:57.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:57.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033467+0000", 2024-09-17T02:20:57.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8091999999999997e-05 2024-09-17T02:20:57.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:57.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033660+0000", 2024-09-17T02:20:57.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019242799999999999 2024-09-17T02:20:57.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:57.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033807+0000", 2024-09-17T02:20:57.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000147436 2024-09-17T02:20:57.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:57.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.035370+0000", 2024-09-17T02:20:57.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001563257 2024-09-17T02:20:57.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:57.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.048889+0000", 2024-09-17T02:20:57.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013518835 2024-09-17T02:20:57.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:57.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.048925+0000", 2024-09-17T02:20:57.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5645000000000002e-05 2024-09-17T02:20:57.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:57.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.048955+0000", 2024-09-17T02:20:57.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9713000000000002e-05 2024-09-17T02:20:57.047 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:57.047 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:57.047 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:57.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.047 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:40730 5.b 5:d64b1dc0:::benchmark_data_smithi001_23533_object40729:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:57.048 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:20:57.048 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.9036001989999995, 2024-09-17T02:20:57.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016675972000000001, 2024-09-17T02:20:57.048 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:57.048 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:57.048 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:57.048 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:57.048 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:57.048 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:57.048 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 40730 2024-09-17T02:20:57.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.048 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:57.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:57.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:20:57.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:57.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:57.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:20:57.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:57.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:57.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:20:57.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5700000000000002e-07 2024-09-17T02:20:57.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:57.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037813+0000", 2024-09-17T02:20:57.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4880999999999999e-05 2024-09-17T02:20:57.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:57.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037820+0000", 2024-09-17T02:20:57.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.34e-06 2024-09-17T02:20:57.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:57.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037825+0000", 2024-09-17T02:20:57.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1420000000000003e-06 2024-09-17T02:20:57.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:57.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.039167+0000", 2024-09-17T02:20:57.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013427529999999999 2024-09-17T02:20:57.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:57.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.039293+0000", 2024-09-17T02:20:57.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000125248 2024-09-17T02:20:57.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:57.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.039442+0000", 2024-09-17T02:20:57.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014929799999999999 2024-09-17T02:20:57.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:57.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.041694+0000", 2024-09-17T02:20:57.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002252324 2024-09-17T02:20:57.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:57.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054324+0000", 2024-09-17T02:20:57.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012629782000000001 2024-09-17T02:20:57.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:57.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054393+0000", 2024-09-17T02:20:57.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9295999999999995e-05 2024-09-17T02:20:57.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:57.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054444+0000", 2024-09-17T02:20:57.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0250999999999997e-05 2024-09-17T02:20:57.054 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:57.054 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:57.054 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:57.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.054 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:40735 5.b 5:df8fd62b:::benchmark_data_smithi001_23533_object40734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:20:57.054 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:47.038253+0000", 2024-09-17T02:20:57.054 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.9031144990000008, 2024-09-17T02:20:57.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016368369000000001, 2024-09-17T02:20:57.054 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:57.054 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:57.054 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:57.054 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:57.054 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:57.055 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:57.055 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 40735 2024-09-17T02:20:57.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.055 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:57.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:57.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038253+0000", 2024-09-17T02:20:57.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:57.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:57.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038253+0000", 2024-09-17T02:20:57.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:57.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:57.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038254+0000", 2024-09-17T02:20:57.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.23e-07 2024-09-17T02:20:57.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:57.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038420+0000", 2024-09-17T02:20:57.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016617499999999999 2024-09-17T02:20:57.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:57.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038432+0000", 2024-09-17T02:20:57.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1406000000000001e-05 2024-09-17T02:20:57.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:57.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038439+0000", 2024-09-17T02:20:57.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7200000000000006e-06 2024-09-17T02:20:57.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:57.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.040422+0000", 2024-09-17T02:20:57.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019828530000000001 2024-09-17T02:20:57.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:57.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.040581+0000", 2024-09-17T02:20:57.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159238 2024-09-17T02:20:57.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:57.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.040744+0000", 2024-09-17T02:20:57.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016255800000000001 2024-09-17T02:20:57.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:57.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.041971+0000", 2024-09-17T02:20:57.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001226551 2024-09-17T02:20:57.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:57.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054500+0000", 2024-09-17T02:20:57.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012529676 2024-09-17T02:20:57.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:57.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054570+0000", 2024-09-17T02:20:57.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9253999999999998e-05 2024-09-17T02:20:57.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:57.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054622+0000", 2024-09-17T02:20:57.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2114999999999998e-05 2024-09-17T02:20:57.060 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:57.060 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:57.060 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:57.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.060 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:62017 5.4 5:2a6cfba0:::benchmark_data_smithi001_23533_object62016:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-17T02:20:57.060 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:56.194041+0000", 2024-09-17T02:20:57.060 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.74732702200000001, 2024-09-17T02:20:57.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015580396, 2024-09-17T02:20:57.060 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:20:57.060 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:20:57.060 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:57.060 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:20:57.060 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:20:57.061 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:57.061 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 62017 2024-09-17T02:20:57.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.061 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:20:57.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:20:57.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.194041+0000", 2024-09-17T02:20:57.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:57.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:20:57.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.194041+0000", 2024-09-17T02:20:57.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:20:57.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:20:57.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.194042+0000", 2024-09-17T02:20:57.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.206e-06 2024-09-17T02:20:57.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:20:57.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.194107+0000", 2024-09-17T02:20:57.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4673999999999998e-05 2024-09-17T02:20:57.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:20:57.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.194118+0000", 2024-09-17T02:20:57.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1664999999999999e-05 2024-09-17T02:20:57.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:20:57.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.194125+0000", 2024-09-17T02:20:57.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3659999999999997e-06 2024-09-17T02:20:57.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:20:57.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.197383+0000", 2024-09-17T02:20:57.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032579940000000002 2024-09-17T02:20:57.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:20:57.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.197628+0000", 2024-09-17T02:20:57.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024552999999999999 2024-09-17T02:20:57.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:57.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.197891+0000", 2024-09-17T02:20:57.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000263124 2024-09-17T02:20:57.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:20:57.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.200593+0000", 2024-09-17T02:20:57.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027021010000000002 2024-09-17T02:20:57.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:57.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.209517+0000", 2024-09-17T02:20:57.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0089234080000000007 2024-09-17T02:20:57.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:20:57.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.209573+0000", 2024-09-17T02:20:57.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5720999999999997e-05 2024-09-17T02:20:57.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:20:57.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:20:57.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:20:57.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:56.209621+0000", 2024-09-17T02:20:57.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8606999999999997e-05 2024-09-17T02:20:57.066 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:57.066 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:57.066 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:57.066 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:20:57.066 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:20:57.066 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:20:57.066 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:20:57.068 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:57.071+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:57.069 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:20:57.169 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:57.172+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:57.196 INFO:teuthology.orchestra.run.smithi001.stderr:nodeep-scrub is set 2024-09-17T02:20:57.228 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:20:57.228 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:20:57.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.228 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:64260 5.a 5:566825a2:::benchmark_data_smithi001_23533_object64259:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-17T02:20:57.228 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:57.224189+0000", 2024-09-17T02:20:57.228 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0079213319999999997, 2024-09-17T02:20:57.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079484959999999993, 2024-09-17T02:20:57.228 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:57.228 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:57.228 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:57.228 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:57.229 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:57.229 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:57.229 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 64260 2024-09-17T02:20:57.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.229 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:57.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:57.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.224189+0000", 2024-09-17T02:20:57.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:57.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:57.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.224189+0000", 2024-09-17T02:20:57.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:57.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:57.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.224190+0000", 2024-09-17T02:20:57.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0899999999999999e-06 2024-09-17T02:20:57.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:57.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.224266+0000", 2024-09-17T02:20:57.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6254999999999994e-05 2024-09-17T02:20:57.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:57.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.224278+0000", 2024-09-17T02:20:57.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.184e-05 2024-09-17T02:20:57.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:57.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.224285+0000", 2024-09-17T02:20:57.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.759e-06 2024-09-17T02:20:57.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:57.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.225587+0000", 2024-09-17T02:20:57.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013018140000000001 2024-09-17T02:20:57.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:57.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.225670+0000", 2024-09-17T02:20:57.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2942000000000006e-05 2024-09-17T02:20:57.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:57.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.225751+0000", 2024-09-17T02:20:57.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1496999999999996e-05 2024-09-17T02:20:57.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:57.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.229426+0000", 2024-09-17T02:20:57.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003674797 2024-09-17T02:20:57.233 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:57.233 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:57.233 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:57.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.233 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:64262 5.a 5:5c370b44:::benchmark_data_smithi001_23533_object64261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-17T02:20:57.233 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:57.225286+0000", 2024-09-17T02:20:57.233 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0068240469999999998, 2024-09-17T02:20:57.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069332780000000002, 2024-09-17T02:20:57.233 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:57.233 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:57.233 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 64262 2024-09-17T02:20:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.225286+0000", 2024-09-17T02:20:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.225286+0000", 2024-09-17T02:20:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.225287+0000", 2024-09-17T02:20:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.09e-07 2024-09-17T02:20:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.225357+0000", 2024-09-17T02:20:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9777999999999995e-05 2024-09-17T02:20:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.225369+0000", 2024-09-17T02:20:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2147000000000001e-05 2024-09-17T02:20:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.225378+0000", 2024-09-17T02:20:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1579999999999994e-06 2024-09-17T02:20:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.227266+0000", 2024-09-17T02:20:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018874289999999999 2024-09-17T02:20:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.227348+0000", 2024-09-17T02:20:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2622999999999998e-05 2024-09-17T02:20:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.227459+0000", 2024-09-17T02:20:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000110575 2024-09-17T02:20:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.230899+0000", 2024-09-17T02:20:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034404380000000001 2024-09-17T02:20:57.238 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:57.238 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:57.238 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:57.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.238 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:64265 5.0 5:0443503e:::benchmark_data_smithi001_23533_object64264:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-17T02:20:57.238 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:57.227720+0000", 2024-09-17T02:20:57.238 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0043901390000000004, 2024-09-17T02:20:57.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045738489999999996, 2024-09-17T02:20:57.238 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:57.238 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:57.238 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:57.238 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:57.238 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:57.239 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:57.239 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 64265 2024-09-17T02:20:57.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.239 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:57.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:57.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.227720+0000", 2024-09-17T02:20:57.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:57.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:57.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.227720+0000", 2024-09-17T02:20:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.227721+0000", 2024-09-17T02:20:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8100000000000001e-07 2024-09-17T02:20:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.227850+0000", 2024-09-17T02:20:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012893299999999999 2024-09-17T02:20:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.227858+0000", 2024-09-17T02:20:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7540000000000006e-06 2024-09-17T02:20:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.227863+0000", 2024-09-17T02:20:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6569999999999996e-06 2024-09-17T02:20:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.227919+0000", 2024-09-17T02:20:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6582000000000001e-05 2024-09-17T02:20:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.228017+0000", 2024-09-17T02:20:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8095000000000002e-05 2024-09-17T02:20:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.228104+0000", 2024-09-17T02:20:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6637000000000004e-05 2024-09-17T02:20:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.231142+0000", 2024-09-17T02:20:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030377830000000001 2024-09-17T02:20:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:64266 5.6 5:6bebd3c5:::benchmark_data_smithi001_23533_object64265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-17T02:20:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:57.227880+0000", 2024-09-17T02:20:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0042304270000000001, 2024-09-17T02:20:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045397889999999998, 2024-09-17T02:20:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 64266 2024-09-17T02:20:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.227880+0000", 2024-09-17T02:20:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.227880+0000", 2024-09-17T02:20:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:57.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.227880+0000", 2024-09-17T02:20:57.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.63e-07 2024-09-17T02:20:57.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:57.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.227919+0000", 2024-09-17T02:20:57.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8529000000000003e-05 2024-09-17T02:20:57.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:57.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.227930+0000", 2024-09-17T02:20:57.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0906e-05 2024-09-17T02:20:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.227936+0000", 2024-09-17T02:20:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9939999999999997e-06 2024-09-17T02:20:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.227986+0000", 2024-09-17T02:20:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0475e-05 2024-09-17T02:20:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.228111+0000", 2024-09-17T02:20:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012436000000000001 2024-09-17T02:20:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.228252+0000", 2024-09-17T02:20:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014116000000000001 2024-09-17T02:20:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:64264 5.b e34/22 5:da3e858a:::benchmark_data_smithi001_23533_object64263:head v 34'3960, mlcod=33'3956)", 2024-09-17T02:20:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:57.228234+0000", 2024-09-17T02:20:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0038767319999999999, 2024-09-17T02:20:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042509669999999996, 2024-09-17T02:20:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.228234+0000", 2024-09-17T02:20:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.228234+0000", 2024-09-17T02:20:57.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:57.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:57.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.228234+0000", 2024-09-17T02:20:57.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6499999999999999e-07 2024-09-17T02:20:57.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:57.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.228304+0000", 2024-09-17T02:20:57.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0203999999999994e-05 2024-09-17T02:20:57.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:57.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.228313+0000", 2024-09-17T02:20:57.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7450000000000001e-06 2024-09-17T02:20:57.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:57.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.228319+0000", 2024-09-17T02:20:57.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8069999999999996e-06 2024-09-17T02:20:57.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:57.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.228948+0000", 2024-09-17T02:20:57.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00062938999999999996 2024-09-17T02:20:57.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:57.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.228963+0000", 2024-09-17T02:20:57.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4634000000000001e-05 2024-09-17T02:20:57.251 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:57.251 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:57.251 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:57.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.251 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:64269 5.c 5:3fe51d0b:::benchmark_data_smithi001_23533_object64268:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-17T02:20:57.251 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:57.228954+0000", 2024-09-17T02:20:57.252 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0031560199999999998, 2024-09-17T02:20:57.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003586325, 2024-09-17T02:20:57.252 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:57.252 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:57.252 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:57.252 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:57.252 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:57.252 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:57.252 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 64269 2024-09-17T02:20:57.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.252 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:57.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:57.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.228954+0000", 2024-09-17T02:20:57.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:57.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:57.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.228954+0000", 2024-09-17T02:20:57.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:57.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:57.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.228955+0000", 2024-09-17T02:20:57.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4300000000000003e-07 2024-09-17T02:20:57.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:57.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.228977+0000", 2024-09-17T02:20:57.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2470999999999999e-05 2024-09-17T02:20:57.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:57.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.228985+0000", 2024-09-17T02:20:57.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8539999999999997e-06 2024-09-17T02:20:57.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:57.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.228990+0000", 2024-09-17T02:20:57.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9729999999999997e-06 2024-09-17T02:20:57.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:57.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.229036+0000", 2024-09-17T02:20:57.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6199999999999998e-05 2024-09-17T02:20:57.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:57.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.229211+0000", 2024-09-17T02:20:57.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000174699 2024-09-17T02:20:57.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:20:57.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.229344+0000", 2024-09-17T02:20:57.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013258500000000001 2024-09-17T02:20:57.256 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:57.256 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:57.256 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:57.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.256 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:64270 5.8 5:10bf66e2:::benchmark_data_smithi001_23533_object64269:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-17T02:20:57.256 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:57.229122+0000", 2024-09-17T02:20:57.256 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0029886259999999999, 2024-09-17T02:20:57.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034918179999999998, 2024-09-17T02:20:57.256 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:57.256 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:57.257 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:57.257 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:57.257 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:57.257 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:57.257 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 64270 2024-09-17T02:20:57.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.257 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:57.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:57.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.229122+0000", 2024-09-17T02:20:57.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:57.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:57.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.229122+0000", 2024-09-17T02:20:57.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:57.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:57.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.229122+0000", 2024-09-17T02:20:57.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6800000000000001e-07 2024-09-17T02:20:57.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:57.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.229209+0000", 2024-09-17T02:20:57.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6471999999999995e-05 2024-09-17T02:20:57.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:57.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.229216+0000", 2024-09-17T02:20:57.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2710000000000003e-06 2024-09-17T02:20:57.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:57.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.229220+0000", 2024-09-17T02:20:57.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1529999999999999e-06 2024-09-17T02:20:57.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:57.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.229257+0000", 2024-09-17T02:20:57.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7023000000000001e-05 2024-09-17T02:20:57.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:57.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.229334+0000", 2024-09-17T02:20:57.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6833000000000001e-05 2024-09-17T02:20:57.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:57.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.229444+0000", 2024-09-17T02:20:57.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109726 2024-09-17T02:20:57.260 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:57.260 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:57.260 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:57.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.261 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:64267 5.2 e34/22 5:45a0819c:::benchmark_data_smithi001_23533_object64266:head v 34'4085, mlcod=33'4081)", 2024-09-17T02:20:57.261 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:57.229854+0000", 2024-09-17T02:20:57.261 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0022569109999999999, 2024-09-17T02:20:57.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002835331, 2024-09-17T02:20:57.261 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:57.261 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:57.261 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:57.261 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:57.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:57.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.229854+0000", 2024-09-17T02:20:57.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:57.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:57.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.229854+0000", 2024-09-17T02:20:57.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:57.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:57.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.229854+0000", 2024-09-17T02:20:57.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3300000000000002e-07 2024-09-17T02:20:57.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:57.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.229880+0000", 2024-09-17T02:20:57.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5908999999999999e-05 2024-09-17T02:20:57.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:57.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.229888+0000", 2024-09-17T02:20:57.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2360000000000004e-06 2024-09-17T02:20:57.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:57.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.229895+0000", 2024-09-17T02:20:57.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5230000000000001e-06 2024-09-17T02:20:57.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:57.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.230991+0000", 2024-09-17T02:20:57.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001096372 2024-09-17T02:20:57.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:57.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.231010+0000", 2024-09-17T02:20:57.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9066999999999999e-05 2024-09-17T02:20:57.264 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:57.264 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:57.265 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:57.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.265 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:64268 5.1 e34/22 5:8348bfc1:::benchmark_data_smithi001_23533_object64267:head v 34'3944, mlcod=33'3942)", 2024-09-17T02:20:57.265 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:57.230901+0000", 2024-09-17T02:20:57.265 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00120951, 2024-09-17T02:20:57.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018475880000000001, 2024-09-17T02:20:57.265 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:57.265 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:57.265 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:20:57.265 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:57.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:57.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.230901+0000", 2024-09-17T02:20:57.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:57.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:57.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.230901+0000", 2024-09-17T02:20:57.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:57.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:57.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.230901+0000", 2024-09-17T02:20:57.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0900000000000002e-07 2024-09-17T02:20:57.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:57.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.230943+0000", 2024-09-17T02:20:57.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2089999999999999e-05 2024-09-17T02:20:57.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:57.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.230951+0000", 2024-09-17T02:20:57.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7540000000000006e-06 2024-09-17T02:20:57.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:57.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.230959+0000", 2024-09-17T02:20:57.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6290000000000001e-06 2024-09-17T02:20:57.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:57.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.231015+0000", 2024-09-17T02:20:57.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6548999999999997e-05 2024-09-17T02:20:57.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:57.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.231034+0000", 2024-09-17T02:20:57.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9059000000000002e-05 2024-09-17T02:20:57.268 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:57.268 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:57.268 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:57.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.269 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:64271 5.2 e34/22)", 2024-09-17T02:20:57.269 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:57.230978+0000", 2024-09-17T02:20:57.269 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0011323170000000001, 2024-09-17T02:20:57.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018245220000000001, 2024-09-17T02:20:57.269 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:57.269 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:57.269 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:20:57.269 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:57.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:57.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.230978+0000", 2024-09-17T02:20:57.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:57.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:57.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.230978+0000", 2024-09-17T02:20:57.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:57.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:57.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.230979+0000", 2024-09-17T02:20:57.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.08e-07 2024-09-17T02:20:57.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:57.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.231007+0000", 2024-09-17T02:20:57.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8328000000000001e-05 2024-09-17T02:20:57.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:57.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.231014+0000", 2024-09-17T02:20:57.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5379999999999997e-06 2024-09-17T02:20:57.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:57.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.231020+0000", 2024-09-17T02:20:57.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4489999999999998e-06 2024-09-17T02:20:57.271 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:57.272 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:57.272 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:57.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.272 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:64274 5.8 5:1671e50a:::benchmark_data_smithi001_23533_object64273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-17T02:20:57.272 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:57.231508+0000", 2024-09-17T02:20:57.272 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00060262, 2024-09-17T02:20:57.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013440469999999999, 2024-09-17T02:20:57.272 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:57.272 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:57.272 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:57.272 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:20:57.272 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:20:57.272 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:57.273 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 64274 2024-09-17T02:20:57.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.273 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:57.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:57.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.231508+0000", 2024-09-17T02:20:57.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:57.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:57.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.231508+0000", 2024-09-17T02:20:57.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:57.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:57.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.231509+0000", 2024-09-17T02:20:57.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7699999999999992e-07 2024-09-17T02:20:57.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:57.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.231603+0000", 2024-09-17T02:20:57.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3784999999999997e-05 2024-09-17T02:20:57.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:57.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.231611+0000", 2024-09-17T02:20:57.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7790000000000001e-06 2024-09-17T02:20:57.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:57.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.231616+0000", 2024-09-17T02:20:57.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8450000000000002e-06 2024-09-17T02:20:57.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:20:57.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.231654+0000", 2024-09-17T02:20:57.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8166e-05 2024-09-17T02:20:57.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:20:57.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.231761+0000", 2024-09-17T02:20:57.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106743 2024-09-17T02:20:57.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:57.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.231850+0000", 2024-09-17T02:20:57.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8539000000000001e-05 2024-09-17T02:20:57.276 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:57.276 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:57.276 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:57.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.277 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4466.0:64270 5.8 e34/26)", 2024-09-17T02:20:57.277 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:57.231680+0000", 2024-09-17T02:20:57.277 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.000430937, 2024-09-17T02:20:57.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012501890000000001, 2024-09-17T02:20:57.277 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:57.277 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:57.277 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:20:57.277 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:57.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:57.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.231680+0000", 2024-09-17T02:20:57.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:57.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:57.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.231680+0000", 2024-09-17T02:20:57.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:57.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:57.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.231680+0000", 2024-09-17T02:20:57.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8500000000000001e-07 2024-09-17T02:20:57.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:57.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.231683+0000", 2024-09-17T02:20:57.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.971e-06 2024-09-17T02:20:57.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:57.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.231692+0000", 2024-09-17T02:20:57.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2399999999999996e-06 2024-09-17T02:20:57.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:57.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.231698+0000", 2024-09-17T02:20:57.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5230000000000003e-06 2024-09-17T02:20:57.279 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:57.279 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:57.279 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:57.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.280 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:64272 5.2 e34/22)", 2024-09-17T02:20:57.280 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:57.232351+0000", 2024-09-17T02:20:57.280 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9997592, 2024-09-17T02:20:57.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00062423299999999997, 2024-09-17T02:20:57.280 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:20:57.280 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:20:57.280 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:20:57.280 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:20:57.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:20:57.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.232351+0000", 2024-09-17T02:20:57.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:57.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:20:57.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.232351+0000", 2024-09-17T02:20:57.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:20:57.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:20:57.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.232352+0000", 2024-09-17T02:20:57.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8699999999999995e-07 2024-09-17T02:20:57.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:20:57.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.232403+0000", 2024-09-17T02:20:57.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0889e-05 2024-09-17T02:20:57.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:20:57.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.232411+0000", 2024-09-17T02:20:57.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3869999999999995e-06 2024-09-17T02:20:57.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:20:57.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:20:57.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:20:57.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.232418+0000", 2024-09-17T02:20:57.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.387e-06 2024-09-17T02:20:57.282 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:57.282 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:20:57.282 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:57.282 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:20:57.283 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:20:57.283 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 13 2024-09-17T02:20:57.283 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:20:57.283 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:20:57.283 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:20:57.283 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:20:57.284 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:20:57.284 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:20:57.285 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:20:57.286 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:20:57.288 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:57.287+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:57.387 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:57.388+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:57.442 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:57.442 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:57.463 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:20:57.487 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:57.488+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:57.588 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:57.592+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:57.619 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:57.619 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:57.640 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:20:57.688 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:57.691+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:57.770 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 25 16 65406 65390 163.457 131.125 0.00687538 0.00611306 2024-09-17T02:20:57.790 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:57.791+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:57.803 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:57.803 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:57.827 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:20:57.891 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:57.892+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:57.983 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:57.983 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:57.992 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:57.995+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:58.007 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:20:58.092 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:58.095+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:58.193 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:58.196+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:58.206 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:58.206 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:58.229 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:20:58.294 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:58.295+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:58.392 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:58.392 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:58.397 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:58.399+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:58.415 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:20:58.508 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:58.511+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:58.601 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:58.603+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:58.614 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:58.614 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:58.636 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:20:58.723 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:58.727+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:58.735 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-17T02:20:58.736 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T02:20:58.736 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-09-17T02:20:58.736 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 0.05 2024-09-17T02:20:58.770 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 26 16 67589 67573 162.418 136.438 0.00831464 0.00615206 2024-09-17T02:20:58.803 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:58.807+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:58.838 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:58.838 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:58.857 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:20:58.905 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:58.907+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:59.004 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:59.007+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:59.014 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:59.014 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:59.036 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:20:59.060 INFO:teuthology.orchestra.run.smithi001.stdout:moved 0 / 242 (0%) 2024-09-17T02:20:59.060 INFO:teuthology.orchestra.run.smithi001.stdout:avg 80.6667 2024-09-17T02:20:59.061 INFO:teuthology.orchestra.run.smithi001.stdout:stddev 3.68179 -> 3.68179 (expected baseline 7.33333) 2024-09-17T02:20:59.061 INFO:teuthology.orchestra.run.smithi001.stdout:min osd.0 with 76 -> 76 pgs (0.942149 -> 0.942149 * mean) 2024-09-17T02:20:59.061 INFO:teuthology.orchestra.run.smithi001.stdout:max osd.1 with 85 -> 85 pgs (1.05372 -> 1.05372 * mean) 2024-09-17T02:20:59.061 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:20:59.061 INFO:teuthology.orchestra.run.smithi001.stdout:oload 1000 2024-09-17T02:20:59.061 INFO:teuthology.orchestra.run.smithi001.stdout:max_change 0.05 2024-09-17T02:20:59.061 INFO:teuthology.orchestra.run.smithi001.stdout:max_change_osds 4 2024-09-17T02:20:59.061 INFO:teuthology.orchestra.run.smithi001.stdout:average_utilization 0.0021 2024-09-17T02:20:59.061 INFO:teuthology.orchestra.run.smithi001.stdout:overload_utilization 0.0215 2024-09-17T02:20:59.061 INFO:teuthology.orchestra.run.smithi001.stderr:no change 2024-09-17T02:20:59.080 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-17T02:20:59.080 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 1.0 2024-09-17T02:20:59.104 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:59.108+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:59.205 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:20:59.208+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:20:59.221 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T02:20:59.236 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:59.236 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:59.260 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:20:59.286 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:20:59.307 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:59.311+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:59.408 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:59.411+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:59.414 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:20:59.414 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:20:59.435 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:20:59.435 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:20:59.437 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:20:59.454 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:20:59.455 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:20:59.473 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:20:59.474 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:20:59.509 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:59.510+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:59.593 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:20:59.593 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-17T02:20:59.593 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.593 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:69319 5.1 5:81b35125:::benchmark_data_smithi001_23533_object69318:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-17T02:20:59.593 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:59.589673+0000", 2024-09-17T02:20:59.593 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0072411020000000001, 2024-09-17T02:20:59.593 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072614410000000004, 2024-09-17T02:20:59.593 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:59.594 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:59.594 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:59.594 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:59.594 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:59.594 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:59.594 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 69319 2024-09-17T02:20:59.594 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.594 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:59.594 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.594 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:59.594 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.589673+0000", 2024-09-17T02:20:59.594 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:59.595 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.595 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.595 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:59.595 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.589673+0000", 2024-09-17T02:20:59.595 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:59.595 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.595 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.595 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:59.595 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.589674+0000", 2024-09-17T02:20:59.595 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7700000000000003e-07 2024-09-17T02:20:59.595 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.595 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.595 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:59.595 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.589777+0000", 2024-09-17T02:20:59.596 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010283 2024-09-17T02:20:59.596 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.596 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.596 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:59.596 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.589789+0000", 2024-09-17T02:20:59.596 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2179e-05 2024-09-17T02:20:59.596 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.596 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.596 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:59.596 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.589796+0000", 2024-09-17T02:20:59.596 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8859999999999998e-06 2024-09-17T02:20:59.596 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.596 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.597 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:59.597 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.589845+0000", 2024-09-17T02:20:59.597 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9190999999999997e-05 2024-09-17T02:20:59.597 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.597 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.597 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:59.597 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.589926+0000", 2024-09-17T02:20:59.597 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0778000000000005e-05 2024-09-17T02:20:59.597 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.597 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.597 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:59.597 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.590057+0000", 2024-09-17T02:20:59.597 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013126899999999999 2024-09-17T02:20:59.598 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.598 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.598 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:59.598 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.592697+0000", 2024-09-17T02:20:59.598 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0026399409999999998 2024-09-17T02:20:59.598 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:59.598 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:59.598 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:59.598 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.598 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.598 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:69326 5.1 5:8d2a8ce4:::benchmark_data_smithi001_23533_object69325:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-17T02:20:59.598 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:59.592902+0000", 2024-09-17T02:20:59.598 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0040122279999999996, 2024-09-17T02:20:59.598 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040842980000000001, 2024-09-17T02:20:59.599 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:59.599 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:59.599 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:59.599 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:59.599 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:59.599 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:59.599 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 69326 2024-09-17T02:20:59.599 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.599 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:59.599 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.599 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:59.599 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.592902+0000", 2024-09-17T02:20:59.599 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:59.600 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.600 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.600 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:59.600 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.592902+0000", 2024-09-17T02:20:59.600 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:59.600 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.600 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.600 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:59.600 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.592903+0000", 2024-09-17T02:20:59.600 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.268e-06 2024-09-17T02:20:59.600 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.600 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.600 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:59.600 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.592992+0000", 2024-09-17T02:20:59.601 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9370000000000007e-05 2024-09-17T02:20:59.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.601 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.601 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:59.601 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.593007+0000", 2024-09-17T02:20:59.601 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4997000000000001e-05 2024-09-17T02:20:59.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.601 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.601 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:59.601 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.593015+0000", 2024-09-17T02:20:59.601 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0479999999999999e-06 2024-09-17T02:20:59.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.601 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.602 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:59.602 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.593056+0000", 2024-09-17T02:20:59.602 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0519000000000003e-05 2024-09-17T02:20:59.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.602 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.602 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:59.602 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.593135+0000", 2024-09-17T02:20:59.602 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9401999999999996e-05 2024-09-17T02:20:59.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.602 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.602 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:59.602 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.593217+0000", 2024-09-17T02:20:59.602 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1657999999999996e-05 2024-09-17T02:20:59.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.603 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.603 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:59.603 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.594899+0000", 2024-09-17T02:20:59.603 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001681742 2024-09-17T02:20:59.603 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:59.603 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:59.603 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:59.603 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.603 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.603 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:69327 5.d 5:be21286a:::benchmark_data_smithi001_23533_object69326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-17T02:20:59.603 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:59.594368+0000", 2024-09-17T02:20:59.603 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0025460629999999999, 2024-09-17T02:20:59.604 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0026625730000000001, 2024-09-17T02:20:59.604 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:59.604 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:59.604 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:59.604 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:59.604 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:59.604 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:59.605 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 69327 2024-09-17T02:20:59.605 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.605 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:59.605 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.605 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:59.605 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.594368+0000", 2024-09-17T02:20:59.605 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:59.605 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.605 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.605 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:59.605 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.594368+0000", 2024-09-17T02:20:59.605 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:59.606 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.606 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.606 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:59.606 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.594369+0000", 2024-09-17T02:20:59.606 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2500000000000004e-07 2024-09-17T02:20:59.606 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.606 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.606 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:59.607 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.594468+0000", 2024-09-17T02:20:59.607 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.9575999999999997e-05 2024-09-17T02:20:59.607 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.607 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.607 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:59.607 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.594477+0000", 2024-09-17T02:20:59.607 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.115e-06 2024-09-17T02:20:59.607 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.607 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.607 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:59.607 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.594483+0000", 2024-09-17T02:20:59.607 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1699999999999996e-06 2024-09-17T02:20:59.607 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.607 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.608 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:59.608 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.594648+0000", 2024-09-17T02:20:59.608 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016526400000000001 2024-09-17T02:20:59.608 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.608 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.608 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:59.608 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.594850+0000", 2024-09-17T02:20:59.608 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00020177199999999999 2024-09-17T02:20:59.608 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.608 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.608 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:59.608 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.594993+0000", 2024-09-17T02:20:59.609 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000143833 2024-09-17T02:20:59.609 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:59.609 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:59.609 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:59.609 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.609 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.609 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:69330 5.f 5:f8299170:::benchmark_data_smithi001_23533_object69329:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-17T02:20:59.609 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:59.594645+0000", 2024-09-17T02:20:59.609 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0022687499999999999, 2024-09-17T02:20:59.609 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002429409, 2024-09-17T02:20:59.609 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:59.609 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:59.610 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:59.610 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:59.610 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:59.610 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:59.610 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 69330 2024-09-17T02:20:59.610 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.610 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:59.610 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.610 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:59.610 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.594645+0000", 2024-09-17T02:20:59.610 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:59.610 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.610 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.610 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:59.611 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.594645+0000", 2024-09-17T02:20:59.611 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:59.611 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.611 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.611 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:59.611 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.594646+0000", 2024-09-17T02:20:59.611 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5400000000000001e-07 2024-09-17T02:20:59.611 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.611 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.611 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:59.611 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.594707+0000", 2024-09-17T02:20:59.611 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1298999999999997e-05 2024-09-17T02:20:59.611 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.612 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.612 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:59.612 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.594719+0000", 2024-09-17T02:20:59.612 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1669e-05 2024-09-17T02:20:59.612 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.612 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.612 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:59.612 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.594723+0000", 2024-09-17T02:20:59.612 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5920000000000002e-06 2024-09-17T02:20:59.612 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.612 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.612 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:59.612 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.594775+0000", 2024-09-17T02:20:59.613 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1583999999999999e-05 2024-09-17T02:20:59.613 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.613 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.613 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:59.613 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.594911+0000", 2024-09-17T02:20:59.613 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013643999999999999 2024-09-17T02:20:59.613 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.613 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.613 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:59.613 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.595053+0000", 2024-09-17T02:20:59.613 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014192999999999999 2024-09-17T02:20:59.613 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:59.613 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:59.613 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:59.614 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.614 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.614 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:69331 5.7 5:e1bf0378:::benchmark_data_smithi001_23533_object69330:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-17T02:20:59.614 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:59.594797+0000", 2024-09-17T02:20:59.614 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.002117365, 2024-09-17T02:20:59.614 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023276070000000002, 2024-09-17T02:20:59.614 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:59.614 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:59.614 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:20:59.614 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:59.614 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:20:59.614 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:20:59.614 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 69331 2024-09-17T02:20:59.615 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.615 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:59.615 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.615 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:59.615 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.594797+0000", 2024-09-17T02:20:59.615 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:59.615 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.615 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.615 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:59.615 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.594797+0000", 2024-09-17T02:20:59.615 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:59.615 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.615 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.616 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:59.616 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.594797+0000", 2024-09-17T02:20:59.616 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.5199999999999997e-07 2024-09-17T02:20:59.616 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.616 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.616 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:59.616 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.594823+0000", 2024-09-17T02:20:59.616 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5695999999999999e-05 2024-09-17T02:20:59.616 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.616 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.616 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:59.616 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.594829+0000", 2024-09-17T02:20:59.616 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8270000000000003e-06 2024-09-17T02:20:59.617 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.617 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.617 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:59.617 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.594832+0000", 2024-09-17T02:20:59.617 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6219999999999998e-06 2024-09-17T02:20:59.617 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.617 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.617 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:59.617 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.594866+0000", 2024-09-17T02:20:59.617 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3433000000000003e-05 2024-09-17T02:20:59.617 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.617 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.617 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:59.617 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.594966+0000", 2024-09-17T02:20:59.618 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000100586 2024-09-17T02:20:59.618 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.618 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.618 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:20:59.618 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.595173+0000", 2024-09-17T02:20:59.618 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00020642600000000001 2024-09-17T02:20:59.618 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:59.618 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:59.618 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:59.618 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.618 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.618 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:69329 5.6 e34/22 5:6520b30a:::benchmark_data_smithi001_23533_object69328:head v 34'4328, mlcod=34'4326)", 2024-09-17T02:20:59.618 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:59.595015+0000", 2024-09-17T02:20:59.619 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0018985129999999999, 2024-09-17T02:20:59.619 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021474689999999999, 2024-09-17T02:20:59.619 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:59.619 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:59.619 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:20:59.619 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:59.619 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.619 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:59.619 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.595015+0000", 2024-09-17T02:20:59.619 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:59.619 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.619 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.619 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:59.619 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.595015+0000", 2024-09-17T02:20:59.620 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:59.620 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.620 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.620 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:59.620 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.595016+0000", 2024-09-17T02:20:59.620 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9599999999999999e-07 2024-09-17T02:20:59.620 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.620 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.620 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:59.620 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.595064+0000", 2024-09-17T02:20:59.620 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7698000000000003e-05 2024-09-17T02:20:59.620 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.620 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.621 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:59.621 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.595073+0000", 2024-09-17T02:20:59.621 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1020000000000003e-06 2024-09-17T02:20:59.621 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.621 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.621 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:59.621 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.595079+0000", 2024-09-17T02:20:59.621 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9939999999999997e-06 2024-09-17T02:20:59.621 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.621 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.621 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:59.621 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.595147+0000", 2024-09-17T02:20:59.621 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8089000000000005e-05 2024-09-17T02:20:59.621 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.622 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.622 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:59.622 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:59.595160+0000", 2024-09-17T02:20:59.622 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3465000000000001e-05 2024-09-17T02:20:59.622 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:59.622 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:59.622 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:59.622 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:59.622 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-09-17T02:20:59.622 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 6 2024-09-17T02:20:59.622 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:20:59.624 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:20:59.624 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:59.627+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:59.724 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:59.727+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:59.771 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 27 16 69713 69697 161.318 132.75 0.00859484 0.00619418 2024-09-17T02:20:59.779 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:20:59.779 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-17T02:20:59.779 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-09-17T02:20:59.779 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-09-17T02:20:59.779 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:20:59.798 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:20:59.825 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:20:59.827+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:20:59.926 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:20:59.926+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:20:59.963 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:20:59.964 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-09-17T02:20:59.964 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-09-17T02:20:59.964 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-17T02:20:59.964 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.964 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-17T02:20:59.964 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:20:59.965 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 55.507549621999999, 2024-09-17T02:20:59.965 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.15597325500000001, 2024-09-17T02:20:59.965 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:59.965 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:59.965 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:59.965 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:20:59.965 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4164", 2024-09-17T02:20:59.965 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/201892753", 2024-09-17T02:20:59.965 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 1 2024-09-17T02:20:59.966 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.966 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:59.966 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.966 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:59.966 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:20:59.966 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:59.966 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.966 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.966 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:59.966 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:20:59.967 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:59.967 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.967 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.967 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:59.967 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458359+0000", 2024-09-17T02:20:59.967 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3929999999999998e-06 2024-09-17T02:20:59.967 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.967 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.967 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:59.967 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458373+0000", 2024-09-17T02:20:59.967 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4103e-05 2024-09-17T02:20:59.967 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.968 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.968 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:59.968 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458397+0000", 2024-09-17T02:20:59.968 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.438e-05 2024-09-17T02:20:59.968 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.968 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.968 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:59.968 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458421+0000", 2024-09-17T02:20:59.968 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3655999999999998e-05 2024-09-17T02:20:59.968 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.968 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.969 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:59.969 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458529+0000", 2024-09-17T02:20:59.969 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010752900000000001 2024-09-17T02:20:59.969 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.969 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.969 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:20:59.969 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458542+0000", 2024-09-17T02:20:59.969 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2986999999999999e-05 2024-09-17T02:20:59.969 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.969 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.970 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:59.970 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.611050+0000", 2024-09-17T02:20:59.970 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.1525087 2024-09-17T02:20:59.970 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.970 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.970 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:59.970 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.611529+0000", 2024-09-17T02:20:59.970 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00047844899999999999 2024-09-17T02:20:59.970 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.970 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.971 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:59.971 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.612061+0000", 2024-09-17T02:20:59.971 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00053230300000000003 2024-09-17T02:20:59.971 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.971 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.971 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:59.971 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.613451+0000", 2024-09-17T02:20:59.971 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0013897250000000001 2024-09-17T02:20:59.971 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.971 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.971 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:59.972 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614168+0000", 2024-09-17T02:20:59.972 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00071692499999999998 2024-09-17T02:20:59.972 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.972 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.972 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:59.972 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614265+0000", 2024-09-17T02:20:59.972 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7589000000000004e-05 2024-09-17T02:20:59.972 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.972 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.972 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:59.973 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614330+0000", 2024-09-17T02:20:59.973 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4516000000000004e-05 2024-09-17T02:20:59.973 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:59.973 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:59.973 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:59.973 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.973 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.973 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:59.973 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:20:59.973 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.409618504000001, 2024-09-17T02:20:59.974 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029713927000000001, 2024-09-17T02:20:59.974 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:59.974 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:59.974 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:59.974 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:59.974 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.974 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:59.974 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:20:59.974 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:59.974 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.974 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.974 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:59.975 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:20:59.975 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:59.975 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.975 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.975 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:59.975 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556289+0000", 2024-09-17T02:20:59.975 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.513e-06 2024-09-17T02:20:59.975 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.975 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.976 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:59.976 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556298+0000", 2024-09-17T02:20:59.976 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1630000000000002e-06 2024-09-17T02:20:59.976 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.976 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.976 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:59.976 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556318+0000", 2024-09-17T02:20:59.976 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9389999999999999e-05 2024-09-17T02:20:59.976 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.976 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.977 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:59.977 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556332+0000", 2024-09-17T02:20:59.977 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4506e-05 2024-09-17T02:20:59.977 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.977 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.977 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:59.977 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557304+0000", 2024-09-17T02:20:59.977 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00097169699999999999 2024-09-17T02:20:59.977 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.977 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.977 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:59.978 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557507+0000", 2024-09-17T02:20:59.978 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000203191 2024-09-17T02:20:59.978 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.978 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.978 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:59.978 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557838+0000", 2024-09-17T02:20:59.978 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033061100000000002 2024-09-17T02:20:59.978 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.978 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.978 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:59.978 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562171+0000", 2024-09-17T02:20:59.979 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043329229999999998 2024-09-17T02:20:59.979 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.979 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.979 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:59.979 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585737+0000", 2024-09-17T02:20:59.979 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023565915 2024-09-17T02:20:59.979 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.979 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.979 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:59.979 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585884+0000", 2024-09-17T02:20:59.979 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014744199999999999 2024-09-17T02:20:59.979 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.980 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.980 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:59.980 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586002+0000", 2024-09-17T02:20:59.980 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000117576 2024-09-17T02:20:59.980 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:59.980 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:59.980 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:59.980 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.980 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.980 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:59.980 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:20:59.980 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.409526532000001, 2024-09-17T02:20:59.981 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030933694000000001, 2024-09-17T02:20:59.981 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:59.981 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:59.981 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:59.981 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:59.981 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.981 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:59.981 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:20:59.981 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:59.981 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.981 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.981 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:59.982 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:20:59.982 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:59.982 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.982 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.982 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:59.982 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556381+0000", 2024-09-17T02:20:59.982 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2100000000000001e-06 2024-09-17T02:20:59.982 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.982 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.982 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:59.983 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556389+0000", 2024-09-17T02:20:59.983 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5539999999999998e-06 2024-09-17T02:20:59.983 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.983 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.983 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:59.983 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556408+0000", 2024-09-17T02:20:59.983 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8623000000000001e-05 2024-09-17T02:20:59.983 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.983 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.983 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:59.983 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556427+0000", 2024-09-17T02:20:59.983 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8566000000000001e-05 2024-09-17T02:20:59.983 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.984 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.984 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:59.984 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558741+0000", 2024-09-17T02:20:59.984 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023144390000000002 2024-09-17T02:20:59.984 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.984 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.984 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:59.984 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559040+0000", 2024-09-17T02:20:59.984 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029912100000000001 2024-09-17T02:20:59.984 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.984 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.984 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:59.984 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559222+0000", 2024-09-17T02:20:59.985 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018211200000000001 2024-09-17T02:20:59.985 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.985 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.985 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:59.985 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.566648+0000", 2024-09-17T02:20:59.985 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074257560000000004 2024-09-17T02:20:59.985 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.985 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.985 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:59.985 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587109+0000", 2024-09-17T02:20:59.985 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.020460685999999999 2024-09-17T02:20:59.985 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.985 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.986 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:59.986 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587232+0000", 2024-09-17T02:20:59.986 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123325 2024-09-17T02:20:59.986 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.986 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.986 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:59.986 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587313+0000", 2024-09-17T02:20:59.986 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1302000000000002e-05 2024-09-17T02:20:59.986 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:59.986 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:59.986 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:59.986 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.987 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.987 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:59.987 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:20:59.987 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.409461086, 2024-09-17T02:20:59.987 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031045538000000001, 2024-09-17T02:20:59.987 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:59.987 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:59.987 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:59.987 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:59.987 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.987 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:59.987 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:20:59.987 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:59.988 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.988 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.988 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:59.988 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:20:59.988 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:59.988 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.988 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.988 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:59.988 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556446+0000", 2024-09-17T02:20:59.988 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.26e-06 2024-09-17T02:20:59.988 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.988 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.989 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:59.989 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556454+0000", 2024-09-17T02:20:59.989 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1640000000000004e-06 2024-09-17T02:20:59.989 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.989 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.989 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:59.989 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556471+0000", 2024-09-17T02:20:59.989 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7586000000000001e-05 2024-09-17T02:20:59.989 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.989 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.989 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:59.990 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556485+0000", 2024-09-17T02:20:59.990 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3523000000000001e-05 2024-09-17T02:20:59.990 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.990 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.990 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:59.990 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559899+0000", 2024-09-17T02:20:59.990 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0034142140000000001 2024-09-17T02:20:59.990 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.990 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.991 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:59.991 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.560104+0000", 2024-09-17T02:20:59.991 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00020539199999999999 2024-09-17T02:20:59.991 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.991 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.991 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:59.991 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.560400+0000", 2024-09-17T02:20:59.991 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029612099999999999 2024-09-17T02:20:59.992 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.992 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.992 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:20:59.992 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.568427+0000", 2024-09-17T02:20:59.992 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0080262909999999996 2024-09-17T02:20:59.992 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.992 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.992 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:20:59.992 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587377+0000", 2024-09-17T02:20:59.992 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018950765000000001 2024-09-17T02:20:59.992 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.993 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.993 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:20:59.993 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587445+0000", 2024-09-17T02:20:59.993 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.724e-05 2024-09-17T02:20:59.993 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.993 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.993 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:20:59.993 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587491+0000", 2024-09-17T02:20:59.994 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5982000000000001e-05 2024-09-17T02:20:59.994 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:59.994 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:20:59.994 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:20:59.994 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.994 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.994 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:20:59.994 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:20:59.994 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.409398316000001, 2024-09-17T02:20:59.994 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031435547000000001, 2024-09-17T02:20:59.995 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:20:59.995 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:20:59.995 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:20:59.995 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:20:59.995 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.995 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:20:59.996 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:20:59.996 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:59.996 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.996 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.996 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:20:59.996 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:20:59.996 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:20:59.996 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.996 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.996 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:20:59.996 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556509+0000", 2024-09-17T02:20:59.996 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.06e-06 2024-09-17T02:20:59.997 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.997 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.997 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:20:59.997 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556515+0000", 2024-09-17T02:20:59.997 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1029999999999998e-06 2024-09-17T02:20:59.997 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.997 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.997 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:20:59.997 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556532+0000", 2024-09-17T02:20:59.997 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7054e-05 2024-09-17T02:20:59.998 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.998 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.998 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:20:59.998 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556545+0000", 2024-09-17T02:20:59.998 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3023000000000001e-05 2024-09-17T02:20:59.998 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.998 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.998 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:20:59.998 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561016+0000", 2024-09-17T02:20:59.998 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044705150000000004 2024-09-17T02:20:59.999 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.999 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.999 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:20:59.999 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561316+0000", 2024-09-17T02:20:59.999 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000299895 2024-09-17T02:20:59.999 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:20:59.999 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:20:59.999 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:20:59.999 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561651+0000", 2024-09-17T02:21:00.000 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033519300000000001 2024-09-17T02:21:00.000 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.000 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.000 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:00.000 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571105+0000", 2024-09-17T02:21:00.000 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094540539999999999 2024-09-17T02:21:00.000 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.000 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.001 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.001 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587628+0000", 2024-09-17T02:21:00.001 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016522819000000001 2024-09-17T02:21:00.001 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.001 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.001 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:00.001 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587770+0000", 2024-09-17T02:21:00.002 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000142352 2024-09-17T02:21:00.002 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.002 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.002 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:00.002 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587943+0000", 2024-09-17T02:21:00.002 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017347900000000001 2024-09-17T02:21:00.002 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.002 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:00.002 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.003 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.003 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.003 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:00.003 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:21:00.003 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.409342586000001, 2024-09-17T02:21:00.003 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031809104999999997, 2024-09-17T02:21:00.003 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:00.003 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:00.004 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.004 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:00.004 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.004 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:00.004 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:21:00.004 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.004 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.004 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.004 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:00.005 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:21:00.005 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.005 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.005 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.005 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:00.005 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556565+0000", 2024-09-17T02:21:00.005 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.116e-06 2024-09-17T02:21:00.005 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.005 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.006 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:00.006 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556572+0000", 2024-09-17T02:21:00.006 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0230000000000004e-06 2024-09-17T02:21:00.006 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.006 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.006 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:00.006 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556588+0000", 2024-09-17T02:21:00.006 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6643e-05 2024-09-17T02:21:00.006 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.006 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.006 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.006 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556606+0000", 2024-09-17T02:21:00.007 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7159999999999998e-05 2024-09-17T02:21:00.007 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.007 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.007 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:00.007 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562712+0000", 2024-09-17T02:21:00.007 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0061061630000000004 2024-09-17T02:21:00.007 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.007 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.007 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:00.007 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562919+0000", 2024-09-17T02:21:00.007 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000207309 2024-09-17T02:21:00.008 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.008 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.008 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:00.008 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563264+0000", 2024-09-17T02:21:00.008 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00034490699999999998 2024-09-17T02:21:00.008 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.008 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.008 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:00.008 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571812+0000", 2024-09-17T02:21:00.008 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0085477810000000008 2024-09-17T02:21:00.008 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.009 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.009 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.009 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588094+0000", 2024-09-17T02:21:00.009 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016282443000000001 2024-09-17T02:21:00.009 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.009 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.009 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:00.009 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588275+0000", 2024-09-17T02:21:00.009 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018058700000000001 2024-09-17T02:21:00.009 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.009 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.009 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:00.010 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588373+0000", 2024-09-17T02:21:00.010 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7973000000000005e-05 2024-09-17T02:21:00.010 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.010 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:00.010 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.010 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.010 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.010 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:00.010 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:21:00.010 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.409284487000001, 2024-09-17T02:21:00.010 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031950544999999997, 2024-09-17T02:21:00.011 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:00.011 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:00.011 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.011 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:00.011 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.011 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:00.011 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:21:00.011 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.011 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.011 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.011 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:00.011 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:21:00.011 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.012 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.012 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.012 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:00.013 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556623+0000", 2024-09-17T02:21:00.013 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.04e-06 2024-09-17T02:21:00.013 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.013 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.013 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:00.013 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556631+0000", 2024-09-17T02:21:00.013 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1529999999999997e-06 2024-09-17T02:21:00.013 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.013 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.013 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:00.013 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556648+0000", 2024-09-17T02:21:00.013 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6583999999999999e-05 2024-09-17T02:21:00.013 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.014 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.014 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.014 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556661+0000", 2024-09-17T02:21:00.014 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3203e-05 2024-09-17T02:21:00.014 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.014 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.014 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:00.014 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564413+0000", 2024-09-17T02:21:00.014 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0077523100000000001 2024-09-17T02:21:00.014 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.014 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.014 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:00.014 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.565841+0000", 2024-09-17T02:21:00.015 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014276320000000001 2024-09-17T02:21:00.015 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.015 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.015 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:00.015 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.566131+0000", 2024-09-17T02:21:00.015 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029043800000000001 2024-09-17T02:21:00.015 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.015 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.015 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:00.015 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572353+0000", 2024-09-17T02:21:00.015 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.006222399 2024-09-17T02:21:00.015 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.015 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.016 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.016 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588452+0000", 2024-09-17T02:21:00.016 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016098635 2024-09-17T02:21:00.016 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.016 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.016 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:00.016 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588520+0000", 2024-09-17T02:21:00.016 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8040000000000006e-05 2024-09-17T02:21:00.016 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.016 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.016 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:00.016 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588572+0000", 2024-09-17T02:21:00.016 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2111000000000003e-05 2024-09-17T02:21:00.017 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.017 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:00.017 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.017 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.017 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.017 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:00.017 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:21:00.017 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.409187320999997, 2024-09-17T02:21:00.017 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.032187205000000003, 2024-09-17T02:21:00.017 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:00.017 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:00.017 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.017 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:00.018 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.018 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:00.018 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:21:00.018 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.018 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.018 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.018 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:00.018 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:21:00.018 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.018 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.018 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.018 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:00.018 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556727+0000", 2024-09-17T02:21:00.019 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3000000000000002e-06 2024-09-17T02:21:00.019 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.019 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.019 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:00.019 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556736+0000", 2024-09-17T02:21:00.019 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4300000000000006e-06 2024-09-17T02:21:00.019 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.019 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.019 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:00.019 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556755+0000", 2024-09-17T02:21:00.019 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9700000000000001e-05 2024-09-17T02:21:00.019 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.019 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.019 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.020 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556771+0000", 2024-09-17T02:21:00.020 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5213e-05 2024-09-17T02:21:00.020 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.020 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.020 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:00.020 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571184+0000", 2024-09-17T02:21:00.020 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014413888999999999 2024-09-17T02:21:00.020 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.020 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.020 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:00.020 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571302+0000", 2024-09-17T02:21:00.020 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011794900000000001 2024-09-17T02:21:00.020 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.021 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.021 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:00.021 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571494+0000", 2024-09-17T02:21:00.021 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000191168 2024-09-17T02:21:00.021 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.021 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.021 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:00.021 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.573775+0000", 2024-09-17T02:21:00.021 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002281656 2024-09-17T02:21:00.021 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.021 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.021 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.021 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588668+0000", 2024-09-17T02:21:00.022 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014892699000000001 2024-09-17T02:21:00.022 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.022 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.022 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:00.022 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588813+0000", 2024-09-17T02:21:00.022 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014530700000000001 2024-09-17T02:21:00.022 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.022 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.022 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:00.022 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588906+0000", 2024-09-17T02:21:00.022 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2893999999999995e-05 2024-09-17T02:21:00.023 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.023 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:00.023 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.023 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.023 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.023 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:00.023 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:21:00.023 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.409046156000002, 2024-09-17T02:21:00.023 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028815922000000001, 2024-09-17T02:21:00.023 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:00.023 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:00.023 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.023 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:00.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.024 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:00.024 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:21:00.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.024 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:00.024 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:21:00.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.024 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:00.024 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556861+0000", 2024-09-17T02:21:00.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.08e-06 2024-09-17T02:21:00.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:00.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556867+0000", 2024-09-17T02:21:00.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.207e-06 2024-09-17T02:21:00.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:00.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556886+0000", 2024-09-17T02:21:00.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9137e-05 2024-09-17T02:21:00.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556900+0000", 2024-09-17T02:21:00.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3253e-05 2024-09-17T02:21:00.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:00.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558301+0000", 2024-09-17T02:21:00.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014008320000000001 2024-09-17T02:21:00.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:00.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558564+0000", 2024-09-17T02:21:00.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000263238 2024-09-17T02:21:00.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.027 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:00.027 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558905+0000", 2024-09-17T02:21:00.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000341534 2024-09-17T02:21:00.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.027 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:00.027 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.568208+0000", 2024-09-17T02:21:00.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0093023689999999996 2024-09-17T02:21:00.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.027 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.027 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585379+0000", 2024-09-17T02:21:00.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017171091999999999 2024-09-17T02:21:00.028 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.028 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:00.028 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585509+0000", 2024-09-17T02:21:00.028 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013036100000000001 2024-09-17T02:21:00.028 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.028 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:00.028 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585676+0000", 2024-09-17T02:21:00.028 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016681899999999999 2024-09-17T02:21:00.028 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.028 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:00.028 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.029 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.029 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.029 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:00.029 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:21:00.029 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.408988889, 2024-09-17T02:21:00.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030862568, 2024-09-17T02:21:00.029 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:00.029 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:00.029 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.029 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:00.029 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.029 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:00.029 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:21:00.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.030 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.030 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:00.030 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:21:00.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.030 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.030 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:00.030 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556918+0000", 2024-09-17T02:21:00.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0529999999999999e-06 2024-09-17T02:21:00.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.030 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:00.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556925+0000", 2024-09-17T02:21:00.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.6939999999999998e-06 2024-09-17T02:21:00.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:00.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556942+0000", 2024-09-17T02:21:00.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6803000000000002e-05 2024-09-17T02:21:00.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556955+0000", 2024-09-17T02:21:00.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2659e-05 2024-09-17T02:21:00.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:00.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558237+0000", 2024-09-17T02:21:00.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001282804 2024-09-17T02:21:00.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:00.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558495+0000", 2024-09-17T02:21:00.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000257178 2024-09-17T02:21:00.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:00.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562168+0000", 2024-09-17T02:21:00.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0036737110000000001 2024-09-17T02:21:00.033 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.033 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:00.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.570855+0000", 2024-09-17T02:21:00.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0086868729999999995 2024-09-17T02:21:00.033 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.033 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587568+0000", 2024-09-17T02:21:00.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016712444999999999 2024-09-17T02:21:00.033 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.034 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:00.034 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587677+0000", 2024-09-17T02:21:00.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000109879 2024-09-17T02:21:00.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.034 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:00.034 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587780+0000", 2024-09-17T02:21:00.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000102469 2024-09-17T02:21:00.034 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.034 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:00.034 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.034 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:00.035 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:21:00.035 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.408906756999997, 2024-09-17T02:21:00.035 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031005751000000002, 2024-09-17T02:21:00.035 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:00.035 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:00.035 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.035 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:00.035 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.035 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:00.035 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:21:00.036 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.036 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.036 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.036 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:00.036 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:21:00.036 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.036 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.036 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:00.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557001+0000", 2024-09-17T02:21:00.037 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.237e-06 2024-09-17T02:21:00.037 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:00.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557007+0000", 2024-09-17T02:21:00.037 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7270000000000001e-06 2024-09-17T02:21:00.037 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:00.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557025+0000", 2024-09-17T02:21:00.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7689999999999998e-05 2024-09-17T02:21:00.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557039+0000", 2024-09-17T02:21:00.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.385e-05 2024-09-17T02:21:00.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:00.039 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563783+0000", 2024-09-17T02:21:00.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0067437110000000003 2024-09-17T02:21:00.039 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.039 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:00.039 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564031+0000", 2024-09-17T02:21:00.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00024871799999999999 2024-09-17T02:21:00.039 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.039 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:00.039 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564518+0000", 2024-09-17T02:21:00.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00048708999999999997 2024-09-17T02:21:00.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.040 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:00.040 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572375+0000", 2024-09-17T02:21:00.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078564780000000001 2024-09-17T02:21:00.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.040 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.040 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587862+0000", 2024-09-17T02:21:00.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015486837999999999 2024-09-17T02:21:00.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.040 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:00.041 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587954+0000", 2024-09-17T02:21:00.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1766000000000002e-05 2024-09-17T02:21:00.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.041 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:00.041 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588005+0000", 2024-09-17T02:21:00.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1646e-05 2024-09-17T02:21:00.041 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.041 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:00.041 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.041 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:00.042 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:21:00.042 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.408762461000002, 2024-09-17T02:21:00.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029554871999999999, 2024-09-17T02:21:00.043 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:00.043 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:00.043 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.043 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:00.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:00.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:21:00.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.044 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:00.044 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:21:00.044 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.044 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.044 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:00.044 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557145+0000", 2024-09-17T02:21:00.044 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.263e-06 2024-09-17T02:21:00.044 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.044 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557151+0000", 2024-09-17T02:21:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1040000000000003e-06 2024-09-17T02:21:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557168+0000", 2024-09-17T02:21:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7289999999999999e-05 2024-09-17T02:21:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557182+0000", 2024-09-17T02:21:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.325e-05 2024-09-17T02:21:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.046 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.046 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:00.046 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564102+0000", 2024-09-17T02:21:00.046 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069199860000000004 2024-09-17T02:21:00.046 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.046 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.046 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:00.046 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564438+0000", 2024-09-17T02:21:00.046 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033651800000000001 2024-09-17T02:21:00.046 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.046 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.046 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:00.046 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.565422+0000", 2024-09-17T02:21:00.046 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00098332499999999995 2024-09-17T02:21:00.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:00.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572361+0000", 2024-09-17T02:21:00.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069392630000000002 2024-09-17T02:21:00.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586567+0000", 2024-09-17T02:21:00.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014206107000000001 2024-09-17T02:21:00.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586643+0000", 2024-09-17T02:21:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5673000000000005e-05 2024-09-17T02:21:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586699+0000", 2024-09-17T02:21:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6093e-05 2024-09-17T02:21:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:21:00.049 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.408628769000003, 2024-09-17T02:21:00.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029800569999999998, 2024-09-17T02:21:00.049 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:00.049 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:00.049 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.049 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:00.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.049 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:00.049 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:21:00.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.049 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.049 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:00.050 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:21:00.050 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.050 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.050 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:00.050 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557279+0000", 2024-09-17T02:21:00.050 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.497e-06 2024-09-17T02:21:00.050 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557287+0000", 2024-09-17T02:21:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9030000000000004e-06 2024-09-17T02:21:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557306+0000", 2024-09-17T02:21:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9394000000000001e-05 2024-09-17T02:21:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557323+0000", 2024-09-17T02:21:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6299000000000001e-05 2024-09-17T02:21:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.570931+0000", 2024-09-17T02:21:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013608841999999999 2024-09-17T02:21:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571250+0000", 2024-09-17T02:21:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031817400000000001 2024-09-17T02:21:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571559+0000", 2024-09-17T02:21:00.053 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000309835 2024-09-17T02:21:00.053 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.053 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.053 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:00.053 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.574161+0000", 2024-09-17T02:21:00.053 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002601543 2024-09-17T02:21:00.053 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.053 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.053 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.053 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586866+0000", 2024-09-17T02:21:00.053 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012704968000000001 2024-09-17T02:21:00.053 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.053 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.054 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:00.054 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586987+0000", 2024-09-17T02:21:00.054 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000121369 2024-09-17T02:21:00.054 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.054 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.054 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:00.054 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587078+0000", 2024-09-17T02:21:00.054 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0746000000000002e-05 2024-09-17T02:21:00.054 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.054 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:00.054 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.055 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.055 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.055 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:00.055 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:21:00.055 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.408563125999997, 2024-09-17T02:21:00.055 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029936054, 2024-09-17T02:21:00.055 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:00.055 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:00.055 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.055 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:00.055 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.056 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:00.056 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:21:00.056 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.056 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.056 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:00.056 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:21:00.056 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.056 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.056 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:00.056 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557344+0000", 2024-09-17T02:21:00.056 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.347e-06 2024-09-17T02:21:00.057 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.057 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.057 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:00.057 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557351+0000", 2024-09-17T02:21:00.057 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5560000000000004e-06 2024-09-17T02:21:00.057 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.057 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.057 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:00.057 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557369+0000", 2024-09-17T02:21:00.057 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7703e-05 2024-09-17T02:21:00.057 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.057 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.057 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.058 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557382+0000", 2024-09-17T02:21:00.058 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3664e-05 2024-09-17T02:21:00.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.058 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.058 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:00.058 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558997+0000", 2024-09-17T02:21:00.058 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0016147970000000001 2024-09-17T02:21:00.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.058 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.058 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:00.058 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559236+0000", 2024-09-17T02:21:00.058 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00023900200000000001 2024-09-17T02:21:00.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.058 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:00.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559547+0000", 2024-09-17T02:21:00.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031132399999999998 2024-09-17T02:21:00.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:00.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563130+0000", 2024-09-17T02:21:00.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003582989 2024-09-17T02:21:00.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587069+0000", 2024-09-17T02:21:00.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023938496 2024-09-17T02:21:00.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.060 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.060 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:00.060 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587192+0000", 2024-09-17T02:21:00.060 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123514 2024-09-17T02:21:00.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.060 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.060 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:00.060 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587279+0000", 2024-09-17T02:21:00.060 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6662000000000005e-05 2024-09-17T02:21:00.060 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.060 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:00.060 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.061 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.061 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:00.061 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:21:00.061 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.408505239999997, 2024-09-17T02:21:00.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030490703000000001, 2024-09-17T02:21:00.061 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:00.061 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:00.061 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.061 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:00.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.061 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:00.061 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:21:00.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.062 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.062 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:00.062 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:21:00.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.062 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.062 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:00.062 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557403+0000", 2024-09-17T02:21:00.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.77e-06 2024-09-17T02:21:00.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.062 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.062 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:00.063 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557412+0000", 2024-09-17T02:21:00.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4099999999999997e-06 2024-09-17T02:21:00.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:00.063 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557431+0000", 2024-09-17T02:21:00.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9177e-05 2024-09-17T02:21:00.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.063 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557444+0000", 2024-09-17T02:21:00.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2999999999999999e-05 2024-09-17T02:21:00.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:00.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557722+0000", 2024-09-17T02:21:00.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00027760699999999997 2024-09-17T02:21:00.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:00.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557991+0000", 2024-09-17T02:21:00.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00026892499999999999 2024-09-17T02:21:00.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:00.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558265+0000", 2024-09-17T02:21:00.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000274524 2024-09-17T02:21:00.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.065 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:00.065 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564270+0000", 2024-09-17T02:21:00.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060045339999999997 2024-09-17T02:21:00.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.066 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.066 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587701+0000", 2024-09-17T02:21:00.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023431285999999999 2024-09-17T02:21:00.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.066 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:00.066 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587803+0000", 2024-09-17T02:21:00.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000101371 2024-09-17T02:21:00.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.066 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:00.066 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587892+0000", 2024-09-17T02:21:00.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9098999999999995e-05 2024-09-17T02:21:00.067 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.067 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:00.067 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.067 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:00.067 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:21:00.067 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.408423644000003, 2024-09-17T02:21:00.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029886725999999999, 2024-09-17T02:21:00.067 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:00.067 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:00.067 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:21:00.068 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:00.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.068 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:00.068 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:21:00.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.068 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:00.068 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:21:00.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:00.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557484+0000", 2024-09-17T02:21:00.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.26e-06 2024-09-17T02:21:00.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:00.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557489+0000", 2024-09-17T02:21:00.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2530000000000004e-06 2024-09-17T02:21:00.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:00.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557507+0000", 2024-09-17T02:21:00.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7473999999999999e-05 2024-09-17T02:21:00.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.070 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.070 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557524+0000", 2024-09-17T02:21:00.070 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7912999999999999e-05 2024-09-17T02:21:00.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.070 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:00.070 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572428+0000", 2024-09-17T02:21:00.070 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014903451999999999 2024-09-17T02:21:00.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.070 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:00.070 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572589+0000", 2024-09-17T02:21:00.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000161299 2024-09-17T02:21:00.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.071 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:00.071 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587369+0000", 2024-09-17T02:21:00.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014780075 2024-09-17T02:21:00.071 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.071 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:00.071 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.071 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28720 5.f 5:f8a7aea5:::benchmark_data_smithi001_23533_object28719:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:00.071 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:00.072 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 17.398119329, 2024-09-17T02:21:00.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.033978608, 2024-09-17T02:21:00.072 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:00.072 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:00.072 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.072 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:00.072 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:00.072 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:00.072 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28720 2024-09-17T02:21:00.072 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.072 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:00.072 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.072 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:00.073 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:00.073 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.073 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.073 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:00.073 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:00.073 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.073 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.073 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:00.073 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:00.073 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3200000000000005e-07 2024-09-17T02:21:00.073 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:00.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567856+0000", 2024-09-17T02:21:00.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8596000000000005e-05 2024-09-17T02:21:00.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:00.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567864+0000", 2024-09-17T02:21:00.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6040000000000004e-06 2024-09-17T02:21:00.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567867+0000", 2024-09-17T02:21:00.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7929999999999999e-06 2024-09-17T02:21:00.075 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.075 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:00.075 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567896+0000", 2024-09-17T02:21:00.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8444000000000001e-05 2024-09-17T02:21:00.075 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.075 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:00.075 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567983+0000", 2024-09-17T02:21:00.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7498999999999997e-05 2024-09-17T02:21:00.075 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.075 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:00.076 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568078+0000", 2024-09-17T02:21:00.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5050999999999995e-05 2024-09-17T02:21:00.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:00.076 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573091+0000", 2024-09-17T02:21:00.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050124599999999998 2024-09-17T02:21:00.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.076 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601705+0000", 2024-09-17T02:21:00.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028614298999999999 2024-09-17T02:21:00.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:00.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601741+0000", 2024-09-17T02:21:00.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5329e-05 2024-09-17T02:21:00.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:00.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601766+0000", 2024-09-17T02:21:00.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5001e-05 2024-09-17T02:21:00.077 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.077 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:00.077 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.078 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28723 5.f 5:f1a2a8f6:::benchmark_data_smithi001_23533_object28722:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:00.078 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:21:00.078 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 17.397840648999999, 2024-09-17T02:21:00.078 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.033805288000000003, 2024-09-17T02:21:00.078 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:00.078 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:00.078 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.078 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:00.078 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:00.078 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:00.078 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28723 2024-09-17T02:21:00.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.078 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:00.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.079 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:00.079 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:21:00.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.079 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.079 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:00.079 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:21:00.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.079 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.079 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:00.079 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568067+0000", 2024-09-17T02:21:00.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6700000000000002e-07 2024-09-17T02:21:00.080 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.080 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.080 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:00.080 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568121+0000", 2024-09-17T02:21:00.080 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4286000000000002e-05 2024-09-17T02:21:00.080 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.080 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.080 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:00.080 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568131+0000", 2024-09-17T02:21:00.080 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0288e-05 2024-09-17T02:21:00.080 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.080 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.080 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.081 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568139+0000", 2024-09-17T02:21:00.081 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5399999999999998e-06 2024-09-17T02:21:00.081 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.081 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.081 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:00.081 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569194+0000", 2024-09-17T02:21:00.081 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0010557100000000001 2024-09-17T02:21:00.081 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.081 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.081 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:00.081 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569298+0000", 2024-09-17T02:21:00.081 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000103491 2024-09-17T02:21:00.081 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.081 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.082 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:00.082 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569428+0000", 2024-09-17T02:21:00.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013050599999999999 2024-09-17T02:21:00.082 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.082 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.082 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:00.082 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573124+0000", 2024-09-17T02:21:00.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0036956810000000001 2024-09-17T02:21:00.082 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.082 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.082 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.082 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601801+0000", 2024-09-17T02:21:00.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028676667999999999 2024-09-17T02:21:00.083 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.083 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.083 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:00.083 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601835+0000", 2024-09-17T02:21:00.083 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4347000000000002e-05 2024-09-17T02:21:00.083 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.083 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.083 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:00.083 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601871+0000", 2024-09-17T02:21:00.083 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5803999999999998e-05 2024-09-17T02:21:00.083 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.083 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:00.083 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.084 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.084 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.084 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28729 5.9 5:9e3b1489:::benchmark_data_smithi001_23533_object28728:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:00.084 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:21:00.084 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 17.396221998000001, 2024-09-17T02:21:00.084 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.032738525999999997, 2024-09-17T02:21:00.084 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:00.084 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:00.084 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.084 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:00.084 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:00.084 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:00.084 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28729 2024-09-17T02:21:00.084 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.085 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:00.085 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.085 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:00.085 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:21:00.085 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.085 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.085 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.085 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:00.085 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:21:00.085 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.086 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.086 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.086 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:00.086 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569685+0000", 2024-09-17T02:21:00.086 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8599999999999996e-07 2024-09-17T02:21:00.086 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.086 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.086 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:00.086 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569725+0000", 2024-09-17T02:21:00.086 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0144000000000001e-05 2024-09-17T02:21:00.086 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.086 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.086 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:00.087 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569737+0000", 2024-09-17T02:21:00.087 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1752e-05 2024-09-17T02:21:00.087 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.087 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.087 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.087 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569745+0000", 2024-09-17T02:21:00.087 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6420000000000007e-06 2024-09-17T02:21:00.087 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.087 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.087 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:00.087 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569801+0000", 2024-09-17T02:21:00.087 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6110000000000003e-05 2024-09-17T02:21:00.087 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:00.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569944+0000", 2024-09-17T02:21:00.088 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014361500000000001 2024-09-17T02:21:00.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:00.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.570234+0000", 2024-09-17T02:21:00.088 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00028927899999999998 2024-09-17T02:21:00.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:00.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572606+0000", 2024-09-17T02:21:00.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023725529999999999 2024-09-17T02:21:00.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.089 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.089 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602361+0000", 2024-09-17T02:21:00.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029755031000000001 2024-09-17T02:21:00.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.089 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:00.089 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602397+0000", 2024-09-17T02:21:00.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5509000000000002e-05 2024-09-17T02:21:00.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.089 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:00.090 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602423+0000", 2024-09-17T02:21:00.090 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5905e-05 2024-09-17T02:21:00.090 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.090 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:00.090 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.090 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.090 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.090 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28734 5.f 5:f1a63647:::benchmark_data_smithi001_23533_object28733:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:00.090 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:21:00.090 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 17.394499511999999, 2024-09-17T02:21:00.090 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.034441100000000002, 2024-09-17T02:21:00.090 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:00.090 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:00.091 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.091 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:00.091 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:00.091 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:00.091 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28734 2024-09-17T02:21:00.091 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.091 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:00.091 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.091 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:00.091 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:21:00.091 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.091 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.091 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.091 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:00.092 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:21:00.092 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:00.092 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.092 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.092 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:00.092 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571408+0000", 2024-09-17T02:21:00.092 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.8899999999999998e-07 2024-09-17T02:21:00.092 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.092 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.092 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:00.092 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571464+0000", 2024-09-17T02:21:00.092 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6546999999999999e-05 2024-09-17T02:21:00.092 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.093 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.093 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:00.093 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571474+0000", 2024-09-17T02:21:00.093 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0348e-05 2024-09-17T02:21:00.093 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.093 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.093 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.093 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571480+0000", 2024-09-17T02:21:00.093 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.366e-06 2024-09-17T02:21:00.093 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.093 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.093 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:00.093 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572097+0000", 2024-09-17T02:21:00.094 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061710599999999997 2024-09-17T02:21:00.094 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.094 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.094 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:00.094 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572172+0000", 2024-09-17T02:21:00.094 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4658000000000002e-05 2024-09-17T02:21:00.094 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.094 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.094 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:00.094 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572247+0000", 2024-09-17T02:21:00.094 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5766000000000006e-05 2024-09-17T02:21:00.094 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.094 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.094 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:00.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573819+0000", 2024-09-17T02:21:00.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015713649999999999 2024-09-17T02:21:00.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.095 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605762+0000", 2024-09-17T02:21:00.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031943304999999998 2024-09-17T02:21:00.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.095 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:00.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605808+0000", 2024-09-17T02:21:00.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5776999999999999e-05 2024-09-17T02:21:00.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:00.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:00.096 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:00.096 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605848+0000", 2024-09-17T02:21:00.096 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9972999999999998e-05 2024-09-17T02:21:00.096 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.096 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:00.096 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.096 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:00.096 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:00.096 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:21:00.097 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:00.098+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:00.098 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:00.198 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:00.198+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:00.252 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:00.253 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:00.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.253 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:70711 5.e 5:74a7d1af:::benchmark_data_smithi001_23533_object70710:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-17T02:21:00.253 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:00.250615+0000", 2024-09-17T02:21:00.253 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0071023409999999999, 2024-09-17T02:21:00.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071324400000000003, 2024-09-17T02:21:00.253 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.253 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.253 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:00.253 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:00.253 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:00.253 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:00.254 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 70711 2024-09-17T02:21:00.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.254 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.250615+0000", 2024-09-17T02:21:00.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.250615+0000", 2024-09-17T02:21:00.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.250617+0000", 2024-09-17T02:21:00.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1230000000000001e-06 2024-09-17T02:21:00.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.250652+0000", 2024-09-17T02:21:00.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5070000000000001e-05 2024-09-17T02:21:00.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.250664+0000", 2024-09-17T02:21:00.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2791e-05 2024-09-17T02:21:00.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.250672+0000", 2024-09-17T02:21:00.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8220000000000007e-06 2024-09-17T02:21:00.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.250717+0000", 2024-09-17T02:21:00.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5015000000000002e-05 2024-09-17T02:21:00.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.250809+0000", 2024-09-17T02:21:00.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1503999999999997e-05 2024-09-17T02:21:00.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:00.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.250899+0000", 2024-09-17T02:21:00.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9821000000000006e-05 2024-09-17T02:21:00.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:00.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.253876+0000", 2024-09-17T02:21:00.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029771490000000001 2024-09-17T02:21:00.258 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.258 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.258 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.258 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:70716 5.4 5:296ebc5d:::benchmark_data_smithi001_23533_object70715:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-17T02:21:00.258 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:00.252025+0000", 2024-09-17T02:21:00.258 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0056925409999999997, 2024-09-17T02:21:00.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0058241170000000002, 2024-09-17T02:21:00.258 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.258 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.259 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:00.259 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:00.259 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:00.259 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:00.259 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 70716 2024-09-17T02:21:00.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.259 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.252025+0000", 2024-09-17T02:21:00.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.252025+0000", 2024-09-17T02:21:00.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.252026+0000", 2024-09-17T02:21:00.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4499999999999995e-07 2024-09-17T02:21:00.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.252073+0000", 2024-09-17T02:21:00.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6743000000000003e-05 2024-09-17T02:21:00.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.252084+0000", 2024-09-17T02:21:00.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1137e-05 2024-09-17T02:21:00.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.252093+0000", 2024-09-17T02:21:00.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.602e-06 2024-09-17T02:21:00.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.252930+0000", 2024-09-17T02:21:00.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083762599999999995 2024-09-17T02:21:00.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.253112+0000", 2024-09-17T02:21:00.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018163000000000001 2024-09-17T02:21:00.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:00.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.253306+0000", 2024-09-17T02:21:00.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019403399999999999 2024-09-17T02:21:00.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:00.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.257826+0000", 2024-09-17T02:21:00.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045203930000000002 2024-09-17T02:21:00.263 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.263 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.263 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.263 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:70718 5.4 5:2d98f3db:::benchmark_data_smithi001_23533_object70717:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-17T02:21:00.263 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:00.252961+0000", 2024-09-17T02:21:00.263 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0047569869999999998, 2024-09-17T02:21:00.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004940196, 2024-09-17T02:21:00.263 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.263 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.264 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:00.264 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:00.264 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:00.264 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:00.264 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 70718 2024-09-17T02:21:00.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.264 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.252961+0000", 2024-09-17T02:21:00.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.252961+0000", 2024-09-17T02:21:00.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.252962+0000", 2024-09-17T02:21:00.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0499999999999999e-06 2024-09-17T02:21:00.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.253002+0000", 2024-09-17T02:21:00.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0033000000000001e-05 2024-09-17T02:21:00.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.253013+0000", 2024-09-17T02:21:00.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.15e-05 2024-09-17T02:21:00.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.253024+0000", 2024-09-17T02:21:00.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0657e-05 2024-09-17T02:21:00.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.255395+0000", 2024-09-17T02:21:00.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002371195 2024-09-17T02:21:00.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.255572+0000", 2024-09-17T02:21:00.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0001771 2024-09-17T02:21:00.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:00.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.255761+0000", 2024-09-17T02:21:00.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018888100000000001 2024-09-17T02:21:00.268 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.268 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.268 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.268 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:70717 5.a e34/22 5:5176bc06:::benchmark_data_smithi001_23533_object70716:head v 34'4474, mlcod=34'4472)", 2024-09-17T02:21:00.268 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:00.253418+0000", 2024-09-17T02:21:00.268 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0043001419999999999, 2024-09-17T02:21:00.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045268870000000003, 2024-09-17T02:21:00.268 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.269 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.269 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:00.269 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.253418+0000", 2024-09-17T02:21:00.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.253418+0000", 2024-09-17T02:21:00.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.253418+0000", 2024-09-17T02:21:00.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4199999999999995e-07 2024-09-17T02:21:00.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.253482+0000", 2024-09-17T02:21:00.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3678999999999998e-05 2024-09-17T02:21:00.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.253493+0000", 2024-09-17T02:21:00.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0712e-05 2024-09-17T02:21:00.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.253498+0000", 2024-09-17T02:21:00.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1880000000000001e-06 2024-09-17T02:21:00.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.253549+0000", 2024-09-17T02:21:00.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1236999999999997e-05 2024-09-17T02:21:00.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.253576+0000", 2024-09-17T02:21:00.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6846999999999999e-05 2024-09-17T02:21:00.272 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.272 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.272 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.272 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:70720 5.8 e34/26 5:13a954f2:::benchmark_data_smithi001_23533_object70719:head v 34'4477, mlcod=34'4475)", 2024-09-17T02:21:00.272 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:00.254128+0000", 2024-09-17T02:21:00.272 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0035895760000000001, 2024-09-17T02:21:00.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038663959999999998, 2024-09-17T02:21:00.272 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.272 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.273 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.273 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.254128+0000", 2024-09-17T02:21:00.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.254128+0000", 2024-09-17T02:21:00.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.254129+0000", 2024-09-17T02:21:00.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4299999999999998e-07 2024-09-17T02:21:00.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.254188+0000", 2024-09-17T02:21:00.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9475999999999998e-05 2024-09-17T02:21:00.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.254198+0000", 2024-09-17T02:21:00.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0078000000000001e-05 2024-09-17T02:21:00.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.254220+0000", 2024-09-17T02:21:00.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1874000000000001e-05 2024-09-17T02:21:00.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.254289+0000", 2024-09-17T02:21:00.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9110999999999996e-05 2024-09-17T02:21:00.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.254312+0000", 2024-09-17T02:21:00.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3113e-05 2024-09-17T02:21:00.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:00.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.257977+0000", 2024-09-17T02:21:00.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036649909999999998 2024-09-17T02:21:00.276 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.276 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.276 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.276 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:70719 5.d e34/26 5:b06aa113:::benchmark_data_smithi001_23533_object70718:head v 34'4438, mlcod=34'4436)", 2024-09-17T02:21:00.277 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:00.254236+0000", 2024-09-17T02:21:00.277 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0034815739999999999, 2024-09-17T02:21:00.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003806168, 2024-09-17T02:21:00.277 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.277 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.277 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:00.277 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.254236+0000", 2024-09-17T02:21:00.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.254236+0000", 2024-09-17T02:21:00.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.254237+0000", 2024-09-17T02:21:00.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7800000000000001e-07 2024-09-17T02:21:00.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.254301+0000", 2024-09-17T02:21:00.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3775000000000005e-05 2024-09-17T02:21:00.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.254318+0000", 2024-09-17T02:21:00.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6994e-05 2024-09-17T02:21:00.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.254327+0000", 2024-09-17T02:21:00.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0100000000000001e-06 2024-09-17T02:21:00.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.254379+0000", 2024-09-17T02:21:00.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2200000000000002e-05 2024-09-17T02:21:00.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.254396+0000", 2024-09-17T02:21:00.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7394999999999999e-05 2024-09-17T02:21:00.280 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.280 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.280 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.280 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:70715 5.9 e34/22 5:96e4e3ec:::benchmark_data_smithi001_23533_object70714:head v 34'4395, mlcod=34'4391)", 2024-09-17T02:21:00.280 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:00.255065+0000", 2024-09-17T02:21:00.281 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.002652976, 2024-09-17T02:21:00.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030117270000000001, 2024-09-17T02:21:00.281 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.281 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.281 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:00.281 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.281 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.281 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.255065+0000", 2024-09-17T02:21:00.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.281 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.281 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.255065+0000", 2024-09-17T02:21:00.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.255065+0000", 2024-09-17T02:21:00.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3099999999999997e-07 2024-09-17T02:21:00.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.255105+0000", 2024-09-17T02:21:00.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9474999999999997e-05 2024-09-17T02:21:00.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.255118+0000", 2024-09-17T02:21:00.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2673999999999999e-05 2024-09-17T02:21:00.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.255124+0000", 2024-09-17T02:21:00.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2249999999999997e-06 2024-09-17T02:21:00.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.255209+0000", 2024-09-17T02:21:00.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5016000000000001e-05 2024-09-17T02:21:00.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.255229+0000", 2024-09-17T02:21:00.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0233000000000001e-05 2024-09-17T02:21:00.284 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.284 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.284 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.284 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:70722 5.4 5:2cf0846e:::benchmark_data_smithi001_23533_object70721:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-17T02:21:00.284 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:00.256038+0000", 2024-09-17T02:21:00.284 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00168015, 2024-09-17T02:21:00.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020784319999999998, 2024-09-17T02:21:00.285 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.285 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.285 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:00.285 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:00.285 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:00.285 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:00.285 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 70722 2024-09-17T02:21:00.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.285 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.256038+0000", 2024-09-17T02:21:00.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.256038+0000", 2024-09-17T02:21:00.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.256039+0000", 2024-09-17T02:21:00.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2130000000000001e-06 2024-09-17T02:21:00.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.256120+0000", 2024-09-17T02:21:00.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1025000000000004e-05 2024-09-17T02:21:00.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.256132+0000", 2024-09-17T02:21:00.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1806e-05 2024-09-17T02:21:00.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.256137+0000", 2024-09-17T02:21:00.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4770000000000002e-06 2024-09-17T02:21:00.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.257857+0000", 2024-09-17T02:21:00.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017196970000000001 2024-09-17T02:21:00.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.257940+0000", 2024-09-17T02:21:00.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3502000000000001e-05 2024-09-17T02:21:00.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:00.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.258073+0000", 2024-09-17T02:21:00.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013282300000000001 2024-09-17T02:21:00.289 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.289 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.289 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.289 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:70721 5.d e34/26 5:bc951957:::benchmark_data_smithi001_23533_object70720:head v 34'4439, mlcod=34'4436)", 2024-09-17T02:21:00.289 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:00.256565+0000", 2024-09-17T02:21:00.289 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.001152569, 2024-09-17T02:21:00.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016101069999999999, 2024-09-17T02:21:00.289 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.289 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.289 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:00.289 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.256565+0000", 2024-09-17T02:21:00.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.256565+0000", 2024-09-17T02:21:00.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.256566+0000", 2024-09-17T02:21:00.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6499999999999999e-07 2024-09-17T02:21:00.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.256635+0000", 2024-09-17T02:21:00.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9531999999999998e-05 2024-09-17T02:21:00.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.256643+0000", 2024-09-17T02:21:00.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8630000000000008e-06 2024-09-17T02:21:00.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.256647+0000", 2024-09-17T02:21:00.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0890000000000002e-06 2024-09-17T02:21:00.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.256695+0000", 2024-09-17T02:21:00.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7592000000000001e-05 2024-09-17T02:21:00.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.256709+0000", 2024-09-17T02:21:00.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4260999999999999e-05 2024-09-17T02:21:00.292 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.292 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.292 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.293 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:70723 5.9 e34/22 5:9458a57d:::benchmark_data_smithi001_23533_object70722:head v 34'4396, mlcod=34'4391)", 2024-09-17T02:21:00.293 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:00.256879+0000", 2024-09-17T02:21:00.293 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00083898700000000002, 2024-09-17T02:21:00.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013675930000000001, 2024-09-17T02:21:00.293 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.293 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.293 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:00.293 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.256879+0000", 2024-09-17T02:21:00.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.256879+0000", 2024-09-17T02:21:00.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.256879+0000", 2024-09-17T02:21:00.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6700000000000003e-07 2024-09-17T02:21:00.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.256941+0000", 2024-09-17T02:21:00.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1739e-05 2024-09-17T02:21:00.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.256947+0000", 2024-09-17T02:21:00.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7629999999999997e-06 2024-09-17T02:21:00.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.256950+0000", 2024-09-17T02:21:00.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.608e-06 2024-09-17T02:21:00.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.257239+0000", 2024-09-17T02:21:00.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028845999999999999 2024-09-17T02:21:00.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.257264+0000", 2024-09-17T02:21:00.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4956999999999998e-05 2024-09-17T02:21:00.296 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.296 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.296 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.296 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:70725 5.b 5:d928cc8b:::benchmark_data_smithi001_23533_object70724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-17T02:21:00.296 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:00.258115+0000", 2024-09-17T02:21:00.297 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4294967295.9996028, 2024-09-17T02:21:00.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020702700000000001, 2024-09-17T02:21:00.297 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.297 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.297 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-17T02:21:00.297 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:00.297 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:00.297 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:00.297 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 70725 2024-09-17T02:21:00.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.297 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.258115+0000", 2024-09-17T02:21:00.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.258115+0000", 2024-09-17T02:21:00.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.258116+0000", 2024-09-17T02:21:00.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.088e-06 2024-09-17T02:21:00.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.258185+0000", 2024-09-17T02:21:00.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9474999999999995e-05 2024-09-17T02:21:00.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.258198+0000", 2024-09-17T02:21:00.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2143e-05 2024-09-17T02:21:00.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.258205+0000", 2024-09-17T02:21:00.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7090000000000002e-06 2024-09-17T02:21:00.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.258269+0000", 2024-09-17T02:21:00.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3583000000000004e-05 2024-09-17T02:21:00.300 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.300 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.300 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.300 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:70706 5.4 5:2051bc19:::benchmark_data_smithi001_23533_object70705:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-17T02:21:00.300 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:00.248374+0000", 2024-09-17T02:21:00.300 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0093437299999999997, 2024-09-17T02:21:00.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010024460000000001, 2024-09-17T02:21:00.300 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.300 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.301 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:00.301 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:00.301 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:00.301 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:00.301 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 70706 2024-09-17T02:21:00.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.301 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.248374+0000", 2024-09-17T02:21:00.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.248374+0000", 2024-09-17T02:21:00.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.248375+0000", 2024-09-17T02:21:00.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.401e-06 2024-09-17T02:21:00.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.248457+0000", 2024-09-17T02:21:00.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2025000000000002e-05 2024-09-17T02:21:00.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.248471+0000", 2024-09-17T02:21:00.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3679999999999999e-05 2024-09-17T02:21:00.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.248479+0000", 2024-09-17T02:21:00.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8960000000000003e-06 2024-09-17T02:21:00.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.250454+0000", 2024-09-17T02:21:00.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019754339999999999 2024-09-17T02:21:00.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.250614+0000", 2024-09-17T02:21:00.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015950099999999999 2024-09-17T02:21:00.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:00.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.250791+0000", 2024-09-17T02:21:00.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017701199999999999 2024-09-17T02:21:00.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:00.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.257447+0000", 2024-09-17T02:21:00.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0066565599999999997 2024-09-17T02:21:00.304 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.305 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.305 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.305 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.305 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:21:00.305 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 12 2024-09-17T02:21:00.305 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:00.306 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:00.307+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:00.307 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:00.407 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:00.406+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:00.409 INFO:teuthology.orchestra.run.smithi001.stdout:moved 15 / 242 (6.19835%) 2024-09-17T02:21:00.410 INFO:teuthology.orchestra.run.smithi001.stdout:avg 80.6667 2024-09-17T02:21:00.410 INFO:teuthology.orchestra.run.smithi001.stdout:stddev 3.68179 -> 8.21922 (expected baseline 7.33333) 2024-09-17T02:21:00.410 INFO:teuthology.orchestra.run.smithi001.stdout:min osd.0 with 76 -> 82 pgs (0.942149 -> 1.01653 * mean) 2024-09-17T02:21:00.410 INFO:teuthology.orchestra.run.smithi001.stdout:max osd.1 with 85 -> 70 pgs (1.05372 -> 0.867769 * mean) 2024-09-17T02:21:00.410 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:21:00.410 INFO:teuthology.orchestra.run.smithi001.stdout:oload 110 2024-09-17T02:21:00.410 INFO:teuthology.orchestra.run.smithi001.stdout:max_change 1 2024-09-17T02:21:00.410 INFO:teuthology.orchestra.run.smithi001.stdout:max_change_osds 4 2024-09-17T02:21:00.410 INFO:teuthology.orchestra.run.smithi001.stdout:average_utilization 0.0026 2024-09-17T02:21:00.410 INFO:teuthology.orchestra.run.smithi001.stdout:overload_utilization 0.0029 2024-09-17T02:21:00.411 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1 weight 1.0000 -> 0.8363 2024-09-17T02:21:00.416 INFO:teuthology.orchestra.run.smithi001.stderr:noscrub is unset 2024-09-17T02:21:00.440 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-17T02:21:00.440 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 3.0 2024-09-17T02:21:00.490 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:00.490 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:21:00.490 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:21:00.490 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:21:00.490 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:00.505 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:00.547 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:00.550+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:00.609 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:00.610+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:00.676 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:00.676 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:21:00.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:21:00.676 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:00.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.676 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:00.676 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:21:00.676 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.121889471999999, 2024-09-17T02:21:00.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035535028000000003, 2024-09-17T02:21:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:21:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:21:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556550+0000", 2024-09-17T02:21:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3500000000000001e-06 2024-09-17T02:21:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556566+0000", 2024-09-17T02:21:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5440000000000001e-05 2024-09-17T02:21:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556594+0000", 2024-09-17T02:21:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8552999999999999e-05 2024-09-17T02:21:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556618+0000", 2024-09-17T02:21:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3207e-05 2024-09-17T02:21:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578337+0000", 2024-09-17T02:21:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021719517000000001 2024-09-17T02:21:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578655+0000", 2024-09-17T02:21:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031837800000000002 2024-09-17T02:21:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.581374+0000", 2024-09-17T02:21:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002718238 2024-09-17T02:21:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587083+0000", 2024-09-17T02:21:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005708912 2024-09-17T02:21:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591823+0000", 2024-09-17T02:21:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047406080000000003 2024-09-17T02:21:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591972+0000", 2024-09-17T02:21:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014874199999999999 2024-09-17T02:21:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592082+0000", 2024-09-17T02:21:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110083 2024-09-17T02:21:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:21:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.120947985000001, 2024-09-17T02:21:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035128756999999997, 2024-09-17T02:21:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:21:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:21:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557491+0000", 2024-09-17T02:21:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.88e-06 2024-09-17T02:21:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557504+0000", 2024-09-17T02:21:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2864000000000001e-05 2024-09-17T02:21:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557535+0000", 2024-09-17T02:21:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0916e-05 2024-09-17T02:21:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557561+0000", 2024-09-17T02:21:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5602999999999999e-05 2024-09-17T02:21:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582290+0000", 2024-09-17T02:21:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024729729999999998 2024-09-17T02:21:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582642+0000", 2024-09-17T02:21:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035143499999999999 2024-09-17T02:21:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582959+0000", 2024-09-17T02:21:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031747399999999999 2024-09-17T02:21:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587302+0000", 2024-09-17T02:21:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043425169999999997 2024-09-17T02:21:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592391+0000", 2024-09-17T02:21:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050895799999999998 2024-09-17T02:21:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592516+0000", 2024-09-17T02:21:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012420500000000001 2024-09-17T02:21:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592617+0000", 2024-09-17T02:21:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010155299999999999 2024-09-17T02:21:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:21:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.120843485999998, 2024-09-17T02:21:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034796066, 2024-09-17T02:21:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:21:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:21:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557594+0000", 2024-09-17T02:21:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3769999999999999e-06 2024-09-17T02:21:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557683+0000", 2024-09-17T02:21:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8896999999999999e-05 2024-09-17T02:21:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557707+0000", 2024-09-17T02:21:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3839e-05 2024-09-17T02:21:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557730+0000", 2024-09-17T02:21:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3047000000000001e-05 2024-09-17T02:21:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582329+0000", 2024-09-17T02:21:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024599283999999999 2024-09-17T02:21:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582624+0000", 2024-09-17T02:21:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000294462 2024-09-17T02:21:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582936+0000", 2024-09-17T02:21:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031223399999999999 2024-09-17T02:21:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587347+0000", 2024-09-17T02:21:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044110340000000003 2024-09-17T02:21:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592165+0000", 2024-09-17T02:21:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048176699999999996 2024-09-17T02:21:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592311+0000", 2024-09-17T02:21:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014661899999999999 2024-09-17T02:21:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592389+0000", 2024-09-17T02:21:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7602999999999995e-05 2024-09-17T02:21:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:21:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.120325858999998, 2024-09-17T02:21:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034457472000000003, 2024-09-17T02:21:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:21:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:21:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558113+0000", 2024-09-17T02:21:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1639999999999999e-06 2024-09-17T02:21:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558125+0000", 2024-09-17T02:21:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2269999999999999e-05 2024-09-17T02:21:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558458+0000", 2024-09-17T02:21:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033322700000000001 2024-09-17T02:21:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558488+0000", 2024-09-17T02:21:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.951e-05 2024-09-17T02:21:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584514+0000", 2024-09-17T02:21:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026025721000000002 2024-09-17T02:21:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584781+0000", 2024-09-17T02:21:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000267142 2024-09-17T02:21:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585078+0000", 2024-09-17T02:21:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029738799999999999 2024-09-17T02:21:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588045+0000", 2024-09-17T02:21:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029673759999999999 2024-09-17T02:21:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592454+0000", 2024-09-17T02:21:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044090209999999999 2024-09-17T02:21:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592520+0000", 2024-09-17T02:21:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6032999999999996e-05 2024-09-17T02:21:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592568+0000", 2024-09-17T02:21:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7620000000000001e-05 2024-09-17T02:21:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:21:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.119865607999998, 2024-09-17T02:21:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031603266999999997, 2024-09-17T02:21:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:21:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:21:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558573+0000", 2024-09-17T02:21:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0660000000000002e-06 2024-09-17T02:21:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558585+0000", 2024-09-17T02:21:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1596999999999999e-05 2024-09-17T02:21:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558612+0000", 2024-09-17T02:21:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7115999999999999e-05 2024-09-17T02:21:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558631+0000", 2024-09-17T02:21:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9519999999999999e-05 2024-09-17T02:21:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558783+0000", 2024-09-17T02:21:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152025 2024-09-17T02:21:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-17T02:21:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558798+0000", 2024-09-17T02:21:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4966999999999999e-05 2024-09-17T02:21:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.572871+0000", 2024-09-17T02:21:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014072782000000001 2024-09-17T02:21:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573153+0000", 2024-09-17T02:21:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028214499999999998 2024-09-17T02:21:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573432+0000", 2024-09-17T02:21:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027932100000000002 2024-09-17T02:21:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582279+0000", 2024-09-17T02:21:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0088463310000000007 2024-09-17T02:21:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.589902+0000", 2024-09-17T02:21:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0076236050000000003 2024-09-17T02:21:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.589997+0000", 2024-09-17T02:21:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4456000000000005e-05 2024-09-17T02:21:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590174+0000", 2024-09-17T02:21:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000177336 2024-09-17T02:21:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:00.710 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:21:00.710 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.119762363, 2024-09-17T02:21:00.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031899064999999997, 2024-09-17T02:21:00.710 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.710 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.710 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.710 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:21:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:21:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558676+0000", 2024-09-17T02:21:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.39e-06 2024-09-17T02:21:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558686+0000", 2024-09-17T02:21:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.022e-05 2024-09-17T02:21:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558708+0000", 2024-09-17T02:21:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2249999999999999e-05 2024-09-17T02:21:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558725+0000", 2024-09-17T02:21:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7387000000000001e-05 2024-09-17T02:21:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558940+0000", 2024-09-17T02:21:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021453800000000001 2024-09-17T02:21:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting_for_map not empty", 2024-09-17T02:21:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558951+0000", 2024-09-17T02:21:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1303e-05 2024-09-17T02:21:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576237+0000", 2024-09-17T02:21:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017285723999999999 2024-09-17T02:21:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576454+0000", 2024-09-17T02:21:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021673800000000001 2024-09-17T02:21:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576932+0000", 2024-09-17T02:21:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047792700000000001 2024-09-17T02:21:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585689+0000", 2024-09-17T02:21:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0087572880000000002 2024-09-17T02:21:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590287+0000", 2024-09-17T02:21:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045978060000000003 2024-09-17T02:21:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590447+0000", 2024-09-17T02:21:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000160719 2024-09-17T02:21:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590573+0000", 2024-09-17T02:21:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012577500000000001 2024-09-17T02:21:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.717 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.717 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:21:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.119684393, 2024-09-17T02:21:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034114029999999997, 2024-09-17T02:21:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:21:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:21:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558753+0000", 2024-09-17T02:21:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2699999999999999e-06 2024-09-17T02:21:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558769+0000", 2024-09-17T02:21:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5906e-05 2024-09-17T02:21:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558791+0000", 2024-09-17T02:21:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1342999999999999e-05 2024-09-17T02:21:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558806+0000", 2024-09-17T02:21:00.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5829999999999999e-05 2024-09-17T02:21:00.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584906+0000", 2024-09-17T02:21:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026099273999999999 2024-09-17T02:21:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585158+0000", 2024-09-17T02:21:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025194600000000002 2024-09-17T02:21:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585368+0000", 2024-09-17T02:21:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210068 2024-09-17T02:21:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588098+0000", 2024-09-17T02:21:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002730522 2024-09-17T02:21:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592680+0000", 2024-09-17T02:21:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045816019999999997 2024-09-17T02:21:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592774+0000", 2024-09-17T02:21:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3726000000000004e-05 2024-09-17T02:21:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592866+0000", 2024-09-17T02:21:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2542999999999998e-05 2024-09-17T02:21:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:21:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.11960809, 2024-09-17T02:21:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031407875000000002, 2024-09-17T02:21:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:21:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:21:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558830+0000", 2024-09-17T02:21:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3599999999999999e-06 2024-09-17T02:21:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558835+0000", 2024-09-17T02:21:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6130000000000003e-06 2024-09-17T02:21:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558853+0000", 2024-09-17T02:21:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8099999999999999e-05 2024-09-17T02:21:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558869+0000", 2024-09-17T02:21:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.59e-05 2024-09-17T02:21:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560437+0000", 2024-09-17T02:21:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015677989999999999 2024-09-17T02:21:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-17T02:21:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560453+0000", 2024-09-17T02:21:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.535e-05 2024-09-17T02:21:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562422+0000", 2024-09-17T02:21:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00196934 2024-09-17T02:21:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562773+0000", 2024-09-17T02:21:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035152399999999998 2024-09-17T02:21:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590236+0000", 2024-09-17T02:21:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.027462889000000001 2024-09-17T02:21:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.560079+0000", 2024-09-17T02:21:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.118357594999999, 2024-09-17T02:21:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016073831, 2024-09-17T02:21:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560079+0000", 2024-09-17T02:21:00.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560079+0000", 2024-09-17T02:21:00.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560081+0000", 2024-09-17T02:21:00.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.266e-06 2024-09-17T02:21:00.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560090+0000", 2024-09-17T02:21:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2129999999999997e-06 2024-09-17T02:21:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560119+0000", 2024-09-17T02:21:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8932999999999999e-05 2024-09-17T02:21:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560145+0000", 2024-09-17T02:21:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6020000000000002e-05 2024-09-17T02:21:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.561833+0000", 2024-09-17T02:21:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016875659999999999 2024-09-17T02:21:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562199+0000", 2024-09-17T02:21:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036619000000000002 2024-09-17T02:21:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576153+0000", 2024-09-17T02:21:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013953643 2024-09-17T02:21:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:25 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'2, mlcod=0'0)", 2024-09-17T02:21:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.568721+0000", 2024-09-17T02:21:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.109715577000003, 2024-09-17T02:21:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015657030999999998, 2024-09-17T02:21:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568721+0000", 2024-09-17T02:21:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568721+0000", 2024-09-17T02:21:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568722+0000", 2024-09-17T02:21:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5600000000000004e-07 2024-09-17T02:21:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568742+0000", 2024-09-17T02:21:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0506999999999999e-05 2024-09-17T02:21:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568762+0000", 2024-09-17T02:21:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9423e-05 2024-09-17T02:21:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.568777+0000", 2024-09-17T02:21:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5457000000000001e-05 2024-09-17T02:21:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.571705+0000", 2024-09-17T02:21:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029280130000000001 2024-09-17T02:21:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.571787+0000", 2024-09-17T02:21:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1509999999999997e-05 2024-09-17T02:21:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584296+0000", 2024-09-17T02:21:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012509398999999999 2024-09-17T02:21:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584378+0000", 2024-09-17T02:21:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1866000000000005e-05 2024-09-17T02:21:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.3:7 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'2, mlcod=0'0)", 2024-09-17T02:21:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.569013+0000", 2024-09-17T02:21:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.109423655999997, 2024-09-17T02:21:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015831576999999999, 2024-09-17T02:21:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569013+0000", 2024-09-17T02:21:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569013+0000", 2024-09-17T02:21:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569014+0000", 2024-09-17T02:21:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6000000000000002e-07 2024-09-17T02:21:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.569024+0000", 2024-09-17T02:21:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8369999999999992e-06 2024-09-17T02:21:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570016+0000", 2024-09-17T02:21:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00099277000000000002 2024-09-17T02:21:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570040+0000", 2024-09-17T02:21:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3790000000000001e-05 2024-09-17T02:21:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570154+0000", 2024-09-17T02:21:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113689 2024-09-17T02:21:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.570208+0000", 2024-09-17T02:21:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4305999999999998e-05 2024-09-17T02:21:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.583286+0000", 2024-09-17T02:21:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013077945000000001 2024-09-17T02:21:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584844+0000", 2024-09-17T02:21:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015583800000000001 2024-09-17T02:21:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:1248 5.e 5:7f482265:::benchmark_data_smithi001_23533_object1247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T02:21:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:33.170647+0000", 2024-09-17T02:21:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 27.507789173999999, 2024-09-17T02:21:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015727534000000001, 2024-09-17T02:21:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1248 2024-09-17T02:21:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170647+0000", 2024-09-17T02:21:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170647+0000", 2024-09-17T02:21:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170648+0000", 2024-09-17T02:21:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4000000000000002e-07 2024-09-17T02:21:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170691+0000", 2024-09-17T02:21:00.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2722000000000002e-05 2024-09-17T02:21:00.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170699+0000", 2024-09-17T02:21:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1540000000000002e-06 2024-09-17T02:21:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.170704+0000", 2024-09-17T02:21:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1290000000000004e-06 2024-09-17T02:21:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.171489+0000", 2024-09-17T02:21:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00078564599999999998 2024-09-17T02:21:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.171653+0000", 2024-09-17T02:21:00.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163027 2024-09-17T02:21:00.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:00.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.171797+0000", 2024-09-17T02:21:00.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000144828 2024-09-17T02:21:00.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.172344+0000", 2024-09-17T02:21:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054687599999999996 2024-09-17T02:21:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.186281+0000", 2024-09-17T02:21:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013936755 2024-09-17T02:21:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.186338+0000", 2024-09-17T02:21:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6598000000000003e-05 2024-09-17T02:21:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:33.186375+0000", 2024-09-17T02:21:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7258999999999997e-05 2024-09-17T02:21:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.759 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28720 5.f e28/22 5:f8a7aea5:::benchmark_data_smithi001_23533_object28719:head v 28'1756, mlcod=28'1754)", 2024-09-17T02:21:00.759 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:21:00.759 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.108316593000001, 2024-09-17T02:21:00.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033308717000000002, 2024-09-17T02:21:00.759 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.759 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.759 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.759 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:21:00.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:21:00.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570121+0000", 2024-09-17T02:21:00.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4e-07 2024-09-17T02:21:00.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570208+0000", 2024-09-17T02:21:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6945000000000002e-05 2024-09-17T02:21:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570222+0000", 2024-09-17T02:21:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4541e-05 2024-09-17T02:21:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570232+0000", 2024-09-17T02:21:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3039999999999994e-06 2024-09-17T02:21:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570273+0000", 2024-09-17T02:21:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1950999999999999e-05 2024-09-17T02:21:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570286+0000", 2024-09-17T02:21:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2268e-05 2024-09-17T02:21:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:00.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603312+0000", 2024-09-17T02:21:00.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033026405000000002 2024-09-17T02:21:00.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:00.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603429+0000", 2024-09-17T02:21:00.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116463 2024-09-17T02:21:00.764 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.764 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.764 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28721 5.a e28/22 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head v 28'1872, mlcod=28'1869)", 2024-09-17T02:21:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:21:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.108173087000001, 2024-09-17T02:21:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033539817999999999, 2024-09-17T02:21:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:21:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:21:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570264+0000", 2024-09-17T02:21:00.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0999999999999997e-07 2024-09-17T02:21:00.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570299+0000", 2024-09-17T02:21:00.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4876999999999998e-05 2024-09-17T02:21:00.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570310+0000", 2024-09-17T02:21:00.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0958000000000001e-05 2024-09-17T02:21:00.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570316+0000", 2024-09-17T02:21:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.485e-06 2024-09-17T02:21:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598947+0000", 2024-09-17T02:21:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.028631058000000001 2024-09-17T02:21:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598969+0000", 2024-09-17T02:21:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2005999999999999e-05 2024-09-17T02:21:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.602638+0000", 2024-09-17T02:21:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036690339999999998 2024-09-17T02:21:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603803+0000", 2024-09-17T02:21:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00116559 2024-09-17T02:21:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28723 5.f e28/22 5:f1a2a8f6:::benchmark_data_smithi001_23533_object28722:head v 28'1757, mlcod=28'1754)", 2024-09-17T02:21:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.571446+0000", 2024-09-17T02:21:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.106990758999999, 2024-09-17T02:21:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.032047203000000003, 2024-09-17T02:21:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571446+0000", 2024-09-17T02:21:00.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571446+0000", 2024-09-17T02:21:00.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571447+0000", 2024-09-17T02:21:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0979999999999999e-06 2024-09-17T02:21:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571554+0000", 2024-09-17T02:21:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107464 2024-09-17T02:21:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598891+0000", 2024-09-17T02:21:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.027336905000000002 2024-09-17T02:21:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598905+0000", 2024-09-17T02:21:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:21:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.600343+0000", 2024-09-17T02:21:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014382100000000001 2024-09-17T02:21:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.600387+0000", 2024-09-17T02:21:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3398e-05 2024-09-17T02:21:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603443+0000", 2024-09-17T02:21:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030562250000000001 2024-09-17T02:21:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603493+0000", 2024-09-17T02:21:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9820000000000001e-05 2024-09-17T02:21:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:40724 5.e 5:78fee04a:::benchmark_data_smithi001_23533_object40723:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:21:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:47.033267+0000", 2024-09-17T02:21:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.645169172999999, 2024-09-17T02:21:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015687298999999998, 2024-09-17T02:21:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:00.777 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 40724 2024-09-17T02:21:00.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.777 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033267+0000", 2024-09-17T02:21:00.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033267+0000", 2024-09-17T02:21:00.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033268+0000", 2024-09-17T02:21:00.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.119e-06 2024-09-17T02:21:00.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033371+0000", 2024-09-17T02:21:00.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010283100000000001 2024-09-17T02:21:00.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033382+0000", 2024-09-17T02:21:00.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0655e-05 2024-09-17T02:21:00.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033389+0000", 2024-09-17T02:21:00.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2880000000000004e-06 2024-09-17T02:21:00.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033467+0000", 2024-09-17T02:21:00.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8091999999999997e-05 2024-09-17T02:21:00.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033660+0000", 2024-09-17T02:21:00.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019242799999999999 2024-09-17T02:21:00.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:00.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.033807+0000", 2024-09-17T02:21:00.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000147436 2024-09-17T02:21:00.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:00.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.035370+0000", 2024-09-17T02:21:00.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001563257 2024-09-17T02:21:00.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.048889+0000", 2024-09-17T02:21:00.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013518835 2024-09-17T02:21:00.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:00.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.048925+0000", 2024-09-17T02:21:00.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5645000000000002e-05 2024-09-17T02:21:00.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:00.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.048955+0000", 2024-09-17T02:21:00.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9713000000000002e-05 2024-09-17T02:21:00.782 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.783 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.783 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.783 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:40730 5.b 5:d64b1dc0:::benchmark_data_smithi001_23533_object40729:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:21:00.783 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:21:00.783 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.640668921, 2024-09-17T02:21:00.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016675972000000001, 2024-09-17T02:21:00.784 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.784 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.784 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.784 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:00.784 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:00.784 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:00.784 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 40730 2024-09-17T02:21:00.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.785 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:21:00.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:21:00.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:21:00.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5700000000000002e-07 2024-09-17T02:21:00.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037813+0000", 2024-09-17T02:21:00.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4880999999999999e-05 2024-09-17T02:21:00.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037820+0000", 2024-09-17T02:21:00.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.34e-06 2024-09-17T02:21:00.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037825+0000", 2024-09-17T02:21:00.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1420000000000003e-06 2024-09-17T02:21:00.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.039167+0000", 2024-09-17T02:21:00.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013427529999999999 2024-09-17T02:21:00.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.039293+0000", 2024-09-17T02:21:00.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000125248 2024-09-17T02:21:00.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:00.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.039442+0000", 2024-09-17T02:21:00.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014929799999999999 2024-09-17T02:21:00.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:00.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.041694+0000", 2024-09-17T02:21:00.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002252324 2024-09-17T02:21:00.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054324+0000", 2024-09-17T02:21:00.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012629782000000001 2024-09-17T02:21:00.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:00.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054393+0000", 2024-09-17T02:21:00.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9295999999999995e-05 2024-09-17T02:21:00.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:00.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054444+0000", 2024-09-17T02:21:00.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0250999999999997e-05 2024-09-17T02:21:00.793 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.793 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.793 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.794 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:40735 5.b 5:df8fd62b:::benchmark_data_smithi001_23533_object40734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:21:00.794 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:47.038253+0000", 2024-09-17T02:21:00.794 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.640183221000001, 2024-09-17T02:21:00.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016368369000000001, 2024-09-17T02:21:00.794 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.794 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.794 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.795 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:00.795 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:00.795 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:00.795 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 40735 2024-09-17T02:21:00.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.795 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038253+0000", 2024-09-17T02:21:00.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038253+0000", 2024-09-17T02:21:00.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038254+0000", 2024-09-17T02:21:00.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.23e-07 2024-09-17T02:21:00.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038420+0000", 2024-09-17T02:21:00.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016617499999999999 2024-09-17T02:21:00.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038432+0000", 2024-09-17T02:21:00.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1406000000000001e-05 2024-09-17T02:21:00.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038439+0000", 2024-09-17T02:21:00.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7200000000000006e-06 2024-09-17T02:21:00.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.040422+0000", 2024-09-17T02:21:00.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019828530000000001 2024-09-17T02:21:00.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.040581+0000", 2024-09-17T02:21:00.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159238 2024-09-17T02:21:00.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:00.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.040744+0000", 2024-09-17T02:21:00.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016255800000000001 2024-09-17T02:21:00.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:00.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.041971+0000", 2024-09-17T02:21:00.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001226551 2024-09-17T02:21:00.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054500+0000", 2024-09-17T02:21:00.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012529676 2024-09-17T02:21:00.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:00.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054570+0000", 2024-09-17T02:21:00.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9253999999999998e-05 2024-09-17T02:21:00.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:00.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054622+0000", 2024-09-17T02:21:00.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2114999999999998e-05 2024-09-17T02:21:00.801 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.801 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.801 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.801 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:64220 5.4 5:27584da2:::benchmark_data_smithi001_23533_object64219:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-17T02:21:00.801 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:57.202813+0000", 2024-09-17T02:21:00.801 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.4756238669999999, 2024-09-17T02:21:00.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019952102999999999, 2024-09-17T02:21:00.802 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.802 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.802 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.802 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:00.802 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:00.802 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:00.803 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 64220 2024-09-17T02:21:00.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.803 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.202813+0000", 2024-09-17T02:21:00.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.202813+0000", 2024-09-17T02:21:00.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.202813+0000", 2024-09-17T02:21:00.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0800000000000004e-07 2024-09-17T02:21:00.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.202879+0000", 2024-09-17T02:21:00.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5698999999999996e-05 2024-09-17T02:21:00.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.202887+0000", 2024-09-17T02:21:00.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3699999999999995e-06 2024-09-17T02:21:00.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.202892+0000", 2024-09-17T02:21:00.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7960000000000003e-06 2024-09-17T02:21:00.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.204623+0000", 2024-09-17T02:21:00.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017305179999999999 2024-09-17T02:21:00.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.204739+0000", 2024-09-17T02:21:00.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116439 2024-09-17T02:21:00.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:00.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.204846+0000", 2024-09-17T02:21:00.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107181 2024-09-17T02:21:00.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:00.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.207469+0000", 2024-09-17T02:21:00.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026227020000000002 2024-09-17T02:21:00.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.222690+0000", 2024-09-17T02:21:00.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015220798000000001 2024-09-17T02:21:00.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:00.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.222732+0000", 2024-09-17T02:21:00.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2552999999999997e-05 2024-09-17T02:21:00.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:00.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.222765+0000", 2024-09-17T02:21:00.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2339000000000003e-05 2024-09-17T02:21:00.810 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.810 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.810 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.810 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:70402 5.e 5:77b97f3b:::benchmark_data_smithi001_23533_object70401:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-17T02:21:00.811 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:00.105258+0000", 2024-09-17T02:21:00.811 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.57317870400000004, 2024-09-17T02:21:00.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016510609999999998, 2024-09-17T02:21:00.811 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:00.811 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:00.811 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:00.811 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:00.811 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:00.811 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:00.811 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 70402 2024-09-17T02:21:00.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.811 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:00.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:00.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.105258+0000", 2024-09-17T02:21:00.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:00.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.105258+0000", 2024-09-17T02:21:00.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:00.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:00.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.105258+0000", 2024-09-17T02:21:00.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4099999999999999e-07 2024-09-17T02:21:00.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:00.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.105288+0000", 2024-09-17T02:21:00.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9825999999999999e-05 2024-09-17T02:21:00.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:00.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.105295+0000", 2024-09-17T02:21:00.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.002e-06 2024-09-17T02:21:00.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:00.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.105301+0000", 2024-09-17T02:21:00.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7629999999999997e-06 2024-09-17T02:21:00.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:00.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.112762+0000", 2024-09-17T02:21:00.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0074614269999999996 2024-09-17T02:21:00.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:00.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.112873+0000", 2024-09-17T02:21:00.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011073600000000001 2024-09-17T02:21:00.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:00.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.112974+0000", 2024-09-17T02:21:00.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101013 2024-09-17T02:21:00.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:00.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.116051+0000", 2024-09-17T02:21:00.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003077336 2024-09-17T02:21:00.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:00.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.121661+0000", 2024-09-17T02:21:00.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056096590000000003 2024-09-17T02:21:00.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:00.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.121722+0000", 2024-09-17T02:21:00.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1084e-05 2024-09-17T02:21:00.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:00.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:00.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:00.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.121768+0000", 2024-09-17T02:21:00.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6322999999999997e-05 2024-09-17T02:21:00.816 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.816 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.816 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.816 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:00.816 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:00.816 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:00.817 INFO:tasks.ceph.mgr.x.smithi001.stderr:2024-09-17T02:21:00.734+0000 7ff103450640 -1 mgr.server reply reply (1) Operation not permitted no change 2024-09-17T02:21:00.818 INFO:teuthology.orchestra.run.smithi001.stdout:moved 12 / 242 (4.95868%) 2024-09-17T02:21:00.818 INFO:teuthology.orchestra.run.smithi001.stdout:avg 80.6667 2024-09-17T02:21:00.818 INFO:teuthology.orchestra.run.smithi001.stdout:stddev 8.21922 -> 16.1107 (expected baseline 7.33333) 2024-09-17T02:21:00.818 INFO:teuthology.orchestra.run.smithi001.stdout:min osd.1 with 70 -> 58 pgs (0.867769 -> 0.719008 * mean) 2024-09-17T02:21:00.818 INFO:teuthology.orchestra.run.smithi001.stdout:max osd.2 with 90 -> 94 pgs (1.1157 -> 1.16529 * mean) 2024-09-17T02:21:00.818 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:21:00.819 INFO:teuthology.orchestra.run.smithi001.stdout:oload 110 2024-09-17T02:21:00.819 INFO:teuthology.orchestra.run.smithi001.stdout:max_change 3 2024-09-17T02:21:00.819 INFO:teuthology.orchestra.run.smithi001.stdout:max_change_osds 4 2024-09-17T02:21:00.819 INFO:teuthology.orchestra.run.smithi001.stdout:average_utilization 0.0026 2024-09-17T02:21:00.819 INFO:teuthology.orchestra.run.smithi001.stdout:overload_utilization 0.0029 2024-09-17T02:21:00.819 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1 weight 0.8363 -> 0.6994 2024-09-17T02:21:00.820 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:00.820 INFO:teuthology.orchestra.run.smithi001.stderr:no change 2024-09-17T02:21:00.821 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-17T02:21:00.821 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 0.05 2024-09-17T02:21:00.821 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 28 16 71173 71157 158.815 91.25 0.005727 0.00621912 2024-09-17T02:21:00.822 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:00.819+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:00.919 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:00.919+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:00.949 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:00.950 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:21:00.950 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-17T02:21:00.950 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:00.964 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:01.020 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:01.022+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:01.077 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:01.077 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:21:01.078 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:21:01.078 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:21:01.078 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:01.090 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:01.120 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:01.123+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:01.130 INFO:tasks.ceph.mgr.x.smithi001.stderr:2024-09-17T02:21:01.130+0000 7ff103450640 -1 mgr.server reply reply (1) Operation not permitted no change 2024-09-17T02:21:01.131 INFO:teuthology.orchestra.run.smithi001.stdout:moved 7 / 242 (2.89256%) 2024-09-17T02:21:01.131 INFO:teuthology.orchestra.run.smithi001.stdout:avg 80.6667 2024-09-17T02:21:01.131 INFO:teuthology.orchestra.run.smithi001.stdout:stddev 8.21922 -> 12.8149 (expected baseline 7.33333) 2024-09-17T02:21:01.131 INFO:teuthology.orchestra.run.smithi001.stdout:min osd.1 with 70 -> 63 pgs (0.867769 -> 0.780992 * mean) 2024-09-17T02:21:01.131 INFO:teuthology.orchestra.run.smithi001.stdout:max osd.2 with 90 -> 93 pgs (1.1157 -> 1.15289 * mean) 2024-09-17T02:21:01.131 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:21:01.131 INFO:teuthology.orchestra.run.smithi001.stdout:oload 110 2024-09-17T02:21:01.132 INFO:teuthology.orchestra.run.smithi001.stdout:max_change 0.05 2024-09-17T02:21:01.132 INFO:teuthology.orchestra.run.smithi001.stdout:max_change_osds 4 2024-09-17T02:21:01.132 INFO:teuthology.orchestra.run.smithi001.stdout:average_utilization 0.0026 2024-09-17T02:21:01.132 INFO:teuthology.orchestra.run.smithi001.stdout:overload_utilization 0.0029 2024-09-17T02:21:01.132 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1 weight 0.8363 -> 0.7863 2024-09-17T02:21:01.132 INFO:teuthology.orchestra.run.smithi001.stderr:no change 2024-09-17T02:21:01.151 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-17T02:21:01.151 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 0.05 2024-09-17T02:21:01.198 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:01.198 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:21:01.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:21:01.198 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:01.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.198 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:01.198 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:21:01.198 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.639609811, 2024-09-17T02:21:01.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021799929999999999, 2024-09-17T02:21:01.198 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:01.199 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:01.199 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:01.199 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:01.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:01.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:21:01.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:01.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:21:01.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:01.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562007+0000", 2024-09-17T02:21:01.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6260000000000001e-06 2024-09-17T02:21:01.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:01.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562021+0000", 2024-09-17T02:21:01.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4440000000000001e-05 2024-09-17T02:21:01.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:01.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562053+0000", 2024-09-17T02:21:01.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2159000000000002e-05 2024-09-17T02:21:01.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562076+0000", 2024-09-17T02:21:01.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2926999999999999e-05 2024-09-17T02:21:01.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:01.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562218+0000", 2024-09-17T02:21:01.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000141726 2024-09-17T02:21:01.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:01.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562506+0000", 2024-09-17T02:21:01.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028752399999999999 2024-09-17T02:21:01.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:01.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562830+0000", 2024-09-17T02:21:01.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032427399999999999 2024-09-17T02:21:01.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:01.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566900+0000", 2024-09-17T02:21:01.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040705660000000003 2024-09-17T02:21:01.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:01.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583581+0000", 2024-09-17T02:21:01.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016680210000000001 2024-09-17T02:21:01.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:01.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583704+0000", 2024-09-17T02:21:01.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012289899999999999 2024-09-17T02:21:01.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:01.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583803+0000", 2024-09-17T02:21:01.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9579000000000003e-05 2024-09-17T02:21:01.203 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.204 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:01.204 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.204 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:01.204 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:21:01.204 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.639482598999997, 2024-09-17T02:21:01.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022056035000000002, 2024-09-17T02:21:01.204 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:01.204 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:01.204 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:01.204 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:01.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:01.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:21:01.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:01.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:21:01.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:01.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562132+0000", 2024-09-17T02:21:01.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6300000000000001e-06 2024-09-17T02:21:01.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:01.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562142+0000", 2024-09-17T02:21:01.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.022e-05 2024-09-17T02:21:01.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:01.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562164+0000", 2024-09-17T02:21:01.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2002999999999999e-05 2024-09-17T02:21:01.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562180+0000", 2024-09-17T02:21:01.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5930000000000002e-05 2024-09-17T02:21:01.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:01.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563517+0000", 2024-09-17T02:21:01.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001336776 2024-09-17T02:21:01.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:01.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563635+0000", 2024-09-17T02:21:01.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117976 2024-09-17T02:21:01.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:01.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563819+0000", 2024-09-17T02:21:01.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018411499999999999 2024-09-17T02:21:01.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:01.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566977+0000", 2024-09-17T02:21:01.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031575990000000001 2024-09-17T02:21:01.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:01.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583917+0000", 2024-09-17T02:21:01.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016940093999999999 2024-09-17T02:21:01.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:01.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584066+0000", 2024-09-17T02:21:01.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000149746 2024-09-17T02:21:01.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:01.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584186+0000", 2024-09-17T02:21:01.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011994600000000001 2024-09-17T02:21:01.210 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.210 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:01.210 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.210 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:01.210 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:01.210 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.639301887999999, 2024-09-17T02:21:01.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023664803000000002, 2024-09-17T02:21:01.211 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:01.211 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:01.211 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:01.211 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:01.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:01.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:01.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:01.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:01.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:01.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562313+0000", 2024-09-17T02:21:01.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.764e-06 2024-09-17T02:21:01.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:01.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562323+0000", 2024-09-17T02:21:01.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0166000000000001e-05 2024-09-17T02:21:01.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:01.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562343+0000", 2024-09-17T02:21:01.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9633999999999999e-05 2024-09-17T02:21:01.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562367+0000", 2024-09-17T02:21:01.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4556e-05 2024-09-17T02:21:01.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:01.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563777+0000", 2024-09-17T02:21:01.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014102330000000001 2024-09-17T02:21:01.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:01.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563969+0000", 2024-09-17T02:21:01.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000191361 2024-09-17T02:21:01.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:01.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564148+0000", 2024-09-17T02:21:01.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017934599999999999 2024-09-17T02:21:01.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:01.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566989+0000", 2024-09-17T02:21:01.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028407010000000002 2024-09-17T02:21:01.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:01.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585770+0000", 2024-09-17T02:21:01.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018781566999999999 2024-09-17T02:21:01.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:01.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585874+0000", 2024-09-17T02:21:01.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103489 2024-09-17T02:21:01.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:01.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585976+0000", 2024-09-17T02:21:01.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101986 2024-09-17T02:21:01.216 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.216 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:01.216 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.216 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:01.217 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:01.217 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.639219007999998, 2024-09-17T02:21:01.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024118555999999999, 2024-09-17T02:21:01.217 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:01.217 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:01.217 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:01.217 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:01.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:01.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:01.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:01.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:01.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:01.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562395+0000", 2024-09-17T02:21:01.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3969999999999999e-06 2024-09-17T02:21:01.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:01.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562405+0000", 2024-09-17T02:21:01.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4229999999999994e-06 2024-09-17T02:21:01.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:01.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562427+0000", 2024-09-17T02:21:01.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759999999999998e-05 2024-09-17T02:21:01.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562444+0000", 2024-09-17T02:21:01.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7019000000000001e-05 2024-09-17T02:21:01.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:01.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564681+0000", 2024-09-17T02:21:01.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022376929999999998 2024-09-17T02:21:01.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:01.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564887+0000", 2024-09-17T02:21:01.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000206178 2024-09-17T02:21:01.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:01.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565230+0000", 2024-09-17T02:21:01.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034233499999999998 2024-09-17T02:21:01.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:01.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567000+0000", 2024-09-17T02:21:01.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017706390000000001 2024-09-17T02:21:01.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:01.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586126+0000", 2024-09-17T02:21:01.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019125672 2024-09-17T02:21:01.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:01.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586314+0000", 2024-09-17T02:21:01.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018740200000000001 2024-09-17T02:21:01.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:01.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586513+0000", 2024-09-17T02:21:01.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019903799999999999 2024-09-17T02:21:01.222 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.222 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:01.222 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.222 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:01.222 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:21:01.222 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.639144334999997, 2024-09-17T02:21:01.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021940779000000001, 2024-09-17T02:21:01.222 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:01.222 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:01.222 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:01.222 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:01.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:01.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:21:01.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:01.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:21:01.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:01.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562470+0000", 2024-09-17T02:21:01.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5030000000000001e-06 2024-09-17T02:21:01.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:01.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562478+0000", 2024-09-17T02:21:01.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.157e-06 2024-09-17T02:21:01.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:01.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562496+0000", 2024-09-17T02:21:01.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7876e-05 2024-09-17T02:21:01.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562511+0000", 2024-09-17T02:21:01.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5067e-05 2024-09-17T02:21:01.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:01.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564628+0000", 2024-09-17T02:21:01.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021171860000000001 2024-09-17T02:21:01.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:01.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564838+0000", 2024-09-17T02:21:01.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000209283 2024-09-17T02:21:01.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:01.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565078+0000", 2024-09-17T02:21:01.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024075100000000001 2024-09-17T02:21:01.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:01.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567012+0000", 2024-09-17T02:21:01.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019331050000000001 2024-09-17T02:21:01.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:01.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584289+0000", 2024-09-17T02:21:01.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017277464999999999 2024-09-17T02:21:01.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:01.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584363+0000", 2024-09-17T02:21:01.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3852999999999999e-05 2024-09-17T02:21:01.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:01.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584409+0000", 2024-09-17T02:21:01.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6533000000000003e-05 2024-09-17T02:21:01.228 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.228 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:01.228 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.228 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:01.228 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:21:01.228 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.639080946, 2024-09-17T02:21:01.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020580694, 2024-09-17T02:21:01.229 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:01.229 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:01.229 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:01.229 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:01.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:01.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:21:01.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:01.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:21:01.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:01.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562533+0000", 2024-09-17T02:21:01.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3239999999999999e-06 2024-09-17T02:21:01.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:01.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562541+0000", 2024-09-17T02:21:01.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3529999999999997e-06 2024-09-17T02:21:01.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:01.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562559+0000", 2024-09-17T02:21:01.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8306000000000001e-05 2024-09-17T02:21:01.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562572+0000", 2024-09-17T02:21:01.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2993000000000001e-05 2024-09-17T02:21:01.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:01.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563230+0000", 2024-09-17T02:21:01.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00065806899999999995 2024-09-17T02:21:01.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:01.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563510+0000", 2024-09-17T02:21:01.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028016400000000001 2024-09-17T02:21:01.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:01.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563677+0000", 2024-09-17T02:21:01.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000166243 2024-09-17T02:21:01.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:01.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566312+0000", 2024-09-17T02:21:01.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026351349999999998 2024-09-17T02:21:01.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:01.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.582943+0000", 2024-09-17T02:21:01.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016631781000000002 2024-09-17T02:21:01.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:01.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583035+0000", 2024-09-17T02:21:01.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1682999999999996e-05 2024-09-17T02:21:01.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:01.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583113+0000", 2024-09-17T02:21:01.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7643000000000002e-05 2024-09-17T02:21:01.233 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.234 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:01.234 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.234 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:01.234 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:21:01.234 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.638973886000002, 2024-09-17T02:21:01.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020802284000000001, 2024-09-17T02:21:01.234 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:01.234 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:01.234 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:01.234 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:01.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:01.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:21:01.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:01.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:21:01.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:01.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562640+0000", 2024-09-17T02:21:01.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.37e-06 2024-09-17T02:21:01.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:01.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562648+0000", 2024-09-17T02:21:01.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.576e-06 2024-09-17T02:21:01.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:01.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562668+0000", 2024-09-17T02:21:01.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0397000000000001e-05 2024-09-17T02:21:01.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562690+0000", 2024-09-17T02:21:01.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1713e-05 2024-09-17T02:21:01.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:01.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564290+0000", 2024-09-17T02:21:01.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001599397 2024-09-17T02:21:01.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:01.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564527+0000", 2024-09-17T02:21:01.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023731199999999999 2024-09-17T02:21:01.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:01.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583441+0000", 2024-09-17T02:21:01.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018914519000000001 2024-09-17T02:21:01.237 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:21:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.638898810999997, 2024-09-17T02:21:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021867154, 2024-09-17T02:21:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:01.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:21:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:21:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562716+0000", 2024-09-17T02:21:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.384e-06 2024-09-17T02:21:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:01.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562726+0000", 2024-09-17T02:21:01.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.04e-05 2024-09-17T02:21:01.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:01.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562745+0000", 2024-09-17T02:21:01.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8770000000000002e-05 2024-09-17T02:21:01.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562759+0000", 2024-09-17T02:21:01.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4392999999999999e-05 2024-09-17T02:21:01.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:01.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565882+0000", 2024-09-17T02:21:01.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031227659999999999 2024-09-17T02:21:01.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:01.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566217+0000", 2024-09-17T02:21:01.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033498000000000002 2024-09-17T02:21:01.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:01.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584581+0000", 2024-09-17T02:21:01.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018364460999999999 2024-09-17T02:21:01.241 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562778+0000", 2024-09-17T02:21:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.638834674000002, 2024-09-17T02:21:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018969949, 2024-09-17T02:21:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562778+0000", 2024-09-17T02:21:01.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:01.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562778+0000", 2024-09-17T02:21:01.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:01.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562779+0000", 2024-09-17T02:21:01.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0470000000000001e-06 2024-09-17T02:21:01.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:01.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562798+0000", 2024-09-17T02:21:01.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8723e-05 2024-09-17T02:21:01.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:01.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562819+0000", 2024-09-17T02:21:01.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1192999999999999e-05 2024-09-17T02:21:01.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562834+0000", 2024-09-17T02:21:01.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4619e-05 2024-09-17T02:21:01.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:01.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562977+0000", 2024-09-17T02:21:01.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014338900000000001 2024-09-17T02:21:01.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:01.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563366+0000", 2024-09-17T02:21:01.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038909399999999999 2024-09-17T02:21:01.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:01.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.581748+0000", 2024-09-17T02:21:01.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018381884000000001 2024-09-17T02:21:01.245 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:26132 5.c 5:3ae49ef5:::benchmark_data_smithi001_23533_object26131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:41.688378+0000", 2024-09-17T02:21:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.513234592, 2024-09-17T02:21:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017107691000000001, 2024-09-17T02:21:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:01.246 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 26132 2024-09-17T02:21:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688378+0000", 2024-09-17T02:21:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688378+0000", 2024-09-17T02:21:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:01.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688379+0000", 2024-09-17T02:21:01.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.048e-06 2024-09-17T02:21:01.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:01.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688407+0000", 2024-09-17T02:21:01.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7271e-05 2024-09-17T02:21:01.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:01.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688418+0000", 2024-09-17T02:21:01.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1333e-05 2024-09-17T02:21:01.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688433+0000", 2024-09-17T02:21:01.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4764e-05 2024-09-17T02:21:01.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:01.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688971+0000", 2024-09-17T02:21:01.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00053786399999999999 2024-09-17T02:21:01.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:01.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.689087+0000", 2024-09-17T02:21:01.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000116385 2024-09-17T02:21:01.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:01.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.689226+0000", 2024-09-17T02:21:01.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013938199999999999 2024-09-17T02:21:01.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:01.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.691077+0000", 2024-09-17T02:21:01.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001850806 2024-09-17T02:21:01.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:01.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.705392+0000", 2024-09-17T02:21:01.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014315006999999999 2024-09-17T02:21:01.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:01.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.705449+0000", 2024-09-17T02:21:01.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7101000000000001e-05 2024-09-17T02:21:01.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:01.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.705486+0000", 2024-09-17T02:21:01.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6730000000000002e-05 2024-09-17T02:21:01.251 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.251 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:01.251 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.252 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:01.252 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:01.252 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.633149904, 2024-09-17T02:21:01.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:21:01.252 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:01.252 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:01.252 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:01.252 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:01.252 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:01.252 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:01.252 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:21:01.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.253 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:01.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:01.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:01.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:01.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:01.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:01.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:21:01.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:21:01.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:01.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:21:01.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:21:01.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:01.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:21:01.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:21:01.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:21:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:21:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:21:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:21:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:21:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:21:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:01.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:21:01.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:21:01.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:01.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:21:01.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:21:01.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:01.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:21:01.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:21:01.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:01.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:21:01.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:21:01.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:01.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:21:01.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:21:01.257 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.257 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:01.257 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.258 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:01.258 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:01.258 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.629247654, 2024-09-17T02:21:01.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:21:01.258 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:01.258 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:01.258 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:01.258 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:01.259 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:01.259 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:01.259 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:21:01.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.259 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:01.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:01.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:01.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:01.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:01.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:01.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:21:01.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:21:01.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:01.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:21:01.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:21:01.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:21:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:21:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:21:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:21:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:21:01.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:21:01.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:01.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:21:01.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:21:01.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:01.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:21:01.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:21:01.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:01.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:21:01.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:21:01.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:01.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:21:01.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:21:01.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:01.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:21:01.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:21:01.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:21:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:21:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:31663 5.8 5:18a4daab:::benchmark_data_smithi001_23533_object31662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-17T02:21:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:43.631605+0000", 2024-09-17T02:21:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.570008003000002, 2024-09-17T02:21:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017528834, 2024-09-17T02:21:01.265 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:01.265 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:01.265 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:01.265 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:01.265 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:01.265 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:01.265 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 31663 2024-09-17T02:21:01.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.265 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:01.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:01.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631605+0000", 2024-09-17T02:21:01.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:01.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631605+0000", 2024-09-17T02:21:01.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:01.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631606+0000", 2024-09-17T02:21:01.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:21:01.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:01.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631633+0000", 2024-09-17T02:21:01.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7455999999999999e-05 2024-09-17T02:21:01.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:01.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631640+0000", 2024-09-17T02:21:01.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8140000000000003e-06 2024-09-17T02:21:01.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631644+0000", 2024-09-17T02:21:01.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4790000000000001e-06 2024-09-17T02:21:01.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:01.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.636150+0000", 2024-09-17T02:21:01.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004506431 2024-09-17T02:21:01.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:01.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.636299+0000", 2024-09-17T02:21:01.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014900499999999999 2024-09-17T02:21:01.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:01.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.636448+0000", 2024-09-17T02:21:01.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000149087 2024-09-17T02:21:01.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:01.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.639522+0000", 2024-09-17T02:21:01.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030734600000000001 2024-09-17T02:21:01.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:01.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.649032+0000", 2024-09-17T02:21:01.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0095109129999999993 2024-09-17T02:21:01.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:01.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.649096+0000", 2024-09-17T02:21:01.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3702999999999996e-05 2024-09-17T02:21:01.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:01.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.649134+0000", 2024-09-17T02:21:01.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7706000000000001e-05 2024-09-17T02:21:01.271 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.271 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:01.271 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.271 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:60187 5.8 5:1830dbcb:::benchmark_data_smithi001_23533_object60186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-17T02:21:01.271 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:55.367795+0000", 2024-09-17T02:21:01.271 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.8338178450000004, 2024-09-17T02:21:01.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017899142, 2024-09-17T02:21:01.271 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:01.271 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:01.271 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:01.272 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:01.272 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:01.272 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:01.272 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 60187 2024-09-17T02:21:01.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.272 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:01.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:01.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:55.367795+0000", 2024-09-17T02:21:01.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:01.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:55.367795+0000", 2024-09-17T02:21:01.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:01.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:55.367796+0000", 2024-09-17T02:21:01.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2900000000000003e-07 2024-09-17T02:21:01.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:01.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:55.367903+0000", 2024-09-17T02:21:01.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107514 2024-09-17T02:21:01.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:55.367922+0000", 2024-09-17T02:21:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8947999999999999e-05 2024-09-17T02:21:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:55.367930+0000", 2024-09-17T02:21:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3200000000000002e-06 2024-09-17T02:21:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:55.379386+0000", 2024-09-17T02:21:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011456559 2024-09-17T02:21:01.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:01.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:55.379519+0000", 2024-09-17T02:21:01.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013242899999999999 2024-09-17T02:21:01.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:01.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:55.379661+0000", 2024-09-17T02:21:01.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000142189 2024-09-17T02:21:01.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:01.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:55.383731+0000", 2024-09-17T02:21:01.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040703249999999996 2024-09-17T02:21:01.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:01.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:55.385592+0000", 2024-09-17T02:21:01.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018606580000000001 2024-09-17T02:21:01.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:01.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:55.385643+0000", 2024-09-17T02:21:01.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1076999999999999e-05 2024-09-17T02:21:01.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:55.385694+0000", 2024-09-17T02:21:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1493999999999999e-05 2024-09-17T02:21:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:61986 5.3 5:c429de76:::benchmark_data_smithi001_23533_object61985:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-17T02:21:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:56.175175+0000", 2024-09-17T02:21:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.0264381660000002, 2024-09-17T02:21:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017413386999999999, 2024-09-17T02:21:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:01.278 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:01.278 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:01.278 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:01.278 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:01.278 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 61986 2024-09-17T02:21:01.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.278 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:01.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:01.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.175175+0000", 2024-09-17T02:21:01.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.175175+0000", 2024-09-17T02:21:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.175175+0000", 2024-09-17T02:21:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3300000000000003e-07 2024-09-17T02:21:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.175273+0000", 2024-09-17T02:21:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8079999999999996e-05 2024-09-17T02:21:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.175281+0000", 2024-09-17T02:21:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5599999999999996e-06 2024-09-17T02:21:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.175287+0000", 2024-09-17T02:21:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4520000000000002e-06 2024-09-17T02:21:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.175330+0000", 2024-09-17T02:21:01.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3022000000000002e-05 2024-09-17T02:21:01.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:01.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.175454+0000", 2024-09-17T02:21:01.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012327400000000001 2024-09-17T02:21:01.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:01.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.175577+0000", 2024-09-17T02:21:01.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012324600000000001 2024-09-17T02:21:01.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:01.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.182661+0000", 2024-09-17T02:21:01.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070836040000000003 2024-09-17T02:21:01.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:01.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.192487+0000", 2024-09-17T02:21:01.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00982623 2024-09-17T02:21:01.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:01.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.192543+0000", 2024-09-17T02:21:01.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6317999999999998e-05 2024-09-17T02:21:01.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:01.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.192588+0000", 2024-09-17T02:21:01.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5167999999999999e-05 2024-09-17T02:21:01.283 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.283 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:01.283 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.283 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:63394 5.8 5:1c2798fd:::benchmark_data_smithi001_23533_object63393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-17T02:21:01.283 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:56.816108+0000", 2024-09-17T02:21:01.283 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3855050230000003, 2024-09-17T02:21:01.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016202957, 2024-09-17T02:21:01.283 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:01.284 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:01.284 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:01.284 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:01.284 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:01.284 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:01.284 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 63394 2024-09-17T02:21:01.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.284 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:01.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:01.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816108+0000", 2024-09-17T02:21:01.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:01.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816108+0000", 2024-09-17T02:21:01.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:01.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816109+0000", 2024-09-17T02:21:01.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6800000000000009e-07 2024-09-17T02:21:01.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:01.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816207+0000", 2024-09-17T02:21:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8051e-05 2024-09-17T02:21:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816216+0000", 2024-09-17T02:21:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0750000000000004e-06 2024-09-17T02:21:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816224+0000", 2024-09-17T02:21:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2949999999999994e-06 2024-09-17T02:21:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816272+0000", 2024-09-17T02:21:01.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7475000000000002e-05 2024-09-17T02:21:01.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:01.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816394+0000", 2024-09-17T02:21:01.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012223400000000001 2024-09-17T02:21:01.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:01.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816531+0000", 2024-09-17T02:21:01.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013693200000000001 2024-09-17T02:21:01.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:01.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.820583+0000", 2024-09-17T02:21:01.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040517740000000002 2024-09-17T02:21:01.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:01.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.832229+0000", 2024-09-17T02:21:01.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011646315000000001 2024-09-17T02:21:01.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:01.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.832276+0000", 2024-09-17T02:21:01.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6629999999999999e-05 2024-09-17T02:21:01.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:01.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.832311+0000", 2024-09-17T02:21:01.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5207999999999999e-05 2024-09-17T02:21:01.289 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.289 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:01.289 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.289 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:63396 5.8 5:18063bc0:::benchmark_data_smithi001_23533_object63395:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-17T02:21:01.289 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:56.816278+0000", 2024-09-17T02:21:01.289 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3853351050000002, 2024-09-17T02:21:01.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016106551, 2024-09-17T02:21:01.290 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:01.290 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:01.290 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:01.290 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:01.290 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:01.290 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:01.290 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 63396 2024-09-17T02:21:01.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.290 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:01.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:01.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816278+0000", 2024-09-17T02:21:01.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:01.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816278+0000", 2024-09-17T02:21:01.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:01.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816278+0000", 2024-09-17T02:21:01.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5799999999999999e-07 2024-09-17T02:21:01.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:01.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816388+0000", 2024-09-17T02:21:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109957 2024-09-17T02:21:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816394+0000", 2024-09-17T02:21:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0109999999999997e-06 2024-09-17T02:21:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816398+0000", 2024-09-17T02:21:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7519999999999998e-06 2024-09-17T02:21:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:01.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.818312+0000", 2024-09-17T02:21:01.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019136660000000001 2024-09-17T02:21:01.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:01.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.818409+0000", 2024-09-17T02:21:01.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7534999999999994e-05 2024-09-17T02:21:01.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:01.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.818485+0000", 2024-09-17T02:21:01.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5957000000000005e-05 2024-09-17T02:21:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.821015+0000", 2024-09-17T02:21:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025296630000000001 2024-09-17T02:21:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.832317+0000", 2024-09-17T02:21:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011302296999999999 2024-09-17T02:21:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.832356+0000", 2024-09-17T02:21:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8349999999999997e-05 2024-09-17T02:21:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.832384+0000", 2024-09-17T02:21:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8804999999999999e-05 2024-09-17T02:21:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:63759 5.6 5:6be6d9a5:::benchmark_data_smithi001_23533_object63758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-17T02:21:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:56.989828+0000", 2024-09-17T02:21:01.296 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.2117852889999998, 2024-09-17T02:21:01.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016095569000000001, 2024-09-17T02:21:01.296 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:01.296 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:01.296 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:01.296 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:01.296 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:01.296 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:01.296 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 63759 2024-09-17T02:21:01.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.296 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:01.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:01.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.989828+0000", 2024-09-17T02:21:01.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:01.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.989828+0000", 2024-09-17T02:21:01.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:01.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.989828+0000", 2024-09-17T02:21:01.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8199999999999999e-07 2024-09-17T02:21:01.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:01.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.989860+0000", 2024-09-17T02:21:01.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1761000000000003e-05 2024-09-17T02:21:01.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:01.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.989868+0000", 2024-09-17T02:21:01.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.055e-06 2024-09-17T02:21:01.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.989877+0000", 2024-09-17T02:21:01.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6100000000000006e-06 2024-09-17T02:21:01.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:01.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.991708+0000", 2024-09-17T02:21:01.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018307359999999999 2024-09-17T02:21:01.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:01.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.991790+0000", 2024-09-17T02:21:01.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2134999999999999e-05 2024-09-17T02:21:01.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:01.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.991871+0000", 2024-09-17T02:21:01.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1407000000000002e-05 2024-09-17T02:21:01.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:01.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.995230+0000", 2024-09-17T02:21:01.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003358874 2024-09-17T02:21:01.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:01.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.005797+0000", 2024-09-17T02:21:01.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010567424000000001 2024-09-17T02:21:01.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:01.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.005866+0000", 2024-09-17T02:21:01.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8477000000000002e-05 2024-09-17T02:21:01.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:01.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.005923+0000", 2024-09-17T02:21:01.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7408000000000003e-05 2024-09-17T02:21:01.301 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.301 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:01.301 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.301 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:69512 5.5 5:a73c9abe:::benchmark_data_smithi001_23533_object69511:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-17T02:21:01.302 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:59.674435+0000", 2024-09-17T02:21:01.302 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.527177767, 2024-09-17T02:21:01.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016550764999999999, 2024-09-17T02:21:01.302 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:01.302 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:01.302 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:01.302 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:01.302 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:01.302 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:01.302 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 69512 2024-09-17T02:21:01.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.302 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:01.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:01.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:59.674435+0000", 2024-09-17T02:21:01.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:01.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:59.674435+0000", 2024-09-17T02:21:01.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:01.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:59.674436+0000", 2024-09-17T02:21:01.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0100000000000003e-07 2024-09-17T02:21:01.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:01.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:59.674510+0000", 2024-09-17T02:21:01.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3815999999999999e-05 2024-09-17T02:21:01.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:01.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:59.674519+0000", 2024-09-17T02:21:01.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2229999999999996e-06 2024-09-17T02:21:01.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:59.674529+0000", 2024-09-17T02:21:01.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6169999999999996e-06 2024-09-17T02:21:01.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:01.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:59.677723+0000", 2024-09-17T02:21:01.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031945459999999999 2024-09-17T02:21:01.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:01.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:59.677839+0000", 2024-09-17T02:21:01.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000115492 2024-09-17T02:21:01.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:01.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:59.677955+0000", 2024-09-17T02:21:01.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011616 2024-09-17T02:21:01.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:01.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:59.679712+0000", 2024-09-17T02:21:01.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017569650000000001 2024-09-17T02:21:01.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:01.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:59.690891+0000", 2024-09-17T02:21:01.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011179171999999999 2024-09-17T02:21:01.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:01.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:59.690945+0000", 2024-09-17T02:21:01.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3672999999999999e-05 2024-09-17T02:21:01.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:01.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:59.690986+0000", 2024-09-17T02:21:01.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1199999999999999e-05 2024-09-17T02:21:01.307 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.307 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:01.307 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.307 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:70193 5.c 5:3e064748:::benchmark_data_smithi001_23533_object70192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-17T02:21:01.308 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:00.001991+0000", 2024-09-17T02:21:01.308 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.1996220479999999, 2024-09-17T02:21:01.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017952037000000001, 2024-09-17T02:21:01.308 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:01.308 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:01.308 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:01.308 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:01.308 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:01.308 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:01.308 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 70193 2024-09-17T02:21:01.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.308 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:01.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:01.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:00.001991+0000", 2024-09-17T02:21:01.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:01.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:00.001991+0000", 2024-09-17T02:21:01.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:01.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:01.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:00.001992+0000", 2024-09-17T02:21:01.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1299999999999998e-07 2024-09-17T02:21:01.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:01.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:00.002075+0000", 2024-09-17T02:21:01.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2947000000000004e-05 2024-09-17T02:21:01.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:01.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:00.002086+0000", 2024-09-17T02:21:01.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1165000000000001e-05 2024-09-17T02:21:01.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:00.002093+0000", 2024-09-17T02:21:01.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0659999999999998e-06 2024-09-17T02:21:01.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:01.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:00.003627+0000", 2024-09-17T02:21:01.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015343430000000001 2024-09-17T02:21:01.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:01.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:00.003767+0000", 2024-09-17T02:21:01.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000139288 2024-09-17T02:21:01.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:01.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:00.003912+0000", 2024-09-17T02:21:01.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014490099999999999 2024-09-17T02:21:01.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:01.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:00.005997+0000", 2024-09-17T02:21:01.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020853730000000002 2024-09-17T02:21:01.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:01.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:00.019858+0000", 2024-09-17T02:21:01.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013861470000000001 2024-09-17T02:21:01.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:01.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:00.019909+0000", 2024-09-17T02:21:01.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0099000000000003e-05 2024-09-17T02:21:01.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:01.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:01.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:01.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:00.019943+0000", 2024-09-17T02:21:01.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4471999999999998e-05 2024-09-17T02:21:01.313 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.313 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:01.313 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.313 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:01.313 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:01.314 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:01.315 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:21:01.316 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:01.319+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:01.416 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:01.419+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:01.457 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:21:01.457 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-17T02:21:01.458 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.458 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:71101 5.1 5.c923a871 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-17T02:21:01.458 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:00.433010+0000", 2024-09-17T02:21:01.458 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 1.0270119769999999, 2024-09-17T02:21:01.458 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0270528539999999, 2024-09-17T02:21:01.458 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:01.458 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:01.458 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:01.458 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:01.458 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:01.458 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:01.458 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 71101 2024-09-17T02:21:01.458 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.459 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:01.459 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.459 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:01.459 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.433010+0000", 2024-09-17T02:21:01.459 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:01.459 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.459 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.459 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:01.459 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.433010+0000", 2024-09-17T02:21:01.459 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:01.459 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.459 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.459 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:01.460 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.433011+0000", 2024-09-17T02:21:01.460 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4700000000000001e-07 2024-09-17T02:21:01.460 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.460 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.460 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:01.460 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.433077+0000", 2024-09-17T02:21:01.460 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.6068999999999994e-05 2024-09-17T02:21:01.460 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.460 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.460 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:01.460 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.433084+0000", 2024-09-17T02:21:01.460 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3470000000000001e-06 2024-09-17T02:21:01.461 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.461 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.461 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.461 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.433089+0000", 2024-09-17T02:21:01.461 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8810000000000004e-06 2024-09-17T02:21:01.461 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.461 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.461 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:01.461 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.433132+0000", 2024-09-17T02:21:01.461 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2388000000000001e-05 2024-09-17T02:21:01.461 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.461 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.461 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:21:01.461 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.433138+0000", 2024-09-17T02:21:01.462 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0390000000000001e-06 2024-09-17T02:21:01.462 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.462 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.462 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:01.462 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:01.439712+0000", 2024-09-17T02:21:01.462 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0065744400000001 2024-09-17T02:21:01.462 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.462 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.462 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:21:01.462 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:01.439737+0000", 2024-09-17T02:21:01.462 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4782000000000001e-05 2024-09-17T02:21:01.462 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:01.462 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:01.462 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:01.463 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.463 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.463 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:71146 5.1 5.c3376fe1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-17T02:21:01.463 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:00.465975+0000", 2024-09-17T02:21:01.463 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.99404750399999997, 2024-09-17T02:21:01.463 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.99424729300000003, 2024-09-17T02:21:01.463 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:01.463 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:01.463 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:01.463 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:01.463 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:01.463 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:01.464 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 71146 2024-09-17T02:21:01.464 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.464 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:01.464 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.464 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:01.464 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.465975+0000", 2024-09-17T02:21:01.464 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:01.464 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.464 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.464 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:01.464 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.465975+0000", 2024-09-17T02:21:01.464 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:01.464 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.464 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.465 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:01.465 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.465976+0000", 2024-09-17T02:21:01.465 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5499999999999996e-07 2024-09-17T02:21:01.465 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.465 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.465 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:01.465 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.466007+0000", 2024-09-17T02:21:01.465 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1253e-05 2024-09-17T02:21:01.465 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.465 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.465 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:01.465 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.466017+0000", 2024-09-17T02:21:01.465 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8199999999999992e-06 2024-09-17T02:21:01.466 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.466 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.466 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.466 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.466023+0000", 2024-09-17T02:21:01.466 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0390000000000001e-06 2024-09-17T02:21:01.466 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.466 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.466 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:01.466 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.466066+0000", 2024-09-17T02:21:01.466 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3563999999999998e-05 2024-09-17T02:21:01.466 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.467 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.467 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:21:01.467 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.466073+0000", 2024-09-17T02:21:01.467 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0569999999999998e-06 2024-09-17T02:21:01.467 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.467 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.467 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:01.467 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:01.442328+0000", 2024-09-17T02:21:01.467 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.97625560600000005 2024-09-17T02:21:01.467 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.467 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.467 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:21:01.467 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:01.442337+0000", 2024-09-17T02:21:01.468 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1020000000000003e-06 2024-09-17T02:21:01.468 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:01.468 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:01.468 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:01.468 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.468 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.468 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:71150 5.1 5.e5ea3dc1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-17T02:21:01.468 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:00.470557+0000", 2024-09-17T02:21:01.468 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.98946519600000005, 2024-09-17T02:21:01.468 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.98978307799999998, 2024-09-17T02:21:01.468 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:01.468 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:01.469 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:01.469 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:01.469 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:01.469 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:01.469 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 71150 2024-09-17T02:21:01.469 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.469 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:01.469 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.469 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:01.469 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.470557+0000", 2024-09-17T02:21:01.469 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:01.469 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.469 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.469 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:01.470 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.470557+0000", 2024-09-17T02:21:01.470 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:01.470 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.470 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.470 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:01.470 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.470558+0000", 2024-09-17T02:21:01.470 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0999999999999998e-07 2024-09-17T02:21:01.470 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.470 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.470 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:01.470 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.470614+0000", 2024-09-17T02:21:01.470 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6523000000000001e-05 2024-09-17T02:21:01.470 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.471 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.471 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:01.471 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.470625+0000", 2024-09-17T02:21:01.471 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.025e-05 2024-09-17T02:21:01.471 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.471 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.471 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.471 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.470631+0000", 2024-09-17T02:21:01.471 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1369999999999999e-06 2024-09-17T02:21:01.471 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.471 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.471 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:01.471 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.470728+0000", 2024-09-17T02:21:01.471 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6772000000000001e-05 2024-09-17T02:21:01.472 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.472 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.472 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:21:01.472 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.470736+0000", 2024-09-17T02:21:01.472 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0420000000000003e-06 2024-09-17T02:21:01.472 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.472 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.472 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:01.472 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:01.442376+0000", 2024-09-17T02:21:01.472 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.97164039899999999 2024-09-17T02:21:01.472 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.472 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.472 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:21:01.473 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:01.442388+0000", 2024-09-17T02:21:01.473 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2147000000000001e-05 2024-09-17T02:21:01.473 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:01.473 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:01.473 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:01.473 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.473 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.473 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:71072 5.1 5:8c6dbf96:::benchmark_data_smithi001_23533_object71071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-17T02:21:01.473 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:00.413681+0000", 2024-09-17T02:21:01.473 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 1.046341172, 2024-09-17T02:21:01.473 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.046792363, 2024-09-17T02:21:01.473 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:01.474 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:01.474 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:01.474 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:01.474 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:01.474 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:01.474 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 71072 2024-09-17T02:21:01.474 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.474 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:01.474 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.474 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:01.474 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.413681+0000", 2024-09-17T02:21:01.474 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:01.474 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.475 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.475 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:01.475 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.413681+0000", 2024-09-17T02:21:01.475 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:01.475 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.475 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.475 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:01.475 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.413682+0000", 2024-09-17T02:21:01.475 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:21:01.475 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.475 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.475 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:01.476 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.413751+0000", 2024-09-17T02:21:01.476 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8577000000000004e-05 2024-09-17T02:21:01.476 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.476 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.476 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:01.476 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.413764+0000", 2024-09-17T02:21:01.476 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3183000000000001e-05 2024-09-17T02:21:01.476 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.476 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.476 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.476 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.413771+0000", 2024-09-17T02:21:01.476 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4359999999999996e-06 2024-09-17T02:21:01.477 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.477 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.477 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:01.477 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.413816+0000", 2024-09-17T02:21:01.477 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4508000000000001e-05 2024-09-17T02:21:01.477 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.477 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.477 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:01.477 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.413943+0000", 2024-09-17T02:21:01.477 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012687199999999999 2024-09-17T02:21:01.477 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.477 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.478 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:01.478 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.414115+0000", 2024-09-17T02:21:01.478 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017219199999999999 2024-09-17T02:21:01.478 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.478 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.478 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:01.478 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.419040+0000", 2024-09-17T02:21:01.478 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0049255610000000002 2024-09-17T02:21:01.478 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.478 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.478 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:01.478 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.422914+0000", 2024-09-17T02:21:01.479 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038733330000000001 2024-09-17T02:21:01.479 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.479 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.479 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:21:01.479 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.422925+0000", 2024-09-17T02:21:01.479 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0896999999999999e-05 2024-09-17T02:21:01.479 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.479 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.479 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:01.479 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:01.439307+0000", 2024-09-17T02:21:01.479 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.016382608 2024-09-17T02:21:01.479 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.479 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.480 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:21:01.480 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:01.439326+0000", 2024-09-17T02:21:01.480 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9003000000000001e-05 2024-09-17T02:21:01.480 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:01.480 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:01.480 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:01.480 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.480 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.480 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:71073 5.1 5:85b47cc1:::benchmark_data_smithi001_23533_object71072:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-17T02:21:01.480 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:00.414018+0000", 2024-09-17T02:21:01.480 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 1.0460044829999999, 2024-09-17T02:21:01.480 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0466130229999999, 2024-09-17T02:21:01.480 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:01.481 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:01.481 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:01.481 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:01.481 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:01.481 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:01.481 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 71073 2024-09-17T02:21:01.481 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.481 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:01.481 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.481 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:01.481 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.414018+0000", 2024-09-17T02:21:01.481 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:01.482 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.482 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.482 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:01.482 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.414018+0000", 2024-09-17T02:21:01.482 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:01.482 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.482 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.482 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:01.482 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.414019+0000", 2024-09-17T02:21:01.482 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2399999999999997e-07 2024-09-17T02:21:01.482 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.482 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.483 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:01.483 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.414141+0000", 2024-09-17T02:21:01.483 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012267800000000001 2024-09-17T02:21:01.483 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.483 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.483 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:01.483 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.414154+0000", 2024-09-17T02:21:01.483 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2292e-05 2024-09-17T02:21:01.483 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.483 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.483 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.483 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.414162+0000", 2024-09-17T02:21:01.483 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0560000000000005e-06 2024-09-17T02:21:01.484 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.484 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.484 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:01.484 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.416390+0000", 2024-09-17T02:21:01.484 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022283860000000002 2024-09-17T02:21:01.484 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.484 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.484 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:01.484 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.416489+0000", 2024-09-17T02:21:01.484 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8469999999999997e-05 2024-09-17T02:21:01.484 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.484 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.484 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:01.485 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.416582+0000", 2024-09-17T02:21:01.485 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.3122999999999996e-05 2024-09-17T02:21:01.485 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.485 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.485 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:01.485 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.422959+0000", 2024-09-17T02:21:01.485 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0063769070000000002 2024-09-17T02:21:01.485 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.485 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.485 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:21:01.485 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.422967+0000", 2024-09-17T02:21:01.485 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7870000000000007e-06 2024-09-17T02:21:01.485 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.486 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.486 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:01.486 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:01.439385+0000", 2024-09-17T02:21:01.486 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0164173249999999 2024-09-17T02:21:01.486 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.486 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.486 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:21:01.486 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:01.439417+0000", 2024-09-17T02:21:01.486 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2724e-05 2024-09-17T02:21:01.486 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:01.486 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:01.486 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:01.486 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.487 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.487 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:71123 5.1 5.27898831 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-17T02:21:01.487 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:00.443946+0000", 2024-09-17T02:21:01.487 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 1.0160762679999999, 2024-09-17T02:21:01.487 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.016848255, 2024-09-17T02:21:01.487 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:01.487 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:01.487 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:01.487 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:01.487 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:01.487 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:01.487 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 71123 2024-09-17T02:21:01.487 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.487 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:01.488 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.488 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:01.488 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.443946+0000", 2024-09-17T02:21:01.488 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:01.488 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.488 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.488 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:01.488 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.443946+0000", 2024-09-17T02:21:01.488 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:01.488 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.488 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.488 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:01.488 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.443948+0000", 2024-09-17T02:21:01.489 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.457e-06 2024-09-17T02:21:01.489 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.489 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.489 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:01.489 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.444018+0000", 2024-09-17T02:21:01.489 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0905e-05 2024-09-17T02:21:01.489 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.489 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.489 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:01.489 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.444032+0000", 2024-09-17T02:21:01.489 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3155e-05 2024-09-17T02:21:01.489 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.489 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.490 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.490 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.444041+0000", 2024-09-17T02:21:01.490 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4939999999999992e-06 2024-09-17T02:21:01.490 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.490 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.490 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:01.490 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.444115+0000", 2024-09-17T02:21:01.490 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3548999999999997e-05 2024-09-17T02:21:01.490 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.490 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.490 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:21:01.490 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.444121+0000", 2024-09-17T02:21:01.490 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.122e-06 2024-09-17T02:21:01.490 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.491 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.491 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:01.491 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:01.441976+0000", 2024-09-17T02:21:01.491 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.99785557199999997 2024-09-17T02:21:01.491 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.491 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.491 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:21:01.491 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:01.442008+0000", 2024-09-17T02:21:01.491 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1875999999999998e-05 2024-09-17T02:21:01.491 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:01.491 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:01.491 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:01.491 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.492 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.492 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:71126 5.1 5.402b5ab1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-17T02:21:01.492 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:00.446409+0000", 2024-09-17T02:21:01.492 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 1.0136132879999999, 2024-09-17T02:21:01.492 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0145031250000001, 2024-09-17T02:21:01.492 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:01.492 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:01.492 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:01.492 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:01.492 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:01.492 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:01.492 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 71126 2024-09-17T02:21:01.492 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.493 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:01.493 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.493 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:01.493 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.446409+0000", 2024-09-17T02:21:01.493 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:01.493 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.493 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.493 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:01.493 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.446409+0000", 2024-09-17T02:21:01.493 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:01.493 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.493 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.493 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:01.494 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.446410+0000", 2024-09-17T02:21:01.494 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.92e-07 2024-09-17T02:21:01.494 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.494 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.494 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:01.494 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.446478+0000", 2024-09-17T02:21:01.494 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7676999999999996e-05 2024-09-17T02:21:01.494 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.494 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.494 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:01.494 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.446489+0000", 2024-09-17T02:21:01.494 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1749999999999999e-05 2024-09-17T02:21:01.494 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.494 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.495 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.495 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.446497+0000", 2024-09-17T02:21:01.495 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3560000000000004e-06 2024-09-17T02:21:01.495 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.495 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.495 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:01.495 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.446534+0000", 2024-09-17T02:21:01.495 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7351000000000002e-05 2024-09-17T02:21:01.495 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.495 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.495 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:21:01.495 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.446542+0000", 2024-09-17T02:21:01.496 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9310000000000008e-06 2024-09-17T02:21:01.496 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.496 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.496 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:01.496 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:01.442171+0000", 2024-09-17T02:21:01.496 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.99562917399999995 2024-09-17T02:21:01.496 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.496 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.496 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:21:01.496 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:01.442184+0000", 2024-09-17T02:21:01.496 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2512e-05 2024-09-17T02:21:01.496 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:01.496 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:01.496 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:01.497 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.497 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.497 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:71133 5.1 5.63aa66b1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-17T02:21:01.497 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:00.451386+0000", 2024-09-17T02:21:01.497 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 1.008636356, 2024-09-17T02:21:01.497 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0096396540000001, 2024-09-17T02:21:01.497 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:01.497 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:01.497 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:01.497 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:01.497 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:01.497 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:01.497 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 71133 2024-09-17T02:21:01.497 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.498 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:01.498 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.498 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:01.498 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.451386+0000", 2024-09-17T02:21:01.498 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:01.498 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.498 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.498 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:01.498 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.451386+0000", 2024-09-17T02:21:01.498 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:01.498 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.498 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.498 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:01.499 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.451387+0000", 2024-09-17T02:21:01.499 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.9300000000000006e-07 2024-09-17T02:21:01.499 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.499 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.499 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:01.499 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.451427+0000", 2024-09-17T02:21:01.499 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9814000000000002e-05 2024-09-17T02:21:01.499 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.499 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.499 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:01.499 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.451439+0000", 2024-09-17T02:21:01.499 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2592000000000001e-05 2024-09-17T02:21:01.499 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.500 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.500 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.500 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.451448+0000", 2024-09-17T02:21:01.500 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3629999999999994e-06 2024-09-17T02:21:01.500 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.500 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.500 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:01.500 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.451492+0000", 2024-09-17T02:21:01.500 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4688999999999999e-05 2024-09-17T02:21:01.500 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.500 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.500 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:21:01.500 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.451500+0000", 2024-09-17T02:21:01.500 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3860000000000001e-06 2024-09-17T02:21:01.501 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.501 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.501 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:01.501 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:01.442235+0000", 2024-09-17T02:21:01.501 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.99073470699999999 2024-09-17T02:21:01.501 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.501 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.501 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:21:01.501 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:01.442248+0000", 2024-09-17T02:21:01.501 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3365e-05 2024-09-17T02:21:01.501 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:01.501 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:01.501 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:01.501 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.502 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.502 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:71098 5.1 5.8b6dd251 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-17T02:21:01.502 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:00.430314+0000", 2024-09-17T02:21:01.502 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 1.029708735, 2024-09-17T02:21:01.502 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.030824014, 2024-09-17T02:21:01.502 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:01.502 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:01.502 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:01.502 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:01.502 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:01.502 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:01.502 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 71098 2024-09-17T02:21:01.502 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.503 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:01.503 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.503 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:01.503 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.430314+0000", 2024-09-17T02:21:01.503 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:01.503 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.503 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.503 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:01.503 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.430314+0000", 2024-09-17T02:21:01.503 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:01.503 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.503 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.503 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:01.503 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.430315+0000", 2024-09-17T02:21:01.504 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.215e-06 2024-09-17T02:21:01.504 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.504 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.504 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:01.504 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.430410+0000", 2024-09-17T02:21:01.504 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5302000000000003e-05 2024-09-17T02:21:01.504 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.504 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.504 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:01.504 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.430420+0000", 2024-09-17T02:21:01.504 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0104e-05 2024-09-17T02:21:01.504 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.504 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.504 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.505 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.430427+0000", 2024-09-17T02:21:01.505 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1600000000000001e-06 2024-09-17T02:21:01.505 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.505 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.505 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:01.505 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.430496+0000", 2024-09-17T02:21:01.505 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8199000000000002e-05 2024-09-17T02:21:01.505 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.505 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.505 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:21:01.505 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.430507+0000", 2024-09-17T02:21:01.505 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1199000000000001e-05 2024-09-17T02:21:01.505 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.506 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.506 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:01.506 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:01.439602+0000", 2024-09-17T02:21:01.506 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0090953060000001 2024-09-17T02:21:01.506 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.506 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.506 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:21:01.506 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:01.439630+0000", 2024-09-17T02:21:01.506 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7546e-05 2024-09-17T02:21:01.506 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:01.506 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:01.506 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:01.506 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.506 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.507 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:71142 5.1 5.358c1aa1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-17T02:21:01.507 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:00.459989+0000", 2024-09-17T02:21:01.507 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 1.00003321, 2024-09-17T02:21:01.507 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0012596659999999, 2024-09-17T02:21:01.507 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:01.507 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:01.507 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:01.507 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:01.507 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:01.507 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:01.507 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 71142 2024-09-17T02:21:01.507 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.507 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:01.507 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.508 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:01.508 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.459989+0000", 2024-09-17T02:21:01.508 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:01.508 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.508 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.508 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:01.508 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.459989+0000", 2024-09-17T02:21:01.508 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:01.508 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.508 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.508 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:01.508 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.459990+0000", 2024-09-17T02:21:01.509 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0720000000000001e-06 2024-09-17T02:21:01.509 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.509 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.509 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:01.509 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.460048+0000", 2024-09-17T02:21:01.509 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7688000000000001e-05 2024-09-17T02:21:01.509 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.509 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.509 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:01.509 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.460061+0000", 2024-09-17T02:21:01.509 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2621e-05 2024-09-17T02:21:01.509 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.509 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.510 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:01.510 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.460067+0000", 2024-09-17T02:21:01.510 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0399999999999998e-06 2024-09-17T02:21:01.510 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.510 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.510 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:01.510 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.460121+0000", 2024-09-17T02:21:01.510 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4694000000000002e-05 2024-09-17T02:21:01.510 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.510 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.510 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:21:01.510 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:00.460131+0000", 2024-09-17T02:21:01.510 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4290000000000007e-06 2024-09-17T02:21:01.510 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.511 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.511 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:01.511 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:01.442287+0000", 2024-09-17T02:21:01.511 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.98215611999999997 2024-09-17T02:21:01.511 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:01.511 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:01.511 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:21:01.511 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:01.442296+0000", 2024-09-17T02:21:01.511 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9530000000000005e-06 2024-09-17T02:21:01.511 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:01.511 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:01.511 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:01.511 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:01.512 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-09-17T02:21:01.512 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 10 2024-09-17T02:21:01.512 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:21:01.512 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:21:01.513 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:21:01.517 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:01.519+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:01.618 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:01.622+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:01.638 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:21:01.638 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-17T02:21:01.638 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-09-17T02:21:01.638 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-09-17T02:21:01.638 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:21:01.652 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:21:01.665 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:21:01.665 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:21:01.686 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:21:01.687 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:21:01.705 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:21:01.705 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:21:01.719 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:01.722+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:01.770 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:01.770 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:01.771 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 29 16 71173 71157 153.338 0 - 0.00621912 2024-09-17T02:21:01.784 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:01.831 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:01.834+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:01.921 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:01.923+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:01.921 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:01.922 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:01.935 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:02.023 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:02.026+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:02.107 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:02.107 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:02.121 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:02.123 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:02.123+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:02.224 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:02.223+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:02.290 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:02.291 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:02.305 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:02.324 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:02.326+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:02.425 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:02.426+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:02.428 INFO:teuthology.orchestra.run.smithi001.stdout:moved 7 / 242 (2.89256%) 2024-09-17T02:21:02.428 INFO:teuthology.orchestra.run.smithi001.stdout:avg 80.6667 2024-09-17T02:21:02.428 INFO:teuthology.orchestra.run.smithi001.stdout:stddev 8.21922 -> 12.8149 (expected baseline 7.33333) 2024-09-17T02:21:02.428 INFO:teuthology.orchestra.run.smithi001.stdout:min osd.1 with 70 -> 63 pgs (0.867769 -> 0.780992 * mean) 2024-09-17T02:21:02.429 INFO:teuthology.orchestra.run.smithi001.stdout:max osd.2 with 90 -> 93 pgs (1.1157 -> 1.15289 * mean) 2024-09-17T02:21:02.429 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:21:02.429 INFO:teuthology.orchestra.run.smithi001.stdout:oload 110 2024-09-17T02:21:02.429 INFO:teuthology.orchestra.run.smithi001.stdout:max_change 0.05 2024-09-17T02:21:02.429 INFO:teuthology.orchestra.run.smithi001.stdout:max_change_osds 4 2024-09-17T02:21:02.429 INFO:teuthology.orchestra.run.smithi001.stdout:average_utilization 0.0026 2024-09-17T02:21:02.429 INFO:teuthology.orchestra.run.smithi001.stdout:overload_utilization 0.0029 2024-09-17T02:21:02.429 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1 weight 0.8363 -> 0.7863 2024-09-17T02:21:02.434 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:02.434 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:02.446 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T02:21:02.450 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:02.526 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:02.526+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:02.561 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:02.561 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:02.573 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:02.627 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:02.631+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:02.692 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:02.693 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:02.710 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:21:02.728 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:02.730+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:02.771 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 30 15 71245 71230 148.379 2.28125 0.00517293 0.00671506 2024-09-17T02:21:02.828 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:02.831+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:02.853 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:02.853 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:02.870 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:21:02.930 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:02.931+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:02.997 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:02.997 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:03.014 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:21:03.064 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:03.067+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:03.132 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:03.134+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:03.140 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:03.141 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:03.156 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:03.233 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:03.234+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:03.306 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:03.306 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:03.322 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:03.333 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:03.335+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:03.434 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:03.439+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:03.449 INFO:teuthology.orchestra.run.smithi001.stderr:nodeep-scrub is unset 2024-09-17T02:21:03.509 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:03.510 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:03.525 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:03.571 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:03.574+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:03.636 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:03.639+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:03.664 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:03.664 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:03.680 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:03.724 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:21:03.737 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:03.739+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:03.771 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 31 16 71255 71239 143.611 0.5625 0.00608412 0.006715 2024-09-17T02:21:03.812 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:03.812 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:03.826 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:03.838 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:03.838+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:03.888 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:21:03.888 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:21:03.909 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:21:03.909 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:21:03.933 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:21:03.933 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:21:03.939 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:03.942+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:03.951 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:03.951 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:21:03.951 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:21:03.951 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:21:03.951 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:03.965 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:04.041 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:04.043+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:04.136 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:04.137 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:21:04.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:21:04.137 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:04.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.137 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:04.137 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:21:04.138 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.572868812000003, 2024-09-17T02:21:04.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021799929999999999, 2024-09-17T02:21:04.138 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:04.138 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:04.138 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.138 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:04.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:04.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:21:04.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:04.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:21:04.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:04.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562007+0000", 2024-09-17T02:21:04.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6260000000000001e-06 2024-09-17T02:21:04.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:04.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562021+0000", 2024-09-17T02:21:04.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4440000000000001e-05 2024-09-17T02:21:04.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:04.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562053+0000", 2024-09-17T02:21:04.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2159000000000002e-05 2024-09-17T02:21:04.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562076+0000", 2024-09-17T02:21:04.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2926999999999999e-05 2024-09-17T02:21:04.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:04.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562218+0000", 2024-09-17T02:21:04.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000141726 2024-09-17T02:21:04.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:04.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562506+0000", 2024-09-17T02:21:04.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028752399999999999 2024-09-17T02:21:04.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:04.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562830+0000", 2024-09-17T02:21:04.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032427399999999999 2024-09-17T02:21:04.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:04.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566900+0000", 2024-09-17T02:21:04.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040705660000000003 2024-09-17T02:21:04.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583581+0000", 2024-09-17T02:21:04.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016680210000000001 2024-09-17T02:21:04.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:04.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583704+0000", 2024-09-17T02:21:04.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012289899999999999 2024-09-17T02:21:04.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:04.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583803+0000", 2024-09-17T02:21:04.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9579000000000003e-05 2024-09-17T02:21:04.144 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.144 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:04.144 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.144 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:04.144 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:21:04.144 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.572741600000001, 2024-09-17T02:21:04.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022056035000000002, 2024-09-17T02:21:04.144 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:04.144 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:04.144 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.144 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:04.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:04.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:21:04.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:04.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:21:04.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:04.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562132+0000", 2024-09-17T02:21:04.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6300000000000001e-06 2024-09-17T02:21:04.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:04.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562142+0000", 2024-09-17T02:21:04.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.022e-05 2024-09-17T02:21:04.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:04.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562164+0000", 2024-09-17T02:21:04.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2002999999999999e-05 2024-09-17T02:21:04.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562180+0000", 2024-09-17T02:21:04.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5930000000000002e-05 2024-09-17T02:21:04.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:04.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563517+0000", 2024-09-17T02:21:04.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001336776 2024-09-17T02:21:04.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:04.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563635+0000", 2024-09-17T02:21:04.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117976 2024-09-17T02:21:04.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:04.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563819+0000", 2024-09-17T02:21:04.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018411499999999999 2024-09-17T02:21:04.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:04.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566977+0000", 2024-09-17T02:21:04.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031575990000000001 2024-09-17T02:21:04.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583917+0000", 2024-09-17T02:21:04.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016940093999999999 2024-09-17T02:21:04.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:04.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584066+0000", 2024-09-17T02:21:04.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000149746 2024-09-17T02:21:04.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:04.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584186+0000", 2024-09-17T02:21:04.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011994600000000001 2024-09-17T02:21:04.150 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.150 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:04.150 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.151 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:04.151 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:04.151 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.572560889000002, 2024-09-17T02:21:04.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023664803000000002, 2024-09-17T02:21:04.151 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:04.151 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:04.151 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.151 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:04.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:04.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:04.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:04.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:04.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:04.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562313+0000", 2024-09-17T02:21:04.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.764e-06 2024-09-17T02:21:04.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:04.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562323+0000", 2024-09-17T02:21:04.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0166000000000001e-05 2024-09-17T02:21:04.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:04.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562343+0000", 2024-09-17T02:21:04.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9633999999999999e-05 2024-09-17T02:21:04.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562367+0000", 2024-09-17T02:21:04.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4556e-05 2024-09-17T02:21:04.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:04.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563777+0000", 2024-09-17T02:21:04.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014102330000000001 2024-09-17T02:21:04.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:04.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563969+0000", 2024-09-17T02:21:04.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000191361 2024-09-17T02:21:04.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:04.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564148+0000", 2024-09-17T02:21:04.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017934599999999999 2024-09-17T02:21:04.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:04.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566989+0000", 2024-09-17T02:21:04.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028407010000000002 2024-09-17T02:21:04.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585770+0000", 2024-09-17T02:21:04.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018781566999999999 2024-09-17T02:21:04.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:04.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585874+0000", 2024-09-17T02:21:04.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103489 2024-09-17T02:21:04.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:04.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585976+0000", 2024-09-17T02:21:04.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101986 2024-09-17T02:21:04.157 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.157 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:04.157 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.158 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:04.158 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:04.158 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.572478009000001, 2024-09-17T02:21:04.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024118555999999999, 2024-09-17T02:21:04.158 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:04.158 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:04.158 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.158 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:04.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:04.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:04.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:04.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:04.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:04.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562395+0000", 2024-09-17T02:21:04.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3969999999999999e-06 2024-09-17T02:21:04.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:04.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562405+0000", 2024-09-17T02:21:04.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4229999999999994e-06 2024-09-17T02:21:04.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:04.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562427+0000", 2024-09-17T02:21:04.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759999999999998e-05 2024-09-17T02:21:04.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562444+0000", 2024-09-17T02:21:04.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7019000000000001e-05 2024-09-17T02:21:04.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:04.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564681+0000", 2024-09-17T02:21:04.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022376929999999998 2024-09-17T02:21:04.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:04.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564887+0000", 2024-09-17T02:21:04.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000206178 2024-09-17T02:21:04.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:04.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565230+0000", 2024-09-17T02:21:04.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034233499999999998 2024-09-17T02:21:04.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:04.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567000+0000", 2024-09-17T02:21:04.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017706390000000001 2024-09-17T02:21:04.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586126+0000", 2024-09-17T02:21:04.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019125672 2024-09-17T02:21:04.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:04.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586314+0000", 2024-09-17T02:21:04.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018740200000000001 2024-09-17T02:21:04.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:04.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586513+0000", 2024-09-17T02:21:04.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019903799999999999 2024-09-17T02:21:04.164 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.164 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:04.164 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.164 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:04.164 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:21:04.164 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.572403336000001, 2024-09-17T02:21:04.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021940779000000001, 2024-09-17T02:21:04.165 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:04.165 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:04.165 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.165 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:04.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:04.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:21:04.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:04.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:21:04.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:04.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562470+0000", 2024-09-17T02:21:04.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5030000000000001e-06 2024-09-17T02:21:04.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:04.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562478+0000", 2024-09-17T02:21:04.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.157e-06 2024-09-17T02:21:04.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:04.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562496+0000", 2024-09-17T02:21:04.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7876e-05 2024-09-17T02:21:04.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562511+0000", 2024-09-17T02:21:04.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5067e-05 2024-09-17T02:21:04.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:04.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564628+0000", 2024-09-17T02:21:04.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021171860000000001 2024-09-17T02:21:04.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:04.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564838+0000", 2024-09-17T02:21:04.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000209283 2024-09-17T02:21:04.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:04.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565078+0000", 2024-09-17T02:21:04.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024075100000000001 2024-09-17T02:21:04.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:04.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567012+0000", 2024-09-17T02:21:04.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019331050000000001 2024-09-17T02:21:04.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584289+0000", 2024-09-17T02:21:04.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017277464999999999 2024-09-17T02:21:04.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:04.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584363+0000", 2024-09-17T02:21:04.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3852999999999999e-05 2024-09-17T02:21:04.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:04.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584409+0000", 2024-09-17T02:21:04.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6533000000000003e-05 2024-09-17T02:21:04.171 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.171 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:04.171 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.171 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:04.171 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:21:04.171 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.572339947000003, 2024-09-17T02:21:04.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020580694, 2024-09-17T02:21:04.172 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:04.172 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:04.172 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.172 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:04.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:04.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:21:04.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:04.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:21:04.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:04.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562533+0000", 2024-09-17T02:21:04.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3239999999999999e-06 2024-09-17T02:21:04.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:04.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562541+0000", 2024-09-17T02:21:04.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3529999999999997e-06 2024-09-17T02:21:04.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:04.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562559+0000", 2024-09-17T02:21:04.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8306000000000001e-05 2024-09-17T02:21:04.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562572+0000", 2024-09-17T02:21:04.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2993000000000001e-05 2024-09-17T02:21:04.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:04.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563230+0000", 2024-09-17T02:21:04.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00065806899999999995 2024-09-17T02:21:04.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:04.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563510+0000", 2024-09-17T02:21:04.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028016400000000001 2024-09-17T02:21:04.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:04.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563677+0000", 2024-09-17T02:21:04.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000166243 2024-09-17T02:21:04.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:04.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566312+0000", 2024-09-17T02:21:04.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026351349999999998 2024-09-17T02:21:04.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.582943+0000", 2024-09-17T02:21:04.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016631781000000002 2024-09-17T02:21:04.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:04.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583035+0000", 2024-09-17T02:21:04.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1682999999999996e-05 2024-09-17T02:21:04.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:04.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583113+0000", 2024-09-17T02:21:04.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7643000000000002e-05 2024-09-17T02:21:04.177 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.177 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:04.178 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.178 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:04.178 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:21:04.178 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.572232886999998, 2024-09-17T02:21:04.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020802284000000001, 2024-09-17T02:21:04.178 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:04.178 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:04.178 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:04.178 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:04.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:04.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:21:04.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:04.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:21:04.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:04.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562640+0000", 2024-09-17T02:21:04.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.37e-06 2024-09-17T02:21:04.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:04.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562648+0000", 2024-09-17T02:21:04.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.576e-06 2024-09-17T02:21:04.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:04.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562668+0000", 2024-09-17T02:21:04.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0397000000000001e-05 2024-09-17T02:21:04.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562690+0000", 2024-09-17T02:21:04.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1713e-05 2024-09-17T02:21:04.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:04.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564290+0000", 2024-09-17T02:21:04.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001599397 2024-09-17T02:21:04.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:04.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564527+0000", 2024-09-17T02:21:04.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023731199999999999 2024-09-17T02:21:04.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:04.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583441+0000", 2024-09-17T02:21:04.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018914519000000001 2024-09-17T02:21:04.183 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.183 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:04.183 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.184 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:04.184 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:21:04.184 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.572157812, 2024-09-17T02:21:04.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021867154, 2024-09-17T02:21:04.185 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:04.185 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:04.185 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:04.185 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:04.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:04.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:21:04.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:04.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:21:04.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:04.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562716+0000", 2024-09-17T02:21:04.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.384e-06 2024-09-17T02:21:04.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:04.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562726+0000", 2024-09-17T02:21:04.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.04e-05 2024-09-17T02:21:04.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:04.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562745+0000", 2024-09-17T02:21:04.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8770000000000002e-05 2024-09-17T02:21:04.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562759+0000", 2024-09-17T02:21:04.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4392999999999999e-05 2024-09-17T02:21:04.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:04.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565882+0000", 2024-09-17T02:21:04.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031227659999999999 2024-09-17T02:21:04.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:04.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566217+0000", 2024-09-17T02:21:04.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033498000000000002 2024-09-17T02:21:04.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:04.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584581+0000", 2024-09-17T02:21:04.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018364460999999999 2024-09-17T02:21:04.189 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.189 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:04.189 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.189 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:04.189 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562778+0000", 2024-09-17T02:21:04.189 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.572093674999998, 2024-09-17T02:21:04.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018969949, 2024-09-17T02:21:04.189 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:04.190 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:04.190 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:04.190 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:04.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:04.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562778+0000", 2024-09-17T02:21:04.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:04.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562778+0000", 2024-09-17T02:21:04.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:04.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562779+0000", 2024-09-17T02:21:04.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0470000000000001e-06 2024-09-17T02:21:04.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:04.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562798+0000", 2024-09-17T02:21:04.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8723e-05 2024-09-17T02:21:04.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:04.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562819+0000", 2024-09-17T02:21:04.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1192999999999999e-05 2024-09-17T02:21:04.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562834+0000", 2024-09-17T02:21:04.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4619e-05 2024-09-17T02:21:04.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:04.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562977+0000", 2024-09-17T02:21:04.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014338900000000001 2024-09-17T02:21:04.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:04.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563366+0000", 2024-09-17T02:21:04.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038909399999999999 2024-09-17T02:21:04.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:04.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.581748+0000", 2024-09-17T02:21:04.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018381884000000001 2024-09-17T02:21:04.193 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.193 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:04.193 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.194 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:26132 5.c 5:3ae49ef5:::benchmark_data_smithi001_23533_object26131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:04.194 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:41.688378+0000", 2024-09-17T02:21:04.194 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.446493593, 2024-09-17T02:21:04.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017107691000000001, 2024-09-17T02:21:04.194 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:04.194 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:04.194 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.194 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:04.194 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:04.194 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:04.194 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 26132 2024-09-17T02:21:04.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.195 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:04.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:04.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688378+0000", 2024-09-17T02:21:04.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:04.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688378+0000", 2024-09-17T02:21:04.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:04.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688379+0000", 2024-09-17T02:21:04.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.048e-06 2024-09-17T02:21:04.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:04.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688407+0000", 2024-09-17T02:21:04.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7271e-05 2024-09-17T02:21:04.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:04.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688418+0000", 2024-09-17T02:21:04.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1333e-05 2024-09-17T02:21:04.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688433+0000", 2024-09-17T02:21:04.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4764e-05 2024-09-17T02:21:04.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:04.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.688971+0000", 2024-09-17T02:21:04.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00053786399999999999 2024-09-17T02:21:04.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:04.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.689087+0000", 2024-09-17T02:21:04.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000116385 2024-09-17T02:21:04.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:04.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.689226+0000", 2024-09-17T02:21:04.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013938199999999999 2024-09-17T02:21:04.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.691077+0000", 2024-09-17T02:21:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001850806 2024-09-17T02:21:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.705392+0000", 2024-09-17T02:21:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014315006999999999 2024-09-17T02:21:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.705449+0000", 2024-09-17T02:21:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7101000000000001e-05 2024-09-17T02:21:04.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:04.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:41.705486+0000", 2024-09-17T02:21:04.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6730000000000002e-05 2024-09-17T02:21:04.200 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.200 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:04.200 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.200 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:04.200 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:04.200 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.566408904999999, 2024-09-17T02:21:04.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:21:04.201 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:04.201 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:04.201 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.201 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:04.201 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:04.201 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:04.201 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:21:04.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.201 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:04.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:21:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:21:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:04.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:21:04.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:21:04.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:04.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:21:04.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:21:04.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:21:04.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:21:04.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:04.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:21:04.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:21:04.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:04.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:21:04.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:21:04.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:04.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:21:04.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:21:04.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:04.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:21:04.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:21:04.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:21:04.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:21:04.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:04.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:21:04.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:21:04.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:04.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:21:04.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:21:04.207 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.207 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:04.207 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.207 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:04.207 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:04.208 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.562506655, 2024-09-17T02:21:04.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:21:04.208 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:04.208 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:04.208 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.208 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:04.208 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:04.208 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:04.208 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:21:04.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.208 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:04.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:04.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:04.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:04.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:04.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:04.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:21:04.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:21:04.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:21:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:21:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:21:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:21:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:21:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:21:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:21:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:21:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:21:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:21:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:04.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:21:04.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:21:04.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:04.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:21:04.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:21:04.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:21:04.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:21:04.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:04.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:21:04.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:21:04.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:04.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:21:04.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:21:04.213 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.213 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:04.213 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.214 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:31663 5.8 5:18a4daab:::benchmark_data_smithi001_23533_object31662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-17T02:21:04.214 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:43.631605+0000", 2024-09-17T02:21:04.214 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 20.503267004000001, 2024-09-17T02:21:04.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017528834, 2024-09-17T02:21:04.214 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:04.214 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:04.214 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.214 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:04.215 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:04.215 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:04.215 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 31663 2024-09-17T02:21:04.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.215 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:04.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:04.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631605+0000", 2024-09-17T02:21:04.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:04.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631605+0000", 2024-09-17T02:21:04.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:04.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631606+0000", 2024-09-17T02:21:04.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:21:04.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:04.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631633+0000", 2024-09-17T02:21:04.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7455999999999999e-05 2024-09-17T02:21:04.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631640+0000", 2024-09-17T02:21:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8140000000000003e-06 2024-09-17T02:21:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.631644+0000", 2024-09-17T02:21:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4790000000000001e-06 2024-09-17T02:21:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.636150+0000", 2024-09-17T02:21:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004506431 2024-09-17T02:21:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:04.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.636299+0000", 2024-09-17T02:21:04.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014900499999999999 2024-09-17T02:21:04.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:04.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.636448+0000", 2024-09-17T02:21:04.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000149087 2024-09-17T02:21:04.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.639522+0000", 2024-09-17T02:21:04.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030734600000000001 2024-09-17T02:21:04.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:04.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.649032+0000", 2024-09-17T02:21:04.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0095109129999999993 2024-09-17T02:21:04.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:04.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.649096+0000", 2024-09-17T02:21:04.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3702999999999996e-05 2024-09-17T02:21:04.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:04.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:43.649134+0000", 2024-09-17T02:21:04.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7706000000000001e-05 2024-09-17T02:21:04.220 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.220 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:04.220 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.220 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:60187 5.8 5:1830dbcb:::benchmark_data_smithi001_23533_object60186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-17T02:21:04.220 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:55.367795+0000", 2024-09-17T02:21:04.220 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7670768460000001, 2024-09-17T02:21:04.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017899142, 2024-09-17T02:21:04.221 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:04.221 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:04.221 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.221 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:04.221 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:04.221 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:04.221 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 60187 2024-09-17T02:21:04.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.221 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:04.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:04.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:55.367795+0000", 2024-09-17T02:21:04.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:04.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:55.367795+0000", 2024-09-17T02:21:04.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:55.367796+0000", 2024-09-17T02:21:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2900000000000003e-07 2024-09-17T02:21:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:55.367903+0000", 2024-09-17T02:21:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107514 2024-09-17T02:21:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:04.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:55.367922+0000", 2024-09-17T02:21:04.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8947999999999999e-05 2024-09-17T02:21:04.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:55.367930+0000", 2024-09-17T02:21:04.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3200000000000002e-06 2024-09-17T02:21:04.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:04.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:55.379386+0000", 2024-09-17T02:21:04.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011456559 2024-09-17T02:21:04.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:04.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:55.379519+0000", 2024-09-17T02:21:04.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013242899999999999 2024-09-17T02:21:04.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:04.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:55.379661+0000", 2024-09-17T02:21:04.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000142189 2024-09-17T02:21:04.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:55.383731+0000", 2024-09-17T02:21:04.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040703249999999996 2024-09-17T02:21:04.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:04.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:55.385592+0000", 2024-09-17T02:21:04.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018606580000000001 2024-09-17T02:21:04.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:04.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:55.385643+0000", 2024-09-17T02:21:04.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1076999999999999e-05 2024-09-17T02:21:04.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:04.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:55.385694+0000", 2024-09-17T02:21:04.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1493999999999999e-05 2024-09-17T02:21:04.227 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.227 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:04.227 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.227 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:61986 5.3 5:c429de76:::benchmark_data_smithi001_23533_object61985:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-17T02:21:04.227 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:56.175175+0000", 2024-09-17T02:21:04.227 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.9596971669999999, 2024-09-17T02:21:04.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017413386999999999, 2024-09-17T02:21:04.228 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:04.228 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:04.228 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.228 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:04.228 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:04.228 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:04.228 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 61986 2024-09-17T02:21:04.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.228 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:04.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:04.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.175175+0000", 2024-09-17T02:21:04.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:04.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.175175+0000", 2024-09-17T02:21:04.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:04.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.175175+0000", 2024-09-17T02:21:04.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3300000000000003e-07 2024-09-17T02:21:04.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:04.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.175273+0000", 2024-09-17T02:21:04.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8079999999999996e-05 2024-09-17T02:21:04.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:04.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.175281+0000", 2024-09-17T02:21:04.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5599999999999996e-06 2024-09-17T02:21:04.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.175287+0000", 2024-09-17T02:21:04.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4520000000000002e-06 2024-09-17T02:21:04.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.175330+0000", 2024-09-17T02:21:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3022000000000002e-05 2024-09-17T02:21:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.175454+0000", 2024-09-17T02:21:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012327400000000001 2024-09-17T02:21:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.175577+0000", 2024-09-17T02:21:04.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012324600000000001 2024-09-17T02:21:04.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:04.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.182661+0000", 2024-09-17T02:21:04.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070836040000000003 2024-09-17T02:21:04.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.192487+0000", 2024-09-17T02:21:04.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00982623 2024-09-17T02:21:04.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:04.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.192543+0000", 2024-09-17T02:21:04.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6317999999999998e-05 2024-09-17T02:21:04.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:04.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.192588+0000", 2024-09-17T02:21:04.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5167999999999999e-05 2024-09-17T02:21:04.233 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.233 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:04.233 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:63394 5.8 5:1c2798fd:::benchmark_data_smithi001_23533_object63393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-17T02:21:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:56.816108+0000", 2024-09-17T02:21:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.318764024, 2024-09-17T02:21:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016202957, 2024-09-17T02:21:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 63394 2024-09-17T02:21:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816108+0000", 2024-09-17T02:21:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816108+0000", 2024-09-17T02:21:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816109+0000", 2024-09-17T02:21:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6800000000000009e-07 2024-09-17T02:21:04.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:04.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816207+0000", 2024-09-17T02:21:04.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8051e-05 2024-09-17T02:21:04.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:04.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816216+0000", 2024-09-17T02:21:04.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0750000000000004e-06 2024-09-17T02:21:04.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816224+0000", 2024-09-17T02:21:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2949999999999994e-06 2024-09-17T02:21:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816272+0000", 2024-09-17T02:21:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7475000000000002e-05 2024-09-17T02:21:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816394+0000", 2024-09-17T02:21:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012223400000000001 2024-09-17T02:21:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:04.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816531+0000", 2024-09-17T02:21:04.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013693200000000001 2024-09-17T02:21:04.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.820583+0000", 2024-09-17T02:21:04.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040517740000000002 2024-09-17T02:21:04.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:04.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.832229+0000", 2024-09-17T02:21:04.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011646315000000001 2024-09-17T02:21:04.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:04.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.832276+0000", 2024-09-17T02:21:04.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6629999999999999e-05 2024-09-17T02:21:04.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:04.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.832311+0000", 2024-09-17T02:21:04.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5207999999999999e-05 2024-09-17T02:21:04.239 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.240 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:04.240 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.240 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:63396 5.8 5:18063bc0:::benchmark_data_smithi001_23533_object63395:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-17T02:21:04.240 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:56.816278+0000", 2024-09-17T02:21:04.240 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.3185941059999999, 2024-09-17T02:21:04.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016106551, 2024-09-17T02:21:04.240 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:04.240 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:04.240 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.240 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:04.240 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:04.241 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:04.241 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 63396 2024-09-17T02:21:04.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.241 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:04.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:04.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816278+0000", 2024-09-17T02:21:04.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:04.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816278+0000", 2024-09-17T02:21:04.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:04.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816278+0000", 2024-09-17T02:21:04.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5799999999999999e-07 2024-09-17T02:21:04.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:04.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816388+0000", 2024-09-17T02:21:04.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109957 2024-09-17T02:21:04.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:04.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816394+0000", 2024-09-17T02:21:04.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0109999999999997e-06 2024-09-17T02:21:04.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.816398+0000", 2024-09-17T02:21:04.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7519999999999998e-06 2024-09-17T02:21:04.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:04.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.818312+0000", 2024-09-17T02:21:04.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019136660000000001 2024-09-17T02:21:04.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:04.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.818409+0000", 2024-09-17T02:21:04.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7534999999999994e-05 2024-09-17T02:21:04.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:04.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.818485+0000", 2024-09-17T02:21:04.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5957000000000005e-05 2024-09-17T02:21:04.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.821015+0000", 2024-09-17T02:21:04.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025296630000000001 2024-09-17T02:21:04.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:04.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.832317+0000", 2024-09-17T02:21:04.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011302296999999999 2024-09-17T02:21:04.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:04.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.832356+0000", 2024-09-17T02:21:04.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8349999999999997e-05 2024-09-17T02:21:04.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.832384+0000", 2024-09-17T02:21:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8804999999999999e-05 2024-09-17T02:21:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:63759 5.6 5:6be6d9a5:::benchmark_data_smithi001_23533_object63758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-17T02:21:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:56.989828+0000", 2024-09-17T02:21:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.1450442900000004, 2024-09-17T02:21:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016095569000000001, 2024-09-17T02:21:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:04.247 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.247 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:04.247 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:04.247 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:04.247 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 63759 2024-09-17T02:21:04.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.247 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:04.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:04.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.989828+0000", 2024-09-17T02:21:04.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:04.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.989828+0000", 2024-09-17T02:21:04.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:04.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.989828+0000", 2024-09-17T02:21:04.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8199999999999999e-07 2024-09-17T02:21:04.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.989860+0000", 2024-09-17T02:21:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1761000000000003e-05 2024-09-17T02:21:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.989868+0000", 2024-09-17T02:21:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.055e-06 2024-09-17T02:21:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.989877+0000", 2024-09-17T02:21:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6100000000000006e-06 2024-09-17T02:21:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:04.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.991708+0000", 2024-09-17T02:21:04.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018307359999999999 2024-09-17T02:21:04.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:04.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.991790+0000", 2024-09-17T02:21:04.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2134999999999999e-05 2024-09-17T02:21:04.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:04.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.991871+0000", 2024-09-17T02:21:04.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1407000000000002e-05 2024-09-17T02:21:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:56.995230+0000", 2024-09-17T02:21:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003358874 2024-09-17T02:21:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.005797+0000", 2024-09-17T02:21:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010567424000000001 2024-09-17T02:21:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.005866+0000", 2024-09-17T02:21:04.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8477000000000002e-05 2024-09-17T02:21:04.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:04.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:57.005923+0000", 2024-09-17T02:21:04.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7408000000000003e-05 2024-09-17T02:21:04.252 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.252 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:04.252 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.252 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:69512 5.5 5:a73c9abe:::benchmark_data_smithi001_23533_object69511:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-17T02:21:04.252 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:59.674435+0000", 2024-09-17T02:21:04.253 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.4604367680000001, 2024-09-17T02:21:04.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016550764999999999, 2024-09-17T02:21:04.253 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:04.253 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:04.253 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.253 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:04.253 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:04.253 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:04.253 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 69512 2024-09-17T02:21:04.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.253 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:04.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:04.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:59.674435+0000", 2024-09-17T02:21:04.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:04.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:59.674435+0000", 2024-09-17T02:21:04.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:04.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:59.674436+0000", 2024-09-17T02:21:04.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0100000000000003e-07 2024-09-17T02:21:04.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:04.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:59.674510+0000", 2024-09-17T02:21:04.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3815999999999999e-05 2024-09-17T02:21:04.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:04.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:59.674519+0000", 2024-09-17T02:21:04.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2229999999999996e-06 2024-09-17T02:21:04.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:59.674529+0000", 2024-09-17T02:21:04.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6169999999999996e-06 2024-09-17T02:21:04.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:04.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:59.677723+0000", 2024-09-17T02:21:04.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031945459999999999 2024-09-17T02:21:04.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:04.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:59.677839+0000", 2024-09-17T02:21:04.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000115492 2024-09-17T02:21:04.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:04.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:59.677955+0000", 2024-09-17T02:21:04.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011616 2024-09-17T02:21:04.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:04.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:59.679712+0000", 2024-09-17T02:21:04.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017569650000000001 2024-09-17T02:21:04.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:59.690891+0000", 2024-09-17T02:21:04.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011179171999999999 2024-09-17T02:21:04.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:04.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:59.690945+0000", 2024-09-17T02:21:04.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3672999999999999e-05 2024-09-17T02:21:04.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:04.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:59.690986+0000", 2024-09-17T02:21:04.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1199999999999999e-05 2024-09-17T02:21:04.258 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.258 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:04.259 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.259 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:70193 5.c 5:3e064748:::benchmark_data_smithi001_23533_object70192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-17T02:21:04.259 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:00.001991+0000", 2024-09-17T02:21:04.259 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.1328810489999999, 2024-09-17T02:21:04.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017952037000000001, 2024-09-17T02:21:04.259 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:04.260 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:04.260 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.260 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:04.260 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:04.260 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:04.260 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 70193 2024-09-17T02:21:04.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.261 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:04.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:04.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:00.001991+0000", 2024-09-17T02:21:04.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:04.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:00.001991+0000", 2024-09-17T02:21:04.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:04.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:04.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:00.001992+0000", 2024-09-17T02:21:04.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1299999999999998e-07 2024-09-17T02:21:04.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:04.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:00.002075+0000", 2024-09-17T02:21:04.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2947000000000004e-05 2024-09-17T02:21:04.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:04.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:00.002086+0000", 2024-09-17T02:21:04.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1165000000000001e-05 2024-09-17T02:21:04.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:00.002093+0000", 2024-09-17T02:21:04.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0659999999999998e-06 2024-09-17T02:21:04.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:04.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:00.003627+0000", 2024-09-17T02:21:04.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015343430000000001 2024-09-17T02:21:04.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:04.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:00.003767+0000", 2024-09-17T02:21:04.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000139288 2024-09-17T02:21:04.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:04.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:00.003912+0000", 2024-09-17T02:21:04.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014490099999999999 2024-09-17T02:21:04.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:04.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:00.005997+0000", 2024-09-17T02:21:04.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020853730000000002 2024-09-17T02:21:04.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:00.019858+0000", 2024-09-17T02:21:04.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013861470000000001 2024-09-17T02:21:04.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:04.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:00.019909+0000", 2024-09-17T02:21:04.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0099000000000003e-05 2024-09-17T02:21:04.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:04.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:04.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:04.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:00.019943+0000", 2024-09-17T02:21:04.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4471999999999998e-05 2024-09-17T02:21:04.272 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.272 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:04.272 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.272 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:04.272 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:04.273 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:04.275 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:21:04.276 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:04.278+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:04.375 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:04.378+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:04.421 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:21:04.421 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-17T02:21:04.421 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-09-17T02:21:04.421 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:21:04.438 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:21:04.475 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:04.478+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:04.576 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:21:04.576 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-17T02:21:04.576 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-09-17T02:21:04.576 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-09-17T02:21:04.577 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:21:04.577 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:04.578+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:04.594 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:21:04.677 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:04.678+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:04.763 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:21:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-09-17T02:21:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-09-17T02:21:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-17T02:21:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-17T02:21:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:21:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 60.306843000999997, 2024-09-17T02:21:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.15597325500000001, 2024-09-17T02:21:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4164", 2024-09-17T02:21:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/201892753", 2024-09-17T02:21:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 1 2024-09-17T02:21:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:21:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:21:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458359+0000", 2024-09-17T02:21:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3929999999999998e-06 2024-09-17T02:21:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458373+0000", 2024-09-17T02:21:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4103e-05 2024-09-17T02:21:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458397+0000", 2024-09-17T02:21:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.438e-05 2024-09-17T02:21:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458421+0000", 2024-09-17T02:21:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3655999999999998e-05 2024-09-17T02:21:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458529+0000", 2024-09-17T02:21:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010752900000000001 2024-09-17T02:21:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:21:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458542+0000", 2024-09-17T02:21:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2986999999999999e-05 2024-09-17T02:21:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.611050+0000", 2024-09-17T02:21:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.1525087 2024-09-17T02:21:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.611529+0000", 2024-09-17T02:21:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00047844899999999999 2024-09-17T02:21:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.612061+0000", 2024-09-17T02:21:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00053230300000000003 2024-09-17T02:21:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.613451+0000", 2024-09-17T02:21:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0013897250000000001 2024-09-17T02:21:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614168+0000", 2024-09-17T02:21:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00071692499999999998 2024-09-17T02:21:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614265+0000", 2024-09-17T02:21:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7589000000000004e-05 2024-09-17T02:21:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614330+0000", 2024-09-17T02:21:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4516000000000004e-05 2024-09-17T02:21:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:21:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 48.208911882999999, 2024-09-17T02:21:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029713927000000001, 2024-09-17T02:21:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:21:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:21:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556289+0000", 2024-09-17T02:21:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.513e-06 2024-09-17T02:21:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556298+0000", 2024-09-17T02:21:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1630000000000002e-06 2024-09-17T02:21:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556318+0000", 2024-09-17T02:21:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9389999999999999e-05 2024-09-17T02:21:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556332+0000", 2024-09-17T02:21:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4506e-05 2024-09-17T02:21:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557304+0000", 2024-09-17T02:21:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00097169699999999999 2024-09-17T02:21:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557507+0000", 2024-09-17T02:21:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000203191 2024-09-17T02:21:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557838+0000", 2024-09-17T02:21:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033061100000000002 2024-09-17T02:21:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562171+0000", 2024-09-17T02:21:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043329229999999998 2024-09-17T02:21:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585737+0000", 2024-09-17T02:21:04.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023565915 2024-09-17T02:21:04.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:04.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585884+0000", 2024-09-17T02:21:04.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014744199999999999 2024-09-17T02:21:04.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:04.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586002+0000", 2024-09-17T02:21:04.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000117576 2024-09-17T02:21:04.779 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.779 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:04.779 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.779 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.779 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:04.779 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:21:04.779 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 48.208819910999999, 2024-09-17T02:21:04.779 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030933694000000001, 2024-09-17T02:21:04.779 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:04.779 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:04.779 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.779 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:04.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:21:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:21:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556381+0000", 2024-09-17T02:21:04.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2100000000000001e-06 2024-09-17T02:21:04.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:04.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556389+0000", 2024-09-17T02:21:04.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5539999999999998e-06 2024-09-17T02:21:04.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:04.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556408+0000", 2024-09-17T02:21:04.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8623000000000001e-05 2024-09-17T02:21:04.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556427+0000", 2024-09-17T02:21:04.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8566000000000001e-05 2024-09-17T02:21:04.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:04.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558741+0000", 2024-09-17T02:21:04.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023144390000000002 2024-09-17T02:21:04.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:04.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559040+0000", 2024-09-17T02:21:04.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029912100000000001 2024-09-17T02:21:04.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:04.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559222+0000", 2024-09-17T02:21:04.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018211200000000001 2024-09-17T02:21:04.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:04.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.566648+0000", 2024-09-17T02:21:04.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074257560000000004 2024-09-17T02:21:04.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.784 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587109+0000", 2024-09-17T02:21:04.784 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.020460685999999999 2024-09-17T02:21:04.784 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.784 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.784 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:04.784 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587232+0000", 2024-09-17T02:21:04.784 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123325 2024-09-17T02:21:04.784 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.784 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.784 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:04.784 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587313+0000", 2024-09-17T02:21:04.784 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1302000000000002e-05 2024-09-17T02:21:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:21:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 48.208754464999998, 2024-09-17T02:21:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031045538000000001, 2024-09-17T02:21:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:21:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:21:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556446+0000", 2024-09-17T02:21:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.26e-06 2024-09-17T02:21:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556454+0000", 2024-09-17T02:21:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1640000000000004e-06 2024-09-17T02:21:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556471+0000", 2024-09-17T02:21:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7586000000000001e-05 2024-09-17T02:21:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556485+0000", 2024-09-17T02:21:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3523000000000001e-05 2024-09-17T02:21:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559899+0000", 2024-09-17T02:21:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0034142140000000001 2024-09-17T02:21:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.560104+0000", 2024-09-17T02:21:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00020539199999999999 2024-09-17T02:21:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.560400+0000", 2024-09-17T02:21:04.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029612099999999999 2024-09-17T02:21:04.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.789 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.789 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:04.789 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.568427+0000", 2024-09-17T02:21:04.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0080262909999999996 2024-09-17T02:21:04.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.789 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.789 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.789 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587377+0000", 2024-09-17T02:21:04.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018950765000000001 2024-09-17T02:21:04.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.789 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.789 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:04.790 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587445+0000", 2024-09-17T02:21:04.790 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.724e-05 2024-09-17T02:21:04.790 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.790 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.790 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:04.790 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587491+0000", 2024-09-17T02:21:04.790 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5982000000000001e-05 2024-09-17T02:21:04.790 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.790 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:04.790 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.790 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.790 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.791 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:04.791 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:21:04.791 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 48.208691694999999, 2024-09-17T02:21:04.791 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031435547000000001, 2024-09-17T02:21:04.791 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:04.791 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:04.791 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.791 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:04.791 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.791 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:04.791 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:21:04.791 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.791 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.792 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:04.792 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:21:04.792 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.792 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.792 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:04.792 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556509+0000", 2024-09-17T02:21:04.792 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.06e-06 2024-09-17T02:21:04.792 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.792 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:04.792 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556515+0000", 2024-09-17T02:21:04.792 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1029999999999998e-06 2024-09-17T02:21:04.792 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.793 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:04.793 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556532+0000", 2024-09-17T02:21:04.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7054e-05 2024-09-17T02:21:04.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.793 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.793 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556545+0000", 2024-09-17T02:21:04.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3023000000000001e-05 2024-09-17T02:21:04.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.794 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:04.794 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561016+0000", 2024-09-17T02:21:04.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044705150000000004 2024-09-17T02:21:04.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.794 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.794 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:04.794 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561316+0000", 2024-09-17T02:21:04.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000299895 2024-09-17T02:21:04.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.794 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.794 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:04.794 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561651+0000", 2024-09-17T02:21:04.795 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033519300000000001 2024-09-17T02:21:04.795 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.795 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.795 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:04.795 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571105+0000", 2024-09-17T02:21:04.795 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094540539999999999 2024-09-17T02:21:04.795 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.795 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.795 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.795 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587628+0000", 2024-09-17T02:21:04.795 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016522819000000001 2024-09-17T02:21:04.795 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.796 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.796 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:04.796 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587770+0000", 2024-09-17T02:21:04.796 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000142352 2024-09-17T02:21:04.796 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.796 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.796 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:04.796 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587943+0000", 2024-09-17T02:21:04.796 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017347900000000001 2024-09-17T02:21:04.796 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.797 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:04.797 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.797 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.797 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.797 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:04.797 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:21:04.797 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 48.208635964999999, 2024-09-17T02:21:04.797 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031809104999999997, 2024-09-17T02:21:04.797 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:04.797 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:04.797 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.797 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:04.797 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.797 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:04.798 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:21:04.798 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.798 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.798 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.798 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:04.798 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:21:04.798 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.798 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.798 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.799 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:04.799 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556565+0000", 2024-09-17T02:21:04.799 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.116e-06 2024-09-17T02:21:04.799 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.799 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.799 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:04.799 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556572+0000", 2024-09-17T02:21:04.799 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0230000000000004e-06 2024-09-17T02:21:04.799 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.799 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.799 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:04.799 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556588+0000", 2024-09-17T02:21:04.799 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6643e-05 2024-09-17T02:21:04.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.800 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556606+0000", 2024-09-17T02:21:04.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7159999999999998e-05 2024-09-17T02:21:04.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.800 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:04.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562712+0000", 2024-09-17T02:21:04.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0061061630000000004 2024-09-17T02:21:04.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:04.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562919+0000", 2024-09-17T02:21:04.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000207309 2024-09-17T02:21:04.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:04.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563264+0000", 2024-09-17T02:21:04.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00034490699999999998 2024-09-17T02:21:04.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:04.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571812+0000", 2024-09-17T02:21:04.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0085477810000000008 2024-09-17T02:21:04.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588094+0000", 2024-09-17T02:21:04.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016282443000000001 2024-09-17T02:21:04.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.803 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.803 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:04.803 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588275+0000", 2024-09-17T02:21:04.803 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018058700000000001 2024-09-17T02:21:04.803 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.803 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.803 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:04.803 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588373+0000", 2024-09-17T02:21:04.803 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7973000000000005e-05 2024-09-17T02:21:04.803 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.804 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:04.804 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.804 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.804 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.804 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:04.804 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:21:04.804 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 48.208577865999999, 2024-09-17T02:21:04.804 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031950544999999997, 2024-09-17T02:21:04.804 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:04.804 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:04.805 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.805 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:04.805 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.805 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:04.805 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:21:04.805 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.805 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.805 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.805 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:04.806 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:21:04.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.806 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.806 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:04.806 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556623+0000", 2024-09-17T02:21:04.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.04e-06 2024-09-17T02:21:04.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.806 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.806 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:04.806 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556631+0000", 2024-09-17T02:21:04.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1529999999999997e-06 2024-09-17T02:21:04.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.806 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:04.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556648+0000", 2024-09-17T02:21:04.807 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6583999999999999e-05 2024-09-17T02:21:04.807 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.807 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556661+0000", 2024-09-17T02:21:04.807 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3203e-05 2024-09-17T02:21:04.807 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.807 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:04.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564413+0000", 2024-09-17T02:21:04.807 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0077523100000000001 2024-09-17T02:21:04.807 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.808 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.808 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:04.808 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.565841+0000", 2024-09-17T02:21:04.808 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014276320000000001 2024-09-17T02:21:04.808 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.808 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.808 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:04.808 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.566131+0000", 2024-09-17T02:21:04.808 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029043800000000001 2024-09-17T02:21:04.808 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.808 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.808 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:04.808 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572353+0000", 2024-09-17T02:21:04.809 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.006222399 2024-09-17T02:21:04.809 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.809 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.809 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.809 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588452+0000", 2024-09-17T02:21:04.809 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016098635 2024-09-17T02:21:04.809 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.809 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.809 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:04.809 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588520+0000", 2024-09-17T02:21:04.809 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8040000000000006e-05 2024-09-17T02:21:04.809 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.809 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.810 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:04.810 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588572+0000", 2024-09-17T02:21:04.810 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2111000000000003e-05 2024-09-17T02:21:04.810 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.810 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:04.810 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.810 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.810 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.810 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:04.810 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:21:04.810 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 48.208480700000003, 2024-09-17T02:21:04.810 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.032187205000000003, 2024-09-17T02:21:04.810 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:04.810 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:04.811 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.811 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:04.811 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.811 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:04.811 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:21:04.811 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.811 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.811 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.811 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:04.811 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:21:04.811 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.811 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.811 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.812 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:04.812 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556727+0000", 2024-09-17T02:21:04.812 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3000000000000002e-06 2024-09-17T02:21:04.812 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.812 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.812 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:04.812 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556736+0000", 2024-09-17T02:21:04.812 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4300000000000006e-06 2024-09-17T02:21:04.812 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.812 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.812 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:04.812 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556755+0000", 2024-09-17T02:21:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9700000000000001e-05 2024-09-17T02:21:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556771+0000", 2024-09-17T02:21:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5213e-05 2024-09-17T02:21:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571184+0000", 2024-09-17T02:21:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014413888999999999 2024-09-17T02:21:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:04.814 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571302+0000", 2024-09-17T02:21:04.814 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011794900000000001 2024-09-17T02:21:04.814 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.814 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.814 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:04.814 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571494+0000", 2024-09-17T02:21:04.814 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000191168 2024-09-17T02:21:04.814 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.814 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.814 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:04.814 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.573775+0000", 2024-09-17T02:21:04.814 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002281656 2024-09-17T02:21:04.814 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.815 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.815 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.815 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588668+0000", 2024-09-17T02:21:04.815 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014892699000000001 2024-09-17T02:21:04.815 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.815 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.815 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:04.815 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588813+0000", 2024-09-17T02:21:04.815 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014530700000000001 2024-09-17T02:21:04.815 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.815 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.815 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:04.815 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588906+0000", 2024-09-17T02:21:04.815 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2893999999999995e-05 2024-09-17T02:21:04.816 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.816 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:04.816 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.816 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.816 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.816 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:04.816 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:21:04.816 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 48.208339535, 2024-09-17T02:21:04.816 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028815922000000001, 2024-09-17T02:21:04.816 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:04.816 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:04.816 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.816 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:04.817 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.817 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:04.817 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:21:04.817 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.817 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.817 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.817 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:04.817 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:21:04.817 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.817 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.817 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.817 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:04.817 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556861+0000", 2024-09-17T02:21:04.817 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.08e-06 2024-09-17T02:21:04.818 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.818 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.818 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:04.818 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556867+0000", 2024-09-17T02:21:04.818 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.207e-06 2024-09-17T02:21:04.818 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.818 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.818 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:04.818 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556886+0000", 2024-09-17T02:21:04.818 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9137e-05 2024-09-17T02:21:04.818 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.818 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.818 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.818 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556900+0000", 2024-09-17T02:21:04.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3253e-05 2024-09-17T02:21:04.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:04.819 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558301+0000", 2024-09-17T02:21:04.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014008320000000001 2024-09-17T02:21:04.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:04.819 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558564+0000", 2024-09-17T02:21:04.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000263238 2024-09-17T02:21:04.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.820 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:04.820 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558905+0000", 2024-09-17T02:21:04.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000341534 2024-09-17T02:21:04.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.820 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:04.820 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.568208+0000", 2024-09-17T02:21:04.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0093023689999999996 2024-09-17T02:21:04.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.820 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.820 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585379+0000", 2024-09-17T02:21:04.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017171091999999999 2024-09-17T02:21:04.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.821 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:04.821 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585509+0000", 2024-09-17T02:21:04.821 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013036100000000001 2024-09-17T02:21:04.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.821 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:04.821 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585676+0000", 2024-09-17T02:21:04.821 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016681899999999999 2024-09-17T02:21:04.821 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.821 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:04.821 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.822 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.822 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.822 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:04.822 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:21:04.822 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 48.208282267999998, 2024-09-17T02:21:04.822 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030862568, 2024-09-17T02:21:04.822 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:04.822 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:04.822 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.822 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:04.822 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.822 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:04.822 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:21:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:21:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556918+0000", 2024-09-17T02:21:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0529999999999999e-06 2024-09-17T02:21:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556925+0000", 2024-09-17T02:21:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.6939999999999998e-06 2024-09-17T02:21:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556942+0000", 2024-09-17T02:21:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6803000000000002e-05 2024-09-17T02:21:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556955+0000", 2024-09-17T02:21:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2659e-05 2024-09-17T02:21:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:04.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558237+0000", 2024-09-17T02:21:04.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001282804 2024-09-17T02:21:04.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:04.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558495+0000", 2024-09-17T02:21:04.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000257178 2024-09-17T02:21:04.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:04.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562168+0000", 2024-09-17T02:21:04.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0036737110000000001 2024-09-17T02:21:04.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:04.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.570855+0000", 2024-09-17T02:21:04.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0086868729999999995 2024-09-17T02:21:04.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587568+0000", 2024-09-17T02:21:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016712444999999999 2024-09-17T02:21:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587677+0000", 2024-09-17T02:21:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000109879 2024-09-17T02:21:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587780+0000", 2024-09-17T02:21:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000102469 2024-09-17T02:21:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:04.828 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.828 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.828 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:04.828 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:21:04.828 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 48.208200136000002, 2024-09-17T02:21:04.828 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031005751000000002, 2024-09-17T02:21:04.828 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:04.828 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:04.828 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.829 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:04.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.829 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:04.829 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:21:04.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.829 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.829 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:04.829 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:21:04.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.829 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:04.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557001+0000", 2024-09-17T02:21:04.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.237e-06 2024-09-17T02:21:04.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:04.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557007+0000", 2024-09-17T02:21:04.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7270000000000001e-06 2024-09-17T02:21:04.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:04.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557025+0000", 2024-09-17T02:21:04.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7689999999999998e-05 2024-09-17T02:21:04.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557039+0000", 2024-09-17T02:21:04.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.385e-05 2024-09-17T02:21:04.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:04.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563783+0000", 2024-09-17T02:21:04.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0067437110000000003 2024-09-17T02:21:04.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:04.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564031+0000", 2024-09-17T02:21:04.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00024871799999999999 2024-09-17T02:21:04.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:04.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564518+0000", 2024-09-17T02:21:04.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00048708999999999997 2024-09-17T02:21:04.833 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.833 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:04.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572375+0000", 2024-09-17T02:21:04.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078564780000000001 2024-09-17T02:21:04.833 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.833 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587862+0000", 2024-09-17T02:21:04.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015486837999999999 2024-09-17T02:21:04.834 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.834 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.834 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:04.834 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587954+0000", 2024-09-17T02:21:04.834 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1766000000000002e-05 2024-09-17T02:21:04.834 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.834 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.834 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:04.834 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588005+0000", 2024-09-17T02:21:04.835 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1646e-05 2024-09-17T02:21:04.835 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.835 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:04.835 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.835 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.835 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.835 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:04.835 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:21:04.835 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 48.20805584, 2024-09-17T02:21:04.835 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029554871999999999, 2024-09-17T02:21:04.835 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:04.835 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:04.835 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.836 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:04.836 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.836 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:04.836 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:21:04.836 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.836 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.836 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.836 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:04.836 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:21:04.836 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.836 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.836 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:04.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557145+0000", 2024-09-17T02:21:04.837 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.263e-06 2024-09-17T02:21:04.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:04.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557151+0000", 2024-09-17T02:21:04.837 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1040000000000003e-06 2024-09-17T02:21:04.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:04.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557168+0000", 2024-09-17T02:21:04.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7289999999999999e-05 2024-09-17T02:21:04.838 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.838 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.838 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.838 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557182+0000", 2024-09-17T02:21:04.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.325e-05 2024-09-17T02:21:04.838 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.838 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.838 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:04.838 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564102+0000", 2024-09-17T02:21:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069199860000000004 2024-09-17T02:21:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564438+0000", 2024-09-17T02:21:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033651800000000001 2024-09-17T02:21:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.565422+0000", 2024-09-17T02:21:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00098332499999999995 2024-09-17T02:21:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.840 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:04.840 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572361+0000", 2024-09-17T02:21:04.840 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069392630000000002 2024-09-17T02:21:04.840 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.840 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.840 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.840 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586567+0000", 2024-09-17T02:21:04.840 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014206107000000001 2024-09-17T02:21:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586643+0000", 2024-09-17T02:21:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5673000000000005e-05 2024-09-17T02:21:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586699+0000", 2024-09-17T02:21:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6093e-05 2024-09-17T02:21:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.842 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:04.842 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.842 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.842 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.842 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:04.842 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:21:04.842 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 48.207922148000002, 2024-09-17T02:21:04.842 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029800569999999998, 2024-09-17T02:21:04.842 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:21:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:21:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557279+0000", 2024-09-17T02:21:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.497e-06 2024-09-17T02:21:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557287+0000", 2024-09-17T02:21:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9030000000000004e-06 2024-09-17T02:21:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557306+0000", 2024-09-17T02:21:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9394000000000001e-05 2024-09-17T02:21:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557323+0000", 2024-09-17T02:21:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6299000000000001e-05 2024-09-17T02:21:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.570931+0000", 2024-09-17T02:21:04.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013608841999999999 2024-09-17T02:21:04.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:04.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571250+0000", 2024-09-17T02:21:04.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031817400000000001 2024-09-17T02:21:04.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:04.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571559+0000", 2024-09-17T02:21:04.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000309835 2024-09-17T02:21:04.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:04.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.574161+0000", 2024-09-17T02:21:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002601543 2024-09-17T02:21:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586866+0000", 2024-09-17T02:21:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012704968000000001 2024-09-17T02:21:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586987+0000", 2024-09-17T02:21:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000121369 2024-09-17T02:21:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:04.848 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587078+0000", 2024-09-17T02:21:04.848 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0746000000000002e-05 2024-09-17T02:21:04.848 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.848 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:04.848 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.848 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.848 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.848 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:04.848 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:21:04.848 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 48.207856505000002, 2024-09-17T02:21:04.848 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029936054, 2024-09-17T02:21:04.848 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:04.848 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:04.848 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.849 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:04.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.849 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:04.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:21:04.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.849 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:04.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:21:04.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.849 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:04.850 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557344+0000", 2024-09-17T02:21:04.850 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.347e-06 2024-09-17T02:21:04.850 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.850 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.850 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:04.850 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557351+0000", 2024-09-17T02:21:04.850 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5560000000000004e-06 2024-09-17T02:21:04.850 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.850 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.851 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:04.851 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557369+0000", 2024-09-17T02:21:04.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7703e-05 2024-09-17T02:21:04.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.851 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.851 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.851 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557382+0000", 2024-09-17T02:21:04.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3664e-05 2024-09-17T02:21:04.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.851 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.851 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:04.851 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558997+0000", 2024-09-17T02:21:04.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0016147970000000001 2024-09-17T02:21:04.852 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.852 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.852 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:04.852 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559236+0000", 2024-09-17T02:21:04.852 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00023900200000000001 2024-09-17T02:21:04.852 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.852 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.852 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:04.852 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559547+0000", 2024-09-17T02:21:04.852 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031132399999999998 2024-09-17T02:21:04.852 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.852 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.852 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563130+0000", 2024-09-17T02:21:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003582989 2024-09-17T02:21:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587069+0000", 2024-09-17T02:21:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023938496 2024-09-17T02:21:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587192+0000", 2024-09-17T02:21:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123514 2024-09-17T02:21:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587279+0000", 2024-09-17T02:21:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6662000000000005e-05 2024-09-17T02:21:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:21:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 48.207798619000002, 2024-09-17T02:21:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030490703000000001, 2024-09-17T02:21:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:21:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:21:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557403+0000", 2024-09-17T02:21:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.77e-06 2024-09-17T02:21:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557412+0000", 2024-09-17T02:21:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4099999999999997e-06 2024-09-17T02:21:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557431+0000", 2024-09-17T02:21:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9177e-05 2024-09-17T02:21:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557444+0000", 2024-09-17T02:21:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2999999999999999e-05 2024-09-17T02:21:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557722+0000", 2024-09-17T02:21:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00027760699999999997 2024-09-17T02:21:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557991+0000", 2024-09-17T02:21:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00026892499999999999 2024-09-17T02:21:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558265+0000", 2024-09-17T02:21:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000274524 2024-09-17T02:21:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564270+0000", 2024-09-17T02:21:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060045339999999997 2024-09-17T02:21:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587701+0000", 2024-09-17T02:21:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023431285999999999 2024-09-17T02:21:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587803+0000", 2024-09-17T02:21:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000101371 2024-09-17T02:21:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587892+0000", 2024-09-17T02:21:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9098999999999995e-05 2024-09-17T02:21:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:21:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 48.207717023000001, 2024-09-17T02:21:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029886725999999999, 2024-09-17T02:21:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:21:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:21:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:04.861 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:21:04.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:04.861 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557484+0000", 2024-09-17T02:21:04.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.26e-06 2024-09-17T02:21:04.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557489+0000", 2024-09-17T02:21:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2530000000000004e-06 2024-09-17T02:21:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557507+0000", 2024-09-17T02:21:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7473999999999999e-05 2024-09-17T02:21:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557524+0000", 2024-09-17T02:21:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7912999999999999e-05 2024-09-17T02:21:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572428+0000", 2024-09-17T02:21:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014903451999999999 2024-09-17T02:21:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572589+0000", 2024-09-17T02:21:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000161299 2024-09-17T02:21:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587369+0000", 2024-09-17T02:21:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014780075 2024-09-17T02:21:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28720 5.f 5:f8a7aea5:::benchmark_data_smithi001_23533_object28719:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.197412708000002, 2024-09-17T02:21:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.033978608, 2024-09-17T02:21:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:04.865 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:04.865 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.865 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:04.865 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:04.865 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:04.865 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28720 2024-09-17T02:21:04.865 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.865 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:04.865 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.865 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:04.866 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:04.866 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.866 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:04.866 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:04.866 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.866 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3200000000000005e-07 2024-09-17T02:21:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567856+0000", 2024-09-17T02:21:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8596000000000005e-05 2024-09-17T02:21:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567864+0000", 2024-09-17T02:21:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6040000000000004e-06 2024-09-17T02:21:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.868 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.868 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567867+0000", 2024-09-17T02:21:04.868 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7929999999999999e-06 2024-09-17T02:21:04.868 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.868 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.868 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:04.868 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567896+0000", 2024-09-17T02:21:04.868 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8444000000000001e-05 2024-09-17T02:21:04.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:04.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567983+0000", 2024-09-17T02:21:04.869 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7498999999999997e-05 2024-09-17T02:21:04.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:04.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568078+0000", 2024-09-17T02:21:04.869 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5050999999999995e-05 2024-09-17T02:21:04.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.870 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:04.870 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573091+0000", 2024-09-17T02:21:04.870 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050124599999999998 2024-09-17T02:21:04.870 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.870 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.870 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.870 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601705+0000", 2024-09-17T02:21:04.870 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028614298999999999 2024-09-17T02:21:04.870 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.870 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.871 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:04.871 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601741+0000", 2024-09-17T02:21:04.871 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5329e-05 2024-09-17T02:21:04.871 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.871 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.871 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:04.871 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601766+0000", 2024-09-17T02:21:04.871 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5001e-05 2024-09-17T02:21:04.871 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.871 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:04.872 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.872 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.872 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.872 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28723 5.f 5:f1a2a8f6:::benchmark_data_smithi001_23533_object28722:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:04.872 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:21:04.872 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.197134028000001, 2024-09-17T02:21:04.872 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.033805288000000003, 2024-09-17T02:21:04.872 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:04.872 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:04.872 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.872 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:04.872 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:04.873 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:04.873 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28723 2024-09-17T02:21:04.873 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.873 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:04.873 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.873 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:04.873 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:21:04.873 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.873 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.874 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.874 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:04.874 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:21:04.874 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.874 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.874 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.874 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:04.874 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568067+0000", 2024-09-17T02:21:04.874 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6700000000000002e-07 2024-09-17T02:21:04.874 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.874 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.875 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:04.875 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568121+0000", 2024-09-17T02:21:04.875 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4286000000000002e-05 2024-09-17T02:21:04.875 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.875 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.875 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:04.875 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568131+0000", 2024-09-17T02:21:04.875 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0288e-05 2024-09-17T02:21:04.875 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.875 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.876 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.876 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568139+0000", 2024-09-17T02:21:04.876 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5399999999999998e-06 2024-09-17T02:21:04.876 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.876 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.876 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:04.876 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569194+0000", 2024-09-17T02:21:04.876 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0010557100000000001 2024-09-17T02:21:04.876 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.876 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.876 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:04.876 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569298+0000", 2024-09-17T02:21:04.876 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000103491 2024-09-17T02:21:04.877 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.877 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.877 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:04.877 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569428+0000", 2024-09-17T02:21:04.877 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013050599999999999 2024-09-17T02:21:04.877 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.877 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.877 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:04.877 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573124+0000", 2024-09-17T02:21:04.877 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0036956810000000001 2024-09-17T02:21:04.877 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.878 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.878 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.878 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601801+0000", 2024-09-17T02:21:04.878 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028676667999999999 2024-09-17T02:21:04.878 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.878 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.878 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:04.878 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601835+0000", 2024-09-17T02:21:04.878 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4347000000000002e-05 2024-09-17T02:21:04.878 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.878 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.878 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601871+0000", 2024-09-17T02:21:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5803999999999998e-05 2024-09-17T02:21:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28729 5.9 5:9e3b1489:::benchmark_data_smithi001_23533_object28728:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:21:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.195515377, 2024-09-17T02:21:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.032738525999999997, 2024-09-17T02:21:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:04.880 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:04.880 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:04.880 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28729 2024-09-17T02:21:04.880 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.880 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:04.880 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.880 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:04.880 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:21:04.880 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.880 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.880 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.880 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:04.880 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:21:04.881 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.881 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.881 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.881 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:04.881 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569685+0000", 2024-09-17T02:21:04.881 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8599999999999996e-07 2024-09-17T02:21:04.881 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.881 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.881 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:04.881 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569725+0000", 2024-09-17T02:21:04.881 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0144000000000001e-05 2024-09-17T02:21:04.881 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.881 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.881 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:04.882 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569737+0000", 2024-09-17T02:21:04.882 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1752e-05 2024-09-17T02:21:04.882 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.882 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.882 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.882 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569745+0000", 2024-09-17T02:21:04.882 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6420000000000007e-06 2024-09-17T02:21:04.882 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.882 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.882 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:04.882 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569801+0000", 2024-09-17T02:21:04.882 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6110000000000003e-05 2024-09-17T02:21:04.882 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.882 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569944+0000", 2024-09-17T02:21:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014361500000000001 2024-09-17T02:21:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.570234+0000", 2024-09-17T02:21:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00028927899999999998 2024-09-17T02:21:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572606+0000", 2024-09-17T02:21:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023725529999999999 2024-09-17T02:21:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.884 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.884 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602361+0000", 2024-09-17T02:21:04.884 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029755031000000001 2024-09-17T02:21:04.884 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.884 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.884 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:04.884 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602397+0000", 2024-09-17T02:21:04.884 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5509000000000002e-05 2024-09-17T02:21:04.884 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.884 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.884 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:04.884 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602423+0000", 2024-09-17T02:21:04.885 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5905e-05 2024-09-17T02:21:04.885 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.885 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:04.885 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.885 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.885 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.885 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28734 5.f 5:f1a63647:::benchmark_data_smithi001_23533_object28733:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:04.885 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:21:04.885 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.193792891000001, 2024-09-17T02:21:04.885 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.034441100000000002, 2024-09-17T02:21:04.885 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:04.885 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28734 2024-09-17T02:21:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:21:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:21:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571408+0000", 2024-09-17T02:21:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.8899999999999998e-07 2024-09-17T02:21:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571464+0000", 2024-09-17T02:21:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6546999999999999e-05 2024-09-17T02:21:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.888 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.888 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:04.888 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571474+0000", 2024-09-17T02:21:04.888 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0348e-05 2024-09-17T02:21:04.888 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.888 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.888 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:04.888 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571480+0000", 2024-09-17T02:21:04.888 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.366e-06 2024-09-17T02:21:04.888 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.888 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572097+0000", 2024-09-17T02:21:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061710599999999997 2024-09-17T02:21:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572172+0000", 2024-09-17T02:21:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4658000000000002e-05 2024-09-17T02:21:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572247+0000", 2024-09-17T02:21:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5766000000000006e-05 2024-09-17T02:21:04.890 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.890 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.890 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:04.890 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573819+0000", 2024-09-17T02:21:04.890 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015713649999999999 2024-09-17T02:21:04.890 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.890 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.890 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:04.890 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605762+0000", 2024-09-17T02:21:04.890 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031943304999999998 2024-09-17T02:21:04.890 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.890 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.890 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:04.891 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605808+0000", 2024-09-17T02:21:04.891 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5776999999999999e-05 2024-09-17T02:21:04.891 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:04.891 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:04.891 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:04.891 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605848+0000", 2024-09-17T02:21:04.891 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9972999999999998e-05 2024-09-17T02:21:04.891 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.891 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:04.891 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.891 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:04.892 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:04.892 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:21:04.893 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 32 16 71532 71516 139.664 17.3125 0.00417287 0.00715563 2024-09-17T02:21:04.893 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:04.894+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:04.894 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:04.994 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:04.994+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:05.059 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:05.059 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:05.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.059 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:72109 5.4 5.499e8ea4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:05.059 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:05.059585+0000", 2024-09-17T02:21:05.059 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0052258440000000003, 2024-09-17T02:21:05.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052421059999999998, 2024-09-17T02:21:05.059 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:05.059 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:05.059 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:05.059 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:05.060 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:05.060 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:05.060 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 72109 2024-09-17T02:21:05.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.060 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:05.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:05.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059585+0000", 2024-09-17T02:21:05.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:05.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059585+0000", 2024-09-17T02:21:05.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:05.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059586+0000", 2024-09-17T02:21:05.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.153e-06 2024-09-17T02:21:05.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:05.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059666+0000", 2024-09-17T02:21:05.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0093999999999996e-05 2024-09-17T02:21:05.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:05.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059677+0000", 2024-09-17T02:21:05.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0786e-05 2024-09-17T02:21:05.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059684+0000", 2024-09-17T02:21:05.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0729999999999999e-06 2024-09-17T02:21:05.062 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.062 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:05.063 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.063 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:72113 5.4 5.833b1344 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:05.063 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:05.059974+0000", 2024-09-17T02:21:05.063 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0048367430000000001, 2024-09-17T02:21:05.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048914520000000001, 2024-09-17T02:21:05.063 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:05.063 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:05.063 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:05.063 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:05.063 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:05.064 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:05.064 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 72113 2024-09-17T02:21:05.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.064 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:05.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:05.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059974+0000", 2024-09-17T02:21:05.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:05.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059974+0000", 2024-09-17T02:21:05.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:05.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059975+0000", 2024-09-17T02:21:05.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6600000000000005e-07 2024-09-17T02:21:05.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:05.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.060002+0000", 2024-09-17T02:21:05.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6602e-05 2024-09-17T02:21:05.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:05.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.060011+0000", 2024-09-17T02:21:05.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4730000000000006e-06 2024-09-17T02:21:05.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.060017+0000", 2024-09-17T02:21:05.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.331e-06 2024-09-17T02:21:05.066 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.066 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:05.066 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.067 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:72116 5.d e39/26 5:b5495b14:::benchmark_data_smithi001_23533_object72115:head v 39'4532, mlcod=39'4529)", 2024-09-17T02:21:05.067 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:05.062801+0000", 2024-09-17T02:21:05.067 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0020100819999999998, 2024-09-17T02:21:05.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002097883, 2024-09-17T02:21:05.067 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:05.067 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:05.067 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:05.067 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:05.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:05.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.062801+0000", 2024-09-17T02:21:05.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:05.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.062801+0000", 2024-09-17T02:21:05.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:05.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.062801+0000", 2024-09-17T02:21:05.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2200000000000004e-07 2024-09-17T02:21:05.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:05.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.062857+0000", 2024-09-17T02:21:05.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5803000000000001e-05 2024-09-17T02:21:05.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:05.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.062868+0000", 2024-09-17T02:21:05.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0797e-05 2024-09-17T02:21:05.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.062875+0000", 2024-09-17T02:21:05.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5830000000000003e-06 2024-09-17T02:21:05.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:05.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.062918+0000", 2024-09-17T02:21:05.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3449999999999999e-05 2024-09-17T02:21:05.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:05.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.062938+0000", 2024-09-17T02:21:05.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9930000000000001e-05 2024-09-17T02:21:05.070 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.070 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:05.070 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.071 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:72123 5.4 5.51ef62a4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:05.071 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:05.063089+0000", 2024-09-17T02:21:05.071 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0017222369999999999, 2024-09-17T02:21:05.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001841896, 2024-09-17T02:21:05.071 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:05.071 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:05.071 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:05.071 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:05.071 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:05.071 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:05.071 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 72123 2024-09-17T02:21:05.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.072 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:05.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:05.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.063089+0000", 2024-09-17T02:21:05.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:05.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.063089+0000", 2024-09-17T02:21:05.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:05.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.063090+0000", 2024-09-17T02:21:05.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1829999999999999e-06 2024-09-17T02:21:05.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:05.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.063205+0000", 2024-09-17T02:21:05.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115634 2024-09-17T02:21:05.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:05.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.063217+0000", 2024-09-17T02:21:05.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.202e-05 2024-09-17T02:21:05.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.063226+0000", 2024-09-17T02:21:05.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5469999999999997e-06 2024-09-17T02:21:05.074 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.074 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:05.075 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.075 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.075 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:21:05.075 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 4 2024-09-17T02:21:05.075 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:05.082 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:05.094 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:05.095+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:05.195 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:05.198+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:05.292 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:05.293 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:21:05.293 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:21:05.293 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:21:05.293 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:05.296 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:05.298+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:05.316 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:05.397 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:05.399+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:05.473 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T02:21:05.498 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:05.498+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:05.534 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:05.534 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:21:05.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:21:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:21:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.980148022999998, 2024-09-17T02:21:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035535028000000003, 2024-09-17T02:21:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:21:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:05.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:21:05.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:05.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556550+0000", 2024-09-17T02:21:05.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3500000000000001e-06 2024-09-17T02:21:05.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:05.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556566+0000", 2024-09-17T02:21:05.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5440000000000001e-05 2024-09-17T02:21:05.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:05.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556594+0000", 2024-09-17T02:21:05.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8552999999999999e-05 2024-09-17T02:21:05.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556618+0000", 2024-09-17T02:21:05.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3207e-05 2024-09-17T02:21:05.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:05.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578337+0000", 2024-09-17T02:21:05.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021719517000000001 2024-09-17T02:21:05.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:05.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578655+0000", 2024-09-17T02:21:05.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031837800000000002 2024-09-17T02:21:05.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:05.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.581374+0000", 2024-09-17T02:21:05.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002718238 2024-09-17T02:21:05.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.540 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:05.540 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587083+0000", 2024-09-17T02:21:05.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005708912 2024-09-17T02:21:05.540 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.540 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:05.540 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591823+0000", 2024-09-17T02:21:05.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047406080000000003 2024-09-17T02:21:05.540 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.540 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:05.540 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591972+0000", 2024-09-17T02:21:05.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014874199999999999 2024-09-17T02:21:05.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:05.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592082+0000", 2024-09-17T02:21:05.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110083 2024-09-17T02:21:05.541 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.541 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:05.541 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.542 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:05.542 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:21:05.542 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.979206536, 2024-09-17T02:21:05.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035128756999999997, 2024-09-17T02:21:05.542 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:05.542 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:05.542 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:05.542 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:05.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:05.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:21:05.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:05.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:21:05.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:05.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557491+0000", 2024-09-17T02:21:05.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.88e-06 2024-09-17T02:21:05.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:05.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557504+0000", 2024-09-17T02:21:05.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2864000000000001e-05 2024-09-17T02:21:05.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:05.545 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557535+0000", 2024-09-17T02:21:05.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0916e-05 2024-09-17T02:21:05.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.545 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557561+0000", 2024-09-17T02:21:05.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5602999999999999e-05 2024-09-17T02:21:05.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:05.545 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582290+0000", 2024-09-17T02:21:05.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024729729999999998 2024-09-17T02:21:05.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:05.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582642+0000", 2024-09-17T02:21:05.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035143499999999999 2024-09-17T02:21:05.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:05.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582959+0000", 2024-09-17T02:21:05.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031747399999999999 2024-09-17T02:21:05.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:05.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587302+0000", 2024-09-17T02:21:05.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043425169999999997 2024-09-17T02:21:05.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:05.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592391+0000", 2024-09-17T02:21:05.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050895799999999998 2024-09-17T02:21:05.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:05.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592516+0000", 2024-09-17T02:21:05.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012420500000000001 2024-09-17T02:21:05.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.548 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:05.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592617+0000", 2024-09-17T02:21:05.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010155299999999999 2024-09-17T02:21:05.548 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.548 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:05.548 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.548 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.548 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:05.548 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:21:05.549 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.979102036999997, 2024-09-17T02:21:05.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034796066, 2024-09-17T02:21:05.549 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:05.549 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:05.549 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:05.549 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:05.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:05.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:21:05.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:05.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:21:05.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:05.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557594+0000", 2024-09-17T02:21:05.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3769999999999999e-06 2024-09-17T02:21:05.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.551 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:05.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557683+0000", 2024-09-17T02:21:05.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8896999999999999e-05 2024-09-17T02:21:05.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.551 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:05.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557707+0000", 2024-09-17T02:21:05.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3839e-05 2024-09-17T02:21:05.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557730+0000", 2024-09-17T02:21:05.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3047000000000001e-05 2024-09-17T02:21:05.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:05.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582329+0000", 2024-09-17T02:21:05.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024599283999999999 2024-09-17T02:21:05.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:05.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582624+0000", 2024-09-17T02:21:05.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000294462 2024-09-17T02:21:05.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:05.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582936+0000", 2024-09-17T02:21:05.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031223399999999999 2024-09-17T02:21:05.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:05.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587347+0000", 2024-09-17T02:21:05.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044110340000000003 2024-09-17T02:21:05.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:05.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592165+0000", 2024-09-17T02:21:05.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048176699999999996 2024-09-17T02:21:05.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:05.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592311+0000", 2024-09-17T02:21:05.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014661899999999999 2024-09-17T02:21:05.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:05.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592389+0000", 2024-09-17T02:21:05.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7602999999999995e-05 2024-09-17T02:21:05.554 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.554 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:05.554 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.555 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:05.555 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:21:05.555 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.978584410000003, 2024-09-17T02:21:05.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034457472000000003, 2024-09-17T02:21:05.555 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:05.555 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:05.555 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:05.555 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:05.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:05.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:21:05.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:05.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:21:05.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:05.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558113+0000", 2024-09-17T02:21:05.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1639999999999999e-06 2024-09-17T02:21:05.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:05.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558125+0000", 2024-09-17T02:21:05.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2269999999999999e-05 2024-09-17T02:21:05.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:05.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558458+0000", 2024-09-17T02:21:05.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033322700000000001 2024-09-17T02:21:05.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558488+0000", 2024-09-17T02:21:05.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.951e-05 2024-09-17T02:21:05.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:05.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584514+0000", 2024-09-17T02:21:05.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026025721000000002 2024-09-17T02:21:05.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:05.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584781+0000", 2024-09-17T02:21:05.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000267142 2024-09-17T02:21:05.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:05.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585078+0000", 2024-09-17T02:21:05.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029738799999999999 2024-09-17T02:21:05.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:05.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588045+0000", 2024-09-17T02:21:05.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029673759999999999 2024-09-17T02:21:05.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:05.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592454+0000", 2024-09-17T02:21:05.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044090209999999999 2024-09-17T02:21:05.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:05.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592520+0000", 2024-09-17T02:21:05.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6032999999999996e-05 2024-09-17T02:21:05.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:05.562 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592568+0000", 2024-09-17T02:21:05.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7620000000000001e-05 2024-09-17T02:21:05.562 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.562 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:05.562 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.562 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:05.562 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:21:05.562 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.978124159000004, 2024-09-17T02:21:05.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031603266999999997, 2024-09-17T02:21:05.562 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:05.562 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:05.563 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:05.563 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:05.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:05.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:21:05.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:05.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:21:05.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:05.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558573+0000", 2024-09-17T02:21:05.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0660000000000002e-06 2024-09-17T02:21:05.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:05.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558585+0000", 2024-09-17T02:21:05.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1596999999999999e-05 2024-09-17T02:21:05.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:05.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558612+0000", 2024-09-17T02:21:05.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7115999999999999e-05 2024-09-17T02:21:05.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558631+0000", 2024-09-17T02:21:05.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9519999999999999e-05 2024-09-17T02:21:05.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:05.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558783+0000", 2024-09-17T02:21:05.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152025 2024-09-17T02:21:05.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-17T02:21:05.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558798+0000", 2024-09-17T02:21:05.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4966999999999999e-05 2024-09-17T02:21:05.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:05.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.572871+0000", 2024-09-17T02:21:05.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014072782000000001 2024-09-17T02:21:05.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:05.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573153+0000", 2024-09-17T02:21:05.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028214499999999998 2024-09-17T02:21:05.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:05.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573432+0000", 2024-09-17T02:21:05.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027932100000000002 2024-09-17T02:21:05.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:05.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582279+0000", 2024-09-17T02:21:05.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0088463310000000007 2024-09-17T02:21:05.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:05.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.589902+0000", 2024-09-17T02:21:05.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0076236050000000003 2024-09-17T02:21:05.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:05.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.589997+0000", 2024-09-17T02:21:05.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4456000000000005e-05 2024-09-17T02:21:05.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:05.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590174+0000", 2024-09-17T02:21:05.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000177336 2024-09-17T02:21:05.569 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.569 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:05.569 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.569 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:05.569 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:21:05.569 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.978020913999998, 2024-09-17T02:21:05.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031899064999999997, 2024-09-17T02:21:05.569 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:05.569 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:05.570 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:05.570 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:05.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:05.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:21:05.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.572 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:05.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:21:05.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:05.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558676+0000", 2024-09-17T02:21:05.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.39e-06 2024-09-17T02:21:05.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:05.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558686+0000", 2024-09-17T02:21:05.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.022e-05 2024-09-17T02:21:05.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:05.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558708+0000", 2024-09-17T02:21:05.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2249999999999999e-05 2024-09-17T02:21:05.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558725+0000", 2024-09-17T02:21:05.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7387000000000001e-05 2024-09-17T02:21:05.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:05.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558940+0000", 2024-09-17T02:21:05.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021453800000000001 2024-09-17T02:21:05.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting_for_map not empty", 2024-09-17T02:21:05.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558951+0000", 2024-09-17T02:21:05.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1303e-05 2024-09-17T02:21:05.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:05.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576237+0000", 2024-09-17T02:21:05.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017285723999999999 2024-09-17T02:21:05.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:05.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576454+0000", 2024-09-17T02:21:05.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021673800000000001 2024-09-17T02:21:05.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:05.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576932+0000", 2024-09-17T02:21:05.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047792700000000001 2024-09-17T02:21:05.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:05.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585689+0000", 2024-09-17T02:21:05.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0087572880000000002 2024-09-17T02:21:05.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:05.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590287+0000", 2024-09-17T02:21:05.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045978060000000003 2024-09-17T02:21:05.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:05.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590447+0000", 2024-09-17T02:21:05.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000160719 2024-09-17T02:21:05.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:05.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590573+0000", 2024-09-17T02:21:05.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012577500000000001 2024-09-17T02:21:05.577 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.578 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:05.578 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.578 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:05.578 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:21:05.578 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.977942943999999, 2024-09-17T02:21:05.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034114029999999997, 2024-09-17T02:21:05.578 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:05.578 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:05.578 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:05.578 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:05.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:05.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:21:05.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:05.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:21:05.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:05.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558753+0000", 2024-09-17T02:21:05.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2699999999999999e-06 2024-09-17T02:21:05.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:05.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558769+0000", 2024-09-17T02:21:05.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5906e-05 2024-09-17T02:21:05.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:05.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558791+0000", 2024-09-17T02:21:05.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1342999999999999e-05 2024-09-17T02:21:05.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558806+0000", 2024-09-17T02:21:05.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5829999999999999e-05 2024-09-17T02:21:05.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:05.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584906+0000", 2024-09-17T02:21:05.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026099273999999999 2024-09-17T02:21:05.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:05.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585158+0000", 2024-09-17T02:21:05.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025194600000000002 2024-09-17T02:21:05.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:05.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585368+0000", 2024-09-17T02:21:05.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210068 2024-09-17T02:21:05.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:05.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588098+0000", 2024-09-17T02:21:05.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002730522 2024-09-17T02:21:05.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:05.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592680+0000", 2024-09-17T02:21:05.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045816019999999997 2024-09-17T02:21:05.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:05.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592774+0000", 2024-09-17T02:21:05.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3726000000000004e-05 2024-09-17T02:21:05.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:05.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592866+0000", 2024-09-17T02:21:05.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2542999999999998e-05 2024-09-17T02:21:05.584 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.584 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:05.584 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.584 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:05.584 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:21:05.584 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.977866640999999, 2024-09-17T02:21:05.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031407875000000002, 2024-09-17T02:21:05.584 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:05.584 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:05.585 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:05.585 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:05.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:05.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:21:05.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:05.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:21:05.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:05.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558830+0000", 2024-09-17T02:21:05.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3599999999999999e-06 2024-09-17T02:21:05.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:05.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558835+0000", 2024-09-17T02:21:05.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6130000000000003e-06 2024-09-17T02:21:05.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:05.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558853+0000", 2024-09-17T02:21:05.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8099999999999999e-05 2024-09-17T02:21:05.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558869+0000", 2024-09-17T02:21:05.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.59e-05 2024-09-17T02:21:05.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:05.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560437+0000", 2024-09-17T02:21:05.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015677989999999999 2024-09-17T02:21:05.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-17T02:21:05.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560453+0000", 2024-09-17T02:21:05.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.535e-05 2024-09-17T02:21:05.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:05.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562422+0000", 2024-09-17T02:21:05.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00196934 2024-09-17T02:21:05.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:05.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562773+0000", 2024-09-17T02:21:05.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035152399999999998 2024-09-17T02:21:05.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:05.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590236+0000", 2024-09-17T02:21:05.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.027462889000000001 2024-09-17T02:21:05.589 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.589 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:05.589 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.589 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28720 5.f e28/22 5:f8a7aea5:::benchmark_data_smithi001_23533_object28719:head v 28'1756, mlcod=28'1754)", 2024-09-17T02:21:05.589 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:21:05.589 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.966575144, 2024-09-17T02:21:05.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033308717000000002, 2024-09-17T02:21:05.590 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:05.590 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:05.590 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:05.590 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:05.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:05.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:21:05.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:05.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:21:05.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:05.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570121+0000", 2024-09-17T02:21:05.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4e-07 2024-09-17T02:21:05.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:05.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570208+0000", 2024-09-17T02:21:05.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6945000000000002e-05 2024-09-17T02:21:05.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:05.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570222+0000", 2024-09-17T02:21:05.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4541e-05 2024-09-17T02:21:05.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570232+0000", 2024-09-17T02:21:05.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3039999999999994e-06 2024-09-17T02:21:05.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:05.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570273+0000", 2024-09-17T02:21:05.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1950999999999999e-05 2024-09-17T02:21:05.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:05.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570286+0000", 2024-09-17T02:21:05.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2268e-05 2024-09-17T02:21:05.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:05.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603312+0000", 2024-09-17T02:21:05.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033026405000000002 2024-09-17T02:21:05.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:05.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603429+0000", 2024-09-17T02:21:05.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116463 2024-09-17T02:21:05.594 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.594 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:05.594 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.594 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28721 5.a e28/22 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head v 28'1872, mlcod=28'1869)", 2024-09-17T02:21:05.594 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:21:05.594 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.966431638, 2024-09-17T02:21:05.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033539817999999999, 2024-09-17T02:21:05.594 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:05.594 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:05.594 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:05.594 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:21:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:21:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570264+0000", 2024-09-17T02:21:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0999999999999997e-07 2024-09-17T02:21:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:05.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570299+0000", 2024-09-17T02:21:05.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4876999999999998e-05 2024-09-17T02:21:05.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:05.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570310+0000", 2024-09-17T02:21:05.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0958000000000001e-05 2024-09-17T02:21:05.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570316+0000", 2024-09-17T02:21:05.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.485e-06 2024-09-17T02:21:05.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:05.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598947+0000", 2024-09-17T02:21:05.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.028631058000000001 2024-09-17T02:21:05.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:05.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598969+0000", 2024-09-17T02:21:05.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2005999999999999e-05 2024-09-17T02:21:05.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:05.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.602638+0000", 2024-09-17T02:21:05.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036690339999999998 2024-09-17T02:21:05.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:05.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603803+0000", 2024-09-17T02:21:05.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00116559 2024-09-17T02:21:05.598 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.598 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:05.598 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.598 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28723 5.f e28/22 5:f1a2a8f6:::benchmark_data_smithi001_23533_object28722:head v 28'1757, mlcod=28'1754)", 2024-09-17T02:21:05.598 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.571446+0000", 2024-09-17T02:21:05.598 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.965249310000001, 2024-09-17T02:21:05.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.032047203000000003, 2024-09-17T02:21:05.599 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:05.599 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:05.599 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:05.599 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:05.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:05.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571446+0000", 2024-09-17T02:21:05.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:05.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571446+0000", 2024-09-17T02:21:05.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:05.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571447+0000", 2024-09-17T02:21:05.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0979999999999999e-06 2024-09-17T02:21:05.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:05.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571554+0000", 2024-09-17T02:21:05.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107464 2024-09-17T02:21:05.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:05.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598891+0000", 2024-09-17T02:21:05.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.027336905000000002 2024-09-17T02:21:05.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598905+0000", 2024-09-17T02:21:05.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:21:05.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:05.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.600343+0000", 2024-09-17T02:21:05.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014382100000000001 2024-09-17T02:21:05.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:05.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.600387+0000", 2024-09-17T02:21:05.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3398e-05 2024-09-17T02:21:05.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:05.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603443+0000", 2024-09-17T02:21:05.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030562250000000001 2024-09-17T02:21:05.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:05.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603493+0000", 2024-09-17T02:21:05.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9820000000000001e-05 2024-09-17T02:21:05.603 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.603 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:05.603 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.603 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:40730 5.b 5:d64b1dc0:::benchmark_data_smithi001_23533_object40729:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:21:05.603 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:21:05.603 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.498927471999998, 2024-09-17T02:21:05.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016675972000000001, 2024-09-17T02:21:05.603 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:05.603 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:05.603 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:05.604 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:05.604 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:05.604 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:05.604 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 40730 2024-09-17T02:21:05.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.604 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:05.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:05.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:21:05.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:05.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:21:05.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:05.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:21:05.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5700000000000002e-07 2024-09-17T02:21:05.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:05.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037813+0000", 2024-09-17T02:21:05.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4880999999999999e-05 2024-09-17T02:21:05.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:05.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037820+0000", 2024-09-17T02:21:05.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.34e-06 2024-09-17T02:21:05.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037825+0000", 2024-09-17T02:21:05.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1420000000000003e-06 2024-09-17T02:21:05.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:05.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.039167+0000", 2024-09-17T02:21:05.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013427529999999999 2024-09-17T02:21:05.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:05.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.039293+0000", 2024-09-17T02:21:05.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000125248 2024-09-17T02:21:05.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:05.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.039442+0000", 2024-09-17T02:21:05.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014929799999999999 2024-09-17T02:21:05.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:05.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.041694+0000", 2024-09-17T02:21:05.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002252324 2024-09-17T02:21:05.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:05.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054324+0000", 2024-09-17T02:21:05.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012629782000000001 2024-09-17T02:21:05.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:05.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054393+0000", 2024-09-17T02:21:05.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9295999999999995e-05 2024-09-17T02:21:05.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:05.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054444+0000", 2024-09-17T02:21:05.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0250999999999997e-05 2024-09-17T02:21:05.609 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.609 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:05.609 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.610 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:40735 5.b 5:df8fd62b:::benchmark_data_smithi001_23533_object40734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:21:05.610 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:47.038253+0000", 2024-09-17T02:21:05.610 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.498441772, 2024-09-17T02:21:05.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016368369000000001, 2024-09-17T02:21:05.610 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:05.610 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:05.610 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:05.610 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:05.610 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:05.610 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:05.610 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 40735 2024-09-17T02:21:05.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.611 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:05.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:05.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038253+0000", 2024-09-17T02:21:05.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:05.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038253+0000", 2024-09-17T02:21:05.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:05.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038254+0000", 2024-09-17T02:21:05.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.23e-07 2024-09-17T02:21:05.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:05.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038420+0000", 2024-09-17T02:21:05.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016617499999999999 2024-09-17T02:21:05.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:05.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038432+0000", 2024-09-17T02:21:05.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1406000000000001e-05 2024-09-17T02:21:05.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038439+0000", 2024-09-17T02:21:05.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7200000000000006e-06 2024-09-17T02:21:05.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:05.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.040422+0000", 2024-09-17T02:21:05.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019828530000000001 2024-09-17T02:21:05.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:05.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.040581+0000", 2024-09-17T02:21:05.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159238 2024-09-17T02:21:05.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:05.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.040744+0000", 2024-09-17T02:21:05.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016255800000000001 2024-09-17T02:21:05.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:05.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.041971+0000", 2024-09-17T02:21:05.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001226551 2024-09-17T02:21:05.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:05.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054500+0000", 2024-09-17T02:21:05.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012529676 2024-09-17T02:21:05.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:05.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054570+0000", 2024-09-17T02:21:05.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9253999999999998e-05 2024-09-17T02:21:05.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:05.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054622+0000", 2024-09-17T02:21:05.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2114999999999998e-05 2024-09-17T02:21:05.615 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.615 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:05.616 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.616 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:64220 5.4 5:27584da2:::benchmark_data_smithi001_23533_object64219:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-17T02:21:05.616 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:57.202813+0000", 2024-09-17T02:21:05.616 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.333882418, 2024-09-17T02:21:05.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019952102999999999, 2024-09-17T02:21:05.616 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:05.616 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:05.616 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:05.616 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:05.616 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:05.616 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:05.617 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 64220 2024-09-17T02:21:05.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.617 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:05.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:05.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.202813+0000", 2024-09-17T02:21:05.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:05.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.202813+0000", 2024-09-17T02:21:05.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:05.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.202813+0000", 2024-09-17T02:21:05.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0800000000000004e-07 2024-09-17T02:21:05.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:05.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.202879+0000", 2024-09-17T02:21:05.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5698999999999996e-05 2024-09-17T02:21:05.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:05.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.202887+0000", 2024-09-17T02:21:05.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3699999999999995e-06 2024-09-17T02:21:05.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.202892+0000", 2024-09-17T02:21:05.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7960000000000003e-06 2024-09-17T02:21:05.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:05.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.204623+0000", 2024-09-17T02:21:05.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017305179999999999 2024-09-17T02:21:05.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:05.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.204739+0000", 2024-09-17T02:21:05.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116439 2024-09-17T02:21:05.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:05.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.204846+0000", 2024-09-17T02:21:05.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107181 2024-09-17T02:21:05.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:05.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.207469+0000", 2024-09-17T02:21:05.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026227020000000002 2024-09-17T02:21:05.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:05.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.222690+0000", 2024-09-17T02:21:05.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015220798000000001 2024-09-17T02:21:05.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:05.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.222732+0000", 2024-09-17T02:21:05.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2552999999999997e-05 2024-09-17T02:21:05.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:05.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.222765+0000", 2024-09-17T02:21:05.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2339000000000003e-05 2024-09-17T02:21:05.622 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.622 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:05.622 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.622 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:70402 5.e 5:77b97f3b:::benchmark_data_smithi001_23533_object70401:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-17T02:21:05.622 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:00.105258+0000", 2024-09-17T02:21:05.622 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.4314372549999996, 2024-09-17T02:21:05.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016510609999999998, 2024-09-17T02:21:05.622 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:05.622 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:05.623 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:05.623 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:05.623 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:05.623 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:05.623 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 70402 2024-09-17T02:21:05.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.623 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:05.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:05.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.105258+0000", 2024-09-17T02:21:05.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:05.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.105258+0000", 2024-09-17T02:21:05.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:05.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.105258+0000", 2024-09-17T02:21:05.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4099999999999999e-07 2024-09-17T02:21:05.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:05.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.105288+0000", 2024-09-17T02:21:05.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9825999999999999e-05 2024-09-17T02:21:05.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:05.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.105295+0000", 2024-09-17T02:21:05.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.002e-06 2024-09-17T02:21:05.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.105301+0000", 2024-09-17T02:21:05.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7629999999999997e-06 2024-09-17T02:21:05.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:05.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.112762+0000", 2024-09-17T02:21:05.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0074614269999999996 2024-09-17T02:21:05.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:05.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.112873+0000", 2024-09-17T02:21:05.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011073600000000001 2024-09-17T02:21:05.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:05.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.112974+0000", 2024-09-17T02:21:05.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101013 2024-09-17T02:21:05.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:05.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.116051+0000", 2024-09-17T02:21:05.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003077336 2024-09-17T02:21:05.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:05.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.121661+0000", 2024-09-17T02:21:05.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056096590000000003 2024-09-17T02:21:05.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:05.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.121722+0000", 2024-09-17T02:21:05.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1084e-05 2024-09-17T02:21:05.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:05.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.121768+0000", 2024-09-17T02:21:05.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6322999999999997e-05 2024-09-17T02:21:05.628 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.629 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:05.629 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.629 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:71274 5.b 5:d2d56400:::benchmark_data_smithi001_23533_object71273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:05.629 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:04.626306+0000", 2024-09-17T02:21:05.629 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.91038893300000001, 2024-09-17T02:21:05.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017847371000000001, 2024-09-17T02:21:05.629 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:05.629 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:05.629 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:05.629 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:05.629 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:05.630 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:05.630 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 71274 2024-09-17T02:21:05.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.630 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:05.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:05.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.626306+0000", 2024-09-17T02:21:05.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:05.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.626306+0000", 2024-09-17T02:21:05.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:05.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.626308+0000", 2024-09-17T02:21:05.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9180000000000001e-06 2024-09-17T02:21:05.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:05.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.626380+0000", 2024-09-17T02:21:05.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2454999999999997e-05 2024-09-17T02:21:05.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:05.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.626402+0000", 2024-09-17T02:21:05.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2016000000000001e-05 2024-09-17T02:21:05.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.626414+0000", 2024-09-17T02:21:05.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1518999999999999e-05 2024-09-17T02:21:05.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:05.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.626505+0000", 2024-09-17T02:21:05.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1379999999999996e-05 2024-09-17T02:21:05.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:05.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.626638+0000", 2024-09-17T02:21:05.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013286600000000001 2024-09-17T02:21:05.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:05.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.626808+0000", 2024-09-17T02:21:05.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016948000000000001 2024-09-17T02:21:05.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:05.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.629520+0000", 2024-09-17T02:21:05.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00271244 2024-09-17T02:21:05.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:05.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.630073+0000", 2024-09-17T02:21:05.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055253300000000002 2024-09-17T02:21:05.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:05.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.643981+0000", 2024-09-17T02:21:05.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01390808 2024-09-17T02:21:05.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:05.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.644049+0000", 2024-09-17T02:21:05.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8528000000000005e-05 2024-09-17T02:21:05.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:05.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.644153+0000", 2024-09-17T02:21:05.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000104156 2024-09-17T02:21:05.635 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.635 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:05.635 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.636 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:72109 5.4 5:25717992:::benchmark_data_smithi001_23533_object72108:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:05.636 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:05.059585+0000", 2024-09-17T02:21:05.636 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.477110013, 2024-09-17T02:21:05.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019702999999999998, 2024-09-17T02:21:05.636 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:05.636 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:05.636 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:05.636 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:05.636 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:05.636 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:05.636 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 72109 2024-09-17T02:21:05.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.637 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:05.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:05.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059585+0000", 2024-09-17T02:21:05.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:05.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059585+0000", 2024-09-17T02:21:05.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:05.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059586+0000", 2024-09-17T02:21:05.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.153e-06 2024-09-17T02:21:05.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:05.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059666+0000", 2024-09-17T02:21:05.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0093999999999996e-05 2024-09-17T02:21:05.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:05.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059677+0000", 2024-09-17T02:21:05.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0786e-05 2024-09-17T02:21:05.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059684+0000", 2024-09-17T02:21:05.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0729999999999999e-06 2024-09-17T02:21:05.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:05.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.069850+0000", 2024-09-17T02:21:05.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010165560000000001 2024-09-17T02:21:05.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:05.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.069997+0000", 2024-09-17T02:21:05.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014692000000000001 2024-09-17T02:21:05.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:05.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.070176+0000", 2024-09-17T02:21:05.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000179774 2024-09-17T02:21:05.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:05.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079031+0000", 2024-09-17T02:21:05.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0088549119999999995 2024-09-17T02:21:05.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:05.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079085+0000", 2024-09-17T02:21:05.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3588999999999998e-05 2024-09-17T02:21:05.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:05.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079155+0000", 2024-09-17T02:21:05.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0166999999999994e-05 2024-09-17T02:21:05.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:05.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079196+0000", 2024-09-17T02:21:05.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0964999999999998e-05 2024-09-17T02:21:05.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:05.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079288+0000", 2024-09-17T02:21:05.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2007000000000002e-05 2024-09-17T02:21:05.642 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.642 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:05.642 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.642 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:72113 5.4 5:22c8dcc1:::benchmark_data_smithi001_23533_object72112:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:05.642 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:05.059974+0000", 2024-09-17T02:21:05.642 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.476720912, 2024-09-17T02:21:05.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022437694000000001, 2024-09-17T02:21:05.643 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:05.643 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:05.643 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:05.643 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:05.643 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:05.643 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:05.643 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 72113 2024-09-17T02:21:05.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.643 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:05.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:05.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059974+0000", 2024-09-17T02:21:05.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:05.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059974+0000", 2024-09-17T02:21:05.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:05.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059975+0000", 2024-09-17T02:21:05.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6600000000000005e-07 2024-09-17T02:21:05.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:05.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.060002+0000", 2024-09-17T02:21:05.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6602e-05 2024-09-17T02:21:05.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:05.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.060011+0000", 2024-09-17T02:21:05.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4730000000000006e-06 2024-09-17T02:21:05.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.060017+0000", 2024-09-17T02:21:05.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.331e-06 2024-09-17T02:21:05.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:05.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.072282+0000", 2024-09-17T02:21:05.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012264126 2024-09-17T02:21:05.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:05.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.072461+0000", 2024-09-17T02:21:05.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017923700000000001 2024-09-17T02:21:05.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:05.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.072656+0000", 2024-09-17T02:21:05.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000195735 2024-09-17T02:21:05.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:05.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079382+0000", 2024-09-17T02:21:05.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067256529999999998 2024-09-17T02:21:05.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:05.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.082111+0000", 2024-09-17T02:21:05.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027287040000000002 2024-09-17T02:21:05.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:05.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.082229+0000", 2024-09-17T02:21:05.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118168 2024-09-17T02:21:05.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:05.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.082308+0000", 2024-09-17T02:21:05.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8888999999999996e-05 2024-09-17T02:21:05.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:05.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.082412+0000", 2024-09-17T02:21:05.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010391 2024-09-17T02:21:05.649 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.649 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:05.649 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.649 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:72123 5.4 5:2546f78a:::benchmark_data_smithi001_23533_object72122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:05.649 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:05.063089+0000", 2024-09-17T02:21:05.649 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.47360640599999998, 2024-09-17T02:21:05.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019591450999999999, 2024-09-17T02:21:05.649 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:05.649 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:05.649 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:05.650 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:05.650 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:05.650 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:05.650 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 72123 2024-09-17T02:21:05.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.650 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:05.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:05.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.063089+0000", 2024-09-17T02:21:05.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:05.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.063089+0000", 2024-09-17T02:21:05.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:05.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.063090+0000", 2024-09-17T02:21:05.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1829999999999999e-06 2024-09-17T02:21:05.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:05.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.063205+0000", 2024-09-17T02:21:05.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115634 2024-09-17T02:21:05.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:05.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.063217+0000", 2024-09-17T02:21:05.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.202e-05 2024-09-17T02:21:05.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.063226+0000", 2024-09-17T02:21:05.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5469999999999997e-06 2024-09-17T02:21:05.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:05.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.074475+0000", 2024-09-17T02:21:05.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01124874 2024-09-17T02:21:05.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:05.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.074639+0000", 2024-09-17T02:21:05.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000164537 2024-09-17T02:21:05.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:05.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.074772+0000", 2024-09-17T02:21:05.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013228599999999999 2024-09-17T02:21:05.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:05.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079387+0000", 2024-09-17T02:21:05.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046156239999999996 2024-09-17T02:21:05.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:05.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.082173+0000", 2024-09-17T02:21:05.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027856030000000002 2024-09-17T02:21:05.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:05.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.082483+0000", 2024-09-17T02:21:05.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031013699999999999 2024-09-17T02:21:05.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:05.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.082548+0000", 2024-09-17T02:21:05.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4745000000000004e-05 2024-09-17T02:21:05.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:05.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.082680+0000", 2024-09-17T02:21:05.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000132395 2024-09-17T02:21:05.655 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.655 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:05.656 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.656 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:72133 5.4 5:2e38f4b5:::benchmark_data_smithi001_23533_object72132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:05.656 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:05.070228+0000", 2024-09-17T02:21:05.656 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.46646747900000002, 2024-09-17T02:21:05.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019598082999999999, 2024-09-17T02:21:05.656 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:05.656 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:05.657 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:05.657 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:05.657 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:05.657 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:05.657 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 72133 2024-09-17T02:21:05.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.657 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:05.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:05.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.070228+0000", 2024-09-17T02:21:05.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:05.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.070228+0000", 2024-09-17T02:21:05.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:05.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:05.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.070228+0000", 2024-09-17T02:21:05.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7599999999999998e-07 2024-09-17T02:21:05.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:05.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.070266+0000", 2024-09-17T02:21:05.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8498000000000003e-05 2024-09-17T02:21:05.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:05.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.070272+0000", 2024-09-17T02:21:05.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4149999999999998e-06 2024-09-17T02:21:05.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.070278+0000", 2024-09-17T02:21:05.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.083e-06 2024-09-17T02:21:05.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:05.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079437+0000", 2024-09-17T02:21:05.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0091590249999999995 2024-09-17T02:21:05.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:05.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079611+0000", 2024-09-17T02:21:05.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000173878 2024-09-17T02:21:05.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:05.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079789+0000", 2024-09-17T02:21:05.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017836699999999999 2024-09-17T02:21:05.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:05.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.082696+0000", 2024-09-17T02:21:05.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029069080000000001 2024-09-17T02:21:05.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:05.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.083065+0000", 2024-09-17T02:21:05.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036905899999999998 2024-09-17T02:21:05.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:05.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.089624+0000", 2024-09-17T02:21:05.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0065584809999999997 2024-09-17T02:21:05.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:05.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.089697+0000", 2024-09-17T02:21:05.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3815999999999999e-05 2024-09-17T02:21:05.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:05.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:05.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:05.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.089826+0000", 2024-09-17T02:21:05.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012817699999999999 2024-09-17T02:21:05.662 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.662 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:05.663 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.663 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:05.663 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:05.663 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:05.664 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:05.665 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:05.666+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:05.768 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:05.770+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:05.772 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 33 16 73609 73593 139.365 129.812 0.00358318 0.00717015 2024-09-17T02:21:05.835 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:05.835 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:05.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.835 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:73730 5.0 5:0711ac26:::benchmark_data_smithi001_23533_object73729:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:05.835 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:05.835293+0000", 2024-09-17T02:21:05.836 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0023541170000000002, 2024-09-17T02:21:05.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023758799999999999, 2024-09-17T02:21:05.836 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:05.836 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:05.836 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:05.836 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:05.837 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:05.837 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:05.837 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 73730 2024-09-17T02:21:05.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.837 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:05.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:05.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.835293+0000", 2024-09-17T02:21:05.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:05.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:05.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.835293+0000", 2024-09-17T02:21:05.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:05.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:05.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.835294+0000", 2024-09-17T02:21:05.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.178e-06 2024-09-17T02:21:05.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:05.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.835376+0000", 2024-09-17T02:21:05.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1866000000000005e-05 2024-09-17T02:21:05.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:05.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.835388+0000", 2024-09-17T02:21:05.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1507e-05 2024-09-17T02:21:05.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.835396+0000", 2024-09-17T02:21:05.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9519999999999994e-06 2024-09-17T02:21:05.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:05.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.835440+0000", 2024-09-17T02:21:05.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4320000000000003e-05 2024-09-17T02:21:05.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:05.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.835527+0000", 2024-09-17T02:21:05.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7422000000000004e-05 2024-09-17T02:21:05.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:05.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.835614+0000", 2024-09-17T02:21:05.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6971000000000005e-05 2024-09-17T02:21:05.843 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:05.843 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:05.843 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:05.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.843 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:73731 5.4 e39/36 5:29cde4a4:::benchmark_data_smithi001_23533_object73730:head v 39'4529, mlcod=39'4526)", 2024-09-17T02:21:05.843 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:05.836271+0000", 2024-09-17T02:21:05.843 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0013762150000000001, 2024-09-17T02:21:05.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001446712, 2024-09-17T02:21:05.844 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:05.844 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:05.844 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:05.844 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:05.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:05.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836271+0000", 2024-09-17T02:21:05.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:05.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:05.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836271+0000", 2024-09-17T02:21:05.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:05.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:05.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836272+0000", 2024-09-17T02:21:05.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3200000000000004e-07 2024-09-17T02:21:05.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:05.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836349+0000", 2024-09-17T02:21:05.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6840000000000003e-05 2024-09-17T02:21:05.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:05.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836362+0000", 2024-09-17T02:21:05.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.29e-05 2024-09-17T02:21:05.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836369+0000", 2024-09-17T02:21:05.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4259999999999997e-06 2024-09-17T02:21:05.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:05.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836403+0000", 2024-09-17T02:21:05.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3565000000000001e-05 2024-09-17T02:21:05.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:05.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836416+0000", 2024-09-17T02:21:05.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2972999999999999e-05 2024-09-17T02:21:05.849 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:05.849 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:05.849 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:05.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.850 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:73736 5.0 5.93d39280 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:05.850 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:05.836413+0000", 2024-09-17T02:21:05.850 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001234511, 2024-09-17T02:21:05.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001338042, 2024-09-17T02:21:05.850 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:05.850 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:05.851 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:05.851 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:05.851 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:05.851 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:05.851 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 73736 2024-09-17T02:21:05.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.851 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:05.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:05.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836413+0000", 2024-09-17T02:21:05.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:05.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:05.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836413+0000", 2024-09-17T02:21:05.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:05.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:05.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836414+0000", 2024-09-17T02:21:05.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7700000000000003e-07 2024-09-17T02:21:05.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:05.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836514+0000", 2024-09-17T02:21:05.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010071199999999999 2024-09-17T02:21:05.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:05.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836528+0000", 2024-09-17T02:21:05.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3444999999999999e-05 2024-09-17T02:21:05.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836543+0000", 2024-09-17T02:21:05.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.519e-05 2024-09-17T02:21:05.854 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:05.854 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:05.854 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:05.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.854 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:73739 5.c 5:3e981303:::benchmark_data_smithi001_23533_object73738:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:05.855 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:05.836561+0000", 2024-09-17T02:21:05.855 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0010864270000000001, 2024-09-17T02:21:05.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001222335, 2024-09-17T02:21:05.855 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:05.855 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:05.855 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:05.855 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:05.855 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:05.856 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:05.856 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 73739 2024-09-17T02:21:05.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.856 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:05.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:05.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836561+0000", 2024-09-17T02:21:05.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:05.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:05.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836561+0000", 2024-09-17T02:21:05.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:05.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:05.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836562+0000", 2024-09-17T02:21:05.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7599999999999997e-07 2024-09-17T02:21:05.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:05.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836621+0000", 2024-09-17T02:21:05.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9791999999999999e-05 2024-09-17T02:21:05.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:05.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836633+0000", 2024-09-17T02:21:05.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1555e-05 2024-09-17T02:21:05.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836640+0000", 2024-09-17T02:21:05.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9829999999999999e-06 2024-09-17T02:21:05.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:05.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836686+0000", 2024-09-17T02:21:05.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6452000000000002e-05 2024-09-17T02:21:05.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:05.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836825+0000", 2024-09-17T02:21:05.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013899 2024-09-17T02:21:05.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:05.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836974+0000", 2024-09-17T02:21:05.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014829599999999999 2024-09-17T02:21:05.862 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:05.862 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:05.862 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:05.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.862 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:73740 5.5 5:aa2d6eea:::benchmark_data_smithi001_23533_object73739:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:05.862 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:05.836683+0000", 2024-09-17T02:21:05.862 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00096437499999999995, 2024-09-17T02:21:05.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011626029999999999, 2024-09-17T02:21:05.862 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:05.862 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:05.863 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:05.863 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:05.863 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:05.863 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:05.863 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 73740 2024-09-17T02:21:05.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.863 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:05.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:05.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836683+0000", 2024-09-17T02:21:05.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:05.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:05.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836683+0000", 2024-09-17T02:21:05.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:05.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:05.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836684+0000", 2024-09-17T02:21:05.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8800000000000002e-07 2024-09-17T02:21:05.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:05.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836802+0000", 2024-09-17T02:21:05.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117892 2024-09-17T02:21:05.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:05.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836812+0000", 2024-09-17T02:21:05.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0505e-05 2024-09-17T02:21:05.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836819+0000", 2024-09-17T02:21:05.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2649999999999999e-06 2024-09-17T02:21:05.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:05.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836878+0000", 2024-09-17T02:21:05.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8601999999999999e-05 2024-09-17T02:21:05.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:05.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.837000+0000", 2024-09-17T02:21:05.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122156 2024-09-17T02:21:05.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:05.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.837121+0000", 2024-09-17T02:21:05.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120543 2024-09-17T02:21:05.868 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:05.868 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:05.869 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:05.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.869 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:73737 5.3 e39/38 5:c45b310d:::benchmark_data_smithi001_23533_object73736:head v 39'4672, mlcod=39'4670)", 2024-09-17T02:21:05.869 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:05.836859+0000", 2024-09-17T02:21:05.869 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00078788000000000003, 2024-09-17T02:21:05.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001051904, 2024-09-17T02:21:05.870 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:05.870 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:05.870 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:05.870 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:05.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:05.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836859+0000", 2024-09-17T02:21:05.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:05.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:05.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836859+0000", 2024-09-17T02:21:05.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:05.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:05.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836860+0000", 2024-09-17T02:21:05.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.06e-07 2024-09-17T02:21:05.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:05.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836918+0000", 2024-09-17T02:21:05.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7877999999999997e-05 2024-09-17T02:21:05.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:05.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836929+0000", 2024-09-17T02:21:05.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1241e-05 2024-09-17T02:21:05.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836935+0000", 2024-09-17T02:21:05.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7969999999999997e-06 2024-09-17T02:21:05.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:05.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.837002+0000", 2024-09-17T02:21:05.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6718999999999996e-05 2024-09-17T02:21:05.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:05.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.837022+0000", 2024-09-17T02:21:05.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0543999999999998e-05 2024-09-17T02:21:05.874 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:05.874 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:05.874 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:05.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.875 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:73741 5.8 5:1b52bfe5:::benchmark_data_smithi001_23533_object73740:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:05.875 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:05.836928+0000", 2024-09-17T02:21:05.875 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00071899900000000001, 2024-09-17T02:21:05.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010167869999999999, 2024-09-17T02:21:05.875 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:05.875 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:05.875 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:05.875 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:05.875 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:05.875 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:05.876 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 73741 2024-09-17T02:21:05.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.876 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:05.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:05.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836928+0000", 2024-09-17T02:21:05.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:05.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:05.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836928+0000", 2024-09-17T02:21:05.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:05.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:05.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.836929+0000", 2024-09-17T02:21:05.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7000000000000003e-07 2024-09-17T02:21:05.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:05.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.837003+0000", 2024-09-17T02:21:05.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3954000000000004e-05 2024-09-17T02:21:05.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:05.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.837014+0000", 2024-09-17T02:21:05.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0441e-05 2024-09-17T02:21:05.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:05.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.837021+0000", 2024-09-17T02:21:05.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1749999999999999e-06 2024-09-17T02:21:05.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:05.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.837532+0000", 2024-09-17T02:21:05.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00051091400000000001 2024-09-17T02:21:05.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:05.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.837653+0000", 2024-09-17T02:21:05.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012135599999999999 2024-09-17T02:21:05.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:05.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:05.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:05.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:05.837777+0000", 2024-09-17T02:21:05.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012406799999999999 2024-09-17T02:21:05.880 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:05.880 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:05.880 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:05.880 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:05.880 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:21:05.880 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 7 2024-09-17T02:21:05.880 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:05.882 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:05.883 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:05.883+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:05.953 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:21:05.983 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:05.982+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:06.084 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:06.083+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:06.086 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:06.087 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:21:06.087 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:21:06.087 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:21:06.087 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:06.109 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:06.119 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:21:06.120 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:21:06.137 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:21:06.138 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:21:06.159 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:21:06.160 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:21:06.203 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:06.206+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:06.287 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:06.287+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:06.312 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:06.312 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:06.334 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:21:06.387 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:06.387+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:06.460 INFO:teuthology.orchestra.run.smithi001.stderr:noscrub is set 2024-09-17T02:21:06.488 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:06.490+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:06.509 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:06.509 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:06.529 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:21:06.589 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:06.590+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:06.690 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:06.691+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:06.733 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:06.733 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:06.754 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:21:06.772 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 34 16 75660 75644 139.036 128.188 0.00858118 0.00718744 2024-09-17T02:21:06.796 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:06.799+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:06.892 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:06.894+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:06.955 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:06.956 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:06.976 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:06.993 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:06.995+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:07.094 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:07.094+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:07.148 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:07.148 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:07.168 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:07.195 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:07.195+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:07.296 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:07.295+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:07.375 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:07.375 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:07.397 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:07.398 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:07.399+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:07.458 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-17T02:21:07.459 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T02:21:07.459 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-17T02:21:07.459 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-17T02:21:07.498 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:07.498+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:07.558 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:07.558 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:07.577 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:07.598 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:07.599+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:07.700 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:07.703+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:07.733 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:07.733 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:07.751 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:07.772 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 35 16 77773 77757 138.836 132.062 0.00669686 0.00719787 2024-09-17T02:21:07.790 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:21:07.790 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-17T02:21:07.790 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 40, 2024-09-17T02:21:07.790 INFO:teuthology.orchestra.run.smithi001.stdout: "fsid": "37cd4495-4915-41f4-bad2-2394cbe235f3", 2024-09-17T02:21:07.790 INFO:teuthology.orchestra.run.smithi001.stdout: "created": "2024-09-17T02:19:52.516342+0000", 2024-09-17T02:21:07.790 INFO:teuthology.orchestra.run.smithi001.stdout: "modified": "2024-09-17T02:21:06.459449+0000", 2024-09-17T02:21:07.790 INFO:teuthology.orchestra.run.smithi001.stdout: "last_up_change": "2024-09-17T02:20:02.422255+0000", 2024-09-17T02:21:07.790 INFO:teuthology.orchestra.run.smithi001.stdout: "last_in_change": "2024-09-17T02:19:54.329423+0000", 2024-09-17T02:21:07.791 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T02:21:07.791 INFO:teuthology.orchestra.run.smithi001.stdout: "flags_num": 5801984, 2024-09-17T02:21:07.791 INFO:teuthology.orchestra.run.smithi001.stdout: "flags_set": [ 2024-09-17T02:21:07.791 INFO:teuthology.orchestra.run.smithi001.stdout: "noscrub", 2024-09-17T02:21:07.791 INFO:teuthology.orchestra.run.smithi001.stdout: "pglog_hardlimit", 2024-09-17T02:21:07.791 INFO:teuthology.orchestra.run.smithi001.stdout: "purged_snapdirs", 2024-09-17T02:21:07.791 INFO:teuthology.orchestra.run.smithi001.stdout: "recovery_deletes", 2024-09-17T02:21:07.791 INFO:teuthology.orchestra.run.smithi001.stdout: "sortbitwise" 2024-09-17T02:21:07.791 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-17T02:21:07.791 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_version": 5, 2024-09-17T02:21:07.791 INFO:teuthology.orchestra.run.smithi001.stdout: "full_ratio": 0.94999998807907104, 2024-09-17T02:21:07.791 INFO:teuthology.orchestra.run.smithi001.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-17T02:21:07.791 INFO:teuthology.orchestra.run.smithi001.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-17T02:21:07.792 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_snapshot": "", 2024-09-17T02:21:07.792 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_max": 5, 2024-09-17T02:21:07.792 INFO:teuthology.orchestra.run.smithi001.stdout: "max_osd": 3, 2024-09-17T02:21:07.792 INFO:teuthology.orchestra.run.smithi001.stdout: "require_min_compat_client": "luminous", 2024-09-17T02:21:07.792 INFO:teuthology.orchestra.run.smithi001.stdout: "min_compat_client": "jewel", 2024-09-17T02:21:07.792 INFO:teuthology.orchestra.run.smithi001.stdout: "require_osd_release": "squid", 2024-09-17T02:21:07.792 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_crimson": false, 2024-09-17T02:21:07.792 INFO:teuthology.orchestra.run.smithi001.stdout: "pools": [ 2024-09-17T02:21:07.792 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.792 INFO:teuthology.orchestra.run.smithi001.stdout: "pool": 1, 2024-09-17T02:21:07.792 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": ".mgr", 2024-09-17T02:21:07.792 INFO:teuthology.orchestra.run.smithi001.stdout: "create_time": "2024-09-17T02:20:03.416336+0000", 2024-09-17T02:21:07.792 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-17T02:21:07.793 INFO:teuthology.orchestra.run.smithi001.stdout: "flags_names": "hashpspool", 2024-09-17T02:21:07.793 INFO:teuthology.orchestra.run.smithi001.stdout: "type": 1, 2024-09-17T02:21:07.793 INFO:teuthology.orchestra.run.smithi001.stdout: "size": 2, 2024-09-17T02:21:07.793 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": 1, 2024-09-17T02:21:07.793 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_rule": 0, 2024-09-17T02:21:07.793 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:21:07.793 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:21:07.793 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:21:07.793 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:21:07.793 INFO:teuthology.orchestra.run.smithi001.stdout: "is_stretch_pool": false, 2024-09-17T02:21:07.793 INFO:teuthology.orchestra.run.smithi001.stdout: "object_hash": 2, 2024-09-17T02:21:07.793 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:21:07.793 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": 1, 2024-09-17T02:21:07.794 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num": 1, 2024-09-17T02:21:07.794 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num_target": 1, 2024-09-17T02:21:07.794 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_target": 1, 2024-09-17T02:21:07.794 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_pending": 1, 2024-09-17T02:21:07.794 INFO:teuthology.orchestra.run.smithi001.stdout: "last_pg_merge_meta": { 2024-09-17T02:21:07.794 INFO:teuthology.orchestra.run.smithi001.stdout: "source_pgid": "0.0", 2024-09-17T02:21:07.794 INFO:teuthology.orchestra.run.smithi001.stdout: "ready_epoch": 0, 2024-09-17T02:21:07.794 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_started": 0, 2024-09-17T02:21:07.794 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_clean": 0, 2024-09-17T02:21:07.794 INFO:teuthology.orchestra.run.smithi001.stdout: "source_version": "0'0", 2024-09-17T02:21:07.794 INFO:teuthology.orchestra.run.smithi001.stdout: "target_version": "0'0" 2024-09-17T02:21:07.794 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.794 INFO:teuthology.orchestra.run.smithi001.stdout: "last_change": "12", 2024-09-17T02:21:07.794 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend": "0", 2024-09-17T02:21:07.795 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:21:07.795 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:21:07.795 INFO:teuthology.orchestra.run.smithi001.stdout: "auid": 0, 2024-09-17T02:21:07.795 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:21:07.795 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_seq": 0, 2024-09-17T02:21:07.795 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_epoch": 0, 2024-09-17T02:21:07.795 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_snaps": [], 2024-09-17T02:21:07.795 INFO:teuthology.orchestra.run.smithi001.stdout: "removed_snaps": "[]", 2024-09-17T02:21:07.795 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_bytes": 0, 2024-09-17T02:21:07.795 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_objects": 0, 2024-09-17T02:21:07.795 INFO:teuthology.orchestra.run.smithi001.stdout: "tiers": [], 2024-09-17T02:21:07.795 INFO:teuthology.orchestra.run.smithi001.stdout: "tier_of": -1, 2024-09-17T02:21:07.795 INFO:teuthology.orchestra.run.smithi001.stdout: "read_tier": -1, 2024-09-17T02:21:07.796 INFO:teuthology.orchestra.run.smithi001.stdout: "write_tier": -1, 2024-09-17T02:21:07.796 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_mode": "none", 2024-09-17T02:21:07.796 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_bytes": 0, 2024-09-17T02:21:07.796 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_objects": 0, 2024-09-17T02:21:07.796 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:21:07.796 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:21:07.796 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:21:07.796 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_flush_age": 0, 2024-09-17T02:21:07.796 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_evict_age": 0, 2024-09-17T02:21:07.796 INFO:teuthology.orchestra.run.smithi001.stdout: "erasure_code_profile": "", 2024-09-17T02:21:07.796 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_params": { 2024-09-17T02:21:07.796 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "none" 2024-09-17T02:21:07.796 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.797 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_period": 0, 2024-09-17T02:21:07.797 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_count": 0, 2024-09-17T02:21:07.797 INFO:teuthology.orchestra.run.smithi001.stdout: "use_gmt_hitset": true, 2024-09-17T02:21:07.797 INFO:teuthology.orchestra.run.smithi001.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:21:07.797 INFO:teuthology.orchestra.run.smithi001.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:21:07.797 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:21:07.797 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:21:07.797 INFO:teuthology.orchestra.run.smithi001.stdout: "grade_table": [], 2024-09-17T02:21:07.797 INFO:teuthology.orchestra.run.smithi001.stdout: "stripe_width": 0, 2024-09-17T02:21:07.797 INFO:teuthology.orchestra.run.smithi001.stdout: "expected_num_objects": 0, 2024-09-17T02:21:07.797 INFO:teuthology.orchestra.run.smithi001.stdout: "fast_read": false, 2024-09-17T02:21:07.797 INFO:teuthology.orchestra.run.smithi001.stdout: "options": { 2024-09-17T02:21:07.797 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_max": 32, 2024-09-17T02:21:07.797 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_min": 1 2024-09-17T02:21:07.798 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.798 INFO:teuthology.orchestra.run.smithi001.stdout: "application_metadata": { 2024-09-17T02:21:07.798 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": {} 2024-09-17T02:21:07.798 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.798 INFO:teuthology.orchestra.run.smithi001.stdout: "read_balance": { 2024-09-17T02:21:07.798 INFO:teuthology.orchestra.run.smithi001.stdout: "score_type": "Fair distribution", 2024-09-17T02:21:07.798 INFO:teuthology.orchestra.run.smithi001.stdout: "score_acting": 2.9900000095367432, 2024-09-17T02:21:07.798 INFO:teuthology.orchestra.run.smithi001.stdout: "score_stable": 2.9900000095367432, 2024-09-17T02:21:07.798 INFO:teuthology.orchestra.run.smithi001.stdout: "optimal_score": 0.67000001668930054, 2024-09-17T02:21:07.798 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_acting": 2, 2024-09-17T02:21:07.798 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_stable": 2, 2024-09-17T02:21:07.798 INFO:teuthology.orchestra.run.smithi001.stdout: "primary_affinity_weighted": 0.79247540235519409, 2024-09-17T02:21:07.798 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity": 0.79000002145767212, 2024-09-17T02:21:07.799 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity_weighted": 0.79000002145767212 2024-09-17T02:21:07.799 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:21:07.799 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.799 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.799 INFO:teuthology.orchestra.run.smithi001.stdout: "pool": 2, 2024-09-17T02:21:07.799 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": "rbd", 2024-09-17T02:21:07.799 INFO:teuthology.orchestra.run.smithi001.stdout: "create_time": "2024-09-17T02:20:08.718296+0000", 2024-09-17T02:21:07.799 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 8193, 2024-09-17T02:21:07.799 INFO:teuthology.orchestra.run.smithi001.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-17T02:21:07.799 INFO:teuthology.orchestra.run.smithi001.stdout: "type": 1, 2024-09-17T02:21:07.799 INFO:teuthology.orchestra.run.smithi001.stdout: "size": 2, 2024-09-17T02:21:07.799 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": 1, 2024-09-17T02:21:07.799 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_rule": 0, 2024-09-17T02:21:07.799 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:21:07.800 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:21:07.800 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:21:07.800 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:21:07.800 INFO:teuthology.orchestra.run.smithi001.stdout: "is_stretch_pool": false, 2024-09-17T02:21:07.800 INFO:teuthology.orchestra.run.smithi001.stdout: "object_hash": 2, 2024-09-17T02:21:07.800 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:21:07.800 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": 8, 2024-09-17T02:21:07.800 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num": 8, 2024-09-17T02:21:07.800 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num_target": 8, 2024-09-17T02:21:07.800 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_target": 8, 2024-09-17T02:21:07.800 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_pending": 8, 2024-09-17T02:21:07.800 INFO:teuthology.orchestra.run.smithi001.stdout: "last_pg_merge_meta": { 2024-09-17T02:21:07.800 INFO:teuthology.orchestra.run.smithi001.stdout: "source_pgid": "0.0", 2024-09-17T02:21:07.801 INFO:teuthology.orchestra.run.smithi001.stdout: "ready_epoch": 0, 2024-09-17T02:21:07.801 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_started": 0, 2024-09-17T02:21:07.801 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_clean": 0, 2024-09-17T02:21:07.801 INFO:teuthology.orchestra.run.smithi001.stdout: "source_version": "0'0", 2024-09-17T02:21:07.801 INFO:teuthology.orchestra.run.smithi001.stdout: "target_version": "0'0" 2024-09-17T02:21:07.801 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.801 INFO:teuthology.orchestra.run.smithi001.stdout: "last_change": "16", 2024-09-17T02:21:07.801 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend": "0", 2024-09-17T02:21:07.801 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:21:07.801 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:21:07.801 INFO:teuthology.orchestra.run.smithi001.stdout: "auid": 0, 2024-09-17T02:21:07.801 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:21:07.801 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_seq": 2, 2024-09-17T02:21:07.801 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_epoch": 16, 2024-09-17T02:21:07.802 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_snaps": [], 2024-09-17T02:21:07.802 INFO:teuthology.orchestra.run.smithi001.stdout: "removed_snaps": "[]", 2024-09-17T02:21:07.802 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_bytes": 0, 2024-09-17T02:21:07.802 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_objects": 0, 2024-09-17T02:21:07.802 INFO:teuthology.orchestra.run.smithi001.stdout: "tiers": [], 2024-09-17T02:21:07.802 INFO:teuthology.orchestra.run.smithi001.stdout: "tier_of": -1, 2024-09-17T02:21:07.802 INFO:teuthology.orchestra.run.smithi001.stdout: "read_tier": -1, 2024-09-17T02:21:07.802 INFO:teuthology.orchestra.run.smithi001.stdout: "write_tier": -1, 2024-09-17T02:21:07.802 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_mode": "none", 2024-09-17T02:21:07.802 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_bytes": 0, 2024-09-17T02:21:07.802 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_objects": 0, 2024-09-17T02:21:07.802 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:21:07.802 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:21:07.803 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:21:07.803 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_flush_age": 0, 2024-09-17T02:21:07.803 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_evict_age": 0, 2024-09-17T02:21:07.803 INFO:teuthology.orchestra.run.smithi001.stdout: "erasure_code_profile": "", 2024-09-17T02:21:07.803 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_params": { 2024-09-17T02:21:07.803 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "none" 2024-09-17T02:21:07.803 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.803 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_period": 0, 2024-09-17T02:21:07.803 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_count": 0, 2024-09-17T02:21:07.803 INFO:teuthology.orchestra.run.smithi001.stdout: "use_gmt_hitset": true, 2024-09-17T02:21:07.803 INFO:teuthology.orchestra.run.smithi001.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:21:07.803 INFO:teuthology.orchestra.run.smithi001.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:21:07.803 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:21:07.803 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:21:07.804 INFO:teuthology.orchestra.run.smithi001.stdout: "grade_table": [], 2024-09-17T02:21:07.804 INFO:teuthology.orchestra.run.smithi001.stdout: "stripe_width": 0, 2024-09-17T02:21:07.804 INFO:teuthology.orchestra.run.smithi001.stdout: "expected_num_objects": 0, 2024-09-17T02:21:07.804 INFO:teuthology.orchestra.run.smithi001.stdout: "fast_read": false, 2024-09-17T02:21:07.804 INFO:teuthology.orchestra.run.smithi001.stdout: "options": {}, 2024-09-17T02:21:07.804 INFO:teuthology.orchestra.run.smithi001.stdout: "application_metadata": { 2024-09-17T02:21:07.804 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd": {} 2024-09-17T02:21:07.804 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.804 INFO:teuthology.orchestra.run.smithi001.stdout: "read_balance": { 2024-09-17T02:21:07.804 INFO:teuthology.orchestra.run.smithi001.stdout: "score_type": "Fair distribution", 2024-09-17T02:21:07.804 INFO:teuthology.orchestra.run.smithi001.stdout: "score_acting": 1.5, 2024-09-17T02:21:07.804 INFO:teuthology.orchestra.run.smithi001.stdout: "score_stable": 1.5, 2024-09-17T02:21:07.804 INFO:teuthology.orchestra.run.smithi001.stdout: "optimal_score": 1, 2024-09-17T02:21:07.804 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_acting": 1.5, 2024-09-17T02:21:07.805 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_stable": 1.5, 2024-09-17T02:21:07.805 INFO:teuthology.orchestra.run.smithi001.stdout: "primary_affinity_weighted": 0.79247540235519409, 2024-09-17T02:21:07.805 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity": 0.79000002145767212, 2024-09-17T02:21:07.805 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity_weighted": 0.79000002145767212 2024-09-17T02:21:07.805 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:21:07.805 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.805 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.805 INFO:teuthology.orchestra.run.smithi001.stdout: "pool": 3, 2024-09-17T02:21:07.805 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": "cephfs_metadata", 2024-09-17T02:21:07.805 INFO:teuthology.orchestra.run.smithi001.stdout: "create_time": "2024-09-17T02:20:13.566396+0000", 2024-09-17T02:21:07.805 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-17T02:21:07.805 INFO:teuthology.orchestra.run.smithi001.stdout: "flags_names": "hashpspool", 2024-09-17T02:21:07.805 INFO:teuthology.orchestra.run.smithi001.stdout: "type": 1, 2024-09-17T02:21:07.805 INFO:teuthology.orchestra.run.smithi001.stdout: "size": 2, 2024-09-17T02:21:07.806 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": 1, 2024-09-17T02:21:07.806 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_rule": 0, 2024-09-17T02:21:07.806 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:21:07.806 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:21:07.806 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:21:07.806 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:21:07.806 INFO:teuthology.orchestra.run.smithi001.stdout: "is_stretch_pool": false, 2024-09-17T02:21:07.806 INFO:teuthology.orchestra.run.smithi001.stdout: "object_hash": 2, 2024-09-17T02:21:07.806 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:21:07.806 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": 32, 2024-09-17T02:21:07.806 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num": 32, 2024-09-17T02:21:07.806 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num_target": 32, 2024-09-17T02:21:07.806 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_target": 32, 2024-09-17T02:21:07.807 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_pending": 32, 2024-09-17T02:21:07.807 INFO:teuthology.orchestra.run.smithi001.stdout: "last_pg_merge_meta": { 2024-09-17T02:21:07.807 INFO:teuthology.orchestra.run.smithi001.stdout: "source_pgid": "0.0", 2024-09-17T02:21:07.807 INFO:teuthology.orchestra.run.smithi001.stdout: "ready_epoch": 0, 2024-09-17T02:21:07.807 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_started": 0, 2024-09-17T02:21:07.807 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_clean": 0, 2024-09-17T02:21:07.807 INFO:teuthology.orchestra.run.smithi001.stdout: "source_version": "0'0", 2024-09-17T02:21:07.807 INFO:teuthology.orchestra.run.smithi001.stdout: "target_version": "0'0" 2024-09-17T02:21:07.807 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.807 INFO:teuthology.orchestra.run.smithi001.stdout: "last_change": "19", 2024-09-17T02:21:07.808 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend": "0", 2024-09-17T02:21:07.808 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:21:07.808 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:21:07.808 INFO:teuthology.orchestra.run.smithi001.stdout: "auid": 0, 2024-09-17T02:21:07.808 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:21:07.808 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_seq": 0, 2024-09-17T02:21:07.808 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_epoch": 0, 2024-09-17T02:21:07.808 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_snaps": [], 2024-09-17T02:21:07.808 INFO:teuthology.orchestra.run.smithi001.stdout: "removed_snaps": "[]", 2024-09-17T02:21:07.808 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_bytes": 0, 2024-09-17T02:21:07.808 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_objects": 0, 2024-09-17T02:21:07.809 INFO:teuthology.orchestra.run.smithi001.stdout: "tiers": [], 2024-09-17T02:21:07.809 INFO:teuthology.orchestra.run.smithi001.stdout: "tier_of": -1, 2024-09-17T02:21:07.809 INFO:teuthology.orchestra.run.smithi001.stdout: "read_tier": -1, 2024-09-17T02:21:07.809 INFO:teuthology.orchestra.run.smithi001.stdout: "write_tier": -1, 2024-09-17T02:21:07.809 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_mode": "none", 2024-09-17T02:21:07.809 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_bytes": 0, 2024-09-17T02:21:07.809 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_objects": 0, 2024-09-17T02:21:07.809 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:21:07.809 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:21:07.810 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:21:07.810 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_flush_age": 0, 2024-09-17T02:21:07.810 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_evict_age": 0, 2024-09-17T02:21:07.810 INFO:teuthology.orchestra.run.smithi001.stdout: "erasure_code_profile": "", 2024-09-17T02:21:07.810 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_params": { 2024-09-17T02:21:07.810 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "none" 2024-09-17T02:21:07.810 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.810 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_period": 0, 2024-09-17T02:21:07.810 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_count": 0, 2024-09-17T02:21:07.810 INFO:teuthology.orchestra.run.smithi001.stdout: "use_gmt_hitset": true, 2024-09-17T02:21:07.810 INFO:teuthology.orchestra.run.smithi001.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:21:07.810 INFO:teuthology.orchestra.run.smithi001.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:21:07.810 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:21:07.810 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:21:07.811 INFO:teuthology.orchestra.run.smithi001.stdout: "grade_table": [], 2024-09-17T02:21:07.811 INFO:teuthology.orchestra.run.smithi001.stdout: "stripe_width": 0, 2024-09-17T02:21:07.811 INFO:teuthology.orchestra.run.smithi001.stdout: "expected_num_objects": 0, 2024-09-17T02:21:07.811 INFO:teuthology.orchestra.run.smithi001.stdout: "fast_read": false, 2024-09-17T02:21:07.811 INFO:teuthology.orchestra.run.smithi001.stdout: "options": { 2024-09-17T02:21:07.811 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscale_bias": 4, 2024-09-17T02:21:07.811 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_min": 16, 2024-09-17T02:21:07.811 INFO:teuthology.orchestra.run.smithi001.stdout: "recovery_priority": 5 2024-09-17T02:21:07.811 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.812 INFO:teuthology.orchestra.run.smithi001.stdout: "application_metadata": { 2024-09-17T02:21:07.812 INFO:teuthology.orchestra.run.smithi001.stdout: "cephfs": { 2024-09-17T02:21:07.812 INFO:teuthology.orchestra.run.smithi001.stdout: "metadata": "cephfs" 2024-09-17T02:21:07.812 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:21:07.812 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.812 INFO:teuthology.orchestra.run.smithi001.stdout: "read_balance": { 2024-09-17T02:21:07.812 INFO:teuthology.orchestra.run.smithi001.stdout: "score_type": "Fair distribution", 2024-09-17T02:21:07.812 INFO:teuthology.orchestra.run.smithi001.stdout: "score_acting": 1.5, 2024-09-17T02:21:07.812 INFO:teuthology.orchestra.run.smithi001.stdout: "score_stable": 1.5, 2024-09-17T02:21:07.812 INFO:teuthology.orchestra.run.smithi001.stdout: "optimal_score": 1, 2024-09-17T02:21:07.812 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_acting": 1.5, 2024-09-17T02:21:07.812 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_stable": 1.5, 2024-09-17T02:21:07.813 INFO:teuthology.orchestra.run.smithi001.stdout: "primary_affinity_weighted": 0.79247540235519409, 2024-09-17T02:21:07.813 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity": 0.79000002145767212, 2024-09-17T02:21:07.813 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity_weighted": 0.79000002145767212 2024-09-17T02:21:07.813 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:21:07.813 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.813 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.813 INFO:teuthology.orchestra.run.smithi001.stdout: "pool": 4, 2024-09-17T02:21:07.813 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": "cephfs_data", 2024-09-17T02:21:07.813 INFO:teuthology.orchestra.run.smithi001.stdout: "create_time": "2024-09-17T02:20:14.902662+0000", 2024-09-17T02:21:07.813 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-17T02:21:07.814 INFO:teuthology.orchestra.run.smithi001.stdout: "flags_names": "hashpspool", 2024-09-17T02:21:07.814 INFO:teuthology.orchestra.run.smithi001.stdout: "type": 1, 2024-09-17T02:21:07.814 INFO:teuthology.orchestra.run.smithi001.stdout: "size": 2, 2024-09-17T02:21:07.814 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": 1, 2024-09-17T02:21:07.814 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_rule": 0, 2024-09-17T02:21:07.814 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:21:07.814 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:21:07.814 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:21:07.814 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:21:07.814 INFO:teuthology.orchestra.run.smithi001.stdout: "is_stretch_pool": false, 2024-09-17T02:21:07.814 INFO:teuthology.orchestra.run.smithi001.stdout: "object_hash": 2, 2024-09-17T02:21:07.815 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:21:07.815 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": 64, 2024-09-17T02:21:07.815 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num": 64, 2024-09-17T02:21:07.815 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num_target": 64, 2024-09-17T02:21:07.815 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_target": 64, 2024-09-17T02:21:07.815 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_pending": 64, 2024-09-17T02:21:07.815 INFO:teuthology.orchestra.run.smithi001.stdout: "last_pg_merge_meta": { 2024-09-17T02:21:07.815 INFO:teuthology.orchestra.run.smithi001.stdout: "source_pgid": "0.0", 2024-09-17T02:21:07.815 INFO:teuthology.orchestra.run.smithi001.stdout: "ready_epoch": 0, 2024-09-17T02:21:07.815 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_started": 0, 2024-09-17T02:21:07.815 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_clean": 0, 2024-09-17T02:21:07.815 INFO:teuthology.orchestra.run.smithi001.stdout: "source_version": "0'0", 2024-09-17T02:21:07.816 INFO:teuthology.orchestra.run.smithi001.stdout: "target_version": "0'0" 2024-09-17T02:21:07.816 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.816 INFO:teuthology.orchestra.run.smithi001.stdout: "last_change": "20", 2024-09-17T02:21:07.816 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend": "0", 2024-09-17T02:21:07.816 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:21:07.816 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:21:07.816 INFO:teuthology.orchestra.run.smithi001.stdout: "auid": 0, 2024-09-17T02:21:07.816 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:21:07.816 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_seq": 0, 2024-09-17T02:21:07.816 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_epoch": 0, 2024-09-17T02:21:07.817 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_snaps": [], 2024-09-17T02:21:07.817 INFO:teuthology.orchestra.run.smithi001.stdout: "removed_snaps": "[]", 2024-09-17T02:21:07.817 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_bytes": 0, 2024-09-17T02:21:07.817 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_objects": 0, 2024-09-17T02:21:07.817 INFO:teuthology.orchestra.run.smithi001.stdout: "tiers": [], 2024-09-17T02:21:07.817 INFO:teuthology.orchestra.run.smithi001.stdout: "tier_of": -1, 2024-09-17T02:21:07.817 INFO:teuthology.orchestra.run.smithi001.stdout: "read_tier": -1, 2024-09-17T02:21:07.817 INFO:teuthology.orchestra.run.smithi001.stdout: "write_tier": -1, 2024-09-17T02:21:07.817 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_mode": "none", 2024-09-17T02:21:07.818 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_bytes": 0, 2024-09-17T02:21:07.818 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_objects": 0, 2024-09-17T02:21:07.818 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:21:07.818 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:21:07.818 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:21:07.818 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_flush_age": 0, 2024-09-17T02:21:07.818 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_evict_age": 0, 2024-09-17T02:21:07.818 INFO:teuthology.orchestra.run.smithi001.stdout: "erasure_code_profile": "", 2024-09-17T02:21:07.818 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_params": { 2024-09-17T02:21:07.818 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "none" 2024-09-17T02:21:07.819 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.819 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_period": 0, 2024-09-17T02:21:07.819 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_count": 0, 2024-09-17T02:21:07.819 INFO:teuthology.orchestra.run.smithi001.stdout: "use_gmt_hitset": true, 2024-09-17T02:21:07.819 INFO:teuthology.orchestra.run.smithi001.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:21:07.819 INFO:teuthology.orchestra.run.smithi001.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:21:07.819 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:21:07.819 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:21:07.819 INFO:teuthology.orchestra.run.smithi001.stdout: "grade_table": [], 2024-09-17T02:21:07.819 INFO:teuthology.orchestra.run.smithi001.stdout: "stripe_width": 0, 2024-09-17T02:21:07.819 INFO:teuthology.orchestra.run.smithi001.stdout: "expected_num_objects": 0, 2024-09-17T02:21:07.819 INFO:teuthology.orchestra.run.smithi001.stdout: "fast_read": false, 2024-09-17T02:21:07.820 INFO:teuthology.orchestra.run.smithi001.stdout: "options": { 2024-09-17T02:21:07.820 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_min": 64, 2024-09-17T02:21:07.820 INFO:teuthology.orchestra.run.smithi001.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T02:21:07.820 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.820 INFO:teuthology.orchestra.run.smithi001.stdout: "application_metadata": { 2024-09-17T02:21:07.820 INFO:teuthology.orchestra.run.smithi001.stdout: "cephfs": { 2024-09-17T02:21:07.820 INFO:teuthology.orchestra.run.smithi001.stdout: "data": "cephfs" 2024-09-17T02:21:07.820 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:21:07.820 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.820 INFO:teuthology.orchestra.run.smithi001.stdout: "read_balance": { 2024-09-17T02:21:07.820 INFO:teuthology.orchestra.run.smithi001.stdout: "score_type": "Fair distribution", 2024-09-17T02:21:07.820 INFO:teuthology.orchestra.run.smithi001.stdout: "score_acting": 1.5499999523162842, 2024-09-17T02:21:07.820 INFO:teuthology.orchestra.run.smithi001.stdout: "score_stable": 1.5499999523162842, 2024-09-17T02:21:07.820 INFO:teuthology.orchestra.run.smithi001.stdout: "optimal_score": 1, 2024-09-17T02:21:07.821 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_acting": 1.5499999523162842, 2024-09-17T02:21:07.821 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_stable": 1.5499999523162842, 2024-09-17T02:21:07.821 INFO:teuthology.orchestra.run.smithi001.stdout: "primary_affinity_weighted": 0.79247540235519409, 2024-09-17T02:21:07.821 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity": 0.79000002145767212, 2024-09-17T02:21:07.821 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity_weighted": 0.79000002145767212 2024-09-17T02:21:07.821 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:21:07.821 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.821 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.821 INFO:teuthology.orchestra.run.smithi001.stdout: "pool": 5, 2024-09-17T02:21:07.821 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": "unique_pool_0", 2024-09-17T02:21:07.821 INFO:teuthology.orchestra.run.smithi001.stdout: "create_time": "2024-09-17T02:20:30.517004+0000", 2024-09-17T02:21:07.821 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-17T02:21:07.821 INFO:teuthology.orchestra.run.smithi001.stdout: "flags_names": "hashpspool", 2024-09-17T02:21:07.822 INFO:teuthology.orchestra.run.smithi001.stdout: "type": 1, 2024-09-17T02:21:07.822 INFO:teuthology.orchestra.run.smithi001.stdout: "size": 2, 2024-09-17T02:21:07.822 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": 1, 2024-09-17T02:21:07.822 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_rule": 0, 2024-09-17T02:21:07.822 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:21:07.822 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:21:07.822 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:21:07.822 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:21:07.822 INFO:teuthology.orchestra.run.smithi001.stdout: "is_stretch_pool": false, 2024-09-17T02:21:07.822 INFO:teuthology.orchestra.run.smithi001.stdout: "object_hash": 2, 2024-09-17T02:21:07.822 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:21:07.822 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": 16, 2024-09-17T02:21:07.822 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num": 16, 2024-09-17T02:21:07.822 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num_target": 16, 2024-09-17T02:21:07.823 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_target": 16, 2024-09-17T02:21:07.823 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_pending": 16, 2024-09-17T02:21:07.823 INFO:teuthology.orchestra.run.smithi001.stdout: "last_pg_merge_meta": { 2024-09-17T02:21:07.823 INFO:teuthology.orchestra.run.smithi001.stdout: "source_pgid": "0.0", 2024-09-17T02:21:07.823 INFO:teuthology.orchestra.run.smithi001.stdout: "ready_epoch": 0, 2024-09-17T02:21:07.823 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_started": 0, 2024-09-17T02:21:07.823 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_clean": 0, 2024-09-17T02:21:07.823 INFO:teuthology.orchestra.run.smithi001.stdout: "source_version": "0'0", 2024-09-17T02:21:07.823 INFO:teuthology.orchestra.run.smithi001.stdout: "target_version": "0'0" 2024-09-17T02:21:07.823 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.823 INFO:teuthology.orchestra.run.smithi001.stdout: "last_change": "24", 2024-09-17T02:21:07.823 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend": "0", 2024-09-17T02:21:07.823 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:21:07.823 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:21:07.824 INFO:teuthology.orchestra.run.smithi001.stdout: "auid": 0, 2024-09-17T02:21:07.824 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:21:07.824 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_seq": 0, 2024-09-17T02:21:07.824 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_epoch": 0, 2024-09-17T02:21:07.824 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_snaps": [], 2024-09-17T02:21:07.824 INFO:teuthology.orchestra.run.smithi001.stdout: "removed_snaps": "[]", 2024-09-17T02:21:07.824 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_bytes": 0, 2024-09-17T02:21:07.824 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_objects": 0, 2024-09-17T02:21:07.824 INFO:teuthology.orchestra.run.smithi001.stdout: "tiers": [], 2024-09-17T02:21:07.824 INFO:teuthology.orchestra.run.smithi001.stdout: "tier_of": -1, 2024-09-17T02:21:07.824 INFO:teuthology.orchestra.run.smithi001.stdout: "read_tier": -1, 2024-09-17T02:21:07.824 INFO:teuthology.orchestra.run.smithi001.stdout: "write_tier": -1, 2024-09-17T02:21:07.824 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_mode": "none", 2024-09-17T02:21:07.824 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_bytes": 0, 2024-09-17T02:21:07.825 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_objects": 0, 2024-09-17T02:21:07.825 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:21:07.825 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:21:07.825 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:21:07.825 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_flush_age": 0, 2024-09-17T02:21:07.825 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_evict_age": 0, 2024-09-17T02:21:07.825 INFO:teuthology.orchestra.run.smithi001.stdout: "erasure_code_profile": "", 2024-09-17T02:21:07.825 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_params": { 2024-09-17T02:21:07.825 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "none" 2024-09-17T02:21:07.825 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.825 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_period": 0, 2024-09-17T02:21:07.825 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_count": 0, 2024-09-17T02:21:07.826 INFO:teuthology.orchestra.run.smithi001.stdout: "use_gmt_hitset": true, 2024-09-17T02:21:07.826 INFO:teuthology.orchestra.run.smithi001.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:21:07.826 INFO:teuthology.orchestra.run.smithi001.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:21:07.826 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:21:07.826 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:21:07.826 INFO:teuthology.orchestra.run.smithi001.stdout: "grade_table": [], 2024-09-17T02:21:07.826 INFO:teuthology.orchestra.run.smithi001.stdout: "stripe_width": 0, 2024-09-17T02:21:07.826 INFO:teuthology.orchestra.run.smithi001.stdout: "expected_num_objects": 0, 2024-09-17T02:21:07.826 INFO:teuthology.orchestra.run.smithi001.stdout: "fast_read": false, 2024-09-17T02:21:07.826 INFO:teuthology.orchestra.run.smithi001.stdout: "options": {}, 2024-09-17T02:21:07.826 INFO:teuthology.orchestra.run.smithi001.stdout: "application_metadata": { 2024-09-17T02:21:07.826 INFO:teuthology.orchestra.run.smithi001.stdout: "rados": {} 2024-09-17T02:21:07.826 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.827 INFO:teuthology.orchestra.run.smithi001.stdout: "read_balance": { 2024-09-17T02:21:07.827 INFO:teuthology.orchestra.run.smithi001.stdout: "score_type": "Fair distribution", 2024-09-17T02:21:07.827 INFO:teuthology.orchestra.run.smithi001.stdout: "score_acting": 1.309999942779541, 2024-09-17T02:21:07.827 INFO:teuthology.orchestra.run.smithi001.stdout: "score_stable": 1.309999942779541, 2024-09-17T02:21:07.827 INFO:teuthology.orchestra.run.smithi001.stdout: "optimal_score": 1, 2024-09-17T02:21:07.827 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_acting": 1.309999942779541, 2024-09-17T02:21:07.827 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_stable": 1.309999942779541, 2024-09-17T02:21:07.827 INFO:teuthology.orchestra.run.smithi001.stdout: "primary_affinity_weighted": 0.79247540235519409, 2024-09-17T02:21:07.827 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity": 0.79000002145767212, 2024-09-17T02:21:07.827 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity_weighted": 0.79000002145767212 2024-09-17T02:21:07.827 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:21:07.827 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:21:07.827 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-17T02:21:07.828 INFO:teuthology.orchestra.run.smithi001.stdout: "osds": [ 2024-09-17T02:21:07.828 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.828 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 0, 2024-09-17T02:21:07.828 INFO:teuthology.orchestra.run.smithi001.stdout: "uuid": "fae746a8-754d-4e52-9819-004ebb0d6886", 2024-09-17T02:21:07.828 INFO:teuthology.orchestra.run.smithi001.stdout: "up": 1, 2024-09-17T02:21:07.828 INFO:teuthology.orchestra.run.smithi001.stdout: "in": 1, 2024-09-17T02:21:07.828 INFO:teuthology.orchestra.run.smithi001.stdout: "weight": 1, 2024-09-17T02:21:07.828 INFO:teuthology.orchestra.run.smithi001.stdout: "primary_affinity": 0.3774261474609375, 2024-09-17T02:21:07.828 INFO:teuthology.orchestra.run.smithi001.stdout: "last_clean_begin": 0, 2024-09-17T02:21:07.828 INFO:teuthology.orchestra.run.smithi001.stdout: "last_clean_end": 0, 2024-09-17T02:21:07.828 INFO:teuthology.orchestra.run.smithi001.stdout: "up_from": 9, 2024-09-17T02:21:07.828 INFO:teuthology.orchestra.run.smithi001.stdout: "up_thru": 38, 2024-09-17T02:21:07.828 INFO:teuthology.orchestra.run.smithi001.stdout: "down_at": 0, 2024-09-17T02:21:07.828 INFO:teuthology.orchestra.run.smithi001.stdout: "lost_at": 0, 2024-09-17T02:21:07.829 INFO:teuthology.orchestra.run.smithi001.stdout: "public_addrs": { 2024-09-17T02:21:07.829 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:21:07.829 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.829 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:21:07.829 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.32:6800", 2024-09-17T02:21:07.829 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2347677104 2024-09-17T02:21:07.829 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.829 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.829 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:21:07.829 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.32:6801", 2024-09-17T02:21:07.829 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2347677104 2024-09-17T02:21:07.829 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:21:07.829 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:21:07.830 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.830 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_addrs": { 2024-09-17T02:21:07.830 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:21:07.830 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.830 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:21:07.830 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.32:6802", 2024-09-17T02:21:07.830 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2347677104 2024-09-17T02:21:07.830 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.830 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.830 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:21:07.830 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.32:6803", 2024-09-17T02:21:07.830 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2347677104 2024-09-17T02:21:07.830 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:21:07.830 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:21:07.831 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.831 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_back_addrs": { 2024-09-17T02:21:07.831 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:21:07.831 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.831 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:21:07.831 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.32:6806", 2024-09-17T02:21:07.831 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2347677104 2024-09-17T02:21:07.831 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.831 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.831 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:21:07.831 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.32:6807", 2024-09-17T02:21:07.831 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2347677104 2024-09-17T02:21:07.831 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:21:07.831 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:21:07.832 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.832 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_front_addrs": { 2024-09-17T02:21:07.832 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:21:07.832 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.832 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:21:07.832 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.32:6804", 2024-09-17T02:21:07.832 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2347677104 2024-09-17T02:21:07.832 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.832 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.832 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:21:07.832 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.32:6805", 2024-09-17T02:21:07.832 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2347677104 2024-09-17T02:21:07.833 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:21:07.833 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:21:07.833 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.833 INFO:teuthology.orchestra.run.smithi001.stdout: "public_addr": "172.21.15.32:6801/2347677104", 2024-09-17T02:21:07.833 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_addr": "172.21.15.32:6803/2347677104", 2024-09-17T02:21:07.833 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_back_addr": "172.21.15.32:6807/2347677104", 2024-09-17T02:21:07.833 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_front_addr": "172.21.15.32:6805/2347677104", 2024-09-17T02:21:07.833 INFO:teuthology.orchestra.run.smithi001.stdout: "state": [ 2024-09-17T02:21:07.833 INFO:teuthology.orchestra.run.smithi001.stdout: "exists", 2024-09-17T02:21:07.833 INFO:teuthology.orchestra.run.smithi001.stdout: "up" 2024-09-17T02:21:07.833 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:21:07.833 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.833 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.833 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 1, 2024-09-17T02:21:07.834 INFO:teuthology.orchestra.run.smithi001.stdout: "uuid": "c9397688-80ca-4c21-b80d-1740194c389d", 2024-09-17T02:21:07.834 INFO:teuthology.orchestra.run.smithi001.stdout: "up": 1, 2024-09-17T02:21:07.834 INFO:teuthology.orchestra.run.smithi001.stdout: "in": 1, 2024-09-17T02:21:07.834 INFO:teuthology.orchestra.run.smithi001.stdout: "weight": 0.7863006591796875, 2024-09-17T02:21:07.834 INFO:teuthology.orchestra.run.smithi001.stdout: "primary_affinity": 1, 2024-09-17T02:21:07.834 INFO:teuthology.orchestra.run.smithi001.stdout: "last_clean_begin": 0, 2024-09-17T02:21:07.834 INFO:teuthology.orchestra.run.smithi001.stdout: "last_clean_end": 0, 2024-09-17T02:21:07.834 INFO:teuthology.orchestra.run.smithi001.stdout: "up_from": 8, 2024-09-17T02:21:07.834 INFO:teuthology.orchestra.run.smithi001.stdout: "up_thru": 26, 2024-09-17T02:21:07.834 INFO:teuthology.orchestra.run.smithi001.stdout: "down_at": 0, 2024-09-17T02:21:07.834 INFO:teuthology.orchestra.run.smithi001.stdout: "lost_at": 0, 2024-09-17T02:21:07.834 INFO:teuthology.orchestra.run.smithi001.stdout: "public_addrs": { 2024-09-17T02:21:07.834 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:21:07.835 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.835 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:21:07.835 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.153:6800", 2024-09-17T02:21:07.835 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1905904204 2024-09-17T02:21:07.835 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.835 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.835 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:21:07.835 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.153:6801", 2024-09-17T02:21:07.835 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1905904204 2024-09-17T02:21:07.835 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:21:07.835 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:21:07.835 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.835 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_addrs": { 2024-09-17T02:21:07.835 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:21:07.836 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.836 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:21:07.836 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.153:6802", 2024-09-17T02:21:07.836 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1905904204 2024-09-17T02:21:07.836 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.836 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.836 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:21:07.836 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.153:6803", 2024-09-17T02:21:07.836 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1905904204 2024-09-17T02:21:07.836 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:21:07.837 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:21:07.837 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.837 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_back_addrs": { 2024-09-17T02:21:07.837 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:21:07.837 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.837 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:21:07.837 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.153:6806", 2024-09-17T02:21:07.837 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1905904204 2024-09-17T02:21:07.837 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.837 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.837 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:21:07.837 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.153:6807", 2024-09-17T02:21:07.837 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1905904204 2024-09-17T02:21:07.838 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:21:07.838 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:21:07.838 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.838 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_front_addrs": { 2024-09-17T02:21:07.838 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:21:07.838 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.838 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:21:07.838 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.153:6804", 2024-09-17T02:21:07.838 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1905904204 2024-09-17T02:21:07.838 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.838 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.838 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:21:07.838 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.153:6805", 2024-09-17T02:21:07.839 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1905904204 2024-09-17T02:21:07.839 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:21:07.839 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:21:07.839 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.839 INFO:teuthology.orchestra.run.smithi001.stdout: "public_addr": "172.21.15.153:6801/1905904204", 2024-09-17T02:21:07.839 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_addr": "172.21.15.153:6803/1905904204", 2024-09-17T02:21:07.839 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_back_addr": "172.21.15.153:6807/1905904204", 2024-09-17T02:21:07.839 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_front_addr": "172.21.15.153:6805/1905904204", 2024-09-17T02:21:07.839 INFO:teuthology.orchestra.run.smithi001.stdout: "state": [ 2024-09-17T02:21:07.839 INFO:teuthology.orchestra.run.smithi001.stdout: "exists", 2024-09-17T02:21:07.839 INFO:teuthology.orchestra.run.smithi001.stdout: "up" 2024-09-17T02:21:07.839 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:21:07.839 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.839 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.840 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 2, 2024-09-17T02:21:07.840 INFO:teuthology.orchestra.run.smithi001.stdout: "uuid": "6d8c01a8-b657-4abc-a624-2b35ef0512ea", 2024-09-17T02:21:07.840 INFO:teuthology.orchestra.run.smithi001.stdout: "up": 1, 2024-09-17T02:21:07.840 INFO:teuthology.orchestra.run.smithi001.stdout: "in": 1, 2024-09-17T02:21:07.840 INFO:teuthology.orchestra.run.smithi001.stdout: "weight": 1, 2024-09-17T02:21:07.840 INFO:teuthology.orchestra.run.smithi001.stdout: "primary_affinity": 1, 2024-09-17T02:21:07.840 INFO:teuthology.orchestra.run.smithi001.stdout: "last_clean_begin": 0, 2024-09-17T02:21:07.840 INFO:teuthology.orchestra.run.smithi001.stdout: "last_clean_end": 0, 2024-09-17T02:21:07.840 INFO:teuthology.orchestra.run.smithi001.stdout: "up_from": 8, 2024-09-17T02:21:07.840 INFO:teuthology.orchestra.run.smithi001.stdout: "up_thru": 38, 2024-09-17T02:21:07.840 INFO:teuthology.orchestra.run.smithi001.stdout: "down_at": 0, 2024-09-17T02:21:07.840 INFO:teuthology.orchestra.run.smithi001.stdout: "lost_at": 0, 2024-09-17T02:21:07.840 INFO:teuthology.orchestra.run.smithi001.stdout: "public_addrs": { 2024-09-17T02:21:07.841 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:21:07.841 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.841 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:21:07.841 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.164:6800", 2024-09-17T02:21:07.841 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 603659517 2024-09-17T02:21:07.841 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.841 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.841 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:21:07.841 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.164:6801", 2024-09-17T02:21:07.841 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 603659517 2024-09-17T02:21:07.841 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:21:07.841 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:21:07.841 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.841 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_addrs": { 2024-09-17T02:21:07.842 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:21:07.842 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.842 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:21:07.842 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.164:6802", 2024-09-17T02:21:07.842 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 603659517 2024-09-17T02:21:07.842 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.842 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.842 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:21:07.842 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.164:6803", 2024-09-17T02:21:07.842 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 603659517 2024-09-17T02:21:07.842 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:21:07.842 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:21:07.842 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.843 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_back_addrs": { 2024-09-17T02:21:07.843 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:21:07.843 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.843 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:21:07.843 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.164:6806", 2024-09-17T02:21:07.843 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 603659517 2024-09-17T02:21:07.843 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.843 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.843 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:21:07.843 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.164:6807", 2024-09-17T02:21:07.843 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 603659517 2024-09-17T02:21:07.843 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:21:07.843 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:21:07.844 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.844 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_front_addrs": { 2024-09-17T02:21:07.844 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:21:07.844 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.844 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:21:07.844 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.164:6804", 2024-09-17T02:21:07.844 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 603659517 2024-09-17T02:21:07.844 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.844 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.844 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:21:07.844 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.164:6805", 2024-09-17T02:21:07.844 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 603659517 2024-09-17T02:21:07.844 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:21:07.845 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:21:07.845 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.845 INFO:teuthology.orchestra.run.smithi001.stdout: "public_addr": "172.21.15.164:6801/603659517", 2024-09-17T02:21:07.845 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_addr": "172.21.15.164:6803/603659517", 2024-09-17T02:21:07.845 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_back_addr": "172.21.15.164:6807/603659517", 2024-09-17T02:21:07.845 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_front_addr": "172.21.15.164:6805/603659517", 2024-09-17T02:21:07.845 INFO:teuthology.orchestra.run.smithi001.stdout: "state": [ 2024-09-17T02:21:07.845 INFO:teuthology.orchestra.run.smithi001.stdout: "exists", 2024-09-17T02:21:07.845 INFO:teuthology.orchestra.run.smithi001.stdout: "up" 2024-09-17T02:21:07.845 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:21:07.845 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:21:07.845 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-17T02:21:07.845 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_xinfo": [ 2024-09-17T02:21:07.846 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.846 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 0, 2024-09-17T02:21:07.846 INFO:teuthology.orchestra.run.smithi001.stdout: "down_stamp": "0.000000", 2024-09-17T02:21:07.846 INFO:teuthology.orchestra.run.smithi001.stdout: "laggy_probability": 0, 2024-09-17T02:21:07.846 INFO:teuthology.orchestra.run.smithi001.stdout: "laggy_interval": 0, 2024-09-17T02:21:07.846 INFO:teuthology.orchestra.run.smithi001.stdout: "features": 4540701547738038271, 2024-09-17T02:21:07.846 INFO:teuthology.orchestra.run.smithi001.stdout: "old_weight": 0, 2024-09-17T02:21:07.846 INFO:teuthology.orchestra.run.smithi001.stdout: "last_purged_snaps_scrub": "2024-09-17T02:20:00.476482+0000", 2024-09-17T02:21:07.846 INFO:teuthology.orchestra.run.smithi001.stdout: "dead_epoch": 0 2024-09-17T02:21:07.846 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.846 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.847 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 1, 2024-09-17T02:21:07.847 INFO:teuthology.orchestra.run.smithi001.stdout: "down_stamp": "0.000000", 2024-09-17T02:21:07.847 INFO:teuthology.orchestra.run.smithi001.stdout: "laggy_probability": 0, 2024-09-17T02:21:07.847 INFO:teuthology.orchestra.run.smithi001.stdout: "laggy_interval": 0, 2024-09-17T02:21:07.847 INFO:teuthology.orchestra.run.smithi001.stdout: "features": 4540701547738038271, 2024-09-17T02:21:07.847 INFO:teuthology.orchestra.run.smithi001.stdout: "old_weight": 0, 2024-09-17T02:21:07.847 INFO:teuthology.orchestra.run.smithi001.stdout: "last_purged_snaps_scrub": "2024-09-17T02:20:00.250903+0000", 2024-09-17T02:21:07.847 INFO:teuthology.orchestra.run.smithi001.stdout: "dead_epoch": 0 2024-09-17T02:21:07.847 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.847 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.847 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 2, 2024-09-17T02:21:07.848 INFO:teuthology.orchestra.run.smithi001.stdout: "down_stamp": "0.000000", 2024-09-17T02:21:07.848 INFO:teuthology.orchestra.run.smithi001.stdout: "laggy_probability": 0, 2024-09-17T02:21:07.848 INFO:teuthology.orchestra.run.smithi001.stdout: "laggy_interval": 0, 2024-09-17T02:21:07.848 INFO:teuthology.orchestra.run.smithi001.stdout: "features": 4540701547738038271, 2024-09-17T02:21:07.848 INFO:teuthology.orchestra.run.smithi001.stdout: "old_weight": 0, 2024-09-17T02:21:07.848 INFO:teuthology.orchestra.run.smithi001.stdout: "last_purged_snaps_scrub": "2024-09-17T02:20:00.326430+0000", 2024-09-17T02:21:07.848 INFO:teuthology.orchestra.run.smithi001.stdout: "dead_epoch": 0 2024-09-17T02:21:07.848 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:21:07.848 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-17T02:21:07.848 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_upmap": [], 2024-09-17T02:21:07.848 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_upmap_items": [], 2024-09-17T02:21:07.849 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_upmap_primaries": [], 2024-09-17T02:21:07.849 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_temp": [ 2024-09-17T02:21:07.849 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.849 INFO:teuthology.orchestra.run.smithi001.stdout: "pgid": "5.1", 2024-09-17T02:21:07.849 INFO:teuthology.orchestra.run.smithi001.stdout: "osds": [ 2024-09-17T02:21:07.849 INFO:teuthology.orchestra.run.smithi001.stdout: 2, 2024-09-17T02:21:07.849 INFO:teuthology.orchestra.run.smithi001.stdout: 1 2024-09-17T02:21:07.849 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:21:07.849 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.849 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.849 INFO:teuthology.orchestra.run.smithi001.stdout: "pgid": "5.3", 2024-09-17T02:21:07.849 INFO:teuthology.orchestra.run.smithi001.stdout: "osds": [ 2024-09-17T02:21:07.850 INFO:teuthology.orchestra.run.smithi001.stdout: 2, 2024-09-17T02:21:07.850 INFO:teuthology.orchestra.run.smithi001.stdout: 1 2024-09-17T02:21:07.850 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:21:07.850 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.850 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.850 INFO:teuthology.orchestra.run.smithi001.stdout: "pgid": "5.4", 2024-09-17T02:21:07.850 INFO:teuthology.orchestra.run.smithi001.stdout: "osds": [ 2024-09-17T02:21:07.850 INFO:teuthology.orchestra.run.smithi001.stdout: 0, 2024-09-17T02:21:07.850 INFO:teuthology.orchestra.run.smithi001.stdout: 1 2024-09-17T02:21:07.850 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:21:07.850 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.851 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:21:07.851 INFO:teuthology.orchestra.run.smithi001.stdout: "pgid": "5.b", 2024-09-17T02:21:07.851 INFO:teuthology.orchestra.run.smithi001.stdout: "osds": [ 2024-09-17T02:21:07.851 INFO:teuthology.orchestra.run.smithi001.stdout: 0, 2024-09-17T02:21:07.851 INFO:teuthology.orchestra.run.smithi001.stdout: 1 2024-09-17T02:21:07.851 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:21:07.851 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:21:07.851 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-17T02:21:07.851 INFO:teuthology.orchestra.run.smithi001.stdout: "primary_temp": [], 2024-09-17T02:21:07.851 INFO:teuthology.orchestra.run.smithi001.stdout: "blocklist": {}, 2024-09-17T02:21:07.851 INFO:teuthology.orchestra.run.smithi001.stdout: "range_blocklist": {}, 2024-09-17T02:21:07.851 INFO:teuthology.orchestra.run.smithi001.stdout: "erasure_code_profiles": { 2024-09-17T02:21:07.851 INFO:teuthology.orchestra.run.smithi001.stdout: "default": { 2024-09-17T02:21:07.852 INFO:teuthology.orchestra.run.smithi001.stdout: "crush-failure-domain": "osd", 2024-09-17T02:21:07.852 INFO:teuthology.orchestra.run.smithi001.stdout: "k": "2", 2024-09-17T02:21:07.852 INFO:teuthology.orchestra.run.smithi001.stdout: "m": "1", 2024-09-17T02:21:07.852 INFO:teuthology.orchestra.run.smithi001.stdout: "plugin": "jerasure", 2024-09-17T02:21:07.852 INFO:teuthology.orchestra.run.smithi001.stdout: "technique": "reed_sol_van" 2024-09-17T02:21:07.852 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:21:07.852 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:21:07.852 INFO:teuthology.orchestra.run.smithi001.stdout: "removed_snaps_queue": [], 2024-09-17T02:21:07.852 INFO:teuthology.orchestra.run.smithi001.stdout: "new_removed_snaps": [], 2024-09-17T02:21:07.853 INFO:teuthology.orchestra.run.smithi001.stdout: "new_purged_snaps": [], 2024-09-17T02:21:07.853 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_node_flags": {}, 2024-09-17T02:21:07.853 INFO:teuthology.orchestra.run.smithi001.stdout: "device_class_flags": {}, 2024-09-17T02:21:07.853 INFO:teuthology.orchestra.run.smithi001.stdout: "stretch_mode": { 2024-09-17T02:21:07.853 INFO:teuthology.orchestra.run.smithi001.stdout: "stretch_mode_enabled": false, 2024-09-17T02:21:07.853 INFO:teuthology.orchestra.run.smithi001.stdout: "stretch_bucket_count": 0, 2024-09-17T02:21:07.853 INFO:teuthology.orchestra.run.smithi001.stdout: "degraded_stretch_mode": 0, 2024-09-17T02:21:07.853 INFO:teuthology.orchestra.run.smithi001.stdout: "recovering_stretch_mode": 0, 2024-09-17T02:21:07.853 INFO:teuthology.orchestra.run.smithi001.stdout: "stretch_mode_bucket": 0 2024-09-17T02:21:07.853 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:21:07.854 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-17T02:21:07.856 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:07.855+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:07.857 INFO:tasks.thrashosds.thrasher:j is {'epoch': 40, 'fsid': '37cd4495-4915-41f4-bad2-2394cbe235f3', 'created': '2024-09-17T02:19:52.516342+0000', 'modified': '2024-09-17T02:21:06.459449+0000', 'last_up_change': '2024-09-17T02:20:02.422255+0000', 'last_in_change': '2024-09-17T02:19:54.329423+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T02:20:03.416336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.7924754023551941, 'average_primary_affinity': 0.7900000214576721, 'average_primary_affinity_weighted': 0.7900000214576721}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-17T02:20:08.718296+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 16, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.7924754023551941, 'average_primary_affinity': 0.7900000214576721, 'average_primary_affinity_weighted': 0.7900000214576721}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-17T02:20:13.566396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.7924754023551941, 'average_primary_affinity': 0.7900000214576721, 'average_primary_affinity_weighted': 0.7900000214576721}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-17T02:20:14.902662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5499999523162842, 'score_stable': 1.5499999523162842, 'optimal_score': 1, 'raw_score_acting': 1.5499999523162842, 'raw_score_stable': 1.5499999523162842, 'primary_affinity_weighted': 0.7924754023551941, 'average_primary_affinity': 0.7900000214576721, 'average_primary_affinity_weighted': 0.7900000214576721}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-09-17T02:20:30.517004+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 0.7924754023551941, 'average_primary_affinity': 0.7900000214576721, 'average_primary_affinity_weighted': 0.7900000214576721}}], 'osds': [{'osd': 0, 'uuid': 'fae746a8-754d-4e52-9819-004ebb0d6886', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.3774261474609375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 38, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6800', 'nonce': 2347677104}, {'type': 'v1', 'addr': '172.21.15.32:6801', 'nonce': 2347677104}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6802', 'nonce': 2347677104}, {'type': 'v1', 'addr': '172.21.15.32:6803', 'nonce': 2347677104}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6806', 'nonce': 2347677104}, {'type': 'v1', 'addr': '172.21.15.32:6807', 'nonce': 2347677104}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6804', 'nonce': 2347677104}, {'type': 'v1', 'addr': '172.21.15.32:6805', 'nonce': 2347677104}]}, 'public_addr': '172.21.15.32:6801/2347677104', 'cluster_addr': '172.21.15.32:6803/2347677104', 'heartbeat_back_addr': '172.21.15.32:6807/2347677104', 'heartbeat_front_addr': '172.21.15.32:6805/2347677104', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'c9397688-80ca-4c21-b80d-1740194c389d', 'up': 1, 'in': 1, 'weight': 0.7863006591796875, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 26, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6800', 'nonce': 1905904204}, {'type': 'v1', 'addr': '172.21.15.153:6801', 'nonce': 1905904204}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6802', 'nonce': 1905904204}, {'type': 'v1', 'addr': '172.21.15.153:6803', 'nonce': 1905904204}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6806', 'nonce': 1905904204}, {'type': 'v1', 'addr': '172.21.15.153:6807', 'nonce': 1905904204}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6804', 'nonce': 1905904204}, {'type': 'v1', 'addr': '172.21.15.153:6805', 'nonce': 1905904204}]}, 'public_addr': '172.21.15.153:6801/1905904204', 'cluster_addr': '172.21.15.153:6803/1905904204', 'heartbeat_back_addr': '172.21.15.153:6807/1905904204', 'heartbeat_front_addr': '172.21.15.153:6805/1905904204', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '6d8c01a8-b657-4abc-a624-2b35ef0512ea', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 38, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6800', 'nonce': 603659517}, {'type': 'v1', 'addr': '172.21.15.164:6801', 'nonce': 603659517}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6802', 'nonce': 603659517}, {'type': 'v1', 'addr': '172.21.15.164:6803', 'nonce': 603659517}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6806', 'nonce': 603659517}, {'type': 'v1', 'addr': '172.21.15.164:6807', 'nonce': 603659517}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6804', 'nonce': 603659517}, {'type': 'v1', 'addr': '172.21.15.164:6805', 'nonce': 603659517}]}, 'public_addr': '172.21.15.164:6801/603659517', 'cluster_addr': '172.21.15.164:6803/603659517', 'heartbeat_back_addr': '172.21.15.164:6807/603659517', 'heartbeat_front_addr': '172.21.15.164:6805/603659517', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T02:20:00.476482+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T02:20:00.250903+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T02:20:00.326430+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [{'pgid': '5.1', 'osds': [2, 1]}, {'pgid': '5.3', 'osds': [2, 1]}, {'pgid': '5.4', 'osds': [0, 1]}, {'pgid': '5.b', 'osds': [0, 1]}], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-17T02:21:07.857 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:21:07.899 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:07.899 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:07.919 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:07.963 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:07.966+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:08.056 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:08.058+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:08.073 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:08.073 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:08.095 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:21:08.157 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:08.158+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:08.175 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:21:08.177 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-17T02:21:08.178 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:21:08.192 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2024-09-17T02:21:07.359701+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4665052061,"num_objects":71200,"num_object_clones":0,"num_object_copies":142400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":8605,"num_objects_unfound":0,"num_objects_dirty":71200,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":71424,"num_write_kb":4558612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":10944512,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57894,"ondisk_log_size":57894,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":243,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":798756,"kb_used_data":570532,"kb_used_omap":4,"kb_used_meta":228155,"kb_avail":282316764,"statfs":{"total":289910292480,"available":289092366336,"internally_reserved":0,"allocated":584224768,"data_stored":9328486887,"data_compressed":7981750,"data_compressed_allocated":583004160,"data_compressed_original":9328033792,"omap_allocated":4785,"internal_metadata":233631055},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,10],"upper_bound":4096},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":212992000,"num_objects":3250,"num_object_clones":0,"num_object_copies":6500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":8605,"num_objects_unfound":0,"num_objects_dirty":3250,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3250,"num_write_kb":208000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":10747904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.927531"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"peering","last_fresh":"2024-09-17T02:21:01.447511+0000","last_change":"2024-09-17T02:21:02.443698+0000","last_active":"2024-09-17T02:21:02.443698+0000","last_peered":"2024-09-17T02:21:01.447511+0000","last_clean":"2024-09-17T02:21:01.447511+0000","last_became_active":"2024-09-17T02:20:16.576566+0000","last_became_peered":"2024-09-17T02:20:16.576566+0000","last_unstale":"2024-09-17T02:21:01.447511+0000","last_undegraded":"2024-09-17T02:21:01.447511+0000","last_fullsized":"2024-09-17T02:21:01.447511+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.437000+0000","last_change":"2024-09-17T02:20:37.709698+0000","last_active":"2024-09-17T02:21:01.437000+0000","last_peered":"2024-09-17T02:21:01.437000+0000","last_clean":"2024-09-17T02:21:01.437000+0000","last_became_active":"2024-09-17T02:20:37.708951+0000","last_became_peered":"2024-09-17T02:20:37.708951+0000","last_unstale":"2024-09-17T02:21:01.437000+0000","last_undegraded":"2024-09-17T02:21:01.437000+0000","last_fullsized":"2024-09-17T02:21:01.437000+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:30.839358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.485540+0000","last_change":"2024-09-17T02:20:16.582493+0000","last_active":"2024-09-17T02:21:02.485540+0000","last_peered":"2024-09-17T02:21:02.485540+0000","last_clean":"2024-09-17T02:21:02.485540+0000","last_became_active":"2024-09-17T02:20:16.581463+0000","last_became_peered":"2024-09-17T02:20:16.581463+0000","last_unstale":"2024-09-17T02:21:02.485540+0000","last_undegraded":"2024-09-17T02:21:02.485540+0000","last_fullsized":"2024-09-17T02:21:02.485540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:12.134652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"peering","last_fresh":"2024-09-17T02:21:01.435192+0000","last_change":"2024-09-17T02:21:02.479856+0000","last_active":"2024-09-17T02:21:02.479856+0000","last_peered":"2024-09-17T02:21:01.435192+0000","last_clean":"2024-09-17T02:21:01.435192+0000","last_became_active":"2024-09-17T02:20:16.566795+0000","last_became_peered":"2024-09-17T02:20:16.566795+0000","last_unstale":"2024-09-17T02:21:01.435192+0000","last_undegraded":"2024-09-17T02:21:01.435192+0000","last_fullsized":"2024-09-17T02:21:01.435192+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.479413+0000","last_change":"2024-09-17T02:21:01.449199+0000","last_active":"2024-09-17T02:21:02.479413+0000","last_peered":"2024-09-17T02:21:02.479413+0000","last_clean":"2024-09-17T02:21:02.479413+0000","last_became_active":"2024-09-17T02:21:01.448772+0000","last_became_peered":"2024-09-17T02:21:01.448772+0000","last_unstale":"2024-09-17T02:21:02.479413+0000","last_undegraded":"2024-09-17T02:21:02.479413+0000","last_fullsized":"2024-09-17T02:21:02.479413+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:41.924060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.437030+0000","last_change":"2024-09-17T02:20:16.568765+0000","last_active":"2024-09-17T02:21:02.437030+0000","last_peered":"2024-09-17T02:21:02.437030+0000","last_clean":"2024-09-17T02:21:02.437030+0000","last_became_active":"2024-09-17T02:20:16.564108+0000","last_became_peered":"2024-09-17T02:20:16.564108+0000","last_unstale":"2024-09-17T02:21:02.437030+0000","last_undegraded":"2024-09-17T02:21:02.437030+0000","last_fullsized":"2024-09-17T02:21:02.437030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:26.782410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.482739+0000","last_change":"2024-09-17T02:20:16.563357+0000","last_active":"2024-09-17T02:21:02.482739+0000","last_peered":"2024-09-17T02:21:02.482739+0000","last_clean":"2024-09-17T02:21:02.482739+0000","last_became_active":"2024-09-17T02:20:16.562276+0000","last_became_peered":"2024-09-17T02:20:16.562276+0000","last_unstale":"2024-09-17T02:21:02.482739+0000","last_undegraded":"2024-09-17T02:21:02.482739+0000","last_fullsized":"2024-09-17T02:21:02.482739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:47.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.436571+0000","last_change":"2024-09-17T02:20:16.568482+0000","last_active":"2024-09-17T02:21:02.436571+0000","last_peered":"2024-09-17T02:21:02.436571+0000","last_clean":"2024-09-17T02:21:02.436571+0000","last_became_active":"2024-09-17T02:20:16.565416+0000","last_became_peered":"2024-09-17T02:20:16.565416+0000","last_unstale":"2024-09-17T02:21:02.436571+0000","last_undegraded":"2024-09-17T02:21:02.436571+0000","last_fullsized":"2024-09-17T02:21:02.436571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:13.574859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.436792+0000","last_change":"2024-09-17T02:20:16.584665+0000","last_active":"2024-09-17T02:21:01.436792+0000","last_peered":"2024-09-17T02:21:01.436792+0000","last_clean":"2024-09-17T02:21:01.436792+0000","last_became_active":"2024-09-17T02:20:16.580797+0000","last_became_peered":"2024-09-17T02:20:16.580797+0000","last_unstale":"2024-09-17T02:21:01.436792+0000","last_undegraded":"2024-09-17T02:21:01.436792+0000","last_fullsized":"2024-09-17T02:21:01.436792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:47.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.444918+0000","last_change":"2024-09-17T02:21:01.447393+0000","last_active":"2024-09-17T02:21:02.444918+0000","last_peered":"2024-09-17T02:21:02.444918+0000","last_clean":"2024-09-17T02:21:02.444918+0000","last_became_active":"2024-09-17T02:21:01.445553+0000","last_became_peered":"2024-09-17T02:21:01.445553+0000","last_unstale":"2024-09-17T02:21:02.444918+0000","last_undegraded":"2024-09-17T02:21:02.444918+0000","last_fullsized":"2024-09-17T02:21:02.444918+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:23.802195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.485974+0000","last_change":"2024-09-17T02:20:16.565609+0000","last_active":"2024-09-17T02:21:02.485974+0000","last_peered":"2024-09-17T02:21:02.485974+0000","last_clean":"2024-09-17T02:21:02.485974+0000","last_became_active":"2024-09-17T02:20:16.564092+0000","last_became_peered":"2024-09-17T02:20:16.564092+0000","last_unstale":"2024-09-17T02:21:02.485974+0000","last_undegraded":"2024-09-17T02:21:02.485974+0000","last_fullsized":"2024-09-17T02:21:02.485974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:40.921595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.483261+0000","last_change":"2024-09-17T02:20:37.706665+0000","last_active":"2024-09-17T02:21:02.483261+0000","last_peered":"2024-09-17T02:21:02.483261+0000","last_clean":"2024-09-17T02:21:02.483261+0000","last_became_active":"2024-09-17T02:20:37.705937+0000","last_became_peered":"2024-09-17T02:20:37.705937+0000","last_unstale":"2024-09-17T02:21:02.483261+0000","last_undegraded":"2024-09-17T02:21:02.483261+0000","last_fullsized":"2024-09-17T02:21:02.483261+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:49:53.415689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.435785+0000","last_change":"2024-09-17T02:20:37.709476+0000","last_active":"2024-09-17T02:21:01.435785+0000","last_peered":"2024-09-17T02:21:01.435785+0000","last_clean":"2024-09-17T02:21:01.435785+0000","last_became_active":"2024-09-17T02:20:37.708730+0000","last_became_peered":"2024-09-17T02:20:37.708730+0000","last_unstale":"2024-09-17T02:21:01.435785+0000","last_undegraded":"2024-09-17T02:21:01.435785+0000","last_fullsized":"2024-09-17T02:21:01.435785+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:54.725651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.479445+0000","last_change":"2024-09-17T02:20:16.563197+0000","last_active":"2024-09-17T02:21:02.479445+0000","last_peered":"2024-09-17T02:21:02.479445+0000","last_clean":"2024-09-17T02:21:02.479445+0000","last_became_active":"2024-09-17T02:20:16.561221+0000","last_became_peered":"2024-09-17T02:20:16.561221+0000","last_unstale":"2024-09-17T02:21:02.479445+0000","last_undegraded":"2024-09-17T02:21:02.479445+0000","last_fullsized":"2024-09-17T02:21:02.479445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:43.309196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.482973+0000","last_change":"2024-09-17T02:20:16.581305+0000","last_active":"2024-09-17T02:21:02.482973+0000","last_peered":"2024-09-17T02:21:02.482973+0000","last_clean":"2024-09-17T02:21:02.482973+0000","last_became_active":"2024-09-17T02:20:16.580377+0000","last_became_peered":"2024-09-17T02:20:16.580377+0000","last_unstale":"2024-09-17T02:21:02.482973+0000","last_undegraded":"2024-09-17T02:21:02.482973+0000","last_fullsized":"2024-09-17T02:21:02.482973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:43.454908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.436793+0000","last_change":"2024-09-17T02:20:16.562686+0000","last_active":"2024-09-17T02:21:02.436793+0000","last_peered":"2024-09-17T02:21:02.436793+0000","last_clean":"2024-09-17T02:21:02.436793+0000","last_became_active":"2024-09-17T02:20:16.561446+0000","last_became_peered":"2024-09-17T02:20:16.561446+0000","last_unstale":"2024-09-17T02:21:02.436793+0000","last_undegraded":"2024-09-17T02:21:02.436793+0000","last_fullsized":"2024-09-17T02:21:02.436793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:22.801598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.438141+0000","last_change":"2024-09-17T02:20:16.563482+0000","last_active":"2024-09-17T02:21:01.438141+0000","last_peered":"2024-09-17T02:21:01.438141+0000","last_clean":"2024-09-17T02:21:01.438141+0000","last_became_active":"2024-09-17T02:20:16.562735+0000","last_became_peered":"2024-09-17T02:20:16.562735+0000","last_unstale":"2024-09-17T02:21:01.438141+0000","last_undegraded":"2024-09-17T02:21:01.438141+0000","last_fullsized":"2024-09-17T02:21:01.438141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:10.315951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.438040+0000","last_change":"2024-09-17T02:20:37.706162+0000","last_active":"2024-09-17T02:21:01.438040+0000","last_peered":"2024-09-17T02:21:01.438040+0000","last_clean":"2024-09-17T02:21:01.438040+0000","last_became_active":"2024-09-17T02:20:37.705497+0000","last_became_peered":"2024-09-17T02:20:37.705497+0000","last_unstale":"2024-09-17T02:21:01.438040+0000","last_undegraded":"2024-09-17T02:21:01.438040+0000","last_fullsized":"2024-09-17T02:21:01.438040+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:43.467659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.437006+0000","last_change":"2024-09-17T02:20:16.586950+0000","last_active":"2024-09-17T02:21:01.437006+0000","last_peered":"2024-09-17T02:21:01.437006+0000","last_clean":"2024-09-17T02:21:01.437006+0000","last_became_active":"2024-09-17T02:20:16.586281+0000","last_became_peered":"2024-09-17T02:20:16.586281+0000","last_unstale":"2024-09-17T02:21:01.437006+0000","last_undegraded":"2024-09-17T02:21:01.437006+0000","last_fullsized":"2024-09-17T02:21:01.437006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:22.801598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.485307+0000","last_change":"2024-09-17T02:20:16.570514+0000","last_active":"2024-09-17T02:21:02.485307+0000","last_peered":"2024-09-17T02:21:02.485307+0000","last_clean":"2024-09-17T02:21:02.485307+0000","last_became_active":"2024-09-17T02:20:16.567156+0000","last_became_peered":"2024-09-17T02:20:16.567156+0000","last_unstale":"2024-09-17T02:21:02.485307+0000","last_undegraded":"2024-09-17T02:21:02.485307+0000","last_fullsized":"2024-09-17T02:21:02.485307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:51.596077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.480555+0000","last_change":"2024-09-17T02:21:01.450368+0000","last_active":"2024-09-17T02:21:02.480555+0000","last_peered":"2024-09-17T02:21:02.480555+0000","last_clean":"2024-09-17T02:21:02.480555+0000","last_became_active":"2024-09-17T02:21:01.449923+0000","last_became_peered":"2024-09-17T02:21:01.449923+0000","last_unstale":"2024-09-17T02:21:02.480555+0000","last_undegraded":"2024-09-17T02:21:02.480555+0000","last_fullsized":"2024-09-17T02:21:02.480555+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:35.987413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.443920+0000","last_change":"2024-09-17T02:20:16.567109+0000","last_active":"2024-09-17T02:21:02.443920+0000","last_peered":"2024-09-17T02:21:02.443920+0000","last_clean":"2024-09-17T02:21:02.443920+0000","last_became_active":"2024-09-17T02:20:16.564753+0000","last_became_peered":"2024-09-17T02:20:16.564753+0000","last_unstale":"2024-09-17T02:21:02.443920+0000","last_undegraded":"2024-09-17T02:21:02.443920+0000","last_fullsized":"2024-09-17T02:21:02.443920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:01.888476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.434720+0000","last_change":"2024-09-17T02:20:16.558778+0000","last_active":"2024-09-17T02:21:01.434720+0000","last_peered":"2024-09-17T02:21:01.434720+0000","last_clean":"2024-09-17T02:21:01.434720+0000","last_became_active":"2024-09-17T02:20:16.557967+0000","last_became_peered":"2024-09-17T02:20:16.557967+0000","last_unstale":"2024-09-17T02:21:01.434720+0000","last_undegraded":"2024-09-17T02:21:01.434720+0000","last_fullsized":"2024-09-17T02:21:01.434720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:40.577627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.434644+0000","last_change":"2024-09-17T02:20:37.710222+0000","last_active":"2024-09-17T02:21:01.434644+0000","last_peered":"2024-09-17T02:21:01.434644+0000","last_clean":"2024-09-17T02:21:01.434644+0000","last_became_active":"2024-09-17T02:20:37.709227+0000","last_became_peered":"2024-09-17T02:20:37.709227+0000","last_unstale":"2024-09-17T02:21:01.434644+0000","last_undegraded":"2024-09-17T02:21:01.434644+0000","last_fullsized":"2024-09-17T02:21:01.434644+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:01:44.250550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.446668+0000","last_change":"2024-09-17T02:20:16.573189+0000","last_active":"2024-09-17T02:21:02.446668+0000","last_peered":"2024-09-17T02:21:02.446668+0000","last_clean":"2024-09-17T02:21:02.446668+0000","last_became_active":"2024-09-17T02:20:16.570669+0000","last_became_peered":"2024-09-17T02:20:16.570669+0000","last_unstale":"2024-09-17T02:21:02.446668+0000","last_undegraded":"2024-09-17T02:21:02.446668+0000","last_fullsized":"2024-09-17T02:21:02.446668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:52.753219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.437806+0000","last_change":"2024-09-17T02:20:16.581076+0000","last_active":"2024-09-17T02:21:01.437806+0000","last_peered":"2024-09-17T02:21:01.437806+0000","last_clean":"2024-09-17T02:21:01.437806+0000","last_became_active":"2024-09-17T02:20:16.579989+0000","last_became_peered":"2024-09-17T02:20:16.579989+0000","last_unstale":"2024-09-17T02:21:01.437806+0000","last_undegraded":"2024-09-17T02:21:01.437806+0000","last_fullsized":"2024-09-17T02:21:01.437806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:43.454908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.486361+0000","last_change":"2024-09-17T02:20:16.582808+0000","last_active":"2024-09-17T02:21:02.486361+0000","last_peered":"2024-09-17T02:21:02.486361+0000","last_clean":"2024-09-17T02:21:02.486361+0000","last_became_active":"2024-09-17T02:20:16.581358+0000","last_became_peered":"2024-09-17T02:20:16.581358+0000","last_unstale":"2024-09-17T02:21:02.486361+0000","last_undegraded":"2024-09-17T02:21:02.486361+0000","last_fullsized":"2024-09-17T02:21:02.486361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:26.441162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.483511+0000","last_change":"2024-09-17T02:20:37.706797+0000","last_active":"2024-09-17T02:21:02.483511+0000","last_peered":"2024-09-17T02:21:02.483511+0000","last_clean":"2024-09-17T02:21:02.483511+0000","last_became_active":"2024-09-17T02:20:37.706110+0000","last_became_peered":"2024-09-17T02:20:37.706110+0000","last_unstale":"2024-09-17T02:21:02.483511+0000","last_undegraded":"2024-09-17T02:21:02.483511+0000","last_fullsized":"2024-09-17T02:21:02.483511+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:16.772216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":2,"reported_epoch":37,"state":"peering","last_fresh":"2024-09-17T02:20:16.544209+0000","last_change":"2024-09-17T02:21:02.515127+0000","last_active":"2024-09-17T02:20:15.524398+0000","last_peered":"2024-09-17T02:20:15.524398+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:20:16.544209+0000","last_undegraded":"2024-09-17T02:20:16.544209+0000","last_fullsized":"2024-09-17T02:20:16.544209+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.444707+0000","last_change":"2024-09-17T02:20:16.565220+0000","last_active":"2024-09-17T02:21:02.444707+0000","last_peered":"2024-09-17T02:21:02.444707+0000","last_clean":"2024-09-17T02:21:02.444707+0000","last_became_active":"2024-09-17T02:20:16.562419+0000","last_became_peered":"2024-09-17T02:20:16.562419+0000","last_unstale":"2024-09-17T02:21:02.444707+0000","last_undegraded":"2024-09-17T02:21:02.444707+0000","last_fullsized":"2024-09-17T02:21:02.444707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:03.961277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.436604+0000","last_change":"2024-09-17T02:21:01.444478+0000","last_active":"2024-09-17T02:21:02.436604+0000","last_peered":"2024-09-17T02:21:02.436604+0000","last_clean":"2024-09-17T02:21:02.436604+0000","last_became_active":"2024-09-17T02:21:01.443574+0000","last_became_peered":"2024-09-17T02:21:01.443574+0000","last_unstale":"2024-09-17T02:21:02.436604+0000","last_undegraded":"2024-09-17T02:21:02.436604+0000","last_fullsized":"2024-09-17T02:21:02.436604+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:26.455575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.436872+0000","last_change":"2024-09-17T02:21:01.444685+0000","last_active":"2024-09-17T02:21:02.436872+0000","last_peered":"2024-09-17T02:21:02.436872+0000","last_clean":"2024-09-17T02:21:02.436872+0000","last_became_active":"2024-09-17T02:21:01.444371+0000","last_became_peered":"2024-09-17T02:21:01.444371+0000","last_unstale":"2024-09-17T02:21:02.436872+0000","last_undegraded":"2024-09-17T02:21:02.436872+0000","last_fullsized":"2024-09-17T02:21:02.436872+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:28.842899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.478544+0000","last_change":"2024-09-17T02:21:01.443619+0000","last_active":"2024-09-17T02:21:02.478544+0000","last_peered":"2024-09-17T02:21:02.478544+0000","last_clean":"2024-09-17T02:21:02.478544+0000","last_became_active":"2024-09-17T02:21:01.443369+0000","last_became_peered":"2024-09-17T02:21:01.443369+0000","last_unstale":"2024-09-17T02:21:02.478544+0000","last_undegraded":"2024-09-17T02:21:02.478544+0000","last_fullsized":"2024-09-17T02:21:02.478544+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:13.680190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.480795+0000","last_change":"2024-09-17T02:20:15.559935+0000","last_active":"2024-09-17T02:21:02.480795+0000","last_peered":"2024-09-17T02:21:02.480795+0000","last_clean":"2024-09-17T02:21:02.480795+0000","last_became_active":"2024-09-17T02:20:15.559413+0000","last_became_peered":"2024-09-17T02:20:15.559413+0000","last_unstale":"2024-09-17T02:21:02.480795+0000","last_undegraded":"2024-09-17T02:21:02.480795+0000","last_fullsized":"2024-09-17T02:21:02.480795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:52.985837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.446535+0000","last_change":"2024-09-17T02:21:01.452127+0000","last_active":"2024-09-17T02:21:02.446535+0000","last_peered":"2024-09-17T02:21:02.446535+0000","last_clean":"2024-09-17T02:21:02.446535+0000","last_became_active":"2024-09-17T02:21:01.451486+0000","last_became_peered":"2024-09-17T02:21:01.451486+0000","last_unstale":"2024-09-17T02:21:02.446535+0000","last_undegraded":"2024-09-17T02:21:02.446535+0000","last_fullsized":"2024-09-17T02:21:02.446535+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:01.265269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"peering","last_fresh":"2024-09-17T02:21:02.481011+0000","last_change":"2024-09-17T02:21:02.481011+0000","last_active":"2024-09-17T02:20:14.516708+0000","last_peered":"2024-09-17T02:20:14.516708+0000","last_clean":"2024-09-17T02:20:14.516708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:21:02.481011+0000","last_undegraded":"2024-09-17T02:21:02.481011+0000","last_fullsized":"2024-09-17T02:21:02.481011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"peering","last_fresh":"2024-09-17T02:21:02.480540+0000","last_change":"2024-09-17T02:21:02.480540+0000","last_active":"2024-09-17T02:20:15.524398+0000","last_peered":"2024-09-17T02:20:15.524398+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:21:02.480540+0000","last_undegraded":"2024-09-17T02:21:02.480540+0000","last_fullsized":"2024-09-17T02:21:02.480540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.443310+0000","last_change":"2024-09-17T02:20:15.569442+0000","last_active":"2024-09-17T02:21:02.443310+0000","last_peered":"2024-09-17T02:21:02.443310+0000","last_clean":"2024-09-17T02:21:02.443310+0000","last_became_active":"2024-09-17T02:20:15.567946+0000","last_became_peered":"2024-09-17T02:20:15.567946+0000","last_unstale":"2024-09-17T02:21:02.443310+0000","last_undegraded":"2024-09-17T02:21:02.443310+0000","last_fullsized":"2024-09-17T02:21:02.443310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:55.866388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.437056+0000","last_change":"2024-09-17T02:20:16.579779+0000","last_active":"2024-09-17T02:21:01.437056+0000","last_peered":"2024-09-17T02:21:01.437056+0000","last_clean":"2024-09-17T02:21:01.437056+0000","last_became_active":"2024-09-17T02:20:16.576734+0000","last_became_peered":"2024-09-17T02:20:16.576734+0000","last_unstale":"2024-09-17T02:21:01.437056+0000","last_undegraded":"2024-09-17T02:21:01.437056+0000","last_fullsized":"2024-09-17T02:21:01.437056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:26.782410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.478335+0000","last_change":"2024-09-17T02:20:15.559245+0000","last_active":"2024-09-17T02:21:02.478335+0000","last_peered":"2024-09-17T02:21:02.478335+0000","last_clean":"2024-09-17T02:21:02.478335+0000","last_became_active":"2024-09-17T02:20:15.558518+0000","last_became_peered":"2024-09-17T02:20:15.558518+0000","last_unstale":"2024-09-17T02:21:02.478335+0000","last_undegraded":"2024-09-17T02:21:02.478335+0000","last_fullsized":"2024-09-17T02:21:02.478335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:52.783635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"35'4418","reported_seq":4456,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.436444+0000","last_change":"2024-09-17T02:20:31.673149+0000","last_active":"2024-09-17T02:21:02.436444+0000","last_peered":"2024-09-17T02:21:02.436444+0000","last_clean":"2024-09-17T02:21:02.436444+0000","last_became_active":"2024-09-17T02:20:31.671595+0000","last_became_peered":"2024-09-17T02:20:31.671595+0000","last_unstale":"2024-09-17T02:21:02.436444+0000","last_undegraded":"2024-09-17T02:21:02.436444+0000","last_fullsized":"2024-09-17T02:21:02.436444+0000","mapping_epoch":22,"log_start":"27'923","ondisk_log_start":"27'923","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":3495,"log_dups_size":0,"ondisk_log_size":3495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:37:51.675707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289538048,"num_objects":4418,"num_object_clones":0,"num_object_copies":8836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4418,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4418,"num_write_kb":282752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.488376+0000","last_change":"2024-09-17T02:20:15.559110+0000","last_active":"2024-09-17T02:21:02.488376+0000","last_peered":"2024-09-17T02:21:02.488376+0000","last_clean":"2024-09-17T02:21:02.488376+0000","last_became_active":"2024-09-17T02:20:15.558285+0000","last_became_peered":"2024-09-17T02:20:15.558285+0000","last_unstale":"2024-09-17T02:21:02.488376+0000","last_undegraded":"2024-09-17T02:21:02.488376+0000","last_fullsized":"2024-09-17T02:21:02.488376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:15.782658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.436282+0000","last_change":"2024-09-17T02:20:37.709691+0000","last_active":"2024-09-17T02:21:02.436282+0000","last_peered":"2024-09-17T02:21:02.436282+0000","last_clean":"2024-09-17T02:21:02.436282+0000","last_became_active":"2024-09-17T02:20:37.708867+0000","last_became_peered":"2024-09-17T02:20:37.708867+0000","last_unstale":"2024-09-17T02:21:02.436282+0000","last_undegraded":"2024-09-17T02:21:02.436282+0000","last_fullsized":"2024-09-17T02:21:02.436282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:29.690935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"35'4505","reported_seq":4549,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.434899+0000","last_change":"2024-09-17T02:20:37.739002+0000","last_active":"2024-09-17T02:21:01.434899+0000","last_peered":"2024-09-17T02:21:01.434899+0000","last_clean":"2024-09-17T02:21:01.434899+0000","last_became_active":"2024-09-17T02:20:37.709755+0000","last_became_peered":"2024-09-17T02:20:37.709755+0000","last_unstale":"2024-09-17T02:21:01.434899+0000","last_undegraded":"2024-09-17T02:21:01.434899+0000","last_fullsized":"2024-09-17T02:21:01.434899+0000","mapping_epoch":26,"log_start":"25'900","ondisk_log_start":"25'900","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":3605,"log_dups_size":0,"ondisk_log_size":3605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:33.839254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295239680,"num_objects":4505,"num_object_clones":0,"num_object_copies":9010,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4505,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4505,"num_write_kb":288320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.447105+0000","last_change":"2024-09-17T02:20:15.568414+0000","last_active":"2024-09-17T02:21:02.447105+0000","last_peered":"2024-09-17T02:21:02.447105+0000","last_clean":"2024-09-17T02:21:02.447105+0000","last_became_active":"2024-09-17T02:20:15.567596+0000","last_became_peered":"2024-09-17T02:20:15.567596+0000","last_unstale":"2024-09-17T02:21:02.447105+0000","last_undegraded":"2024-09-17T02:21:02.447105+0000","last_fullsized":"2024-09-17T02:21:02.447105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:11.356699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.435568+0000","last_change":"2024-09-17T02:20:37.705585+0000","last_active":"2024-09-17T02:21:01.435568+0000","last_peered":"2024-09-17T02:21:01.435568+0000","last_clean":"2024-09-17T02:21:01.435568+0000","last_became_active":"2024-09-17T02:20:37.705266+0000","last_became_peered":"2024-09-17T02:20:37.705266+0000","last_unstale":"2024-09-17T02:21:01.435568+0000","last_undegraded":"2024-09-17T02:21:01.435568+0000","last_fullsized":"2024-09-17T02:21:01.435568+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:10:51.092163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"35'4389","reported_seq":4426,"reported_epoch":36,"state":"peering","last_fresh":"2024-09-17T02:21:01.445422+0000","last_change":"2024-09-17T02:21:02.449520+0000","last_active":"2024-09-17T02:21:02.449520+0000","last_peered":"2024-09-17T02:21:01.445422+0000","last_clean":"2024-09-17T02:21:01.445422+0000","last_became_active":"2024-09-17T02:20:31.670982+0000","last_became_peered":"2024-09-17T02:20:31.670982+0000","last_unstale":"2024-09-17T02:21:01.445422+0000","last_undegraded":"2024-09-17T02:21:01.445422+0000","last_fullsized":"2024-09-17T02:21:01.445422+0000","mapping_epoch":37,"log_start":"25'400","ondisk_log_start":"25'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":3989,"log_dups_size":0,"ondisk_log_size":3989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287637504,"num_objects":4389,"num_object_clones":0,"num_object_copies":8778,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4389,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4389,"num_write_kb":280896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.488647+0000","last_change":"2024-09-17T02:20:15.559767+0000","last_active":"2024-09-17T02:21:02.488647+0000","last_peered":"2024-09-17T02:21:02.488647+0000","last_clean":"2024-09-17T02:21:02.488647+0000","last_became_active":"2024-09-17T02:20:15.558888+0000","last_became_peered":"2024-09-17T02:20:15.558888+0000","last_unstale":"2024-09-17T02:21:02.488647+0000","last_undegraded":"2024-09-17T02:21:02.488647+0000","last_fullsized":"2024-09-17T02:21:02.488647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:09.831510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.479726+0000","last_change":"2024-09-17T02:20:16.565632+0000","last_active":"2024-09-17T02:21:02.479726+0000","last_peered":"2024-09-17T02:21:02.479726+0000","last_clean":"2024-09-17T02:21:02.479726+0000","last_became_active":"2024-09-17T02:20:16.563630+0000","last_became_peered":"2024-09-17T02:20:16.563630+0000","last_unstale":"2024-09-17T02:21:02.479726+0000","last_undegraded":"2024-09-17T02:21:02.479726+0000","last_fullsized":"2024-09-17T02:21:02.479726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:05.049317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"35'4501","reported_seq":4537,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.434786+0000","last_change":"2024-09-17T02:20:31.666487+0000","last_active":"2024-09-17T02:21:01.434786+0000","last_peered":"2024-09-17T02:21:01.434786+0000","last_clean":"2024-09-17T02:21:01.434786+0000","last_became_active":"2024-09-17T02:20:31.665775+0000","last_became_peered":"2024-09-17T02:20:31.665775+0000","last_unstale":"2024-09-17T02:21:01.434786+0000","last_undegraded":"2024-09-17T02:21:01.434786+0000","last_fullsized":"2024-09-17T02:21:01.434786+0000","mapping_epoch":22,"log_start":"26'900","ondisk_log_start":"26'900","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":3601,"log_dups_size":0,"ondisk_log_size":3601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:57:45.009348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":294977536,"num_objects":4501,"num_object_clones":0,"num_object_copies":9002,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4501,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4501,"num_write_kb":288064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.486492+0000","last_change":"2024-09-17T02:20:15.562539+0000","last_active":"2024-09-17T02:21:02.486492+0000","last_peered":"2024-09-17T02:21:02.486492+0000","last_clean":"2024-09-17T02:21:02.486492+0000","last_became_active":"2024-09-17T02:20:15.561801+0000","last_became_peered":"2024-09-17T02:20:15.561801+0000","last_unstale":"2024-09-17T02:21:02.486492+0000","last_undegraded":"2024-09-17T02:21:02.486492+0000","last_fullsized":"2024-09-17T02:21:02.486492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:15.848081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.436385+0000","last_change":"2024-09-17T02:20:16.578474+0000","last_active":"2024-09-17T02:21:01.436385+0000","last_peered":"2024-09-17T02:21:01.436385+0000","last_clean":"2024-09-17T02:21:01.436385+0000","last_became_active":"2024-09-17T02:20:16.576264+0000","last_became_peered":"2024-09-17T02:20:16.576264+0000","last_unstale":"2024-09-17T02:21:01.436385+0000","last_undegraded":"2024-09-17T02:21:01.436385+0000","last_fullsized":"2024-09-17T02:21:01.436385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:48.313282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"35'4471","reported_seq":4518,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.482965+0000","last_change":"2024-09-17T02:20:37.736851+0000","last_active":"2024-09-17T02:21:02.482965+0000","last_peered":"2024-09-17T02:21:02.482965+0000","last_clean":"2024-09-17T02:21:02.482965+0000","last_became_active":"2024-09-17T02:20:37.709201+0000","last_became_peered":"2024-09-17T02:20:37.709201+0000","last_unstale":"2024-09-17T02:21:02.482965+0000","last_undegraded":"2024-09-17T02:21:02.482965+0000","last_fullsized":"2024-09-17T02:21:02.482965+0000","mapping_epoch":26,"log_start":"27'980","ondisk_log_start":"27'980","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":3491,"log_dups_size":0,"ondisk_log_size":3491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:10.646940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293011456,"num_objects":4471,"num_object_clones":0,"num_object_copies":8942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4471,"num_write_kb":286144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.436652+0000","last_change":"2024-09-17T02:20:15.551986+0000","last_active":"2024-09-17T02:21:01.436652+0000","last_peered":"2024-09-17T02:21:01.436652+0000","last_clean":"2024-09-17T02:21:01.436652+0000","last_became_active":"2024-09-17T02:20:15.550418+0000","last_became_peered":"2024-09-17T02:20:15.550418+0000","last_unstale":"2024-09-17T02:21:01.436652+0000","last_undegraded":"2024-09-17T02:21:01.436652+0000","last_fullsized":"2024-09-17T02:21:01.436652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:17.866665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.485572+0000","last_change":"2024-09-17T02:20:16.570845+0000","last_active":"2024-09-17T02:21:02.485572+0000","last_peered":"2024-09-17T02:21:02.485572+0000","last_clean":"2024-09-17T02:21:02.485572+0000","last_became_active":"2024-09-17T02:20:16.568862+0000","last_became_peered":"2024-09-17T02:20:16.568862+0000","last_unstale":"2024-09-17T02:21:02.485572+0000","last_undegraded":"2024-09-17T02:21:02.485572+0000","last_fullsized":"2024-09-17T02:21:02.485572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:30.715391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"35'4368","reported_seq":4404,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.435353+0000","last_change":"2024-09-17T02:20:31.669260+0000","last_active":"2024-09-17T02:21:01.435353+0000","last_peered":"2024-09-17T02:21:01.435353+0000","last_clean":"2024-09-17T02:21:01.435353+0000","last_became_active":"2024-09-17T02:20:31.668017+0000","last_became_peered":"2024-09-17T02:20:31.668017+0000","last_unstale":"2024-09-17T02:21:01.435353+0000","last_undegraded":"2024-09-17T02:21:01.435353+0000","last_fullsized":"2024-09-17T02:21:01.435353+0000","mapping_epoch":22,"log_start":"25'800","ondisk_log_start":"25'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":3568,"log_dups_size":0,"ondisk_log_size":3568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:32.347658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286261248,"num_objects":4368,"num_object_clones":0,"num_object_copies":8736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4368,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4368,"num_write_kb":279552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.480376+0000","last_change":"2024-09-17T02:21:01.445908+0000","last_active":"2024-09-17T02:21:02.480376+0000","last_peered":"2024-09-17T02:21:02.480376+0000","last_clean":"2024-09-17T02:21:02.480376+0000","last_became_active":"2024-09-17T02:21:01.445460+0000","last_became_peered":"2024-09-17T02:21:01.445460+0000","last_unstale":"2024-09-17T02:21:02.480376+0000","last_undegraded":"2024-09-17T02:21:02.480376+0000","last_fullsized":"2024-09-17T02:21:02.480376+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:48.240265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.488180+0000","last_change":"2024-09-17T02:20:16.586434+0000","last_active":"2024-09-17T02:21:02.488180+0000","last_peered":"2024-09-17T02:21:02.488180+0000","last_clean":"2024-09-17T02:21:02.488180+0000","last_became_active":"2024-09-17T02:20:16.585466+0000","last_became_peered":"2024-09-17T02:20:16.585466+0000","last_unstale":"2024-09-17T02:21:02.488180+0000","last_undegraded":"2024-09-17T02:21:02.488180+0000","last_fullsized":"2024-09-17T02:21:02.488180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:57:29.891850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"35'4411","reported_seq":4449,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.485625+0000","last_change":"2024-09-17T02:20:31.674087+0000","last_active":"2024-09-17T02:21:02.485625+0000","last_peered":"2024-09-17T02:21:02.485625+0000","last_clean":"2024-09-17T02:21:02.485625+0000","last_became_active":"2024-09-17T02:20:31.673495+0000","last_became_peered":"2024-09-17T02:20:31.673495+0000","last_unstale":"2024-09-17T02:21:02.485625+0000","last_undegraded":"2024-09-17T02:21:02.485625+0000","last_fullsized":"2024-09-17T02:21:02.485625+0000","mapping_epoch":22,"log_start":"27'916","ondisk_log_start":"27'916","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":3495,"log_dups_size":0,"ondisk_log_size":3495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:19.606217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289079296,"num_objects":4411,"num_object_clones":0,"num_object_copies":8822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4411,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4411,"num_write_kb":282304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.482311+0000","last_change":"2024-09-17T02:20:37.706666+0000","last_active":"2024-09-17T02:21:02.482311+0000","last_peered":"2024-09-17T02:21:02.482311+0000","last_clean":"2024-09-17T02:21:02.482311+0000","last_became_active":"2024-09-17T02:20:37.706105+0000","last_became_peered":"2024-09-17T02:20:37.706105+0000","last_unstale":"2024-09-17T02:21:02.482311+0000","last_undegraded":"2024-09-17T02:21:02.482311+0000","last_fullsized":"2024-09-17T02:21:02.482311+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:22.802170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.485873+0000","last_change":"2024-09-17T02:20:16.582353+0000","last_active":"2024-09-17T02:21:02.485873+0000","last_peered":"2024-09-17T02:21:02.485873+0000","last_clean":"2024-09-17T02:21:02.485873+0000","last_became_active":"2024-09-17T02:20:16.581462+0000","last_became_peered":"2024-09-17T02:20:16.581462+0000","last_unstale":"2024-09-17T02:21:02.485873+0000","last_undegraded":"2024-09-17T02:21:02.485873+0000","last_fullsized":"2024-09-17T02:21:02.485873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:44.023284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"37'4466","reported_seq":4504,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.766562+0000","last_change":"2024-09-17T02:20:31.672194+0000","last_active":"2024-09-17T02:21:02.766562+0000","last_peered":"2024-09-17T02:21:02.766562+0000","last_clean":"2024-09-17T02:21:02.766562+0000","last_became_active":"2024-09-17T02:20:31.671763+0000","last_became_peered":"2024-09-17T02:20:31.671763+0000","last_unstale":"2024-09-17T02:21:02.766562+0000","last_undegraded":"2024-09-17T02:21:02.766562+0000","last_fullsized":"2024-09-17T02:21:02.766562+0000","mapping_epoch":22,"log_start":"25'802","ondisk_log_start":"25'802","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":3664,"log_dups_size":0,"ondisk_log_size":3664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:07.301574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292683776,"num_objects":4466,"num_object_clones":0,"num_object_copies":8932,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4466,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4466,"num_write_kb":285824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.435126+0000","last_change":"2024-09-17T02:20:37.709979+0000","last_active":"2024-09-17T02:21:01.435126+0000","last_peered":"2024-09-17T02:21:01.435126+0000","last_clean":"2024-09-17T02:21:01.435126+0000","last_became_active":"2024-09-17T02:20:37.708736+0000","last_became_peered":"2024-09-17T02:20:37.708736+0000","last_unstale":"2024-09-17T02:21:01.435126+0000","last_undegraded":"2024-09-17T02:21:01.435126+0000","last_fullsized":"2024-09-17T02:21:01.435126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:03.481029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.437289+0000","last_change":"2024-09-17T02:20:16.583084+0000","last_active":"2024-09-17T02:21:01.437289+0000","last_peered":"2024-09-17T02:21:01.437289+0000","last_clean":"2024-09-17T02:21:01.437289+0000","last_became_active":"2024-09-17T02:20:16.582326+0000","last_became_peered":"2024-09-17T02:20:16.582326+0000","last_unstale":"2024-09-17T02:21:01.437289+0000","last_undegraded":"2024-09-17T02:21:01.437289+0000","last_fullsized":"2024-09-17T02:21:01.437289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:05.049317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"37'4392","reported_seq":4766,"reported_epoch":37,"state":"active+remapped+backfilling","last_fresh":"2024-09-17T02:21:03.448777+0000","last_change":"2024-09-17T02:21:02.629851+0000","last_active":"2024-09-17T02:21:03.448777+0000","last_peered":"2024-09-17T02:21:03.448777+0000","last_clean":"2024-09-17T02:21:00.400772+0000","last_became_active":"2024-09-17T02:21:02.585406+0000","last_became_peered":"2024-09-17T02:21:02.585406+0000","last_unstale":"2024-09-17T02:21:03.448777+0000","last_undegraded":"2024-09-17T02:21:03.448777+0000","last_fullsized":"2024-09-17T02:21:03.448777+0000","mapping_epoch":36,"log_start":"25'726","ondisk_log_start":"25'726","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":3666,"log_dups_size":0,"ondisk_log_size":3666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287834112,"num_objects":4392,"num_object_clones":0,"num_object_copies":8784,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":4230,"num_objects_unfound":0,"num_objects_dirty":4392,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4392,"num_write_kb":281088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":10747904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":4392}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":258,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.479245+0000","last_change":"2024-09-17T02:20:04.612894+0000","last_active":"2024-09-17T02:21:02.479245+0000","last_peered":"2024-09-17T02:21:02.479245+0000","last_clean":"2024-09-17T02:21:02.479245+0000","last_became_active":"2024-09-17T02:20:04.610517+0000","last_became_peered":"2024-09-17T02:20:04.610517+0000","last_unstale":"2024-09-17T02:21:02.479245+0000","last_undegraded":"2024-09-17T02:21:02.479245+0000","last_fullsized":"2024-09-17T02:21:02.479245+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_clean_scrub_stamp":"2024-09-17T02:20:03.432050+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:51.879303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.481698+0000","last_change":"2024-09-17T02:20:12.513513+0000","last_active":"2024-09-17T02:21:02.481698+0000","last_peered":"2024-09-17T02:21:02.481698+0000","last_clean":"2024-09-17T02:21:02.481698+0000","last_became_active":"2024-09-17T02:20:10.504616+0000","last_became_peered":"2024-09-17T02:20:10.504616+0000","last_unstale":"2024-09-17T02:21:02.481698+0000","last_undegraded":"2024-09-17T02:21:02.481698+0000","last_fullsized":"2024-09-17T02:21:02.481698+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:13.341611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001517832,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.437026+0000","last_change":"2024-09-17T02:20:15.560646+0000","last_active":"2024-09-17T02:21:01.437026+0000","last_peered":"2024-09-17T02:21:01.437026+0000","last_clean":"2024-09-17T02:21:01.437026+0000","last_became_active":"2024-09-17T02:20:15.559104+0000","last_became_peered":"2024-09-17T02:20:15.559104+0000","last_unstale":"2024-09-17T02:21:01.437026+0000","last_undegraded":"2024-09-17T02:21:01.437026+0000","last_fullsized":"2024-09-17T02:21:01.437026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:44.299986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.488509+0000","last_change":"2024-09-17T02:20:16.585522+0000","last_active":"2024-09-17T02:21:02.488509+0000","last_peered":"2024-09-17T02:21:02.488509+0000","last_clean":"2024-09-17T02:21:02.488509+0000","last_became_active":"2024-09-17T02:20:16.584520+0000","last_became_peered":"2024-09-17T02:20:16.584520+0000","last_unstale":"2024-09-17T02:21:02.488509+0000","last_undegraded":"2024-09-17T02:21:02.488509+0000","last_fullsized":"2024-09-17T02:21:02.488509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:14.123192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"35'4496","reported_seq":4534,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.488066+0000","last_change":"2024-09-17T02:20:31.675261+0000","last_active":"2024-09-17T02:21:02.488066+0000","last_peered":"2024-09-17T02:21:02.488066+0000","last_clean":"2024-09-17T02:21:02.488066+0000","last_became_active":"2024-09-17T02:20:31.674677+0000","last_became_peered":"2024-09-17T02:20:31.674677+0000","last_unstale":"2024-09-17T02:21:02.488066+0000","last_undegraded":"2024-09-17T02:21:02.488066+0000","last_fullsized":"2024-09-17T02:21:02.488066+0000","mapping_epoch":22,"log_start":"27'963","ondisk_log_start":"27'963","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":3533,"log_dups_size":0,"ondisk_log_size":3533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:01:59.368049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":294649856,"num_objects":4496,"num_object_clones":0,"num_object_copies":8992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4496,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4496,"num_write_kb":287744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.478869+0000","last_change":"2024-09-17T02:20:12.512798+0000","last_active":"2024-09-17T02:21:02.478869+0000","last_peered":"2024-09-17T02:21:02.478869+0000","last_clean":"2024-09-17T02:21:02.478869+0000","last_became_active":"2024-09-17T02:20:10.502115+0000","last_became_peered":"2024-09-17T02:20:10.502115+0000","last_unstale":"2024-09-17T02:21:02.478869+0000","last_undegraded":"2024-09-17T02:21:02.478869+0000","last_fullsized":"2024-09-17T02:21:02.478869+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:17.554878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083467700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.436059+0000","last_change":"2024-09-17T02:20:15.551632+0000","last_active":"2024-09-17T02:21:01.436059+0000","last_peered":"2024-09-17T02:21:01.436059+0000","last_clean":"2024-09-17T02:21:01.436059+0000","last_became_active":"2024-09-17T02:20:15.551062+0000","last_became_peered":"2024-09-17T02:20:15.551062+0000","last_unstale":"2024-09-17T02:21:01.436059+0000","last_undegraded":"2024-09-17T02:21:01.436059+0000","last_fullsized":"2024-09-17T02:21:01.436059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:55.295518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.445072+0000","last_change":"2024-09-17T02:20:16.571568+0000","last_active":"2024-09-17T02:21:02.445072+0000","last_peered":"2024-09-17T02:21:02.445072+0000","last_clean":"2024-09-17T02:21:02.445072+0000","last_became_active":"2024-09-17T02:20:16.570622+0000","last_became_peered":"2024-09-17T02:20:16.570622+0000","last_unstale":"2024-09-17T02:21:02.445072+0000","last_undegraded":"2024-09-17T02:21:02.445072+0000","last_fullsized":"2024-09-17T02:21:02.445072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:57.083446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"35'4443","reported_seq":4479,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.438004+0000","last_change":"2024-09-17T02:20:31.669013+0000","last_active":"2024-09-17T02:21:01.438004+0000","last_peered":"2024-09-17T02:21:01.438004+0000","last_clean":"2024-09-17T02:21:01.438004+0000","last_became_active":"2024-09-17T02:20:31.667964+0000","last_became_peered":"2024-09-17T02:20:31.667964+0000","last_unstale":"2024-09-17T02:21:01.438004+0000","last_undegraded":"2024-09-17T02:21:01.438004+0000","last_fullsized":"2024-09-17T02:21:01.438004+0000","mapping_epoch":22,"log_start":"27'900","ondisk_log_start":"27'900","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":3543,"log_dups_size":0,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:34.130523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291176448,"num_objects":4443,"num_object_clones":0,"num_object_copies":8886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4443,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4443,"num_write_kb":284352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.436653+0000","last_change":"2024-09-17T02:20:12.511823+0000","last_active":"2024-09-17T02:21:01.436653+0000","last_peered":"2024-09-17T02:21:01.436653+0000","last_clean":"2024-09-17T02:21:01.436653+0000","last_became_active":"2024-09-17T02:20:10.497164+0000","last_became_peered":"2024-09-17T02:20:10.497164+0000","last_unstale":"2024-09-17T02:21:01.436653+0000","last_undegraded":"2024-09-17T02:21:01.436653+0000","last_fullsized":"2024-09-17T02:21:01.436653+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:21.242753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081052700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.436479+0000","last_change":"2024-09-17T02:20:37.709680+0000","last_active":"2024-09-17T02:21:02.436479+0000","last_peered":"2024-09-17T02:21:02.436479+0000","last_clean":"2024-09-17T02:21:02.436479+0000","last_became_active":"2024-09-17T02:20:37.708876+0000","last_became_peered":"2024-09-17T02:20:37.708876+0000","last_unstale":"2024-09-17T02:21:02.436479+0000","last_undegraded":"2024-09-17T02:21:02.436479+0000","last_fullsized":"2024-09-17T02:21:02.436479+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:51.301056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.485218+0000","last_change":"2024-09-17T02:21:01.442885+0000","last_active":"2024-09-17T02:21:02.485218+0000","last_peered":"2024-09-17T02:21:02.485218+0000","last_clean":"2024-09-17T02:21:02.485218+0000","last_became_active":"2024-09-17T02:21:01.442685+0000","last_became_peered":"2024-09-17T02:21:01.442685+0000","last_unstale":"2024-09-17T02:21:02.485218+0000","last_undegraded":"2024-09-17T02:21:02.485218+0000","last_fullsized":"2024-09-17T02:21:02.485218+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:33.688522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"35'4463","reported_seq":4499,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.436282+0000","last_change":"2024-09-17T02:20:31.669982+0000","last_active":"2024-09-17T02:21:01.436282+0000","last_peered":"2024-09-17T02:21:01.436282+0000","last_clean":"2024-09-17T02:21:01.436282+0000","last_became_active":"2024-09-17T02:20:31.669185+0000","last_became_peered":"2024-09-17T02:20:31.669185+0000","last_unstale":"2024-09-17T02:21:01.436282+0000","last_undegraded":"2024-09-17T02:21:01.436282+0000","last_fullsized":"2024-09-17T02:21:01.436282+0000","mapping_epoch":22,"log_start":"27'900","ondisk_log_start":"27'900","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":3563,"log_dups_size":0,"ondisk_log_size":3563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:57:10.062557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292487168,"num_objects":4463,"num_object_clones":0,"num_object_copies":8926,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4463,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4463,"num_write_kb":285632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.480633+0000","last_change":"2024-09-17T02:20:12.512742+0000","last_active":"2024-09-17T02:21:02.480633+0000","last_peered":"2024-09-17T02:21:02.480633+0000","last_clean":"2024-09-17T02:21:02.480633+0000","last_became_active":"2024-09-17T02:20:10.503622+0000","last_became_peered":"2024-09-17T02:20:10.503622+0000","last_unstale":"2024-09-17T02:21:02.480633+0000","last_undegraded":"2024-09-17T02:21:02.480633+0000","last_fullsized":"2024-09-17T02:21:02.480633+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:36.226043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078085399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.480861+0000","last_change":"2024-09-17T02:20:15.562840+0000","last_active":"2024-09-17T02:21:02.480861+0000","last_peered":"2024-09-17T02:21:02.480861+0000","last_clean":"2024-09-17T02:21:02.480861+0000","last_became_active":"2024-09-17T02:20:15.562177+0000","last_became_peered":"2024-09-17T02:20:15.562177+0000","last_unstale":"2024-09-17T02:21:02.480861+0000","last_undegraded":"2024-09-17T02:21:02.480861+0000","last_fullsized":"2024-09-17T02:21:02.480861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:39.709524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.436589+0000","last_change":"2024-09-17T02:20:16.580184+0000","last_active":"2024-09-17T02:21:01.436589+0000","last_peered":"2024-09-17T02:21:01.436589+0000","last_clean":"2024-09-17T02:21:01.436589+0000","last_became_active":"2024-09-17T02:20:16.578343+0000","last_became_peered":"2024-09-17T02:20:16.578343+0000","last_unstale":"2024-09-17T02:21:01.436589+0000","last_undegraded":"2024-09-17T02:21:01.436589+0000","last_fullsized":"2024-09-17T02:21:01.436589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:42.123535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"35'4513","reported_seq":4548,"reported_epoch":37,"state":"unknown","last_fresh":"2024-09-17T02:21:02.479413+0000","last_change":"2024-09-17T02:21:02.515261+0000","last_active":"2024-09-17T02:21:02.479413+0000","last_peered":"2024-09-17T02:21:00.474297+0000","last_clean":"2024-09-17T02:21:00.474297+0000","last_became_active":"2024-09-17T02:20:31.669504+0000","last_became_peered":"2024-09-17T02:20:31.669504+0000","last_unstale":"2024-09-17T02:21:02.479413+0000","last_undegraded":"2024-09-17T02:21:02.479413+0000","last_fullsized":"2024-09-17T02:21:02.479413+0000","mapping_epoch":37,"log_start":"25'900","ondisk_log_start":"25'900","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":3613,"log_dups_size":0,"ondisk_log_size":3613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295763968,"num_objects":4513,"num_object_clones":0,"num_object_copies":9026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4513,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4513,"num_write_kb":288832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.488778+0000","last_change":"2024-09-17T02:21:01.446828+0000","last_active":"2024-09-17T02:21:02.488778+0000","last_peered":"2024-09-17T02:21:02.488778+0000","last_clean":"2024-09-17T02:21:02.488778+0000","last_became_active":"2024-09-17T02:21:01.446003+0000","last_became_peered":"2024-09-17T02:21:01.446003+0000","last_unstale":"2024-09-17T02:21:02.488778+0000","last_undegraded":"2024-09-17T02:21:02.488778+0000","last_fullsized":"2024-09-17T02:21:02.488778+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:31.085209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.437654+0000","last_change":"2024-09-17T02:20:12.511838+0000","last_active":"2024-09-17T02:21:01.437654+0000","last_peered":"2024-09-17T02:21:01.437654+0000","last_clean":"2024-09-17T02:21:01.437654+0000","last_became_active":"2024-09-17T02:20:10.497049+0000","last_became_peered":"2024-09-17T02:20:10.497049+0000","last_unstale":"2024-09-17T02:21:01.437654+0000","last_undegraded":"2024-09-17T02:21:01.437654+0000","last_fullsized":"2024-09-17T02:21:01.437654+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:54.446484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079701100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.444210+0000","last_change":"2024-09-17T02:20:16.571485+0000","last_active":"2024-09-17T02:21:02.444210+0000","last_peered":"2024-09-17T02:21:02.444210+0000","last_clean":"2024-09-17T02:21:02.444210+0000","last_became_active":"2024-09-17T02:20:16.567570+0000","last_became_peered":"2024-09-17T02:20:16.567570+0000","last_unstale":"2024-09-17T02:21:02.444210+0000","last_undegraded":"2024-09-17T02:21:02.444210+0000","last_fullsized":"2024-09-17T02:21:02.444210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:14.228385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"35'4504","reported_seq":4542,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.436631+0000","last_change":"2024-09-17T02:20:31.671886+0000","last_active":"2024-09-17T02:21:02.436631+0000","last_peered":"2024-09-17T02:21:02.436631+0000","last_clean":"2024-09-17T02:21:02.436631+0000","last_became_active":"2024-09-17T02:20:31.671023+0000","last_became_peered":"2024-09-17T02:20:31.671023+0000","last_unstale":"2024-09-17T02:21:02.436631+0000","last_undegraded":"2024-09-17T02:21:02.436631+0000","last_fullsized":"2024-09-17T02:21:02.436631+0000","mapping_epoch":22,"log_start":"27'969","ondisk_log_start":"27'969","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":3535,"log_dups_size":0,"ondisk_log_size":3535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:45.956857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295174144,"num_objects":4504,"num_object_clones":0,"num_object_copies":9008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4504,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4504,"num_write_kb":288256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.437370+0000","last_change":"2024-09-17T02:20:15.559252+0000","last_active":"2024-09-17T02:21:01.437370+0000","last_peered":"2024-09-17T02:21:01.437370+0000","last_clean":"2024-09-17T02:21:01.437370+0000","last_became_active":"2024-09-17T02:20:15.557667+0000","last_became_peered":"2024-09-17T02:20:15.557667+0000","last_unstale":"2024-09-17T02:21:01.437370+0000","last_undegraded":"2024-09-17T02:21:01.437370+0000","last_fullsized":"2024-09-17T02:21:01.437370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:01.292626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.447346+0000","last_change":"2024-09-17T02:20:12.661034+0000","last_active":"2024-09-17T02:21:02.447346+0000","last_peered":"2024-09-17T02:21:02.447346+0000","last_clean":"2024-09-17T02:21:02.447346+0000","last_became_active":"2024-09-17T02:20:10.497829+0000","last_became_peered":"2024-09-17T02:20:10.497829+0000","last_unstale":"2024-09-17T02:21:02.447346+0000","last_undegraded":"2024-09-17T02:21:02.447346+0000","last_fullsized":"2024-09-17T02:21:02.447346+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:46:27.427685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096944700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.479054+0000","last_change":"2024-09-17T02:20:37.705819+0000","last_active":"2024-09-17T02:21:02.479054+0000","last_peered":"2024-09-17T02:21:02.479054+0000","last_clean":"2024-09-17T02:21:02.479054+0000","last_became_active":"2024-09-17T02:20:37.705291+0000","last_became_peered":"2024-09-17T02:20:37.705291+0000","last_unstale":"2024-09-17T02:21:02.479054+0000","last_undegraded":"2024-09-17T02:21:02.479054+0000","last_fullsized":"2024-09-17T02:21:02.479054+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:18.721755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"34'4377","reported_seq":4412,"reported_epoch":37,"state":"activating+remapped","last_fresh":"2024-09-17T02:21:02.436947+0000","last_change":"2024-09-17T02:21:02.513980+0000","last_active":"2024-09-17T02:21:00.422159+0000","last_peered":"2024-09-17T02:21:00.413480+0000","last_clean":"2024-09-17T02:21:00.413480+0000","last_became_active":"2024-09-17T02:20:31.670650+0000","last_became_peered":"2024-09-17T02:20:31.670650+0000","last_unstale":"2024-09-17T02:21:02.436947+0000","last_undegraded":"2024-09-17T02:21:02.436947+0000","last_fullsized":"2024-09-17T02:21:02.436947+0000","mapping_epoch":36,"log_start":"25'600","ondisk_log_start":"25'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":3777,"log_dups_size":0,"ondisk_log_size":3777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286851072,"num_objects":4377,"num_object_clones":0,"num_object_copies":8754,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":4375,"num_objects_unfound":0,"num_objects_dirty":4377,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4377,"num_write_kb":280128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,1],"avail_no_missing":["2"],"object_location_counts":[{"shards":"1,2","objects":4375},{"shards":"2","objects":2}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.438284+0000","last_change":"2024-09-17T02:20:15.558961+0000","last_active":"2024-09-17T02:21:01.438284+0000","last_peered":"2024-09-17T02:21:01.438284+0000","last_clean":"2024-09-17T02:21:01.438284+0000","last_became_active":"2024-09-17T02:20:15.558299+0000","last_became_peered":"2024-09-17T02:20:15.558299+0000","last_unstale":"2024-09-17T02:21:01.438284+0000","last_undegraded":"2024-09-17T02:21:01.438284+0000","last_fullsized":"2024-09-17T02:21:01.438284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:39.709524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.438436+0000","last_change":"2024-09-17T02:20:12.512481+0000","last_active":"2024-09-17T02:21:01.438436+0000","last_peered":"2024-09-17T02:21:01.438436+0000","last_clean":"2024-09-17T02:21:01.438436+0000","last_became_active":"2024-09-17T02:20:10.497021+0000","last_became_peered":"2024-09-17T02:20:10.497021+0000","last_unstale":"2024-09-17T02:21:01.438436+0000","last_undegraded":"2024-09-17T02:21:01.438436+0000","last_fullsized":"2024-09-17T02:21:01.438436+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:41.167283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001400079,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.435375+0000","last_change":"2024-09-17T02:20:16.560687+0000","last_active":"2024-09-17T02:21:01.435375+0000","last_peered":"2024-09-17T02:21:01.435375+0000","last_clean":"2024-09-17T02:21:01.435375+0000","last_became_active":"2024-09-17T02:20:16.559758+0000","last_became_peered":"2024-09-17T02:20:16.559758+0000","last_unstale":"2024-09-17T02:21:01.435375+0000","last_undegraded":"2024-09-17T02:21:01.435375+0000","last_fullsized":"2024-09-17T02:21:01.435375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:54:33.088375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"35'4457","reported_seq":4501,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.434446+0000","last_change":"2024-09-17T02:20:37.734341+0000","last_active":"2024-09-17T02:21:01.434446+0000","last_peered":"2024-09-17T02:21:01.434446+0000","last_clean":"2024-09-17T02:21:01.434446+0000","last_became_active":"2024-09-17T02:20:37.708774+0000","last_became_peered":"2024-09-17T02:20:37.708774+0000","last_unstale":"2024-09-17T02:21:01.434446+0000","last_undegraded":"2024-09-17T02:21:01.434446+0000","last_fullsized":"2024-09-17T02:21:01.434446+0000","mapping_epoch":26,"log_start":"27'900","ondisk_log_start":"27'900","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:30.641896+0000","last_clean_scrub_stamp":"2024-09-17T02:20:30.641896+0000","objects_scrubbed":0,"log_size":3557,"log_dups_size":0,"ondisk_log_size":3557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:37:13.741634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292093952,"num_objects":4457,"num_object_clones":0,"num_object_copies":8914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4457,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4457,"num_write_kb":285248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.438385+0000","last_change":"2024-09-17T02:20:15.551758+0000","last_active":"2024-09-17T02:21:01.438385+0000","last_peered":"2024-09-17T02:21:01.438385+0000","last_clean":"2024-09-17T02:21:01.438385+0000","last_became_active":"2024-09-17T02:20:15.550353+0000","last_became_peered":"2024-09-17T02:20:15.550353+0000","last_unstale":"2024-09-17T02:21:01.438385+0000","last_undegraded":"2024-09-17T02:21:01.438385+0000","last_fullsized":"2024-09-17T02:21:01.438385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:04.229911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.488474+0000","last_change":"2024-09-17T02:20:12.513530+0000","last_active":"2024-09-17T02:21:02.488474+0000","last_peered":"2024-09-17T02:21:02.488474+0000","last_clean":"2024-09-17T02:21:02.488474+0000","last_became_active":"2024-09-17T02:20:10.502692+0000","last_became_peered":"2024-09-17T02:20:10.502692+0000","last_unstale":"2024-09-17T02:21:02.488474+0000","last_undegraded":"2024-09-17T02:21:02.488474+0000","last_fullsized":"2024-09-17T02:21:02.488474+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:53.004641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015329009999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.443296+0000","last_change":"2024-09-17T02:20:16.575882+0000","last_active":"2024-09-17T02:21:02.443296+0000","last_peered":"2024-09-17T02:21:02.443296+0000","last_clean":"2024-09-17T02:21:02.443296+0000","last_became_active":"2024-09-17T02:20:16.573968+0000","last_became_peered":"2024-09-17T02:20:16.573968+0000","last_unstale":"2024-09-17T02:21:02.443296+0000","last_undegraded":"2024-09-17T02:21:02.443296+0000","last_fullsized":"2024-09-17T02:21:02.443296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:18.090082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.480106+0000","last_change":"2024-09-17T02:20:16.582881+0000","last_active":"2024-09-17T02:21:02.480106+0000","last_peered":"2024-09-17T02:21:02.480106+0000","last_clean":"2024-09-17T02:21:02.480106+0000","last_became_active":"2024-09-17T02:20:16.580985+0000","last_became_peered":"2024-09-17T02:20:16.580985+0000","last_unstale":"2024-09-17T02:21:02.480106+0000","last_undegraded":"2024-09-17T02:21:02.480106+0000","last_fullsized":"2024-09-17T02:21:02.480106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:10.315951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.486145+0000","last_change":"2024-09-17T02:20:15.558925+0000","last_active":"2024-09-17T02:21:02.486145+0000","last_peered":"2024-09-17T02:21:02.486145+0000","last_clean":"2024-09-17T02:21:02.486145+0000","last_became_active":"2024-09-17T02:20:15.558174+0000","last_became_peered":"2024-09-17T02:20:15.558174+0000","last_unstale":"2024-09-17T02:21:02.486145+0000","last_undegraded":"2024-09-17T02:21:02.486145+0000","last_fullsized":"2024-09-17T02:21:02.486145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:55.639841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.480244+0000","last_change":"2024-09-17T02:21:01.446176+0000","last_active":"2024-09-17T02:21:02.480244+0000","last_peered":"2024-09-17T02:21:02.480244+0000","last_clean":"2024-09-17T02:21:02.480244+0000","last_became_active":"2024-09-17T02:21:01.445837+0000","last_became_peered":"2024-09-17T02:21:01.445837+0000","last_unstale":"2024-09-17T02:21:02.480244+0000","last_undegraded":"2024-09-17T02:21:02.480244+0000","last_fullsized":"2024-09-17T02:21:02.480244+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:56.786160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.488157+0000","last_change":"2024-09-17T02:20:37.711022+0000","last_active":"2024-09-17T02:21:02.488157+0000","last_peered":"2024-09-17T02:21:02.488157+0000","last_clean":"2024-09-17T02:21:02.488157+0000","last_became_active":"2024-09-17T02:20:37.709692+0000","last_became_peered":"2024-09-17T02:20:37.709692+0000","last_unstale":"2024-09-17T02:21:02.488157+0000","last_undegraded":"2024-09-17T02:21:02.488157+0000","last_fullsized":"2024-09-17T02:21:02.488157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:35.490311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.486115+0000","last_change":"2024-09-17T02:20:15.562827+0000","last_active":"2024-09-17T02:21:02.486115+0000","last_peered":"2024-09-17T02:21:02.486115+0000","last_clean":"2024-09-17T02:21:02.486115+0000","last_became_active":"2024-09-17T02:20:15.562073+0000","last_became_peered":"2024-09-17T02:20:15.562073+0000","last_unstale":"2024-09-17T02:21:02.486115+0000","last_undegraded":"2024-09-17T02:21:02.486115+0000","last_fullsized":"2024-09-17T02:21:02.486115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:17.866665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.435318+0000","last_change":"2024-09-17T02:20:16.577670+0000","last_active":"2024-09-17T02:21:01.435318+0000","last_peered":"2024-09-17T02:21:01.435318+0000","last_clean":"2024-09-17T02:21:01.435318+0000","last_became_active":"2024-09-17T02:20:16.575082+0000","last_became_peered":"2024-09-17T02:20:16.575082+0000","last_unstale":"2024-09-17T02:21:01.435318+0000","last_undegraded":"2024-09-17T02:21:01.435318+0000","last_fullsized":"2024-09-17T02:21:01.435318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:21.356437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.438118+0000","last_change":"2024-09-17T02:20:15.555513+0000","last_active":"2024-09-17T02:21:01.438118+0000","last_peered":"2024-09-17T02:21:01.438118+0000","last_clean":"2024-09-17T02:21:01.438118+0000","last_became_active":"2024-09-17T02:20:15.554256+0000","last_became_peered":"2024-09-17T02:20:15.554256+0000","last_unstale":"2024-09-17T02:21:01.438118+0000","last_undegraded":"2024-09-17T02:21:01.438118+0000","last_fullsized":"2024-09-17T02:21:01.438118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:52.985837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.435187+0000","last_change":"2024-09-17T02:20:16.577803+0000","last_active":"2024-09-17T02:21:01.435187+0000","last_peered":"2024-09-17T02:21:01.435187+0000","last_clean":"2024-09-17T02:21:01.435187+0000","last_became_active":"2024-09-17T02:20:16.576640+0000","last_became_peered":"2024-09-17T02:20:16.576640+0000","last_unstale":"2024-09-17T02:21:01.435187+0000","last_undegraded":"2024-09-17T02:21:01.435187+0000","last_fullsized":"2024-09-17T02:21:01.435187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:07.190169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.446459+0000","last_change":"2024-09-17T02:20:16.571738+0000","last_active":"2024-09-17T02:21:02.446459+0000","last_peered":"2024-09-17T02:21:02.446459+0000","last_clean":"2024-09-17T02:21:02.446459+0000","last_became_active":"2024-09-17T02:20:16.568615+0000","last_became_peered":"2024-09-17T02:20:16.568615+0000","last_unstale":"2024-09-17T02:21:02.446459+0000","last_undegraded":"2024-09-17T02:21:02.446459+0000","last_fullsized":"2024-09-17T02:21:02.446459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:42.931361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.443154+0000","last_change":"2024-09-17T02:21:01.451425+0000","last_active":"2024-09-17T02:21:02.443154+0000","last_peered":"2024-09-17T02:21:02.443154+0000","last_clean":"2024-09-17T02:21:02.443154+0000","last_became_active":"2024-09-17T02:21:01.449751+0000","last_became_peered":"2024-09-17T02:21:01.449751+0000","last_unstale":"2024-09-17T02:21:02.443154+0000","last_undegraded":"2024-09-17T02:21:02.443154+0000","last_fullsized":"2024-09-17T02:21:02.443154+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:27.537412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.437848+0000","last_change":"2024-09-17T02:20:16.577527+0000","last_active":"2024-09-17T02:21:01.437848+0000","last_peered":"2024-09-17T02:21:01.437848+0000","last_clean":"2024-09-17T02:21:01.437848+0000","last_became_active":"2024-09-17T02:20:16.574761+0000","last_became_peered":"2024-09-17T02:20:16.574761+0000","last_unstale":"2024-09-17T02:21:01.437848+0000","last_undegraded":"2024-09-17T02:21:01.437848+0000","last_fullsized":"2024-09-17T02:21:01.437848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:43.309196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.435801+0000","last_change":"2024-09-17T02:20:15.552417+0000","last_active":"2024-09-17T02:21:01.435801+0000","last_peered":"2024-09-17T02:21:01.435801+0000","last_clean":"2024-09-17T02:21:01.435801+0000","last_became_active":"2024-09-17T02:20:15.551609+0000","last_became_peered":"2024-09-17T02:20:15.551609+0000","last_unstale":"2024-09-17T02:21:01.435801+0000","last_undegraded":"2024-09-17T02:21:01.435801+0000","last_fullsized":"2024-09-17T02:21:01.435801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:15.782658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.444789+0000","last_change":"2024-09-17T02:20:16.591978+0000","last_active":"2024-09-17T02:21:02.444789+0000","last_peered":"2024-09-17T02:21:02.444789+0000","last_clean":"2024-09-17T02:21:02.444789+0000","last_became_active":"2024-09-17T02:20:16.591378+0000","last_became_peered":"2024-09-17T02:20:16.591378+0000","last_unstale":"2024-09-17T02:21:02.444789+0000","last_undegraded":"2024-09-17T02:21:02.444789+0000","last_fullsized":"2024-09-17T02:21:02.444789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:44.489118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.435104+0000","last_change":"2024-09-17T02:20:37.706393+0000","last_active":"2024-09-17T02:21:01.435104+0000","last_peered":"2024-09-17T02:21:01.435104+0000","last_clean":"2024-09-17T02:21:01.435104+0000","last_became_active":"2024-09-17T02:20:37.705739+0000","last_became_peered":"2024-09-17T02:20:37.705739+0000","last_unstale":"2024-09-17T02:21:01.435104+0000","last_undegraded":"2024-09-17T02:21:01.435104+0000","last_fullsized":"2024-09-17T02:21:01.435104+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:57.361673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.435697+0000","last_change":"2024-09-17T02:20:37.706175+0000","last_active":"2024-09-17T02:21:01.435697+0000","last_peered":"2024-09-17T02:21:01.435697+0000","last_clean":"2024-09-17T02:21:01.435697+0000","last_became_active":"2024-09-17T02:20:37.705742+0000","last_became_peered":"2024-09-17T02:20:37.705742+0000","last_unstale":"2024-09-17T02:21:01.435697+0000","last_undegraded":"2024-09-17T02:21:01.435697+0000","last_fullsized":"2024-09-17T02:21:01.435697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:09.959092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.451980+0000","last_change":"2024-09-17T02:20:15.568883+0000","last_active":"2024-09-17T02:21:02.451980+0000","last_peered":"2024-09-17T02:21:02.451980+0000","last_clean":"2024-09-17T02:21:02.451980+0000","last_became_active":"2024-09-17T02:20:15.567980+0000","last_became_peered":"2024-09-17T02:20:15.567980+0000","last_unstale":"2024-09-17T02:21:02.451980+0000","last_undegraded":"2024-09-17T02:21:02.451980+0000","last_fullsized":"2024-09-17T02:21:02.451980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:04.059900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.479826+0000","last_change":"2024-09-17T02:21:01.445942+0000","last_active":"2024-09-17T02:21:02.479826+0000","last_peered":"2024-09-17T02:21:02.479826+0000","last_clean":"2024-09-17T02:21:02.479826+0000","last_became_active":"2024-09-17T02:21:01.445555+0000","last_became_peered":"2024-09-17T02:21:01.445555+0000","last_unstale":"2024-09-17T02:21:02.479826+0000","last_undegraded":"2024-09-17T02:21:02.479826+0000","last_fullsized":"2024-09-17T02:21:02.479826+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:20.890249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.485860+0000","last_change":"2024-09-17T02:20:15.558296+0000","last_active":"2024-09-17T02:21:02.485860+0000","last_peered":"2024-09-17T02:21:02.485860+0000","last_clean":"2024-09-17T02:21:02.485860+0000","last_became_active":"2024-09-17T02:20:15.557520+0000","last_became_peered":"2024-09-17T02:20:15.557520+0000","last_unstale":"2024-09-17T02:21:02.485860+0000","last_undegraded":"2024-09-17T02:21:02.485860+0000","last_fullsized":"2024-09-17T02:21:02.485860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:04.229911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.479895+0000","last_change":"2024-09-17T02:20:16.568334+0000","last_active":"2024-09-17T02:21:02.479895+0000","last_peered":"2024-09-17T02:21:02.479895+0000","last_clean":"2024-09-17T02:21:02.479895+0000","last_became_active":"2024-09-17T02:20:16.566982+0000","last_became_peered":"2024-09-17T02:20:16.566982+0000","last_unstale":"2024-09-17T02:21:02.479895+0000","last_undegraded":"2024-09-17T02:21:02.479895+0000","last_fullsized":"2024-09-17T02:21:02.479895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:55.083688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.485249+0000","last_change":"2024-09-17T02:20:37.710685+0000","last_active":"2024-09-17T02:21:02.485249+0000","last_peered":"2024-09-17T02:21:02.485249+0000","last_clean":"2024-09-17T02:21:02.485249+0000","last_became_active":"2024-09-17T02:20:37.708795+0000","last_became_peered":"2024-09-17T02:20:37.708795+0000","last_unstale":"2024-09-17T02:21:02.485249+0000","last_undegraded":"2024-09-17T02:21:02.485249+0000","last_fullsized":"2024-09-17T02:21:02.485249+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:41.161743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.443594+0000","last_change":"2024-09-17T02:20:16.570456+0000","last_active":"2024-09-17T02:21:02.443594+0000","last_peered":"2024-09-17T02:21:02.443594+0000","last_clean":"2024-09-17T02:21:02.443594+0000","last_became_active":"2024-09-17T02:20:16.568095+0000","last_became_peered":"2024-09-17T02:20:16.568095+0000","last_unstale":"2024-09-17T02:21:02.443594+0000","last_undegraded":"2024-09-17T02:21:02.443594+0000","last_fullsized":"2024-09-17T02:21:02.443594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:58.329169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.438183+0000","last_change":"2024-09-17T02:20:15.560293+0000","last_active":"2024-09-17T02:21:01.438183+0000","last_peered":"2024-09-17T02:21:01.438183+0000","last_clean":"2024-09-17T02:21:01.438183+0000","last_became_active":"2024-09-17T02:20:15.559074+0000","last_became_peered":"2024-09-17T02:20:15.559074+0000","last_unstale":"2024-09-17T02:21:01.438183+0000","last_undegraded":"2024-09-17T02:21:01.438183+0000","last_fullsized":"2024-09-17T02:21:01.438183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:55.639841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T02:21:02.478628+0000","last_change":"2024-09-17T02:20:16.570950+0000","last_active":"2024-09-17T02:21:02.478628+0000","last_peered":"2024-09-17T02:21:02.478628+0000","last_clean":"2024-09-17T02:21:02.478628+0000","last_became_active":"2024-09-17T02:20:16.569496+0000","last_became_peered":"2024-09-17T02:20:16.569496+0000","last_unstale":"2024-09-17T02:21:02.478628+0000","last_undegraded":"2024-09-17T02:21:02.478628+0000","last_fullsized":"2024-09-17T02:21:02.478628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:29.757455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-17T02:21:01.437811+0000","last_change":"2024-09-17T02:20:15.544675+0000","last_active":"2024-09-17T02:21:01.437811+0000","last_peered":"2024-09-17T02:21:01.437811+0000","last_clean":"2024-09-17T02:21:01.437811+0000","last_became_active":"2024-09-17T02:20:15.544213+0000","last_became_peered":"2024-09-17T02:20:15.544213+0000","last_unstale":"2024-09-17T02:21:01.437811+0000","last_undegraded":"2024-09-17T02:21:01.437811+0000","last_fullsized":"2024-09-17T02:21:01.437811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:31.933850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":4664459264,"num_objects":71174,"num_object_clones":0,"num_object_copies":142348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":8605,"num_objects_unfound":0,"num_objects_dirty":71174,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71174,"num_write_kb":4555136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":10944512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":583852032,"data_stored":9341632512,"data_compressed":7980128,"data_compressed_allocated":583852032,"data_compressed_original":9341632512,"omap_allocated":0,"internal_metadata":0},"log_size":57695,"ondisk_log_size":57695,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705680,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":231880,"kb_used_data":160432,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94139960,"statfs":{"total":96636764160,"available":96399319040,"internally_reserved":0,"allocated":164282368,"data_stored":2621911357,"data_compressed":2246276,"data_compressed_allocated":163860480,"data_compressed_original":2621751296,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738384,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":253908,"kb_used_data":178304,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94117932,"statfs":{"total":96636764160,"available":96376762368,"internally_reserved":0,"allocated":182583296,"data_stored":2914722022,"data_compressed":2496394,"data_compressed_allocated":182161408,"data_compressed_original":2914566144,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,10],"upper_bound":4096},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738383,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312968,"kb_used_data":231796,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94058872,"statfs":{"total":96636764160,"available":96316284928,"internally_reserved":0,"allocated":237359104,"data_stored":3791853508,"data_compressed":3239080,"data_compressed_allocated":236982272,"data_compressed_original":3791716352,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":164745216,"data_stored":2635923456,"data_compressed":2251763,"data_compressed_allocated":164745216,"data_compressed_original":2635923456,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":236982272,"data_stored":3791716352,"data_compressed":3239080,"data_compressed_allocated":236982272,"data_compressed_original":3791716352,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":182124544,"data_stored":2913992704,"data_compressed":2489285,"data_compressed_allocated":182124544,"data_compressed_original":2913992704,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T02:21:08.197 INFO:tasks.thrashosds.thrasher:Setting 4.1d to [0, 1] 2024-09-17T02:21:08.197 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.1d', '0', '1'] 2024-09-17T02:21:08.197 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.1d 0 1 2024-09-17T02:21:08.251 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:08.251 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:08.258 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:08.258+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:08.271 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:21:08.335 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:21:08.335 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:21:08.354 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:21:08.354 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:21:08.359 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:08.362+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:08.375 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:21:08.375 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:21:08.432 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:21:08.432 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-17T02:21:08.432 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-09-17T02:21:08.432 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-09-17T02:21:08.432 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:21:08.454 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:21:08.487 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T02:21:08.500 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:08.503+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:08.560 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:08.562+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:08.618 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:21:08.618 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-09-17T02:21:08.618 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-09-17T02:21:08.618 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-17T02:21:08.618 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.618 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-17T02:21:08.618 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:21:08.619 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 64.160829858, 2024-09-17T02:21:08.619 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.15597325500000001, 2024-09-17T02:21:08.619 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:08.619 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:08.619 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:08.619 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:08.619 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4164", 2024-09-17T02:21:08.619 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/201892753", 2024-09-17T02:21:08.619 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 1 2024-09-17T02:21:08.619 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.619 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:08.619 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.619 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:08.619 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:21:08.620 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.620 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.620 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.620 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:08.620 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:21:08.620 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.620 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.620 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.620 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:08.620 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458359+0000", 2024-09-17T02:21:08.620 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3929999999999998e-06 2024-09-17T02:21:08.620 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.621 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.621 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:08.621 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458373+0000", 2024-09-17T02:21:08.621 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4103e-05 2024-09-17T02:21:08.621 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.621 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.621 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:08.621 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458397+0000", 2024-09-17T02:21:08.621 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.438e-05 2024-09-17T02:21:08.621 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.621 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.621 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:08.621 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458421+0000", 2024-09-17T02:21:08.621 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3655999999999998e-05 2024-09-17T02:21:08.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.622 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.622 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:08.622 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458529+0000", 2024-09-17T02:21:08.622 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010752900000000001 2024-09-17T02:21:08.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.622 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.622 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:21:08.622 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458542+0000", 2024-09-17T02:21:08.622 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2986999999999999e-05 2024-09-17T02:21:08.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.622 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.622 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:08.623 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.611050+0000", 2024-09-17T02:21:08.623 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.1525087 2024-09-17T02:21:08.623 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.623 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.623 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:08.623 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.611529+0000", 2024-09-17T02:21:08.623 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00047844899999999999 2024-09-17T02:21:08.623 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.623 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.623 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:08.623 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.612061+0000", 2024-09-17T02:21:08.623 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00053230300000000003 2024-09-17T02:21:08.623 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.624 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.624 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:08.624 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.613451+0000", 2024-09-17T02:21:08.624 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0013897250000000001 2024-09-17T02:21:08.624 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.624 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.624 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:08.624 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614168+0000", 2024-09-17T02:21:08.624 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00071692499999999998 2024-09-17T02:21:08.624 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.624 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.624 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:08.624 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614265+0000", 2024-09-17T02:21:08.625 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7589000000000004e-05 2024-09-17T02:21:08.625 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.625 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.625 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:08.625 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614330+0000", 2024-09-17T02:21:08.625 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4516000000000004e-05 2024-09-17T02:21:08.625 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.625 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:08.625 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.625 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.625 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.625 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:08.625 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:21:08.626 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 52.062898740000001, 2024-09-17T02:21:08.626 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029713927000000001, 2024-09-17T02:21:08.626 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:08.626 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:08.626 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:08.626 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:08.626 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.626 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:08.626 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:21:08.626 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.626 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.627 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.627 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:08.627 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:21:08.627 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.627 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.627 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.627 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:08.627 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556289+0000", 2024-09-17T02:21:08.627 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.513e-06 2024-09-17T02:21:08.627 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.627 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.627 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:08.628 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556298+0000", 2024-09-17T02:21:08.628 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1630000000000002e-06 2024-09-17T02:21:08.628 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.628 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.628 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:08.628 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556318+0000", 2024-09-17T02:21:08.628 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9389999999999999e-05 2024-09-17T02:21:08.628 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.628 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.628 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:08.628 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556332+0000", 2024-09-17T02:21:08.628 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4506e-05 2024-09-17T02:21:08.628 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.629 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.629 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:08.629 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557304+0000", 2024-09-17T02:21:08.629 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00097169699999999999 2024-09-17T02:21:08.629 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.629 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.629 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:08.629 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557507+0000", 2024-09-17T02:21:08.629 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000203191 2024-09-17T02:21:08.629 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.629 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.629 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:08.629 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557838+0000", 2024-09-17T02:21:08.630 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033061100000000002 2024-09-17T02:21:08.630 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.630 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.630 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:08.630 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562171+0000", 2024-09-17T02:21:08.630 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043329229999999998 2024-09-17T02:21:08.630 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.630 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.630 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:08.630 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585737+0000", 2024-09-17T02:21:08.630 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023565915 2024-09-17T02:21:08.630 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.630 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.630 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:08.631 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585884+0000", 2024-09-17T02:21:08.631 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014744199999999999 2024-09-17T02:21:08.631 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.631 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.631 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:08.631 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586002+0000", 2024-09-17T02:21:08.631 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000117576 2024-09-17T02:21:08.631 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.631 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:08.631 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.631 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.631 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.631 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:08.631 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:21:08.632 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 52.062806768000002, 2024-09-17T02:21:08.632 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030933694000000001, 2024-09-17T02:21:08.632 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:08.632 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:08.632 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:08.632 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:08.632 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.632 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:08.632 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:21:08.632 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.632 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.632 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.633 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:08.633 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:21:08.633 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.633 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.633 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.633 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:08.633 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556381+0000", 2024-09-17T02:21:08.633 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2100000000000001e-06 2024-09-17T02:21:08.633 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.633 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.633 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:08.633 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556389+0000", 2024-09-17T02:21:08.633 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5539999999999998e-06 2024-09-17T02:21:08.634 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.634 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.634 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:08.634 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556408+0000", 2024-09-17T02:21:08.634 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8623000000000001e-05 2024-09-17T02:21:08.634 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.634 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.634 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:08.634 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556427+0000", 2024-09-17T02:21:08.634 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8566000000000001e-05 2024-09-17T02:21:08.634 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.634 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.634 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:08.635 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558741+0000", 2024-09-17T02:21:08.635 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023144390000000002 2024-09-17T02:21:08.635 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.635 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.635 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:08.635 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559040+0000", 2024-09-17T02:21:08.635 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029912100000000001 2024-09-17T02:21:08.635 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.635 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.635 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:08.635 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559222+0000", 2024-09-17T02:21:08.635 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018211200000000001 2024-09-17T02:21:08.635 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.635 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.636 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:08.636 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.566648+0000", 2024-09-17T02:21:08.636 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074257560000000004 2024-09-17T02:21:08.636 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.636 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.636 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:08.636 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587109+0000", 2024-09-17T02:21:08.636 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.020460685999999999 2024-09-17T02:21:08.636 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.636 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.636 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:08.636 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587232+0000", 2024-09-17T02:21:08.636 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123325 2024-09-17T02:21:08.637 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.637 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.637 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:08.637 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587313+0000", 2024-09-17T02:21:08.637 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1302000000000002e-05 2024-09-17T02:21:08.637 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.637 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:08.637 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.637 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.637 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.637 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:08.637 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:21:08.637 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 52.062741322000001, 2024-09-17T02:21:08.637 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031045538000000001, 2024-09-17T02:21:08.638 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:08.638 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:08.638 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:08.638 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:08.638 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.638 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:08.638 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:21:08.638 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.638 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.638 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.638 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:08.638 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:21:08.638 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.638 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.639 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.639 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:08.639 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556446+0000", 2024-09-17T02:21:08.639 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.26e-06 2024-09-17T02:21:08.639 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.639 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.639 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:08.639 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556454+0000", 2024-09-17T02:21:08.639 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1640000000000004e-06 2024-09-17T02:21:08.639 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.640 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.640 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:08.640 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556471+0000", 2024-09-17T02:21:08.640 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7586000000000001e-05 2024-09-17T02:21:08.640 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.640 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.640 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:08.640 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556485+0000", 2024-09-17T02:21:08.640 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3523000000000001e-05 2024-09-17T02:21:08.640 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.640 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.640 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:08.641 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559899+0000", 2024-09-17T02:21:08.641 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0034142140000000001 2024-09-17T02:21:08.641 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.641 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.641 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:08.641 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.560104+0000", 2024-09-17T02:21:08.641 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00020539199999999999 2024-09-17T02:21:08.641 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.641 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.641 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:08.641 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.560400+0000", 2024-09-17T02:21:08.641 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029612099999999999 2024-09-17T02:21:08.641 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.641 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.642 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:08.642 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.568427+0000", 2024-09-17T02:21:08.642 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0080262909999999996 2024-09-17T02:21:08.642 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.642 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.642 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:08.642 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587377+0000", 2024-09-17T02:21:08.642 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018950765000000001 2024-09-17T02:21:08.642 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.642 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.642 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:08.642 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587445+0000", 2024-09-17T02:21:08.642 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.724e-05 2024-09-17T02:21:08.643 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.643 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.643 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:08.643 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587491+0000", 2024-09-17T02:21:08.643 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5982000000000001e-05 2024-09-17T02:21:08.643 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.643 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:08.643 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.643 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.643 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.643 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:08.643 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:21:08.643 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 52.062678552000001, 2024-09-17T02:21:08.644 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031435547000000001, 2024-09-17T02:21:08.644 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:08.644 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:08.644 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:08.644 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:08.644 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.644 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:08.644 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:21:08.644 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.644 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.644 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.644 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:08.644 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:21:08.645 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.645 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.645 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.645 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:08.645 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556509+0000", 2024-09-17T02:21:08.645 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.06e-06 2024-09-17T02:21:08.645 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.645 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.645 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:08.645 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556515+0000", 2024-09-17T02:21:08.645 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1029999999999998e-06 2024-09-17T02:21:08.645 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.645 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.646 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:08.646 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556532+0000", 2024-09-17T02:21:08.646 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7054e-05 2024-09-17T02:21:08.646 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.646 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.646 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:08.646 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556545+0000", 2024-09-17T02:21:08.646 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3023000000000001e-05 2024-09-17T02:21:08.646 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.646 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.646 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:08.646 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561016+0000", 2024-09-17T02:21:08.646 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044705150000000004 2024-09-17T02:21:08.647 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.647 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.647 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:08.647 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561316+0000", 2024-09-17T02:21:08.647 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000299895 2024-09-17T02:21:08.647 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.647 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.647 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:08.647 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561651+0000", 2024-09-17T02:21:08.647 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033519300000000001 2024-09-17T02:21:08.647 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.647 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.647 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:08.648 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571105+0000", 2024-09-17T02:21:08.648 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094540539999999999 2024-09-17T02:21:08.648 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.648 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.648 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:08.648 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587628+0000", 2024-09-17T02:21:08.648 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016522819000000001 2024-09-17T02:21:08.648 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.648 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.648 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:08.648 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587770+0000", 2024-09-17T02:21:08.648 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000142352 2024-09-17T02:21:08.648 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.649 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.649 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:08.649 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587943+0000", 2024-09-17T02:21:08.649 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017347900000000001 2024-09-17T02:21:08.649 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.649 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:08.649 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.649 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.649 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.649 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:08.649 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:21:08.649 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 52.062622822000002, 2024-09-17T02:21:08.649 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031809104999999997, 2024-09-17T02:21:08.649 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:08.650 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:08.650 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:08.650 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:08.650 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.650 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:08.650 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:21:08.650 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.650 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.650 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:08.650 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:21:08.650 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.651 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:08.651 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556565+0000", 2024-09-17T02:21:08.651 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.116e-06 2024-09-17T02:21:08.651 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.651 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:08.651 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556572+0000", 2024-09-17T02:21:08.651 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0230000000000004e-06 2024-09-17T02:21:08.651 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.651 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:08.651 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556588+0000", 2024-09-17T02:21:08.652 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6643e-05 2024-09-17T02:21:08.652 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.652 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:08.652 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556606+0000", 2024-09-17T02:21:08.652 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7159999999999998e-05 2024-09-17T02:21:08.652 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.652 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:08.652 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562712+0000", 2024-09-17T02:21:08.652 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0061061630000000004 2024-09-17T02:21:08.652 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.652 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:08.653 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562919+0000", 2024-09-17T02:21:08.653 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000207309 2024-09-17T02:21:08.653 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.653 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.653 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:08.656 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563264+0000", 2024-09-17T02:21:08.656 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00034490699999999998 2024-09-17T02:21:08.656 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.656 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.656 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:08.657 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571812+0000", 2024-09-17T02:21:08.657 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0085477810000000008 2024-09-17T02:21:08.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.657 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.657 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:08.657 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588094+0000", 2024-09-17T02:21:08.657 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016282443000000001 2024-09-17T02:21:08.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.657 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.657 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:08.657 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588275+0000", 2024-09-17T02:21:08.657 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018058700000000001 2024-09-17T02:21:08.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.657 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.658 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:08.658 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588373+0000", 2024-09-17T02:21:08.658 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7973000000000005e-05 2024-09-17T02:21:08.658 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.658 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:08.658 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.658 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.658 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.658 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:08.658 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:21:08.658 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 52.062564723000001, 2024-09-17T02:21:08.658 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031950544999999997, 2024-09-17T02:21:08.658 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:08.658 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:08.659 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:08.659 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:08.659 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.659 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:08.659 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:21:08.659 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.659 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.659 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.659 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:08.659 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:21:08.659 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.659 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.659 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.659 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:08.660 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556623+0000", 2024-09-17T02:21:08.660 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.04e-06 2024-09-17T02:21:08.660 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.660 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.660 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:08.660 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556631+0000", 2024-09-17T02:21:08.660 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1529999999999997e-06 2024-09-17T02:21:08.660 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.660 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.660 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:08.660 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556648+0000", 2024-09-17T02:21:08.660 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6583999999999999e-05 2024-09-17T02:21:08.660 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.661 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.661 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:08.661 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556661+0000", 2024-09-17T02:21:08.661 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3203e-05 2024-09-17T02:21:08.661 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.661 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.661 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:08.661 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564413+0000", 2024-09-17T02:21:08.661 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0077523100000000001 2024-09-17T02:21:08.661 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.661 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.661 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:08.661 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.565841+0000", 2024-09-17T02:21:08.661 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014276320000000001 2024-09-17T02:21:08.662 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.662 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.662 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:08.662 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.566131+0000", 2024-09-17T02:21:08.662 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029043800000000001 2024-09-17T02:21:08.662 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.662 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.662 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:08.662 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572353+0000", 2024-09-17T02:21:08.662 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.006222399 2024-09-17T02:21:08.662 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.662 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.662 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:08.663 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588452+0000", 2024-09-17T02:21:08.663 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016098635 2024-09-17T02:21:08.663 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.663 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.663 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:08.663 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588520+0000", 2024-09-17T02:21:08.663 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8040000000000006e-05 2024-09-17T02:21:08.663 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.663 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.663 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:08.663 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588572+0000", 2024-09-17T02:21:08.663 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2111000000000003e-05 2024-09-17T02:21:08.663 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.663 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:08.664 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.664 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.664 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.664 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:08.664 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:21:08.664 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 52.062467556999998, 2024-09-17T02:21:08.664 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.032187205000000003, 2024-09-17T02:21:08.664 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:08.664 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:08.664 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:08.664 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:08.664 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.665 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:08.665 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:21:08.665 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.665 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.665 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.665 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:08.665 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:21:08.665 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.665 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.665 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.665 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:08.665 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556727+0000", 2024-09-17T02:21:08.665 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3000000000000002e-06 2024-09-17T02:21:08.665 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.666 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.666 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:08.666 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556736+0000", 2024-09-17T02:21:08.666 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4300000000000006e-06 2024-09-17T02:21:08.666 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.666 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.666 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:08.666 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556755+0000", 2024-09-17T02:21:08.666 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9700000000000001e-05 2024-09-17T02:21:08.666 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.666 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.666 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:08.666 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556771+0000", 2024-09-17T02:21:08.667 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5213e-05 2024-09-17T02:21:08.667 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.667 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.667 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:08.667 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571184+0000", 2024-09-17T02:21:08.667 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014413888999999999 2024-09-17T02:21:08.667 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.667 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.667 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:08.667 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571302+0000", 2024-09-17T02:21:08.667 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011794900000000001 2024-09-17T02:21:08.667 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.667 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.667 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:08.668 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571494+0000", 2024-09-17T02:21:08.668 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000191168 2024-09-17T02:21:08.668 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.668 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.668 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:08.668 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.573775+0000", 2024-09-17T02:21:08.668 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002281656 2024-09-17T02:21:08.668 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.668 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.668 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:08.668 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588668+0000", 2024-09-17T02:21:08.668 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014892699000000001 2024-09-17T02:21:08.668 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.669 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.669 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:08.669 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588813+0000", 2024-09-17T02:21:08.669 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014530700000000001 2024-09-17T02:21:08.669 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.669 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.669 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:08.669 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588906+0000", 2024-09-17T02:21:08.669 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2893999999999995e-05 2024-09-17T02:21:08.669 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.669 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:08.669 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.669 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.670 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.670 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:08.670 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:21:08.670 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 52.062326392000003, 2024-09-17T02:21:08.670 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028815922000000001, 2024-09-17T02:21:08.670 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:08.670 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:08.670 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:08.670 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:08.670 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.670 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:08.670 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:21:08.670 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.670 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.671 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.671 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:08.671 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:21:08.671 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.671 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.671 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.671 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:08.671 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556861+0000", 2024-09-17T02:21:08.671 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.08e-06 2024-09-17T02:21:08.671 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.671 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.671 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:08.671 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556867+0000", 2024-09-17T02:21:08.671 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.207e-06 2024-09-17T02:21:08.672 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.672 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.672 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:08.672 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556886+0000", 2024-09-17T02:21:08.672 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9137e-05 2024-09-17T02:21:08.672 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.672 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.672 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:08.672 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556900+0000", 2024-09-17T02:21:08.672 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3253e-05 2024-09-17T02:21:08.672 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.672 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.672 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:08.673 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558301+0000", 2024-09-17T02:21:08.673 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014008320000000001 2024-09-17T02:21:08.673 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.673 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.673 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:08.673 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558564+0000", 2024-09-17T02:21:08.673 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000263238 2024-09-17T02:21:08.673 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.673 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.673 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:08.673 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558905+0000", 2024-09-17T02:21:08.673 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000341534 2024-09-17T02:21:08.673 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.673 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.674 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:08.674 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.568208+0000", 2024-09-17T02:21:08.674 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0093023689999999996 2024-09-17T02:21:08.674 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.674 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.674 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:08.674 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585379+0000", 2024-09-17T02:21:08.674 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017171091999999999 2024-09-17T02:21:08.674 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.674 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.674 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:08.674 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585509+0000", 2024-09-17T02:21:08.674 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013036100000000001 2024-09-17T02:21:08.674 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.675 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.675 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:08.675 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585676+0000", 2024-09-17T02:21:08.675 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016681899999999999 2024-09-17T02:21:08.675 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.675 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:08.675 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.675 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.675 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.675 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:08.675 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:21:08.675 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 52.062269125, 2024-09-17T02:21:08.675 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030862568, 2024-09-17T02:21:08.675 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:08.676 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:08.676 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:08.676 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:08.676 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.676 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:08.676 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:21:08.676 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.676 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.676 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.676 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:08.676 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:21:08.676 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.676 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.677 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.677 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:08.677 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556918+0000", 2024-09-17T02:21:08.677 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0529999999999999e-06 2024-09-17T02:21:08.677 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.677 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.677 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:08.677 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556925+0000", 2024-09-17T02:21:08.677 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.6939999999999998e-06 2024-09-17T02:21:08.677 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.677 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.677 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:08.677 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556942+0000", 2024-09-17T02:21:08.677 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6803000000000002e-05 2024-09-17T02:21:08.678 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.678 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.678 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:08.678 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556955+0000", 2024-09-17T02:21:08.678 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2659e-05 2024-09-17T02:21:08.678 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.678 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.678 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:08.678 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558237+0000", 2024-09-17T02:21:08.678 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001282804 2024-09-17T02:21:08.678 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.678 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.678 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:08.679 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558495+0000", 2024-09-17T02:21:08.679 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000257178 2024-09-17T02:21:08.679 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.679 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.679 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:08.679 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562168+0000", 2024-09-17T02:21:08.679 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0036737110000000001 2024-09-17T02:21:08.679 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.679 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.679 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:08.679 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.570855+0000", 2024-09-17T02:21:08.679 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0086868729999999995 2024-09-17T02:21:08.679 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.679 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.680 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:08.680 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587568+0000", 2024-09-17T02:21:08.680 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016712444999999999 2024-09-17T02:21:08.680 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.680 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.680 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:08.680 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587677+0000", 2024-09-17T02:21:08.680 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000109879 2024-09-17T02:21:08.680 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.680 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.680 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:08.680 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587780+0000", 2024-09-17T02:21:08.680 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000102469 2024-09-17T02:21:08.680 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.681 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:08.681 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.681 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.681 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.681 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:08.681 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:21:08.681 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 52.062186992999997, 2024-09-17T02:21:08.681 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031005751000000002, 2024-09-17T02:21:08.681 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:08.681 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:08.681 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:08.681 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:08.681 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.682 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:08.682 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:21:08.682 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.682 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.682 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.682 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:08.682 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:21:08.682 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.682 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.682 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.682 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:08.682 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557001+0000", 2024-09-17T02:21:08.682 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.237e-06 2024-09-17T02:21:08.682 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.683 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.683 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:08.683 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557007+0000", 2024-09-17T02:21:08.683 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7270000000000001e-06 2024-09-17T02:21:08.683 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.683 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.683 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:08.683 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557025+0000", 2024-09-17T02:21:08.683 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7689999999999998e-05 2024-09-17T02:21:08.683 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.683 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.683 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:08.683 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557039+0000", 2024-09-17T02:21:08.683 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.385e-05 2024-09-17T02:21:08.684 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.684 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.684 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:08.684 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563783+0000", 2024-09-17T02:21:08.684 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0067437110000000003 2024-09-17T02:21:08.684 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.684 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.684 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:08.684 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564031+0000", 2024-09-17T02:21:08.684 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00024871799999999999 2024-09-17T02:21:08.684 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.684 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.684 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:08.685 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564518+0000", 2024-09-17T02:21:08.685 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00048708999999999997 2024-09-17T02:21:08.685 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.685 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.685 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:08.685 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572375+0000", 2024-09-17T02:21:08.685 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078564780000000001 2024-09-17T02:21:08.685 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.685 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.685 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:08.685 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587862+0000", 2024-09-17T02:21:08.685 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015486837999999999 2024-09-17T02:21:08.685 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.686 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.686 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:08.686 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587954+0000", 2024-09-17T02:21:08.686 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1766000000000002e-05 2024-09-17T02:21:08.686 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.686 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.686 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:08.686 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588005+0000", 2024-09-17T02:21:08.686 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1646e-05 2024-09-17T02:21:08.686 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.686 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:08.686 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.686 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.686 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.687 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:08.687 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:21:08.687 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 52.062042697000003, 2024-09-17T02:21:08.687 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029554871999999999, 2024-09-17T02:21:08.687 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:08.687 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:08.687 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:08.687 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:08.687 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.687 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:08.687 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:21:08.687 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.687 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.688 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:08.688 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:21:08.688 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.688 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.688 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.688 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:08.688 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557145+0000", 2024-09-17T02:21:08.688 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.263e-06 2024-09-17T02:21:08.688 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.688 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.688 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:08.688 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557151+0000", 2024-09-17T02:21:08.688 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1040000000000003e-06 2024-09-17T02:21:08.689 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.689 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.689 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:08.689 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557168+0000", 2024-09-17T02:21:08.689 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7289999999999999e-05 2024-09-17T02:21:08.689 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.689 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.689 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:08.689 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557182+0000", 2024-09-17T02:21:08.689 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.325e-05 2024-09-17T02:21:08.689 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.689 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.689 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:08.689 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564102+0000", 2024-09-17T02:21:08.690 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069199860000000004 2024-09-17T02:21:08.690 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.690 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.690 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:08.690 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564438+0000", 2024-09-17T02:21:08.690 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033651800000000001 2024-09-17T02:21:08.690 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.690 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.690 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:08.690 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.565422+0000", 2024-09-17T02:21:08.690 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00098332499999999995 2024-09-17T02:21:08.690 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.690 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.690 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:08.691 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572361+0000", 2024-09-17T02:21:08.691 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069392630000000002 2024-09-17T02:21:08.691 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.691 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.691 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:08.691 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586567+0000", 2024-09-17T02:21:08.691 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014206107000000001 2024-09-17T02:21:08.691 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.691 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.691 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:08.691 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586643+0000", 2024-09-17T02:21:08.691 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5673000000000005e-05 2024-09-17T02:21:08.691 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.691 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.692 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:08.692 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586699+0000", 2024-09-17T02:21:08.692 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6093e-05 2024-09-17T02:21:08.692 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.692 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:08.692 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.692 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.692 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.692 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:08.692 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:21:08.692 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 52.061909004999997, 2024-09-17T02:21:08.692 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029800569999999998, 2024-09-17T02:21:08.692 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:08.693 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:08.693 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:08.693 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:08.693 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.693 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:08.693 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:21:08.693 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.693 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.693 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.693 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:08.693 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:21:08.693 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.693 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.693 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.694 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:08.694 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557279+0000", 2024-09-17T02:21:08.694 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.497e-06 2024-09-17T02:21:08.694 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.694 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.694 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:08.694 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557287+0000", 2024-09-17T02:21:08.694 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9030000000000004e-06 2024-09-17T02:21:08.694 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.694 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.694 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:08.694 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557306+0000", 2024-09-17T02:21:08.694 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9394000000000001e-05 2024-09-17T02:21:08.694 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.695 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.695 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:08.695 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557323+0000", 2024-09-17T02:21:08.695 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6299000000000001e-05 2024-09-17T02:21:08.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.695 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.695 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:08.695 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.570931+0000", 2024-09-17T02:21:08.695 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013608841999999999 2024-09-17T02:21:08.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.695 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.695 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:08.695 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571250+0000", 2024-09-17T02:21:08.695 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031817400000000001 2024-09-17T02:21:08.696 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.696 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.696 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:08.696 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571559+0000", 2024-09-17T02:21:08.696 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000309835 2024-09-17T02:21:08.696 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.696 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.696 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:08.696 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.574161+0000", 2024-09-17T02:21:08.696 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002601543 2024-09-17T02:21:08.696 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.696 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.696 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:08.697 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586866+0000", 2024-09-17T02:21:08.697 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012704968000000001 2024-09-17T02:21:08.697 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.697 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.697 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:08.697 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586987+0000", 2024-09-17T02:21:08.697 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000121369 2024-09-17T02:21:08.697 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.697 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.697 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:08.697 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587078+0000", 2024-09-17T02:21:08.697 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0746000000000002e-05 2024-09-17T02:21:08.697 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.697 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:08.698 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.698 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.698 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.698 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:08.698 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:21:08.698 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 52.061843361999998, 2024-09-17T02:21:08.698 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029936054, 2024-09-17T02:21:08.698 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:08.698 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:08.698 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:08.698 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:08.698 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.698 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:08.699 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:21:08.699 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.699 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.699 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.699 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:08.699 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:21:08.699 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.699 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.699 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.699 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:08.699 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557344+0000", 2024-09-17T02:21:08.699 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.347e-06 2024-09-17T02:21:08.699 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.699 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.700 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:08.700 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557351+0000", 2024-09-17T02:21:08.700 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5560000000000004e-06 2024-09-17T02:21:08.700 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.700 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.700 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:08.700 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557369+0000", 2024-09-17T02:21:08.700 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7703e-05 2024-09-17T02:21:08.700 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.700 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.700 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:08.700 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557382+0000", 2024-09-17T02:21:08.700 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3664e-05 2024-09-17T02:21:08.701 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.701 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.701 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:08.701 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558997+0000", 2024-09-17T02:21:08.701 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0016147970000000001 2024-09-17T02:21:08.701 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.701 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.701 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:08.701 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559236+0000", 2024-09-17T02:21:08.701 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00023900200000000001 2024-09-17T02:21:08.701 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.701 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.701 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:08.702 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559547+0000", 2024-09-17T02:21:08.702 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031132399999999998 2024-09-17T02:21:08.702 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.702 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.702 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:08.702 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563130+0000", 2024-09-17T02:21:08.702 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003582989 2024-09-17T02:21:08.702 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.702 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.702 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:08.702 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587069+0000", 2024-09-17T02:21:08.702 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023938496 2024-09-17T02:21:08.702 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.702 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.703 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:08.703 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587192+0000", 2024-09-17T02:21:08.703 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123514 2024-09-17T02:21:08.703 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.703 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.703 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:08.703 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587279+0000", 2024-09-17T02:21:08.703 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6662000000000005e-05 2024-09-17T02:21:08.703 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.703 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:08.703 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.703 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.703 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.704 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:08.704 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:21:08.704 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 52.061785475999997, 2024-09-17T02:21:08.704 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030490703000000001, 2024-09-17T02:21:08.704 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:08.704 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:08.704 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:08.704 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:08.704 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.704 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:08.704 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:21:08.704 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.704 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.704 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.705 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:08.705 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:21:08.705 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.705 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.705 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.705 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:08.705 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557403+0000", 2024-09-17T02:21:08.705 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.77e-06 2024-09-17T02:21:08.705 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.705 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.705 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:08.705 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557412+0000", 2024-09-17T02:21:08.705 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4099999999999997e-06 2024-09-17T02:21:08.706 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.706 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.706 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:08.706 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557431+0000", 2024-09-17T02:21:08.706 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9177e-05 2024-09-17T02:21:08.706 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.706 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.706 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:08.706 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557444+0000", 2024-09-17T02:21:08.706 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2999999999999999e-05 2024-09-17T02:21:08.706 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.706 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.706 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:08.706 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557722+0000", 2024-09-17T02:21:08.707 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00027760699999999997 2024-09-17T02:21:08.707 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.707 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.707 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:08.707 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557991+0000", 2024-09-17T02:21:08.707 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00026892499999999999 2024-09-17T02:21:08.707 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.707 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.707 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:08.707 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558265+0000", 2024-09-17T02:21:08.707 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000274524 2024-09-17T02:21:08.707 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.707 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.708 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:08.708 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564270+0000", 2024-09-17T02:21:08.708 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060045339999999997 2024-09-17T02:21:08.708 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.708 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.708 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:08.708 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587701+0000", 2024-09-17T02:21:08.708 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023431285999999999 2024-09-17T02:21:08.708 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.708 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.708 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:08.708 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587803+0000", 2024-09-17T02:21:08.708 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000101371 2024-09-17T02:21:08.709 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.709 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.709 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:08.709 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587892+0000", 2024-09-17T02:21:08.709 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9098999999999995e-05 2024-09-17T02:21:08.709 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.709 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:08.709 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.709 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.709 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.709 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:08.709 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:21:08.709 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 52.061703880000003, 2024-09-17T02:21:08.709 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029886725999999999, 2024-09-17T02:21:08.710 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:08.710 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:08.710 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:21:08.710 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:08.710 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.710 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:08.710 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:21:08.710 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.710 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.710 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.710 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:08.710 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:21:08.710 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.710 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.711 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.711 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:08.711 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557484+0000", 2024-09-17T02:21:08.711 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.26e-06 2024-09-17T02:21:08.711 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.711 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.711 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:08.711 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557489+0000", 2024-09-17T02:21:08.711 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2530000000000004e-06 2024-09-17T02:21:08.711 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.711 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.711 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:08.711 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557507+0000", 2024-09-17T02:21:08.711 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7473999999999999e-05 2024-09-17T02:21:08.712 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.712 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.712 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:08.712 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557524+0000", 2024-09-17T02:21:08.712 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7912999999999999e-05 2024-09-17T02:21:08.712 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.712 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.712 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:08.712 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572428+0000", 2024-09-17T02:21:08.712 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014903451999999999 2024-09-17T02:21:08.712 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.712 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.712 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:08.713 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572589+0000", 2024-09-17T02:21:08.713 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000161299 2024-09-17T02:21:08.713 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.713 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.713 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:08.713 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587369+0000", 2024-09-17T02:21:08.713 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014780075 2024-09-17T02:21:08.713 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.713 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:08.713 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.713 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.713 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.713 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28720 5.f 5:f8a7aea5:::benchmark_data_smithi001_23533_object28719:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:08.714 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:08.714 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 26.051399565000001, 2024-09-17T02:21:08.714 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.033978608, 2024-09-17T02:21:08.714 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:08.714 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:08.714 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:08.714 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:08.714 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:08.714 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:08.714 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28720 2024-09-17T02:21:08.714 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.714 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:08.714 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.714 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:08.715 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:08.715 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.715 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.715 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.715 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:08.715 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:08.715 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.715 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.715 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.715 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:08.715 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:08.715 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3200000000000005e-07 2024-09-17T02:21:08.715 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.715 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.716 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:08.716 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567856+0000", 2024-09-17T02:21:08.716 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8596000000000005e-05 2024-09-17T02:21:08.716 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.716 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.716 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:08.716 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567864+0000", 2024-09-17T02:21:08.716 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6040000000000004e-06 2024-09-17T02:21:08.716 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.716 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.716 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:08.716 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567867+0000", 2024-09-17T02:21:08.716 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7929999999999999e-06 2024-09-17T02:21:08.717 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.717 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.717 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:08.717 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567896+0000", 2024-09-17T02:21:08.717 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8444000000000001e-05 2024-09-17T02:21:08.717 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.717 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.717 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:08.717 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567983+0000", 2024-09-17T02:21:08.717 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7498999999999997e-05 2024-09-17T02:21:08.717 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.717 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.717 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:08.717 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568078+0000", 2024-09-17T02:21:08.718 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5050999999999995e-05 2024-09-17T02:21:08.718 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.718 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.718 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:08.718 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573091+0000", 2024-09-17T02:21:08.718 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050124599999999998 2024-09-17T02:21:08.718 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.718 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.718 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:08.718 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601705+0000", 2024-09-17T02:21:08.718 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028614298999999999 2024-09-17T02:21:08.718 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.718 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.718 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:08.719 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601741+0000", 2024-09-17T02:21:08.719 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5329e-05 2024-09-17T02:21:08.719 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.719 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.719 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:08.719 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601766+0000", 2024-09-17T02:21:08.719 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5001e-05 2024-09-17T02:21:08.719 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.719 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:08.719 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.719 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.719 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.719 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28723 5.f 5:f1a2a8f6:::benchmark_data_smithi001_23533_object28722:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:08.719 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:21:08.720 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 26.051120885, 2024-09-17T02:21:08.720 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.033805288000000003, 2024-09-17T02:21:08.720 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:08.720 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:08.720 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:08.720 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:08.720 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:08.720 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:08.720 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28723 2024-09-17T02:21:08.720 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.720 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:08.720 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.720 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:08.721 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:21:08.721 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.721 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.721 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.721 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:08.721 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:21:08.721 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.721 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.721 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.721 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:08.721 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568067+0000", 2024-09-17T02:21:08.721 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6700000000000002e-07 2024-09-17T02:21:08.721 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.721 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.722 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:08.722 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568121+0000", 2024-09-17T02:21:08.722 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4286000000000002e-05 2024-09-17T02:21:08.722 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.722 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.722 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:08.722 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568131+0000", 2024-09-17T02:21:08.722 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0288e-05 2024-09-17T02:21:08.722 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.722 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.722 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:08.722 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568139+0000", 2024-09-17T02:21:08.722 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5399999999999998e-06 2024-09-17T02:21:08.723 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.723 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.723 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:08.723 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569194+0000", 2024-09-17T02:21:08.723 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0010557100000000001 2024-09-17T02:21:08.723 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.723 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.723 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:08.723 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569298+0000", 2024-09-17T02:21:08.723 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000103491 2024-09-17T02:21:08.723 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.723 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.723 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:08.723 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569428+0000", 2024-09-17T02:21:08.724 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013050599999999999 2024-09-17T02:21:08.724 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.724 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.724 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:08.724 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573124+0000", 2024-09-17T02:21:08.724 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0036956810000000001 2024-09-17T02:21:08.724 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.724 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.724 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:08.724 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601801+0000", 2024-09-17T02:21:08.724 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028676667999999999 2024-09-17T02:21:08.724 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.724 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.724 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:08.725 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601835+0000", 2024-09-17T02:21:08.725 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4347000000000002e-05 2024-09-17T02:21:08.725 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.725 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.725 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:08.725 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601871+0000", 2024-09-17T02:21:08.725 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5803999999999998e-05 2024-09-17T02:21:08.725 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.725 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:08.725 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.725 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.725 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.725 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28729 5.9 5:9e3b1489:::benchmark_data_smithi001_23533_object28728:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:08.726 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:21:08.726 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 26.049502233999998, 2024-09-17T02:21:08.726 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.032738525999999997, 2024-09-17T02:21:08.726 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:08.726 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:08.726 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:08.726 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:08.726 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:08.726 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:08.726 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28729 2024-09-17T02:21:08.726 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.726 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:08.726 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.726 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:08.727 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:21:08.727 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.727 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.727 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.727 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:08.727 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:21:08.727 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.727 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.727 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.727 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:08.727 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569685+0000", 2024-09-17T02:21:08.728 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8599999999999996e-07 2024-09-17T02:21:08.728 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.728 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.728 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:08.728 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569725+0000", 2024-09-17T02:21:08.728 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0144000000000001e-05 2024-09-17T02:21:08.728 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.728 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.728 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:08.728 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569737+0000", 2024-09-17T02:21:08.728 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1752e-05 2024-09-17T02:21:08.728 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.728 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.729 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:08.729 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569745+0000", 2024-09-17T02:21:08.729 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6420000000000007e-06 2024-09-17T02:21:08.729 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.729 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.729 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:08.729 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569801+0000", 2024-09-17T02:21:08.729 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6110000000000003e-05 2024-09-17T02:21:08.729 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.729 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.729 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:08.729 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569944+0000", 2024-09-17T02:21:08.729 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014361500000000001 2024-09-17T02:21:08.729 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.730 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.730 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:08.730 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.570234+0000", 2024-09-17T02:21:08.730 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00028927899999999998 2024-09-17T02:21:08.730 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.730 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.730 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:08.730 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572606+0000", 2024-09-17T02:21:08.730 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023725529999999999 2024-09-17T02:21:08.730 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.730 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.730 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:08.730 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602361+0000", 2024-09-17T02:21:08.731 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029755031000000001 2024-09-17T02:21:08.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.731 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:08.731 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602397+0000", 2024-09-17T02:21:08.731 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5509000000000002e-05 2024-09-17T02:21:08.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.731 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:08.731 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602423+0000", 2024-09-17T02:21:08.731 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5905e-05 2024-09-17T02:21:08.731 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.731 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:08.731 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.732 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.732 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28734 5.f 5:f1a63647:::benchmark_data_smithi001_23533_object28733:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:08.732 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:21:08.732 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 26.047779748, 2024-09-17T02:21:08.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.034441100000000002, 2024-09-17T02:21:08.732 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:08.732 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:08.732 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:08.732 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:08.732 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:08.732 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:08.732 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28734 2024-09-17T02:21:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:21:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:21:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571408+0000", 2024-09-17T02:21:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.8899999999999998e-07 2024-09-17T02:21:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571464+0000", 2024-09-17T02:21:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6546999999999999e-05 2024-09-17T02:21:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571474+0000", 2024-09-17T02:21:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0348e-05 2024-09-17T02:21:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.734 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571480+0000", 2024-09-17T02:21:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.366e-06 2024-09-17T02:21:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572097+0000", 2024-09-17T02:21:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061710599999999997 2024-09-17T02:21:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572172+0000", 2024-09-17T02:21:08.735 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4658000000000002e-05 2024-09-17T02:21:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572247+0000", 2024-09-17T02:21:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5766000000000006e-05 2024-09-17T02:21:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573819+0000", 2024-09-17T02:21:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015713649999999999 2024-09-17T02:21:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.736 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605762+0000", 2024-09-17T02:21:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031943304999999998 2024-09-17T02:21:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605808+0000", 2024-09-17T02:21:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5776999999999999e-05 2024-09-17T02:21:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605848+0000", 2024-09-17T02:21:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9972999999999998e-05 2024-09-17T02:21:08.737 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.738 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:08.738 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.738 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:08.738 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:08.738 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:21:08.740 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:08.741 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:08.742+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:08.772 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 36 16 79876 79860 138.63 131.438 0.00554584 0.00720858 2024-09-17T02:21:08.841 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:08.842+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:08.904 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:08.905 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:08.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.905 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:80153 5.4 5:22e1baac:::benchmark_data_smithi001_23533_object80152:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T02:21:08.905 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:08.907848+0000", 2024-09-17T02:21:08.905 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.001686402, 2024-09-17T02:21:08.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017141700000000001, 2024-09-17T02:21:08.905 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:08.905 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:08.905 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:08.905 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:08.905 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:08.905 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:08.905 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 80153 2024-09-17T02:21:08.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.906 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:08.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:08.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.907848+0000", 2024-09-17T02:21:08.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:08.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:08.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.907848+0000", 2024-09-17T02:21:08.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:08.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:08.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.907850+0000", 2024-09-17T02:21:08.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3549999999999999e-06 2024-09-17T02:21:08.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:08.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.907876+0000", 2024-09-17T02:21:08.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5582e-05 2024-09-17T02:21:08.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:08.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.907894+0000", 2024-09-17T02:21:08.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8566000000000001e-05 2024-09-17T02:21:08.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:08.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.907903+0000", 2024-09-17T02:21:08.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3420000000000008e-06 2024-09-17T02:21:08.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:08.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.908196+0000", 2024-09-17T02:21:08.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029289399999999998 2024-09-17T02:21:08.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:08.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.908359+0000", 2024-09-17T02:21:08.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016309699999999999 2024-09-17T02:21:08.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:08.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.908530+0000", 2024-09-17T02:21:08.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017184599999999999 2024-09-17T02:21:08.909 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:08.909 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:08.909 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:08.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.909 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:80152 5.3 e40/38)", 2024-09-17T02:21:08.910 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:08.908030+0000", 2024-09-17T02:21:08.910 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0015044559999999999, 2024-09-17T02:21:08.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016199739999999999, 2024-09-17T02:21:08.910 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:08.910 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:08.910 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-17T02:21:08.910 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:08.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:08.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.908030+0000", 2024-09-17T02:21:08.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:08.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:08.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.908030+0000", 2024-09-17T02:21:08.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:08.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:08.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.908030+0000", 2024-09-17T02:21:08.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4600000000000005e-07 2024-09-17T02:21:08.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:08.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.908034+0000", 2024-09-17T02:21:08.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0999999999999997e-06 2024-09-17T02:21:08.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:08.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.908043+0000", 2024-09-17T02:21:08.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0750000000000004e-06 2024-09-17T02:21:08.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:08.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.908049+0000", 2024-09-17T02:21:08.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8409999999999996e-06 2024-09-17T02:21:08.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:08.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.909649+0000", 2024-09-17T02:21:08.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015995200000000001 2024-09-17T02:21:08.913 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:08.913 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:08.913 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:08.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.913 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:80141 5.b 5:dd95f827:::benchmark_data_smithi001_23533_object80140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T02:21:08.913 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:08.901723+0000", 2024-09-17T02:21:08.913 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.007810946, 2024-09-17T02:21:08.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0079849759999999995, 2024-09-17T02:21:08.913 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:08.913 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:08.913 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:08.914 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:08.914 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:08.914 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:08.914 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 80141 2024-09-17T02:21:08.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.914 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:08.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:08.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.901723+0000", 2024-09-17T02:21:08.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:08.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:08.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.901723+0000", 2024-09-17T02:21:08.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:08.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:08.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.901724+0000", 2024-09-17T02:21:08.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.78e-07 2024-09-17T02:21:08.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:08.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.901847+0000", 2024-09-17T02:21:08.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012239400000000001 2024-09-17T02:21:08.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:08.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.901858+0000", 2024-09-17T02:21:08.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1738e-05 2024-09-17T02:21:08.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:08.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.901865+0000", 2024-09-17T02:21:08.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6540000000000002e-06 2024-09-17T02:21:08.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:08.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.903612+0000", 2024-09-17T02:21:08.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017465919999999999 2024-09-17T02:21:08.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:08.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.903774+0000", 2024-09-17T02:21:08.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016191600000000001 2024-09-17T02:21:08.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:08.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.903947+0000", 2024-09-17T02:21:08.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017297800000000001 2024-09-17T02:21:08.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:08.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.908945+0000", 2024-09-17T02:21:08.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049988999999999997 2024-09-17T02:21:08.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:08.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.908983+0000", 2024-09-17T02:21:08.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8012000000000001e-05 2024-09-17T02:21:08.918 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:08.918 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:08.918 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:08.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.918 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:80159 5.e 5:7cdb0346:::benchmark_data_smithi001_23533_object80158:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T02:21:08.918 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:08.909394+0000", 2024-09-17T02:21:08.918 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00014061600000000001, 2024-09-17T02:21:08.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041446400000000002, 2024-09-17T02:21:08.919 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:08.919 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:08.919 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:08.919 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:08.919 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:08.919 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:08.919 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 80159 2024-09-17T02:21:08.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.919 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:08.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:08.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.909394+0000", 2024-09-17T02:21:08.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:08.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:08.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.909394+0000", 2024-09-17T02:21:08.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:08.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:08.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.909394+0000", 2024-09-17T02:21:08.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8199999999999999e-07 2024-09-17T02:21:08.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:08.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.909544+0000", 2024-09-17T02:21:08.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000150073 2024-09-17T02:21:08.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:08.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.909555+0000", 2024-09-17T02:21:08.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0586e-05 2024-09-17T02:21:08.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:08.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.909562+0000", 2024-09-17T02:21:08.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2529999999999998e-06 2024-09-17T02:21:08.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:08.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.909623+0000", 2024-09-17T02:21:08.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1033000000000003e-05 2024-09-17T02:21:08.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:08.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.909770+0000", 2024-09-17T02:21:08.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014700800000000001 2024-09-17T02:21:08.922 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:08.922 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:08.922 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:08.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.923 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:80144 5.b 5:d279eb2e:::benchmark_data_smithi001_23533_object80143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T02:21:08.923 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:08.901889+0000", 2024-09-17T02:21:08.923 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0076450859999999997, 2024-09-17T02:21:08.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0079925259999999998, 2024-09-17T02:21:08.923 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:08.923 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:08.923 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:08.923 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:08.923 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:08.923 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:08.923 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 80144 2024-09-17T02:21:08.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.923 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:08.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:08.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.901889+0000", 2024-09-17T02:21:08.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:08.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:08.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.901889+0000", 2024-09-17T02:21:08.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:08.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:08.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.901890+0000", 2024-09-17T02:21:08.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6300000000000005e-07 2024-09-17T02:21:08.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:08.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.901969+0000", 2024-09-17T02:21:08.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9123999999999997e-05 2024-09-17T02:21:08.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:08.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.901978+0000", 2024-09-17T02:21:08.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1810000000000007e-06 2024-09-17T02:21:08.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:08.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.901984+0000", 2024-09-17T02:21:08.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8370000000000002e-06 2024-09-17T02:21:08.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:08.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.906081+0000", 2024-09-17T02:21:08.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040974519999999997 2024-09-17T02:21:08.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:08.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.906257+0000", 2024-09-17T02:21:08.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017578299999999999 2024-09-17T02:21:08.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:08.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.906433+0000", 2024-09-17T02:21:08.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017589 2024-09-17T02:21:08.927 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:08.927 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:08.927 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:08.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.927 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:80148 5.b 5:de2617b5:::benchmark_data_smithi001_23533_object80147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T02:21:08.927 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:08.904088+0000", 2024-09-17T02:21:08.927 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0054460949999999998, 2024-09-17T02:21:08.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0058741799999999997, 2024-09-17T02:21:08.927 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:08.928 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:08.928 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:08.928 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:08.928 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:08.928 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:08.928 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 80148 2024-09-17T02:21:08.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.928 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:08.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:08.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.904088+0000", 2024-09-17T02:21:08.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:08.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:08.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.904088+0000", 2024-09-17T02:21:08.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:08.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:08.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.904089+0000", 2024-09-17T02:21:08.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.128e-06 2024-09-17T02:21:08.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:08.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.904118+0000", 2024-09-17T02:21:08.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9172000000000001e-05 2024-09-17T02:21:08.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:08.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.904133+0000", 2024-09-17T02:21:08.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4698999999999999e-05 2024-09-17T02:21:08.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:08.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.904141+0000", 2024-09-17T02:21:08.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0209999999999999e-06 2024-09-17T02:21:08.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:08.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.909633+0000", 2024-09-17T02:21:08.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054915889999999998 2024-09-17T02:21:08.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:08.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.909774+0000", 2024-09-17T02:21:08.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000140774 2024-09-17T02:21:08.931 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:08.931 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:08.931 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:08.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.932 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:80145 5.3 e40/38 5:cbe75c34:::benchmark_data_smithi001_23533_object80144:head v 40'5068, mlcod=40'5066)", 2024-09-17T02:21:08.932 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:08.905324+0000", 2024-09-17T02:21:08.932 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0042103499999999999, 2024-09-17T02:21:08.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047065350000000004, 2024-09-17T02:21:08.932 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:08.932 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:08.932 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:08.932 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:08.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:08.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.905324+0000", 2024-09-17T02:21:08.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:08.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:08.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.905324+0000", 2024-09-17T02:21:08.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:08.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:08.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.905324+0000", 2024-09-17T02:21:08.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5600000000000001e-07 2024-09-17T02:21:08.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:08.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.905328+0000", 2024-09-17T02:21:08.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8229999999999997e-06 2024-09-17T02:21:08.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:08.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.905335+0000", 2024-09-17T02:21:08.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4309999999999999e-06 2024-09-17T02:21:08.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:08.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.905339+0000", 2024-09-17T02:21:08.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.335e-06 2024-09-17T02:21:08.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:08.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.908260+0000", 2024-09-17T02:21:08.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029206240000000001 2024-09-17T02:21:08.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:08.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:08.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:08.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:08.908277+0000", 2024-09-17T02:21:08.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7906000000000001e-05 2024-09-17T02:21:08.935 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:08.935 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:08.935 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:08.935 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:08.935 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:21:08.935 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 7 2024-09-17T02:21:08.935 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:08.937 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:08.941 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:08.943+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:09.043 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:09.042+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:09.100 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:09.100 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:21:09.100 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:21:09.100 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:21:09.101 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:09.120 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:09.143 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:09.146+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:09.245 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:09.246+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:09.321 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:09.322 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:21:09.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:21:09.322 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:09.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.322 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:09.322 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:21:09.323 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.768508756000003, 2024-09-17T02:21:09.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035535028000000003, 2024-09-17T02:21:09.323 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:09.323 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:09.323 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:09.323 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:09.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:09.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:21:09.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:09.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:21:09.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:09.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556550+0000", 2024-09-17T02:21:09.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3500000000000001e-06 2024-09-17T02:21:09.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:09.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556566+0000", 2024-09-17T02:21:09.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5440000000000001e-05 2024-09-17T02:21:09.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556594+0000", 2024-09-17T02:21:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8552999999999999e-05 2024-09-17T02:21:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556618+0000", 2024-09-17T02:21:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3207e-05 2024-09-17T02:21:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578337+0000", 2024-09-17T02:21:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021719517000000001 2024-09-17T02:21:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578655+0000", 2024-09-17T02:21:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031837800000000002 2024-09-17T02:21:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.581374+0000", 2024-09-17T02:21:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002718238 2024-09-17T02:21:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587083+0000", 2024-09-17T02:21:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005708912 2024-09-17T02:21:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591823+0000", 2024-09-17T02:21:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047406080000000003 2024-09-17T02:21:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591972+0000", 2024-09-17T02:21:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014874199999999999 2024-09-17T02:21:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592082+0000", 2024-09-17T02:21:09.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110083 2024-09-17T02:21:09.328 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.328 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:09.328 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.328 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:09.328 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:21:09.328 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.767567268999997, 2024-09-17T02:21:09.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035128756999999997, 2024-09-17T02:21:09.328 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:09.328 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:09.329 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:09.329 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:09.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:09.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:21:09.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:09.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:21:09.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:09.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557491+0000", 2024-09-17T02:21:09.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.88e-06 2024-09-17T02:21:09.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:09.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557504+0000", 2024-09-17T02:21:09.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2864000000000001e-05 2024-09-17T02:21:09.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557535+0000", 2024-09-17T02:21:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0916e-05 2024-09-17T02:21:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557561+0000", 2024-09-17T02:21:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5602999999999999e-05 2024-09-17T02:21:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582290+0000", 2024-09-17T02:21:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024729729999999998 2024-09-17T02:21:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:09.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582642+0000", 2024-09-17T02:21:09.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035143499999999999 2024-09-17T02:21:09.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:09.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582959+0000", 2024-09-17T02:21:09.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031747399999999999 2024-09-17T02:21:09.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:09.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587302+0000", 2024-09-17T02:21:09.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043425169999999997 2024-09-17T02:21:09.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:09.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592391+0000", 2024-09-17T02:21:09.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050895799999999998 2024-09-17T02:21:09.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:09.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592516+0000", 2024-09-17T02:21:09.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012420500000000001 2024-09-17T02:21:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592617+0000", 2024-09-17T02:21:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010155299999999999 2024-09-17T02:21:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:21:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.767462770000002, 2024-09-17T02:21:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034796066, 2024-09-17T02:21:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:21:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:21:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:09.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557594+0000", 2024-09-17T02:21:09.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3769999999999999e-06 2024-09-17T02:21:09.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:09.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557683+0000", 2024-09-17T02:21:09.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8896999999999999e-05 2024-09-17T02:21:09.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:09.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557707+0000", 2024-09-17T02:21:09.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3839e-05 2024-09-17T02:21:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557730+0000", 2024-09-17T02:21:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3047000000000001e-05 2024-09-17T02:21:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582329+0000", 2024-09-17T02:21:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024599283999999999 2024-09-17T02:21:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582624+0000", 2024-09-17T02:21:09.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000294462 2024-09-17T02:21:09.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:09.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582936+0000", 2024-09-17T02:21:09.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031223399999999999 2024-09-17T02:21:09.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:09.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587347+0000", 2024-09-17T02:21:09.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044110340000000003 2024-09-17T02:21:09.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:09.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592165+0000", 2024-09-17T02:21:09.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048176699999999996 2024-09-17T02:21:09.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:09.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592311+0000", 2024-09-17T02:21:09.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014661899999999999 2024-09-17T02:21:09.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:09.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592389+0000", 2024-09-17T02:21:09.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7602999999999995e-05 2024-09-17T02:21:09.340 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.340 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:09.340 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.340 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:09.340 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:21:09.341 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.766945143000001, 2024-09-17T02:21:09.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034457472000000003, 2024-09-17T02:21:09.341 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:09.341 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:09.341 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:09.341 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:09.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:09.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:21:09.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:09.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:21:09.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:09.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558113+0000", 2024-09-17T02:21:09.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1639999999999999e-06 2024-09-17T02:21:09.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:09.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558125+0000", 2024-09-17T02:21:09.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2269999999999999e-05 2024-09-17T02:21:09.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:09.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558458+0000", 2024-09-17T02:21:09.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033322700000000001 2024-09-17T02:21:09.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558488+0000", 2024-09-17T02:21:09.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.951e-05 2024-09-17T02:21:09.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:09.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584514+0000", 2024-09-17T02:21:09.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026025721000000002 2024-09-17T02:21:09.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:09.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584781+0000", 2024-09-17T02:21:09.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000267142 2024-09-17T02:21:09.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:09.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585078+0000", 2024-09-17T02:21:09.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029738799999999999 2024-09-17T02:21:09.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:09.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588045+0000", 2024-09-17T02:21:09.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029673759999999999 2024-09-17T02:21:09.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:09.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592454+0000", 2024-09-17T02:21:09.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044090209999999999 2024-09-17T02:21:09.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:09.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592520+0000", 2024-09-17T02:21:09.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6032999999999996e-05 2024-09-17T02:21:09.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:09.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592568+0000", 2024-09-17T02:21:09.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7620000000000001e-05 2024-09-17T02:21:09.347 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.347 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:09.347 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.348 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:09.348 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:21:09.348 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.766484892000001, 2024-09-17T02:21:09.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031603266999999997, 2024-09-17T02:21:09.348 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:09.348 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:09.348 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:09.348 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:09.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:09.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:21:09.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:09.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:21:09.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:09.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558573+0000", 2024-09-17T02:21:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0660000000000002e-06 2024-09-17T02:21:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558585+0000", 2024-09-17T02:21:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1596999999999999e-05 2024-09-17T02:21:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558612+0000", 2024-09-17T02:21:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7115999999999999e-05 2024-09-17T02:21:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558631+0000", 2024-09-17T02:21:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9519999999999999e-05 2024-09-17T02:21:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558783+0000", 2024-09-17T02:21:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152025 2024-09-17T02:21:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-17T02:21:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558798+0000", 2024-09-17T02:21:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4966999999999999e-05 2024-09-17T02:21:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.572871+0000", 2024-09-17T02:21:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014072782000000001 2024-09-17T02:21:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573153+0000", 2024-09-17T02:21:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028214499999999998 2024-09-17T02:21:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573432+0000", 2024-09-17T02:21:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027932100000000002 2024-09-17T02:21:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582279+0000", 2024-09-17T02:21:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0088463310000000007 2024-09-17T02:21:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.589902+0000", 2024-09-17T02:21:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0076236050000000003 2024-09-17T02:21:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.589997+0000", 2024-09-17T02:21:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4456000000000005e-05 2024-09-17T02:21:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590174+0000", 2024-09-17T02:21:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000177336 2024-09-17T02:21:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:21:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.766381647000003, 2024-09-17T02:21:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031899064999999997, 2024-09-17T02:21:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:21:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:21:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558676+0000", 2024-09-17T02:21:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.39e-06 2024-09-17T02:21:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558686+0000", 2024-09-17T02:21:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.022e-05 2024-09-17T02:21:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558708+0000", 2024-09-17T02:21:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2249999999999999e-05 2024-09-17T02:21:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558725+0000", 2024-09-17T02:21:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7387000000000001e-05 2024-09-17T02:21:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558940+0000", 2024-09-17T02:21:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021453800000000001 2024-09-17T02:21:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting_for_map not empty", 2024-09-17T02:21:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558951+0000", 2024-09-17T02:21:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1303e-05 2024-09-17T02:21:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576237+0000", 2024-09-17T02:21:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017285723999999999 2024-09-17T02:21:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576454+0000", 2024-09-17T02:21:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021673800000000001 2024-09-17T02:21:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576932+0000", 2024-09-17T02:21:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047792700000000001 2024-09-17T02:21:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585689+0000", 2024-09-17T02:21:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0087572880000000002 2024-09-17T02:21:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590287+0000", 2024-09-17T02:21:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045978060000000003 2024-09-17T02:21:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590447+0000", 2024-09-17T02:21:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000160719 2024-09-17T02:21:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590573+0000", 2024-09-17T02:21:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012577500000000001 2024-09-17T02:21:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:21:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.766303677000003, 2024-09-17T02:21:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034114029999999997, 2024-09-17T02:21:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:21:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:21:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558753+0000", 2024-09-17T02:21:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2699999999999999e-06 2024-09-17T02:21:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558769+0000", 2024-09-17T02:21:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5906e-05 2024-09-17T02:21:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558791+0000", 2024-09-17T02:21:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1342999999999999e-05 2024-09-17T02:21:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558806+0000", 2024-09-17T02:21:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5829999999999999e-05 2024-09-17T02:21:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584906+0000", 2024-09-17T02:21:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026099273999999999 2024-09-17T02:21:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585158+0000", 2024-09-17T02:21:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025194600000000002 2024-09-17T02:21:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585368+0000", 2024-09-17T02:21:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210068 2024-09-17T02:21:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588098+0000", 2024-09-17T02:21:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002730522 2024-09-17T02:21:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592680+0000", 2024-09-17T02:21:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045816019999999997 2024-09-17T02:21:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592774+0000", 2024-09-17T02:21:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3726000000000004e-05 2024-09-17T02:21:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592866+0000", 2024-09-17T02:21:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2542999999999998e-05 2024-09-17T02:21:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:21:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.766227374000003, 2024-09-17T02:21:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031407875000000002, 2024-09-17T02:21:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:21:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:21:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558830+0000", 2024-09-17T02:21:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3599999999999999e-06 2024-09-17T02:21:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558835+0000", 2024-09-17T02:21:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6130000000000003e-06 2024-09-17T02:21:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558853+0000", 2024-09-17T02:21:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8099999999999999e-05 2024-09-17T02:21:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558869+0000", 2024-09-17T02:21:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.59e-05 2024-09-17T02:21:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560437+0000", 2024-09-17T02:21:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015677989999999999 2024-09-17T02:21:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-17T02:21:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560453+0000", 2024-09-17T02:21:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.535e-05 2024-09-17T02:21:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562422+0000", 2024-09-17T02:21:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00196934 2024-09-17T02:21:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562773+0000", 2024-09-17T02:21:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035152399999999998 2024-09-17T02:21:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590236+0000", 2024-09-17T02:21:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.027462889000000001 2024-09-17T02:21:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28720 5.f e28/22 5:f8a7aea5:::benchmark_data_smithi001_23533_object28719:head v 28'1756, mlcod=28'1754)", 2024-09-17T02:21:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:21:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.754935877000001, 2024-09-17T02:21:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033308717000000002, 2024-09-17T02:21:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:09.374 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:09.374 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:09.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:09.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:21:09.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:09.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:21:09.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:09.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570121+0000", 2024-09-17T02:21:09.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4e-07 2024-09-17T02:21:09.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:09.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570208+0000", 2024-09-17T02:21:09.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6945000000000002e-05 2024-09-17T02:21:09.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:09.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570222+0000", 2024-09-17T02:21:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4541e-05 2024-09-17T02:21:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570232+0000", 2024-09-17T02:21:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3039999999999994e-06 2024-09-17T02:21:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570273+0000", 2024-09-17T02:21:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1950999999999999e-05 2024-09-17T02:21:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570286+0000", 2024-09-17T02:21:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2268e-05 2024-09-17T02:21:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603312+0000", 2024-09-17T02:21:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033026405000000002 2024-09-17T02:21:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603429+0000", 2024-09-17T02:21:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116463 2024-09-17T02:21:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28721 5.a e28/22 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head v 28'1872, mlcod=28'1869)", 2024-09-17T02:21:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:21:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.754792371000001, 2024-09-17T02:21:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033539817999999999, 2024-09-17T02:21:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:21:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:21:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570264+0000", 2024-09-17T02:21:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0999999999999997e-07 2024-09-17T02:21:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570299+0000", 2024-09-17T02:21:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4876999999999998e-05 2024-09-17T02:21:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570310+0000", 2024-09-17T02:21:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0958000000000001e-05 2024-09-17T02:21:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570316+0000", 2024-09-17T02:21:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.485e-06 2024-09-17T02:21:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598947+0000", 2024-09-17T02:21:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.028631058000000001 2024-09-17T02:21:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598969+0000", 2024-09-17T02:21:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2005999999999999e-05 2024-09-17T02:21:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.602638+0000", 2024-09-17T02:21:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036690339999999998 2024-09-17T02:21:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603803+0000", 2024-09-17T02:21:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00116559 2024-09-17T02:21:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28723 5.f e28/22 5:f1a2a8f6:::benchmark_data_smithi001_23533_object28722:head v 28'1757, mlcod=28'1754)", 2024-09-17T02:21:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.571446+0000", 2024-09-17T02:21:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.753610042999998, 2024-09-17T02:21:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.032047203000000003, 2024-09-17T02:21:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571446+0000", 2024-09-17T02:21:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571446+0000", 2024-09-17T02:21:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571447+0000", 2024-09-17T02:21:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0979999999999999e-06 2024-09-17T02:21:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571554+0000", 2024-09-17T02:21:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107464 2024-09-17T02:21:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598891+0000", 2024-09-17T02:21:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.027336905000000002 2024-09-17T02:21:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598905+0000", 2024-09-17T02:21:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:21:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.600343+0000", 2024-09-17T02:21:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014382100000000001 2024-09-17T02:21:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.600387+0000", 2024-09-17T02:21:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3398e-05 2024-09-17T02:21:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603443+0000", 2024-09-17T02:21:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030562250000000001 2024-09-17T02:21:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603493+0000", 2024-09-17T02:21:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9820000000000001e-05 2024-09-17T02:21:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:40730 5.b 5:d64b1dc0:::benchmark_data_smithi001_23533_object40729:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:21:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:21:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.287288204999999, 2024-09-17T02:21:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016675972000000001, 2024-09-17T02:21:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 40730 2024-09-17T02:21:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:21:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:21:09.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:09.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:21:09.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5700000000000002e-07 2024-09-17T02:21:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037813+0000", 2024-09-17T02:21:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4880999999999999e-05 2024-09-17T02:21:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037820+0000", 2024-09-17T02:21:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.34e-06 2024-09-17T02:21:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037825+0000", 2024-09-17T02:21:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1420000000000003e-06 2024-09-17T02:21:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.039167+0000", 2024-09-17T02:21:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013427529999999999 2024-09-17T02:21:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.039293+0000", 2024-09-17T02:21:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000125248 2024-09-17T02:21:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.039442+0000", 2024-09-17T02:21:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014929799999999999 2024-09-17T02:21:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.041694+0000", 2024-09-17T02:21:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002252324 2024-09-17T02:21:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054324+0000", 2024-09-17T02:21:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012629782000000001 2024-09-17T02:21:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054393+0000", 2024-09-17T02:21:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9295999999999995e-05 2024-09-17T02:21:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054444+0000", 2024-09-17T02:21:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0250999999999997e-05 2024-09-17T02:21:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:40735 5.b 5:df8fd62b:::benchmark_data_smithi001_23533_object40734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:21:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:47.038253+0000", 2024-09-17T02:21:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.286802505000001, 2024-09-17T02:21:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016368369000000001, 2024-09-17T02:21:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 40735 2024-09-17T02:21:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038253+0000", 2024-09-17T02:21:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038253+0000", 2024-09-17T02:21:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038254+0000", 2024-09-17T02:21:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.23e-07 2024-09-17T02:21:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038420+0000", 2024-09-17T02:21:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016617499999999999 2024-09-17T02:21:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038432+0000", 2024-09-17T02:21:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1406000000000001e-05 2024-09-17T02:21:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.038439+0000", 2024-09-17T02:21:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7200000000000006e-06 2024-09-17T02:21:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.040422+0000", 2024-09-17T02:21:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019828530000000001 2024-09-17T02:21:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.040581+0000", 2024-09-17T02:21:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159238 2024-09-17T02:21:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.040744+0000", 2024-09-17T02:21:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016255800000000001 2024-09-17T02:21:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.041971+0000", 2024-09-17T02:21:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001226551 2024-09-17T02:21:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054500+0000", 2024-09-17T02:21:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012529676 2024-09-17T02:21:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054570+0000", 2024-09-17T02:21:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9253999999999998e-05 2024-09-17T02:21:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054622+0000", 2024-09-17T02:21:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2114999999999998e-05 2024-09-17T02:21:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:64220 5.4 5:27584da2:::benchmark_data_smithi001_23533_object64219:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-17T02:21:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:57.202813+0000", 2024-09-17T02:21:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.122243150999999, 2024-09-17T02:21:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019952102999999999, 2024-09-17T02:21:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 64220 2024-09-17T02:21:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.202813+0000", 2024-09-17T02:21:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.202813+0000", 2024-09-17T02:21:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.202813+0000", 2024-09-17T02:21:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0800000000000004e-07 2024-09-17T02:21:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.202879+0000", 2024-09-17T02:21:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5698999999999996e-05 2024-09-17T02:21:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.202887+0000", 2024-09-17T02:21:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3699999999999995e-06 2024-09-17T02:21:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.202892+0000", 2024-09-17T02:21:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7960000000000003e-06 2024-09-17T02:21:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.204623+0000", 2024-09-17T02:21:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017305179999999999 2024-09-17T02:21:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.204739+0000", 2024-09-17T02:21:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116439 2024-09-17T02:21:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.204846+0000", 2024-09-17T02:21:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107181 2024-09-17T02:21:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.207469+0000", 2024-09-17T02:21:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026227020000000002 2024-09-17T02:21:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.222690+0000", 2024-09-17T02:21:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015220798000000001 2024-09-17T02:21:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.222732+0000", 2024-09-17T02:21:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2552999999999997e-05 2024-09-17T02:21:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.222765+0000", 2024-09-17T02:21:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2339000000000003e-05 2024-09-17T02:21:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:70402 5.e 5:77b97f3b:::benchmark_data_smithi001_23533_object70401:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-17T02:21:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:00.105258+0000", 2024-09-17T02:21:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.2197979879999998, 2024-09-17T02:21:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016510609999999998, 2024-09-17T02:21:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 70402 2024-09-17T02:21:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.105258+0000", 2024-09-17T02:21:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.105258+0000", 2024-09-17T02:21:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.105258+0000", 2024-09-17T02:21:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4099999999999999e-07 2024-09-17T02:21:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.105288+0000", 2024-09-17T02:21:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9825999999999999e-05 2024-09-17T02:21:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.105295+0000", 2024-09-17T02:21:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.002e-06 2024-09-17T02:21:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.105301+0000", 2024-09-17T02:21:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7629999999999997e-06 2024-09-17T02:21:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.112762+0000", 2024-09-17T02:21:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0074614269999999996 2024-09-17T02:21:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.112873+0000", 2024-09-17T02:21:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011073600000000001 2024-09-17T02:21:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.112974+0000", 2024-09-17T02:21:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101013 2024-09-17T02:21:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.116051+0000", 2024-09-17T02:21:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003077336 2024-09-17T02:21:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.121661+0000", 2024-09-17T02:21:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056096590000000003 2024-09-17T02:21:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.121722+0000", 2024-09-17T02:21:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1084e-05 2024-09-17T02:21:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:00.121768+0000", 2024-09-17T02:21:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6322999999999997e-05 2024-09-17T02:21:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:71274 5.b 5:d2d56400:::benchmark_data_smithi001_23533_object71273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:04.626306+0000", 2024-09-17T02:21:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.6987496660000003, 2024-09-17T02:21:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017847371000000001, 2024-09-17T02:21:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 71274 2024-09-17T02:21:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.626306+0000", 2024-09-17T02:21:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.626306+0000", 2024-09-17T02:21:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.626308+0000", 2024-09-17T02:21:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9180000000000001e-06 2024-09-17T02:21:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.626380+0000", 2024-09-17T02:21:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2454999999999997e-05 2024-09-17T02:21:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.626402+0000", 2024-09-17T02:21:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2016000000000001e-05 2024-09-17T02:21:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.626414+0000", 2024-09-17T02:21:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1518999999999999e-05 2024-09-17T02:21:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.626505+0000", 2024-09-17T02:21:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1379999999999996e-05 2024-09-17T02:21:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.626638+0000", 2024-09-17T02:21:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013286600000000001 2024-09-17T02:21:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.626808+0000", 2024-09-17T02:21:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016948000000000001 2024-09-17T02:21:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.629520+0000", 2024-09-17T02:21:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00271244 2024-09-17T02:21:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.630073+0000", 2024-09-17T02:21:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055253300000000002 2024-09-17T02:21:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.643981+0000", 2024-09-17T02:21:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01390808 2024-09-17T02:21:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.644049+0000", 2024-09-17T02:21:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8528000000000005e-05 2024-09-17T02:21:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.644153+0000", 2024-09-17T02:21:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000104156 2024-09-17T02:21:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:72109 5.4 5:25717992:::benchmark_data_smithi001_23533_object72108:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:05.059585+0000", 2024-09-17T02:21:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.2654707460000001, 2024-09-17T02:21:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019702999999999998, 2024-09-17T02:21:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 72109 2024-09-17T02:21:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059585+0000", 2024-09-17T02:21:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059585+0000", 2024-09-17T02:21:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059586+0000", 2024-09-17T02:21:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.153e-06 2024-09-17T02:21:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059666+0000", 2024-09-17T02:21:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0093999999999996e-05 2024-09-17T02:21:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059677+0000", 2024-09-17T02:21:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0786e-05 2024-09-17T02:21:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059684+0000", 2024-09-17T02:21:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0729999999999999e-06 2024-09-17T02:21:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.069850+0000", 2024-09-17T02:21:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010165560000000001 2024-09-17T02:21:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.069997+0000", 2024-09-17T02:21:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014692000000000001 2024-09-17T02:21:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.070176+0000", 2024-09-17T02:21:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000179774 2024-09-17T02:21:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079031+0000", 2024-09-17T02:21:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0088549119999999995 2024-09-17T02:21:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079085+0000", 2024-09-17T02:21:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3588999999999998e-05 2024-09-17T02:21:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079155+0000", 2024-09-17T02:21:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0166999999999994e-05 2024-09-17T02:21:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079196+0000", 2024-09-17T02:21:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0964999999999998e-05 2024-09-17T02:21:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079288+0000", 2024-09-17T02:21:09.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2007000000000002e-05 2024-09-17T02:21:09.430 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.430 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:09.430 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.430 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:72113 5.4 5:22c8dcc1:::benchmark_data_smithi001_23533_object72112:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:09.430 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:05.059974+0000", 2024-09-17T02:21:09.430 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.2650816450000004, 2024-09-17T02:21:09.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022437694000000001, 2024-09-17T02:21:09.430 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:09.430 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:09.431 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:09.431 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:09.431 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:09.431 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:09.431 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 72113 2024-09-17T02:21:09.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.431 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:09.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:09.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059974+0000", 2024-09-17T02:21:09.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:09.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059974+0000", 2024-09-17T02:21:09.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:09.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059975+0000", 2024-09-17T02:21:09.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6600000000000005e-07 2024-09-17T02:21:09.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:09.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.060002+0000", 2024-09-17T02:21:09.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6602e-05 2024-09-17T02:21:09.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:09.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.060011+0000", 2024-09-17T02:21:09.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4730000000000006e-06 2024-09-17T02:21:09.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.060017+0000", 2024-09-17T02:21:09.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.331e-06 2024-09-17T02:21:09.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:09.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.072282+0000", 2024-09-17T02:21:09.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012264126 2024-09-17T02:21:09.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:09.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.072461+0000", 2024-09-17T02:21:09.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017923700000000001 2024-09-17T02:21:09.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:09.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.072656+0000", 2024-09-17T02:21:09.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000195735 2024-09-17T02:21:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079382+0000", 2024-09-17T02:21:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067256529999999998 2024-09-17T02:21:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.082111+0000", 2024-09-17T02:21:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027287040000000002 2024-09-17T02:21:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.082229+0000", 2024-09-17T02:21:09.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118168 2024-09-17T02:21:09.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:09.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.082308+0000", 2024-09-17T02:21:09.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8888999999999996e-05 2024-09-17T02:21:09.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:09.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.082412+0000", 2024-09-17T02:21:09.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010391 2024-09-17T02:21:09.436 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.437 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:09.437 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.437 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:72123 5.4 5:2546f78a:::benchmark_data_smithi001_23533_object72122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:09.437 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:05.063089+0000", 2024-09-17T02:21:09.437 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.2619671390000002, 2024-09-17T02:21:09.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019591450999999999, 2024-09-17T02:21:09.437 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:09.437 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:09.437 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:09.437 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:09.437 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:09.438 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:09.438 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 72123 2024-09-17T02:21:09.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.438 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:09.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:09.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.063089+0000", 2024-09-17T02:21:09.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:09.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.063089+0000", 2024-09-17T02:21:09.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:09.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.063090+0000", 2024-09-17T02:21:09.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1829999999999999e-06 2024-09-17T02:21:09.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:09.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.063205+0000", 2024-09-17T02:21:09.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115634 2024-09-17T02:21:09.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:09.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.063217+0000", 2024-09-17T02:21:09.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.202e-05 2024-09-17T02:21:09.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.063226+0000", 2024-09-17T02:21:09.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5469999999999997e-06 2024-09-17T02:21:09.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:09.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.074475+0000", 2024-09-17T02:21:09.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01124874 2024-09-17T02:21:09.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:09.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.074639+0000", 2024-09-17T02:21:09.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000164537 2024-09-17T02:21:09.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:09.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.074772+0000", 2024-09-17T02:21:09.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013228599999999999 2024-09-17T02:21:09.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:09.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079387+0000", 2024-09-17T02:21:09.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046156239999999996 2024-09-17T02:21:09.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:09.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.082173+0000", 2024-09-17T02:21:09.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027856030000000002 2024-09-17T02:21:09.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:09.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.082483+0000", 2024-09-17T02:21:09.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031013699999999999 2024-09-17T02:21:09.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:09.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.082548+0000", 2024-09-17T02:21:09.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4745000000000004e-05 2024-09-17T02:21:09.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:09.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.082680+0000", 2024-09-17T02:21:09.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000132395 2024-09-17T02:21:09.443 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.443 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:09.444 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.444 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:72133 5.4 5:2e38f4b5:::benchmark_data_smithi001_23533_object72132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:09.444 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:05.070228+0000", 2024-09-17T02:21:09.444 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.2548282119999996, 2024-09-17T02:21:09.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019598082999999999, 2024-09-17T02:21:09.445 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:09.445 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:09.445 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:09.445 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:09.445 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:09.445 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:09.445 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 72133 2024-09-17T02:21:09.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.445 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:09.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:09.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.070228+0000", 2024-09-17T02:21:09.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:09.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.070228+0000", 2024-09-17T02:21:09.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:09.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:09.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.070228+0000", 2024-09-17T02:21:09.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7599999999999998e-07 2024-09-17T02:21:09.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:09.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.070266+0000", 2024-09-17T02:21:09.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8498000000000003e-05 2024-09-17T02:21:09.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:09.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.070272+0000", 2024-09-17T02:21:09.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4149999999999998e-06 2024-09-17T02:21:09.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.070278+0000", 2024-09-17T02:21:09.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.083e-06 2024-09-17T02:21:09.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:09.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079437+0000", 2024-09-17T02:21:09.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0091590249999999995 2024-09-17T02:21:09.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:09.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079611+0000", 2024-09-17T02:21:09.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000173878 2024-09-17T02:21:09.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:09.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079789+0000", 2024-09-17T02:21:09.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017836699999999999 2024-09-17T02:21:09.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:09.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.082696+0000", 2024-09-17T02:21:09.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029069080000000001 2024-09-17T02:21:09.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:09.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.083065+0000", 2024-09-17T02:21:09.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036905899999999998 2024-09-17T02:21:09.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:09.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.089624+0000", 2024-09-17T02:21:09.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0065584809999999997 2024-09-17T02:21:09.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:09.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.089697+0000", 2024-09-17T02:21:09.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3815999999999999e-05 2024-09-17T02:21:09.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:09.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:09.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:09.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.089826+0000", 2024-09-17T02:21:09.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012817699999999999 2024-09-17T02:21:09.450 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.451 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:09.451 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.451 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:09.451 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:09.451 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:09.452 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:09.454+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:09.453 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:09.497 INFO:teuthology.orchestra.run.smithi001.stderr:set 4.1d pg_upmap mapping to [0,1] 2024-09-17T02:21:09.498 INFO:teuthology.orchestra.run.smithi001.stderr:nodeep-scrub is set 2024-09-17T02:21:09.553 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:09.554+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:09.614 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.615 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:81591 5.2 e41/22 5:40f308ce:::benchmark_data_smithi001_23533_object81590:head v 41'5152, mlcod=41'5149)", 2024-09-17T02:21:09.615 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:09.609843+0000", 2024-09-17T02:21:09.615 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0087784200000000003, 2024-09-17T02:21:09.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0087998320000000005, 2024-09-17T02:21:09.615 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:09.615 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:09.615 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:09.615 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:09.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:09.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.609843+0000", 2024-09-17T02:21:09.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:09.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.609843+0000", 2024-09-17T02:21:09.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:09.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.609843+0000", 2024-09-17T02:21:09.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5499999999999998e-07 2024-09-17T02:21:09.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:09.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.609937+0000", 2024-09-17T02:21:09.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3614000000000002e-05 2024-09-17T02:21:09.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:09.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.609944+0000", 2024-09-17T02:21:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.781e-06 2024-09-17T02:21:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.609948+0000", 2024-09-17T02:21:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4750000000000004e-06 2024-09-17T02:21:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.613237+0000", 2024-09-17T02:21:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003288839 2024-09-17T02:21:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.613255+0000", 2024-09-17T02:21:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8016000000000002e-05 2024-09-17T02:21:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:81595 5.5 5:a8e7f822:::benchmark_data_smithi001_23533_object81594:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-17T02:21:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:09.610651+0000", 2024-09-17T02:21:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0079702330000000002, 2024-09-17T02:21:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0080572930000000001, 2024-09-17T02:21:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 81595 2024-09-17T02:21:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.610651+0000", 2024-09-17T02:21:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:09.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.610651+0000", 2024-09-17T02:21:09.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:09.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.610652+0000", 2024-09-17T02:21:09.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9400000000000004e-07 2024-09-17T02:21:09.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:09.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.610788+0000", 2024-09-17T02:21:09.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000135864 2024-09-17T02:21:09.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:09.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.610798+0000", 2024-09-17T02:21:09.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0454e-05 2024-09-17T02:21:09.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.610805+0000", 2024-09-17T02:21:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7179999999999999e-06 2024-09-17T02:21:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.610859+0000", 2024-09-17T02:21:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3705999999999997e-05 2024-09-17T02:21:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.610979+0000", 2024-09-17T02:21:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012012599999999999 2024-09-17T02:21:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:09.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.611101+0000", 2024-09-17T02:21:09.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012224100000000001 2024-09-17T02:21:09.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:09.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.615619+0000", 2024-09-17T02:21:09.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045177050000000003 2024-09-17T02:21:09.624 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.624 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:09.624 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:81596 5.a 5:5ff636d4:::benchmark_data_smithi001_23533_object81595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-17T02:21:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:09.610823+0000", 2024-09-17T02:21:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0077983469999999997, 2024-09-17T02:21:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079755350000000006, 2024-09-17T02:21:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 81596 2024-09-17T02:21:09.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.626 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:09.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:09.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.610823+0000", 2024-09-17T02:21:09.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:09.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.610823+0000", 2024-09-17T02:21:09.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.610824+0000", 2024-09-17T02:21:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0699999999999997e-07 2024-09-17T02:21:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.610886+0000", 2024-09-17T02:21:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1839000000000002e-05 2024-09-17T02:21:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.610894+0000", 2024-09-17T02:21:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1510000000000004e-06 2024-09-17T02:21:09.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.610899+0000", 2024-09-17T02:21:09.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4310000000000002e-06 2024-09-17T02:21:09.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:09.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.614803+0000", 2024-09-17T02:21:09.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003904355 2024-09-17T02:21:09.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.614934+0000", 2024-09-17T02:21:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130853 2024-09-17T02:21:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.615091+0000", 2024-09-17T02:21:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015709 2024-09-17T02:21:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.630 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:81598 5.5 5:aeb18435:::benchmark_data_smithi001_23533_object81597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-17T02:21:09.630 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:09.611369+0000", 2024-09-17T02:21:09.630 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0072524260000000002, 2024-09-17T02:21:09.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.007509221, 2024-09-17T02:21:09.630 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:09.630 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:09.630 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:09.630 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:09.630 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:09.630 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:09.630 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 81598 2024-09-17T02:21:09.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.611369+0000", 2024-09-17T02:21:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.611369+0000", 2024-09-17T02:21:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.611370+0000", 2024-09-17T02:21:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.47e-07 2024-09-17T02:21:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.611644+0000", 2024-09-17T02:21:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027373600000000001 2024-09-17T02:21:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.611655+0000", 2024-09-17T02:21:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.128e-05 2024-09-17T02:21:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.611662+0000", 2024-09-17T02:21:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3100000000000003e-06 2024-09-17T02:21:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.613439+0000", 2024-09-17T02:21:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017770850000000001 2024-09-17T02:21:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:09.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.613556+0000", 2024-09-17T02:21:09.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000116505 2024-09-17T02:21:09.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:09.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.613672+0000", 2024-09-17T02:21:09.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000115969 2024-09-17T02:21:09.634 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.634 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:09.634 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.634 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:81600 5.4 e41/36 5:2adb8db1:::benchmark_data_smithi001_23533_object81599:head v 41'4985, mlcod=41'4983)", 2024-09-17T02:21:09.635 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:09.612318+0000", 2024-09-17T02:21:09.635 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0063031509999999999, 2024-09-17T02:21:09.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066138200000000003, 2024-09-17T02:21:09.635 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:09.635 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:09.635 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:09.635 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:09.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:09.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.612318+0000", 2024-09-17T02:21:09.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:09.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.612318+0000", 2024-09-17T02:21:09.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:09.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.612319+0000", 2024-09-17T02:21:09.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6800000000000001e-07 2024-09-17T02:21:09.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:09.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.612378+0000", 2024-09-17T02:21:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8900000000000002e-05 2024-09-17T02:21:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.612386+0000", 2024-09-17T02:21:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9170000000000006e-06 2024-09-17T02:21:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.612391+0000", 2024-09-17T02:21:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1229999999999999e-06 2024-09-17T02:21:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.612447+0000", 2024-09-17T02:21:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5804000000000003e-05 2024-09-17T02:21:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.612467+0000", 2024-09-17T02:21:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0288e-05 2024-09-17T02:21:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:81601 5.b e41/38 5:db62840a:::benchmark_data_smithi001_23533_object81600:head v 41'5034, mlcod=41'5032)", 2024-09-17T02:21:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:09.614048+0000", 2024-09-17T02:21:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.004573728, 2024-09-17T02:21:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049144319999999998, 2024-09-17T02:21:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.614048+0000", 2024-09-17T02:21:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.614048+0000", 2024-09-17T02:21:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.614048+0000", 2024-09-17T02:21:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7999999999999995e-07 2024-09-17T02:21:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.614104+0000", 2024-09-17T02:21:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5272000000000002e-05 2024-09-17T02:21:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.614112+0000", 2024-09-17T02:21:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8890000000000008e-06 2024-09-17T02:21:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.614120+0000", 2024-09-17T02:21:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8970000000000008e-06 2024-09-17T02:21:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.614167+0000", 2024-09-17T02:21:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6811000000000003e-05 2024-09-17T02:21:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.614189+0000", 2024-09-17T02:21:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1552e-05 2024-09-17T02:21:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:81602 5.5 5:ac4fb028:::benchmark_data_smithi001_23533_object81601:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-17T02:21:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:09.614218+0000", 2024-09-17T02:21:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0044031890000000001, 2024-09-17T02:21:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047762179999999996, 2024-09-17T02:21:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 81602 2024-09-17T02:21:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.614218+0000", 2024-09-17T02:21:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.614218+0000", 2024-09-17T02:21:09.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:09.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.614219+0000", 2024-09-17T02:21:09.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1930000000000001e-06 2024-09-17T02:21:09.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:09.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.614321+0000", 2024-09-17T02:21:09.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101357 2024-09-17T02:21:09.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:09.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.614329+0000", 2024-09-17T02:21:09.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5799999999999992e-06 2024-09-17T02:21:09.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.614336+0000", 2024-09-17T02:21:09.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.934e-06 2024-09-17T02:21:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.615645+0000", 2024-09-17T02:21:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013090910000000001 2024-09-17T02:21:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.615768+0000", 2024-09-17T02:21:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012226000000000001 2024-09-17T02:21:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.615899+0000", 2024-09-17T02:21:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131397 2024-09-17T02:21:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:81603 5.a 5.7b8ff4ba (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-17T02:21:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:09.614354+0000", 2024-09-17T02:21:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0042677799999999997, 2024-09-17T02:21:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046788699999999999, 2024-09-17T02:21:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 81603 2024-09-17T02:21:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.614354+0000", 2024-09-17T02:21:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:09.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.614354+0000", 2024-09-17T02:21:09.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:09.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.614354+0000", 2024-09-17T02:21:09.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3600000000000004e-07 2024-09-17T02:21:09.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:09.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.614432+0000", 2024-09-17T02:21:09.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7694999999999994e-05 2024-09-17T02:21:09.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:09.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.614439+0000", 2024-09-17T02:21:09.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8619999999999997e-06 2024-09-17T02:21:09.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.614445+0000", 2024-09-17T02:21:09.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9379999999999997e-06 2024-09-17T02:21:09.650 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.650 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:09.650 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.651 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4466.0:81595 5.5 e41/22)", 2024-09-17T02:21:09.651 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:09.616401+0000", 2024-09-17T02:21:09.651 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0022200919999999999, 2024-09-17T02:21:09.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026574469999999998, 2024-09-17T02:21:09.651 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:09.651 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:09.651 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:09.651 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:09.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:09.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.616401+0000", 2024-09-17T02:21:09.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:09.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.616401+0000", 2024-09-17T02:21:09.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:09.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.616402+0000", 2024-09-17T02:21:09.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4399999999999999e-07 2024-09-17T02:21:09.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:09.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.616407+0000", 2024-09-17T02:21:09.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9189999999999998e-06 2024-09-17T02:21:09.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:09.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.616416+0000", 2024-09-17T02:21:09.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6910000000000003e-06 2024-09-17T02:21:09.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.616422+0000", 2024-09-17T02:21:09.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0499999999999997e-06 2024-09-17T02:21:09.653 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.653 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:09.654 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.654 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:81583 5.a 5:5cc4d99b:::benchmark_data_smithi001_23533_object81582:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-17T02:21:09.654 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:09.604507+0000", 2024-09-17T02:21:09.654 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.014114211999999999, 2024-09-17T02:21:09.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014578575999999999, 2024-09-17T02:21:09.654 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:09.654 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:09.654 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:09.654 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:09.654 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:09.654 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:09.654 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 81583 2024-09-17T02:21:09.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.655 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:09.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:09.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.604507+0000", 2024-09-17T02:21:09.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:09.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.604507+0000", 2024-09-17T02:21:09.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:09.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.604508+0000", 2024-09-17T02:21:09.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5400000000000001e-07 2024-09-17T02:21:09.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:09.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.604567+0000", 2024-09-17T02:21:09.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9463000000000003e-05 2024-09-17T02:21:09.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:09.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.604574+0000", 2024-09-17T02:21:09.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.849e-06 2024-09-17T02:21:09.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.604578+0000", 2024-09-17T02:21:09.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0389999999999998e-06 2024-09-17T02:21:09.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:09.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.604625+0000", 2024-09-17T02:21:09.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7228999999999998e-05 2024-09-17T02:21:09.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:09.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.604741+0000", 2024-09-17T02:21:09.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000116103 2024-09-17T02:21:09.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:09.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.604869+0000", 2024-09-17T02:21:09.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012714599999999999 2024-09-17T02:21:09.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:09.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.611424+0000", 2024-09-17T02:21:09.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0065551849999999998 2024-09-17T02:21:09.659 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.659 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:09.659 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.659 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:81606 5.c 5:320e714d:::benchmark_data_smithi001_23533_object81605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-17T02:21:09.659 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:09.616932+0000", 2024-09-17T02:21:09.659 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001689585, 2024-09-17T02:21:09.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021944690000000001, 2024-09-17T02:21:09.659 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:09.660 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:09.660 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:09.660 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:09.660 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:09.660 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:09.660 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 81606 2024-09-17T02:21:09.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.660 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:09.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:09.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.616932+0000", 2024-09-17T02:21:09.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:09.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.616932+0000", 2024-09-17T02:21:09.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:09.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.616933+0000", 2024-09-17T02:21:09.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1100000000000004e-07 2024-09-17T02:21:09.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:09.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.617011+0000", 2024-09-17T02:21:09.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8077999999999993e-05 2024-09-17T02:21:09.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:09.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.617020+0000", 2024-09-17T02:21:09.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.516e-06 2024-09-17T02:21:09.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.617025+0000", 2024-09-17T02:21:09.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0119999999999996e-06 2024-09-17T02:21:09.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:09.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.617061+0000", 2024-09-17T02:21:09.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5816999999999999e-05 2024-09-17T02:21:09.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:09.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.617144+0000", 2024-09-17T02:21:09.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2670999999999995e-05 2024-09-17T02:21:09.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:09.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.617217+0000", 2024-09-17T02:21:09.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2867999999999994e-05 2024-09-17T02:21:09.663 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.664 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:09.664 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.664 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4466.0:81596 5.a e41/22)", 2024-09-17T02:21:09.664 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:09.617783+0000", 2024-09-17T02:21:09.664 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00083815300000000001, 2024-09-17T02:21:09.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001384857, 2024-09-17T02:21:09.664 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:09.664 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:09.664 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:09.664 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:09.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:09.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.617783+0000", 2024-09-17T02:21:09.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:09.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.617783+0000", 2024-09-17T02:21:09.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:09.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.617784+0000", 2024-09-17T02:21:09.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:21:09.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:09.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.617787+0000", 2024-09-17T02:21:09.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3610000000000001e-06 2024-09-17T02:21:09.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:09.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.617797+0000", 2024-09-17T02:21:09.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0069e-05 2024-09-17T02:21:09.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.617803+0000", 2024-09-17T02:21:09.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9780000000000002e-06 2024-09-17T02:21:09.667 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.667 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:09.667 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.667 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:81607 5.1 e41/36 5:865ae68b:::benchmark_data_smithi001_23533_object81606:head v 41'5059, mlcod=41'5057)", 2024-09-17T02:21:09.667 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:09.618020+0000", 2024-09-17T02:21:09.667 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00060169200000000003, 2024-09-17T02:21:09.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011947080000000001, 2024-09-17T02:21:09.667 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:09.667 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:09.667 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:09.667 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:09.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:09.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.618020+0000", 2024-09-17T02:21:09.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:09.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.618020+0000", 2024-09-17T02:21:09.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:09.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.618020+0000", 2024-09-17T02:21:09.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6599999999999996e-07 2024-09-17T02:21:09.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:09.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.618080+0000", 2024-09-17T02:21:09.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9212999999999997e-05 2024-09-17T02:21:09.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:09.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.618088+0000", 2024-09-17T02:21:09.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3529999999999995e-06 2024-09-17T02:21:09.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.618093+0000", 2024-09-17T02:21:09.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8250000000000004e-06 2024-09-17T02:21:09.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:09.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.618131+0000", 2024-09-17T02:21:09.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8751999999999998e-05 2024-09-17T02:21:09.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:09.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.618146+0000", 2024-09-17T02:21:09.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4399000000000001e-05 2024-09-17T02:21:09.671 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.671 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:09.671 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.671 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:81584 5.a 5:5fe7cf4f:::benchmark_data_smithi001_23533_object81583:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-17T02:21:09.671 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:09.606170+0000", 2024-09-17T02:21:09.671 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.012451758, 2024-09-17T02:21:09.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013102047, 2024-09-17T02:21:09.671 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:09.671 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:09.671 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:09.672 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:09.672 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:09.672 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:09.672 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 81584 2024-09-17T02:21:09.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.672 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:09.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:09.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.606170+0000", 2024-09-17T02:21:09.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:09.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.606170+0000", 2024-09-17T02:21:09.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:09.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.606170+0000", 2024-09-17T02:21:09.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9100000000000003e-07 2024-09-17T02:21:09.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:09.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.606292+0000", 2024-09-17T02:21:09.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000121865 2024-09-17T02:21:09.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:09.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.606309+0000", 2024-09-17T02:21:09.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6305000000000001e-05 2024-09-17T02:21:09.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.606315+0000", 2024-09-17T02:21:09.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5089999999999999e-06 2024-09-17T02:21:09.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:09.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.609001+0000", 2024-09-17T02:21:09.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026860180000000001 2024-09-17T02:21:09.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:09.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.609096+0000", 2024-09-17T02:21:09.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4718999999999999e-05 2024-09-17T02:21:09.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:09.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.609200+0000", 2024-09-17T02:21:09.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103941 2024-09-17T02:21:09.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:09.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.614773+0000", 2024-09-17T02:21:09.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055728560000000002 2024-09-17T02:21:09.675 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.676 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:09.676 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.676 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:81586 5.2 e41/22 5:4cb6677e:::benchmark_data_smithi001_23533_object81585:head v 41'5151, mlcod=41'5149)", 2024-09-17T02:21:09.676 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:09.607566+0000", 2024-09-17T02:21:09.676 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.011055871, 2024-09-17T02:21:09.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011751863, 2024-09-17T02:21:09.676 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:09.676 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:09.676 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:09.676 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:09.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:09.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.607566+0000", 2024-09-17T02:21:09.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:09.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.607566+0000", 2024-09-17T02:21:09.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:09.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:09.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.607566+0000", 2024-09-17T02:21:09.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2799999999999995e-07 2024-09-17T02:21:09.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:09.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.607623+0000", 2024-09-17T02:21:09.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6421000000000001e-05 2024-09-17T02:21:09.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:09.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.607633+0000", 2024-09-17T02:21:09.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9569999999999997e-06 2024-09-17T02:21:09.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:09.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.607640+0000", 2024-09-17T02:21:09.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1069999999999999e-06 2024-09-17T02:21:09.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:09.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.611396+0000", 2024-09-17T02:21:09.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037566499999999998 2024-09-17T02:21:09.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:09.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:09.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:09.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:09.611413+0000", 2024-09-17T02:21:09.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6239000000000002e-05 2024-09-17T02:21:09.681 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.681 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:09.681 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.681 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:09.681 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:21:09.681 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 15 2024-09-17T02:21:09.681 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:09.683 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:09.683 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:09.682+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:09.772 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 37 16 81950 81934 138.387 129.625 0.00824522 0.0072215 2024-09-17T02:21:09.782 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:09.783+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:09.880 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:09.880 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:21:09.880 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:21:09.880 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:21:09.880 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:09.885 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:09.887+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:09.901 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:09.985 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:09.987+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:10.059 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:10.059 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:21:10.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:21:10.059 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:10.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.060 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:10.060 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:21:10.060 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.500607350999999, 2024-09-17T02:21:10.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021799929999999999, 2024-09-17T02:21:10.060 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:10.060 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:10.060 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:10.060 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:10.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:10.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:21:10.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:10.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:21:10.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:10.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562007+0000", 2024-09-17T02:21:10.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6260000000000001e-06 2024-09-17T02:21:10.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562021+0000", 2024-09-17T02:21:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4440000000000001e-05 2024-09-17T02:21:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562053+0000", 2024-09-17T02:21:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2159000000000002e-05 2024-09-17T02:21:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562076+0000", 2024-09-17T02:21:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2926999999999999e-05 2024-09-17T02:21:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562218+0000", 2024-09-17T02:21:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000141726 2024-09-17T02:21:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562506+0000", 2024-09-17T02:21:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028752399999999999 2024-09-17T02:21:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:10.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562830+0000", 2024-09-17T02:21:10.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032427399999999999 2024-09-17T02:21:10.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:10.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566900+0000", 2024-09-17T02:21:10.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040705660000000003 2024-09-17T02:21:10.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:10.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583581+0000", 2024-09-17T02:21:10.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016680210000000001 2024-09-17T02:21:10.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583704+0000", 2024-09-17T02:21:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012289899999999999 2024-09-17T02:21:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583803+0000", 2024-09-17T02:21:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9579000000000003e-05 2024-09-17T02:21:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:21:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.500480138999997, 2024-09-17T02:21:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022056035000000002, 2024-09-17T02:21:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:21:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:10.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:21:10.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:10.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562132+0000", 2024-09-17T02:21:10.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6300000000000001e-06 2024-09-17T02:21:10.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562142+0000", 2024-09-17T02:21:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.022e-05 2024-09-17T02:21:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562164+0000", 2024-09-17T02:21:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2002999999999999e-05 2024-09-17T02:21:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562180+0000", 2024-09-17T02:21:10.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5930000000000002e-05 2024-09-17T02:21:10.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:10.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563517+0000", 2024-09-17T02:21:10.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001336776 2024-09-17T02:21:10.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:10.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563635+0000", 2024-09-17T02:21:10.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117976 2024-09-17T02:21:10.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:10.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563819+0000", 2024-09-17T02:21:10.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018411499999999999 2024-09-17T02:21:10.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:10.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566977+0000", 2024-09-17T02:21:10.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031575990000000001 2024-09-17T02:21:10.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:10.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583917+0000", 2024-09-17T02:21:10.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016940093999999999 2024-09-17T02:21:10.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:10.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584066+0000", 2024-09-17T02:21:10.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000149746 2024-09-17T02:21:10.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:10.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584186+0000", 2024-09-17T02:21:10.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011994600000000001 2024-09-17T02:21:10.073 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.073 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.500299427999998, 2024-09-17T02:21:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023664803000000002, 2024-09-17T02:21:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562313+0000", 2024-09-17T02:21:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.764e-06 2024-09-17T02:21:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562323+0000", 2024-09-17T02:21:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0166000000000001e-05 2024-09-17T02:21:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562343+0000", 2024-09-17T02:21:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9633999999999999e-05 2024-09-17T02:21:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562367+0000", 2024-09-17T02:21:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4556e-05 2024-09-17T02:21:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:10.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563777+0000", 2024-09-17T02:21:10.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014102330000000001 2024-09-17T02:21:10.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:10.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563969+0000", 2024-09-17T02:21:10.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000191361 2024-09-17T02:21:10.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:10.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564148+0000", 2024-09-17T02:21:10.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017934599999999999 2024-09-17T02:21:10.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:10.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566989+0000", 2024-09-17T02:21:10.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028407010000000002 2024-09-17T02:21:10.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:10.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585770+0000", 2024-09-17T02:21:10.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018781566999999999 2024-09-17T02:21:10.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:10.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585874+0000", 2024-09-17T02:21:10.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103489 2024-09-17T02:21:10.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:10.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585976+0000", 2024-09-17T02:21:10.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101986 2024-09-17T02:21:10.081 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.081 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:10.081 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.081 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:10.082 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:10.082 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.500216547999997, 2024-09-17T02:21:10.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024118555999999999, 2024-09-17T02:21:10.082 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:10.083 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:10.083 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:10.083 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:10.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:10.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:10.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:10.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:10.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:10.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562395+0000", 2024-09-17T02:21:10.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3969999999999999e-06 2024-09-17T02:21:10.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:10.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562405+0000", 2024-09-17T02:21:10.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4229999999999994e-06 2024-09-17T02:21:10.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:10.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562427+0000", 2024-09-17T02:21:10.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759999999999998e-05 2024-09-17T02:21:10.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562444+0000", 2024-09-17T02:21:10.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7019000000000001e-05 2024-09-17T02:21:10.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:10.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564681+0000", 2024-09-17T02:21:10.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022376929999999998 2024-09-17T02:21:10.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:10.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564887+0000", 2024-09-17T02:21:10.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000206178 2024-09-17T02:21:10.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:10.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565230+0000", 2024-09-17T02:21:10.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034233499999999998 2024-09-17T02:21:10.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:10.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567000+0000", 2024-09-17T02:21:10.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017706390000000001 2024-09-17T02:21:10.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586126+0000", 2024-09-17T02:21:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019125672 2024-09-17T02:21:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586314+0000", 2024-09-17T02:21:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018740200000000001 2024-09-17T02:21:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586513+0000", 2024-09-17T02:21:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019903799999999999 2024-09-17T02:21:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:21:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.500141874999997, 2024-09-17T02:21:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021940779000000001, 2024-09-17T02:21:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:10.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:10.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:21:10.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:21:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562470+0000", 2024-09-17T02:21:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5030000000000001e-06 2024-09-17T02:21:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:10.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562478+0000", 2024-09-17T02:21:10.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.157e-06 2024-09-17T02:21:10.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:10.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562496+0000", 2024-09-17T02:21:10.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7876e-05 2024-09-17T02:21:10.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562511+0000", 2024-09-17T02:21:10.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5067e-05 2024-09-17T02:21:10.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:10.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564628+0000", 2024-09-17T02:21:10.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021171860000000001 2024-09-17T02:21:10.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:10.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564838+0000", 2024-09-17T02:21:10.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000209283 2024-09-17T02:21:10.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:10.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565078+0000", 2024-09-17T02:21:10.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024075100000000001 2024-09-17T02:21:10.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:10.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567012+0000", 2024-09-17T02:21:10.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019331050000000001 2024-09-17T02:21:10.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:10.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584289+0000", 2024-09-17T02:21:10.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017277464999999999 2024-09-17T02:21:10.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:10.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584363+0000", 2024-09-17T02:21:10.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3852999999999999e-05 2024-09-17T02:21:10.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:10.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584409+0000", 2024-09-17T02:21:10.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6533000000000003e-05 2024-09-17T02:21:10.098 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.098 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:10.098 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.098 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:10.098 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:21:10.098 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.500078486, 2024-09-17T02:21:10.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020580694, 2024-09-17T02:21:10.098 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:10.098 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:21:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:21:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:10.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562533+0000", 2024-09-17T02:21:10.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3239999999999999e-06 2024-09-17T02:21:10.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:10.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562541+0000", 2024-09-17T02:21:10.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3529999999999997e-06 2024-09-17T02:21:10.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:10.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562559+0000", 2024-09-17T02:21:10.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8306000000000001e-05 2024-09-17T02:21:10.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562572+0000", 2024-09-17T02:21:10.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2993000000000001e-05 2024-09-17T02:21:10.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:10.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563230+0000", 2024-09-17T02:21:10.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00065806899999999995 2024-09-17T02:21:10.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:10.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563510+0000", 2024-09-17T02:21:10.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028016400000000001 2024-09-17T02:21:10.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:10.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563677+0000", 2024-09-17T02:21:10.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000166243 2024-09-17T02:21:10.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:10.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566312+0000", 2024-09-17T02:21:10.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026351349999999998 2024-09-17T02:21:10.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:10.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.582943+0000", 2024-09-17T02:21:10.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016631781000000002 2024-09-17T02:21:10.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:10.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583035+0000", 2024-09-17T02:21:10.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1682999999999996e-05 2024-09-17T02:21:10.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:10.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583113+0000", 2024-09-17T02:21:10.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7643000000000002e-05 2024-09-17T02:21:10.105 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.105 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:10.105 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:21:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.499971426000002, 2024-09-17T02:21:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020802284000000001, 2024-09-17T02:21:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:21:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:21:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562640+0000", 2024-09-17T02:21:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.37e-06 2024-09-17T02:21:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562648+0000", 2024-09-17T02:21:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.576e-06 2024-09-17T02:21:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562668+0000", 2024-09-17T02:21:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0397000000000001e-05 2024-09-17T02:21:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562690+0000", 2024-09-17T02:21:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1713e-05 2024-09-17T02:21:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564290+0000", 2024-09-17T02:21:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001599397 2024-09-17T02:21:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564527+0000", 2024-09-17T02:21:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023731199999999999 2024-09-17T02:21:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583441+0000", 2024-09-17T02:21:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018914519000000001 2024-09-17T02:21:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:21:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.499896350999997, 2024-09-17T02:21:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021867154, 2024-09-17T02:21:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:21:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:21:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562716+0000", 2024-09-17T02:21:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.384e-06 2024-09-17T02:21:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562726+0000", 2024-09-17T02:21:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.04e-05 2024-09-17T02:21:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562745+0000", 2024-09-17T02:21:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8770000000000002e-05 2024-09-17T02:21:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562759+0000", 2024-09-17T02:21:10.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4392999999999999e-05 2024-09-17T02:21:10.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:10.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565882+0000", 2024-09-17T02:21:10.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031227659999999999 2024-09-17T02:21:10.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:10.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566217+0000", 2024-09-17T02:21:10.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033498000000000002 2024-09-17T02:21:10.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:10.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584581+0000", 2024-09-17T02:21:10.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018364460999999999 2024-09-17T02:21:10.114 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.114 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:10.114 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.494147443999999, 2024-09-17T02:21:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:21:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:21:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:10.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:10.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:10.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:10.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:10.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:10.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:21:10.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:21:10.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:10.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:21:10.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:21:10.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:21:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:21:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:21:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:21:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:21:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:21:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:21:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:21:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:21:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:21:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:21:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:21:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:21:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:21:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:21:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:21:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:10.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:21:10.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:21:10.122 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.122 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:10.122 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.122 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:10.122 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:10.122 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.490245194, 2024-09-17T02:21:10.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:21:10.122 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:10.122 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:10.122 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:10.123 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:10.123 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:10.123 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:10.123 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:21:10.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.123 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:10.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:10.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:10.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:10.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:10.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:10.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:21:10.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:21:10.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:10.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:21:10.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:21:10.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:10.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:21:10.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:21:10.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:21:10.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:21:10.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:10.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:21:10.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:21:10.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:10.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:21:10.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:21:10.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:10.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:21:10.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:21:10.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:10.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:21:10.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:21:10.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:10.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:21:10.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:21:10.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:10.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:21:10.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:21:10.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:10.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:21:10.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:21:10.128 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.128 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:10.128 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.128 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71190 5.3 e39/38 5:c99e0ae2:::benchmark_data_smithi001_23533_object71189:head v 39'4516, mlcod=35'4513)", 2024-09-17T02:21:10.128 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.607413+0000", 2024-09-17T02:21:10.128 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.4551971699999999, 2024-09-17T02:21:10.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023407462, 2024-09-17T02:21:10.129 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:10.129 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:10.129 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:10.129 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:10.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:10.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607413+0000", 2024-09-17T02:21:10.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:10.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607413+0000", 2024-09-17T02:21:10.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:10.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607415+0000", 2024-09-17T02:21:10.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2139999999999999e-06 2024-09-17T02:21:10.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:10.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607479+0000", 2024-09-17T02:21:10.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4374000000000004e-05 2024-09-17T02:21:10.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:10.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607496+0000", 2024-09-17T02:21:10.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6820000000000002e-05 2024-09-17T02:21:10.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607512+0000", 2024-09-17T02:21:10.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5976000000000001e-05 2024-09-17T02:21:10.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:10.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609288+0000", 2024-09-17T02:21:10.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001776311 2024-09-17T02:21:10.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:10.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609327+0000", 2024-09-17T02:21:10.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9165999999999997e-05 2024-09-17T02:21:10.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:10.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630723+0000", 2024-09-17T02:21:10.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021395290000000001 2024-09-17T02:21:10.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:10.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630821+0000", 2024-09-17T02:21:10.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8311000000000001e-05 2024-09-17T02:21:10.133 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.133 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:10.133 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.133 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71206 5.3 e39/38 5:c6c9386d:::benchmark_data_smithi001_23533_object71205:head v 39'4517, mlcod=35'4513)", 2024-09-17T02:21:10.133 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:10.133 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.4529180789999998, 2024-09-17T02:21:10.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026101868, 2024-09-17T02:21:10.133 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:10.133 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:10.133 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:10.133 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:10.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:10.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:10.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:10.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:10.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:10.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609694+0000", 2024-09-17T02:21:10.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9539999999999998e-06 2024-09-17T02:21:10.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:10.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609841+0000", 2024-09-17T02:21:10.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014690800000000001 2024-09-17T02:21:10.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:10.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609872+0000", 2024-09-17T02:21:10.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0326000000000001e-05 2024-09-17T02:21:10.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609892+0000", 2024-09-17T02:21:10.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9848999999999999e-05 2024-09-17T02:21:10.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:10.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613826+0000", 2024-09-17T02:21:10.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039345140000000001 2024-09-17T02:21:10.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:10.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613908+0000", 2024-09-17T02:21:10.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2412999999999999e-05 2024-09-17T02:21:10.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:10.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635696+0000", 2024-09-17T02:21:10.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021787597999999998 2024-09-17T02:21:10.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:10.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635794+0000", 2024-09-17T02:21:10.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8306000000000004e-05 2024-09-17T02:21:10.137 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.137 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:10.138 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.138 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71210 5.3 e39/38 5:c0498d13:::benchmark_data_smithi001_23533_object71209:head v 39'4518, mlcod=35'4513)", 2024-09-17T02:21:10.138 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:10.138 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.4514401130000003, 2024-09-17T02:21:10.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024703197, 2024-09-17T02:21:10.138 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:10.138 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:10.138 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:10.138 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:10.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:10.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:10.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:10.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:10.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:10.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611172+0000", 2024-09-17T02:21:10.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6470000000000001e-06 2024-09-17T02:21:10.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:10.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611344+0000", 2024-09-17T02:21:10.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000171607 2024-09-17T02:21:10.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:10.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611389+0000", 2024-09-17T02:21:10.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5738000000000002e-05 2024-09-17T02:21:10.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611407+0000", 2024-09-17T02:21:10.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7893e-05 2024-09-17T02:21:10.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:10.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617820+0000", 2024-09-17T02:21:10.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064131070000000004 2024-09-17T02:21:10.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:10.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617885+0000", 2024-09-17T02:21:10.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4442000000000004e-05 2024-09-17T02:21:10.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:10.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635806+0000", 2024-09-17T02:21:10.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017920874999999999 2024-09-17T02:21:10.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:10.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635874+0000", 2024-09-17T02:21:10.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7887999999999998e-05 2024-09-17T02:21:10.142 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.142 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:10.142 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.142 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71213 5.3 e39/38 5:ce9071a1:::benchmark_data_smithi001_23533_object71212:head v 39'4519, mlcod=35'4513)", 2024-09-17T02:21:10.142 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.613453+0000", 2024-09-17T02:21:10.142 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.4491576019999997, 2024-09-17T02:21:10.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022494631000000001, 2024-09-17T02:21:10.142 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:10.143 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:10.143 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:10.143 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:10.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:10.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613453+0000", 2024-09-17T02:21:10.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:10.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613453+0000", 2024-09-17T02:21:10.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:10.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613455+0000", 2024-09-17T02:21:10.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.703e-06 2024-09-17T02:21:10.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:10.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613594+0000", 2024-09-17T02:21:10.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000139405 2024-09-17T02:21:10.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:10.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613625+0000", 2024-09-17T02:21:10.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0993e-05 2024-09-17T02:21:10.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613646+0000", 2024-09-17T02:21:10.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0761999999999999e-05 2024-09-17T02:21:10.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:10.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.620855+0000", 2024-09-17T02:21:10.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0072088270000000001 2024-09-17T02:21:10.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:10.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.620933+0000", 2024-09-17T02:21:10.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8807000000000006e-05 2024-09-17T02:21:10.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:10.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635882+0000", 2024-09-17T02:21:10.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014948530999999999 2024-09-17T02:21:10.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:10.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635948+0000", 2024-09-17T02:21:10.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5603000000000002e-05 2024-09-17T02:21:10.147 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.147 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:10.147 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.147 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71214 5.3 e39/38 5:c5e24f3f:::benchmark_data_smithi001_23533_object71213:head v 39'4520, mlcod=35'4513)", 2024-09-17T02:21:10.147 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:10.147 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.447075881, 2024-09-17T02:21:10.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024251297000000002, 2024-09-17T02:21:10.147 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:10.147 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:10.147 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:10.148 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:10.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:10.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:10.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:10.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:10.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:10.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615536+0000", 2024-09-17T02:21:10.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5370000000000001e-06 2024-09-17T02:21:10.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:10.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615696+0000", 2024-09-17T02:21:10.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015948700000000001 2024-09-17T02:21:10.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:10.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615723+0000", 2024-09-17T02:21:10.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7518999999999999e-05 2024-09-17T02:21:10.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615742+0000", 2024-09-17T02:21:10.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8519999999999999e-05 2024-09-17T02:21:10.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:10.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.624440+0000", 2024-09-17T02:21:10.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0086983080000000001 2024-09-17T02:21:10.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:10.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.624489+0000", 2024-09-17T02:21:10.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8838000000000002e-05 2024-09-17T02:21:10.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:10.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639673+0000", 2024-09-17T02:21:10.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01518451 2024-09-17T02:21:10.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:10.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639786+0000", 2024-09-17T02:21:10.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011257800000000001 2024-09-17T02:21:10.152 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.152 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:10.152 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.152 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71215 5.3 e39/38 5:c5603662:::benchmark_data_smithi001_23533_object71214:head v 39'4521, mlcod=35'4513)", 2024-09-17T02:21:10.152 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.617466+0000", 2024-09-17T02:21:10.152 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.4451449009999999, 2024-09-17T02:21:10.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022395379999999999, 2024-09-17T02:21:10.152 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:10.152 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:10.152 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:10.152 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:10.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:10.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617466+0000", 2024-09-17T02:21:10.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:10.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617466+0000", 2024-09-17T02:21:10.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:10.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617467+0000", 2024-09-17T02:21:10.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3600000000000002e-07 2024-09-17T02:21:10.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:10.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617521+0000", 2024-09-17T02:21:10.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4654999999999998e-05 2024-09-17T02:21:10.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:10.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617548+0000", 2024-09-17T02:21:10.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6706000000000001e-05 2024-09-17T02:21:10.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617566+0000", 2024-09-17T02:21:10.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7989e-05 2024-09-17T02:21:10.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:10.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.627598+0000", 2024-09-17T02:21:10.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010031854 2024-09-17T02:21:10.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:10.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.627656+0000", 2024-09-17T02:21:10.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8511999999999998e-05 2024-09-17T02:21:10.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:10.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639794+0000", 2024-09-17T02:21:10.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012137445 2024-09-17T02:21:10.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:10.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639861+0000", 2024-09-17T02:21:10.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7282999999999999e-05 2024-09-17T02:21:10.156 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.156 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:10.156 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.157 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71230 5.3 e39/38 5:c9397868:::benchmark_data_smithi001_23533_object71229:head v 39'4522, mlcod=35'4513)", 2024-09-17T02:21:10.157 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.619689+0000", 2024-09-17T02:21:10.157 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.4429218749999997, 2024-09-17T02:21:10.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020242406000000001, 2024-09-17T02:21:10.157 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:10.157 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:10.157 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:10.157 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:10.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:10.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.619689+0000", 2024-09-17T02:21:10.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:10.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.619689+0000", 2024-09-17T02:21:10.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:10.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.619690+0000", 2024-09-17T02:21:10.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.623e-06 2024-09-17T02:21:10.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:10.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.619753+0000", 2024-09-17T02:21:10.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3124000000000001e-05 2024-09-17T02:21:10.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:10.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.619776+0000", 2024-09-17T02:21:10.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2682999999999999e-05 2024-09-17T02:21:10.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.619790+0000", 2024-09-17T02:21:10.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4283e-05 2024-09-17T02:21:10.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:10.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630908+0000", 2024-09-17T02:21:10.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011117217 2024-09-17T02:21:10.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:10.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630968+0000", 2024-09-17T02:21:10.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0724999999999999e-05 2024-09-17T02:21:10.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:10.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639865+0000", 2024-09-17T02:21:10.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0088964430000000004 2024-09-17T02:21:10.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:10.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639931+0000", 2024-09-17T02:21:10.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6308000000000003e-05 2024-09-17T02:21:10.161 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.161 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:10.161 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.162 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:71277 5.a 5:5576e9b8:::benchmark_data_smithi001_23533_object71276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:10.162 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.630891+0000", 2024-09-17T02:21:10.162 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.4317193609999999, 2024-09-17T02:21:10.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022210245999999999, 2024-09-17T02:21:10.162 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:10.162 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:10.162 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:10.162 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:10.162 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:10.162 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:10.162 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71277 2024-09-17T02:21:10.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.162 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:10.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:10.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630891+0000", 2024-09-17T02:21:10.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:10.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630891+0000", 2024-09-17T02:21:10.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:10.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630893+0000", 2024-09-17T02:21:10.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-09-17T02:21:10.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:10.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630961+0000", 2024-09-17T02:21:10.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7971000000000004e-05 2024-09-17T02:21:10.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:10.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630989+0000", 2024-09-17T02:21:10.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7855999999999999e-05 2024-09-17T02:21:10.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631010+0000", 2024-09-17T02:21:10.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0888999999999999e-05 2024-09-17T02:21:10.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:10.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631123+0000", 2024-09-17T02:21:10.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011292 2024-09-17T02:21:10.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:10.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631434+0000", 2024-09-17T02:21:10.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00031039199999999999 2024-09-17T02:21:10.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:10.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631679+0000", 2024-09-17T02:21:10.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024517099999999997 2024-09-17T02:21:10.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:10.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.636619+0000", 2024-09-17T02:21:10.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049405339999999999 2024-09-17T02:21:10.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:10.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.652851+0000", 2024-09-17T02:21:10.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016231440999999999 2024-09-17T02:21:10.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:10.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.653012+0000", 2024-09-17T02:21:10.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016157199999999999 2024-09-17T02:21:10.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:10.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.653101+0000", 2024-09-17T02:21:10.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9190000000000005e-05 2024-09-17T02:21:10.167 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.167 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:10.168 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.168 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:71283 5.a 5:520c97e2:::benchmark_data_smithi001_23533_object71282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:10.168 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.636969+0000", 2024-09-17T02:21:10.168 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.4256419840000003, 2024-09-17T02:21:10.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020377408, 2024-09-17T02:21:10.168 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:10.168 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:10.168 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:10.168 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:10.168 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:10.168 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:10.169 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71283 2024-09-17T02:21:10.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.169 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:10.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:10.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.636969+0000", 2024-09-17T02:21:10.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:10.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.636969+0000", 2024-09-17T02:21:10.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:10.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.636971+0000", 2024-09-17T02:21:10.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.402e-06 2024-09-17T02:21:10.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:10.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.637034+0000", 2024-09-17T02:21:10.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3460999999999994e-05 2024-09-17T02:21:10.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:10.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.637058+0000", 2024-09-17T02:21:10.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3615999999999999e-05 2024-09-17T02:21:10.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.637071+0000", 2024-09-17T02:21:10.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3157e-05 2024-09-17T02:21:10.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:10.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.637238+0000", 2024-09-17T02:21:10.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000167016 2024-09-17T02:21:10.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:10.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.637483+0000", 2024-09-17T02:21:10.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024506799999999998 2024-09-17T02:21:10.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:10.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.637677+0000", 2024-09-17T02:21:10.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000193771 2024-09-17T02:21:10.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:10.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.644539+0000", 2024-09-17T02:21:10.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0068624259999999996 2024-09-17T02:21:10.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:10.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.657109+0000", 2024-09-17T02:21:10.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012569258999999999 2024-09-17T02:21:10.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:10.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.657249+0000", 2024-09-17T02:21:10.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014017200000000001 2024-09-17T02:21:10.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:10.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.657346+0000", 2024-09-17T02:21:10.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7059999999999996e-05 2024-09-17T02:21:10.173 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.174 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:10.174 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.174 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:71320 5.8 5:1cc902ac:::benchmark_data_smithi001_23533_object71319:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:10.174 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.664873+0000", 2024-09-17T02:21:10.174 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.397737759, 2024-09-17T02:21:10.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019295593999999999, 2024-09-17T02:21:10.174 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:10.174 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:10.174 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:10.174 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:10.174 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:10.175 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:10.175 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71320 2024-09-17T02:21:10.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.175 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:10.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:10.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.664873+0000", 2024-09-17T02:21:10.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:10.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.664873+0000", 2024-09-17T02:21:10.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:10.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:10.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.664875+0000", 2024-09-17T02:21:10.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.368e-06 2024-09-17T02:21:10.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:10.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.665035+0000", 2024-09-17T02:21:10.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000159927 2024-09-17T02:21:10.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:10.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.665057+0000", 2024-09-17T02:21:10.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1668999999999999e-05 2024-09-17T02:21:10.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.665070+0000", 2024-09-17T02:21:10.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.346e-05 2024-09-17T02:21:10.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:10.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.665171+0000", 2024-09-17T02:21:10.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010123 2024-09-17T02:21:10.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:10.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.665518+0000", 2024-09-17T02:21:10.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034674499999999997 2024-09-17T02:21:10.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:10.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.665832+0000", 2024-09-17T02:21:10.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00031377199999999998 2024-09-17T02:21:10.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:10.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.674660+0000", 2024-09-17T02:21:10.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0088280939999999999 2024-09-17T02:21:10.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:10.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.684078+0000", 2024-09-17T02:21:10.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0094177770000000004 2024-09-17T02:21:10.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:10.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.684128+0000", 2024-09-17T02:21:10.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9706999999999997e-05 2024-09-17T02:21:10.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:10.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:10.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:10.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.684168+0000", 2024-09-17T02:21:10.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0844999999999999e-05 2024-09-17T02:21:10.180 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.180 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:10.180 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.180 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:10.180 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:10.180 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:10.182 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:21:10.182 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:10.182+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:10.283 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:10.283+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:10.341 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:21:10.341 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-17T02:21:10.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.341 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:83100 5.9 5:99f152f5:::benchmark_data_smithi001_23533_object83099:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-17T02:21:10.341 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:10.340964+0000", 2024-09-17T02:21:10.341 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0031736249999999998, 2024-09-17T02:21:10.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0031957079999999998, 2024-09-17T02:21:10.341 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:10.342 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:10.342 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:21:10.342 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:10.342 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:10.342 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:10.342 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 83100 2024-09-17T02:21:10.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.342 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:10.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:10.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.340964+0000", 2024-09-17T02:21:10.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:10.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:10.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.340964+0000", 2024-09-17T02:21:10.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:10.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:10.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.340965+0000", 2024-09-17T02:21:10.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.159e-06 2024-09-17T02:21:10.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:10.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.341077+0000", 2024-09-17T02:21:10.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112507 2024-09-17T02:21:10.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:10.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.341089+0000", 2024-09-17T02:21:10.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.203e-05 2024-09-17T02:21:10.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.341097+0000", 2024-09-17T02:21:10.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9410000000000007e-06 2024-09-17T02:21:10.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:10.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.344008+0000", 2024-09-17T02:21:10.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002910354 2024-09-17T02:21:10.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:10.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.344143+0000", 2024-09-17T02:21:10.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013474799999999999 2024-09-17T02:21:10.345 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:10.345 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:10.346 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:10.346 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.346 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:83101 5.5 e41/22 5:a5859134:::benchmark_data_smithi001_23533_object83100:head v 41'5225, mlcod=41'5223)", 2024-09-17T02:21:10.346 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:10.342326+0000", 2024-09-17T02:21:10.346 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0018112340000000001, 2024-09-17T02:21:10.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001877351, 2024-09-17T02:21:10.346 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:10.346 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:10.346 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:21:10.346 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:10.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.346 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:10.346 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.342326+0000", 2024-09-17T02:21:10.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:10.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:10.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.342326+0000", 2024-09-17T02:21:10.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:10.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:10.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.342327+0000", 2024-09-17T02:21:10.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7299999999999995e-07 2024-09-17T02:21:10.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.348 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:10.348 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.342389+0000", 2024-09-17T02:21:10.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1742000000000006e-05 2024-09-17T02:21:10.348 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.348 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:10.348 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.342407+0000", 2024-09-17T02:21:10.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8711000000000001e-05 2024-09-17T02:21:10.348 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.348 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.348 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.342415+0000", 2024-09-17T02:21:10.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7219999999999999e-06 2024-09-17T02:21:10.348 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:10.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.342472+0000", 2024-09-17T02:21:10.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6755999999999997e-05 2024-09-17T02:21:10.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:10.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.342511+0000", 2024-09-17T02:21:10.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9465999999999998e-05 2024-09-17T02:21:10.349 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:10.349 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:10.349 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:10.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.350 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:83106 5.d 5:bc0a1b22:::benchmark_data_smithi001_23533_object83105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-17T02:21:10.350 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:10.342545+0000", 2024-09-17T02:21:10.350 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.001592553, 2024-09-17T02:21:10.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001699866, 2024-09-17T02:21:10.350 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:10.350 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:10.350 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:10.350 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:10.350 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:10.350 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:10.350 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 83106 2024-09-17T02:21:10.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.350 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:10.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:10.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.342545+0000", 2024-09-17T02:21:10.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:10.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:10.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.342545+0000", 2024-09-17T02:21:10.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:10.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:10.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.342546+0000", 2024-09-17T02:21:10.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5300000000000003e-07 2024-09-17T02:21:10.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:10.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.342636+0000", 2024-09-17T02:21:10.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0350000000000001e-05 2024-09-17T02:21:10.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:10.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.342646+0000", 2024-09-17T02:21:10.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0254e-05 2024-09-17T02:21:10.353 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.353 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.353 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.342654+0000", 2024-09-17T02:21:10.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8050000000000007e-06 2024-09-17T02:21:10.353 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.353 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:10.353 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.342700+0000", 2024-09-17T02:21:10.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6343e-05 2024-09-17T02:21:10.353 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.353 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:10.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.342850+0000", 2024-09-17T02:21:10.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000149584 2024-09-17T02:21:10.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:10.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.342996+0000", 2024-09-17T02:21:10.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000145833 2024-09-17T02:21:10.354 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:10.354 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:10.354 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:10.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.354 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(client.4466.0:83095 5.3 e41/38)", 2024-09-17T02:21:10.354 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:10.343473+0000", 2024-09-17T02:21:10.355 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.00066414800000000004, 2024-09-17T02:21:10.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00084306799999999999, 2024-09-17T02:21:10.355 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:10.355 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:10.355 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:10.355 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:10.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:10.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.343473+0000", 2024-09-17T02:21:10.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:10.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:10.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.343473+0000", 2024-09-17T02:21:10.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:10.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.356 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:10.356 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.343474+0000", 2024-09-17T02:21:10.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4300000000000003e-07 2024-09-17T02:21:10.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.356 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:10.356 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.343478+0000", 2024-09-17T02:21:10.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8689999999999997e-06 2024-09-17T02:21:10.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.357 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:10.357 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.343489+0000", 2024-09-17T02:21:10.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0808999999999999e-05 2024-09-17T02:21:10.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.357 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.357 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.343497+0000", 2024-09-17T02:21:10.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2139999999999996e-06 2024-09-17T02:21:10.357 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:10.357 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:10.357 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:10.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.358 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(client.4466.0:83095 5.3 e41/38)", 2024-09-17T02:21:10.358 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:10.343947+0000", 2024-09-17T02:21:10.358 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.00019077800000000001, 2024-09-17T02:21:10.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00042165600000000002, 2024-09-17T02:21:10.358 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:10.358 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:10.358 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:10.358 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:10.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:10.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.343947+0000", 2024-09-17T02:21:10.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:10.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:10.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.343947+0000", 2024-09-17T02:21:10.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:10.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:10.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.343947+0000", 2024-09-17T02:21:10.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0699999999999997e-07 2024-09-17T02:21:10.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:10.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.343951+0000", 2024-09-17T02:21:10.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.675e-06 2024-09-17T02:21:10.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:10.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.343969+0000", 2024-09-17T02:21:10.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7912000000000001e-05 2024-09-17T02:21:10.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.343975+0000", 2024-09-17T02:21:10.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9699999999999996e-06 2024-09-17T02:21:10.361 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:10.361 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:10.361 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:10.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.361 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:83109 5.9 5.f3257689 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-17T02:21:10.361 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:10.344254+0000", 2024-09-17T02:21:10.361 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4294967295.9998832, 2024-09-17T02:21:10.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000162459, 2024-09-17T02:21:10.361 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:10.361 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:10.361 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:10.362 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:10.362 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:10.362 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:10.362 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 83109 2024-09-17T02:21:10.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.362 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:10.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.362 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:10.362 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.344254+0000", 2024-09-17T02:21:10.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:10.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.362 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:10.362 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.344254+0000", 2024-09-17T02:21:10.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:10.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:10.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.344255+0000", 2024-09-17T02:21:10.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1000000000000001e-06 2024-09-17T02:21:10.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:10.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.344359+0000", 2024-09-17T02:21:10.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010415 2024-09-17T02:21:10.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:10.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.344371+0000", 2024-09-17T02:21:10.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.167e-05 2024-09-17T02:21:10.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.344378+0000", 2024-09-17T02:21:10.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2459999999999997e-06 2024-09-17T02:21:10.364 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:10.364 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:10.364 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:10.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.364 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:83110 5.d 5.dfd6024d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-17T02:21:10.364 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:10.344391+0000", 2024-09-17T02:21:10.365 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4294967295.9997468, 2024-09-17T02:21:10.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2509000000000006e-05, 2024-09-17T02:21:10.365 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:10.365 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:10.365 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:10.365 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:10.365 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:10.365 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:10.365 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 83110 2024-09-17T02:21:10.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.365 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:10.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:10.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.344391+0000", 2024-09-17T02:21:10.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:10.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:10.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.344391+0000", 2024-09-17T02:21:10.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:10.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:10.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.344391+0000", 2024-09-17T02:21:10.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7599999999999997e-07 2024-09-17T02:21:10.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:10.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.344434+0000", 2024-09-17T02:21:10.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2920000000000002e-05 2024-09-17T02:21:10.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:10.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.344446+0000", 2024-09-17T02:21:10.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1505000000000001e-05 2024-09-17T02:21:10.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.344452+0000", 2024-09-17T02:21:10.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1840000000000004e-06 2024-09-17T02:21:10.367 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:10.367 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:10.368 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:10.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.368 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:83111 5.3 5.f5660b93 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-17T02:21:10.368 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:10.344465+0000", 2024-09-17T02:21:10.368 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4294967295.9996724, 2024-09-17T02:21:10.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4838999999999994e-05, 2024-09-17T02:21:10.368 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:10.368 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:10.368 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:10.368 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:10.368 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:10.368 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:10.369 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 83111 2024-09-17T02:21:10.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.369 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:10.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:10.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.344465+0000", 2024-09-17T02:21:10.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:10.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:10.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.344465+0000", 2024-09-17T02:21:10.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:10.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:10.370 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.344465+0000", 2024-09-17T02:21:10.370 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0900000000000002e-07 2024-09-17T02:21:10.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:10.370 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.344502+0000", 2024-09-17T02:21:10.370 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7079999999999997e-05 2024-09-17T02:21:10.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:10.370 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.344513+0000", 2024-09-17T02:21:10.370 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0448999999999999e-05 2024-09-17T02:21:10.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.344519+0000", 2024-09-17T02:21:10.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3620000000000002e-06 2024-09-17T02:21:10.371 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:10.371 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:10.371 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:10.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.371 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:83090 5.9 5:9de6da4e:::benchmark_data_smithi001_23533_object83089:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-17T02:21:10.371 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:10.336951+0000", 2024-09-17T02:21:10.371 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0071861759999999998, 2024-09-17T02:21:10.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0076149420000000004, 2024-09-17T02:21:10.372 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:10.372 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:10.372 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:10.372 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:10.372 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:10.372 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:10.372 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 83090 2024-09-17T02:21:10.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.372 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:10.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.372 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:10.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.336951+0000", 2024-09-17T02:21:10.373 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:10.373 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.373 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.373 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:10.373 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.336951+0000", 2024-09-17T02:21:10.373 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:10.373 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.373 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.373 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:10.373 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.336952+0000", 2024-09-17T02:21:10.373 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3300000000000002e-07 2024-09-17T02:21:10.373 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.373 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.373 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:10.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.336982+0000", 2024-09-17T02:21:10.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0321e-05 2024-09-17T02:21:10.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.374 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:10.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.336989+0000", 2024-09-17T02:21:10.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0500000000000003e-06 2024-09-17T02:21:10.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.374 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.336994+0000", 2024-09-17T02:21:10.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0320000000000003e-06 2024-09-17T02:21:10.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.375 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:10.375 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.341560+0000", 2024-09-17T02:21:10.375 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004566082 2024-09-17T02:21:10.375 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.375 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.375 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:10.375 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.341719+0000", 2024-09-17T02:21:10.375 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015861799999999999 2024-09-17T02:21:10.375 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.375 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.375 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:10.375 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.341865+0000", 2024-09-17T02:21:10.375 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146539 2024-09-17T02:21:10.376 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:10.376 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:10.376 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:10.376 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.376 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.376 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:83095 5.3 5:c3263bf2:::benchmark_data_smithi001_23533_object83094:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-17T02:21:10.376 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:10.337321+0000", 2024-09-17T02:21:10.376 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0068163989999999999, 2024-09-17T02:21:10.376 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0072845039999999998, 2024-09-17T02:21:10.376 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:10.376 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:10.376 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:10.376 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:10.376 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:10.377 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:10.377 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 83095 2024-09-17T02:21:10.377 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.377 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:10.377 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.377 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:10.377 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.337321+0000", 2024-09-17T02:21:10.377 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:10.377 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.377 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.377 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:10.377 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.337321+0000", 2024-09-17T02:21:10.377 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:10.377 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.378 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.378 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:10.378 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.337322+0000", 2024-09-17T02:21:10.378 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.06e-07 2024-09-17T02:21:10.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.378 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.378 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:10.378 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.337354+0000", 2024-09-17T02:21:10.378 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2852999999999999e-05 2024-09-17T02:21:10.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.378 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.378 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:10.378 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.337362+0000", 2024-09-17T02:21:10.378 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5490000000000001e-06 2024-09-17T02:21:10.379 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.379 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.379 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:10.379 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.337368+0000", 2024-09-17T02:21:10.379 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1129999999999997e-06 2024-09-17T02:21:10.379 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.379 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.379 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:10.379 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.339753+0000", 2024-09-17T02:21:10.379 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023845149999999998 2024-09-17T02:21:10.379 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.379 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.379 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:10.379 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.339903+0000", 2024-09-17T02:21:10.380 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015009299999999999 2024-09-17T02:21:10.380 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:10.380 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:10.380 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0,1", 2024-09-17T02:21:10.380 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:10.340053+0000", 2024-09-17T02:21:10.380 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000149834 2024-09-17T02:21:10.380 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:10.380 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:10.380 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:10.380 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:10.380 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-09-17T02:21:10.380 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 10 2024-09-17T02:21:10.380 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:21:10.381 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:21:10.382 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:10.382+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:10.392 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:21:10.484 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:10.487+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:10.556 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:21:10.556 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:21:10.576 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:21:10.576 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:21:10.578 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:21:10.578 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-17T02:21:10.578 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-09-17T02:21:10.579 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-09-17T02:21:10.579 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:21:10.585 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:10.586+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:10.594 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:21:10.594 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:21:10.600 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:21:10.686 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:10.686+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:10.772 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 38 16 84001 83985 138.118 128.188 0.00861596 0.00723514 2024-09-17T02:21:10.787 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:10.786+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:10.796 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:10.796 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:10.817 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:10.887 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:10.890+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:10.968 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:10.968 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:10.989 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:10.989 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:10.990+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:11.089 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:11.091+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:11.183 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:11.184 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:11.190 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:11.191+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:11.205 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:11.291 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:11.290+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:11.366 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:11.366 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:11.384 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:11.392 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:11.395+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:11.493 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:11.495+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:11.523 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T02:21:11.531 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:11.531 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:11.548 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:11.594 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:11.595+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:11.695 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:11.698+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:11.700 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:11.701 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:11.720 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:11.773 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 39 16 86053 86037 137.864 128.25 0.00496061 0.00724874 2024-09-17T02:21:11.811 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:11.814+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:11.898 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:11.899+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:11.922 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:11.922 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:11.943 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:21:11.997 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:11.999+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:12.098 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:12.099+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:12.106 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:12.106 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:12.128 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:21:12.199 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:12.198+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:12.300 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:12.303+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:12.324 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:12.324 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:12.345 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:21:12.432 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:12.435+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:12.502 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:12.502+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:12.519 INFO:teuthology.orchestra.run.smithi001.stderr:noscrub is unset 2024-09-17T02:21:12.545 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:12.545 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:12.567 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:12.612 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:21:12.615 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:12.618+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:12.705 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:12.706+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:12.729 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:12.729 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:12.750 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:12.771 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:21:12.771 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:21:12.772 INFO:tasks.radosbench.radosbench.0.smithi001.stdout:2024-09-17T02:21:12.776290+0000 min lat: 0.00147149 max lat: 2.22367 avg lat: 0.00726111 2024-09-17T02:21:12.772 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-17T02:21:12.773 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 40 16 88107 88091 137.627 128.375 0.00853925 0.00726111 2024-09-17T02:21:12.791 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:21:12.791 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:21:12.807 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:12.810+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:12.810 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:21:12.810 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:21:12.908 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:12.910+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:12.952 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:12.952 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:21:12.952 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:21:12.952 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:21:12.952 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:12.973 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:13.009 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:13.011+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:13.113 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:13.114+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:13.179 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:13.180 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:21:13.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:21:13.180 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:13.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.180 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:13.180 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:21:13.180 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 56.624366969999997, 2024-09-17T02:21:13.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035535028000000003, 2024-09-17T02:21:13.180 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:13.180 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:13.180 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.181 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:13.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:13.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:21:13.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:13.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:21:13.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:13.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556550+0000", 2024-09-17T02:21:13.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3500000000000001e-06 2024-09-17T02:21:13.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:13.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556566+0000", 2024-09-17T02:21:13.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5440000000000001e-05 2024-09-17T02:21:13.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:13.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556594+0000", 2024-09-17T02:21:13.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8552999999999999e-05 2024-09-17T02:21:13.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556618+0000", 2024-09-17T02:21:13.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3207e-05 2024-09-17T02:21:13.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:13.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578337+0000", 2024-09-17T02:21:13.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021719517000000001 2024-09-17T02:21:13.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:13.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578655+0000", 2024-09-17T02:21:13.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031837800000000002 2024-09-17T02:21:13.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:13.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.581374+0000", 2024-09-17T02:21:13.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002718238 2024-09-17T02:21:13.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:13.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587083+0000", 2024-09-17T02:21:13.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005708912 2024-09-17T02:21:13.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591823+0000", 2024-09-17T02:21:13.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047406080000000003 2024-09-17T02:21:13.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:13.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591972+0000", 2024-09-17T02:21:13.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014874199999999999 2024-09-17T02:21:13.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:13.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592082+0000", 2024-09-17T02:21:13.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110083 2024-09-17T02:21:13.186 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.186 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:13.186 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.186 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:13.186 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:21:13.186 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 56.623425482999998, 2024-09-17T02:21:13.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035128756999999997, 2024-09-17T02:21:13.186 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:13.186 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:13.186 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.186 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:13.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:13.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:21:13.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:13.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:21:13.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:13.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557491+0000", 2024-09-17T02:21:13.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.88e-06 2024-09-17T02:21:13.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:13.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557504+0000", 2024-09-17T02:21:13.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2864000000000001e-05 2024-09-17T02:21:13.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:13.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557535+0000", 2024-09-17T02:21:13.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0916e-05 2024-09-17T02:21:13.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557561+0000", 2024-09-17T02:21:13.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5602999999999999e-05 2024-09-17T02:21:13.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:13.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582290+0000", 2024-09-17T02:21:13.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024729729999999998 2024-09-17T02:21:13.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:13.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582642+0000", 2024-09-17T02:21:13.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035143499999999999 2024-09-17T02:21:13.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:13.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582959+0000", 2024-09-17T02:21:13.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031747399999999999 2024-09-17T02:21:13.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:13.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587302+0000", 2024-09-17T02:21:13.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043425169999999997 2024-09-17T02:21:13.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592391+0000", 2024-09-17T02:21:13.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050895799999999998 2024-09-17T02:21:13.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:13.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592516+0000", 2024-09-17T02:21:13.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012420500000000001 2024-09-17T02:21:13.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:13.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592617+0000", 2024-09-17T02:21:13.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010155299999999999 2024-09-17T02:21:13.191 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.192 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:13.192 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.192 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:13.192 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:21:13.192 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 56.623320984000003, 2024-09-17T02:21:13.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034796066, 2024-09-17T02:21:13.192 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:13.192 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:13.192 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.192 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:13.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:13.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:21:13.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:13.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:21:13.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:13.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557594+0000", 2024-09-17T02:21:13.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3769999999999999e-06 2024-09-17T02:21:13.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:13.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557683+0000", 2024-09-17T02:21:13.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8896999999999999e-05 2024-09-17T02:21:13.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:13.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557707+0000", 2024-09-17T02:21:13.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3839e-05 2024-09-17T02:21:13.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557730+0000", 2024-09-17T02:21:13.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3047000000000001e-05 2024-09-17T02:21:13.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:13.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582329+0000", 2024-09-17T02:21:13.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024599283999999999 2024-09-17T02:21:13.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:13.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582624+0000", 2024-09-17T02:21:13.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000294462 2024-09-17T02:21:13.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:13.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582936+0000", 2024-09-17T02:21:13.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031223399999999999 2024-09-17T02:21:13.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:13.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587347+0000", 2024-09-17T02:21:13.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044110340000000003 2024-09-17T02:21:13.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592165+0000", 2024-09-17T02:21:13.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048176699999999996 2024-09-17T02:21:13.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:13.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592311+0000", 2024-09-17T02:21:13.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014661899999999999 2024-09-17T02:21:13.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:13.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592389+0000", 2024-09-17T02:21:13.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7602999999999995e-05 2024-09-17T02:21:13.197 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.197 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:13.197 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.198 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:13.198 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:21:13.198 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 56.622803357000002, 2024-09-17T02:21:13.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034457472000000003, 2024-09-17T02:21:13.198 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:13.198 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:13.198 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.198 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:13.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:13.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:21:13.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:13.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:21:13.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:13.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558113+0000", 2024-09-17T02:21:13.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1639999999999999e-06 2024-09-17T02:21:13.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:13.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558125+0000", 2024-09-17T02:21:13.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2269999999999999e-05 2024-09-17T02:21:13.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:13.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558458+0000", 2024-09-17T02:21:13.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033322700000000001 2024-09-17T02:21:13.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558488+0000", 2024-09-17T02:21:13.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.951e-05 2024-09-17T02:21:13.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:13.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584514+0000", 2024-09-17T02:21:13.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026025721000000002 2024-09-17T02:21:13.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:13.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584781+0000", 2024-09-17T02:21:13.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000267142 2024-09-17T02:21:13.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:13.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585078+0000", 2024-09-17T02:21:13.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029738799999999999 2024-09-17T02:21:13.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:13.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588045+0000", 2024-09-17T02:21:13.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029673759999999999 2024-09-17T02:21:13.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592454+0000", 2024-09-17T02:21:13.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044090209999999999 2024-09-17T02:21:13.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:13.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592520+0000", 2024-09-17T02:21:13.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6032999999999996e-05 2024-09-17T02:21:13.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:13.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592568+0000", 2024-09-17T02:21:13.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7620000000000001e-05 2024-09-17T02:21:13.203 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.203 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:13.203 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.204 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:13.204 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:21:13.204 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 56.622343106000002, 2024-09-17T02:21:13.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031603266999999997, 2024-09-17T02:21:13.204 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:13.204 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:13.204 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.204 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:13.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:13.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:21:13.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:13.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558571+0000", 2024-09-17T02:21:13.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:13.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558573+0000", 2024-09-17T02:21:13.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0660000000000002e-06 2024-09-17T02:21:13.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:13.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558585+0000", 2024-09-17T02:21:13.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1596999999999999e-05 2024-09-17T02:21:13.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:13.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558612+0000", 2024-09-17T02:21:13.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7115999999999999e-05 2024-09-17T02:21:13.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558631+0000", 2024-09-17T02:21:13.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9519999999999999e-05 2024-09-17T02:21:13.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:13.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558783+0000", 2024-09-17T02:21:13.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152025 2024-09-17T02:21:13.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-17T02:21:13.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558798+0000", 2024-09-17T02:21:13.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4966999999999999e-05 2024-09-17T02:21:13.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:13.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.572871+0000", 2024-09-17T02:21:13.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014072782000000001 2024-09-17T02:21:13.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:13.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573153+0000", 2024-09-17T02:21:13.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028214499999999998 2024-09-17T02:21:13.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:13.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.573432+0000", 2024-09-17T02:21:13.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027932100000000002 2024-09-17T02:21:13.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:13.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582279+0000", 2024-09-17T02:21:13.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0088463310000000007 2024-09-17T02:21:13.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.589902+0000", 2024-09-17T02:21:13.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0076236050000000003 2024-09-17T02:21:13.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:13.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.589997+0000", 2024-09-17T02:21:13.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4456000000000005e-05 2024-09-17T02:21:13.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:13.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590174+0000", 2024-09-17T02:21:13.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000177336 2024-09-17T02:21:13.210 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.210 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:13.210 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.210 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:13.210 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:21:13.210 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 56.622239860999997, 2024-09-17T02:21:13.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031899064999999997, 2024-09-17T02:21:13.210 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:13.211 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:13.211 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.211 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:13.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:13.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:21:13.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:13.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558674+0000", 2024-09-17T02:21:13.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:13.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558676+0000", 2024-09-17T02:21:13.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.39e-06 2024-09-17T02:21:13.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:13.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558686+0000", 2024-09-17T02:21:13.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.022e-05 2024-09-17T02:21:13.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:13.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558708+0000", 2024-09-17T02:21:13.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2249999999999999e-05 2024-09-17T02:21:13.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558725+0000", 2024-09-17T02:21:13.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7387000000000001e-05 2024-09-17T02:21:13.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:13.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558940+0000", 2024-09-17T02:21:13.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021453800000000001 2024-09-17T02:21:13.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting_for_map not empty", 2024-09-17T02:21:13.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558951+0000", 2024-09-17T02:21:13.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1303e-05 2024-09-17T02:21:13.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:13.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576237+0000", 2024-09-17T02:21:13.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017285723999999999 2024-09-17T02:21:13.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:13.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576454+0000", 2024-09-17T02:21:13.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021673800000000001 2024-09-17T02:21:13.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:13.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.576932+0000", 2024-09-17T02:21:13.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047792700000000001 2024-09-17T02:21:13.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:13.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585689+0000", 2024-09-17T02:21:13.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0087572880000000002 2024-09-17T02:21:13.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590287+0000", 2024-09-17T02:21:13.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045978060000000003 2024-09-17T02:21:13.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:13.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590447+0000", 2024-09-17T02:21:13.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000160719 2024-09-17T02:21:13.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:13.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590573+0000", 2024-09-17T02:21:13.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012577500000000001 2024-09-17T02:21:13.217 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.217 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:13.217 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.217 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:13.217 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:21:13.217 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 56.622161890999998, 2024-09-17T02:21:13.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034114029999999997, 2024-09-17T02:21:13.218 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:13.218 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:13.218 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.218 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:13.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:13.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:21:13.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:13.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:21:13.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:13.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558753+0000", 2024-09-17T02:21:13.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2699999999999999e-06 2024-09-17T02:21:13.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:13.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558769+0000", 2024-09-17T02:21:13.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5906e-05 2024-09-17T02:21:13.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:13.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558791+0000", 2024-09-17T02:21:13.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1342999999999999e-05 2024-09-17T02:21:13.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558806+0000", 2024-09-17T02:21:13.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5829999999999999e-05 2024-09-17T02:21:13.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:13.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584906+0000", 2024-09-17T02:21:13.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026099273999999999 2024-09-17T02:21:13.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:13.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585158+0000", 2024-09-17T02:21:13.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025194600000000002 2024-09-17T02:21:13.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:13.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585368+0000", 2024-09-17T02:21:13.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210068 2024-09-17T02:21:13.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:13.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588098+0000", 2024-09-17T02:21:13.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002730522 2024-09-17T02:21:13.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592680+0000", 2024-09-17T02:21:13.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045816019999999997 2024-09-17T02:21:13.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:13.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592774+0000", 2024-09-17T02:21:13.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3726000000000004e-05 2024-09-17T02:21:13.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:13.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592866+0000", 2024-09-17T02:21:13.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2542999999999998e-05 2024-09-17T02:21:13.223 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.223 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:13.223 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.223 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:13.223 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:21:13.223 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 56.622085587999997, 2024-09-17T02:21:13.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.031407875000000002, 2024-09-17T02:21:13.223 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:13.223 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:13.223 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:13.224 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:13.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:13.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:21:13.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:13.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558828+0000", 2024-09-17T02:21:13.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:13.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558830+0000", 2024-09-17T02:21:13.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3599999999999999e-06 2024-09-17T02:21:13.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:13.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558835+0000", 2024-09-17T02:21:13.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6130000000000003e-06 2024-09-17T02:21:13.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:13.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558853+0000", 2024-09-17T02:21:13.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8099999999999999e-05 2024-09-17T02:21:13.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558869+0000", 2024-09-17T02:21:13.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.59e-05 2024-09-17T02:21:13.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:13.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560437+0000", 2024-09-17T02:21:13.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015677989999999999 2024-09-17T02:21:13.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-17T02:21:13.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.560453+0000", 2024-09-17T02:21:13.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.535e-05 2024-09-17T02:21:13.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:13.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562422+0000", 2024-09-17T02:21:13.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00196934 2024-09-17T02:21:13.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:13.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.562773+0000", 2024-09-17T02:21:13.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035152399999999998 2024-09-17T02:21:13.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:13.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.590236+0000", 2024-09-17T02:21:13.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.027462889000000001 2024-09-17T02:21:13.228 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.228 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:13.228 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.228 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28720 5.f e28/22 5:f8a7aea5:::benchmark_data_smithi001_23533_object28719:head v 28'1756, mlcod=28'1754)", 2024-09-17T02:21:13.228 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:21:13.229 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.610794090999999, 2024-09-17T02:21:13.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033308717000000002, 2024-09-17T02:21:13.229 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:13.229 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:13.229 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.229 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:13.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:13.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:21:13.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:13.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:21:13.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:13.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570121+0000", 2024-09-17T02:21:13.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4e-07 2024-09-17T02:21:13.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:13.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570208+0000", 2024-09-17T02:21:13.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6945000000000002e-05 2024-09-17T02:21:13.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:13.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570222+0000", 2024-09-17T02:21:13.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4541e-05 2024-09-17T02:21:13.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570232+0000", 2024-09-17T02:21:13.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3039999999999994e-06 2024-09-17T02:21:13.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:13.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570273+0000", 2024-09-17T02:21:13.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1950999999999999e-05 2024-09-17T02:21:13.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:13.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570286+0000", 2024-09-17T02:21:13.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2268e-05 2024-09-17T02:21:13.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:13.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603312+0000", 2024-09-17T02:21:13.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033026405000000002 2024-09-17T02:21:13.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:13.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603429+0000", 2024-09-17T02:21:13.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116463 2024-09-17T02:21:13.233 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.233 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:13.233 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.233 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28721 5.a e28/22 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head v 28'1872, mlcod=28'1869)", 2024-09-17T02:21:13.234 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:21:13.234 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.610650584999998, 2024-09-17T02:21:13.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033539817999999999, 2024-09-17T02:21:13.234 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:13.234 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:13.234 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.234 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:13.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:13.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:21:13.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:13.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:21:13.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:13.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570264+0000", 2024-09-17T02:21:13.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0999999999999997e-07 2024-09-17T02:21:13.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:13.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570299+0000", 2024-09-17T02:21:13.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4876999999999998e-05 2024-09-17T02:21:13.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:13.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570310+0000", 2024-09-17T02:21:13.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0958000000000001e-05 2024-09-17T02:21:13.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570316+0000", 2024-09-17T02:21:13.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.485e-06 2024-09-17T02:21:13.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:13.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598947+0000", 2024-09-17T02:21:13.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.028631058000000001 2024-09-17T02:21:13.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:13.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598969+0000", 2024-09-17T02:21:13.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2005999999999999e-05 2024-09-17T02:21:13.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:13.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.602638+0000", 2024-09-17T02:21:13.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036690339999999998 2024-09-17T02:21:13.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:13.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603803+0000", 2024-09-17T02:21:13.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00116559 2024-09-17T02:21:13.238 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.238 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:13.238 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.238 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28723 5.f e28/22 5:f1a2a8f6:::benchmark_data_smithi001_23533_object28722:head v 28'1757, mlcod=28'1754)", 2024-09-17T02:21:13.238 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.571446+0000", 2024-09-17T02:21:13.238 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.609468257, 2024-09-17T02:21:13.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.032047203000000003, 2024-09-17T02:21:13.239 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:13.239 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:13.239 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.239 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:13.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:13.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571446+0000", 2024-09-17T02:21:13.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:13.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571446+0000", 2024-09-17T02:21:13.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:13.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571447+0000", 2024-09-17T02:21:13.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0979999999999999e-06 2024-09-17T02:21:13.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:13.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.571554+0000", 2024-09-17T02:21:13.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107464 2024-09-17T02:21:13.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:13.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598891+0000", 2024-09-17T02:21:13.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.027336905000000002 2024-09-17T02:21:13.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598905+0000", 2024-09-17T02:21:13.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:21:13.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:13.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.600343+0000", 2024-09-17T02:21:13.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014382100000000001 2024-09-17T02:21:13.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:13.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.600387+0000", 2024-09-17T02:21:13.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3398e-05 2024-09-17T02:21:13.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:13.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603443+0000", 2024-09-17T02:21:13.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030562250000000001 2024-09-17T02:21:13.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:13.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603493+0000", 2024-09-17T02:21:13.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9820000000000001e-05 2024-09-17T02:21:13.243 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.243 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:13.243 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.243 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:40730 5.b 5:d64b1dc0:::benchmark_data_smithi001_23533_object40729:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T02:21:13.243 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:21:13.243 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.143146419000001, 2024-09-17T02:21:13.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016675972000000001, 2024-09-17T02:21:13.243 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:13.244 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:13.244 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.244 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:13.244 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:13.244 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:13.244 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 40730 2024-09-17T02:21:13.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.244 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:13.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:13.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:21:13.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:13.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:21:13.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:13.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037768+0000", 2024-09-17T02:21:13.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5700000000000002e-07 2024-09-17T02:21:13.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:13.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037813+0000", 2024-09-17T02:21:13.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4880999999999999e-05 2024-09-17T02:21:13.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:13.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037820+0000", 2024-09-17T02:21:13.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.34e-06 2024-09-17T02:21:13.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.037825+0000", 2024-09-17T02:21:13.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1420000000000003e-06 2024-09-17T02:21:13.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:13.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.039167+0000", 2024-09-17T02:21:13.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013427529999999999 2024-09-17T02:21:13.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:13.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.039293+0000", 2024-09-17T02:21:13.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000125248 2024-09-17T02:21:13.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:13.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.039442+0000", 2024-09-17T02:21:13.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014929799999999999 2024-09-17T02:21:13.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:13.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.041694+0000", 2024-09-17T02:21:13.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002252324 2024-09-17T02:21:13.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054324+0000", 2024-09-17T02:21:13.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012629782000000001 2024-09-17T02:21:13.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:13.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054393+0000", 2024-09-17T02:21:13.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9295999999999995e-05 2024-09-17T02:21:13.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:13.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:47.054444+0000", 2024-09-17T02:21:13.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0250999999999997e-05 2024-09-17T02:21:13.249 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.249 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:13.249 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.249 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:64220 5.4 5:27584da2:::benchmark_data_smithi001_23533_object64219:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-17T02:21:13.249 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:57.202813+0000", 2024-09-17T02:21:13.250 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 15.978101365000001, 2024-09-17T02:21:13.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019952102999999999, 2024-09-17T02:21:13.250 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:13.250 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:13.250 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.250 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:13.250 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:13.250 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:13.250 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 64220 2024-09-17T02:21:13.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.250 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:13.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.250 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:13.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.202813+0000", 2024-09-17T02:21:13.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:13.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.202813+0000", 2024-09-17T02:21:13.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:13.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.202813+0000", 2024-09-17T02:21:13.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0800000000000004e-07 2024-09-17T02:21:13.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:13.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.202879+0000", 2024-09-17T02:21:13.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5698999999999996e-05 2024-09-17T02:21:13.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:13.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.202887+0000", 2024-09-17T02:21:13.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3699999999999995e-06 2024-09-17T02:21:13.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.202892+0000", 2024-09-17T02:21:13.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7960000000000003e-06 2024-09-17T02:21:13.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:13.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.204623+0000", 2024-09-17T02:21:13.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017305179999999999 2024-09-17T02:21:13.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:13.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.204739+0000", 2024-09-17T02:21:13.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116439 2024-09-17T02:21:13.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:13.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.204846+0000", 2024-09-17T02:21:13.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107181 2024-09-17T02:21:13.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:13.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.207469+0000", 2024-09-17T02:21:13.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026227020000000002 2024-09-17T02:21:13.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.222690+0000", 2024-09-17T02:21:13.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015220798000000001 2024-09-17T02:21:13.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:13.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.222732+0000", 2024-09-17T02:21:13.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2552999999999997e-05 2024-09-17T02:21:13.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:13.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:57.222765+0000", 2024-09-17T02:21:13.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2339000000000003e-05 2024-09-17T02:21:13.256 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.256 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:13.256 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.256 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:71274 5.b 5:d2d56400:::benchmark_data_smithi001_23533_object71273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:13.256 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:04.626306+0000", 2024-09-17T02:21:13.256 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.5546078800000007, 2024-09-17T02:21:13.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017847371000000001, 2024-09-17T02:21:13.256 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:13.257 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:13.257 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.257 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:13.257 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:13.257 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:13.257 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 71274 2024-09-17T02:21:13.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.257 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:13.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:13.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.626306+0000", 2024-09-17T02:21:13.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:13.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.626306+0000", 2024-09-17T02:21:13.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:13.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.626308+0000", 2024-09-17T02:21:13.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9180000000000001e-06 2024-09-17T02:21:13.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:13.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.626380+0000", 2024-09-17T02:21:13.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2454999999999997e-05 2024-09-17T02:21:13.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:13.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.626402+0000", 2024-09-17T02:21:13.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2016000000000001e-05 2024-09-17T02:21:13.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.626414+0000", 2024-09-17T02:21:13.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1518999999999999e-05 2024-09-17T02:21:13.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:13.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.626505+0000", 2024-09-17T02:21:13.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1379999999999996e-05 2024-09-17T02:21:13.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:13.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.626638+0000", 2024-09-17T02:21:13.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013286600000000001 2024-09-17T02:21:13.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:13.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.626808+0000", 2024-09-17T02:21:13.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016948000000000001 2024-09-17T02:21:13.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.629520+0000", 2024-09-17T02:21:13.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00271244 2024-09-17T02:21:13.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:13.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.630073+0000", 2024-09-17T02:21:13.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055253300000000002 2024-09-17T02:21:13.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.643981+0000", 2024-09-17T02:21:13.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01390808 2024-09-17T02:21:13.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:13.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.644049+0000", 2024-09-17T02:21:13.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8528000000000005e-05 2024-09-17T02:21:13.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:13.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:04.644153+0000", 2024-09-17T02:21:13.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000104156 2024-09-17T02:21:13.263 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.263 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:13.263 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.264 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:72109 5.4 5:25717992:::benchmark_data_smithi001_23533_object72108:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:13.264 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:05.059585+0000", 2024-09-17T02:21:13.264 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.1213289599999996, 2024-09-17T02:21:13.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019702999999999998, 2024-09-17T02:21:13.264 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:13.264 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:13.264 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.264 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:13.264 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:13.264 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:13.264 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 72109 2024-09-17T02:21:13.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.265 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:13.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:13.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059585+0000", 2024-09-17T02:21:13.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:13.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059585+0000", 2024-09-17T02:21:13.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:13.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059586+0000", 2024-09-17T02:21:13.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.153e-06 2024-09-17T02:21:13.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:13.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059666+0000", 2024-09-17T02:21:13.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0093999999999996e-05 2024-09-17T02:21:13.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:13.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059677+0000", 2024-09-17T02:21:13.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0786e-05 2024-09-17T02:21:13.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059684+0000", 2024-09-17T02:21:13.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0729999999999999e-06 2024-09-17T02:21:13.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:13.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.069850+0000", 2024-09-17T02:21:13.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010165560000000001 2024-09-17T02:21:13.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:13.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.069997+0000", 2024-09-17T02:21:13.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014692000000000001 2024-09-17T02:21:13.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:13.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.070176+0000", 2024-09-17T02:21:13.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000179774 2024-09-17T02:21:13.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:13.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079031+0000", 2024-09-17T02:21:13.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0088549119999999995 2024-09-17T02:21:13.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079085+0000", 2024-09-17T02:21:13.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3588999999999998e-05 2024-09-17T02:21:13.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079155+0000", 2024-09-17T02:21:13.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0166999999999994e-05 2024-09-17T02:21:13.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:13.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079196+0000", 2024-09-17T02:21:13.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0964999999999998e-05 2024-09-17T02:21:13.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:13.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079288+0000", 2024-09-17T02:21:13.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2007000000000002e-05 2024-09-17T02:21:13.271 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.271 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:13.271 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.272 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:72113 5.4 5:22c8dcc1:::benchmark_data_smithi001_23533_object72112:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:13.272 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:05.059974+0000", 2024-09-17T02:21:13.272 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.1209398589999999, 2024-09-17T02:21:13.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022437694000000001, 2024-09-17T02:21:13.272 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:13.272 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:13.272 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.272 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:13.273 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:13.273 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:13.273 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 72113 2024-09-17T02:21:13.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.273 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:13.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:13.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059974+0000", 2024-09-17T02:21:13.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:13.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059974+0000", 2024-09-17T02:21:13.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:13.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.059975+0000", 2024-09-17T02:21:13.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6600000000000005e-07 2024-09-17T02:21:13.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:13.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.060002+0000", 2024-09-17T02:21:13.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6602e-05 2024-09-17T02:21:13.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:13.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.060011+0000", 2024-09-17T02:21:13.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4730000000000006e-06 2024-09-17T02:21:13.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.060017+0000", 2024-09-17T02:21:13.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.331e-06 2024-09-17T02:21:13.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:13.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.072282+0000", 2024-09-17T02:21:13.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012264126 2024-09-17T02:21:13.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:13.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.072461+0000", 2024-09-17T02:21:13.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017923700000000001 2024-09-17T02:21:13.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:13.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.072656+0000", 2024-09-17T02:21:13.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000195735 2024-09-17T02:21:13.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:13.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079382+0000", 2024-09-17T02:21:13.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067256529999999998 2024-09-17T02:21:13.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.082111+0000", 2024-09-17T02:21:13.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027287040000000002 2024-09-17T02:21:13.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.082229+0000", 2024-09-17T02:21:13.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118168 2024-09-17T02:21:13.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:13.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.082308+0000", 2024-09-17T02:21:13.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8888999999999996e-05 2024-09-17T02:21:13.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:13.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.082412+0000", 2024-09-17T02:21:13.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010391 2024-09-17T02:21:13.280 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.280 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:13.280 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.280 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:72123 5.4 5:2546f78a:::benchmark_data_smithi001_23533_object72122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:13.280 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:05.063089+0000", 2024-09-17T02:21:13.281 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.1178253530000006, 2024-09-17T02:21:13.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019591450999999999, 2024-09-17T02:21:13.281 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:13.281 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:13.281 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.281 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:13.281 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:13.281 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:13.281 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 72123 2024-09-17T02:21:13.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.281 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:13.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:13.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.063089+0000", 2024-09-17T02:21:13.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:13.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.063089+0000", 2024-09-17T02:21:13.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:13.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.063090+0000", 2024-09-17T02:21:13.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1829999999999999e-06 2024-09-17T02:21:13.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:13.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.063205+0000", 2024-09-17T02:21:13.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115634 2024-09-17T02:21:13.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:13.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.063217+0000", 2024-09-17T02:21:13.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.202e-05 2024-09-17T02:21:13.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.063226+0000", 2024-09-17T02:21:13.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5469999999999997e-06 2024-09-17T02:21:13.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:13.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.074475+0000", 2024-09-17T02:21:13.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01124874 2024-09-17T02:21:13.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:13.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.074639+0000", 2024-09-17T02:21:13.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000164537 2024-09-17T02:21:13.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:13.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.074772+0000", 2024-09-17T02:21:13.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013228599999999999 2024-09-17T02:21:13.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:13.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079387+0000", 2024-09-17T02:21:13.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046156239999999996 2024-09-17T02:21:13.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.082173+0000", 2024-09-17T02:21:13.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027856030000000002 2024-09-17T02:21:13.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.082483+0000", 2024-09-17T02:21:13.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031013699999999999 2024-09-17T02:21:13.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:13.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.082548+0000", 2024-09-17T02:21:13.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4745000000000004e-05 2024-09-17T02:21:13.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:13.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.082680+0000", 2024-09-17T02:21:13.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000132395 2024-09-17T02:21:13.288 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.288 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:13.288 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.288 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:72133 5.4 5:2e38f4b5:::benchmark_data_smithi001_23533_object72132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:13.288 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:05.070228+0000", 2024-09-17T02:21:13.288 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.1106864260000009, 2024-09-17T02:21:13.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019598082999999999, 2024-09-17T02:21:13.288 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:13.288 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:13.289 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.289 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:13.289 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:13.289 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:13.289 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 72133 2024-09-17T02:21:13.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.289 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:13.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:13.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.070228+0000", 2024-09-17T02:21:13.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:13.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.070228+0000", 2024-09-17T02:21:13.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:13.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.070228+0000", 2024-09-17T02:21:13.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7599999999999998e-07 2024-09-17T02:21:13.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:13.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.070266+0000", 2024-09-17T02:21:13.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8498000000000003e-05 2024-09-17T02:21:13.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:13.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.070272+0000", 2024-09-17T02:21:13.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4149999999999998e-06 2024-09-17T02:21:13.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.070278+0000", 2024-09-17T02:21:13.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.083e-06 2024-09-17T02:21:13.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:13.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079437+0000", 2024-09-17T02:21:13.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0091590249999999995 2024-09-17T02:21:13.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:13.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079611+0000", 2024-09-17T02:21:13.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000173878 2024-09-17T02:21:13.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:13.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.079789+0000", 2024-09-17T02:21:13.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017836699999999999 2024-09-17T02:21:13.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:13.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.082696+0000", 2024-09-17T02:21:13.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029069080000000001 2024-09-17T02:21:13.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.083065+0000", 2024-09-17T02:21:13.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036905899999999998 2024-09-17T02:21:13.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.089624+0000", 2024-09-17T02:21:13.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0065584809999999997 2024-09-17T02:21:13.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:13.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.089697+0000", 2024-09-17T02:21:13.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3815999999999999e-05 2024-09-17T02:21:13.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:13.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:05.089826+0000", 2024-09-17T02:21:13.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012817699999999999 2024-09-17T02:21:13.295 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.296 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:13.296 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.296 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:83464 5.b 5:d1c4e4b5:::benchmark_data_smithi001_23533_object83463:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T02:21:13.296 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:10.509321+0000", 2024-09-17T02:21:13.296 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 2.671592881, 2024-09-17T02:21:13.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017425145999999999, 2024-09-17T02:21:13.296 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:13.296 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:13.297 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.297 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:13.297 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:13.297 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:13.297 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 83464 2024-09-17T02:21:13.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.297 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:13.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:13.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:10.509321+0000", 2024-09-17T02:21:13.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:13.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:10.509321+0000", 2024-09-17T02:21:13.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:13.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:10.509322+0000", 2024-09-17T02:21:13.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2900000000000002e-07 2024-09-17T02:21:13.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:13.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:10.509394+0000", 2024-09-17T02:21:13.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2049000000000001e-05 2024-09-17T02:21:13.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:13.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:10.509403+0000", 2024-09-17T02:21:13.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9889999999999998e-06 2024-09-17T02:21:13.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:10.509408+0000", 2024-09-17T02:21:13.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.69e-06 2024-09-17T02:21:13.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:13.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:10.509459+0000", 2024-09-17T02:21:13.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0977999999999999e-05 2024-09-17T02:21:13.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:13.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:10.509587+0000", 2024-09-17T02:21:13.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012788200000000001 2024-09-17T02:21:13.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:13.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:10.509753+0000", 2024-09-17T02:21:13.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016691199999999999 2024-09-17T02:21:13.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:13.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:10.513097+0000", 2024-09-17T02:21:13.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003343796 2024-09-17T02:21:13.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:10.513295+0000", 2024-09-17T02:21:13.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000198235 2024-09-17T02:21:13.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:10.526643+0000", 2024-09-17T02:21:13.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013347951 2024-09-17T02:21:13.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:13.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:10.526679+0000", 2024-09-17T02:21:13.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5716000000000002e-05 2024-09-17T02:21:13.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:13.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:10.526746+0000", 2024-09-17T02:21:13.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7119000000000006e-05 2024-09-17T02:21:13.303 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.303 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:13.303 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.304 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:88312 5.4 5:29623021:::benchmark_data_smithi001_23533_object88311:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T02:21:13.304 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:12.881048+0000", 2024-09-17T02:21:13.304 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.29986642699999999, 2024-09-17T02:21:13.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016817990000000001, 2024-09-17T02:21:13.304 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:13.304 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:13.304 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.304 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:13.304 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:13.304 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:13.305 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 88312 2024-09-17T02:21:13.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.305 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:13.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:13.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:12.881048+0000", 2024-09-17T02:21:13.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:13.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:12.881048+0000", 2024-09-17T02:21:13.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:13.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:13.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:12.881048+0000", 2024-09-17T02:21:13.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0199999999999998e-07 2024-09-17T02:21:13.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:13.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:12.881075+0000", 2024-09-17T02:21:13.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7588000000000001e-05 2024-09-17T02:21:13.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:13.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:12.881081+0000", 2024-09-17T02:21:13.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1599999999999997e-06 2024-09-17T02:21:13.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:12.881084+0000", 2024-09-17T02:21:13.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7299999999999999e-06 2024-09-17T02:21:13.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:13.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:12.886476+0000", 2024-09-17T02:21:13.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0053914729999999999 2024-09-17T02:21:13.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:13.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:12.886593+0000", 2024-09-17T02:21:13.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117599 2024-09-17T02:21:13.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:13.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:12.886713+0000", 2024-09-17T02:21:13.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000119333 2024-09-17T02:21:13.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:13.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:12.891517+0000", 2024-09-17T02:21:13.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048040890000000001 2024-09-17T02:21:13.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:12.893184+0000", 2024-09-17T02:21:13.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016672639999999999 2024-09-17T02:21:13.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:12.897728+0000", 2024-09-17T02:21:13.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045441400000000003 2024-09-17T02:21:13.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:13.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:12.897795+0000", 2024-09-17T02:21:13.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7041999999999999e-05 2024-09-17T02:21:13.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:13.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:13.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:13.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:12.897866+0000", 2024-09-17T02:21:13.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0270000000000003e-05 2024-09-17T02:21:13.311 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.311 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:13.311 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.311 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:13.311 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:13.311 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:13.313 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:13.314 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:13.314+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:13.414 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:13.414+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:13.463 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:13.463 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:13.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.463 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:89481 5.3 e43/38 5:c9d39167:::benchmark_data_smithi001_23533_object89480:head v 43'5664, mlcod=43'5661)", 2024-09-17T02:21:13.464 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:13.463329+0000", 2024-09-17T02:21:13.464 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0036739730000000001, 2024-09-17T02:21:13.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003695453, 2024-09-17T02:21:13.464 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.464 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.464 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:13.464 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463329+0000", 2024-09-17T02:21:13.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463329+0000", 2024-09-17T02:21:13.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463330+0000", 2024-09-17T02:21:13.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.607e-06 2024-09-17T02:21:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463393+0000", 2024-09-17T02:21:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2540999999999996e-05 2024-09-17T02:21:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463399+0000", 2024-09-17T02:21:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-09-17T02:21:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463402+0000", 2024-09-17T02:21:13.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5020000000000001e-06 2024-09-17T02:21:13.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463445+0000", 2024-09-17T02:21:13.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2747000000000003e-05 2024-09-17T02:21:13.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463464+0000", 2024-09-17T02:21:13.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9031000000000001e-05 2024-09-17T02:21:13.468 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.468 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.468 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.468 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:89483 5.5 5:a90c1569:::benchmark_data_smithi001_23533_object89482:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T02:21:13.468 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:13.463441+0000", 2024-09-17T02:21:13.468 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0035616369999999999, 2024-09-17T02:21:13.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036494330000000001, 2024-09-17T02:21:13.469 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 89483 2024-09-17T02:21:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463441+0000", 2024-09-17T02:21:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463441+0000", 2024-09-17T02:21:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463442+0000", 2024-09-17T02:21:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4399999999999999e-07 2024-09-17T02:21:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463503+0000", 2024-09-17T02:21:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0736000000000003e-05 2024-09-17T02:21:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463513+0000", 2024-09-17T02:21:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0437e-05 2024-09-17T02:21:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463518+0000", 2024-09-17T02:21:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7500000000000003e-06 2024-09-17T02:21:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463561+0000", 2024-09-17T02:21:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3677999999999998e-05 2024-09-17T02:21:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463733+0000", 2024-09-17T02:21:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017205700000000001 2024-09-17T02:21:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463914+0000", 2024-09-17T02:21:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000180571 2024-09-17T02:21:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:89484 5.c 5:3dd57bf5:::benchmark_data_smithi001_23533_object89483:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T02:21:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:13.463659+0000", 2024-09-17T02:21:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0033435119999999999, 2024-09-17T02:21:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003504358, 2024-09-17T02:21:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 89484 2024-09-17T02:21:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463659+0000", 2024-09-17T02:21:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463659+0000", 2024-09-17T02:21:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463660+0000", 2024-09-17T02:21:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8400000000000003e-07 2024-09-17T02:21:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463699+0000", 2024-09-17T02:21:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8565000000000001e-05 2024-09-17T02:21:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463725+0000", 2024-09-17T02:21:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6083000000000001e-05 2024-09-17T02:21:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463732+0000", 2024-09-17T02:21:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2359999999999998e-06 2024-09-17T02:21:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.465302+0000", 2024-09-17T02:21:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001570225 2024-09-17T02:21:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.465536+0000", 2024-09-17T02:21:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000234231 2024-09-17T02:21:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.465661+0000", 2024-09-17T02:21:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000124206 2024-09-17T02:21:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:89485 5.5 5:af6155fa:::benchmark_data_smithi001_23533_object89484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T02:21:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:13.463759+0000", 2024-09-17T02:21:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0032438380000000002, 2024-09-17T02:21:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034735249999999999, 2024-09-17T02:21:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 89485 2024-09-17T02:21:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463759+0000", 2024-09-17T02:21:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463759+0000", 2024-09-17T02:21:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463759+0000", 2024-09-17T02:21:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1200000000000003e-07 2024-09-17T02:21:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463806+0000", 2024-09-17T02:21:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6162999999999998e-05 2024-09-17T02:21:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463822+0000", 2024-09-17T02:21:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6773e-05 2024-09-17T02:21:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463831+0000", 2024-09-17T02:21:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5599999999999994e-06 2024-09-17T02:21:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466555+0000", 2024-09-17T02:21:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027238620000000001 2024-09-17T02:21:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466713+0000", 2024-09-17T02:21:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000158271 2024-09-17T02:21:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466894+0000", 2024-09-17T02:21:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018082999999999999 2024-09-17T02:21:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:89486 5.a 5:5c0311cd:::benchmark_data_smithi001_23533_object89485:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T02:21:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:13.463868+0000", 2024-09-17T02:21:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0031351030000000002, 2024-09-17T02:21:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034370960000000002, 2024-09-17T02:21:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 89486 2024-09-17T02:21:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463868+0000", 2024-09-17T02:21:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463868+0000", 2024-09-17T02:21:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463868+0000", 2024-09-17T02:21:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0200000000000001e-07 2024-09-17T02:21:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463903+0000", 2024-09-17T02:21:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4418000000000001e-05 2024-09-17T02:21:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463914+0000", 2024-09-17T02:21:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1274000000000001e-05 2024-09-17T02:21:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463921+0000", 2024-09-17T02:21:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3250000000000002e-06 2024-09-17T02:21:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463982+0000", 2024-09-17T02:21:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0572999999999998e-05 2024-09-17T02:21:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.464107+0000", 2024-09-17T02:21:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000125425 2024-09-17T02:21:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.464248+0000", 2024-09-17T02:21:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014018200000000001 2024-09-17T02:21:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:89488 5.a 5:5173aee4:::benchmark_data_smithi001_23533_object89487:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T02:21:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:13.464278+0000", 2024-09-17T02:21:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0027242640000000001, 2024-09-17T02:21:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030952459999999998, 2024-09-17T02:21:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 89488 2024-09-17T02:21:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.464278+0000", 2024-09-17T02:21:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.464278+0000", 2024-09-17T02:21:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.464279+0000", 2024-09-17T02:21:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7300000000000005e-07 2024-09-17T02:21:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.464356+0000", 2024-09-17T02:21:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7069000000000004e-05 2024-09-17T02:21:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.464366+0000", 2024-09-17T02:21:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.011e-05 2024-09-17T02:21:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.464373+0000", 2024-09-17T02:21:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.776e-06 2024-09-17T02:21:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466476+0000", 2024-09-17T02:21:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021027120000000001 2024-09-17T02:21:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466591+0000", 2024-09-17T02:21:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000114861 2024-09-17T02:21:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466723+0000", 2024-09-17T02:21:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000132655 2024-09-17T02:21:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:89489 5.6 5:6fcc8c89:::benchmark_data_smithi001_23533_object89488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T02:21:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:13.464407+0000", 2024-09-17T02:21:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.002595862, 2024-09-17T02:21:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030351219999999999, 2024-09-17T02:21:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 89489 2024-09-17T02:21:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.464407+0000", 2024-09-17T02:21:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.464407+0000", 2024-09-17T02:21:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.464407+0000", 2024-09-17T02:21:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.13e-07 2024-09-17T02:21:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.464443+0000", 2024-09-17T02:21:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5401000000000002e-05 2024-09-17T02:21:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.464453+0000", 2024-09-17T02:21:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6509999999999996e-06 2024-09-17T02:21:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.464458+0000", 2024-09-17T02:21:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6409999999999999e-06 2024-09-17T02:21:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.465233+0000", 2024-09-17T02:21:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00077435899999999996 2024-09-17T02:21:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.465354+0000", 2024-09-17T02:21:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000121688 2024-09-17T02:21:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.465527+0000", 2024-09-17T02:21:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000172459 2024-09-17T02:21:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:89490 5.5 5.a5a63c35 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T02:21:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:13.466429+0000", 2024-09-17T02:21:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00057372100000000002, 2024-09-17T02:21:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010793300000000001, 2024-09-17T02:21:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 89490 2024-09-17T02:21:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466429+0000", 2024-09-17T02:21:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466429+0000", 2024-09-17T02:21:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466430+0000", 2024-09-17T02:21:13.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7899999999999997e-07 2024-09-17T02:21:13.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466522+0000", 2024-09-17T02:21:13.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2398000000000005e-05 2024-09-17T02:21:13.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466532+0000", 2024-09-17T02:21:13.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5429999999999999e-06 2024-09-17T02:21:13.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466538+0000", 2024-09-17T02:21:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5030000000000002e-06 2024-09-17T02:21:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:89491 5.c 5.35c7433c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T02:21:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:13.466644+0000", 2024-09-17T02:21:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00035896000000000002, 2024-09-17T02:21:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000912995, 2024-09-17T02:21:13.505 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.505 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.505 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:13.505 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:13.505 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:13.505 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:13.505 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 89491 2024-09-17T02:21:13.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.505 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466644+0000", 2024-09-17T02:21:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466644+0000", 2024-09-17T02:21:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466644+0000", 2024-09-17T02:21:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4899999999999995e-07 2024-09-17T02:21:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466723+0000", 2024-09-17T02:21:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8541999999999994e-05 2024-09-17T02:21:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466733+0000", 2024-09-17T02:21:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0076e-05 2024-09-17T02:21:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466739+0000", 2024-09-17T02:21:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7690000000000002e-06 2024-09-17T02:21:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:89492 5.8 5:17dc5ea7:::benchmark_data_smithi001_23533_object89491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T02:21:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:13.466748+0000", 2024-09-17T02:21:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00025441899999999998, 2024-09-17T02:21:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000861606, 2024-09-17T02:21:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 89492 2024-09-17T02:21:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466748+0000", 2024-09-17T02:21:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466748+0000", 2024-09-17T02:21:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466749+0000", 2024-09-17T02:21:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8599999999999998e-07 2024-09-17T02:21:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466825+0000", 2024-09-17T02:21:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6087999999999994e-05 2024-09-17T02:21:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466834+0000", 2024-09-17T02:21:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3789999999999995e-06 2024-09-17T02:21:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466840+0000", 2024-09-17T02:21:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3159999999999996e-06 2024-09-17T02:21:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466893+0000", 2024-09-17T02:21:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3275000000000001e-05 2024-09-17T02:21:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.467020+0000", 2024-09-17T02:21:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012727800000000001 2024-09-17T02:21:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.467141+0000", 2024-09-17T02:21:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000121076 2024-09-17T02:21:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:89494 5.6 5:60023869:::benchmark_data_smithi001_23533_object89493:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T02:21:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:13.466903+0000", 2024-09-17T02:21:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00010006899999999999, 2024-09-17T02:21:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00077603199999999996, 2024-09-17T02:21:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-17T02:21:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 89494 2024-09-17T02:21:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466903+0000", 2024-09-17T02:21:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466903+0000", 2024-09-17T02:21:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466903+0000", 2024-09-17T02:21:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4300000000000003e-07 2024-09-17T02:21:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.467003+0000", 2024-09-17T02:21:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9579000000000003e-05 2024-09-17T02:21:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.467026+0000", 2024-09-17T02:21:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3088999999999999e-05 2024-09-17T02:21:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.467032+0000", 2024-09-17T02:21:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3489999999999997e-06 2024-09-17T02:21:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.467636+0000", 2024-09-17T02:21:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00060375700000000001 2024-09-17T02:21:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4466.0:89486 5.a e43/22)", 2024-09-17T02:21:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:13.467059+0000", 2024-09-17T02:21:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9999442, 2024-09-17T02:21:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00067260099999999999, 2024-09-17T02:21:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.467059+0000", 2024-09-17T02:21:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.467059+0000", 2024-09-17T02:21:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.467059+0000", 2024-09-17T02:21:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8400000000000005e-07 2024-09-17T02:21:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.467062+0000", 2024-09-17T02:21:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.368e-06 2024-09-17T02:21:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.467068+0000", 2024-09-17T02:21:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.64e-06 2024-09-17T02:21:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.467074+0000", 2024-09-17T02:21:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2769999999999996e-06 2024-09-17T02:21:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:89493 5.b e43/38 5:d6e6bb57:::benchmark_data_smithi001_23533_object89492:head v 43'5526, mlcod=43'5524)", 2024-09-17T02:21:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:13.467242+0000", 2024-09-17T02:21:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9997611, 2024-09-17T02:21:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00053469200000000002, 2024-09-17T02:21:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.467242+0000", 2024-09-17T02:21:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.467242+0000", 2024-09-17T02:21:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.467242+0000", 2024-09-17T02:21:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9999999999999998e-07 2024-09-17T02:21:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.467310+0000", 2024-09-17T02:21:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8190999999999998e-05 2024-09-17T02:21:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.467328+0000", 2024-09-17T02:21:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7588000000000002e-05 2024-09-17T02:21:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.467333+0000", 2024-09-17T02:21:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3210000000000004e-06 2024-09-17T02:21:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.467591+0000", 2024-09-17T02:21:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025763400000000002 2024-09-17T02:21:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.467612+0000", 2024-09-17T02:21:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1160000000000001e-05 2024-09-17T02:21:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.524 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.524 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:89474 5.c 5:31fea625:::benchmark_data_smithi001_23533_object89473:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T02:21:13.524 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:13.459634+0000", 2024-09-17T02:21:13.524 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0073688620000000003, 2024-09-17T02:21:13.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0082009040000000002, 2024-09-17T02:21:13.524 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.524 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.524 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:13.524 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:13.524 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:13.525 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:13.525 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 89474 2024-09-17T02:21:13.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.525 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.459634+0000", 2024-09-17T02:21:13.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.459634+0000", 2024-09-17T02:21:13.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.459635+0000", 2024-09-17T02:21:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.16e-07 2024-09-17T02:21:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.459682+0000", 2024-09-17T02:21:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7472999999999998e-05 2024-09-17T02:21:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.459693+0000", 2024-09-17T02:21:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0828e-05 2024-09-17T02:21:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.459705+0000", 2024-09-17T02:21:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2262999999999999e-05 2024-09-17T02:21:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.459754+0000", 2024-09-17T02:21:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8207000000000001e-05 2024-09-17T02:21:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.459868+0000", 2024-09-17T02:21:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000114024 2024-09-17T02:21:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.459960+0000", 2024-09-17T02:21:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2267000000000003e-05 2024-09-17T02:21:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463248+0000", 2024-09-17T02:21:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032877919999999999 2024-09-17T02:21:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:89482 5.8 5:1c6e131c:::benchmark_data_smithi001_23533_object89481:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T02:21:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:13.463213+0000", 2024-09-17T02:21:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.003789714, 2024-09-17T02:21:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047011589999999999, 2024-09-17T02:21:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 89482 2024-09-17T02:21:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463213+0000", 2024-09-17T02:21:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463213+0000", 2024-09-17T02:21:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463214+0000", 2024-09-17T02:21:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9199999999999999e-07 2024-09-17T02:21:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463247+0000", 2024-09-17T02:21:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2941999999999997e-05 2024-09-17T02:21:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463257+0000", 2024-09-17T02:21:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0046e-05 2024-09-17T02:21:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463264+0000", 2024-09-17T02:21:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0509999999999999e-06 2024-09-17T02:21:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463300+0000", 2024-09-17T02:21:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5614999999999997e-05 2024-09-17T02:21:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463458+0000", 2024-09-17T02:21:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015816499999999999 2024-09-17T02:21:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.463585+0000", 2024-09-17T02:21:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012694299999999999 2024-09-17T02:21:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:13.466657+0000", 2024-09-17T02:21:13.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030721099999999999 2024-09-17T02:21:13.534 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.534 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.534 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.534 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.534 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:21:13.534 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 15 2024-09-17T02:21:13.534 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:13.536 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:13.536 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:13.535+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:13.637 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:13.638+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:13.729 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:13.729 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:21:13.729 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:21:13.729 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:21:13.729 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:13.737 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:13.739+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:13.751 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:13.773 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 41 16 90124 90108 137.344 126.062 0.00392301 0.00727599 2024-09-17T02:21:13.838 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:13.839+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:13.905 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:13.906 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:21:13.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:21:13.906 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:13.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.906 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:13.906 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:21:13.906 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.346703263999999, 2024-09-17T02:21:13.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021799929999999999, 2024-09-17T02:21:13.906 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.906 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.906 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.907 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:21:13.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:21:13.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562007+0000", 2024-09-17T02:21:13.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6260000000000001e-06 2024-09-17T02:21:13.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562021+0000", 2024-09-17T02:21:13.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4440000000000001e-05 2024-09-17T02:21:13.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562053+0000", 2024-09-17T02:21:13.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2159000000000002e-05 2024-09-17T02:21:13.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562076+0000", 2024-09-17T02:21:13.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2926999999999999e-05 2024-09-17T02:21:13.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562218+0000", 2024-09-17T02:21:13.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000141726 2024-09-17T02:21:13.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562506+0000", 2024-09-17T02:21:13.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028752399999999999 2024-09-17T02:21:13.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:13.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562830+0000", 2024-09-17T02:21:13.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032427399999999999 2024-09-17T02:21:13.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:13.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566900+0000", 2024-09-17T02:21:13.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040705660000000003 2024-09-17T02:21:13.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583581+0000", 2024-09-17T02:21:13.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016680210000000001 2024-09-17T02:21:13.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:13.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583704+0000", 2024-09-17T02:21:13.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012289899999999999 2024-09-17T02:21:13.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:13.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583803+0000", 2024-09-17T02:21:13.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9579000000000003e-05 2024-09-17T02:21:13.913 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.913 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.913 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.914 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:13.914 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:21:13.914 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.346576052000003, 2024-09-17T02:21:13.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022056035000000002, 2024-09-17T02:21:13.914 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.914 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.914 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.914 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:21:13.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:21:13.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562132+0000", 2024-09-17T02:21:13.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6300000000000001e-06 2024-09-17T02:21:13.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562142+0000", 2024-09-17T02:21:13.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.022e-05 2024-09-17T02:21:13.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562164+0000", 2024-09-17T02:21:13.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2002999999999999e-05 2024-09-17T02:21:13.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562180+0000", 2024-09-17T02:21:13.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5930000000000002e-05 2024-09-17T02:21:13.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563517+0000", 2024-09-17T02:21:13.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001336776 2024-09-17T02:21:13.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563635+0000", 2024-09-17T02:21:13.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117976 2024-09-17T02:21:13.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:13.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563819+0000", 2024-09-17T02:21:13.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018411499999999999 2024-09-17T02:21:13.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:13.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566977+0000", 2024-09-17T02:21:13.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031575990000000001 2024-09-17T02:21:13.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583917+0000", 2024-09-17T02:21:13.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016940093999999999 2024-09-17T02:21:13.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:13.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584066+0000", 2024-09-17T02:21:13.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000149746 2024-09-17T02:21:13.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:13.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584186+0000", 2024-09-17T02:21:13.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011994600000000001 2024-09-17T02:21:13.919 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.919 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.919 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.920 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:13.920 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:13.920 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.346395340999997, 2024-09-17T02:21:13.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023664803000000002, 2024-09-17T02:21:13.920 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.920 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.920 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.920 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:13.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:13.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562313+0000", 2024-09-17T02:21:13.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.764e-06 2024-09-17T02:21:13.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562323+0000", 2024-09-17T02:21:13.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0166000000000001e-05 2024-09-17T02:21:13.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562343+0000", 2024-09-17T02:21:13.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9633999999999999e-05 2024-09-17T02:21:13.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562367+0000", 2024-09-17T02:21:13.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4556e-05 2024-09-17T02:21:13.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563777+0000", 2024-09-17T02:21:13.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014102330000000001 2024-09-17T02:21:13.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563969+0000", 2024-09-17T02:21:13.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000191361 2024-09-17T02:21:13.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:13.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564148+0000", 2024-09-17T02:21:13.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017934599999999999 2024-09-17T02:21:13.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:13.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566989+0000", 2024-09-17T02:21:13.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028407010000000002 2024-09-17T02:21:13.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585770+0000", 2024-09-17T02:21:13.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018781566999999999 2024-09-17T02:21:13.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:13.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585874+0000", 2024-09-17T02:21:13.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103489 2024-09-17T02:21:13.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:13.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585976+0000", 2024-09-17T02:21:13.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101986 2024-09-17T02:21:13.926 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.926 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.926 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.926 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:13.926 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:13.926 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.346312460999997, 2024-09-17T02:21:13.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024118555999999999, 2024-09-17T02:21:13.927 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.927 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.927 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.927 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:13.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:13.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562395+0000", 2024-09-17T02:21:13.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3969999999999999e-06 2024-09-17T02:21:13.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562405+0000", 2024-09-17T02:21:13.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4229999999999994e-06 2024-09-17T02:21:13.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562427+0000", 2024-09-17T02:21:13.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759999999999998e-05 2024-09-17T02:21:13.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562444+0000", 2024-09-17T02:21:13.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7019000000000001e-05 2024-09-17T02:21:13.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564681+0000", 2024-09-17T02:21:13.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022376929999999998 2024-09-17T02:21:13.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564887+0000", 2024-09-17T02:21:13.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000206178 2024-09-17T02:21:13.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:13.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565230+0000", 2024-09-17T02:21:13.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034233499999999998 2024-09-17T02:21:13.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:13.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567000+0000", 2024-09-17T02:21:13.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017706390000000001 2024-09-17T02:21:13.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586126+0000", 2024-09-17T02:21:13.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019125672 2024-09-17T02:21:13.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:13.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586314+0000", 2024-09-17T02:21:13.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018740200000000001 2024-09-17T02:21:13.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:13.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586513+0000", 2024-09-17T02:21:13.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019903799999999999 2024-09-17T02:21:13.932 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.932 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.932 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.933 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:13.933 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:21:13.933 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.346237788000003, 2024-09-17T02:21:13.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021940779000000001, 2024-09-17T02:21:13.933 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.933 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.933 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.933 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:21:13.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:21:13.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562470+0000", 2024-09-17T02:21:13.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5030000000000001e-06 2024-09-17T02:21:13.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562478+0000", 2024-09-17T02:21:13.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.157e-06 2024-09-17T02:21:13.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562496+0000", 2024-09-17T02:21:13.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7876e-05 2024-09-17T02:21:13.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562511+0000", 2024-09-17T02:21:13.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5067e-05 2024-09-17T02:21:13.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564628+0000", 2024-09-17T02:21:13.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021171860000000001 2024-09-17T02:21:13.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564838+0000", 2024-09-17T02:21:13.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000209283 2024-09-17T02:21:13.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:13.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565078+0000", 2024-09-17T02:21:13.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024075100000000001 2024-09-17T02:21:13.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:13.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567012+0000", 2024-09-17T02:21:13.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019331050000000001 2024-09-17T02:21:13.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584289+0000", 2024-09-17T02:21:13.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017277464999999999 2024-09-17T02:21:13.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:13.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584363+0000", 2024-09-17T02:21:13.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3852999999999999e-05 2024-09-17T02:21:13.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:13.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584409+0000", 2024-09-17T02:21:13.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6533000000000003e-05 2024-09-17T02:21:13.938 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.938 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.938 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.939 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:13.939 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:21:13.939 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.346174398999999, 2024-09-17T02:21:13.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020580694, 2024-09-17T02:21:13.939 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.939 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.939 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.939 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:21:13.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562532+0000", 2024-09-17T02:21:13.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562533+0000", 2024-09-17T02:21:13.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3239999999999999e-06 2024-09-17T02:21:13.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562541+0000", 2024-09-17T02:21:13.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3529999999999997e-06 2024-09-17T02:21:13.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562559+0000", 2024-09-17T02:21:13.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8306000000000001e-05 2024-09-17T02:21:13.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562572+0000", 2024-09-17T02:21:13.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2993000000000001e-05 2024-09-17T02:21:13.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563230+0000", 2024-09-17T02:21:13.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00065806899999999995 2024-09-17T02:21:13.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563510+0000", 2024-09-17T02:21:13.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028016400000000001 2024-09-17T02:21:13.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:13.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563677+0000", 2024-09-17T02:21:13.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000166243 2024-09-17T02:21:13.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:13.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566312+0000", 2024-09-17T02:21:13.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026351349999999998 2024-09-17T02:21:13.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.582943+0000", 2024-09-17T02:21:13.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016631781000000002 2024-09-17T02:21:13.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:13.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583035+0000", 2024-09-17T02:21:13.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1682999999999996e-05 2024-09-17T02:21:13.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:13.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583113+0000", 2024-09-17T02:21:13.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7643000000000002e-05 2024-09-17T02:21:13.944 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.945 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.945 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.945 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:13.945 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:21:13.945 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.346067339000001, 2024-09-17T02:21:13.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020802284000000001, 2024-09-17T02:21:13.945 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.945 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.945 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:13.945 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:21:13.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562639+0000", 2024-09-17T02:21:13.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562640+0000", 2024-09-17T02:21:13.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.37e-06 2024-09-17T02:21:13.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562648+0000", 2024-09-17T02:21:13.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.576e-06 2024-09-17T02:21:13.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562668+0000", 2024-09-17T02:21:13.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0397000000000001e-05 2024-09-17T02:21:13.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562690+0000", 2024-09-17T02:21:13.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1713e-05 2024-09-17T02:21:13.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564290+0000", 2024-09-17T02:21:13.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001599397 2024-09-17T02:21:13.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564527+0000", 2024-09-17T02:21:13.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023731199999999999 2024-09-17T02:21:13.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:13.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583441+0000", 2024-09-17T02:21:13.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018914519000000001 2024-09-17T02:21:13.949 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.949 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.949 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.949 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:13.949 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:21:13.949 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.345992264000003, 2024-09-17T02:21:13.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021867154, 2024-09-17T02:21:13.949 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.949 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.950 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:13.950 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:21:13.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:21:13.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562716+0000", 2024-09-17T02:21:13.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.384e-06 2024-09-17T02:21:13.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562726+0000", 2024-09-17T02:21:13.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.04e-05 2024-09-17T02:21:13.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562745+0000", 2024-09-17T02:21:13.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8770000000000002e-05 2024-09-17T02:21:13.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562759+0000", 2024-09-17T02:21:13.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4392999999999999e-05 2024-09-17T02:21:13.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565882+0000", 2024-09-17T02:21:13.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031227659999999999 2024-09-17T02:21:13.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566217+0000", 2024-09-17T02:21:13.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033498000000000002 2024-09-17T02:21:13.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:13.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584581+0000", 2024-09-17T02:21:13.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018364460999999999 2024-09-17T02:21:13.953 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.953 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.953 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.953 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:13.954 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:13.954 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.340243356999999, 2024-09-17T02:21:13.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:21:13.954 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.954 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.954 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.954 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:13.954 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:13.954 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:13.954 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:21:13.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.954 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:13.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:13.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:21:13.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:21:13.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:21:13.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:21:13.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:21:13.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:21:13.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:21:13.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:21:13.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:21:13.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:21:13.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:21:13.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:21:13.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:13.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:21:13.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:21:13.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:13.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:21:13.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:21:13.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:21:13.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:21:13.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:13.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:21:13.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:21:13.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:13.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:21:13.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:21:13.960 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.960 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.960 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.960 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:13.961 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:13.961 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.336341106999999, 2024-09-17T02:21:13.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:21:13.961 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.961 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.961 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.961 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:13.961 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:13.961 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:13.962 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:21:13.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.962 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:13.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:13.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:21:13.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:21:13.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:21:13.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:21:13.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:21:13.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:21:13.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:21:13.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:21:13.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:21:13.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:21:13.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:21:13.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:21:13.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:13.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:21:13.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:21:13.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:13.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:21:13.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:21:13.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:13.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:21:13.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:21:13.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:13.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:21:13.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:21:13.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:13.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:21:13.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:21:13.966 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.967 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.967 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.967 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71190 5.3 e39/38 5:c99e0ae2:::benchmark_data_smithi001_23533_object71189:head v 39'4516, mlcod=35'4513)", 2024-09-17T02:21:13.967 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.607413+0000", 2024-09-17T02:21:13.967 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.3012930830000009, 2024-09-17T02:21:13.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023407462, 2024-09-17T02:21:13.967 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.967 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.967 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.967 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607413+0000", 2024-09-17T02:21:13.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607413+0000", 2024-09-17T02:21:13.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607415+0000", 2024-09-17T02:21:13.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2139999999999999e-06 2024-09-17T02:21:13.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607479+0000", 2024-09-17T02:21:13.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4374000000000004e-05 2024-09-17T02:21:13.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607496+0000", 2024-09-17T02:21:13.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6820000000000002e-05 2024-09-17T02:21:13.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607512+0000", 2024-09-17T02:21:13.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5976000000000001e-05 2024-09-17T02:21:13.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609288+0000", 2024-09-17T02:21:13.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001776311 2024-09-17T02:21:13.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609327+0000", 2024-09-17T02:21:13.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9165999999999997e-05 2024-09-17T02:21:13.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:13.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630723+0000", 2024-09-17T02:21:13.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021395290000000001 2024-09-17T02:21:13.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:13.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630821+0000", 2024-09-17T02:21:13.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8311000000000001e-05 2024-09-17T02:21:13.971 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.971 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.971 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.972 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71206 5.3 e39/38 5:c6c9386d:::benchmark_data_smithi001_23533_object71205:head v 39'4517, mlcod=35'4513)", 2024-09-17T02:21:13.972 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:13.972 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.2990139920000008, 2024-09-17T02:21:13.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026101868, 2024-09-17T02:21:13.972 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.972 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.972 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.972 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:13.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:13.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609694+0000", 2024-09-17T02:21:13.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9539999999999998e-06 2024-09-17T02:21:13.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609841+0000", 2024-09-17T02:21:13.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014690800000000001 2024-09-17T02:21:13.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609872+0000", 2024-09-17T02:21:13.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0326000000000001e-05 2024-09-17T02:21:13.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609892+0000", 2024-09-17T02:21:13.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9848999999999999e-05 2024-09-17T02:21:13.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613826+0000", 2024-09-17T02:21:13.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039345140000000001 2024-09-17T02:21:13.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613908+0000", 2024-09-17T02:21:13.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2412999999999999e-05 2024-09-17T02:21:13.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:13.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635696+0000", 2024-09-17T02:21:13.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021787597999999998 2024-09-17T02:21:13.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:13.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635794+0000", 2024-09-17T02:21:13.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8306000000000004e-05 2024-09-17T02:21:13.976 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.976 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.976 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.976 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71210 5.3 e39/38 5:c0498d13:::benchmark_data_smithi001_23533_object71209:head v 39'4518, mlcod=35'4513)", 2024-09-17T02:21:13.976 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:13.976 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.2975360259999995, 2024-09-17T02:21:13.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024703197, 2024-09-17T02:21:13.976 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.976 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.977 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.977 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:13.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:13.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611172+0000", 2024-09-17T02:21:13.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6470000000000001e-06 2024-09-17T02:21:13.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611344+0000", 2024-09-17T02:21:13.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000171607 2024-09-17T02:21:13.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611389+0000", 2024-09-17T02:21:13.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5738000000000002e-05 2024-09-17T02:21:13.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611407+0000", 2024-09-17T02:21:13.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7893e-05 2024-09-17T02:21:13.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617820+0000", 2024-09-17T02:21:13.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064131070000000004 2024-09-17T02:21:13.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617885+0000", 2024-09-17T02:21:13.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4442000000000004e-05 2024-09-17T02:21:13.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:13.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635806+0000", 2024-09-17T02:21:13.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017920874999999999 2024-09-17T02:21:13.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:13.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635874+0000", 2024-09-17T02:21:13.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7887999999999998e-05 2024-09-17T02:21:13.980 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.980 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.980 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.980 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71213 5.3 e39/38 5:ce9071a1:::benchmark_data_smithi001_23533_object71212:head v 39'4519, mlcod=35'4513)", 2024-09-17T02:21:13.980 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.613453+0000", 2024-09-17T02:21:13.981 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.2952535150000006, 2024-09-17T02:21:13.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022494631000000001, 2024-09-17T02:21:13.981 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.981 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.981 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.981 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613453+0000", 2024-09-17T02:21:13.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613453+0000", 2024-09-17T02:21:13.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613455+0000", 2024-09-17T02:21:13.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.703e-06 2024-09-17T02:21:13.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613594+0000", 2024-09-17T02:21:13.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000139405 2024-09-17T02:21:13.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613625+0000", 2024-09-17T02:21:13.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0993e-05 2024-09-17T02:21:13.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613646+0000", 2024-09-17T02:21:13.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0761999999999999e-05 2024-09-17T02:21:13.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.620855+0000", 2024-09-17T02:21:13.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0072088270000000001 2024-09-17T02:21:13.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.620933+0000", 2024-09-17T02:21:13.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8807000000000006e-05 2024-09-17T02:21:13.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:13.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635882+0000", 2024-09-17T02:21:13.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014948530999999999 2024-09-17T02:21:13.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:13.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635948+0000", 2024-09-17T02:21:13.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5603000000000002e-05 2024-09-17T02:21:13.984 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.985 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.985 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.985 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71214 5.3 e39/38 5:c5e24f3f:::benchmark_data_smithi001_23533_object71213:head v 39'4520, mlcod=35'4513)", 2024-09-17T02:21:13.985 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:13.985 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.2931717939999992, 2024-09-17T02:21:13.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024251297000000002, 2024-09-17T02:21:13.985 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.985 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.985 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.986 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:13.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:13.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615536+0000", 2024-09-17T02:21:13.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5370000000000001e-06 2024-09-17T02:21:13.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615696+0000", 2024-09-17T02:21:13.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015948700000000001 2024-09-17T02:21:13.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615723+0000", 2024-09-17T02:21:13.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7518999999999999e-05 2024-09-17T02:21:13.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615742+0000", 2024-09-17T02:21:13.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8519999999999999e-05 2024-09-17T02:21:13.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.624440+0000", 2024-09-17T02:21:13.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0086983080000000001 2024-09-17T02:21:13.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.624489+0000", 2024-09-17T02:21:13.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8838000000000002e-05 2024-09-17T02:21:13.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:13.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639673+0000", 2024-09-17T02:21:13.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01518451 2024-09-17T02:21:13.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:13.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639786+0000", 2024-09-17T02:21:13.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011257800000000001 2024-09-17T02:21:13.989 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.990 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.990 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.990 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71215 5.3 e39/38 5:c5603662:::benchmark_data_smithi001_23533_object71214:head v 39'4521, mlcod=35'4513)", 2024-09-17T02:21:13.990 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.617466+0000", 2024-09-17T02:21:13.990 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.291240814, 2024-09-17T02:21:13.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022395379999999999, 2024-09-17T02:21:13.990 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.990 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.990 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.990 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617466+0000", 2024-09-17T02:21:13.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617466+0000", 2024-09-17T02:21:13.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617467+0000", 2024-09-17T02:21:13.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3600000000000002e-07 2024-09-17T02:21:13.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617521+0000", 2024-09-17T02:21:13.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4654999999999998e-05 2024-09-17T02:21:13.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617548+0000", 2024-09-17T02:21:13.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6706000000000001e-05 2024-09-17T02:21:13.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617566+0000", 2024-09-17T02:21:13.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7989e-05 2024-09-17T02:21:13.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.627598+0000", 2024-09-17T02:21:13.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010031854 2024-09-17T02:21:13.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.627656+0000", 2024-09-17T02:21:13.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8511999999999998e-05 2024-09-17T02:21:13.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:13.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639794+0000", 2024-09-17T02:21:13.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012137445 2024-09-17T02:21:13.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:13.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639861+0000", 2024-09-17T02:21:13.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7282999999999999e-05 2024-09-17T02:21:13.994 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.995 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.995 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.995 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71230 5.3 e39/38 5:c9397868:::benchmark_data_smithi001_23533_object71229:head v 39'4522, mlcod=35'4513)", 2024-09-17T02:21:13.995 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.619689+0000", 2024-09-17T02:21:13.995 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.2890177880000007, 2024-09-17T02:21:13.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020242406000000001, 2024-09-17T02:21:13.995 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:13.995 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:13.995 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:13.995 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:13.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:13.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.619689+0000", 2024-09-17T02:21:13.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:13.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.619689+0000", 2024-09-17T02:21:13.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:13.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:13.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.619690+0000", 2024-09-17T02:21:13.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.623e-06 2024-09-17T02:21:13.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:13.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.619753+0000", 2024-09-17T02:21:13.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3124000000000001e-05 2024-09-17T02:21:13.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:13.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.619776+0000", 2024-09-17T02:21:13.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2682999999999999e-05 2024-09-17T02:21:13.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:13.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.619790+0000", 2024-09-17T02:21:13.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4283e-05 2024-09-17T02:21:13.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:13.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630908+0000", 2024-09-17T02:21:13.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011117217 2024-09-17T02:21:13.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:13.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630968+0000", 2024-09-17T02:21:13.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0724999999999999e-05 2024-09-17T02:21:13.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:13.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639865+0000", 2024-09-17T02:21:13.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0088964430000000004 2024-09-17T02:21:13.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:13.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:13.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639931+0000", 2024-09-17T02:21:13.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6308000000000003e-05 2024-09-17T02:21:13.999 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.999 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:13.999 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:13.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:13.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:71277 5.a 5:5576e9b8:::benchmark_data_smithi001_23533_object71276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.630891+0000", 2024-09-17T02:21:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.2778152739999999, 2024-09-17T02:21:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022210245999999999, 2024-09-17T02:21:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71277 2024-09-17T02:21:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:14.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:14.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630891+0000", 2024-09-17T02:21:14.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:14.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:14.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630891+0000", 2024-09-17T02:21:14.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:14.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:14.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630893+0000", 2024-09-17T02:21:14.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-09-17T02:21:14.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:14.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630961+0000", 2024-09-17T02:21:14.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7971000000000004e-05 2024-09-17T02:21:14.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:14.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630989+0000", 2024-09-17T02:21:14.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7855999999999999e-05 2024-09-17T02:21:14.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631010+0000", 2024-09-17T02:21:14.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0888999999999999e-05 2024-09-17T02:21:14.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:14.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631123+0000", 2024-09-17T02:21:14.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011292 2024-09-17T02:21:14.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:14.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631434+0000", 2024-09-17T02:21:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00031039199999999999 2024-09-17T02:21:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631679+0000", 2024-09-17T02:21:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024517099999999997 2024-09-17T02:21:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.636619+0000", 2024-09-17T02:21:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049405339999999999 2024-09-17T02:21:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.652851+0000", 2024-09-17T02:21:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016231440999999999 2024-09-17T02:21:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.653012+0000", 2024-09-17T02:21:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016157199999999999 2024-09-17T02:21:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.653101+0000", 2024-09-17T02:21:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9190000000000005e-05 2024-09-17T02:21:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:71283 5.a 5:520c97e2:::benchmark_data_smithi001_23533_object71282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.636969+0000", 2024-09-17T02:21:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.2717378969999995, 2024-09-17T02:21:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020377408, 2024-09-17T02:21:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71283 2024-09-17T02:21:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.636969+0000", 2024-09-17T02:21:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.636969+0000", 2024-09-17T02:21:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.636971+0000", 2024-09-17T02:21:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.402e-06 2024-09-17T02:21:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.637034+0000", 2024-09-17T02:21:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3460999999999994e-05 2024-09-17T02:21:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:14.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.637058+0000", 2024-09-17T02:21:14.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3615999999999999e-05 2024-09-17T02:21:14.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.637071+0000", 2024-09-17T02:21:14.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3157e-05 2024-09-17T02:21:14.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:14.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.637238+0000", 2024-09-17T02:21:14.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000167016 2024-09-17T02:21:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.637483+0000", 2024-09-17T02:21:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024506799999999998 2024-09-17T02:21:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.637677+0000", 2024-09-17T02:21:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000193771 2024-09-17T02:21:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.644539+0000", 2024-09-17T02:21:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0068624259999999996 2024-09-17T02:21:14.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:14.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.657109+0000", 2024-09-17T02:21:14.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012569258999999999 2024-09-17T02:21:14.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:14.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.657249+0000", 2024-09-17T02:21:14.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014017200000000001 2024-09-17T02:21:14.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:14.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.657346+0000", 2024-09-17T02:21:14.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7059999999999996e-05 2024-09-17T02:21:14.012 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:14.012 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:14.012 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:14.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.012 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:71320 5.8 5:1cc902ac:::benchmark_data_smithi001_23533_object71319:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:14.012 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.664873+0000", 2024-09-17T02:21:14.012 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.2438336719999992, 2024-09-17T02:21:14.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019295593999999999, 2024-09-17T02:21:14.012 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:14.012 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:14.013 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:14.013 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:14.013 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:14.013 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:14.013 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71320 2024-09-17T02:21:14.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.013 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:14.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:14.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.664873+0000", 2024-09-17T02:21:14.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:14.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:14.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.664873+0000", 2024-09-17T02:21:14.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:14.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:14.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.664875+0000", 2024-09-17T02:21:14.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.368e-06 2024-09-17T02:21:14.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:14.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.665035+0000", 2024-09-17T02:21:14.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000159927 2024-09-17T02:21:14.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:14.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.665057+0000", 2024-09-17T02:21:14.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1668999999999999e-05 2024-09-17T02:21:14.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.665070+0000", 2024-09-17T02:21:14.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.346e-05 2024-09-17T02:21:14.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:14.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.665171+0000", 2024-09-17T02:21:14.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010123 2024-09-17T02:21:14.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:14.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.665518+0000", 2024-09-17T02:21:14.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034674499999999997 2024-09-17T02:21:14.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:14.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.665832+0000", 2024-09-17T02:21:14.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00031377199999999998 2024-09-17T02:21:14.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:14.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.674660+0000", 2024-09-17T02:21:14.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0088280939999999999 2024-09-17T02:21:14.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:14.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.684078+0000", 2024-09-17T02:21:14.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0094177770000000004 2024-09-17T02:21:14.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:14.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.684128+0000", 2024-09-17T02:21:14.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9706999999999997e-05 2024-09-17T02:21:14.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:14.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:14.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:14.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.684168+0000", 2024-09-17T02:21:14.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0844999999999999e-05 2024-09-17T02:21:14.018 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:14.018 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:14.018 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:14.018 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:14.018 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:14.018 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:14.020 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:21:14.021 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:14.019+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:14.120 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:14.122+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:14.177 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:21:14.177 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-17T02:21:14.177 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.177 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:90943 5.9 5:935f98c1:::benchmark_data_smithi001_23533_object90942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T02:21:14.177 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:14.179076+0000", 2024-09-17T02:21:14.177 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0017117860000000001, 2024-09-17T02:21:14.178 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0017333120000000001, 2024-09-17T02:21:14.178 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:14.178 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:14.178 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:14.178 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:14.178 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:14.178 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:14.178 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 90943 2024-09-17T02:21:14.178 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.178 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:14.178 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.178 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:14.178 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.179076+0000", 2024-09-17T02:21:14.179 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.179 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.179 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.179 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:14.179 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.179076+0000", 2024-09-17T02:21:14.179 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.179 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.179 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.179 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:14.179 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.179077+0000", 2024-09-17T02:21:14.179 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1399999999999995e-07 2024-09-17T02:21:14.179 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.179 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.179 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:14.180 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.179118+0000", 2024-09-17T02:21:14.180 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0822000000000003e-05 2024-09-17T02:21:14.180 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.180 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.180 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:14.180 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.179130+0000", 2024-09-17T02:21:14.180 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1659e-05 2024-09-17T02:21:14.180 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.180 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.180 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.180 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.179144+0000", 2024-09-17T02:21:14.180 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3954000000000001e-05 2024-09-17T02:21:14.181 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.181 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.181 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:14.181 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.179630+0000", 2024-09-17T02:21:14.181 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00048670799999999998 2024-09-17T02:21:14.181 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.181 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.181 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:14.181 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.179702+0000", 2024-09-17T02:21:14.181 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1716000000000003e-05 2024-09-17T02:21:14.181 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.181 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.181 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:14.182 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.179814+0000", 2024-09-17T02:21:14.182 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112339 2024-09-17T02:21:14.182 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.182 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.182 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.182 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.182 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.182 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:90944 5.d 5:b08a0777:::benchmark_data_smithi001_23533_object90943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T02:21:14.182 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:14.179310+0000", 2024-09-17T02:21:14.182 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0014779120000000001, 2024-09-17T02:21:14.182 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001552122, 2024-09-17T02:21:14.182 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:14.182 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:14.183 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:14.183 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:14.183 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:14.183 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:14.183 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 90944 2024-09-17T02:21:14.183 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.183 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:14.183 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.183 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:14.183 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.179310+0000", 2024-09-17T02:21:14.183 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.183 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.183 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.183 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:14.184 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.179310+0000", 2024-09-17T02:21:14.184 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.184 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.184 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.184 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:14.184 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.179311+0000", 2024-09-17T02:21:14.184 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7000000000000005e-07 2024-09-17T02:21:14.184 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.184 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.184 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:14.184 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.179382+0000", 2024-09-17T02:21:14.184 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1582999999999995e-05 2024-09-17T02:21:14.184 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.185 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.185 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:14.185 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.179390+0000", 2024-09-17T02:21:14.185 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5780000000000001e-06 2024-09-17T02:21:14.185 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.185 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.185 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.185 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.179394+0000", 2024-09-17T02:21:14.185 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6260000000000003e-06 2024-09-17T02:21:14.185 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.185 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.185 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:14.186 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.180285+0000", 2024-09-17T02:21:14.186 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00089052200000000004 2024-09-17T02:21:14.186 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.186 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.186 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:14.186 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.180370+0000", 2024-09-17T02:21:14.186 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5543000000000004e-05 2024-09-17T02:21:14.186 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.186 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.186 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:14.186 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.180506+0000", 2024-09-17T02:21:14.186 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000135566 2024-09-17T02:21:14.187 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.187 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.187 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.187 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.187 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.187 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:90948 5.3 5:c6872584:::benchmark_data_smithi001_23533_object90947:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T02:21:14.187 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:14.180566+0000", 2024-09-17T02:21:14.187 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.000222365, 2024-09-17T02:21:14.187 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00034117199999999999, 2024-09-17T02:21:14.187 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:14.187 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:14.187 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "reached pg", 2024-09-17T02:21:14.187 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:14.188 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:14.188 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:14.188 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 90948 2024-09-17T02:21:14.188 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.188 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:14.188 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.188 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:14.188 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.180566+0000", 2024-09-17T02:21:14.188 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.188 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.188 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.188 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:14.189 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.180566+0000", 2024-09-17T02:21:14.189 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.189 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.189 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.189 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:14.189 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.180567+0000", 2024-09-17T02:21:14.189 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0699999999999996e-07 2024-09-17T02:21:14.189 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.189 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.189 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:14.189 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.180668+0000", 2024-09-17T02:21:14.189 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000101062 2024-09-17T02:21:14.189 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.190 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.190 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:14.190 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.180700+0000", 2024-09-17T02:21:14.190 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2793000000000003e-05 2024-09-17T02:21:14.190 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.190 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.190 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.190 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.180713+0000", 2024-09-17T02:21:14.190 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2639e-05 2024-09-17T02:21:14.190 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.190 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.190 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:14.190 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.180818+0000", 2024-09-17T02:21:14.191 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000105343 2024-09-17T02:21:14.191 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.191 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.191 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.191 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.191 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.191 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:90951 5.d 5.78a31a9d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T02:21:14.191 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:14.180804+0000", 2024-09-17T02:21:14.191 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4294967295.9999843, 2024-09-17T02:21:14.191 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000147026, 2024-09-17T02:21:14.191 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:14.191 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:14.191 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:14.191 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:14.192 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:14.192 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:14.192 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 90951 2024-09-17T02:21:14.192 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.192 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:14.192 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.192 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:14.192 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.180804+0000", 2024-09-17T02:21:14.192 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.192 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.192 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.192 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:14.192 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.180804+0000", 2024-09-17T02:21:14.193 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.193 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.193 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.193 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:14.193 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.180805+0000", 2024-09-17T02:21:14.193 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.9000000000000005e-07 2024-09-17T02:21:14.193 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.193 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.193 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:14.193 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.180906+0000", 2024-09-17T02:21:14.193 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000101061 2024-09-17T02:21:14.193 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.194 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.194 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:14.194 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.180916+0000", 2024-09-17T02:21:14.194 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8199999999999992e-06 2024-09-17T02:21:14.194 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.194 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.194 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.194 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.180923+0000", 2024-09-17T02:21:14.194 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1289999999999998e-06 2024-09-17T02:21:14.194 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.194 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.194 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.194 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.194 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.195 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:90947 5.4 e43/36)", 2024-09-17T02:21:14.195 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:14.180944+0000", 2024-09-17T02:21:14.195 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4294967295.9998441, 2024-09-17T02:21:14.195 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.5974000000000003e-05, 2024-09-17T02:21:14.195 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:14.195 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:14.195 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:14.195 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:14.195 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.195 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:14.195 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.180944+0000", 2024-09-17T02:21:14.195 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.196 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.196 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.196 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:14.196 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.180944+0000", 2024-09-17T02:21:14.196 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.196 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.196 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.196 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:14.196 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.180945+0000", 2024-09-17T02:21:14.196 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8100000000000002e-07 2024-09-17T02:21:14.196 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.196 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.196 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:14.197 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.180950+0000", 2024-09-17T02:21:14.197 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4040000000000003e-06 2024-09-17T02:21:14.197 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.197 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.197 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:14.197 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.180960+0000", 2024-09-17T02:21:14.197 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.011e-05 2024-09-17T02:21:14.197 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.197 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.197 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.197 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.180967+0000", 2024-09-17T02:21:14.197 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4910000000000002e-06 2024-09-17T02:21:14.197 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.198 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.198 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.198 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.198 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.198 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:90939 5.9 5:9d98b774:::benchmark_data_smithi001_23533_object90938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T02:21:14.198 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:14.177579+0000", 2024-09-17T02:21:14.198 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0032089990000000001, 2024-09-17T02:21:14.198 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003466116, 2024-09-17T02:21:14.198 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:14.198 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:14.198 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:14.198 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:14.198 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:14.198 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:14.199 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 90939 2024-09-17T02:21:14.199 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.199 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:14.199 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.199 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:14.199 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.177579+0000", 2024-09-17T02:21:14.199 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.199 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.199 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.199 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:14.199 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.177579+0000", 2024-09-17T02:21:14.199 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.199 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.200 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.200 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:14.200 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.177581+0000", 2024-09-17T02:21:14.200 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5430000000000001e-06 2024-09-17T02:21:14.200 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.200 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.200 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:14.200 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.177655+0000", 2024-09-17T02:21:14.200 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4777000000000006e-05 2024-09-17T02:21:14.200 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.200 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.200 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:14.200 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.177667+0000", 2024-09-17T02:21:14.201 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1369000000000001e-05 2024-09-17T02:21:14.201 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.201 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.201 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.201 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.177682+0000", 2024-09-17T02:21:14.201 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5252000000000001e-05 2024-09-17T02:21:14.201 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.201 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.201 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:14.201 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.177747+0000", 2024-09-17T02:21:14.201 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5512999999999994e-05 2024-09-17T02:21:14.201 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.201 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.202 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:14.202 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.177850+0000", 2024-09-17T02:21:14.202 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010255900000000001 2024-09-17T02:21:14.202 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.202 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.202 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:14.202 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.177946+0000", 2024-09-17T02:21:14.202 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6491999999999997e-05 2024-09-17T02:21:14.202 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.202 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.202 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:14.202 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.181025+0000", 2024-09-17T02:21:14.202 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0030788529999999999 2024-09-17T02:21:14.202 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.203 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.203 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.203 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.203 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.203 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:90938 5.6 e43/22 5:63f53985:::benchmark_data_smithi001_23533_object90937:head v 43'5620, mlcod=43'5617)", 2024-09-17T02:21:14.203 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:14.177941+0000", 2024-09-17T02:21:14.203 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.002847362, 2024-09-17T02:21:14.203 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0031516690000000002, 2024-09-17T02:21:14.203 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:14.203 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:14.203 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:21:14.203 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:14.203 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.204 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:14.204 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.177941+0000", 2024-09-17T02:21:14.204 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.204 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.204 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.204 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:14.204 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.177941+0000", 2024-09-17T02:21:14.204 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.204 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.204 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.204 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:14.204 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.177941+0000", 2024-09-17T02:21:14.204 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4799999999999997e-07 2024-09-17T02:21:14.205 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.205 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.205 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:14.205 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.178009+0000", 2024-09-17T02:21:14.205 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7873000000000006e-05 2024-09-17T02:21:14.205 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.205 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.205 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:14.205 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.178021+0000", 2024-09-17T02:21:14.205 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2150999999999999e-05 2024-09-17T02:21:14.205 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.205 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.205 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.205 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.178028+0000", 2024-09-17T02:21:14.206 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9630000000000001e-06 2024-09-17T02:21:14.206 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.206 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.206 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:14.206 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.178069+0000", 2024-09-17T02:21:14.206 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0819999999999999e-05 2024-09-17T02:21:14.206 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.206 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.206 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:14.206 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:14.178089+0000", 2024-09-17T02:21:14.206 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9491999999999999e-05 2024-09-17T02:21:14.206 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.206 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.206 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.207 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.207 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-09-17T02:21:14.207 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 7 2024-09-17T02:21:14.207 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:21:14.208 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:21:14.252 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:14.255+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:14.322 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:14.322+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:14.366 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:21:14.367 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-17T02:21:14.367 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-09-17T02:21:14.367 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-09-17T02:21:14.367 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:21:14.387 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:21:14.422 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:14.422+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:14.523 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-17T02:21:14.523 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T02:21:14.524 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-09-17T02:21:14.524 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-17T02:21:14.524 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-17T02:21:14.524 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-09-17T02:21:14.525 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:14.526+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:14.542 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T02:21:14.590 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:21:14.590 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-09-17T02:21:14.590 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-09-17T02:21:14.590 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-17T02:21:14.590 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.590 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-17T02:21:14.591 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:21:14.591 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 70.132792166000002, 2024-09-17T02:21:14.591 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.15597325500000001, 2024-09-17T02:21:14.591 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:14.591 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:14.591 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:14.591 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:14.591 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4164", 2024-09-17T02:21:14.591 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/201892753", 2024-09-17T02:21:14.591 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 1 2024-09-17T02:21:14.591 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.591 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:14.591 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.592 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:14.592 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:21:14.592 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.592 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.592 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.592 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:14.592 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:21:14.592 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.592 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.592 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.592 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:14.592 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458359+0000", 2024-09-17T02:21:14.592 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3929999999999998e-06 2024-09-17T02:21:14.593 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.593 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.593 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:14.593 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458373+0000", 2024-09-17T02:21:14.593 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4103e-05 2024-09-17T02:21:14.593 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.593 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.593 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:14.593 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458397+0000", 2024-09-17T02:21:14.593 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.438e-05 2024-09-17T02:21:14.593 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.593 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.593 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.594 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458421+0000", 2024-09-17T02:21:14.594 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3655999999999998e-05 2024-09-17T02:21:14.594 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.594 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.594 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:14.594 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458529+0000", 2024-09-17T02:21:14.594 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010752900000000001 2024-09-17T02:21:14.594 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.594 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.594 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:21:14.594 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458542+0000", 2024-09-17T02:21:14.594 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2986999999999999e-05 2024-09-17T02:21:14.594 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.595 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.595 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:14.595 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.611050+0000", 2024-09-17T02:21:14.595 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.1525087 2024-09-17T02:21:14.595 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.595 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.595 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:14.595 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.611529+0000", 2024-09-17T02:21:14.595 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00047844899999999999 2024-09-17T02:21:14.595 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.595 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.595 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:14.595 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.612061+0000", 2024-09-17T02:21:14.596 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00053230300000000003 2024-09-17T02:21:14.596 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.596 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.596 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:14.596 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.613451+0000", 2024-09-17T02:21:14.596 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0013897250000000001 2024-09-17T02:21:14.596 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.596 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.596 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:14.596 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614168+0000", 2024-09-17T02:21:14.596 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00071692499999999998 2024-09-17T02:21:14.596 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.596 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.597 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:14.597 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614265+0000", 2024-09-17T02:21:14.597 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7589000000000004e-05 2024-09-17T02:21:14.597 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.597 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.597 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:14.597 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614330+0000", 2024-09-17T02:21:14.597 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4516000000000004e-05 2024-09-17T02:21:14.597 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.597 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.597 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.597 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.597 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.598 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:14.598 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:21:14.598 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 58.034861048000003, 2024-09-17T02:21:14.598 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029713927000000001, 2024-09-17T02:21:14.598 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:14.598 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:14.598 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:14.598 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:14.598 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.598 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:14.598 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:21:14.598 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.598 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.599 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.599 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:14.599 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556288+0000", 2024-09-17T02:21:14.599 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.599 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.599 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.599 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:14.599 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556289+0000", 2024-09-17T02:21:14.599 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.513e-06 2024-09-17T02:21:14.599 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.599 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.599 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:14.599 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556298+0000", 2024-09-17T02:21:14.600 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1630000000000002e-06 2024-09-17T02:21:14.600 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.600 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.600 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:14.600 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556318+0000", 2024-09-17T02:21:14.600 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9389999999999999e-05 2024-09-17T02:21:14.600 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.600 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.600 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.600 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556332+0000", 2024-09-17T02:21:14.600 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4506e-05 2024-09-17T02:21:14.600 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.600 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.601 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:14.601 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557304+0000", 2024-09-17T02:21:14.601 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00097169699999999999 2024-09-17T02:21:14.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.601 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.601 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:14.601 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557507+0000", 2024-09-17T02:21:14.601 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000203191 2024-09-17T02:21:14.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.601 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.601 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:14.601 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557838+0000", 2024-09-17T02:21:14.601 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033061100000000002 2024-09-17T02:21:14.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.602 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.602 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:14.602 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562171+0000", 2024-09-17T02:21:14.602 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043329229999999998 2024-09-17T02:21:14.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.602 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.602 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:14.602 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585737+0000", 2024-09-17T02:21:14.602 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023565915 2024-09-17T02:21:14.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.602 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.602 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:14.603 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585884+0000", 2024-09-17T02:21:14.603 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014744199999999999 2024-09-17T02:21:14.603 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.603 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.603 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:14.603 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586002+0000", 2024-09-17T02:21:14.603 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000117576 2024-09-17T02:21:14.603 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.603 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.603 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.603 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.603 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.603 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:14.604 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:21:14.604 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 58.034769076000003, 2024-09-17T02:21:14.604 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030933694000000001, 2024-09-17T02:21:14.604 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:14.604 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:14.604 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:14.604 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:14.604 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.604 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:14.604 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:21:14.604 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.604 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.604 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.605 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:14.605 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:21:14.605 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.605 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.605 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.605 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:14.605 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556381+0000", 2024-09-17T02:21:14.605 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2100000000000001e-06 2024-09-17T02:21:14.605 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.605 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.605 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:14.605 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556389+0000", 2024-09-17T02:21:14.605 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5539999999999998e-06 2024-09-17T02:21:14.606 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.606 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.606 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:14.606 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556408+0000", 2024-09-17T02:21:14.606 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8623000000000001e-05 2024-09-17T02:21:14.606 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.606 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.606 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.606 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556427+0000", 2024-09-17T02:21:14.606 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8566000000000001e-05 2024-09-17T02:21:14.606 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.606 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.606 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:14.608 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558741+0000", 2024-09-17T02:21:14.608 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023144390000000002 2024-09-17T02:21:14.608 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.609 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.609 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:14.609 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559040+0000", 2024-09-17T02:21:14.609 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029912100000000001 2024-09-17T02:21:14.609 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.609 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.609 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:14.609 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559222+0000", 2024-09-17T02:21:14.609 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018211200000000001 2024-09-17T02:21:14.609 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.609 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.609 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:14.610 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.566648+0000", 2024-09-17T02:21:14.610 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074257560000000004 2024-09-17T02:21:14.610 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.610 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.610 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:14.610 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587109+0000", 2024-09-17T02:21:14.610 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.020460685999999999 2024-09-17T02:21:14.610 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.610 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.610 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:14.610 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587232+0000", 2024-09-17T02:21:14.611 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123325 2024-09-17T02:21:14.611 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.611 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.611 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:14.611 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587313+0000", 2024-09-17T02:21:14.611 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1302000000000002e-05 2024-09-17T02:21:14.611 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.611 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.611 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.611 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.611 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.611 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:14.612 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:21:14.612 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 58.034703630000003, 2024-09-17T02:21:14.612 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031045538000000001, 2024-09-17T02:21:14.612 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:14.612 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:14.612 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:14.612 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:14.612 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.612 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:14.612 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:21:14.612 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.613 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.613 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.613 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:14.613 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:21:14.613 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.613 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.613 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.613 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:14.613 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556446+0000", 2024-09-17T02:21:14.613 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.26e-06 2024-09-17T02:21:14.613 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.613 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.613 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:14.614 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556454+0000", 2024-09-17T02:21:14.614 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1640000000000004e-06 2024-09-17T02:21:14.614 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.614 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.614 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:14.614 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556471+0000", 2024-09-17T02:21:14.614 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7586000000000001e-05 2024-09-17T02:21:14.614 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.614 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.614 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.614 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556485+0000", 2024-09-17T02:21:14.614 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3523000000000001e-05 2024-09-17T02:21:14.615 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.615 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.615 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:14.615 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559899+0000", 2024-09-17T02:21:14.615 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0034142140000000001 2024-09-17T02:21:14.615 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.615 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.615 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:14.615 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.560104+0000", 2024-09-17T02:21:14.615 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00020539199999999999 2024-09-17T02:21:14.615 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.615 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.615 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:14.616 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.560400+0000", 2024-09-17T02:21:14.616 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029612099999999999 2024-09-17T02:21:14.616 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.616 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.616 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:14.616 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.568427+0000", 2024-09-17T02:21:14.616 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0080262909999999996 2024-09-17T02:21:14.616 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.616 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.616 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:14.616 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587377+0000", 2024-09-17T02:21:14.616 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018950765000000001 2024-09-17T02:21:14.617 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.617 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.617 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:14.617 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587445+0000", 2024-09-17T02:21:14.617 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.724e-05 2024-09-17T02:21:14.617 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.617 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.617 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:14.617 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587491+0000", 2024-09-17T02:21:14.617 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5982000000000001e-05 2024-09-17T02:21:14.617 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.617 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.617 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.618 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.618 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.618 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:14.618 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:21:14.618 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 58.034640860000003, 2024-09-17T02:21:14.618 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031435547000000001, 2024-09-17T02:21:14.618 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:14.618 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:14.618 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:14.618 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:14.618 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.618 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:14.618 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:21:14.619 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.619 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.619 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.619 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:14.619 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:21:14.619 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.619 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.619 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.619 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:14.619 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556509+0000", 2024-09-17T02:21:14.619 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.06e-06 2024-09-17T02:21:14.619 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.619 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.620 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:14.620 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556515+0000", 2024-09-17T02:21:14.620 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1029999999999998e-06 2024-09-17T02:21:14.620 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.620 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.620 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:14.620 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556532+0000", 2024-09-17T02:21:14.620 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7054e-05 2024-09-17T02:21:14.620 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.620 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.620 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.620 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556545+0000", 2024-09-17T02:21:14.620 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3023000000000001e-05 2024-09-17T02:21:14.621 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.621 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.621 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:14.621 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561016+0000", 2024-09-17T02:21:14.621 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044705150000000004 2024-09-17T02:21:14.621 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.621 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.621 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:14.621 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561316+0000", 2024-09-17T02:21:14.621 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000299895 2024-09-17T02:21:14.621 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.621 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.621 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:14.622 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561651+0000", 2024-09-17T02:21:14.622 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033519300000000001 2024-09-17T02:21:14.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.622 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.622 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:14.622 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571105+0000", 2024-09-17T02:21:14.622 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094540539999999999 2024-09-17T02:21:14.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.622 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.622 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:14.622 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587628+0000", 2024-09-17T02:21:14.622 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016522819000000001 2024-09-17T02:21:14.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.623 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.623 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:14.623 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587770+0000", 2024-09-17T02:21:14.623 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000142352 2024-09-17T02:21:14.623 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.623 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.623 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:14.623 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587943+0000", 2024-09-17T02:21:14.623 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017347900000000001 2024-09-17T02:21:14.623 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.623 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.623 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.623 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.624 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.624 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:14.624 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:21:14.624 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 58.034585130000004, 2024-09-17T02:21:14.624 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031809104999999997, 2024-09-17T02:21:14.624 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:14.624 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:14.624 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:14.624 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:14.624 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.624 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:14.624 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:21:14.624 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.625 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.625 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.625 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:14.625 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:21:14.625 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.625 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.625 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.625 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:14.625 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556565+0000", 2024-09-17T02:21:14.625 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.116e-06 2024-09-17T02:21:14.625 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.625 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.625 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:14.626 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556572+0000", 2024-09-17T02:21:14.626 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0230000000000004e-06 2024-09-17T02:21:14.626 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.626 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.626 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:14.626 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556588+0000", 2024-09-17T02:21:14.626 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6643e-05 2024-09-17T02:21:14.626 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.626 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.626 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.626 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556606+0000", 2024-09-17T02:21:14.626 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7159999999999998e-05 2024-09-17T02:21:14.626 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.627 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.627 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:14.627 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562712+0000", 2024-09-17T02:21:14.627 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0061061630000000004 2024-09-17T02:21:14.627 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.627 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.627 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:14.627 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562919+0000", 2024-09-17T02:21:14.627 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000207309 2024-09-17T02:21:14.627 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.627 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.627 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:14.627 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563264+0000", 2024-09-17T02:21:14.627 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00034490699999999998 2024-09-17T02:21:14.628 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.628 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.628 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:14.628 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571812+0000", 2024-09-17T02:21:14.628 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0085477810000000008 2024-09-17T02:21:14.628 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.628 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.628 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:14.628 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588094+0000", 2024-09-17T02:21:14.628 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016282443000000001 2024-09-17T02:21:14.628 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.628 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.628 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:14.629 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588275+0000", 2024-09-17T02:21:14.629 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018058700000000001 2024-09-17T02:21:14.629 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.629 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.629 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:14.629 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588373+0000", 2024-09-17T02:21:14.629 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7973000000000005e-05 2024-09-17T02:21:14.629 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.629 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.629 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.629 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.629 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.630 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:14.630 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:21:14.630 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 58.034527031000003, 2024-09-17T02:21:14.630 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031950544999999997, 2024-09-17T02:21:14.630 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:14.630 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:14.630 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:14.630 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:14.630 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.630 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:14.630 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:21:14.630 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.630 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.630 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.631 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:14.631 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:21:14.631 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.631 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.631 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.631 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:14.631 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556623+0000", 2024-09-17T02:21:14.631 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.04e-06 2024-09-17T02:21:14.631 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.631 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.631 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:14.631 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556631+0000", 2024-09-17T02:21:14.631 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1529999999999997e-06 2024-09-17T02:21:14.631 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.632 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.632 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:14.632 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556648+0000", 2024-09-17T02:21:14.632 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6583999999999999e-05 2024-09-17T02:21:14.632 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.632 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.632 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.632 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556661+0000", 2024-09-17T02:21:14.632 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3203e-05 2024-09-17T02:21:14.632 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.632 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.632 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:14.632 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564413+0000", 2024-09-17T02:21:14.633 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0077523100000000001 2024-09-17T02:21:14.633 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.633 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.633 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:14.633 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.565841+0000", 2024-09-17T02:21:14.633 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014276320000000001 2024-09-17T02:21:14.633 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.633 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.633 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:14.633 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.566131+0000", 2024-09-17T02:21:14.633 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029043800000000001 2024-09-17T02:21:14.633 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.633 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.633 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:14.634 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572353+0000", 2024-09-17T02:21:14.634 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.006222399 2024-09-17T02:21:14.634 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.634 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.634 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:14.634 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588452+0000", 2024-09-17T02:21:14.634 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016098635 2024-09-17T02:21:14.634 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.634 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.634 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:14.634 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588520+0000", 2024-09-17T02:21:14.634 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8040000000000006e-05 2024-09-17T02:21:14.634 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.635 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.635 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:14.635 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588572+0000", 2024-09-17T02:21:14.635 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2111000000000003e-05 2024-09-17T02:21:14.635 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.635 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.635 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.635 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.635 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.635 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:14.635 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:21:14.635 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 58.034429865, 2024-09-17T02:21:14.635 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.032187205000000003, 2024-09-17T02:21:14.635 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:14.636 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:14.636 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:14.636 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:14.636 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.636 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:14.636 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:21:14.636 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.636 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.636 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.636 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:14.636 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:21:14.636 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.637 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.637 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.637 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:14.637 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556727+0000", 2024-09-17T02:21:14.637 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3000000000000002e-06 2024-09-17T02:21:14.637 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.637 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.637 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:14.637 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556736+0000", 2024-09-17T02:21:14.637 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4300000000000006e-06 2024-09-17T02:21:14.637 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.637 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.637 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:14.637 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556755+0000", 2024-09-17T02:21:14.638 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9700000000000001e-05 2024-09-17T02:21:14.638 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.638 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.638 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.638 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556771+0000", 2024-09-17T02:21:14.638 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5213e-05 2024-09-17T02:21:14.638 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.638 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.638 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:14.638 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571184+0000", 2024-09-17T02:21:14.638 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014413888999999999 2024-09-17T02:21:14.638 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.639 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.639 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:14.639 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571302+0000", 2024-09-17T02:21:14.639 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011794900000000001 2024-09-17T02:21:14.639 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.639 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.639 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:14.639 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571494+0000", 2024-09-17T02:21:14.639 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000191168 2024-09-17T02:21:14.639 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.639 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.639 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:14.639 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.573775+0000", 2024-09-17T02:21:14.640 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002281656 2024-09-17T02:21:14.640 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.640 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.640 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:14.640 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588668+0000", 2024-09-17T02:21:14.640 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014892699000000001 2024-09-17T02:21:14.640 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.640 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.640 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:14.640 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588813+0000", 2024-09-17T02:21:14.640 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014530700000000001 2024-09-17T02:21:14.640 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.641 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.641 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:14.641 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588906+0000", 2024-09-17T02:21:14.641 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2893999999999995e-05 2024-09-17T02:21:14.641 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.641 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.641 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.641 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.641 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.641 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:14.641 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:21:14.641 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 58.034288699999998, 2024-09-17T02:21:14.641 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028815922000000001, 2024-09-17T02:21:14.641 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:14.642 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:14.642 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:14.642 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:14.642 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.642 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:14.642 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:21:14.642 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.642 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.642 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.642 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:14.642 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556860+0000", 2024-09-17T02:21:14.642 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.642 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.642 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.643 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:14.643 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556861+0000", 2024-09-17T02:21:14.643 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.08e-06 2024-09-17T02:21:14.643 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.643 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.643 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:14.643 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556867+0000", 2024-09-17T02:21:14.643 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.207e-06 2024-09-17T02:21:14.643 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.643 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.643 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:14.643 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556886+0000", 2024-09-17T02:21:14.643 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9137e-05 2024-09-17T02:21:14.644 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.644 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.644 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.644 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556900+0000", 2024-09-17T02:21:14.644 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3253e-05 2024-09-17T02:21:14.644 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.644 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.644 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:14.644 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558301+0000", 2024-09-17T02:21:14.644 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014008320000000001 2024-09-17T02:21:14.644 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.644 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.644 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:14.645 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558564+0000", 2024-09-17T02:21:14.645 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000263238 2024-09-17T02:21:14.645 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.645 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.645 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:14.645 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558905+0000", 2024-09-17T02:21:14.645 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000341534 2024-09-17T02:21:14.645 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.645 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.645 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:14.645 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.568208+0000", 2024-09-17T02:21:14.645 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0093023689999999996 2024-09-17T02:21:14.645 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.645 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.646 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:14.646 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585379+0000", 2024-09-17T02:21:14.646 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.017171091999999999 2024-09-17T02:21:14.646 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.646 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.646 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:14.646 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585509+0000", 2024-09-17T02:21:14.646 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013036100000000001 2024-09-17T02:21:14.646 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.646 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.646 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:14.646 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.585676+0000", 2024-09-17T02:21:14.646 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016681899999999999 2024-09-17T02:21:14.647 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.647 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.647 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.647 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.647 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.647 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:14.647 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:21:14.647 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 58.034231433000002, 2024-09-17T02:21:14.647 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030862568, 2024-09-17T02:21:14.647 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:14.647 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:14.647 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:14.647 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:14.647 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.648 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:14.648 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:21:14.648 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.648 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.648 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.648 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:14.648 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:21:14.648 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.648 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.648 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.648 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:14.648 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556918+0000", 2024-09-17T02:21:14.648 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0529999999999999e-06 2024-09-17T02:21:14.649 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.649 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.649 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:14.649 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556925+0000", 2024-09-17T02:21:14.649 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.6939999999999998e-06 2024-09-17T02:21:14.649 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.649 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.649 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:14.649 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556942+0000", 2024-09-17T02:21:14.649 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6803000000000002e-05 2024-09-17T02:21:14.649 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.649 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.649 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.649 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556955+0000", 2024-09-17T02:21:14.650 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2659e-05 2024-09-17T02:21:14.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.650 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.650 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:14.650 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558237+0000", 2024-09-17T02:21:14.650 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001282804 2024-09-17T02:21:14.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.650 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.650 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:14.650 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558495+0000", 2024-09-17T02:21:14.650 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000257178 2024-09-17T02:21:14.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.650 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.651 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:14.651 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562168+0000", 2024-09-17T02:21:14.651 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0036737110000000001 2024-09-17T02:21:14.651 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.651 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:14.651 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.570855+0000", 2024-09-17T02:21:14.651 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0086868729999999995 2024-09-17T02:21:14.651 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.651 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:14.651 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587568+0000", 2024-09-17T02:21:14.651 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016712444999999999 2024-09-17T02:21:14.652 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.652 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:14.652 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587677+0000", 2024-09-17T02:21:14.652 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000109879 2024-09-17T02:21:14.652 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.652 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:14.652 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587780+0000", 2024-09-17T02:21:14.652 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000102469 2024-09-17T02:21:14.652 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.652 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.652 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.653 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.653 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.653 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:14.653 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:21:14.653 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 58.034149300999999, 2024-09-17T02:21:14.653 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031005751000000002, 2024-09-17T02:21:14.653 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:14.653 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:14.653 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:14.653 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:14.653 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.653 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:14.654 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:21:14.654 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.654 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.654 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.654 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:14.654 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:21:14.654 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.654 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.654 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.654 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:14.654 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557001+0000", 2024-09-17T02:21:14.654 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.237e-06 2024-09-17T02:21:14.654 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.655 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.655 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:14.655 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557007+0000", 2024-09-17T02:21:14.655 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7270000000000001e-06 2024-09-17T02:21:14.655 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.655 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.655 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:14.655 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557025+0000", 2024-09-17T02:21:14.655 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7689999999999998e-05 2024-09-17T02:21:14.655 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.655 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.655 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.655 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557039+0000", 2024-09-17T02:21:14.655 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.385e-05 2024-09-17T02:21:14.656 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.656 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.656 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:14.656 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563783+0000", 2024-09-17T02:21:14.656 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0067437110000000003 2024-09-17T02:21:14.656 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.656 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.656 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:14.656 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564031+0000", 2024-09-17T02:21:14.656 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00024871799999999999 2024-09-17T02:21:14.656 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.656 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.656 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:14.657 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564518+0000", 2024-09-17T02:21:14.657 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00048708999999999997 2024-09-17T02:21:14.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.657 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.657 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:14.657 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572375+0000", 2024-09-17T02:21:14.657 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078564780000000001 2024-09-17T02:21:14.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.657 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.657 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:14.657 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587862+0000", 2024-09-17T02:21:14.657 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015486837999999999 2024-09-17T02:21:14.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.657 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.658 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:14.658 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587954+0000", 2024-09-17T02:21:14.658 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1766000000000002e-05 2024-09-17T02:21:14.658 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.658 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.658 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:14.658 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588005+0000", 2024-09-17T02:21:14.658 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1646e-05 2024-09-17T02:21:14.658 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.658 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.658 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.658 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.658 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.658 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:14.659 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:21:14.659 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 58.034005004999997, 2024-09-17T02:21:14.659 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029554871999999999, 2024-09-17T02:21:14.659 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:14.659 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:14.659 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:14.659 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:14.659 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.659 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:14.659 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:21:14.659 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.659 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.659 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.659 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:14.660 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557144+0000", 2024-09-17T02:21:14.660 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.660 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.660 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.660 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:14.660 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557145+0000", 2024-09-17T02:21:14.660 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.263e-06 2024-09-17T02:21:14.660 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.660 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.661 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:14.661 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557151+0000", 2024-09-17T02:21:14.661 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1040000000000003e-06 2024-09-17T02:21:14.661 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.661 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.661 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:14.661 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557168+0000", 2024-09-17T02:21:14.661 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7289999999999999e-05 2024-09-17T02:21:14.661 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.661 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.661 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.661 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557182+0000", 2024-09-17T02:21:14.661 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.325e-05 2024-09-17T02:21:14.662 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.662 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.662 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:14.662 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564102+0000", 2024-09-17T02:21:14.662 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069199860000000004 2024-09-17T02:21:14.662 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.662 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.662 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:14.662 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564438+0000", 2024-09-17T02:21:14.662 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033651800000000001 2024-09-17T02:21:14.662 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.662 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.662 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:14.662 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.565422+0000", 2024-09-17T02:21:14.663 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00098332499999999995 2024-09-17T02:21:14.663 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.663 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.663 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:14.663 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572361+0000", 2024-09-17T02:21:14.663 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069392630000000002 2024-09-17T02:21:14.663 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.663 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.663 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:14.663 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586567+0000", 2024-09-17T02:21:14.663 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014206107000000001 2024-09-17T02:21:14.663 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.663 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.664 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:14.664 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586643+0000", 2024-09-17T02:21:14.664 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5673000000000005e-05 2024-09-17T02:21:14.664 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.664 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.664 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:14.664 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586699+0000", 2024-09-17T02:21:14.664 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6093e-05 2024-09-17T02:21:14.664 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.664 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.664 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.664 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.664 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.665 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:14.665 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:21:14.665 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 58.033871312999999, 2024-09-17T02:21:14.665 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029800569999999998, 2024-09-17T02:21:14.665 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:14.665 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:14.665 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:14.665 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:14.665 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.665 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:14.665 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:21:14.665 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.665 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.666 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.666 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:14.666 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557277+0000", 2024-09-17T02:21:14.666 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.666 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.666 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.666 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:14.666 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557279+0000", 2024-09-17T02:21:14.666 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.497e-06 2024-09-17T02:21:14.666 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.666 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.666 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:14.666 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557287+0000", 2024-09-17T02:21:14.667 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9030000000000004e-06 2024-09-17T02:21:14.667 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.667 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.667 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:14.667 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557306+0000", 2024-09-17T02:21:14.667 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9394000000000001e-05 2024-09-17T02:21:14.667 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.667 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.667 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.667 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557323+0000", 2024-09-17T02:21:14.667 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6299000000000001e-05 2024-09-17T02:21:14.667 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.667 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.668 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:14.668 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.570931+0000", 2024-09-17T02:21:14.668 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013608841999999999 2024-09-17T02:21:14.668 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.668 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.668 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:14.668 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571250+0000", 2024-09-17T02:21:14.668 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031817400000000001 2024-09-17T02:21:14.668 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.668 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.668 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:14.668 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571559+0000", 2024-09-17T02:21:14.668 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000309835 2024-09-17T02:21:14.668 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.669 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.669 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:14.669 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.574161+0000", 2024-09-17T02:21:14.669 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002601543 2024-09-17T02:21:14.669 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.669 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.669 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:14.669 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586866+0000", 2024-09-17T02:21:14.669 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012704968000000001 2024-09-17T02:21:14.669 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.669 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.669 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:14.669 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.586987+0000", 2024-09-17T02:21:14.670 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000121369 2024-09-17T02:21:14.670 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.670 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.670 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:14.670 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587078+0000", 2024-09-17T02:21:14.670 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0746000000000002e-05 2024-09-17T02:21:14.670 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.670 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.670 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.670 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.670 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.670 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:14.670 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:21:14.670 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 58.03380567, 2024-09-17T02:21:14.671 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029936054, 2024-09-17T02:21:14.671 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:14.671 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:14.671 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:14.671 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:14.671 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.671 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:14.671 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:21:14.671 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.671 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.671 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.671 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:14.671 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557343+0000", 2024-09-17T02:21:14.672 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.672 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.672 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.672 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:14.672 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557344+0000", 2024-09-17T02:21:14.672 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.347e-06 2024-09-17T02:21:14.672 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.672 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.672 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:14.672 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557351+0000", 2024-09-17T02:21:14.672 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5560000000000004e-06 2024-09-17T02:21:14.672 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.672 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.672 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:14.673 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557369+0000", 2024-09-17T02:21:14.673 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7703e-05 2024-09-17T02:21:14.673 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.673 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.673 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.673 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557382+0000", 2024-09-17T02:21:14.673 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3664e-05 2024-09-17T02:21:14.673 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.673 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.673 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:14.673 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558997+0000", 2024-09-17T02:21:14.673 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0016147970000000001 2024-09-17T02:21:14.673 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.674 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.674 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:14.674 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559236+0000", 2024-09-17T02:21:14.674 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00023900200000000001 2024-09-17T02:21:14.674 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.674 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.674 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:14.674 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559547+0000", 2024-09-17T02:21:14.674 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00031132399999999998 2024-09-17T02:21:14.674 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.674 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.674 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:14.674 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563130+0000", 2024-09-17T02:21:14.674 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003582989 2024-09-17T02:21:14.675 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.675 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.675 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:14.675 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587069+0000", 2024-09-17T02:21:14.675 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023938496 2024-09-17T02:21:14.675 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.675 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.675 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:14.675 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587192+0000", 2024-09-17T02:21:14.675 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123514 2024-09-17T02:21:14.675 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.675 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.675 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:14.675 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587279+0000", 2024-09-17T02:21:14.676 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6662000000000005e-05 2024-09-17T02:21:14.676 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.676 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.676 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.676 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.676 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.676 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:14.676 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:21:14.676 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 58.033747783999999, 2024-09-17T02:21:14.676 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030490703000000001, 2024-09-17T02:21:14.676 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:14.676 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:14.677 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:14.677 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:14.677 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.677 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:14.677 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:21:14.677 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.677 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.677 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.677 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:14.677 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557401+0000", 2024-09-17T02:21:14.677 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.677 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.677 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.677 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:14.678 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557403+0000", 2024-09-17T02:21:14.678 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.77e-06 2024-09-17T02:21:14.678 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.678 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.678 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:14.678 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557412+0000", 2024-09-17T02:21:14.678 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4099999999999997e-06 2024-09-17T02:21:14.678 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.678 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.678 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:14.678 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557431+0000", 2024-09-17T02:21:14.678 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9177e-05 2024-09-17T02:21:14.678 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.678 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.679 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.679 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557444+0000", 2024-09-17T02:21:14.679 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2999999999999999e-05 2024-09-17T02:21:14.679 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.679 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.679 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:14.679 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557722+0000", 2024-09-17T02:21:14.679 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00027760699999999997 2024-09-17T02:21:14.679 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.679 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.679 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:14.679 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557991+0000", 2024-09-17T02:21:14.679 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00026892499999999999 2024-09-17T02:21:14.680 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.680 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.680 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:14.680 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558265+0000", 2024-09-17T02:21:14.680 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000274524 2024-09-17T02:21:14.680 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.680 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.680 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:14.680 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564270+0000", 2024-09-17T02:21:14.680 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060045339999999997 2024-09-17T02:21:14.680 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.680 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.680 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:14.680 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587701+0000", 2024-09-17T02:21:14.681 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.023431285999999999 2024-09-17T02:21:14.681 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.681 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.681 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:14.681 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587803+0000", 2024-09-17T02:21:14.681 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000101371 2024-09-17T02:21:14.681 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.681 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.681 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:14.681 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587892+0000", 2024-09-17T02:21:14.681 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9098999999999995e-05 2024-09-17T02:21:14.681 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.681 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.682 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.682 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.682 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.682 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:14.682 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:21:14.682 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 58.033666187999998, 2024-09-17T02:21:14.682 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029886725999999999, 2024-09-17T02:21:14.682 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:14.682 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:14.682 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:21:14.682 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:14.682 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.682 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:14.683 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:21:14.683 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.683 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.683 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.683 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:14.683 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557483+0000", 2024-09-17T02:21:14.683 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.683 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.683 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.683 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:14.683 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557484+0000", 2024-09-17T02:21:14.683 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.26e-06 2024-09-17T02:21:14.683 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.683 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.684 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:14.684 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557489+0000", 2024-09-17T02:21:14.684 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2530000000000004e-06 2024-09-17T02:21:14.684 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.684 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.684 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:14.684 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557507+0000", 2024-09-17T02:21:14.684 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7473999999999999e-05 2024-09-17T02:21:14.684 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.684 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.684 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.684 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557524+0000", 2024-09-17T02:21:14.684 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7912999999999999e-05 2024-09-17T02:21:14.685 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.685 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.685 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:14.685 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572428+0000", 2024-09-17T02:21:14.685 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014903451999999999 2024-09-17T02:21:14.685 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.685 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.685 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:14.685 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572589+0000", 2024-09-17T02:21:14.685 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000161299 2024-09-17T02:21:14.685 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.685 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.685 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:14.686 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587369+0000", 2024-09-17T02:21:14.686 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014780075 2024-09-17T02:21:14.686 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.686 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.686 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.686 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.686 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.686 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28720 5.f 5:f8a7aea5:::benchmark_data_smithi001_23533_object28719:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:14.686 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:14.686 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 32.023361872999999, 2024-09-17T02:21:14.686 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.033978608, 2024-09-17T02:21:14.686 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:14.686 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:14.687 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:14.687 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:14.687 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:14.687 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:14.687 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28720 2024-09-17T02:21:14.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.687 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:14.687 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.687 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:14.687 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:14.687 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.687 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.687 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:14.688 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:14.688 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.688 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.688 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.688 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:14.688 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:14.688 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3200000000000005e-07 2024-09-17T02:21:14.688 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.688 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.688 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:14.688 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567856+0000", 2024-09-17T02:21:14.688 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8596000000000005e-05 2024-09-17T02:21:14.688 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.688 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.689 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:14.689 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567864+0000", 2024-09-17T02:21:14.689 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6040000000000004e-06 2024-09-17T02:21:14.689 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.689 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.689 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.689 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567867+0000", 2024-09-17T02:21:14.689 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7929999999999999e-06 2024-09-17T02:21:14.689 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.689 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.689 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:14.689 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567896+0000", 2024-09-17T02:21:14.689 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8444000000000001e-05 2024-09-17T02:21:14.690 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.690 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.690 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:14.690 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567983+0000", 2024-09-17T02:21:14.690 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7498999999999997e-05 2024-09-17T02:21:14.690 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.690 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.690 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:14.690 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568078+0000", 2024-09-17T02:21:14.690 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5050999999999995e-05 2024-09-17T02:21:14.690 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.690 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.690 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:14.690 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573091+0000", 2024-09-17T02:21:14.691 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050124599999999998 2024-09-17T02:21:14.691 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.691 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.691 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:14.691 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601705+0000", 2024-09-17T02:21:14.691 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028614298999999999 2024-09-17T02:21:14.691 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.691 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.691 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:14.691 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601741+0000", 2024-09-17T02:21:14.691 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5329e-05 2024-09-17T02:21:14.691 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.691 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.692 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:14.692 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601766+0000", 2024-09-17T02:21:14.692 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5001e-05 2024-09-17T02:21:14.692 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.692 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.692 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.692 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.692 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.692 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28723 5.f 5:f1a2a8f6:::benchmark_data_smithi001_23533_object28722:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:14.692 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:21:14.692 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 32.023083192999998, 2024-09-17T02:21:14.692 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.033805288000000003, 2024-09-17T02:21:14.692 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:14.693 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:14.693 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:14.693 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:14.693 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:14.693 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:14.693 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28723 2024-09-17T02:21:14.693 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.693 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:14.693 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.693 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:14.693 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:21:14.693 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.693 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.694 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.694 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:14.694 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:21:14.694 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.694 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.694 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.694 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:14.694 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568067+0000", 2024-09-17T02:21:14.694 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6700000000000002e-07 2024-09-17T02:21:14.694 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.694 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.694 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:14.694 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568121+0000", 2024-09-17T02:21:14.694 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4286000000000002e-05 2024-09-17T02:21:14.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.695 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.695 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:14.695 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568131+0000", 2024-09-17T02:21:14.695 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0288e-05 2024-09-17T02:21:14.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.695 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.695 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.695 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568139+0000", 2024-09-17T02:21:14.695 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5399999999999998e-06 2024-09-17T02:21:14.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.695 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.695 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:14.696 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569194+0000", 2024-09-17T02:21:14.696 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0010557100000000001 2024-09-17T02:21:14.696 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.696 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.696 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:14.696 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569298+0000", 2024-09-17T02:21:14.696 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000103491 2024-09-17T02:21:14.696 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.696 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.696 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:14.696 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569428+0000", 2024-09-17T02:21:14.696 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013050599999999999 2024-09-17T02:21:14.696 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.696 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.697 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:14.697 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573124+0000", 2024-09-17T02:21:14.697 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0036956810000000001 2024-09-17T02:21:14.697 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.697 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.697 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:14.697 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601801+0000", 2024-09-17T02:21:14.697 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028676667999999999 2024-09-17T02:21:14.697 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.697 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.697 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:14.697 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601835+0000", 2024-09-17T02:21:14.697 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4347000000000002e-05 2024-09-17T02:21:14.698 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.698 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.698 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:14.698 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601871+0000", 2024-09-17T02:21:14.698 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5803999999999998e-05 2024-09-17T02:21:14.698 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.698 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.698 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.698 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.698 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.698 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28729 5.9 5:9e3b1489:::benchmark_data_smithi001_23533_object28728:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:14.698 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:21:14.698 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 32.021464541999997, 2024-09-17T02:21:14.699 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.032738525999999997, 2024-09-17T02:21:14.699 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:14.699 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:14.699 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:14.699 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:14.699 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:14.699 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:14.699 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28729 2024-09-17T02:21:14.699 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.699 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:14.699 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.699 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:14.699 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:21:14.699 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.700 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.700 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.700 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:14.700 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:21:14.700 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.700 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.700 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.700 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:14.700 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569685+0000", 2024-09-17T02:21:14.700 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8599999999999996e-07 2024-09-17T02:21:14.700 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.700 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.700 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:14.700 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569725+0000", 2024-09-17T02:21:14.701 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0144000000000001e-05 2024-09-17T02:21:14.701 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.701 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.701 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:14.701 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569737+0000", 2024-09-17T02:21:14.701 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1752e-05 2024-09-17T02:21:14.701 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.701 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.701 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.701 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569745+0000", 2024-09-17T02:21:14.701 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6420000000000007e-06 2024-09-17T02:21:14.701 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.701 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.702 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:14.702 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569801+0000", 2024-09-17T02:21:14.702 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6110000000000003e-05 2024-09-17T02:21:14.702 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.702 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.702 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:14.702 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569944+0000", 2024-09-17T02:21:14.702 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014361500000000001 2024-09-17T02:21:14.702 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.702 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.702 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:14.702 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.570234+0000", 2024-09-17T02:21:14.702 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00028927899999999998 2024-09-17T02:21:14.703 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.703 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.703 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:14.703 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572606+0000", 2024-09-17T02:21:14.703 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023725529999999999 2024-09-17T02:21:14.703 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.703 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.703 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:14.703 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602361+0000", 2024-09-17T02:21:14.703 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029755031000000001 2024-09-17T02:21:14.703 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.703 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.703 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:14.704 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602397+0000", 2024-09-17T02:21:14.704 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5509000000000002e-05 2024-09-17T02:21:14.704 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.704 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.704 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:14.704 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602423+0000", 2024-09-17T02:21:14.704 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5905e-05 2024-09-17T02:21:14.704 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.704 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.704 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.704 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.704 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.705 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28734 5.f 5:f1a63647:::benchmark_data_smithi001_23533_object28733:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:14.705 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:21:14.705 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 32.019742055999998, 2024-09-17T02:21:14.705 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.034441100000000002, 2024-09-17T02:21:14.705 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:14.705 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:14.705 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:14.705 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:14.705 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:14.705 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:14.705 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28734 2024-09-17T02:21:14.705 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.705 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:14.705 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.706 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:14.706 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:21:14.706 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.706 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.706 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.706 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:14.706 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:21:14.706 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:14.706 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.706 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.706 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:14.706 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571408+0000", 2024-09-17T02:21:14.706 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.8899999999999998e-07 2024-09-17T02:21:14.706 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.707 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.707 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:14.707 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571464+0000", 2024-09-17T02:21:14.707 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6546999999999999e-05 2024-09-17T02:21:14.707 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.707 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.707 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:14.707 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571474+0000", 2024-09-17T02:21:14.707 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0348e-05 2024-09-17T02:21:14.707 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.707 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.707 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.707 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571480+0000", 2024-09-17T02:21:14.707 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.366e-06 2024-09-17T02:21:14.708 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.708 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.708 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:14.708 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572097+0000", 2024-09-17T02:21:14.708 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061710599999999997 2024-09-17T02:21:14.708 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.708 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.708 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:14.708 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572172+0000", 2024-09-17T02:21:14.708 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4658000000000002e-05 2024-09-17T02:21:14.708 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.708 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.708 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:14.709 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572247+0000", 2024-09-17T02:21:14.709 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5766000000000006e-05 2024-09-17T02:21:14.709 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.709 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.709 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:14.709 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573819+0000", 2024-09-17T02:21:14.709 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015713649999999999 2024-09-17T02:21:14.709 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.709 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.709 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:14.709 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605762+0000", 2024-09-17T02:21:14.709 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031943304999999998 2024-09-17T02:21:14.709 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.709 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.710 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:14.710 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605808+0000", 2024-09-17T02:21:14.710 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5776999999999999e-05 2024-09-17T02:21:14.710 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:14.710 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:14.710 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:14.710 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605848+0000", 2024-09-17T02:21:14.710 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9972999999999998e-05 2024-09-17T02:21:14.710 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.710 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.710 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.710 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:14.710 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:14.710 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:21:14.713 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:14.713 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "" 2024-09-17T02:21:14.713 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:14.713 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:14.711+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:14.713 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:14.773 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 42 16 92152 92136 137.092 126.75 0.0145426 0.00728895 2024-09-17T02:21:14.812 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:14.814+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:14.829 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:21:14.875 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:14.875 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:14.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.876 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:92340 5.b 5:d60edbde:::benchmark_data_smithi001_23533_object92339:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T02:21:14.876 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:14.871041+0000", 2024-09-17T02:21:14.876 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0085183310000000005, 2024-09-17T02:21:14.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0085400270000000004, 2024-09-17T02:21:14.876 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:14.876 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:14.876 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:14.876 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:14.876 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:14.876 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:14.876 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 92340 2024-09-17T02:21:14.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.877 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:14.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:14.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.871041+0000", 2024-09-17T02:21:14.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:14.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.871041+0000", 2024-09-17T02:21:14.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:14.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.871042+0000", 2024-09-17T02:21:14.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7700000000000003e-07 2024-09-17T02:21:14.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:14.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.871108+0000", 2024-09-17T02:21:14.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6668000000000006e-05 2024-09-17T02:21:14.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:14.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.871124+0000", 2024-09-17T02:21:14.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5311999999999998e-05 2024-09-17T02:21:14.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.871131+0000", 2024-09-17T02:21:14.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3370000000000002e-06 2024-09-17T02:21:14.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:14.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.874076+0000", 2024-09-17T02:21:14.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029450740000000002 2024-09-17T02:21:14.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:14.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.874203+0000", 2024-09-17T02:21:14.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000126892 2024-09-17T02:21:14.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:14.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.874362+0000", 2024-09-17T02:21:14.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015859500000000001 2024-09-17T02:21:14.880 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.880 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:14.880 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.880 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:92341 5.e 5:711fc06d:::benchmark_data_smithi001_23533_object92340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T02:21:14.880 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:14.871335+0000", 2024-09-17T02:21:14.880 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.008224238, 2024-09-17T02:21:14.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083067939999999993, 2024-09-17T02:21:14.881 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:14.881 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:14.881 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:14.881 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:14.881 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:14.881 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:14.881 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 92341 2024-09-17T02:21:14.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.881 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:14.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:14.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.871335+0000", 2024-09-17T02:21:14.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:14.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.871335+0000", 2024-09-17T02:21:14.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:14.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.871336+0000", 2024-09-17T02:21:14.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6000000000000002e-07 2024-09-17T02:21:14.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:14.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.871432+0000", 2024-09-17T02:21:14.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6726999999999997e-05 2024-09-17T02:21:14.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:14.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.871443+0000", 2024-09-17T02:21:14.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0223e-05 2024-09-17T02:21:14.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.871450+0000", 2024-09-17T02:21:14.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0890000000000002e-06 2024-09-17T02:21:14.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:14.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.873032+0000", 2024-09-17T02:21:14.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001581938 2024-09-17T02:21:14.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:14.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.873176+0000", 2024-09-17T02:21:14.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014464400000000001 2024-09-17T02:21:14.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:14.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.873494+0000", 2024-09-17T02:21:14.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031750399999999997 2024-09-17T02:21:14.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:14.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.876897+0000", 2024-09-17T02:21:14.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034034769999999998 2024-09-17T02:21:14.885 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.885 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:14.885 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.885 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:92349 5.3 e43/38 5:c0e9bca4:::benchmark_data_smithi001_23533_object92348:head v 43'5842, mlcod=43'5840)", 2024-09-17T02:21:14.886 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:14.875394+0000", 2024-09-17T02:21:14.886 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.004164793, 2024-09-17T02:21:14.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042933240000000003, 2024-09-17T02:21:14.886 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:14.886 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:14.886 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:14.886 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:14.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:14.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.875394+0000", 2024-09-17T02:21:14.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:14.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.875394+0000", 2024-09-17T02:21:14.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:14.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.875395+0000", 2024-09-17T02:21:14.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9800000000000003e-07 2024-09-17T02:21:14.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:14.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.875505+0000", 2024-09-17T02:21:14.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109485 2024-09-17T02:21:14.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:14.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.875517+0000", 2024-09-17T02:21:14.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2237e-05 2024-09-17T02:21:14.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.875525+0000", 2024-09-17T02:21:14.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9230000000000002e-06 2024-09-17T02:21:14.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:14.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.875576+0000", 2024-09-17T02:21:14.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1103000000000002e-05 2024-09-17T02:21:14.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:14.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.875595+0000", 2024-09-17T02:21:14.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8678999999999999e-05 2024-09-17T02:21:14.889 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.889 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:14.889 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.890 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:92348 5.b 5:d016e22b:::benchmark_data_smithi001_23533_object92347:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T02:21:14.890 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:14.874234+0000", 2024-09-17T02:21:14.890 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0053255020000000002, 2024-09-17T02:21:14.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054974500000000001, 2024-09-17T02:21:14.890 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:14.890 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:14.890 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:14.891 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:14.891 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:14.891 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:14.891 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 92348 2024-09-17T02:21:14.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.891 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:14.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:14.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.874234+0000", 2024-09-17T02:21:14.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:14.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.874234+0000", 2024-09-17T02:21:14.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:14.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.874235+0000", 2024-09-17T02:21:14.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0589999999999999e-06 2024-09-17T02:21:14.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:14.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.875958+0000", 2024-09-17T02:21:14.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001723666 2024-09-17T02:21:14.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:14.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.875969+0000", 2024-09-17T02:21:14.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0574000000000001e-05 2024-09-17T02:21:14.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.875976+0000", 2024-09-17T02:21:14.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.951e-06 2024-09-17T02:21:14.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:14.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.876811+0000", 2024-09-17T02:21:14.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083561799999999999 2024-09-17T02:21:14.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:14.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.876967+0000", 2024-09-17T02:21:14.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015601499999999999 2024-09-17T02:21:14.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:14.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877129+0000", 2024-09-17T02:21:14.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016134 2024-09-17T02:21:14.895 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.895 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:14.895 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.895 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:92351 5.b 5:df6728ec:::benchmark_data_smithi001_23533_object92350:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T02:21:14.895 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:14.875990+0000", 2024-09-17T02:21:14.895 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0035691389999999998, 2024-09-17T02:21:14.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037836520000000002, 2024-09-17T02:21:14.895 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:14.895 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:14.896 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:14.896 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:14.896 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:14.896 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:14.896 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 92351 2024-09-17T02:21:14.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.896 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:14.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:14.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.875990+0000", 2024-09-17T02:21:14.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:14.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.875990+0000", 2024-09-17T02:21:14.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:14.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.875991+0000", 2024-09-17T02:21:14.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5099999999999998e-07 2024-09-17T02:21:14.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:14.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.876020+0000", 2024-09-17T02:21:14.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9612999999999999e-05 2024-09-17T02:21:14.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:14.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.876028+0000", 2024-09-17T02:21:14.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9160000000000001e-06 2024-09-17T02:21:14.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.876034+0000", 2024-09-17T02:21:14.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0260000000000004e-06 2024-09-17T02:21:14.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:14.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.878860+0000", 2024-09-17T02:21:14.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028254970000000002 2024-09-17T02:21:14.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:14.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.879027+0000", 2024-09-17T02:21:14.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016718399999999999 2024-09-17T02:21:14.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:14.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.879135+0000", 2024-09-17T02:21:14.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010754700000000001 2024-09-17T02:21:14.900 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.900 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:14.900 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.900 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:92350 5.8 e43/26 5:1c5d2ed2:::benchmark_data_smithi001_23533_object92349:head v 43'5862, mlcod=43'5859)", 2024-09-17T02:21:14.900 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:14.876070+0000", 2024-09-17T02:21:14.900 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.003488723, 2024-09-17T02:21:14.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037476419999999998, 2024-09-17T02:21:14.900 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:14.900 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:14.901 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:14.901 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:14.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:14.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.876070+0000", 2024-09-17T02:21:14.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:14.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.876070+0000", 2024-09-17T02:21:14.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:14.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.876071+0000", 2024-09-17T02:21:14.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9200000000000001e-07 2024-09-17T02:21:14.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:14.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.876100+0000", 2024-09-17T02:21:14.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8679000000000001e-05 2024-09-17T02:21:14.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:14.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.876108+0000", 2024-09-17T02:21:14.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5790000000000004e-06 2024-09-17T02:21:14.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.876114+0000", 2024-09-17T02:21:14.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.784e-06 2024-09-17T02:21:14.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:14.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.876181+0000", 2024-09-17T02:21:14.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6879999999999997e-05 2024-09-17T02:21:14.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:14.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.876201+0000", 2024-09-17T02:21:14.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0180999999999999e-05 2024-09-17T02:21:14.904 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.904 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:14.904 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.904 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:92355 5.e 5:7819cac9:::benchmark_data_smithi001_23533_object92354:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T02:21:14.904 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:14.876918+0000", 2024-09-17T02:21:14.904 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0026410610000000001, 2024-09-17T02:21:14.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029634639999999999, 2024-09-17T02:21:14.904 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:14.904 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:14.905 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:14.905 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:14.905 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:14.905 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:14.905 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 92355 2024-09-17T02:21:14.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.905 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:14.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:14.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.876918+0000", 2024-09-17T02:21:14.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:14.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.876918+0000", 2024-09-17T02:21:14.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:14.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.876919+0000", 2024-09-17T02:21:14.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5099999999999998e-07 2024-09-17T02:21:14.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:14.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.876946+0000", 2024-09-17T02:21:14.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7535e-05 2024-09-17T02:21:14.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:14.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.876956+0000", 2024-09-17T02:21:14.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0056e-05 2024-09-17T02:21:14.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.876963+0000", 2024-09-17T02:21:14.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4819999999999999e-06 2024-09-17T02:21:14.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:14.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877010+0000", 2024-09-17T02:21:14.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7295e-05 2024-09-17T02:21:14.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:14.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877129+0000", 2024-09-17T02:21:14.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011888 2024-09-17T02:21:14.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:14.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877267+0000", 2024-09-17T02:21:14.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013833899999999999 2024-09-17T02:21:14.909 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.909 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:14.909 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.909 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:92353 5.a e43/22 5:5a56774d:::benchmark_data_smithi001_23533_object92352:head v 43'5830, mlcod=43'5828)", 2024-09-17T02:21:14.909 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:14.877003+0000", 2024-09-17T02:21:14.909 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0025558680000000002, 2024-09-17T02:21:14.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002953528, 2024-09-17T02:21:14.909 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:14.909 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:14.909 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:14.910 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:14.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:14.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877003+0000", 2024-09-17T02:21:14.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:14.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877003+0000", 2024-09-17T02:21:14.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:14.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877004+0000", 2024-09-17T02:21:14.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2099999999999997e-07 2024-09-17T02:21:14.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:14.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877156+0000", 2024-09-17T02:21:14.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152101 2024-09-17T02:21:14.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:14.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877163+0000", 2024-09-17T02:21:14.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8789999999999997e-06 2024-09-17T02:21:14.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877167+0000", 2024-09-17T02:21:14.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6609999999999999e-06 2024-09-17T02:21:14.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:14.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877212+0000", 2024-09-17T02:21:14.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4308999999999999e-05 2024-09-17T02:21:14.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:14.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877230+0000", 2024-09-17T02:21:14.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8170000000000001e-05 2024-09-17T02:21:14.913 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.913 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:14.913 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.913 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:92341 5.e e43/22)", 2024-09-17T02:21:14.913 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:14.877180+0000", 2024-09-17T02:21:14.913 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.002378818, 2024-09-17T02:21:14.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002831779, 2024-09-17T02:21:14.913 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:14.914 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:14.914 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:14.914 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:14.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:14.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877180+0000", 2024-09-17T02:21:14.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:14.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877180+0000", 2024-09-17T02:21:14.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:14.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877181+0000", 2024-09-17T02:21:14.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1100000000000001e-07 2024-09-17T02:21:14.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:14.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877184+0000", 2024-09-17T02:21:14.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8559999999999998e-06 2024-09-17T02:21:14.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:14.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877190+0000", 2024-09-17T02:21:14.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2360000000000001e-06 2024-09-17T02:21:14.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877195+0000", 2024-09-17T02:21:14.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8590000000000004e-06 2024-09-17T02:21:14.916 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.916 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:14.916 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.916 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:92352 5.9 e43/22 5:9055660e:::benchmark_data_smithi001_23533_object92351:head v 43'5783, mlcod=43'5781)", 2024-09-17T02:21:14.916 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:14.877684+0000", 2024-09-17T02:21:14.917 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.001874784, 2024-09-17T02:21:14.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023758719999999998, 2024-09-17T02:21:14.917 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:14.917 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:14.917 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:14.917 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:14.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:14.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877684+0000", 2024-09-17T02:21:14.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:14.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877684+0000", 2024-09-17T02:21:14.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:14.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877685+0000", 2024-09-17T02:21:14.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2700000000000001e-07 2024-09-17T02:21:14.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:14.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877712+0000", 2024-09-17T02:21:14.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7821999999999999e-05 2024-09-17T02:21:14.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:14.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877719+0000", 2024-09-17T02:21:14.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5579999999999997e-06 2024-09-17T02:21:14.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877723+0000", 2024-09-17T02:21:14.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3810000000000001e-06 2024-09-17T02:21:14.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:14.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877759+0000", 2024-09-17T02:21:14.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6105000000000001e-05 2024-09-17T02:21:14.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:14.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877776+0000", 2024-09-17T02:21:14.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6609999999999999e-05 2024-09-17T02:21:14.920 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.920 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:14.920 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.920 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:92354 5.d e43/26 5:bc31d608:::benchmark_data_smithi001_23533_object92353:head v 43'5799, mlcod=43'5797)", 2024-09-17T02:21:14.921 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:14.877736+0000", 2024-09-17T02:21:14.921 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0018230709999999999, 2024-09-17T02:21:14.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023816380000000002, 2024-09-17T02:21:14.921 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:14.921 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:14.921 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:14.921 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:14.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:14.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877736+0000", 2024-09-17T02:21:14.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:14.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877736+0000", 2024-09-17T02:21:14.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:14.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877736+0000", 2024-09-17T02:21:14.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.99e-07 2024-09-17T02:21:14.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:14.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877762+0000", 2024-09-17T02:21:14.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5497999999999999e-05 2024-09-17T02:21:14.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:14.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877768+0000", 2024-09-17T02:21:14.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0430000000000004e-06 2024-09-17T02:21:14.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877772+0000", 2024-09-17T02:21:14.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2180000000000001e-06 2024-09-17T02:21:14.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:14.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877817+0000", 2024-09-17T02:21:14.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4953999999999997e-05 2024-09-17T02:21:14.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:14.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877834+0000", 2024-09-17T02:21:14.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6626999999999999e-05 2024-09-17T02:21:14.924 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.924 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:14.924 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.925 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPush(5.3 43/38 [PushOp(5:c2c3a616:::benchmark_data_smithi001_23533_object10775:head, version: 25'718, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(5:c2c3a616:::benchmark_data_smithi001_23533_object10775:head@25'718, size: 65536, copy_subset: [(0, 65536)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 65536, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-17T02:21:14.925 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:14.877784+0000", 2024-09-17T02:21:14.925 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.001774819, 2024-09-17T02:21:14.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024148020000000002, 2024-09-17T02:21:14.925 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:14.925 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:14.925 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:14.925 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:14.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:14.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877784+0000", 2024-09-17T02:21:14.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:14.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877784+0000", 2024-09-17T02:21:14.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:14.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877785+0000", 2024-09-17T02:21:14.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.34e-07 2024-09-17T02:21:14.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:14.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877817+0000", 2024-09-17T02:21:14.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2193999999999997e-05 2024-09-17T02:21:14.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:14.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877831+0000", 2024-09-17T02:21:14.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4588e-05 2024-09-17T02:21:14.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877844+0000", 2024-09-17T02:21:14.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3145999999999999e-05 2024-09-17T02:21:14.927 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.928 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:14.928 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.928 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 43/43 lb 5:c2c3587e:::benchmark_data_smithi001_23533_object57424:head)", 2024-09-17T02:21:14.928 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:14.877860+0000", 2024-09-17T02:21:14.928 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0016992140000000001, 2024-09-17T02:21:14.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024011459999999998, 2024-09-17T02:21:14.928 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:14.928 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:14.928 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:14.928 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:14.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:14.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877860+0000", 2024-09-17T02:21:14.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:14.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877860+0000", 2024-09-17T02:21:14.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:14.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877860+0000", 2024-09-17T02:21:14.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5100000000000001e-07 2024-09-17T02:21:14.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:14.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877866+0000", 2024-09-17T02:21:14.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8869999999999997e-06 2024-09-17T02:21:14.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:14.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877873+0000", 2024-09-17T02:21:14.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.737e-06 2024-09-17T02:21:14.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877877+0000", 2024-09-17T02:21:14.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6949999999999999e-06 2024-09-17T02:21:14.931 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.931 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:14.931 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.931 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:92337 5.b e43/38)", 2024-09-17T02:21:14.931 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:14.877885+0000", 2024-09-17T02:21:14.931 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.001674067, 2024-09-17T02:21:14.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024215349999999998, 2024-09-17T02:21:14.931 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:14.931 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:14.931 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:14.931 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:14.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:14.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877885+0000", 2024-09-17T02:21:14.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:14.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877885+0000", 2024-09-17T02:21:14.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:14.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877885+0000", 2024-09-17T02:21:14.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8e-07 2024-09-17T02:21:14.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:14.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877887+0000", 2024-09-17T02:21:14.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.883e-06 2024-09-17T02:21:14.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:14.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877892+0000", 2024-09-17T02:21:14.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1599999999999997e-06 2024-09-17T02:21:14.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877896+0000", 2024-09-17T02:21:14.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8650000000000003e-06 2024-09-17T02:21:14.934 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.934 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:14.934 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.934 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:92337 5.b 5:dac22589:::benchmark_data_smithi001_23533_object92336:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T02:21:14.934 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:14.868978+0000", 2024-09-17T02:21:14.934 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.010581254, 2024-09-17T02:21:14.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011387097000000001, 2024-09-17T02:21:14.934 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:14.934 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:14.934 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:14.935 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:14.935 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:14.935 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:14.935 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 92337 2024-09-17T02:21:14.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.935 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:14.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:14.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.868978+0000", 2024-09-17T02:21:14.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:14.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.868978+0000", 2024-09-17T02:21:14.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:14.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.868979+0000", 2024-09-17T02:21:14.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1689999999999999e-06 2024-09-17T02:21:14.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:14.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.869151+0000", 2024-09-17T02:21:14.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000171533 2024-09-17T02:21:14.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:14.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.869161+0000", 2024-09-17T02:21:14.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0202e-05 2024-09-17T02:21:14.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.869170+0000", 2024-09-17T02:21:14.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5289999999999997e-06 2024-09-17T02:21:14.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:14.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.870963+0000", 2024-09-17T02:21:14.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017926890000000001 2024-09-17T02:21:14.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:14.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.871294+0000", 2024-09-17T02:21:14.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033106999999999999 2024-09-17T02:21:14.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:14.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.871458+0000", 2024-09-17T02:21:14.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016353099999999999 2024-09-17T02:21:14.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:14.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.876776+0000", 2024-09-17T02:21:14.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0053179810000000003 2024-09-17T02:21:14.939 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.939 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:14.939 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.939 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:92340 5.b e43/38)", 2024-09-17T02:21:14.939 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:14.877901+0000", 2024-09-17T02:21:14.939 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00165782, 2024-09-17T02:21:14.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002554031, 2024-09-17T02:21:14.940 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:14.940 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:14.940 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:14.940 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:14.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:14.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877901+0000", 2024-09-17T02:21:14.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:14.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877901+0000", 2024-09-17T02:21:14.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:14.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877901+0000", 2024-09-17T02:21:14.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6e-07 2024-09-17T02:21:14.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:14.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877903+0000", 2024-09-17T02:21:14.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.426e-06 2024-09-17T02:21:14.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:14.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877908+0000", 2024-09-17T02:21:14.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8289999999999998e-06 2024-09-17T02:21:14.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.877911+0000", 2024-09-17T02:21:14.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4070000000000002e-06 2024-09-17T02:21:14.942 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.942 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:14.942 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.943 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:92355 5.e e43/22)", 2024-09-17T02:21:14.943 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:14.879634+0000", 2024-09-17T02:21:14.943 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4294967295.9999247, 2024-09-17T02:21:14.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00086370000000000001, 2024-09-17T02:21:14.943 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:14.943 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:14.943 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:14.943 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:14.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:14.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.879634+0000", 2024-09-17T02:21:14.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:14.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.879634+0000", 2024-09-17T02:21:14.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:14.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.879635+0000", 2024-09-17T02:21:14.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.99e-07 2024-09-17T02:21:14.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:14.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.879639+0000", 2024-09-17T02:21:14.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8909999999999997e-06 2024-09-17T02:21:14.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:14.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.879648+0000", 2024-09-17T02:21:14.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9779999999999994e-06 2024-09-17T02:21:14.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.879654+0000", 2024-09-17T02:21:14.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3419999999999996e-06 2024-09-17T02:21:14.945 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.945 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:14.946 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.946 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:92340 5.b e43/38)", 2024-09-17T02:21:14.946 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:14.880230+0000", 2024-09-17T02:21:14.946 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4294967295.9993291, 2024-09-17T02:21:14.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031488700000000002, 2024-09-17T02:21:14.946 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:14.946 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:14.946 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:14.946 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:14.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:14.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.880230+0000", 2024-09-17T02:21:14.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:14.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.880230+0000", 2024-09-17T02:21:14.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:14.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.880231+0000", 2024-09-17T02:21:14.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3799999999999997e-07 2024-09-17T02:21:14.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:14.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.880234+0000", 2024-09-17T02:21:14.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7610000000000001e-06 2024-09-17T02:21:14.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:14.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.880257+0000", 2024-09-17T02:21:14.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2390000000000001e-05 2024-09-17T02:21:14.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.880263+0000", 2024-09-17T02:21:14.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9390000000000002e-06 2024-09-17T02:21:14.949 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.949 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:14.949 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.949 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:92348 5.b e43/38)", 2024-09-17T02:21:14.949 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:14.880557+0000", 2024-09-17T02:21:14.949 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4294967295.9990025, 2024-09-17T02:21:14.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9360000000000003e-05, 2024-09-17T02:21:14.949 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:14.949 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:14.949 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:14.949 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:14.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:14.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.880557+0000", 2024-09-17T02:21:14.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:14.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.880557+0000", 2024-09-17T02:21:14.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:14.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:14.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.880557+0000", 2024-09-17T02:21:14.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0500000000000004e-07 2024-09-17T02:21:14.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:14.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.880560+0000", 2024-09-17T02:21:14.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6690000000000002e-06 2024-09-17T02:21:14.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:14.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.880570+0000", 2024-09-17T02:21:14.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0266e-05 2024-09-17T02:21:14.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:14.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:14.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:14.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:14.880577+0000", 2024-09-17T02:21:14.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4799999999999998e-06 2024-09-17T02:21:14.952 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.952 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:14.952 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.952 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:14.952 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:21:14.952 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 19 2024-09-17T02:21:14.952 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:14.953 INFO:teuthology.orchestra.run.smithi001.stderr:nodeep-scrub is unset 2024-09-17T02:21:14.954 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:14.954+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:14.955 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:14.993 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:21:14.993 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:21:15.012 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:21:15.012 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:21:15.031 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:21:15.031 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:21:15.054 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:15.054+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:15.153 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:15.154 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:15.154 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:15.154+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:15.173 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:15.259 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:15.262+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:15.357 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:15.358+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:15.375 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:15.375 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:15.397 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:15.458 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:15.458+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:15.550 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:15.550 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:15.558 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:15.559+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:15.571 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:15.659 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:15.659+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:15.722 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:15.723 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:15.743 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:15.773 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 43 16 94159 94143 136.82 125.438 0.00703085 0.00730431 2024-09-17T02:21:15.787 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:15.790+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:15.860 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:15.862+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:15.894 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:15.894 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:15.916 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:21:15.961 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:15.962+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:16.063 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:16.062+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:16.075 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:16.075 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:16.098 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:21:16.164 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:16.166+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:16.255 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:16.256 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:16.265 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:16.267+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:16.277 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:21:16.366 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:16.366+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:16.467 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:16.466+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:16.477 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:16.477 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:16.501 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:16.568 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:16.570+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:16.660 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:16.660 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:16.669 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:16.671+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:16.679 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:16.770 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:16.771+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:16.773 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 44 16 96159 96143 136.551 125 0.0075089 0.00731845 2024-09-17T02:21:16.872 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:16.874+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:16.881 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:16.881 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:16.902 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:16.971 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T02:21:16.972 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:16.974+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:17.050 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:21:17.066 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:17.066 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:17.073 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:17.074+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:17.086 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:17.174 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:17.174+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:17.207 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:21:17.208 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:21:17.227 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:21:17.227 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:21:17.240 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:17.240 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:17.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.240 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:97094 5.3 e44/38 5:cd8017ce:::benchmark_data_smithi001_23533_object97093:head v 44'6124, mlcod=44'6121)", 2024-09-17T02:21:17.240 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.242446+0000", 2024-09-17T02:21:17.240 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0019587459999999999, 2024-09-17T02:21:17.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019830020000000002, 2024-09-17T02:21:17.240 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.240 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.241 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:17.241 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242446+0000", 2024-09-17T02:21:17.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242446+0000", 2024-09-17T02:21:17.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242446+0000", 2024-09-17T02:21:17.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2300000000000001e-07 2024-09-17T02:21:17.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242475+0000", 2024-09-17T02:21:17.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8983e-05 2024-09-17T02:21:17.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242483+0000", 2024-09-17T02:21:17.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9440000000000005e-06 2024-09-17T02:21:17.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242491+0000", 2024-09-17T02:21:17.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9829999999999996e-06 2024-09-17T02:21:17.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242537+0000", 2024-09-17T02:21:17.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5498999999999999e-05 2024-09-17T02:21:17.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242558+0000", 2024-09-17T02:21:17.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1175999999999999e-05 2024-09-17T02:21:17.244 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.244 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.244 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.244 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:97091 5.b e44/38 5:d5abc0f6:::benchmark_data_smithi001_23533_object97090:head v 44'5979, mlcod=44'5977)", 2024-09-17T02:21:17.244 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.242682+0000", 2024-09-17T02:21:17.244 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001722187, 2024-09-17T02:21:17.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018140999999999999, 2024-09-17T02:21:17.244 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.244 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.244 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:17.244 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242682+0000", 2024-09-17T02:21:17.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242682+0000", 2024-09-17T02:21:17.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242683+0000", 2024-09-17T02:21:17.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3900000000000004e-07 2024-09-17T02:21:17.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242717+0000", 2024-09-17T02:21:17.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4249999999999999e-05 2024-09-17T02:21:17.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242730+0000", 2024-09-17T02:21:17.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2599000000000001e-05 2024-09-17T02:21:17.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242737+0000", 2024-09-17T02:21:17.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.029e-06 2024-09-17T02:21:17.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242819+0000", 2024-09-17T02:21:17.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2609999999999997e-05 2024-09-17T02:21:17.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242838+0000", 2024-09-17T02:21:17.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8850000000000001e-05 2024-09-17T02:21:17.247 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.248 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.248 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.248 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:97093 5.e e44/22 5:7da8f9b1:::benchmark_data_smithi001_23533_object97092:head v 44'6064, mlcod=44'6062)", 2024-09-17T02:21:17.248 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.242755+0000", 2024-09-17T02:21:17.248 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0016494999999999999, 2024-09-17T02:21:17.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001788043, 2024-09-17T02:21:17.248 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.248 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.248 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:17.248 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242755+0000", 2024-09-17T02:21:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242755+0000", 2024-09-17T02:21:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242755+0000", 2024-09-17T02:21:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.72e-07 2024-09-17T02:21:17.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242785+0000", 2024-09-17T02:21:17.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9839999999999999e-05 2024-09-17T02:21:17.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242793+0000", 2024-09-17T02:21:17.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8590000000000005e-06 2024-09-17T02:21:17.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242798+0000", 2024-09-17T02:21:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4199999999999998e-06 2024-09-17T02:21:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242840+0000", 2024-09-17T02:21:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1165999999999999e-05 2024-09-17T02:21:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242856+0000", 2024-09-17T02:21:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6337e-05 2024-09-17T02:21:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:97096 5.4 e44/36)", 2024-09-17T02:21:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.242810+0000", 2024-09-17T02:21:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0015941919999999999, 2024-09-17T02:21:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001761185, 2024-09-17T02:21:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242810+0000", 2024-09-17T02:21:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242810+0000", 2024-09-17T02:21:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242810+0000", 2024-09-17T02:21:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1699999999999999e-07 2024-09-17T02:21:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242843+0000", 2024-09-17T02:21:17.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2481999999999998e-05 2024-09-17T02:21:17.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242850+0000", 2024-09-17T02:21:17.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2370000000000003e-06 2024-09-17T02:21:17.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242857+0000", 2024-09-17T02:21:17.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5640000000000002e-06 2024-09-17T02:21:17.254 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.254 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:97095 5.e e44/22)", 2024-09-17T02:21:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.242865+0000", 2024-09-17T02:21:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00153911, 2024-09-17T02:21:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001743901, 2024-09-17T02:21:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242865+0000", 2024-09-17T02:21:17.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242865+0000", 2024-09-17T02:21:17.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242866+0000", 2024-09-17T02:21:17.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2399999999999999e-07 2024-09-17T02:21:17.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242893+0000", 2024-09-17T02:21:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7344000000000001e-05 2024-09-17T02:21:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242900+0000", 2024-09-17T02:21:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8070000000000002e-06 2024-09-17T02:21:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242905+0000", 2024-09-17T02:21:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9389999999999996e-06 2024-09-17T02:21:17.258 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.258 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.258 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.258 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97099 5.6 5.cbcf39a6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:17.258 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.243183+0000", 2024-09-17T02:21:17.258 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001221855, 2024-09-17T02:21:17.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014728359999999999, 2024-09-17T02:21:17.258 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.258 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.258 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:17.258 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97099 2024-09-17T02:21:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.243183+0000", 2024-09-17T02:21:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.243183+0000", 2024-09-17T02:21:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.243184+0000", 2024-09-17T02:21:17.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:21:17.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.243313+0000", 2024-09-17T02:21:17.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012959399999999999 2024-09-17T02:21:17.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.243324+0000", 2024-09-17T02:21:17.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1046999999999999e-05 2024-09-17T02:21:17.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.243332+0000", 2024-09-17T02:21:17.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4789999999999999e-06 2024-09-17T02:21:17.261 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.261 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.261 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.262 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:97098 5.e e44/22)", 2024-09-17T02:21:17.262 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.244363+0000", 2024-09-17T02:21:17.262 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.1136000000000001e-05, 2024-09-17T02:21:17.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034666200000000002, 2024-09-17T02:21:17.262 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.262 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.262 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:17.262 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.244363+0000", 2024-09-17T02:21:17.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.244363+0000", 2024-09-17T02:21:17.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.244364+0000", 2024-09-17T02:21:17.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8500000000000001e-07 2024-09-17T02:21:17.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.244410+0000", 2024-09-17T02:21:17.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6334000000000001e-05 2024-09-17T02:21:17.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.244418+0000", 2024-09-17T02:21:17.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0919999999999998e-06 2024-09-17T02:21:17.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.244423+0000", 2024-09-17T02:21:17.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5809999999999998e-06 2024-09-17T02:21:17.266 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.266 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.266 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.266 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97086 5.c 5:385f64ef:::benchmark_data_smithi001_23533_object97085:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:17.266 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.239323+0000", 2024-09-17T02:21:17.266 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0050808759999999998, 2024-09-17T02:21:17.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0054415160000000004, 2024-09-17T02:21:17.266 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.267 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.267 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:17.267 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:17.267 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:17.267 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:17.267 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97086 2024-09-17T02:21:17.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.267 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239323+0000", 2024-09-17T02:21:17.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239323+0000", 2024-09-17T02:21:17.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239325+0000", 2024-09-17T02:21:17.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.517e-06 2024-09-17T02:21:17.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239354+0000", 2024-09-17T02:21:17.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9145e-05 2024-09-17T02:21:17.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239367+0000", 2024-09-17T02:21:17.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2848e-05 2024-09-17T02:21:17.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239385+0000", 2024-09-17T02:21:17.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8459999999999999e-05 2024-09-17T02:21:17.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239449+0000", 2024-09-17T02:21:17.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3793000000000004e-05 2024-09-17T02:21:17.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239591+0000", 2024-09-17T02:21:17.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000141765 2024-09-17T02:21:17.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:17.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239726+0000", 2024-09-17T02:21:17.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013476800000000001 2024-09-17T02:21:17.270 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.270 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.270 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.271 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97088 5.5 5:ac6c3fac:::benchmark_data_smithi001_23533_object97087:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:17.271 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.239589+0000", 2024-09-17T02:21:17.271 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0048157620000000003, 2024-09-17T02:21:17.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052490810000000001, 2024-09-17T02:21:17.271 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.271 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.271 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:17.271 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:17.271 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:17.271 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:17.271 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97088 2024-09-17T02:21:17.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.272 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239589+0000", 2024-09-17T02:21:17.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239589+0000", 2024-09-17T02:21:17.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239590+0000", 2024-09-17T02:21:17.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1100000000000004e-07 2024-09-17T02:21:17.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239730+0000", 2024-09-17T02:21:17.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014034799999999999 2024-09-17T02:21:17.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239742+0000", 2024-09-17T02:21:17.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1661999999999999e-05 2024-09-17T02:21:17.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239749+0000", 2024-09-17T02:21:17.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6590000000000007e-06 2024-09-17T02:21:17.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239793+0000", 2024-09-17T02:21:17.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4138000000000003e-05 2024-09-17T02:21:17.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239930+0000", 2024-09-17T02:21:17.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000136804 2024-09-17T02:21:17.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:17.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.240131+0000", 2024-09-17T02:21:17.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020062300000000001 2024-09-17T02:21:17.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:17.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242743+0000", 2024-09-17T02:21:17.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002612503 2024-09-17T02:21:17.276 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.276 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.276 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.276 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97089 5.c 5:39c683a8:::benchmark_data_smithi001_23533_object97088:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:17.276 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.239766+0000", 2024-09-17T02:21:17.276 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0046383220000000003, 2024-09-17T02:21:17.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051699479999999997, 2024-09-17T02:21:17.276 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.276 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.277 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:17.277 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:17.277 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:17.277 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:17.277 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97089 2024-09-17T02:21:17.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.277 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239766+0000", 2024-09-17T02:21:17.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239766+0000", 2024-09-17T02:21:17.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239767+0000", 2024-09-17T02:21:17.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2900000000000003e-07 2024-09-17T02:21:17.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239809+0000", 2024-09-17T02:21:17.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2481000000000002e-05 2024-09-17T02:21:17.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239820+0000", 2024-09-17T02:21:17.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0614999999999999e-05 2024-09-17T02:21:17.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239826+0000", 2024-09-17T02:21:17.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6579999999999996e-06 2024-09-17T02:21:17.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242243+0000", 2024-09-17T02:21:17.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024170089999999999 2024-09-17T02:21:17.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242381+0000", 2024-09-17T02:21:17.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013794100000000001 2024-09-17T02:21:17.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:17.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.242539+0000", 2024-09-17T02:21:17.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015769100000000001 2024-09-17T02:21:17.280 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.280 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.281 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.281 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97090 5.6 5:6178df20:::benchmark_data_smithi001_23533_object97089:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:17.281 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.239840+0000", 2024-09-17T02:21:17.281 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0045645479999999999, 2024-09-17T02:21:17.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051667980000000002, 2024-09-17T02:21:17.281 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.281 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.281 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:17.281 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:17.281 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:17.281 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:17.282 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97090 2024-09-17T02:21:17.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.282 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239840+0000", 2024-09-17T02:21:17.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239840+0000", 2024-09-17T02:21:17.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239841+0000", 2024-09-17T02:21:17.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7999999999999995e-07 2024-09-17T02:21:17.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239876+0000", 2024-09-17T02:21:17.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5459000000000001e-05 2024-09-17T02:21:17.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239885+0000", 2024-09-17T02:21:17.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6640000000000004e-06 2024-09-17T02:21:17.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239891+0000", 2024-09-17T02:21:17.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9939999999999997e-06 2024-09-17T02:21:17.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239937+0000", 2024-09-17T02:21:17.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6489000000000002e-05 2024-09-17T02:21:17.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.240049+0000", 2024-09-17T02:21:17.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111834 2024-09-17T02:21:17.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:17.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.240170+0000", 2024-09-17T02:21:17.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012153499999999999 2024-09-17T02:21:17.285 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.285 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.285 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.285 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97092 5.a 5:502acaa9:::benchmark_data_smithi001_23533_object97091:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:17.285 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.239909+0000", 2024-09-17T02:21:17.286 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.004495415, 2024-09-17T02:21:17.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005165925, 2024-09-17T02:21:17.286 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.286 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.286 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:17.286 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:17.286 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:17.286 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:17.286 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97092 2024-09-17T02:21:17.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.286 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239909+0000", 2024-09-17T02:21:17.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239909+0000", 2024-09-17T02:21:17.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239909+0000", 2024-09-17T02:21:17.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9500000000000003e-07 2024-09-17T02:21:17.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239945+0000", 2024-09-17T02:21:17.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5080000000000003e-05 2024-09-17T02:21:17.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239955+0000", 2024-09-17T02:21:17.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0378e-05 2024-09-17T02:21:17.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.239961+0000", 2024-09-17T02:21:17.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0939999999999996e-06 2024-09-17T02:21:17.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.240016+0000", 2024-09-17T02:21:17.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5245999999999999e-05 2024-09-17T02:21:17.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.240140+0000", 2024-09-17T02:21:17.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012342599999999999 2024-09-17T02:21:17.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:17.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.240276+0000", 2024-09-17T02:21:17.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013640899999999999 2024-09-17T02:21:17.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:17.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.243545+0000", 2024-09-17T02:21:17.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032689329999999999 2024-09-17T02:21:17.290 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.290 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.290 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.290 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.290 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:21:17.290 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 12 2024-09-17T02:21:17.290 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:17.292 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:21:17.292 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:17.294+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:17.293 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:17.293 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:21:17.392 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:17.394+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:17.444 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:17.444 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:21:17.444 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:21:17.445 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:21:17.445 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:17.466 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:17.511 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:17.514+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:17.594 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:17.594+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:17.611 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:17.611 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:21:17.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:21:17.611 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:17.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.612 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:17.612 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:21:17.612 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 61.052920641999997, 2024-09-17T02:21:17.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021799929999999999, 2024-09-17T02:21:17.612 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.612 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.612 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:17.613 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:21:17.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562003+0000", 2024-09-17T02:21:17.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562007+0000", 2024-09-17T02:21:17.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6260000000000001e-06 2024-09-17T02:21:17.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562021+0000", 2024-09-17T02:21:17.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4440000000000001e-05 2024-09-17T02:21:17.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562053+0000", 2024-09-17T02:21:17.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2159000000000002e-05 2024-09-17T02:21:17.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562076+0000", 2024-09-17T02:21:17.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2926999999999999e-05 2024-09-17T02:21:17.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562218+0000", 2024-09-17T02:21:17.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000141726 2024-09-17T02:21:17.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562506+0000", 2024-09-17T02:21:17.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028752399999999999 2024-09-17T02:21:17.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:17.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562830+0000", 2024-09-17T02:21:17.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032427399999999999 2024-09-17T02:21:17.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:17.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566900+0000", 2024-09-17T02:21:17.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040705660000000003 2024-09-17T02:21:17.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:17.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583581+0000", 2024-09-17T02:21:17.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016680210000000001 2024-09-17T02:21:17.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:17.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583704+0000", 2024-09-17T02:21:17.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012289899999999999 2024-09-17T02:21:17.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:17.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583803+0000", 2024-09-17T02:21:17.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9579000000000003e-05 2024-09-17T02:21:17.618 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.618 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.618 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.618 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:17.618 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:21:17.618 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 61.052793430000001, 2024-09-17T02:21:17.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022056035000000002, 2024-09-17T02:21:17.618 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.618 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.618 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:17.619 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:21:17.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:21:17.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562132+0000", 2024-09-17T02:21:17.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6300000000000001e-06 2024-09-17T02:21:17.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562142+0000", 2024-09-17T02:21:17.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.022e-05 2024-09-17T02:21:17.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562164+0000", 2024-09-17T02:21:17.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2002999999999999e-05 2024-09-17T02:21:17.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562180+0000", 2024-09-17T02:21:17.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5930000000000002e-05 2024-09-17T02:21:17.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563517+0000", 2024-09-17T02:21:17.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001336776 2024-09-17T02:21:17.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563635+0000", 2024-09-17T02:21:17.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117976 2024-09-17T02:21:17.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:17.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563819+0000", 2024-09-17T02:21:17.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018411499999999999 2024-09-17T02:21:17.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:17.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566977+0000", 2024-09-17T02:21:17.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031575990000000001 2024-09-17T02:21:17.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:17.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583917+0000", 2024-09-17T02:21:17.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016940093999999999 2024-09-17T02:21:17.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:17.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584066+0000", 2024-09-17T02:21:17.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000149746 2024-09-17T02:21:17.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:17.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584186+0000", 2024-09-17T02:21:17.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011994600000000001 2024-09-17T02:21:17.624 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.624 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.624 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.624 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:17.624 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:17.624 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 61.052612719000003, 2024-09-17T02:21:17.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023664803000000002, 2024-09-17T02:21:17.625 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.625 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.625 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:17.625 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:17.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:17.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562313+0000", 2024-09-17T02:21:17.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.764e-06 2024-09-17T02:21:17.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562323+0000", 2024-09-17T02:21:17.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0166000000000001e-05 2024-09-17T02:21:17.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562343+0000", 2024-09-17T02:21:17.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9633999999999999e-05 2024-09-17T02:21:17.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562367+0000", 2024-09-17T02:21:17.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4556e-05 2024-09-17T02:21:17.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563777+0000", 2024-09-17T02:21:17.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014102330000000001 2024-09-17T02:21:17.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563969+0000", 2024-09-17T02:21:17.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000191361 2024-09-17T02:21:17.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:17.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564148+0000", 2024-09-17T02:21:17.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017934599999999999 2024-09-17T02:21:17.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:17.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566989+0000", 2024-09-17T02:21:17.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028407010000000002 2024-09-17T02:21:17.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:17.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585770+0000", 2024-09-17T02:21:17.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018781566999999999 2024-09-17T02:21:17.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:17.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585874+0000", 2024-09-17T02:21:17.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103489 2024-09-17T02:21:17.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:17.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585976+0000", 2024-09-17T02:21:17.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101986 2024-09-17T02:21:17.630 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.630 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.630 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.631 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:17.631 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:17.631 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 61.052529839000002, 2024-09-17T02:21:17.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024118555999999999, 2024-09-17T02:21:17.631 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.631 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.631 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:17.631 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:17.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:17.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562395+0000", 2024-09-17T02:21:17.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3969999999999999e-06 2024-09-17T02:21:17.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562405+0000", 2024-09-17T02:21:17.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4229999999999994e-06 2024-09-17T02:21:17.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562427+0000", 2024-09-17T02:21:17.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759999999999998e-05 2024-09-17T02:21:17.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562444+0000", 2024-09-17T02:21:17.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7019000000000001e-05 2024-09-17T02:21:17.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564681+0000", 2024-09-17T02:21:17.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022376929999999998 2024-09-17T02:21:17.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564887+0000", 2024-09-17T02:21:17.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000206178 2024-09-17T02:21:17.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:17.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565230+0000", 2024-09-17T02:21:17.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034233499999999998 2024-09-17T02:21:17.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:17.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567000+0000", 2024-09-17T02:21:17.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017706390000000001 2024-09-17T02:21:17.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:17.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586126+0000", 2024-09-17T02:21:17.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019125672 2024-09-17T02:21:17.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:17.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586314+0000", 2024-09-17T02:21:17.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018740200000000001 2024-09-17T02:21:17.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:17.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586513+0000", 2024-09-17T02:21:17.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019903799999999999 2024-09-17T02:21:17.636 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.637 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.637 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.637 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:17.637 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:21:17.637 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 61.052455166000001, 2024-09-17T02:21:17.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021940779000000001, 2024-09-17T02:21:17.637 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.637 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.637 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:17.637 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:21:17.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562469+0000", 2024-09-17T02:21:17.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562470+0000", 2024-09-17T02:21:17.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5030000000000001e-06 2024-09-17T02:21:17.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562478+0000", 2024-09-17T02:21:17.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.157e-06 2024-09-17T02:21:17.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562496+0000", 2024-09-17T02:21:17.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7876e-05 2024-09-17T02:21:17.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562511+0000", 2024-09-17T02:21:17.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5067e-05 2024-09-17T02:21:17.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564628+0000", 2024-09-17T02:21:17.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021171860000000001 2024-09-17T02:21:17.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564838+0000", 2024-09-17T02:21:17.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000209283 2024-09-17T02:21:17.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:17.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565078+0000", 2024-09-17T02:21:17.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024075100000000001 2024-09-17T02:21:17.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:17.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567012+0000", 2024-09-17T02:21:17.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019331050000000001 2024-09-17T02:21:17.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:17.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584289+0000", 2024-09-17T02:21:17.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017277464999999999 2024-09-17T02:21:17.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:17.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584363+0000", 2024-09-17T02:21:17.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3852999999999999e-05 2024-09-17T02:21:17.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:17.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584409+0000", 2024-09-17T02:21:17.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6533000000000003e-05 2024-09-17T02:21:17.642 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.642 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.642 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.642 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:17.643 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:21:17.643 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 61.052209642000001, 2024-09-17T02:21:17.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021867154, 2024-09-17T02:21:17.643 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.643 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.643 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:17.643 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:21:17.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562714+0000", 2024-09-17T02:21:17.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562716+0000", 2024-09-17T02:21:17.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.384e-06 2024-09-17T02:21:17.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562726+0000", 2024-09-17T02:21:17.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.04e-05 2024-09-17T02:21:17.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562745+0000", 2024-09-17T02:21:17.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8770000000000002e-05 2024-09-17T02:21:17.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562759+0000", 2024-09-17T02:21:17.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4392999999999999e-05 2024-09-17T02:21:17.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565882+0000", 2024-09-17T02:21:17.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031227659999999999 2024-09-17T02:21:17.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566217+0000", 2024-09-17T02:21:17.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033498000000000002 2024-09-17T02:21:17.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:17.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584581+0000", 2024-09-17T02:21:17.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018364460999999999 2024-09-17T02:21:17.646 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.646 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.646 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.647 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:17.647 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:17.647 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 35.046460734999997, 2024-09-17T02:21:17.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:21:17.647 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.647 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.647 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:17.647 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:17.647 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:17.647 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:17.647 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:21:17.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.648 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:17.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:17.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:21:17.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:21:17.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:21:17.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:21:17.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:21:17.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:21:17.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:21:17.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:21:17.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:21:17.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:21:17.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:21:17.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:21:17.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:17.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:21:17.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:21:17.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:17.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:21:17.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:21:17.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:17.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:21:17.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:21:17.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:17.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:21:17.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:21:17.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:17.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:21:17.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:21:17.653 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.653 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.653 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.653 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:17.653 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:17.653 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 35.042558485000001, 2024-09-17T02:21:17.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:21:17.653 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.654 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.654 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:17.654 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:17.654 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:17.654 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:17.654 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:21:17.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.654 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:17.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:17.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:21:17.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:21:17.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:21:17.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:21:17.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:21:17.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:21:17.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:21:17.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:21:17.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:21:17.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:21:17.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:21:17.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:21:17.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:17.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:21:17.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:21:17.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:17.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:21:17.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:21:17.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:17.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:21:17.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:21:17.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:17.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:21:17.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:21:17.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:17.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:21:17.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:21:17.659 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.659 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.659 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71190 5.3 e39/38 5:c99e0ae2:::benchmark_data_smithi001_23533_object71189:head v 39'4516, mlcod=35'4513)", 2024-09-17T02:21:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.607413+0000", 2024-09-17T02:21:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.007510461000001, 2024-09-17T02:21:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023407462, 2024-09-17T02:21:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607413+0000", 2024-09-17T02:21:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607413+0000", 2024-09-17T02:21:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607415+0000", 2024-09-17T02:21:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2139999999999999e-06 2024-09-17T02:21:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607479+0000", 2024-09-17T02:21:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4374000000000004e-05 2024-09-17T02:21:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607496+0000", 2024-09-17T02:21:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6820000000000002e-05 2024-09-17T02:21:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607512+0000", 2024-09-17T02:21:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5976000000000001e-05 2024-09-17T02:21:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609288+0000", 2024-09-17T02:21:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001776311 2024-09-17T02:21:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609327+0000", 2024-09-17T02:21:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9165999999999997e-05 2024-09-17T02:21:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630723+0000", 2024-09-17T02:21:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021395290000000001 2024-09-17T02:21:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630821+0000", 2024-09-17T02:21:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8311000000000001e-05 2024-09-17T02:21:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71206 5.3 e39/38 5:c6c9386d:::benchmark_data_smithi001_23533_object71205:head v 39'4517, mlcod=35'4513)", 2024-09-17T02:21:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.005231370000001, 2024-09-17T02:21:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026101868, 2024-09-17T02:21:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609694+0000", 2024-09-17T02:21:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9539999999999998e-06 2024-09-17T02:21:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609841+0000", 2024-09-17T02:21:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014690800000000001 2024-09-17T02:21:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609872+0000", 2024-09-17T02:21:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0326000000000001e-05 2024-09-17T02:21:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609892+0000", 2024-09-17T02:21:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9848999999999999e-05 2024-09-17T02:21:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613826+0000", 2024-09-17T02:21:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039345140000000001 2024-09-17T02:21:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613908+0000", 2024-09-17T02:21:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2412999999999999e-05 2024-09-17T02:21:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635696+0000", 2024-09-17T02:21:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021787597999999998 2024-09-17T02:21:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635794+0000", 2024-09-17T02:21:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8306000000000004e-05 2024-09-17T02:21:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.672 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71210 5.3 e39/38 5:c0498d13:::benchmark_data_smithi001_23533_object71209:head v 39'4518, mlcod=35'4513)", 2024-09-17T02:21:17.672 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:17.672 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.003753403999999, 2024-09-17T02:21:17.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024703197, 2024-09-17T02:21:17.672 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611172+0000", 2024-09-17T02:21:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6470000000000001e-06 2024-09-17T02:21:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611344+0000", 2024-09-17T02:21:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000171607 2024-09-17T02:21:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611389+0000", 2024-09-17T02:21:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5738000000000002e-05 2024-09-17T02:21:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611407+0000", 2024-09-17T02:21:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7893e-05 2024-09-17T02:21:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617820+0000", 2024-09-17T02:21:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064131070000000004 2024-09-17T02:21:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617885+0000", 2024-09-17T02:21:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4442000000000004e-05 2024-09-17T02:21:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635806+0000", 2024-09-17T02:21:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017920874999999999 2024-09-17T02:21:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635874+0000", 2024-09-17T02:21:17.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7887999999999998e-05 2024-09-17T02:21:17.677 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.677 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.677 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.677 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71213 5.3 e39/38 5:ce9071a1:::benchmark_data_smithi001_23533_object71212:head v 39'4519, mlcod=35'4513)", 2024-09-17T02:21:17.677 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.613453+0000", 2024-09-17T02:21:17.677 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.001470893, 2024-09-17T02:21:17.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022494631000000001, 2024-09-17T02:21:17.677 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.677 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.677 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613453+0000", 2024-09-17T02:21:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613453+0000", 2024-09-17T02:21:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613455+0000", 2024-09-17T02:21:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.703e-06 2024-09-17T02:21:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613594+0000", 2024-09-17T02:21:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000139405 2024-09-17T02:21:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613625+0000", 2024-09-17T02:21:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0993e-05 2024-09-17T02:21:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613646+0000", 2024-09-17T02:21:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0761999999999999e-05 2024-09-17T02:21:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.620855+0000", 2024-09-17T02:21:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0072088270000000001 2024-09-17T02:21:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.620933+0000", 2024-09-17T02:21:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8807000000000006e-05 2024-09-17T02:21:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635882+0000", 2024-09-17T02:21:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014948530999999999 2024-09-17T02:21:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635948+0000", 2024-09-17T02:21:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5603000000000002e-05 2024-09-17T02:21:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71214 5.3 e39/38 5:c5e24f3f:::benchmark_data_smithi001_23533_object71213:head v 39'4520, mlcod=35'4513)", 2024-09-17T02:21:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.999389172000001, 2024-09-17T02:21:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024251297000000002, 2024-09-17T02:21:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615536+0000", 2024-09-17T02:21:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5370000000000001e-06 2024-09-17T02:21:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615696+0000", 2024-09-17T02:21:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015948700000000001 2024-09-17T02:21:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615723+0000", 2024-09-17T02:21:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7518999999999999e-05 2024-09-17T02:21:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615742+0000", 2024-09-17T02:21:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8519999999999999e-05 2024-09-17T02:21:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.624440+0000", 2024-09-17T02:21:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0086983080000000001 2024-09-17T02:21:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.624489+0000", 2024-09-17T02:21:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8838000000000002e-05 2024-09-17T02:21:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639673+0000", 2024-09-17T02:21:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01518451 2024-09-17T02:21:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639786+0000", 2024-09-17T02:21:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011257800000000001 2024-09-17T02:21:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71215 5.3 e39/38 5:c5603662:::benchmark_data_smithi001_23533_object71214:head v 39'4521, mlcod=35'4513)", 2024-09-17T02:21:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.617466+0000", 2024-09-17T02:21:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.997458192, 2024-09-17T02:21:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022395379999999999, 2024-09-17T02:21:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617466+0000", 2024-09-17T02:21:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617466+0000", 2024-09-17T02:21:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617467+0000", 2024-09-17T02:21:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3600000000000002e-07 2024-09-17T02:21:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617521+0000", 2024-09-17T02:21:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4654999999999998e-05 2024-09-17T02:21:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617548+0000", 2024-09-17T02:21:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6706000000000001e-05 2024-09-17T02:21:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617566+0000", 2024-09-17T02:21:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7989e-05 2024-09-17T02:21:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.627598+0000", 2024-09-17T02:21:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010031854 2024-09-17T02:21:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.627656+0000", 2024-09-17T02:21:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8511999999999998e-05 2024-09-17T02:21:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639794+0000", 2024-09-17T02:21:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012137445 2024-09-17T02:21:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639861+0000", 2024-09-17T02:21:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7282999999999999e-05 2024-09-17T02:21:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:71277 5.a 5:5576e9b8:::benchmark_data_smithi001_23533_object71276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.630891+0000", 2024-09-17T02:21:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.984032652, 2024-09-17T02:21:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022210245999999999, 2024-09-17T02:21:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71277 2024-09-17T02:21:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630891+0000", 2024-09-17T02:21:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630891+0000", 2024-09-17T02:21:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630893+0000", 2024-09-17T02:21:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-09-17T02:21:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630961+0000", 2024-09-17T02:21:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7971000000000004e-05 2024-09-17T02:21:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630989+0000", 2024-09-17T02:21:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7855999999999999e-05 2024-09-17T02:21:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631010+0000", 2024-09-17T02:21:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0888999999999999e-05 2024-09-17T02:21:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631123+0000", 2024-09-17T02:21:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011292 2024-09-17T02:21:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631434+0000", 2024-09-17T02:21:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00031039199999999999 2024-09-17T02:21:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631679+0000", 2024-09-17T02:21:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024517099999999997 2024-09-17T02:21:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.636619+0000", 2024-09-17T02:21:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049405339999999999 2024-09-17T02:21:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.652851+0000", 2024-09-17T02:21:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016231440999999999 2024-09-17T02:21:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.653012+0000", 2024-09-17T02:21:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016157199999999999 2024-09-17T02:21:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:17.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.653101+0000", 2024-09-17T02:21:17.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9190000000000005e-05 2024-09-17T02:21:17.697 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.697 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.697 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97147 5.0 5:02d17bf7:::benchmark_data_smithi001_23533_object97146:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268128+0000", 2024-09-17T02:21:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.34679542800000002, 2024-09-17T02:21:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022726434, 2024-09-17T02:21:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97147 2024-09-17T02:21:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268128+0000", 2024-09-17T02:21:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268128+0000", 2024-09-17T02:21:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268129+0000", 2024-09-17T02:21:17.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5700000000000001e-07 2024-09-17T02:21:17.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268194+0000", 2024-09-17T02:21:17.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4731000000000001e-05 2024-09-17T02:21:17.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268202+0000", 2024-09-17T02:21:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7950000000000008e-06 2024-09-17T02:21:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268207+0000", 2024-09-17T02:21:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8550000000000001e-06 2024-09-17T02:21:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268694+0000", 2024-09-17T02:21:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00048752799999999998 2024-09-17T02:21:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268768+0000", 2024-09-17T02:21:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3638000000000002e-05 2024-09-17T02:21:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268842+0000", 2024-09-17T02:21:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3928000000000001e-05 2024-09-17T02:21:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.285598+0000", 2024-09-17T02:21:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016756436 2024-09-17T02:21:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290771+0000", 2024-09-17T02:21:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051724789999999998 2024-09-17T02:21:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290817+0000", 2024-09-17T02:21:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6220999999999997e-05 2024-09-17T02:21:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290855+0000", 2024-09-17T02:21:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7966000000000002e-05 2024-09-17T02:21:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97148 5.5 5:a643b955:::benchmark_data_smithi001_23533_object97147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:17.705 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268218+0000", 2024-09-17T02:21:17.705 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.34670604399999999, 2024-09-17T02:21:17.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022628112999999998, 2024-09-17T02:21:17.705 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.705 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.705 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:17.705 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:17.705 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:17.705 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:17.705 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97148 2024-09-17T02:21:17.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.705 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268218+0000", 2024-09-17T02:21:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268218+0000", 2024-09-17T02:21:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268218+0000", 2024-09-17T02:21:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.53e-07 2024-09-17T02:21:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268300+0000", 2024-09-17T02:21:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2219999999999995e-05 2024-09-17T02:21:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268306+0000", 2024-09-17T02:21:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8989999999999998e-06 2024-09-17T02:21:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268310+0000", 2024-09-17T02:21:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6610000000000002e-06 2024-09-17T02:21:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268354+0000", 2024-09-17T02:21:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3782000000000002e-05 2024-09-17T02:21:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268452+0000", 2024-09-17T02:21:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8339999999999997e-05 2024-09-17T02:21:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268536+0000", 2024-09-17T02:21:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3931999999999995e-05 2024-09-17T02:21:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.286252+0000", 2024-09-17T02:21:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017715740000000001 2024-09-17T02:21:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290758+0000", 2024-09-17T02:21:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045060940000000004 2024-09-17T02:21:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290801+0000", 2024-09-17T02:21:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2818000000000002e-05 2024-09-17T02:21:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290846+0000", 2024-09-17T02:21:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5274000000000001e-05 2024-09-17T02:21:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97151 5.5 5:a0c2c072:::benchmark_data_smithi001_23533_object97150:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.34655176300000001, 2024-09-17T02:21:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027297614000000001, 2024-09-17T02:21:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97151 2024-09-17T02:21:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268373+0000", 2024-09-17T02:21:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4000000000000002e-07 2024-09-17T02:21:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268423+0000", 2024-09-17T02:21:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0175e-05 2024-09-17T02:21:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268428+0000", 2024-09-17T02:21:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-17T02:21:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268431+0000", 2024-09-17T02:21:17.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.179e-06 2024-09-17T02:21:17.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283631+0000", 2024-09-17T02:21:17.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015199691 2024-09-17T02:21:17.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283740+0000", 2024-09-17T02:21:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109305 2024-09-17T02:21:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283863+0000", 2024-09-17T02:21:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012226699999999999 2024-09-17T02:21:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290857+0000", 2024-09-17T02:21:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069945449999999996 2024-09-17T02:21:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295595+0000", 2024-09-17T02:21:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047376750000000002 2024-09-17T02:21:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295638+0000", 2024-09-17T02:21:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3671999999999998e-05 2024-09-17T02:21:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295670+0000", 2024-09-17T02:21:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1266000000000002e-05 2024-09-17T02:21:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97248 5.c 5:3796bec5:::benchmark_data_smithi001_23533_object97247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.327358+0000", 2024-09-17T02:21:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.28756552000000002, 2024-09-17T02:21:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022963006000000001, 2024-09-17T02:21:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97248 2024-09-17T02:21:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327358+0000", 2024-09-17T02:21:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327358+0000", 2024-09-17T02:21:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327359+0000", 2024-09-17T02:21:17.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5699999999999998e-07 2024-09-17T02:21:17.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327382+0000", 2024-09-17T02:21:17.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3458000000000001e-05 2024-09-17T02:21:17.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327387+0000", 2024-09-17T02:21:17.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6149999999999999e-06 2024-09-17T02:21:17.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327391+0000", 2024-09-17T02:21:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8999999999999999e-06 2024-09-17T02:21:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.332084+0000", 2024-09-17T02:21:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046935240000000001 2024-09-17T02:21:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.332216+0000", 2024-09-17T02:21:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131798 2024-09-17T02:21:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:17.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.332352+0000", 2024-09-17T02:21:17.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013587500000000001 2024-09-17T02:21:17.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:17.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.338559+0000", 2024-09-17T02:21:17.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0062075510000000004 2024-09-17T02:21:17.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:17.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350237+0000", 2024-09-17T02:21:17.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011677121 2024-09-17T02:21:17.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:17.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350287+0000", 2024-09-17T02:21:17.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0080999999999997e-05 2024-09-17T02:21:17.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:17.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350321+0000", 2024-09-17T02:21:17.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4625999999999997e-05 2024-09-17T02:21:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97251 5.c 5:382be9a3:::benchmark_data_smithi001_23533_object97250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.328203+0000", 2024-09-17T02:21:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.28672128400000002, 2024-09-17T02:21:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022268999000000001, 2024-09-17T02:21:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97251 2024-09-17T02:21:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328203+0000", 2024-09-17T02:21:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328203+0000", 2024-09-17T02:21:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328203+0000", 2024-09-17T02:21:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3699999999999999e-07 2024-09-17T02:21:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328319+0000", 2024-09-17T02:21:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011560100000000001 2024-09-17T02:21:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328332+0000", 2024-09-17T02:21:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2978e-05 2024-09-17T02:21:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328340+0000", 2024-09-17T02:21:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4680000000000003e-06 2024-09-17T02:21:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.335525+0000", 2024-09-17T02:21:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0071852399999999999 2024-09-17T02:21:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.335650+0000", 2024-09-17T02:21:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012522299999999999 2024-09-17T02:21:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.335732+0000", 2024-09-17T02:21:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1582999999999995e-05 2024-09-17T02:21:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.346944+0000", 2024-09-17T02:21:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011211936 2024-09-17T02:21:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350332+0000", 2024-09-17T02:21:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033884140000000002 2024-09-17T02:21:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350433+0000", 2024-09-17T02:21:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010115600000000001 2024-09-17T02:21:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350472+0000", 2024-09-17T02:21:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8463000000000001e-05 2024-09-17T02:21:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.730 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.730 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.730 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:17.730 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:17.730 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:17.731 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:21:17.732 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:17.735+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:17.774 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 45 16 97929 97913 135.975 110.625 0.00502695 0.00734955 2024-09-17T02:21:17.832 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:17.834+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:17.897 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:21:17.898 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-17T02:21:17.898 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.898 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:98155 5.f 5:f662a02b:::benchmark_data_smithi001_23533_object98154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:17.898 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.895351+0000", 2024-09-17T02:21:17.898 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0044693399999999996, 2024-09-17T02:21:17.898 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004494708, 2024-09-17T02:21:17.898 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:17.898 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:17.898 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:17.898 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:17.898 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:17.898 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:17.899 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 98155 2024-09-17T02:21:17.899 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.899 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:17.899 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.899 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:17.899 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.895351+0000", 2024-09-17T02:21:17.899 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.899 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.899 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.899 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:17.899 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.895351+0000", 2024-09-17T02:21:17.899 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.900 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.900 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.900 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:17.900 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.895352+0000", 2024-09-17T02:21:17.900 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.068e-06 2024-09-17T02:21:17.900 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.900 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.900 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:17.900 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.895417+0000", 2024-09-17T02:21:17.900 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4825000000000004e-05 2024-09-17T02:21:17.900 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.900 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.901 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:17.901 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.895427+0000", 2024-09-17T02:21:17.901 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0362e-05 2024-09-17T02:21:17.901 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.901 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.901 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.901 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.895437+0000", 2024-09-17T02:21:17.901 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0154e-05 2024-09-17T02:21:17.901 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.902 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.902 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:17.902 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.895488+0000", 2024-09-17T02:21:17.902 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0769000000000001e-05 2024-09-17T02:21:17.902 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.902 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.902 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:17.902 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.895629+0000", 2024-09-17T02:21:17.902 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000140906 2024-09-17T02:21:17.902 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.902 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.902 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:17.902 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.895774+0000", 2024-09-17T02:21:17.903 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014450300000000001 2024-09-17T02:21:17.903 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.903 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.903 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:17.903 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898876+0000", 2024-09-17T02:21:17.903 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0031025419999999998 2024-09-17T02:21:17.903 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.903 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:17.903 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.903 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.903 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.903 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:98158 5.9 5:9b6893ec:::benchmark_data_smithi001_23533_object98157:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:17.903 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.895870+0000", 2024-09-17T02:21:17.904 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0039499849999999996, 2024-09-17T02:21:17.904 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040579520000000001, 2024-09-17T02:21:17.904 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:17.904 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:17.904 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:17.904 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:17.904 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:17.904 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:17.904 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 98158 2024-09-17T02:21:17.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.904 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:17.905 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.905 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:17.905 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.895870+0000", 2024-09-17T02:21:17.905 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.905 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.905 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.905 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:17.905 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.895870+0000", 2024-09-17T02:21:17.905 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.905 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.905 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.905 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:17.905 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.895871+0000", 2024-09-17T02:21:17.906 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1500000000000003e-07 2024-09-17T02:21:17.906 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.906 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.906 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:17.906 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.895930+0000", 2024-09-17T02:21:17.906 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8572000000000001e-05 2024-09-17T02:21:17.906 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.906 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.906 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:17.906 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.895941+0000", 2024-09-17T02:21:17.906 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1595e-05 2024-09-17T02:21:17.906 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.906 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.907 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.907 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.895950+0000", 2024-09-17T02:21:17.907 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.106e-06 2024-09-17T02:21:17.907 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.907 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.907 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:17.907 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.896003+0000", 2024-09-17T02:21:17.907 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3338000000000003e-05 2024-09-17T02:21:17.907 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.907 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.907 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:17.907 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.896142+0000", 2024-09-17T02:21:17.908 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000138873 2024-09-17T02:21:17.908 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.908 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.908 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:17.908 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.896290+0000", 2024-09-17T02:21:17.908 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000148646 2024-09-17T02:21:17.908 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.908 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.908 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:17.908 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898401+0000", 2024-09-17T02:21:17.908 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021102260000000002 2024-09-17T02:21:17.908 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.908 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:17.909 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.909 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:98159 5.7 5:ea5f0514:::benchmark_data_smithi001_23533_object98158:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:17.909 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.896066+0000", 2024-09-17T02:21:17.909 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.003754229, 2024-09-17T02:21:17.909 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0039376339999999998, 2024-09-17T02:21:17.909 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:17.909 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:17.909 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:17.909 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:17.909 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:17.909 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:17.910 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 98159 2024-09-17T02:21:17.910 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.910 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:17.910 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.910 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:17.910 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.896066+0000", 2024-09-17T02:21:17.910 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.910 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.910 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.910 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:17.910 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.896066+0000", 2024-09-17T02:21:17.910 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.911 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.911 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.911 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:17.911 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.896076+0000", 2024-09-17T02:21:17.911 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6209999999999999e-06 2024-09-17T02:21:17.911 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.911 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.911 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:17.911 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.896177+0000", 2024-09-17T02:21:17.911 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010100200000000001 2024-09-17T02:21:17.911 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.911 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.911 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:17.912 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.896187+0000", 2024-09-17T02:21:17.912 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0324e-05 2024-09-17T02:21:17.912 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.912 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.912 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.912 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.896195+0000", 2024-09-17T02:21:17.912 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8460000000000008e-06 2024-09-17T02:21:17.912 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.912 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.912 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:17.912 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.896604+0000", 2024-09-17T02:21:17.912 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00040898399999999999 2024-09-17T02:21:17.912 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.912 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.913 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:17.913 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.896747+0000", 2024-09-17T02:21:17.913 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014320899999999999 2024-09-17T02:21:17.913 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.913 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.913 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:17.913 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.896895+0000", 2024-09-17T02:21:17.913 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014787900000000001 2024-09-17T02:21:17.913 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.913 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:17.913 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.914 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.914 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.914 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:98160 5.3 5:cd8f8ce8:::benchmark_data_smithi001_23533_object98159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:17.914 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.896212+0000", 2024-09-17T02:21:17.914 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0036080729999999998, 2024-09-17T02:21:17.914 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038622330000000001, 2024-09-17T02:21:17.914 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:17.914 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:17.914 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:17.914 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:17.914 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:17.914 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:17.914 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 98160 2024-09-17T02:21:17.914 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.915 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:17.915 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.915 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:17.915 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.896212+0000", 2024-09-17T02:21:17.915 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.915 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.915 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.915 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:17.915 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.896212+0000", 2024-09-17T02:21:17.915 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.915 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.915 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.915 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:17.916 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.896213+0000", 2024-09-17T02:21:17.916 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.61e-07 2024-09-17T02:21:17.916 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.916 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.916 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:17.916 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.896252+0000", 2024-09-17T02:21:17.916 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9178000000000003e-05 2024-09-17T02:21:17.916 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.916 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.916 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:17.916 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.896261+0000", 2024-09-17T02:21:17.916 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0769999999999997e-06 2024-09-17T02:21:17.917 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.917 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.917 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.917 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.896268+0000", 2024-09-17T02:21:17.917 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.827e-06 2024-09-17T02:21:17.917 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.917 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.917 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:17.917 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898740+0000", 2024-09-17T02:21:17.917 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0024715710000000001 2024-09-17T02:21:17.917 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.918 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.918 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:17.918 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898870+0000", 2024-09-17T02:21:17.918 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013028399999999999 2024-09-17T02:21:17.918 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.918 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.918 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0,1", 2024-09-17T02:21:17.918 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.899028+0000", 2024-09-17T02:21:17.918 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000158338 2024-09-17T02:21:17.918 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.918 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:17.918 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.919 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.919 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.919 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:98154 5.6 e44/22 5:65bfe3bd:::benchmark_data_smithi001_23533_object98153:head v 44'6054, mlcod=44'6050)", 2024-09-17T02:21:17.919 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.897838+0000", 2024-09-17T02:21:17.919 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0019819170000000001, 2024-09-17T02:21:17.919 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023569039999999999, 2024-09-17T02:21:17.919 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:17.919 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:17.919 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:21:17.919 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:17.919 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.919 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:17.920 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.897838+0000", 2024-09-17T02:21:17.920 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.920 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.920 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.920 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:17.920 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.897838+0000", 2024-09-17T02:21:17.920 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.920 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.920 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.920 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:17.920 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.897839+0000", 2024-09-17T02:21:17.920 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.99e-07 2024-09-17T02:21:17.920 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.921 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.921 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:17.921 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.897898+0000", 2024-09-17T02:21:17.921 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9197000000000003e-05 2024-09-17T02:21:17.921 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.921 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.921 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:17.921 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.897906+0000", 2024-09-17T02:21:17.921 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3420000000000002e-06 2024-09-17T02:21:17.921 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.921 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.921 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.921 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.897910+0000", 2024-09-17T02:21:17.922 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.42e-06 2024-09-17T02:21:17.922 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.922 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.922 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:17.922 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.897958+0000", 2024-09-17T02:21:17.922 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7961999999999999e-05 2024-09-17T02:21:17.922 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.922 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.922 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:17.922 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.897978+0000", 2024-09-17T02:21:17.922 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0083999999999999e-05 2024-09-17T02:21:17.922 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.922 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:17.922 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.923 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.923 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.923 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "MOSDPGPushReply(5.3 44/38 [PushReplyOp(5:c46b3e7e:::benchmark_data_smithi001_23533_object96175:head)])", 2024-09-17T02:21:17.923 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.898682+0000", 2024-09-17T02:21:17.923 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.00113805, 2024-09-17T02:21:17.923 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001565454, 2024-09-17T02:21:17.923 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:17.923 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:17.923 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:17.923 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:17.923 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.923 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:17.923 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898682+0000", 2024-09-17T02:21:17.923 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.924 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.924 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.924 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:17.924 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898682+0000", 2024-09-17T02:21:17.924 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.924 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.924 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.924 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:17.924 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898683+0000", 2024-09-17T02:21:17.924 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4000000000000002e-07 2024-09-17T02:21:17.924 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.924 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.925 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:17.925 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898687+0000", 2024-09-17T02:21:17.925 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.374e-06 2024-09-17T02:21:17.925 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.925 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.925 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:17.925 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898697+0000", 2024-09-17T02:21:17.925 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0223e-05 2024-09-17T02:21:17.925 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.925 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.925 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.926 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898705+0000", 2024-09-17T02:21:17.926 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4950000000000002e-06 2024-09-17T02:21:17.926 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.926 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:17.926 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.926 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.926 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.926 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:98162 5.1 5:8be8f20b:::benchmark_data_smithi001_23533_object98161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:17.926 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.898698+0000", 2024-09-17T02:21:17.926 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.001122035, 2024-09-17T02:21:17.926 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015967080000000001, 2024-09-17T02:21:17.926 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:17.926 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:17.927 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:17.927 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:17.927 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:17.927 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:17.927 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 98162 2024-09-17T02:21:17.927 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.927 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:17.927 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.927 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:17.927 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898698+0000", 2024-09-17T02:21:17.928 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.928 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.928 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.928 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:17.928 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898698+0000", 2024-09-17T02:21:17.928 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.928 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.928 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.928 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:17.928 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898699+0000", 2024-09-17T02:21:17.928 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0979999999999999e-06 2024-09-17T02:21:17.929 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.929 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.929 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:17.929 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898731+0000", 2024-09-17T02:21:17.929 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1538000000000002e-05 2024-09-17T02:21:17.929 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.929 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.929 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:17.929 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898741+0000", 2024-09-17T02:21:17.929 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7310000000000005e-06 2024-09-17T02:21:17.929 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.929 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.930 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.930 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898747+0000", 2024-09-17T02:21:17.930 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5089999999999999e-06 2024-09-17T02:21:17.930 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.930 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.930 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:17.930 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898796+0000", 2024-09-17T02:21:17.930 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8841000000000002e-05 2024-09-17T02:21:17.930 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.930 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.931 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:17.931 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898929+0000", 2024-09-17T02:21:17.931 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000133163 2024-09-17T02:21:17.931 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.931 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.931 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0,1", 2024-09-17T02:21:17.931 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.899072+0000", 2024-09-17T02:21:17.931 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014304500000000001 2024-09-17T02:21:17.931 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.931 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:17.931 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.932 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.932 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.932 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:98157 5.4 e44/36 5:2b88a215:::benchmark_data_smithi001_23533_object98156:head v 44'6038, mlcod=44'6034)", 2024-09-17T02:21:17.932 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.898752+0000", 2024-09-17T02:21:17.932 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.001068142, 2024-09-17T02:21:17.932 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0016102950000000001, 2024-09-17T02:21:17.932 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:17.932 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:17.932 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:21:17.932 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:17.933 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.933 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:17.933 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898752+0000", 2024-09-17T02:21:17.933 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.933 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.933 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.933 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:17.933 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898752+0000", 2024-09-17T02:21:17.933 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.933 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.933 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.934 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:17.934 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898753+0000", 2024-09-17T02:21:17.934 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4000000000000002e-07 2024-09-17T02:21:17.934 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.934 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.934 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:17.934 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898756+0000", 2024-09-17T02:21:17.934 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1200000000000002e-06 2024-09-17T02:21:17.934 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.934 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.934 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:17.934 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898763+0000", 2024-09-17T02:21:17.935 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.182e-06 2024-09-17T02:21:17.935 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.935 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.935 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.935 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898769+0000", 2024-09-17T02:21:17.935 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3339999999999998e-06 2024-09-17T02:21:17.935 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.935 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.935 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:17.935 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898919+0000", 2024-09-17T02:21:17.935 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014924299999999999 2024-09-17T02:21:17.936 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.936 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.936 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:17.936 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898936+0000", 2024-09-17T02:21:17.936 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7628000000000001e-05 2024-09-17T02:21:17.936 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.936 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:17.936 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.936 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.936 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.936 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:98156 5.b e44/38)", 2024-09-17T02:21:17.936 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.898787+0000", 2024-09-17T02:21:17.937 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.001033873, 2024-09-17T02:21:17.937 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0016257209999999999, 2024-09-17T02:21:17.937 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:17.937 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:17.937 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:17.937 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:17.937 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.937 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:17.937 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898787+0000", 2024-09-17T02:21:17.937 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.937 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.938 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.938 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:17.938 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898787+0000", 2024-09-17T02:21:17.938 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.938 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.938 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.938 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:17.938 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898787+0000", 2024-09-17T02:21:17.938 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1199999999999999e-07 2024-09-17T02:21:17.938 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.938 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.938 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:17.939 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898790+0000", 2024-09-17T02:21:17.939 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1089999999999998e-06 2024-09-17T02:21:17.939 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.939 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.939 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:17.939 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898796+0000", 2024-09-17T02:21:17.939 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9209999999999997e-06 2024-09-17T02:21:17.939 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.939 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.939 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.939 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898800+0000", 2024-09-17T02:21:17.939 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1370000000000004e-06 2024-09-17T02:21:17.940 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.940 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:17.940 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.940 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.940 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.940 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:98163 5.7 5:eff25ef0:::benchmark_data_smithi001_23533_object98162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:17.940 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.898866+0000", 2024-09-17T02:21:17.940 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.00095480499999999998, 2024-09-17T02:21:17.940 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001593831, 2024-09-17T02:21:17.940 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:17.940 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:17.941 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:17.941 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:17.941 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:17.941 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:17.941 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 98163 2024-09-17T02:21:17.941 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.941 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:17.941 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.941 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:17.941 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898866+0000", 2024-09-17T02:21:17.941 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.942 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.942 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.942 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:17.942 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898866+0000", 2024-09-17T02:21:17.942 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.942 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.942 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.942 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:17.942 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898866+0000", 2024-09-17T02:21:17.942 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3900000000000004e-07 2024-09-17T02:21:17.942 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.942 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.943 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:17.943 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898916+0000", 2024-09-17T02:21:17.943 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0071000000000002e-05 2024-09-17T02:21:17.943 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.943 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.943 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:17.943 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898935+0000", 2024-09-17T02:21:17.943 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8468999999999999e-05 2024-09-17T02:21:17.943 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.943 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.944 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.944 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.898942+0000", 2024-09-17T02:21:17.944 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9990000000000002e-06 2024-09-17T02:21:17.944 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.944 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.944 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:17.944 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.899125+0000", 2024-09-17T02:21:17.944 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018279700000000001 2024-09-17T02:21:17.944 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.944 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.944 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:17.944 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.899235+0000", 2024-09-17T02:21:17.945 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000110506 2024-09-17T02:21:17.945 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.945 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.945 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:17.945 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.899361+0000", 2024-09-17T02:21:17.945 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012540500000000001 2024-09-17T02:21:17.945 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.945 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:17.945 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.945 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.945 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.945 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(client.4466.0:98159 5.7 e44/22)", 2024-09-17T02:21:17.946 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.899510+0000", 2024-09-17T02:21:17.946 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.00031044800000000001, 2024-09-17T02:21:17.946 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0010106609999999999, 2024-09-17T02:21:17.946 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:17.946 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:17.946 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:17.946 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:17.946 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.946 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:17.946 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.899510+0000", 2024-09-17T02:21:17.946 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.947 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.947 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.947 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:17.947 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.899510+0000", 2024-09-17T02:21:17.947 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.947 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.947 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.947 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:17.947 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.899511+0000", 2024-09-17T02:21:17.947 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9500000000000002e-07 2024-09-17T02:21:17.947 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.948 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.948 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:17.948 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.899513+0000", 2024-09-17T02:21:17.948 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8490000000000002e-06 2024-09-17T02:21:17.948 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.948 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.948 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:17.948 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.899522+0000", 2024-09-17T02:21:17.948 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7679999999999997e-06 2024-09-17T02:21:17.948 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.948 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.949 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.949 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.899528+0000", 2024-09-17T02:21:17.949 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0469999999999999e-06 2024-09-17T02:21:17.949 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.949 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:17.949 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.949 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.949 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.949 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:98165 5.5 e44/22 5:a6e50a83:::benchmark_data_smithi001_23533_object98164:head v 44'6167, mlcod=44'6165)", 2024-09-17T02:21:17.949 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.899818+0000", 2024-09-17T02:21:17.949 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 2.0310000000000001e-06, 2024-09-17T02:21:17.950 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00074643699999999997, 2024-09-17T02:21:17.950 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:17.950 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:17.950 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:21:17.950 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:17.950 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.950 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:17.950 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.899818+0000", 2024-09-17T02:21:17.950 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.950 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.950 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.951 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:17.951 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.899818+0000", 2024-09-17T02:21:17.951 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.951 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.951 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.951 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:17.951 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.899819+0000", 2024-09-17T02:21:17.951 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5400000000000001e-07 2024-09-17T02:21:17.951 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.951 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.951 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:17.951 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.899895+0000", 2024-09-17T02:21:17.952 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6262999999999998e-05 2024-09-17T02:21:17.952 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.952 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.952 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:17.952 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.899903+0000", 2024-09-17T02:21:17.952 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9359999999999999e-06 2024-09-17T02:21:17.952 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.952 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.952 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.952 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.899907+0000", 2024-09-17T02:21:17.952 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2590000000000002e-06 2024-09-17T02:21:17.952 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.953 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.953 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:17.953 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.899956+0000", 2024-09-17T02:21:17.953 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8309000000000001e-05 2024-09-17T02:21:17.953 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.953 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.953 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:17.953 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.899968+0000", 2024-09-17T02:21:17.953 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2506e-05 2024-09-17T02:21:17.953 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.953 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:17.954 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.954 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.954 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.954 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "MOSDPGPush(5.4 44/36 [PushOp(5:292f4b8b:::benchmark_data_smithi001_23533_object20645:head, version: 28'1218, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(5:292f4b8b:::benchmark_data_smithi001_23533_object20645:head@28'1218, size: 65536, copy_subset: [(0, 65536)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 65536, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-17T02:21:17.954 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.900149+0000", 2024-09-17T02:21:17.954 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4294967295.999671, 2024-09-17T02:21:17.954 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00050418700000000002, 2024-09-17T02:21:17.954 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:17.954 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:17.954 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:21:17.954 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:17.955 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.955 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:17.955 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.900149+0000", 2024-09-17T02:21:17.955 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.955 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.955 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.955 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:17.955 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.900149+0000", 2024-09-17T02:21:17.955 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.955 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.955 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.955 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:17.956 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.900150+0000", 2024-09-17T02:21:17.956 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9400000000000005e-07 2024-09-17T02:21:17.956 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.956 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.956 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:17.956 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.900204+0000", 2024-09-17T02:21:17.956 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4283000000000002e-05 2024-09-17T02:21:17.956 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.956 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.956 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:17.956 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.900222+0000", 2024-09-17T02:21:17.956 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7428e-05 2024-09-17T02:21:17.957 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.957 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.957 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.957 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.900235+0000", 2024-09-17T02:21:17.957 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3628999999999999e-05 2024-09-17T02:21:17.957 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.957 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.957 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:17.957 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.900482+0000", 2024-09-17T02:21:17.957 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00024696100000000002 2024-09-17T02:21:17.957 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.957 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.958 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:17.958 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.900494+0000", 2024-09-17T02:21:17.958 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1936000000000001e-05 2024-09-17T02:21:17.958 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.958 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:17.958 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.958 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.958 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.958 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "pg_backfill(progress 5.4 e 44/44 lb 5:292f3d40:::benchmark_data_smithi001_23533_object48136:head)", 2024-09-17T02:21:17.958 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.900255+0000", 2024-09-17T02:21:17.958 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4294967295.9995656, 2024-09-17T02:21:17.959 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00046899799999999998, 2024-09-17T02:21:17.959 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:17.959 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:17.959 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:17.959 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:17.959 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.959 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:17.959 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.900255+0000", 2024-09-17T02:21:17.959 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.959 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.959 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.959 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:17.960 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.900255+0000", 2024-09-17T02:21:17.960 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.960 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.960 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.960 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:17.960 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.900255+0000", 2024-09-17T02:21:17.960 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0699999999999998e-07 2024-09-17T02:21:17.960 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.960 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.960 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:17.960 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.900261+0000", 2024-09-17T02:21:17.960 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8039999999999998e-06 2024-09-17T02:21:17.961 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.961 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.961 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:17.961 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.900268+0000", 2024-09-17T02:21:17.961 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8170000000000001e-06 2024-09-17T02:21:17.961 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.961 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.961 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.961 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.900274+0000", 2024-09-17T02:21:17.961 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5810000000000002e-06 2024-09-17T02:21:17.961 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.961 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:17.962 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.962 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.962 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.962 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(client.4466.0:98160 5.3 e44/38)", 2024-09-17T02:21:17.962 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.900525+0000", 2024-09-17T02:21:17.962 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4294967295.9992948, 2024-09-17T02:21:17.962 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00024962999999999998, 2024-09-17T02:21:17.962 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:17.962 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:17.962 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:17.962 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:17.963 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.963 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:17.963 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.900525+0000", 2024-09-17T02:21:17.963 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.963 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.963 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.963 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:17.963 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.900525+0000", 2024-09-17T02:21:17.963 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.963 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.963 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.963 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:17.964 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.900526+0000", 2024-09-17T02:21:17.964 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6899999999999998e-07 2024-09-17T02:21:17.964 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.964 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.964 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:17.964 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.900529+0000", 2024-09-17T02:21:17.964 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8509999999999999e-06 2024-09-17T02:21:17.964 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.964 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.964 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:17.964 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.900538+0000", 2024-09-17T02:21:17.964 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2439999999999999e-06 2024-09-17T02:21:17.965 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.965 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.965 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.965 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.900543+0000", 2024-09-17T02:21:17.965 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0420000000000002e-06 2024-09-17T02:21:17.965 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.965 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:17.965 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.965 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.965 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.965 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:98152 5.7 5:e5d974d5:::benchmark_data_smithi001_23533_object98151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:17.965 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.892419+0000", 2024-09-17T02:21:17.966 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0074017570000000001, 2024-09-17T02:21:17.966 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0084100930000000004, 2024-09-17T02:21:17.966 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:17.966 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:17.966 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:17.966 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:17.966 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:17.966 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:17.966 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 98152 2024-09-17T02:21:17.966 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.966 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:17.967 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.967 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:17.967 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.892419+0000", 2024-09-17T02:21:17.967 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.967 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.967 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.967 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:17.967 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.892419+0000", 2024-09-17T02:21:17.967 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:17.967 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.967 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.967 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:17.967 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.892420+0000", 2024-09-17T02:21:17.968 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.141e-06 2024-09-17T02:21:17.968 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.968 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.968 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:17.968 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.892503+0000", 2024-09-17T02:21:17.968 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3207000000000005e-05 2024-09-17T02:21:17.968 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.968 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.968 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:17.968 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.892518+0000", 2024-09-17T02:21:17.968 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5446000000000001e-05 2024-09-17T02:21:17.969 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.969 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.969 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:17.969 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.892527+0000", 2024-09-17T02:21:17.969 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.14e-06 2024-09-17T02:21:17.969 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.969 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.969 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:17.969 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.893356+0000", 2024-09-17T02:21:17.969 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000829889 2024-09-17T02:21:17.969 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.969 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.970 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:17.970 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.893494+0000", 2024-09-17T02:21:17.970 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013764499999999999 2024-09-17T02:21:17.970 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.970 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.970 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:17.970 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.893654+0000", 2024-09-17T02:21:17.970 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015955099999999999 2024-09-17T02:21:17.970 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:17.970 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:17.970 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:17.971 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.899003+0000", 2024-09-17T02:21:17.971 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0053491470000000003 2024-09-17T02:21:17.971 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.971 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:17.971 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.971 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:17.971 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-09-17T02:21:17.971 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 16 2024-09-17T02:21:17.971 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:21:17.973 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:17.974+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:17.973 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:21:18.073 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:18.074+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:18.129 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:21:18.129 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-17T02:21:18.129 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-09-17T02:21:18.129 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-09-17T02:21:18.129 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:21:18.149 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:21:18.174 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:18.174+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:18.254 INFO:teuthology.orchestra.run.smithi001.stderr:noscrub is set 2024-09-17T02:21:18.275 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:18.275+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:18.308 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:21:18.309 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-09-17T02:21:18.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-09-17T02:21:18.309 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-17T02:21:18.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.309 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-17T02:21:18.309 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:21:18.309 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 73.851480202999994, 2024-09-17T02:21:18.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.15597325500000001, 2024-09-17T02:21:18.309 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:18.309 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:18.309 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:18.309 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:18.310 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4164", 2024-09-17T02:21:18.310 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/201892753", 2024-09-17T02:21:18.310 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 1 2024-09-17T02:21:18.310 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.310 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:18.310 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.310 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:18.310 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:21:18.310 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.310 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.310 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.310 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:18.310 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:21:18.310 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.311 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.311 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:18.311 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458359+0000", 2024-09-17T02:21:18.311 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3929999999999998e-06 2024-09-17T02:21:18.311 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.311 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:18.311 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458373+0000", 2024-09-17T02:21:18.311 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4103e-05 2024-09-17T02:21:18.311 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.311 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:18.312 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458397+0000", 2024-09-17T02:21:18.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.438e-05 2024-09-17T02:21:18.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.312 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:18.312 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458421+0000", 2024-09-17T02:21:18.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3655999999999998e-05 2024-09-17T02:21:18.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.312 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:18.312 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458529+0000", 2024-09-17T02:21:18.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010752900000000001 2024-09-17T02:21:18.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.312 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.313 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:21:18.313 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458542+0000", 2024-09-17T02:21:18.313 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2986999999999999e-05 2024-09-17T02:21:18.313 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.313 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.313 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:18.313 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.611050+0000", 2024-09-17T02:21:18.313 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.1525087 2024-09-17T02:21:18.313 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.313 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:18.314 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.611529+0000", 2024-09-17T02:21:18.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00047844899999999999 2024-09-17T02:21:18.314 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:18.314 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.612061+0000", 2024-09-17T02:21:18.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00053230300000000003 2024-09-17T02:21:18.314 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:18.314 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.613451+0000", 2024-09-17T02:21:18.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0013897250000000001 2024-09-17T02:21:18.314 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.315 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:18.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614168+0000", 2024-09-17T02:21:18.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00071692499999999998 2024-09-17T02:21:18.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.315 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:18.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614265+0000", 2024-09-17T02:21:18.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7589000000000004e-05 2024-09-17T02:21:18.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.315 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:18.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614330+0000", 2024-09-17T02:21:18.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4516000000000004e-05 2024-09-17T02:21:18.316 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.316 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:18.316 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.316 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.316 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.316 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:18.316 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:21:18.316 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 61.753457113000003, 2024-09-17T02:21:18.316 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030933694000000001, 2024-09-17T02:21:18.316 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:18.316 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:18.316 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:18.316 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:18.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:18.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:21:18.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:18.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:21:18.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:18.318 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556381+0000", 2024-09-17T02:21:18.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2100000000000001e-06 2024-09-17T02:21:18.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.318 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:18.318 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556389+0000", 2024-09-17T02:21:18.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5539999999999998e-06 2024-09-17T02:21:18.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.318 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:18.318 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556408+0000", 2024-09-17T02:21:18.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8623000000000001e-05 2024-09-17T02:21:18.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.319 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.319 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:18.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556427+0000", 2024-09-17T02:21:18.319 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8566000000000001e-05 2024-09-17T02:21:18.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.319 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.319 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:18.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558741+0000", 2024-09-17T02:21:18.319 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023144390000000002 2024-09-17T02:21:18.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.320 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.320 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:18.320 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559040+0000", 2024-09-17T02:21:18.320 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029912100000000001 2024-09-17T02:21:18.320 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.320 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.320 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:18.320 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559222+0000", 2024-09-17T02:21:18.320 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018211200000000001 2024-09-17T02:21:18.320 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.320 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.320 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:18.320 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.566648+0000", 2024-09-17T02:21:18.320 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074257560000000004 2024-09-17T02:21:18.321 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.321 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.321 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:18.321 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587109+0000", 2024-09-17T02:21:18.321 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.020460685999999999 2024-09-17T02:21:18.321 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.321 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.321 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:18.321 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587232+0000", 2024-09-17T02:21:18.321 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123325 2024-09-17T02:21:18.321 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.321 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.321 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:18.322 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587313+0000", 2024-09-17T02:21:18.322 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1302000000000002e-05 2024-09-17T02:21:18.322 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.322 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:18.322 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.322 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.322 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.322 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:18.322 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:21:18.322 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 61.753391667000002, 2024-09-17T02:21:18.322 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031045538000000001, 2024-09-17T02:21:18.322 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:18.322 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:18.322 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:18.323 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:18.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:18.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:21:18.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.323 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:18.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:21:18.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.323 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:18.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556446+0000", 2024-09-17T02:21:18.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.26e-06 2024-09-17T02:21:18.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:18.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556454+0000", 2024-09-17T02:21:18.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1640000000000004e-06 2024-09-17T02:21:18.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:18.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556471+0000", 2024-09-17T02:21:18.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7586000000000001e-05 2024-09-17T02:21:18.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.325 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:18.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556485+0000", 2024-09-17T02:21:18.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3523000000000001e-05 2024-09-17T02:21:18.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.325 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:18.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559899+0000", 2024-09-17T02:21:18.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0034142140000000001 2024-09-17T02:21:18.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.325 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:18.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.560104+0000", 2024-09-17T02:21:18.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00020539199999999999 2024-09-17T02:21:18.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.326 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:18.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.560400+0000", 2024-09-17T02:21:18.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029612099999999999 2024-09-17T02:21:18.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.326 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:18.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.568427+0000", 2024-09-17T02:21:18.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0080262909999999996 2024-09-17T02:21:18.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.326 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:18.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587377+0000", 2024-09-17T02:21:18.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018950765000000001 2024-09-17T02:21:18.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:18.327 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587445+0000", 2024-09-17T02:21:18.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.724e-05 2024-09-17T02:21:18.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:18.327 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587491+0000", 2024-09-17T02:21:18.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5982000000000001e-05 2024-09-17T02:21:18.327 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.327 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:18.327 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.328 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.328 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:18.328 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:21:18.328 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 61.753328897000003, 2024-09-17T02:21:18.328 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031435547000000001, 2024-09-17T02:21:18.328 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:18.328 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:18.328 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:18.328 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:18.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.328 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:18.328 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:21:18.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.329 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:18.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:21:18.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.329 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:18.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556509+0000", 2024-09-17T02:21:18.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.06e-06 2024-09-17T02:21:18.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:18.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556515+0000", 2024-09-17T02:21:18.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1029999999999998e-06 2024-09-17T02:21:18.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:18.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556532+0000", 2024-09-17T02:21:18.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7054e-05 2024-09-17T02:21:18.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:18.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556545+0000", 2024-09-17T02:21:18.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3023000000000001e-05 2024-09-17T02:21:18.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.331 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:18.331 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561016+0000", 2024-09-17T02:21:18.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044705150000000004 2024-09-17T02:21:18.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.331 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:18.331 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561316+0000", 2024-09-17T02:21:18.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000299895 2024-09-17T02:21:18.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.331 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:18.331 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561651+0000", 2024-09-17T02:21:18.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033519300000000001 2024-09-17T02:21:18.332 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.332 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.332 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:18.332 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571105+0000", 2024-09-17T02:21:18.332 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094540539999999999 2024-09-17T02:21:18.332 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.332 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.332 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:18.332 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587628+0000", 2024-09-17T02:21:18.332 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016522819000000001 2024-09-17T02:21:18.332 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.332 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.332 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:18.332 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587770+0000", 2024-09-17T02:21:18.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000142352 2024-09-17T02:21:18.333 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.333 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:18.333 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587943+0000", 2024-09-17T02:21:18.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017347900000000001 2024-09-17T02:21:18.333 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.333 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:18.333 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.333 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.333 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:18.333 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:21:18.333 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 61.753273167000003, 2024-09-17T02:21:18.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031809104999999997, 2024-09-17T02:21:18.334 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:18.334 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:18.334 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:18.334 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:18.334 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.334 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:18.334 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:21:18.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.334 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:18.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:21:18.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:18.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556565+0000", 2024-09-17T02:21:18.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.116e-06 2024-09-17T02:21:18.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.336 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:18.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556572+0000", 2024-09-17T02:21:18.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0230000000000004e-06 2024-09-17T02:21:18.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.336 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:18.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556588+0000", 2024-09-17T02:21:18.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6643e-05 2024-09-17T02:21:18.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.336 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:18.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556606+0000", 2024-09-17T02:21:18.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7159999999999998e-05 2024-09-17T02:21:18.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:18.337 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562712+0000", 2024-09-17T02:21:18.337 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0061061630000000004 2024-09-17T02:21:18.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:18.337 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562919+0000", 2024-09-17T02:21:18.337 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000207309 2024-09-17T02:21:18.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:18.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563264+0000", 2024-09-17T02:21:18.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00034490699999999998 2024-09-17T02:21:18.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:18.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571812+0000", 2024-09-17T02:21:18.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0085477810000000008 2024-09-17T02:21:18.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:18.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588094+0000", 2024-09-17T02:21:18.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016282443000000001 2024-09-17T02:21:18.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:18.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588275+0000", 2024-09-17T02:21:18.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018058700000000001 2024-09-17T02:21:18.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:18.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588373+0000", 2024-09-17T02:21:18.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7973000000000005e-05 2024-09-17T02:21:18.339 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.339 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:18.339 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.340 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:18.340 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:21:18.340 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 61.753215068000003, 2024-09-17T02:21:18.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031950544999999997, 2024-09-17T02:21:18.340 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:18.340 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:18.340 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:18.340 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:18.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.340 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:18.340 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:21:18.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.340 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:18.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:21:18.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:18.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556623+0000", 2024-09-17T02:21:18.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.04e-06 2024-09-17T02:21:18.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:18.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556631+0000", 2024-09-17T02:21:18.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1529999999999997e-06 2024-09-17T02:21:18.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:18.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556648+0000", 2024-09-17T02:21:18.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6583999999999999e-05 2024-09-17T02:21:18.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:18.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556661+0000", 2024-09-17T02:21:18.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3203e-05 2024-09-17T02:21:18.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:18.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564413+0000", 2024-09-17T02:21:18.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0077523100000000001 2024-09-17T02:21:18.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:18.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.565841+0000", 2024-09-17T02:21:18.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014276320000000001 2024-09-17T02:21:18.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:18.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.566131+0000", 2024-09-17T02:21:18.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029043800000000001 2024-09-17T02:21:18.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:18.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572353+0000", 2024-09-17T02:21:18.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.006222399 2024-09-17T02:21:18.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:18.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588452+0000", 2024-09-17T02:21:18.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016098635 2024-09-17T02:21:18.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:18.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588520+0000", 2024-09-17T02:21:18.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8040000000000006e-05 2024-09-17T02:21:18.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:18.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588572+0000", 2024-09-17T02:21:18.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2111000000000003e-05 2024-09-17T02:21:18.345 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.345 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:18.345 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.345 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:18.345 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:21:18.345 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 61.753117902, 2024-09-17T02:21:18.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.032187205000000003, 2024-09-17T02:21:18.346 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:18.346 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:18.346 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:18.346 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:18.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.346 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:18.346 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:21:18.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.346 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.346 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:18.346 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:21:18.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.346 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:18.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556727+0000", 2024-09-17T02:21:18.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3000000000000002e-06 2024-09-17T02:21:18.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:18.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556736+0000", 2024-09-17T02:21:18.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4300000000000006e-06 2024-09-17T02:21:18.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:18.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556755+0000", 2024-09-17T02:21:18.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9700000000000001e-05 2024-09-17T02:21:18.348 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.348 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:18.348 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556771+0000", 2024-09-17T02:21:18.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5213e-05 2024-09-17T02:21:18.348 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.348 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:18.348 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571184+0000", 2024-09-17T02:21:18.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014413888999999999 2024-09-17T02:21:18.348 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.348 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:18.348 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571302+0000", 2024-09-17T02:21:18.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011794900000000001 2024-09-17T02:21:18.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:18.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571494+0000", 2024-09-17T02:21:18.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000191168 2024-09-17T02:21:18.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:18.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.573775+0000", 2024-09-17T02:21:18.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002281656 2024-09-17T02:21:18.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:18.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588668+0000", 2024-09-17T02:21:18.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014892699000000001 2024-09-17T02:21:18.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:18.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588813+0000", 2024-09-17T02:21:18.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014530700000000001 2024-09-17T02:21:18.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:18.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588906+0000", 2024-09-17T02:21:18.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2893999999999995e-05 2024-09-17T02:21:18.350 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.350 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:18.351 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.351 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:18.351 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:21:18.351 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 61.752919470000002, 2024-09-17T02:21:18.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030862568, 2024-09-17T02:21:18.351 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:18.351 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:18.351 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:18.351 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:18.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:18.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:21:18.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:18.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:21:18.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:18.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556918+0000", 2024-09-17T02:21:18.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0529999999999999e-06 2024-09-17T02:21:18.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:18.353 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556925+0000", 2024-09-17T02:21:18.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.6939999999999998e-06 2024-09-17T02:21:18.353 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.353 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:18.353 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556942+0000", 2024-09-17T02:21:18.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6803000000000002e-05 2024-09-17T02:21:18.353 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.353 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:18.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556955+0000", 2024-09-17T02:21:18.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2659e-05 2024-09-17T02:21:18.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:18.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558237+0000", 2024-09-17T02:21:18.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001282804 2024-09-17T02:21:18.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:18.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558495+0000", 2024-09-17T02:21:18.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000257178 2024-09-17T02:21:18.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:18.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562168+0000", 2024-09-17T02:21:18.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0036737110000000001 2024-09-17T02:21:18.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:18.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.570855+0000", 2024-09-17T02:21:18.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0086868729999999995 2024-09-17T02:21:18.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:18.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587568+0000", 2024-09-17T02:21:18.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016712444999999999 2024-09-17T02:21:18.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.356 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:18.356 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587677+0000", 2024-09-17T02:21:18.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000109879 2024-09-17T02:21:18.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.356 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:18.356 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587780+0000", 2024-09-17T02:21:18.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000102469 2024-09-17T02:21:18.356 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.356 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:18.357 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.357 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:18.357 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:21:18.357 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 61.752837337999999, 2024-09-17T02:21:18.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031005751000000002, 2024-09-17T02:21:18.357 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:18.357 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:18.357 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:18.357 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:18.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.357 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:18.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:21:18.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:18.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:21:18.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:18.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557001+0000", 2024-09-17T02:21:18.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.237e-06 2024-09-17T02:21:18.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:18.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557007+0000", 2024-09-17T02:21:18.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7270000000000001e-06 2024-09-17T02:21:18.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:18.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557025+0000", 2024-09-17T02:21:18.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7689999999999998e-05 2024-09-17T02:21:18.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:18.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557039+0000", 2024-09-17T02:21:18.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.385e-05 2024-09-17T02:21:18.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:18.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563783+0000", 2024-09-17T02:21:18.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0067437110000000003 2024-09-17T02:21:18.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:18.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564031+0000", 2024-09-17T02:21:18.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00024871799999999999 2024-09-17T02:21:18.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:18.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564518+0000", 2024-09-17T02:21:18.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00048708999999999997 2024-09-17T02:21:18.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:18.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572375+0000", 2024-09-17T02:21:18.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078564780000000001 2024-09-17T02:21:18.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:18.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587862+0000", 2024-09-17T02:21:18.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015486837999999999 2024-09-17T02:21:18.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.362 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:18.362 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587954+0000", 2024-09-17T02:21:18.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1766000000000002e-05 2024-09-17T02:21:18.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.362 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:18.362 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588005+0000", 2024-09-17T02:21:18.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1646e-05 2024-09-17T02:21:18.362 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.362 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:18.363 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.363 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28720 5.f 5:f8a7aea5:::benchmark_data_smithi001_23533_object28719:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:18.363 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:18.363 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 35.742049909999999, 2024-09-17T02:21:18.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.033978608, 2024-09-17T02:21:18.363 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:18.363 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:18.363 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:18.363 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:18.363 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:18.363 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:18.363 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28720 2024-09-17T02:21:18.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.364 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:18.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:18.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:18.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:18.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:18.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:18.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:18.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3200000000000005e-07 2024-09-17T02:21:18.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:18.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567856+0000", 2024-09-17T02:21:18.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8596000000000005e-05 2024-09-17T02:21:18.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:18.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567864+0000", 2024-09-17T02:21:18.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6040000000000004e-06 2024-09-17T02:21:18.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:18.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567867+0000", 2024-09-17T02:21:18.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7929999999999999e-06 2024-09-17T02:21:18.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:18.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567896+0000", 2024-09-17T02:21:18.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8444000000000001e-05 2024-09-17T02:21:18.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:18.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567983+0000", 2024-09-17T02:21:18.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7498999999999997e-05 2024-09-17T02:21:18.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:18.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568078+0000", 2024-09-17T02:21:18.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5050999999999995e-05 2024-09-17T02:21:18.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:18.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573091+0000", 2024-09-17T02:21:18.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050124599999999998 2024-09-17T02:21:18.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.368 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:18.368 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601705+0000", 2024-09-17T02:21:18.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028614298999999999 2024-09-17T02:21:18.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.368 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:18.368 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601741+0000", 2024-09-17T02:21:18.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5329e-05 2024-09-17T02:21:18.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:18.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601766+0000", 2024-09-17T02:21:18.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5001e-05 2024-09-17T02:21:18.369 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.369 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:18.369 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.369 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28723 5.f 5:f1a2a8f6:::benchmark_data_smithi001_23533_object28722:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:18.369 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:21:18.369 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 35.741771229999998, 2024-09-17T02:21:18.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.033805288000000003, 2024-09-17T02:21:18.369 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:18.369 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:18.370 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:18.370 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:18.370 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:18.370 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:18.370 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28723 2024-09-17T02:21:18.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.370 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:18.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:18.370 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:21:18.370 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:18.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:21:18.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:18.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568067+0000", 2024-09-17T02:21:18.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6700000000000002e-07 2024-09-17T02:21:18.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:18.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568121+0000", 2024-09-17T02:21:18.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4286000000000002e-05 2024-09-17T02:21:18.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.372 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:18.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568131+0000", 2024-09-17T02:21:18.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0288e-05 2024-09-17T02:21:18.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.372 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:18.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568139+0000", 2024-09-17T02:21:18.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5399999999999998e-06 2024-09-17T02:21:18.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.372 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:18.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569194+0000", 2024-09-17T02:21:18.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0010557100000000001 2024-09-17T02:21:18.373 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.373 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.373 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:18.373 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569298+0000", 2024-09-17T02:21:18.373 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000103491 2024-09-17T02:21:18.373 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.373 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.373 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:18.373 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569428+0000", 2024-09-17T02:21:18.373 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013050599999999999 2024-09-17T02:21:18.373 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.373 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.373 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:18.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573124+0000", 2024-09-17T02:21:18.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0036956810000000001 2024-09-17T02:21:18.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.374 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:18.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601801+0000", 2024-09-17T02:21:18.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028676667999999999 2024-09-17T02:21:18.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.374 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:18.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601835+0000", 2024-09-17T02:21:18.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4347000000000002e-05 2024-09-17T02:21:18.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.375 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:18.375 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601871+0000", 2024-09-17T02:21:18.375 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5803999999999998e-05 2024-09-17T02:21:18.375 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.375 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:18.375 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.375 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.375 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.375 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28729 5.9 5:9e3b1489:::benchmark_data_smithi001_23533_object28728:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:18.375 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:21:18.375 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 35.740152578999997, 2024-09-17T02:21:18.375 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.032738525999999997, 2024-09-17T02:21:18.375 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:18.375 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:18.376 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:18.376 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:18.376 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:18.376 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:18.376 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28729 2024-09-17T02:21:18.376 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.376 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:18.376 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.376 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:18.376 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:21:18.376 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.376 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.376 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.377 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:18.377 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:21:18.377 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.377 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.377 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.377 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:18.377 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569685+0000", 2024-09-17T02:21:18.377 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8599999999999996e-07 2024-09-17T02:21:18.377 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.377 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.377 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:18.377 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569725+0000", 2024-09-17T02:21:18.378 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0144000000000001e-05 2024-09-17T02:21:18.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.378 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.378 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:18.378 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569737+0000", 2024-09-17T02:21:18.378 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1752e-05 2024-09-17T02:21:18.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.378 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.378 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:18.378 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569745+0000", 2024-09-17T02:21:18.378 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6420000000000007e-06 2024-09-17T02:21:18.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.379 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.379 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:18.379 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569801+0000", 2024-09-17T02:21:18.379 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6110000000000003e-05 2024-09-17T02:21:18.379 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.379 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.379 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:18.379 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569944+0000", 2024-09-17T02:21:18.379 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014361500000000001 2024-09-17T02:21:18.379 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.379 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.379 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:18.379 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.570234+0000", 2024-09-17T02:21:18.379 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00028927899999999998 2024-09-17T02:21:18.380 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.380 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.380 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:18.380 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572606+0000", 2024-09-17T02:21:18.380 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023725529999999999 2024-09-17T02:21:18.380 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.380 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.380 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:18.380 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602361+0000", 2024-09-17T02:21:18.380 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029755031000000001 2024-09-17T02:21:18.380 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.380 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.380 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:18.380 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602397+0000", 2024-09-17T02:21:18.381 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5509000000000002e-05 2024-09-17T02:21:18.381 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.381 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.381 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:18.381 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602423+0000", 2024-09-17T02:21:18.382 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5905e-05 2024-09-17T02:21:18.382 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.382 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:18.382 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.382 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.382 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.382 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28734 5.f 5:f1a63647:::benchmark_data_smithi001_23533_object28733:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:18.382 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:21:18.382 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 35.738430092999998, 2024-09-17T02:21:18.382 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.034441100000000002, 2024-09-17T02:21:18.382 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:18.382 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:18.382 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:18.383 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:18.383 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:18.383 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:18.383 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28734 2024-09-17T02:21:18.383 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.383 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:18.383 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.383 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:18.383 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:21:18.383 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.383 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.383 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.383 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:18.384 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:21:18.384 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.384 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.384 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.384 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:18.384 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571408+0000", 2024-09-17T02:21:18.384 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.8899999999999998e-07 2024-09-17T02:21:18.384 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.384 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.384 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:18.384 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571464+0000", 2024-09-17T02:21:18.384 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6546999999999999e-05 2024-09-17T02:21:18.384 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.385 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.385 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:18.385 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571474+0000", 2024-09-17T02:21:18.385 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0348e-05 2024-09-17T02:21:18.385 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.385 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.385 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:18.385 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571480+0000", 2024-09-17T02:21:18.385 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.366e-06 2024-09-17T02:21:18.385 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.385 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.385 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:18.385 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572097+0000", 2024-09-17T02:21:18.386 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061710599999999997 2024-09-17T02:21:18.386 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.386 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.386 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:18.386 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572172+0000", 2024-09-17T02:21:18.386 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4658000000000002e-05 2024-09-17T02:21:18.386 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.386 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.386 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:18.386 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572247+0000", 2024-09-17T02:21:18.386 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5766000000000006e-05 2024-09-17T02:21:18.386 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.386 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.386 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:18.387 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573819+0000", 2024-09-17T02:21:18.387 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015713649999999999 2024-09-17T02:21:18.387 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.387 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.387 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:18.387 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605762+0000", 2024-09-17T02:21:18.387 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031943304999999998 2024-09-17T02:21:18.387 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.387 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.387 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:18.387 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605808+0000", 2024-09-17T02:21:18.387 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5776999999999999e-05 2024-09-17T02:21:18.387 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.387 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.388 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:18.388 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605848+0000", 2024-09-17T02:21:18.388 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9972999999999998e-05 2024-09-17T02:21:18.388 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.388 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:18.388 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.388 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.388 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.388 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:97761 5.9 5:908717b6:::benchmark_data_smithi001_23533_object97760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:18.388 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.597267+0000", 2024-09-17T02:21:18.389 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.71256958299999995, 2024-09-17T02:21:18.389 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.093254994999999993, 2024-09-17T02:21:18.389 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:18.389 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:18.389 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:18.389 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:18.389 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:18.389 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:18.389 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 97761 2024-09-17T02:21:18.389 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.389 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:18.389 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.389 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:18.390 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597267+0000", 2024-09-17T02:21:18.390 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.390 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.390 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.390 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:18.390 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597267+0000", 2024-09-17T02:21:18.390 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.390 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.390 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.390 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:18.390 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597268+0000", 2024-09-17T02:21:18.390 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6300000000000004e-07 2024-09-17T02:21:18.390 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597425+0000", 2024-09-17T02:21:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015732499999999999 2024-09-17T02:21:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597436+0000", 2024-09-17T02:21:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1015e-05 2024-09-17T02:21:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597443+0000", 2024-09-17T02:21:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3840000000000002e-06 2024-09-17T02:21:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597551+0000", 2024-09-17T02:21:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000108274 2024-09-17T02:21:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597683+0000", 2024-09-17T02:21:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000131645 2024-09-17T02:21:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:18.393 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597835+0000", 2024-09-17T02:21:18.393 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015207400000000001 2024-09-17T02:21:18.393 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.393 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.393 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:18.393 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604322+0000", 2024-09-17T02:21:18.393 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064874829999999996 2024-09-17T02:21:18.393 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.393 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.393 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:18.393 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690350+0000", 2024-09-17T02:21:18.393 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.086028154999999995 2024-09-17T02:21:18.393 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.393 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.394 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:18.394 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690448+0000", 2024-09-17T02:21:18.394 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8129999999999997e-05 2024-09-17T02:21:18.394 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.394 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.394 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:18.394 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690522+0000", 2024-09-17T02:21:18.394 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3746999999999997e-05 2024-09-17T02:21:18.394 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.394 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:18.394 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.394 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.394 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.394 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:97763 5.9 5:95165281:::benchmark_data_smithi001_23533_object97762:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.597457+0000", 2024-09-17T02:21:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.71238023699999997, 2024-09-17T02:21:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.093308472000000003, 2024-09-17T02:21:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 97763 2024-09-17T02:21:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.396 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:18.396 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597457+0000", 2024-09-17T02:21:18.396 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.396 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.396 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.396 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:18.396 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597457+0000", 2024-09-17T02:21:18.396 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.396 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.396 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.396 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:18.396 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597457+0000", 2024-09-17T02:21:18.396 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1699999999999999e-07 2024-09-17T02:21:18.397 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.397 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.397 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:18.397 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597485+0000", 2024-09-17T02:21:18.397 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7923e-05 2024-09-17T02:21:18.397 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.397 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.397 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:18.397 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597492+0000", 2024-09-17T02:21:18.397 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8990000000000004e-06 2024-09-17T02:21:18.397 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.397 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.397 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:18.398 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597497+0000", 2024-09-17T02:21:18.398 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8709999999999996e-06 2024-09-17T02:21:18.398 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.398 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.398 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:18.398 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599319+0000", 2024-09-17T02:21:18.398 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0018221680000000001 2024-09-17T02:21:18.398 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.398 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.398 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:18.398 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599405+0000", 2024-09-17T02:21:18.398 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6119999999999995e-05 2024-09-17T02:21:18.398 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.398 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.399 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:18.399 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599495+0000", 2024-09-17T02:21:18.399 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9963000000000006e-05 2024-09-17T02:21:18.399 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.399 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.399 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:18.399 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604325+0000", 2024-09-17T02:21:18.399 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048300829999999998 2024-09-17T02:21:18.399 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.399 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.399 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:18.399 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690598+0000", 2024-09-17T02:21:18.399 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.086272969000000005 2024-09-17T02:21:18.400 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.400 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.400 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:18.400 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690696+0000", 2024-09-17T02:21:18.400 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8053000000000005e-05 2024-09-17T02:21:18.400 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.400 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.400 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:18.400 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690765+0000", 2024-09-17T02:21:18.400 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9005999999999996e-05 2024-09-17T02:21:18.400 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.400 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:18.400 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.400 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.401 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.401 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:97766 5.f 5:f82e5e9e:::benchmark_data_smithi001_23533_object97765:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:18.401 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.599640+0000", 2024-09-17T02:21:18.401 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.71019648199999996, 2024-09-17T02:21:18.401 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.090645999000000005, 2024-09-17T02:21:18.401 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:18.401 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:18.401 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:18.401 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:18.401 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:18.401 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:18.401 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 97766 2024-09-17T02:21:18.401 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.402 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:18.402 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.402 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:18.402 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599640+0000", 2024-09-17T02:21:18.402 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.402 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.402 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.402 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:18.402 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599640+0000", 2024-09-17T02:21:18.402 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.402 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.402 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.402 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:18.403 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599641+0000", 2024-09-17T02:21:18.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.95e-07 2024-09-17T02:21:18.403 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.403 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.403 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:18.403 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599720+0000", 2024-09-17T02:21:18.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8527000000000002e-05 2024-09-17T02:21:18.403 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.403 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.403 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:18.403 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599729+0000", 2024-09-17T02:21:18.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4040000000000001e-06 2024-09-17T02:21:18.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:18.404 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599734+0000", 2024-09-17T02:21:18.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8550000000000001e-06 2024-09-17T02:21:18.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:18.404 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599770+0000", 2024-09-17T02:21:18.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6139000000000001e-05 2024-09-17T02:21:18.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:18.405 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599868+0000", 2024-09-17T02:21:18.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7816e-05 2024-09-17T02:21:18.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.405 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.405 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:18.405 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599946+0000", 2024-09-17T02:21:18.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8064000000000003e-05 2024-09-17T02:21:18.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.405 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.405 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:18.405 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.603915+0000", 2024-09-17T02:21:18.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003969017 2024-09-17T02:21:18.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:18.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690096+0000", 2024-09-17T02:21:18.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.086180997999999995 2024-09-17T02:21:18.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:18.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690212+0000", 2024-09-17T02:21:18.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0001155 2024-09-17T02:21:18.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:18.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690286+0000", 2024-09-17T02:21:18.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4684000000000005e-05 2024-09-17T02:21:18.407 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.407 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:18.407 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.407 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:97768 5.d 5:b646c3c5:::benchmark_data_smithi001_23533_object97767:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:18.407 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.601357+0000", 2024-09-17T02:21:18.407 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.70848029199999996, 2024-09-17T02:21:18.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.096153645999999995, 2024-09-17T02:21:18.407 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:18.407 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:18.407 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:18.407 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:18.407 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:18.408 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:18.408 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 97768 2024-09-17T02:21:18.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.408 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:18.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:18.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601357+0000", 2024-09-17T02:21:18.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:18.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601357+0000", 2024-09-17T02:21:18.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:18.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601357+0000", 2024-09-17T02:21:18.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3900000000000004e-07 2024-09-17T02:21:18.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:18.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601439+0000", 2024-09-17T02:21:18.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2139999999999996e-05 2024-09-17T02:21:18.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:18.410 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601452+0000", 2024-09-17T02:21:18.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2166e-05 2024-09-17T02:21:18.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.410 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:18.410 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601458+0000", 2024-09-17T02:21:18.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7340000000000002e-06 2024-09-17T02:21:18.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.410 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:18.410 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601498+0000", 2024-09-17T02:21:18.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9368e-05 2024-09-17T02:21:18.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:18.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601616+0000", 2024-09-17T02:21:18.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118684 2024-09-17T02:21:18.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:18.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601699+0000", 2024-09-17T02:21:18.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2519000000000001e-05 2024-09-17T02:21:18.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:18.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604447+0000", 2024-09-17T02:21:18.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027481620000000002 2024-09-17T02:21:18.412 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.412 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.412 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:18.412 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.697379+0000", 2024-09-17T02:21:18.412 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.092932030999999998 2024-09-17T02:21:18.412 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.412 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.412 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:18.412 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.697444+0000", 2024-09-17T02:21:18.412 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5155999999999998e-05 2024-09-17T02:21:18.412 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.412 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.412 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:18.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.697510+0000", 2024-09-17T02:21:18.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5846999999999995e-05 2024-09-17T02:21:18.413 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.413 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:18.413 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.413 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:97769 5.d 5:b3b4045f:::benchmark_data_smithi001_23533_object97768:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:18.413 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.601473+0000", 2024-09-17T02:21:18.413 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.70836423800000003, 2024-09-17T02:21:18.414 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.096303069000000005, 2024-09-17T02:21:18.414 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:18.414 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:18.414 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:18.414 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:18.414 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:18.414 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:18.414 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 97769 2024-09-17T02:21:18.414 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.414 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:18.414 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.414 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:18.414 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601473+0000", 2024-09-17T02:21:18.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:18.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601473+0000", 2024-09-17T02:21:18.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:18.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601473+0000", 2024-09-17T02:21:18.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7299999999999996e-07 2024-09-17T02:21:18.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.416 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:18.416 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601511+0000", 2024-09-17T02:21:18.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8034000000000002e-05 2024-09-17T02:21:18.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.416 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.416 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:18.416 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601521+0000", 2024-09-17T02:21:18.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0016e-05 2024-09-17T02:21:18.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.416 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.416 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:18.416 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601527+0000", 2024-09-17T02:21:18.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4639999999999997e-06 2024-09-17T02:21:18.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:18.417 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.603170+0000", 2024-09-17T02:21:18.417 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0016433089999999999 2024-09-17T02:21:18.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:18.417 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.603249+0000", 2024-09-17T02:21:18.417 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8699e-05 2024-09-17T02:21:18.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:18.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.603330+0000", 2024-09-17T02:21:18.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1489999999999994e-05 2024-09-17T02:21:18.418 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:18.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.605667+0000", 2024-09-17T02:21:18.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023371389999999998 2024-09-17T02:21:18.418 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:18.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.697612+0000", 2024-09-17T02:21:18.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.091944520000000002 2024-09-17T02:21:18.418 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:18.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.697708+0000", 2024-09-17T02:21:18.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6096999999999998e-05 2024-09-17T02:21:18.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:18.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.697776+0000", 2024-09-17T02:21:18.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7727999999999999e-05 2024-09-17T02:21:18.419 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.419 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:18.420 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.420 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:97771 5.9 5:918a4ce1:::benchmark_data_smithi001_23533_object97770:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:18.420 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.602798+0000", 2024-09-17T02:21:18.420 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.70703906900000002, 2024-09-17T02:21:18.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.091332647000000003, 2024-09-17T02:21:18.420 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:18.420 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:18.420 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:18.421 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:18.421 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:18.421 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:18.421 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 97771 2024-09-17T02:21:18.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.421 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:18.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:18.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.602798+0000", 2024-09-17T02:21:18.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:18.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.602798+0000", 2024-09-17T02:21:18.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.422 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:18.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.602798+0000", 2024-09-17T02:21:18.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4600000000000004e-07 2024-09-17T02:21:18.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.422 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:18.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.602877+0000", 2024-09-17T02:21:18.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8511999999999996e-05 2024-09-17T02:21:18.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.423 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:18.423 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.602886+0000", 2024-09-17T02:21:18.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.3689999999999996e-06 2024-09-17T02:21:18.423 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.423 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.423 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:18.423 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.602891+0000", 2024-09-17T02:21:18.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8250000000000004e-06 2024-09-17T02:21:18.423 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.423 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.423 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:18.423 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.602934+0000", 2024-09-17T02:21:18.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3025000000000002e-05 2024-09-17T02:21:18.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:18.424 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.603016+0000", 2024-09-17T02:21:18.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1718000000000006e-05 2024-09-17T02:21:18.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:18.424 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.603107+0000", 2024-09-17T02:21:18.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0588999999999996e-05 2024-09-17T02:21:18.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:18.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604720+0000", 2024-09-17T02:21:18.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001613831 2024-09-17T02:21:18.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:18.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.693951+0000", 2024-09-17T02:21:18.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.089231104000000006 2024-09-17T02:21:18.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.426 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:18.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.694054+0000", 2024-09-17T02:21:18.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000102446 2024-09-17T02:21:18.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.426 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:18.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.694130+0000", 2024-09-17T02:21:18.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6482000000000004e-05 2024-09-17T02:21:18.426 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.426 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:18.426 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.427 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:97772 5.3 5:c001bee5:::benchmark_data_smithi001_23533_object97771:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:18.427 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.604119+0000", 2024-09-17T02:21:18.427 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.70571820299999999, 2024-09-17T02:21:18.427 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.086607842000000004, 2024-09-17T02:21:18.427 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:18.427 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:18.427 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:18.427 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:18.427 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:18.427 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:18.427 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 97772 2024-09-17T02:21:18.427 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.427 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:18.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:18.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604119+0000", 2024-09-17T02:21:18.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.428 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:18.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604119+0000", 2024-09-17T02:21:18.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:18.428 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:18.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604119+0000", 2024-09-17T02:21:18.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.09e-07 2024-09-17T02:21:18.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:18.429 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604183+0000", 2024-09-17T02:21:18.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3659999999999997e-05 2024-09-17T02:21:18.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:18.429 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604195+0000", 2024-09-17T02:21:18.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1783999999999999e-05 2024-09-17T02:21:18.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.430 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:18.430 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604203+0000", 2024-09-17T02:21:18.430 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2390000000000002e-06 2024-09-17T02:21:18.430 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.430 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.430 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:18.430 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604256+0000", 2024-09-17T02:21:18.430 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3103000000000003e-05 2024-09-17T02:21:18.430 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.430 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.430 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:18.430 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604348+0000", 2024-09-17T02:21:18.430 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1837999999999997e-05 2024-09-17T02:21:18.431 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.431 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.431 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0,1", 2024-09-17T02:21:18.431 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604458+0000", 2024-09-17T02:21:18.431 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000110431 2024-09-17T02:21:18.431 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.431 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.431 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:18.431 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.606523+0000", 2024-09-17T02:21:18.431 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020649359999999999 2024-09-17T02:21:18.431 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.431 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.431 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:18.431 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.607160+0000", 2024-09-17T02:21:18.432 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00063626000000000004 2024-09-17T02:21:18.432 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.432 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.432 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:18.432 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690459+0000", 2024-09-17T02:21:18.432 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.083299629 2024-09-17T02:21:18.432 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.432 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.432 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:18.432 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690529+0000", 2024-09-17T02:21:18.432 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0203999999999994e-05 2024-09-17T02:21:18.432 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:18.432 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:18.432 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:18.433 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690726+0000", 2024-09-17T02:21:18.433 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000196949 2024-09-17T02:21:18.433 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.433 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:18.433 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.433 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:18.433 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:18.433 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:21:18.435 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:18.435+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:18.435 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:18.536 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:18.538+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:18.591 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:18.592 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:18.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.592 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:99554 5.b 5:da43503a:::benchmark_data_smithi001_23533_object99553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T02:21:18.592 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:18.592757+0000", 2024-09-17T02:21:18.592 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0042478350000000002, 2024-09-17T02:21:18.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042747059999999996, 2024-09-17T02:21:18.592 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:18.592 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:18.592 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:18.592 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:18.592 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:18.593 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:18.593 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 99554 2024-09-17T02:21:18.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.593 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:18.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:18.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.592757+0000", 2024-09-17T02:21:18.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:18.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:18.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.592757+0000", 2024-09-17T02:21:18.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:18.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:18.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.592758+0000", 2024-09-17T02:21:18.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2500000000000004e-07 2024-09-17T02:21:18.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:18.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.592824+0000", 2024-09-17T02:21:18.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5712999999999999e-05 2024-09-17T02:21:18.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:18.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.592836+0000", 2024-09-17T02:21:18.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2439000000000001e-05 2024-09-17T02:21:18.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:18.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.592844+0000", 2024-09-17T02:21:18.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.481e-06 2024-09-17T02:21:18.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:18.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.592905+0000", 2024-09-17T02:21:18.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1075999999999996e-05 2024-09-17T02:21:18.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:18.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.593071+0000", 2024-09-17T02:21:18.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016654199999999999 2024-09-17T02:21:18.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:18.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.593273+0000", 2024-09-17T02:21:18.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020200599999999999 2024-09-17T02:21:18.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:18.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.596060+0000", 2024-09-17T02:21:18.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027868369999999999 2024-09-17T02:21:18.597 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:18.597 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:18.597 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:18.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.598 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 45/45 lb 5:c4d0da2a:::benchmark_data_smithi001_23533_object3078:head)", 2024-09-17T02:21:18.598 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:18.595031+0000", 2024-09-17T02:21:18.598 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0019735909999999998, 2024-09-17T02:21:18.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020810960000000002, 2024-09-17T02:21:18.598 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:18.598 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:18.598 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:18.598 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:18.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:18.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.595031+0000", 2024-09-17T02:21:18.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:18.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:18.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.595031+0000", 2024-09-17T02:21:18.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:18.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:18.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.595032+0000", 2024-09-17T02:21:18.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.89e-07 2024-09-17T02:21:18.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:18.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.595039+0000", 2024-09-17T02:21:18.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7349999999999999e-06 2024-09-17T02:21:18.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:18.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.595048+0000", 2024-09-17T02:21:18.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2050000000000008e-06 2024-09-17T02:21:18.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:18.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.595053+0000", 2024-09-17T02:21:18.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.75e-06 2024-09-17T02:21:18.600 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:18.600 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:18.601 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:18.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.601 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:99556 5.3 e45/38 5:c29c7f33:::benchmark_data_smithi001_23533_object99555:head v 45'6274, mlcod=45'6270)", 2024-09-17T02:21:18.601 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:18.595523+0000", 2024-09-17T02:21:18.601 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00148226, 2024-09-17T02:21:18.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016362270000000001, 2024-09-17T02:21:18.601 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:18.601 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:18.601 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:18.601 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:18.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:18.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.595523+0000", 2024-09-17T02:21:18.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:18.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:18.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.595523+0000", 2024-09-17T02:21:18.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:18.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:18.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.595523+0000", 2024-09-17T02:21:18.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3399999999999999e-07 2024-09-17T02:21:18.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:18.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.595660+0000", 2024-09-17T02:21:18.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013679400000000001 2024-09-17T02:21:18.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:18.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.595669+0000", 2024-09-17T02:21:18.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8389999999999996e-06 2024-09-17T02:21:18.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:18.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.595675+0000", 2024-09-17T02:21:18.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8499999999999999e-06 2024-09-17T02:21:18.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:18.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.596161+0000", 2024-09-17T02:21:18.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048592200000000001 2024-09-17T02:21:18.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:18.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.596179+0000", 2024-09-17T02:21:18.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8187000000000001e-05 2024-09-17T02:21:18.605 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:18.605 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:18.605 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:18.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.605 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:99555 5.8 e45/26 5:1071cc52:::benchmark_data_smithi001_23533_object99554:head v 45'6323, mlcod=45'6321)", 2024-09-17T02:21:18.605 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:18.595979+0000", 2024-09-17T02:21:18.605 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.001025506, 2024-09-17T02:21:18.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001234459, 2024-09-17T02:21:18.605 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:18.606 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:18.606 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:18.606 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:18.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:18.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.595979+0000", 2024-09-17T02:21:18.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:18.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:18.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.595979+0000", 2024-09-17T02:21:18.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:18.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:18.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.595980+0000", 2024-09-17T02:21:18.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1299999999999999e-07 2024-09-17T02:21:18.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:18.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.596124+0000", 2024-09-17T02:21:18.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014338600000000001 2024-09-17T02:21:18.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:18.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.596134+0000", 2024-09-17T02:21:18.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0753e-05 2024-09-17T02:21:18.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:18.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.596141+0000", 2024-09-17T02:21:18.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0589999999999997e-06 2024-09-17T02:21:18.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:18.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.596182+0000", 2024-09-17T02:21:18.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0120999999999998e-05 2024-09-17T02:21:18.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:18.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.596195+0000", 2024-09-17T02:21:18.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3933e-05 2024-09-17T02:21:18.609 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:18.610 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:18.610 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:18.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.610 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:99557 5.a e45/22 5:524da9d1:::benchmark_data_smithi001_23533_object99556:head v 45'6300, mlcod=45'6298)", 2024-09-17T02:21:18.610 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:18.596166+0000", 2024-09-17T02:21:18.610 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00083916700000000004, 2024-09-17T02:21:18.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011044130000000001, 2024-09-17T02:21:18.610 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:18.610 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:18.610 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:18.610 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:18.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:18.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.596166+0000", 2024-09-17T02:21:18.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:18.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:18.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.596166+0000", 2024-09-17T02:21:18.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:18.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:18.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.596166+0000", 2024-09-17T02:21:18.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4000000000000002e-07 2024-09-17T02:21:18.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:18.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.596278+0000", 2024-09-17T02:21:18.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112001 2024-09-17T02:21:18.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:18.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.596290+0000", 2024-09-17T02:21:18.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1931e-05 2024-09-17T02:21:18.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:18.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.596297+0000", 2024-09-17T02:21:18.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4930000000000003e-06 2024-09-17T02:21:18.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:18.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.596374+0000", 2024-09-17T02:21:18.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7521999999999994e-05 2024-09-17T02:21:18.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:18.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.596391+0000", 2024-09-17T02:21:18.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6262000000000001e-05 2024-09-17T02:21:18.614 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:18.614 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:18.614 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:18.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.614 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:99561 5.b 5.5f8a6c3b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T02:21:18.614 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:18.596346+0000", 2024-09-17T02:21:18.614 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00065873699999999995, 2024-09-17T02:21:18.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00097777699999999999, 2024-09-17T02:21:18.614 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:18.614 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:18.614 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:18.615 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:18.615 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:18.615 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:18.615 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 99561 2024-09-17T02:21:18.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.615 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:18.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:18.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.596346+0000", 2024-09-17T02:21:18.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:18.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:18.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.596346+0000", 2024-09-17T02:21:18.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:18.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:18.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.596347+0000", 2024-09-17T02:21:18.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4600000000000003e-07 2024-09-17T02:21:18.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:18.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.596376+0000", 2024-09-17T02:21:18.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8781000000000001e-05 2024-09-17T02:21:18.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:18.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.596389+0000", 2024-09-17T02:21:18.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3117e-05 2024-09-17T02:21:18.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:18.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:18.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:18.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:18.596397+0000", 2024-09-17T02:21:18.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5750000000000003e-06 2024-09-17T02:21:18.617 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:18.617 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:18.618 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:18.618 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:18.618 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:21:18.618 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 6 2024-09-17T02:21:18.618 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:18.620 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:18.636 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:18.639+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:18.737 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:18.738+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:18.773 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 46 16 99936 99920 135.745 125.438 0.0092835 0.00736198 2024-09-17T02:21:18.782 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:18.782 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:21:18.782 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:21:18.782 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:21:18.782 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:18.802 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:18.838 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:18.838+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:18.941 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:18.942+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:19.009 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:19.010 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:21:19.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:21:19.010 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:19.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.010 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:19.010 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:21:19.011 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.456001417000003, 2024-09-17T02:21:19.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035535028000000003, 2024-09-17T02:21:19.011 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:19.011 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:19.011 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:19.011 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:19.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:19.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:21:19.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:19.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:21:19.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:19.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556550+0000", 2024-09-17T02:21:19.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3500000000000001e-06 2024-09-17T02:21:19.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:19.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556566+0000", 2024-09-17T02:21:19.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5440000000000001e-05 2024-09-17T02:21:19.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:19.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556594+0000", 2024-09-17T02:21:19.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8552999999999999e-05 2024-09-17T02:21:19.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556618+0000", 2024-09-17T02:21:19.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3207e-05 2024-09-17T02:21:19.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:19.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578337+0000", 2024-09-17T02:21:19.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021719517000000001 2024-09-17T02:21:19.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:19.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578655+0000", 2024-09-17T02:21:19.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031837800000000002 2024-09-17T02:21:19.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:19.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.581374+0000", 2024-09-17T02:21:19.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002718238 2024-09-17T02:21:19.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:19.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587083+0000", 2024-09-17T02:21:19.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005708912 2024-09-17T02:21:19.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:19.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591823+0000", 2024-09-17T02:21:19.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047406080000000003 2024-09-17T02:21:19.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:19.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591972+0000", 2024-09-17T02:21:19.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014874199999999999 2024-09-17T02:21:19.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:19.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592082+0000", 2024-09-17T02:21:19.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110083 2024-09-17T02:21:19.019 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.019 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:19.019 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.020 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:19.020 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:21:19.020 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.455059929999997, 2024-09-17T02:21:19.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035128756999999997, 2024-09-17T02:21:19.020 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:19.020 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:19.020 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:19.020 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:19.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:19.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:21:19.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:19.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:21:19.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:19.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557491+0000", 2024-09-17T02:21:19.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.88e-06 2024-09-17T02:21:19.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:19.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557504+0000", 2024-09-17T02:21:19.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2864000000000001e-05 2024-09-17T02:21:19.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:19.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557535+0000", 2024-09-17T02:21:19.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0916e-05 2024-09-17T02:21:19.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557561+0000", 2024-09-17T02:21:19.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5602999999999999e-05 2024-09-17T02:21:19.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:19.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582290+0000", 2024-09-17T02:21:19.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024729729999999998 2024-09-17T02:21:19.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:19.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582642+0000", 2024-09-17T02:21:19.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035143499999999999 2024-09-17T02:21:19.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:19.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582959+0000", 2024-09-17T02:21:19.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031747399999999999 2024-09-17T02:21:19.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:19.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587302+0000", 2024-09-17T02:21:19.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043425169999999997 2024-09-17T02:21:19.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:19.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592391+0000", 2024-09-17T02:21:19.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050895799999999998 2024-09-17T02:21:19.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:19.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592516+0000", 2024-09-17T02:21:19.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012420500000000001 2024-09-17T02:21:19.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:19.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592617+0000", 2024-09-17T02:21:19.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010155299999999999 2024-09-17T02:21:19.026 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.026 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:19.026 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.027 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:19.027 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:21:19.027 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.454955431000002, 2024-09-17T02:21:19.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034796066, 2024-09-17T02:21:19.027 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:19.027 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:19.027 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:19.027 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:19.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:21:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:21:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557594+0000", 2024-09-17T02:21:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3769999999999999e-06 2024-09-17T02:21:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557683+0000", 2024-09-17T02:21:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8896999999999999e-05 2024-09-17T02:21:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557707+0000", 2024-09-17T02:21:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3839e-05 2024-09-17T02:21:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557730+0000", 2024-09-17T02:21:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3047000000000001e-05 2024-09-17T02:21:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582329+0000", 2024-09-17T02:21:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024599283999999999 2024-09-17T02:21:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582624+0000", 2024-09-17T02:21:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000294462 2024-09-17T02:21:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582936+0000", 2024-09-17T02:21:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031223399999999999 2024-09-17T02:21:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587347+0000", 2024-09-17T02:21:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044110340000000003 2024-09-17T02:21:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592165+0000", 2024-09-17T02:21:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048176699999999996 2024-09-17T02:21:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592311+0000", 2024-09-17T02:21:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014661899999999999 2024-09-17T02:21:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592389+0000", 2024-09-17T02:21:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7602999999999995e-05 2024-09-17T02:21:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:21:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.454437804000001, 2024-09-17T02:21:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034457472000000003, 2024-09-17T02:21:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:21:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:21:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558113+0000", 2024-09-17T02:21:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1639999999999999e-06 2024-09-17T02:21:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558125+0000", 2024-09-17T02:21:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2269999999999999e-05 2024-09-17T02:21:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558458+0000", 2024-09-17T02:21:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033322700000000001 2024-09-17T02:21:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558488+0000", 2024-09-17T02:21:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.951e-05 2024-09-17T02:21:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584514+0000", 2024-09-17T02:21:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026025721000000002 2024-09-17T02:21:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584781+0000", 2024-09-17T02:21:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000267142 2024-09-17T02:21:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585078+0000", 2024-09-17T02:21:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029738799999999999 2024-09-17T02:21:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588045+0000", 2024-09-17T02:21:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029673759999999999 2024-09-17T02:21:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592454+0000", 2024-09-17T02:21:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044090209999999999 2024-09-17T02:21:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592520+0000", 2024-09-17T02:21:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6032999999999996e-05 2024-09-17T02:21:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592568+0000", 2024-09-17T02:21:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7620000000000001e-05 2024-09-17T02:21:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:21:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.453796337999997, 2024-09-17T02:21:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034114029999999997, 2024-09-17T02:21:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:21:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:21:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558753+0000", 2024-09-17T02:21:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2699999999999999e-06 2024-09-17T02:21:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558769+0000", 2024-09-17T02:21:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5906e-05 2024-09-17T02:21:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558791+0000", 2024-09-17T02:21:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1342999999999999e-05 2024-09-17T02:21:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558806+0000", 2024-09-17T02:21:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5829999999999999e-05 2024-09-17T02:21:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584906+0000", 2024-09-17T02:21:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026099273999999999 2024-09-17T02:21:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585158+0000", 2024-09-17T02:21:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025194600000000002 2024-09-17T02:21:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585368+0000", 2024-09-17T02:21:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210068 2024-09-17T02:21:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588098+0000", 2024-09-17T02:21:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002730522 2024-09-17T02:21:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592680+0000", 2024-09-17T02:21:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045816019999999997 2024-09-17T02:21:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592774+0000", 2024-09-17T02:21:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3726000000000004e-05 2024-09-17T02:21:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592866+0000", 2024-09-17T02:21:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2542999999999998e-05 2024-09-17T02:21:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28720 5.f e28/22 5:f8a7aea5:::benchmark_data_smithi001_23533_object28719:head v 28'1756, mlcod=28'1754)", 2024-09-17T02:21:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:21:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.442428538000001, 2024-09-17T02:21:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033308717000000002, 2024-09-17T02:21:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:21:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:21:19.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:19.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570121+0000", 2024-09-17T02:21:19.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4e-07 2024-09-17T02:21:19.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:19.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570208+0000", 2024-09-17T02:21:19.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6945000000000002e-05 2024-09-17T02:21:19.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:19.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570222+0000", 2024-09-17T02:21:19.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4541e-05 2024-09-17T02:21:19.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570232+0000", 2024-09-17T02:21:19.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3039999999999994e-06 2024-09-17T02:21:19.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:19.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570273+0000", 2024-09-17T02:21:19.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1950999999999999e-05 2024-09-17T02:21:19.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:19.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570286+0000", 2024-09-17T02:21:19.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2268e-05 2024-09-17T02:21:19.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:19.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603312+0000", 2024-09-17T02:21:19.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033026405000000002 2024-09-17T02:21:19.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:19.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603429+0000", 2024-09-17T02:21:19.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116463 2024-09-17T02:21:19.051 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.051 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:19.051 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.051 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28721 5.a e28/22 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head v 28'1872, mlcod=28'1869)", 2024-09-17T02:21:19.052 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:21:19.052 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.442285032000001, 2024-09-17T02:21:19.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033539817999999999, 2024-09-17T02:21:19.052 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:19.052 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:19.052 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:19.052 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:19.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:19.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:21:19.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:19.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:21:19.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:19.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570264+0000", 2024-09-17T02:21:19.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0999999999999997e-07 2024-09-17T02:21:19.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:19.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570299+0000", 2024-09-17T02:21:19.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4876999999999998e-05 2024-09-17T02:21:19.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:19.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570310+0000", 2024-09-17T02:21:19.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0958000000000001e-05 2024-09-17T02:21:19.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570316+0000", 2024-09-17T02:21:19.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.485e-06 2024-09-17T02:21:19.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:19.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598947+0000", 2024-09-17T02:21:19.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.028631058000000001 2024-09-17T02:21:19.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:19.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598969+0000", 2024-09-17T02:21:19.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2005999999999999e-05 2024-09-17T02:21:19.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:19.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.602638+0000", 2024-09-17T02:21:19.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036690339999999998 2024-09-17T02:21:19.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:19.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603803+0000", 2024-09-17T02:21:19.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00116559 2024-09-17T02:21:19.057 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.057 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:19.057 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.057 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97749 5.b 5:d930ef52:::benchmark_data_smithi001_23533_object97748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:19.057 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:19.057 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 1.4206021180000001, 2024-09-17T02:21:19.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092964343000000005, 2024-09-17T02:21:19.057 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:19.057 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:19.057 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97749 2024-09-17T02:21:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:19.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:19.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591947+0000", 2024-09-17T02:21:19.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:21:19.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:19.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592011+0000", 2024-09-17T02:21:19.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3608000000000005e-05 2024-09-17T02:21:19.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:19.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592021+0000", 2024-09-17T02:21:19.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9979999999999998e-06 2024-09-17T02:21:19.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592028+0000", 2024-09-17T02:21:19.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1439999999999997e-06 2024-09-17T02:21:19.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:19.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593633+0000", 2024-09-17T02:21:19.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001604636 2024-09-17T02:21:19.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593757+0000", 2024-09-17T02:21:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012432099999999999 2024-09-17T02:21:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593866+0000", 2024-09-17T02:21:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109094 2024-09-17T02:21:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601190+0000", 2024-09-17T02:21:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073237620000000002 2024-09-17T02:21:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:19.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601356+0000", 2024-09-17T02:21:19.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016651900000000001 2024-09-17T02:21:19.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:19.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684618+0000", 2024-09-17T02:21:19.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083261356999999994 2024-09-17T02:21:19.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:19.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684724+0000", 2024-09-17T02:21:19.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010681800000000001 2024-09-17T02:21:19.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:19.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684911+0000", 2024-09-17T02:21:19.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186243 2024-09-17T02:21:19.064 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.064 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:19.064 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.064 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97752 5.b 5:d146f486:::benchmark_data_smithi001_23533_object97751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:19.064 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:19.064 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 1.419249424, 2024-09-17T02:21:19.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091989557, 2024-09-17T02:21:19.064 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:19.065 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:19.065 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:19.065 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:19.065 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:19.065 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:19.065 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97752 2024-09-17T02:21:19.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.065 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:19.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:19.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:19.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:19.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:19.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:19.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593300+0000", 2024-09-17T02:21:19.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8199999999999998e-07 2024-09-17T02:21:19.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:19.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593364+0000", 2024-09-17T02:21:19.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3831999999999995e-05 2024-09-17T02:21:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593376+0000", 2024-09-17T02:21:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1800999999999999e-05 2024-09-17T02:21:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593382+0000", 2024-09-17T02:21:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6780000000000003e-06 2024-09-17T02:21:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595491+0000", 2024-09-17T02:21:19.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021090689999999999 2024-09-17T02:21:19.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:19.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595614+0000", 2024-09-17T02:21:19.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012321500000000001 2024-09-17T02:21:19.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:19.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595778+0000", 2024-09-17T02:21:19.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016321900000000001 2024-09-17T02:21:19.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:19.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601197+0000", 2024-09-17T02:21:19.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054195600000000003 2024-09-17T02:21:19.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:19.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601396+0000", 2024-09-17T02:21:19.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019825299999999999 2024-09-17T02:21:19.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:19.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684990+0000", 2024-09-17T02:21:19.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083594878999999997 2024-09-17T02:21:19.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685116+0000", 2024-09-17T02:21:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012522799999999999 2024-09-17T02:21:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685289+0000", 2024-09-17T02:21:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172941 2024-09-17T02:21:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97754 5.b 5:da0615e5:::benchmark_data_smithi001_23533_object97753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 1.417611502, 2024-09-17T02:21:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092097207, 2024-09-17T02:21:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97754 2024-09-17T02:21:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:19.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:19.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:19.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:19.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:19.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594938+0000", 2024-09-17T02:21:19.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5000000000000002e-07 2024-09-17T02:21:19.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:19.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595075+0000", 2024-09-17T02:21:19.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137742 2024-09-17T02:21:19.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:19.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595087+0000", 2024-09-17T02:21:19.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1243000000000001e-05 2024-09-17T02:21:19.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595095+0000", 2024-09-17T02:21:19.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1030000000000002e-06 2024-09-17T02:21:19.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:19.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598461+0000", 2024-09-17T02:21:19.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033661170000000001 2024-09-17T02:21:19.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:19.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598540+0000", 2024-09-17T02:21:19.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8937999999999995e-05 2024-09-17T02:21:19.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:19.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598626+0000", 2024-09-17T02:21:19.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6042000000000001e-05 2024-09-17T02:21:19.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:19.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684258+0000", 2024-09-17T02:21:19.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085632394000000001 2024-09-17T02:21:19.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:19.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685369+0000", 2024-09-17T02:21:19.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001111063 2024-09-17T02:21:19.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:19.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685511+0000", 2024-09-17T02:21:19.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141965 2024-09-17T02:21:19.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:19.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685604+0000", 2024-09-17T02:21:19.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2935000000000004e-05 2024-09-17T02:21:19.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:19.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687034+0000", 2024-09-17T02:21:19.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001430015 2024-09-17T02:21:19.077 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.077 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:19.077 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97755 5.b 5:d36a03a1:::benchmark_data_smithi001_23533_object97754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 1.417438352, 2024-09-17T02:21:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0924904, 2024-09-17T02:21:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97755 2024-09-17T02:21:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595111+0000", 2024-09-17T02:21:19.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:21:19.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:19.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595145+0000", 2024-09-17T02:21:19.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3927000000000002e-05 2024-09-17T02:21:19.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:19.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595155+0000", 2024-09-17T02:21:19.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0023e-05 2024-09-17T02:21:19.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595162+0000", 2024-09-17T02:21:19.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3950000000000003e-06 2024-09-17T02:21:19.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:19.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599821+0000", 2024-09-17T02:21:19.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046592880000000001 2024-09-17T02:21:19.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:19.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599912+0000", 2024-09-17T02:21:19.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1049000000000002e-05 2024-09-17T02:21:19.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600062+0000", 2024-09-17T02:21:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015001700000000001 2024-09-17T02:21:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685307+0000", 2024-09-17T02:21:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085244340000000002 2024-09-17T02:21:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685446+0000", 2024-09-17T02:21:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013955700000000001 2024-09-17T02:21:19.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:19.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687375+0000", 2024-09-17T02:21:19.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019291079999999999 2024-09-17T02:21:19.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:19.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687462+0000", 2024-09-17T02:21:19.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6148000000000003e-05 2024-09-17T02:21:19.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:19.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687600+0000", 2024-09-17T02:21:19.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013887900000000001 2024-09-17T02:21:19.084 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.084 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:19.084 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.084 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPush(5.3 44/38 [PushOp(5:c45b310d:::benchmark_data_smithi001_23533_object73736:head, version: 39'4672, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(5:c45b310d:::benchmark_data_smithi001_23533_object73736:head@39'4672, size: 65536, copy_subset: [(0, 65536)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 65536, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-17T02:21:19.084 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597100+0000", 2024-09-17T02:21:19.084 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 1.4154482319999999, 2024-09-17T02:21:19.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.089325374999999999, 2024-09-17T02:21:19.084 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:19.084 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:19.084 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597100+0000", 2024-09-17T02:21:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597100+0000", 2024-09-17T02:21:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597101+0000", 2024-09-17T02:21:19.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4899999999999995e-07 2024-09-17T02:21:19.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:19.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597155+0000", 2024-09-17T02:21:19.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4466999999999999e-05 2024-09-17T02:21:19.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:19.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597174+0000", 2024-09-17T02:21:19.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8393000000000002e-05 2024-09-17T02:21:19.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597189+0000", 2024-09-17T02:21:19.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5716999999999999e-05 2024-09-17T02:21:19.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:19.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684442+0000", 2024-09-17T02:21:19.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.087252918999999998 2024-09-17T02:21:19.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:19.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684479+0000", 2024-09-17T02:21:19.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6902e-05 2024-09-17T02:21:19.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:19.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.686426+0000", 2024-09-17T02:21:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001946328 2024-09-17T02:21:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 44/44 lb 5:c4567a04:::benchmark_data_smithi001_23533_object4200:head)", 2024-09-17T02:21:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 1.4153417260000001, 2024-09-17T02:21:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092483421999999996, 2024-09-17T02:21:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:19.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:19.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:19.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:19.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:19.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:19.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:19.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6399999999999998e-07 2024-09-17T02:21:19.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:19.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597213+0000", 2024-09-17T02:21:19.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3659999999999997e-06 2024-09-17T02:21:19.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:19.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597222+0000", 2024-09-17T02:21:19.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0510000000000002e-06 2024-09-17T02:21:19.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597228+0000", 2024-09-17T02:21:19.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1569999999999999e-06 2024-09-17T02:21:19.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:19.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689588+0000", 2024-09-17T02:21:19.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092359931000000006 2024-09-17T02:21:19.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:19.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689622+0000", 2024-09-17T02:21:19.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4425999999999999e-05 2024-09-17T02:21:19.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:19.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689690+0000", 2024-09-17T02:21:19.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8126999999999993e-05 2024-09-17T02:21:19.093 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.094 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:19.094 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.094 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:97759 5.a e44/22 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head v 44'6175, mlcod=44'6173)", 2024-09-17T02:21:19.094 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.599333+0000", 2024-09-17T02:21:19.095 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 1.413215506, 2024-09-17T02:21:19.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088908582, 2024-09-17T02:21:19.095 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:19.095 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:19.095 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:19.095 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:19.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:19.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599333+0000", 2024-09-17T02:21:19.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:19.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599333+0000", 2024-09-17T02:21:19.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:19.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599334+0000", 2024-09-17T02:21:19.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6700000000000003e-07 2024-09-17T02:21:19.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:19.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599503+0000", 2024-09-17T02:21:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0001693 2024-09-17T02:21:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599510+0000", 2024-09-17T02:21:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0469999999999996e-06 2024-09-17T02:21:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599514+0000", 2024-09-17T02:21:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0069999999999999e-06 2024-09-17T02:21:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:19.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599559+0000", 2024-09-17T02:21:19.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4697999999999998e-05 2024-09-17T02:21:19.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:19.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599570+0000", 2024-09-17T02:21:19.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1042e-05 2024-09-17T02:21:19.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:19.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.688181+0000", 2024-09-17T02:21:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088611756999999999 2024-09-17T02:21:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.688242+0000", 2024-09-17T02:21:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0064e-05 2024-09-17T02:21:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97762 5.4 5:2c64abcd:::benchmark_data_smithi001_23533_object97761:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.599394+0000", 2024-09-17T02:21:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 1.4131539710000001, 2024-09-17T02:21:19.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088655857000000005, 2024-09-17T02:21:19.100 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:19.100 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:19.100 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:19.100 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:19.100 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:19.100 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:19.100 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97762 2024-09-17T02:21:19.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.100 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:19.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:19.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599394+0000", 2024-09-17T02:21:19.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:19.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599394+0000", 2024-09-17T02:21:19.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:19.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599395+0000", 2024-09-17T02:21:19.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.85e-07 2024-09-17T02:21:19.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:19.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599442+0000", 2024-09-17T02:21:19.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6964e-05 2024-09-17T02:21:19.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:19.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599454+0000", 2024-09-17T02:21:19.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1841999999999999e-05 2024-09-17T02:21:19.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599459+0000", 2024-09-17T02:21:19.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1000000000000003e-06 2024-09-17T02:21:19.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:19.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599511+0000", 2024-09-17T02:21:19.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1814999999999998e-05 2024-09-17T02:21:19.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:19.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599627+0000", 2024-09-17T02:21:19.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116087 2024-09-17T02:21:19.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:19.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599716+0000", 2024-09-17T02:21:19.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9174999999999999e-05 2024-09-17T02:21:19.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:19.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687757+0000", 2024-09-17T02:21:19.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088040361999999997 2024-09-17T02:21:19.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:19.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687778+0000", 2024-09-17T02:21:19.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1229e-05 2024-09-17T02:21:19.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:19.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687833+0000", 2024-09-17T02:21:19.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4928e-05 2024-09-17T02:21:19.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:19.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687916+0000", 2024-09-17T02:21:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3175000000000002e-05 2024-09-17T02:21:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.688050+0000", 2024-09-17T02:21:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013429499999999999 2024-09-17T02:21:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPushReply(5.4 44/36 [PushReplyOp(5:291a38c7:::benchmark_data_smithi001_23533_object22817:head)])", 2024-09-17T02:21:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.599945+0000", 2024-09-17T02:21:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 1.4126032070000001, 2024-09-17T02:21:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.084468808000000006, 2024-09-17T02:21:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-17T02:21:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599945+0000", 2024-09-17T02:21:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599945+0000", 2024-09-17T02:21:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:19.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599945+0000", 2024-09-17T02:21:19.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1e-07 2024-09-17T02:21:19.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:19.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599949+0000", 2024-09-17T02:21:19.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2849999999999999e-06 2024-09-17T02:21:19.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:19.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599956+0000", 2024-09-17T02:21:19.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3640000000000001e-06 2024-09-17T02:21:19.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599962+0000", 2024-09-17T02:21:19.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2360000000000001e-06 2024-09-17T02:21:19.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:19.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601282+0000", 2024-09-17T02:21:19.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001319808 2024-09-17T02:21:19.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:19.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684414+0000", 2024-09-17T02:21:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083131905000000006 2024-09-17T02:21:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:97761 5.9 e44/22 5:908717b6:::benchmark_data_smithi001_23533_object97760:head v 44'6129, mlcod=44'6125)", 2024-09-17T02:21:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.599983+0000", 2024-09-17T02:21:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 1.4125654189999999, 2024-09-17T02:21:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091911272000000002, 2024-09-17T02:21:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:19.115 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:19.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:19.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599983+0000", 2024-09-17T02:21:19.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:19.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599983+0000", 2024-09-17T02:21:19.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:19.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599983+0000", 2024-09-17T02:21:19.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1100000000000002e-07 2024-09-17T02:21:19.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:19.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600085+0000", 2024-09-17T02:21:19.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102007 2024-09-17T02:21:19.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:19.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600094+0000", 2024-09-17T02:21:19.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1850000000000004e-06 2024-09-17T02:21:19.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600099+0000", 2024-09-17T02:21:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6640000000000003e-06 2024-09-17T02:21:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600140+0000", 2024-09-17T02:21:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0998999999999998e-05 2024-09-17T02:21:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600157+0000", 2024-09-17T02:21:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7122999999999999e-05 2024-09-17T02:21:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:19.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.691795+0000", 2024-09-17T02:21:19.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091638002999999996 2024-09-17T02:21:19.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:19.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.691894+0000", 2024-09-17T02:21:19.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8980000000000004e-05 2024-09-17T02:21:19.118 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.119 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:19.119 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.119 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:97749 5.b e44/38 ondisk, result = 0)", 2024-09-17T02:21:19.119 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.600115+0000", 2024-09-17T02:21:19.119 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 1.412433426, 2024-09-17T02:21:19.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.084148770999999997, 2024-09-17T02:21:19.119 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:19.119 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:19.120 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:19.120 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:19.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:19.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600115+0000", 2024-09-17T02:21:19.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:19.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600115+0000", 2024-09-17T02:21:19.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600115+0000", 2024-09-17T02:21:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.39e-07 2024-09-17T02:21:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600119+0000", 2024-09-17T02:21:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3060000000000002e-06 2024-09-17T02:21:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600125+0000", 2024-09-17T02:21:19.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3330000000000002e-06 2024-09-17T02:21:19.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600130+0000", 2024-09-17T02:21:19.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8999999999999997e-06 2024-09-17T02:21:19.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:19.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601349+0000", 2024-09-17T02:21:19.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012192209999999999 2024-09-17T02:21:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601353+0000", 2024-09-17T02:21:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9149999999999998e-06 2024-09-17T02:21:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684264+0000", 2024-09-17T02:21:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.082910757000000002 2024-09-17T02:21:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.124 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:97754 5.b e44/38 ondisk, result = 0)", 2024-09-17T02:21:19.124 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.601431+0000", 2024-09-17T02:21:19.124 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 1.4111172700000001, 2024-09-17T02:21:19.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085620499000000003, 2024-09-17T02:21:19.124 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:19.124 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:19.124 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:19.125 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:19.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:19.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601431+0000", 2024-09-17T02:21:19.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:19.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601431+0000", 2024-09-17T02:21:19.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601432+0000", 2024-09-17T02:21:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8400000000000004e-07 2024-09-17T02:21:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601435+0000", 2024-09-17T02:21:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9969999999999999e-06 2024-09-17T02:21:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684720+0000", 2024-09-17T02:21:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083285740999999996 2024-09-17T02:21:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684750+0000", 2024-09-17T02:21:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9632999999999999e-05 2024-09-17T02:21:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685492+0000", 2024-09-17T02:21:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00074159699999999998 2024-09-17T02:21:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685503+0000", 2024-09-17T02:21:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1294999999999999e-05 2024-09-17T02:21:19.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:19.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687052+0000", 2024-09-17T02:21:19.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001548652 2024-09-17T02:21:19.128 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.128 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:19.128 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.128 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:97749 5.b e44/38 ondisk, result = 0)", 2024-09-17T02:21:19.129 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.601857+0000", 2024-09-17T02:21:19.129 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 1.410691819, 2024-09-17T02:21:19.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083064447999999999, 2024-09-17T02:21:19.129 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:19.129 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:19.129 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:19.129 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:19.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:19.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601857+0000", 2024-09-17T02:21:19.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601857+0000", 2024-09-17T02:21:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601857+0000", 2024-09-17T02:21:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5799999999999999e-07 2024-09-17T02:21:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601862+0000", 2024-09-17T02:21:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1900000000000003e-06 2024-09-17T02:21:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:19.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684426+0000", 2024-09-17T02:21:19.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.082564018000000003 2024-09-17T02:21:19.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684443+0000", 2024-09-17T02:21:19.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6986e-05 2024-09-17T02:21:19.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:19.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684592+0000", 2024-09-17T02:21:19.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000148818 2024-09-17T02:21:19.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:19.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684607+0000", 2024-09-17T02:21:19.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5033e-05 2024-09-17T02:21:19.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:19.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:19.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:19.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684921+0000", 2024-09-17T02:21:19.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031374499999999999 2024-09-17T02:21:19.134 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.134 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:19.134 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.135 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:19.135 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:19.135 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:19.137 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:19.135+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:19.138 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:19.237 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:19.238+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:19.295 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:21:19.296 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:19.296 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:19.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.297 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:101002 5.1 e45/36 5:89c77672:::benchmark_data_smithi001_23533_object101001:head v 45'6285, mlcod=45'6282)", 2024-09-17T02:21:19.297 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:19.298055+0000", 2024-09-17T02:21:19.297 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.002820899, 2024-09-17T02:21:19.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028376400000000002, 2024-09-17T02:21:19.298 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:19.298 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:19.298 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:19.298 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:19.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:19.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.298055+0000", 2024-09-17T02:21:19.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:19.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:19.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.298055+0000", 2024-09-17T02:21:19.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:19.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:19.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.298055+0000", 2024-09-17T02:21:19.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0900000000000001e-07 2024-09-17T02:21:19.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:19.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.298195+0000", 2024-09-17T02:21:19.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000139529 2024-09-17T02:21:19.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:19.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.298204+0000", 2024-09-17T02:21:19.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8300000000000002e-06 2024-09-17T02:21:19.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.298210+0000", 2024-09-17T02:21:19.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9839999999999998e-06 2024-09-17T02:21:19.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:19.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.298253+0000", 2024-09-17T02:21:19.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3340999999999997e-05 2024-09-17T02:21:19.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:19.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.298268+0000", 2024-09-17T02:21:19.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4907e-05 2024-09-17T02:21:19.305 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:19.305 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:19.309 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:19.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.309 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:101003 5.6 5:624e402b:::benchmark_data_smithi001_23533_object101002:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T02:21:19.309 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:19.299222+0000", 2024-09-17T02:21:19.310 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001653608, 2024-09-17T02:21:19.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001722887, 2024-09-17T02:21:19.310 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:19.310 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:19.310 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:19.310 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:19.310 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:19.310 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:19.310 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 101003 2024-09-17T02:21:19.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.310 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:19.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.299222+0000", 2024-09-17T02:21:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.299222+0000", 2024-09-17T02:21:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.299223+0000", 2024-09-17T02:21:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.108e-06 2024-09-17T02:21:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.299246+0000", 2024-09-17T02:21:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2263e-05 2024-09-17T02:21:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.299255+0000", 2024-09-17T02:21:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5289999999999997e-06 2024-09-17T02:21:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.299260+0000", 2024-09-17T02:21:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1909999999999999e-06 2024-09-17T02:21:19.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:19.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.299311+0000", 2024-09-17T02:21:19.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0676000000000001e-05 2024-09-17T02:21:19.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:19.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.299429+0000", 2024-09-17T02:21:19.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011807300000000001 2024-09-17T02:21:19.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:19.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.299556+0000", 2024-09-17T02:21:19.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012724700000000001 2024-09-17T02:21:19.315 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:19.315 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:19.315 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:19.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.316 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4466.0:100982 5.5 e45/22)", 2024-09-17T02:21:19.316 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:19.300758+0000", 2024-09-17T02:21:19.316 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00011772, 2024-09-17T02:21:19.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022512399999999999, 2024-09-17T02:21:19.316 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:19.317 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:19.317 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:19.317 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:19.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:19.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.300758+0000", 2024-09-17T02:21:19.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:19.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:19.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.300758+0000", 2024-09-17T02:21:19.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.300758+0000", 2024-09-17T02:21:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3200000000000001e-07 2024-09-17T02:21:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.300760+0000", 2024-09-17T02:21:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7379999999999999e-06 2024-09-17T02:21:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.300766+0000", 2024-09-17T02:21:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.925e-06 2024-09-17T02:21:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.300770+0000", 2024-09-17T02:21:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4850000000000001e-06 2024-09-17T02:21:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:19.323 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:19.323 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:19.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.323 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:100982 5.5 5:a89eec50:::benchmark_data_smithi001_23533_object100981:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T02:21:19.323 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:19.288084+0000", 2024-09-17T02:21:19.324 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.012791921, 2024-09-17T02:21:19.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012927321, 2024-09-17T02:21:19.324 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:19.324 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:19.324 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:19.325 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:19.325 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:19.325 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:19.325 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 100982 2024-09-17T02:21:19.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.325 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:19.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:19.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.288084+0000", 2024-09-17T02:21:19.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:19.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:19.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.288084+0000", 2024-09-17T02:21:19.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:19.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:19.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.288084+0000", 2024-09-17T02:21:19.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8800000000000003e-07 2024-09-17T02:21:19.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:19.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.288110+0000", 2024-09-17T02:21:19.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5167000000000001e-05 2024-09-17T02:21:19.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:19.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.288125+0000", 2024-09-17T02:21:19.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5982999999999999e-05 2024-09-17T02:21:19.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.288131+0000", 2024-09-17T02:21:19.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5040000000000002e-06 2024-09-17T02:21:19.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:19.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.290724+0000", 2024-09-17T02:21:19.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025925129999999998 2024-09-17T02:21:19.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:19.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.290838+0000", 2024-09-17T02:21:19.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011466700000000001 2024-09-17T02:21:19.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:19.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.290960+0000", 2024-09-17T02:21:19.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000121327 2024-09-17T02:21:19.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:19.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.295210+0000", 2024-09-17T02:21:19.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042500419999999999 2024-09-17T02:21:19.331 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:19.331 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:19.331 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:19.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.332 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:100996 5.5 5:ac7c8c47:::benchmark_data_smithi001_23533_object100995:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T02:21:19.332 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:19.295235+0000", 2024-09-17T02:21:19.332 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0056406670000000003, 2024-09-17T02:21:19.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058198089999999996, 2024-09-17T02:21:19.332 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:19.332 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:19.332 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:19.332 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:19.332 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:19.332 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:19.332 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 100996 2024-09-17T02:21:19.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.333 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:19.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:19.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.295235+0000", 2024-09-17T02:21:19.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:19.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:19.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.295235+0000", 2024-09-17T02:21:19.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:19.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:19.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.295236+0000", 2024-09-17T02:21:19.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2799999999999995e-07 2024-09-17T02:21:19.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:19.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.295392+0000", 2024-09-17T02:21:19.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015573599999999999 2024-09-17T02:21:19.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:19.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.295400+0000", 2024-09-17T02:21:19.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5080000000000005e-06 2024-09-17T02:21:19.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.295405+0000", 2024-09-17T02:21:19.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0069999999999997e-06 2024-09-17T02:21:19.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:19.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.295440+0000", 2024-09-17T02:21:19.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5182000000000003e-05 2024-09-17T02:21:19.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:19.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.295529+0000", 2024-09-17T02:21:19.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8918999999999993e-05 2024-09-17T02:21:19.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:19.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.295629+0000", 2024-09-17T02:21:19.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100109 2024-09-17T02:21:19.336 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:19.336 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:19.336 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:19.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.337 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:100998 5.5 5:a9d5fdbe:::benchmark_data_smithi001_23533_object100997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T02:21:19.337 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:19.295593+0000", 2024-09-17T02:21:19.337 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0052830669999999998, 2024-09-17T02:21:19.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055002710000000002, 2024-09-17T02:21:19.337 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:19.337 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:19.337 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:19.338 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:19.338 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:19.338 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:19.338 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 100998 2024-09-17T02:21:19.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.338 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:19.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:19.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.295593+0000", 2024-09-17T02:21:19.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:19.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:19.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.295593+0000", 2024-09-17T02:21:19.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:19.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:19.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.295593+0000", 2024-09-17T02:21:19.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8400000000000004e-07 2024-09-17T02:21:19.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:19.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.295706+0000", 2024-09-17T02:21:19.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000112262 2024-09-17T02:21:19.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:19.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.295715+0000", 2024-09-17T02:21:19.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.132e-06 2024-09-17T02:21:19.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.295721+0000", 2024-09-17T02:21:19.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9270000000000002e-06 2024-09-17T02:21:19.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:19.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.298068+0000", 2024-09-17T02:21:19.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023471239999999999 2024-09-17T02:21:19.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:19.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.298201+0000", 2024-09-17T02:21:19.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013295700000000001 2024-09-17T02:21:19.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:19.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.298356+0000", 2024-09-17T02:21:19.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000155091 2024-09-17T02:21:19.342 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:19.342 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:19.342 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:19.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.343 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:101000 5.a 5:570e37cf:::benchmark_data_smithi001_23533_object100999:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T02:21:19.343 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:19.295760+0000", 2024-09-17T02:21:19.343 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0051153939999999997, 2024-09-17T02:21:19.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053702489999999997, 2024-09-17T02:21:19.343 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:19.343 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:19.343 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:19.343 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:19.343 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:19.343 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:19.343 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 101000 2024-09-17T02:21:19.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.343 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:19.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:19.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.295760+0000", 2024-09-17T02:21:19.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:19.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:19.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.295760+0000", 2024-09-17T02:21:19.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:19.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:19.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.295761+0000", 2024-09-17T02:21:19.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2399999999999998e-07 2024-09-17T02:21:19.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:19.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.295857+0000", 2024-09-17T02:21:19.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6576000000000005e-05 2024-09-17T02:21:19.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:19.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.295865+0000", 2024-09-17T02:21:19.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4390000000000003e-06 2024-09-17T02:21:19.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.295869+0000", 2024-09-17T02:21:19.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.895e-06 2024-09-17T02:21:19.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:19.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.295903+0000", 2024-09-17T02:21:19.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3686000000000002e-05 2024-09-17T02:21:19.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:19.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.296007+0000", 2024-09-17T02:21:19.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104392 2024-09-17T02:21:19.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:19.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.297007+0000", 2024-09-17T02:21:19.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00099967999999999997 2024-09-17T02:21:19.349 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:19.349 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:19.349 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:19.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.350 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:100999 5.b e45/38 5:d377c7ef:::benchmark_data_smithi001_23533_object100998:head v 45'6241, mlcod=45'6239)", 2024-09-17T02:21:19.350 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:19.296257+0000", 2024-09-17T02:21:19.350 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0046190950000000001, 2024-09-17T02:21:19.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049127859999999997, 2024-09-17T02:21:19.350 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:19.350 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:19.350 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:19.350 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:19.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:19.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.296257+0000", 2024-09-17T02:21:19.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:19.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:19.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.296257+0000", 2024-09-17T02:21:19.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:19.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:19.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.296257+0000", 2024-09-17T02:21:19.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5999999999999999e-07 2024-09-17T02:21:19.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:19.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.296371+0000", 2024-09-17T02:21:19.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000113906 2024-09-17T02:21:19.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:19.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.296380+0000", 2024-09-17T02:21:19.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2969999999999992e-06 2024-09-17T02:21:19.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:19.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.296386+0000", 2024-09-17T02:21:19.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6160000000000001e-06 2024-09-17T02:21:19.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:19.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.296430+0000", 2024-09-17T02:21:19.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3785999999999997e-05 2024-09-17T02:21:19.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:19.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:19.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:19.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.296451+0000", 2024-09-17T02:21:19.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1189e-05 2024-09-17T02:21:19.354 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:19.354 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:19.355 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:19.355 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:19.355 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:21:19.355 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 8 2024-09-17T02:21:19.355 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:19.357 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:19.358+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:19.358 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:19.457 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:19.459+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:19.523 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:21:19.523 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:21:19.541 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:21:19.542 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:21:19.555 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:19.555 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:19.557 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:19.558+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:19.560 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:21:19.560 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:21:19.576 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:19.659 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:19.658+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:19.713 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-17T02:21:19.714 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T02:21:19.714 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-17T02:21:19.714 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-17T02:21:19.714 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-17T02:21:19.714 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-17T02:21:19.760 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:19.762+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:19.768 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:19.768 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:19.773 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 47 16 101955 101939 135.542 126.188 0.00606232 0.00737288 2024-09-17T02:21:19.789 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:21:19.861 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:19.862+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:19.871 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:21:19.871 INFO:teuthology.orchestra.run.smithi164.stdout: "success": "" 2024-09-17T02:21:19.871 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:21:19.946 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:19.946 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:19.962 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:19.962+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:19.968 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:21:20.063 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:20.066+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:20.126 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:20.127 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:20.148 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:21:20.164 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:20.166+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:20.265 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:20.266+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:20.282 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T02:21:20.303 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:20.303 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:20.323 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:20.368 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:20.370+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:20.466 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:20.467+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:20.476 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:20.476 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:20.494 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:20.568 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:20.567+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:20.669 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:20.671+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:20.695 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:20.695 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:20.716 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:20.769 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:20.769+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:20.774 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 48 16 103956 103940 135.323 125.062 0.00615176 0.00738492 2024-09-17T02:21:20.870 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:20.871+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:20.878 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:20.878 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:20.899 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:20.971 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:20.973+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:21.054 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:21.054 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:21.073 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:21.074+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:21.075 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:21.173 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:21.173+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:21.259 INFO:teuthology.orchestra.run.smithi001.stderr:nodeep-scrub is set 2024-09-17T02:21:21.274 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:21.273+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:21.275 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:21.275 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:21.297 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:21.378 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:21.378+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:21.456 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:21.457 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:21.477 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:21:21.477 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:21.479+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:21.577 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:21.579+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:21.579 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:21:21.636 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:21.636 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:21.658 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:21:21.678 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:21.678+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:21.744 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:21:21.744 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:21:21.761 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:21:21.762 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:21:21.774 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 49 16 105982 105966 135.145 126.625 0.00920036 0.00739474 2024-09-17T02:21:21.779 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:21.782+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:21.779 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:21:21.780 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:21:21.855 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:21:21.855 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-17T02:21:21.855 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-09-17T02:21:21.855 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-09-17T02:21:21.855 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:21:21.874 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:21:21.880 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:21.881+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:21.983 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:21.982+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:22.036 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:21:22.036 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-09-17T02:21:22.036 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-09-17T02:21:22.036 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-17T02:21:22.036 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.036 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-17T02:21:22.036 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:21:22.037 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 77.579143450999993, 2024-09-17T02:21:22.037 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.15597325500000001, 2024-09-17T02:21:22.037 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:22.037 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:22.037 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.037 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:22.037 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4164", 2024-09-17T02:21:22.037 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/201892753", 2024-09-17T02:21:22.037 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 1 2024-09-17T02:21:22.037 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.037 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:22.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:22.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:21:22.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:22.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:21:22.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:22.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458359+0000", 2024-09-17T02:21:22.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3929999999999998e-06 2024-09-17T02:21:22.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.039 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:22.039 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458373+0000", 2024-09-17T02:21:22.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4103e-05 2024-09-17T02:21:22.039 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.039 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:22.039 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458397+0000", 2024-09-17T02:21:22.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.438e-05 2024-09-17T02:21:22.039 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.039 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.039 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458421+0000", 2024-09-17T02:21:22.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3655999999999998e-05 2024-09-17T02:21:22.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.040 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:22.040 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458529+0000", 2024-09-17T02:21:22.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010752900000000001 2024-09-17T02:21:22.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.040 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:21:22.041 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458542+0000", 2024-09-17T02:21:22.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2986999999999999e-05 2024-09-17T02:21:22.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.041 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:22.041 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.611050+0000", 2024-09-17T02:21:22.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.1525087 2024-09-17T02:21:22.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.041 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:22.041 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.611529+0000", 2024-09-17T02:21:22.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00047844899999999999 2024-09-17T02:21:22.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:22.042 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.612061+0000", 2024-09-17T02:21:22.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00053230300000000003 2024-09-17T02:21:22.042 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:22.042 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.613451+0000", 2024-09-17T02:21:22.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0013897250000000001 2024-09-17T02:21:22.042 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.042 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614168+0000", 2024-09-17T02:21:22.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00071692499999999998 2024-09-17T02:21:22.042 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:22.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614265+0000", 2024-09-17T02:21:22.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7589000000000004e-05 2024-09-17T02:21:22.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:22.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614330+0000", 2024-09-17T02:21:22.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4516000000000004e-05 2024-09-17T02:21:22.043 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.043 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:22.043 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.044 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:22.044 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:21:22.044 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 65.481120360999995, 2024-09-17T02:21:22.044 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030933694000000001, 2024-09-17T02:21:22.044 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:22.044 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:22.044 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.044 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:22.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.044 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:22.044 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:21:22.044 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.044 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:22.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:21:22.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:22.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556381+0000", 2024-09-17T02:21:22.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2100000000000001e-06 2024-09-17T02:21:22.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.046 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:22.046 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556389+0000", 2024-09-17T02:21:22.046 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5539999999999998e-06 2024-09-17T02:21:22.046 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.046 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.046 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:22.046 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556408+0000", 2024-09-17T02:21:22.046 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8623000000000001e-05 2024-09-17T02:21:22.046 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.046 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.046 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.046 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556427+0000", 2024-09-17T02:21:22.046 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8566000000000001e-05 2024-09-17T02:21:22.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:22.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558741+0000", 2024-09-17T02:21:22.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023144390000000002 2024-09-17T02:21:22.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:22.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559040+0000", 2024-09-17T02:21:22.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029912100000000001 2024-09-17T02:21:22.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:22.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559222+0000", 2024-09-17T02:21:22.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018211200000000001 2024-09-17T02:21:22.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:22.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.566648+0000", 2024-09-17T02:21:22.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074257560000000004 2024-09-17T02:21:22.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587109+0000", 2024-09-17T02:21:22.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.020460685999999999 2024-09-17T02:21:22.049 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.049 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:22.049 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587232+0000", 2024-09-17T02:21:22.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123325 2024-09-17T02:21:22.049 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.049 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:22.049 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587313+0000", 2024-09-17T02:21:22.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1302000000000002e-05 2024-09-17T02:21:22.049 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.049 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:22.050 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.050 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.050 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:22.050 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:21:22.050 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 65.481054915000001, 2024-09-17T02:21:22.050 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031045538000000001, 2024-09-17T02:21:22.050 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:22.050 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:22.050 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.050 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:22.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.050 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:22.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:21:22.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.051 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:22.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:21:22.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.051 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:22.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556446+0000", 2024-09-17T02:21:22.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.26e-06 2024-09-17T02:21:22.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.052 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:22.052 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556454+0000", 2024-09-17T02:21:22.052 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1640000000000004e-06 2024-09-17T02:21:22.052 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.052 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:22.052 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556471+0000", 2024-09-17T02:21:22.052 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7586000000000001e-05 2024-09-17T02:21:22.052 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.053 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.053 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.053 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556485+0000", 2024-09-17T02:21:22.053 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3523000000000001e-05 2024-09-17T02:21:22.053 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.053 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.053 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:22.053 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559899+0000", 2024-09-17T02:21:22.053 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0034142140000000001 2024-09-17T02:21:22.053 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.053 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.053 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:22.054 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.560104+0000", 2024-09-17T02:21:22.054 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00020539199999999999 2024-09-17T02:21:22.054 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.054 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.054 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:22.054 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.560400+0000", 2024-09-17T02:21:22.054 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029612099999999999 2024-09-17T02:21:22.054 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.054 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.054 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:22.054 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.568427+0000", 2024-09-17T02:21:22.054 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0080262909999999996 2024-09-17T02:21:22.055 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.055 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.055 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.055 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587377+0000", 2024-09-17T02:21:22.055 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018950765000000001 2024-09-17T02:21:22.055 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.055 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.055 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:22.055 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587445+0000", 2024-09-17T02:21:22.055 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.724e-05 2024-09-17T02:21:22.055 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.055 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.055 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:22.056 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587491+0000", 2024-09-17T02:21:22.056 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5982000000000001e-05 2024-09-17T02:21:22.056 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.056 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:22.056 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.056 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.056 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:22.056 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:21:22.056 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 65.480992145000002, 2024-09-17T02:21:22.056 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031435547000000001, 2024-09-17T02:21:22.056 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:22.057 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:22.057 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.057 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:22.057 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.057 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:22.057 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:21:22.057 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.057 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.057 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.057 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:22.057 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:21:22.057 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.057 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.058 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.058 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:22.058 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556509+0000", 2024-09-17T02:21:22.058 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.06e-06 2024-09-17T02:21:22.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.058 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.058 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:22.058 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556515+0000", 2024-09-17T02:21:22.058 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1029999999999998e-06 2024-09-17T02:21:22.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.058 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.058 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:22.058 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556532+0000", 2024-09-17T02:21:22.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7054e-05 2024-09-17T02:21:22.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556545+0000", 2024-09-17T02:21:22.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3023000000000001e-05 2024-09-17T02:21:22.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:22.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561016+0000", 2024-09-17T02:21:22.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044705150000000004 2024-09-17T02:21:22.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:22.060 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561316+0000", 2024-09-17T02:21:22.060 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000299895 2024-09-17T02:21:22.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.060 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.060 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:22.060 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561651+0000", 2024-09-17T02:21:22.060 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033519300000000001 2024-09-17T02:21:22.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.060 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.060 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:22.060 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571105+0000", 2024-09-17T02:21:22.060 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094540539999999999 2024-09-17T02:21:22.061 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.061 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.061 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587628+0000", 2024-09-17T02:21:22.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016522819000000001 2024-09-17T02:21:22.061 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.061 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:22.061 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587770+0000", 2024-09-17T02:21:22.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000142352 2024-09-17T02:21:22.061 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.062 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:22.062 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587943+0000", 2024-09-17T02:21:22.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017347900000000001 2024-09-17T02:21:22.062 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.062 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:22.062 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.062 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.062 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:22.062 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:21:22.062 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 65.480936415000002, 2024-09-17T02:21:22.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031809104999999997, 2024-09-17T02:21:22.062 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:22.062 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:22.063 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.063 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:22.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:22.063 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:21:22.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:22.063 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:21:22.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:22.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556565+0000", 2024-09-17T02:21:22.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.116e-06 2024-09-17T02:21:22.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:22.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556572+0000", 2024-09-17T02:21:22.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0230000000000004e-06 2024-09-17T02:21:22.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:22.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556588+0000", 2024-09-17T02:21:22.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6643e-05 2024-09-17T02:21:22.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.065 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.065 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556606+0000", 2024-09-17T02:21:22.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7159999999999998e-05 2024-09-17T02:21:22.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.065 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:22.065 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562712+0000", 2024-09-17T02:21:22.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0061061630000000004 2024-09-17T02:21:22.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.065 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:22.065 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562919+0000", 2024-09-17T02:21:22.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000207309 2024-09-17T02:21:22.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.066 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:22.066 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563264+0000", 2024-09-17T02:21:22.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00034490699999999998 2024-09-17T02:21:22.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.066 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:22.066 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571812+0000", 2024-09-17T02:21:22.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0085477810000000008 2024-09-17T02:21:22.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.066 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588094+0000", 2024-09-17T02:21:22.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016282443000000001 2024-09-17T02:21:22.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.067 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:22.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588275+0000", 2024-09-17T02:21:22.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018058700000000001 2024-09-17T02:21:22.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.067 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:22.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588373+0000", 2024-09-17T02:21:22.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7973000000000005e-05 2024-09-17T02:21:22.067 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.067 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:22.068 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.068 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:22.068 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:21:22.068 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 65.480878316000002, 2024-09-17T02:21:22.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031950544999999997, 2024-09-17T02:21:22.068 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:22.068 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:22.068 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.068 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:22.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.068 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:22.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:21:22.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:22.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:21:22.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:22.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556623+0000", 2024-09-17T02:21:22.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.04e-06 2024-09-17T02:21:22.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:22.070 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556631+0000", 2024-09-17T02:21:22.070 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1529999999999997e-06 2024-09-17T02:21:22.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.070 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:22.070 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556648+0000", 2024-09-17T02:21:22.070 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6583999999999999e-05 2024-09-17T02:21:22.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.070 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.070 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556661+0000", 2024-09-17T02:21:22.070 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3203e-05 2024-09-17T02:21:22.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.071 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:22.071 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564413+0000", 2024-09-17T02:21:22.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0077523100000000001 2024-09-17T02:21:22.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.071 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:22.071 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.565841+0000", 2024-09-17T02:21:22.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014276320000000001 2024-09-17T02:21:22.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.071 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:22.072 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.566131+0000", 2024-09-17T02:21:22.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029043800000000001 2024-09-17T02:21:22.072 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.072 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.072 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:22.072 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572353+0000", 2024-09-17T02:21:22.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.006222399 2024-09-17T02:21:22.072 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.072 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.072 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.072 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588452+0000", 2024-09-17T02:21:22.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016098635 2024-09-17T02:21:22.072 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.073 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:22.073 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588520+0000", 2024-09-17T02:21:22.073 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8040000000000006e-05 2024-09-17T02:21:22.073 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.073 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:22.073 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588572+0000", 2024-09-17T02:21:22.073 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2111000000000003e-05 2024-09-17T02:21:22.073 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.073 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:22.073 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.074 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:22.074 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:21:22.074 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 65.480781149999999, 2024-09-17T02:21:22.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.032187205000000003, 2024-09-17T02:21:22.074 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:22.074 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:22.074 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.074 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:22.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:22.075 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:21:22.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.075 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.075 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:22.075 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:21:22.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.075 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.075 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:22.075 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556727+0000", 2024-09-17T02:21:22.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3000000000000002e-06 2024-09-17T02:21:22.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:22.076 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556736+0000", 2024-09-17T02:21:22.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4300000000000006e-06 2024-09-17T02:21:22.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:22.076 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556755+0000", 2024-09-17T02:21:22.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9700000000000001e-05 2024-09-17T02:21:22.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556771+0000", 2024-09-17T02:21:22.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5213e-05 2024-09-17T02:21:22.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:22.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571184+0000", 2024-09-17T02:21:22.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014413888999999999 2024-09-17T02:21:22.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:22.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571302+0000", 2024-09-17T02:21:22.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011794900000000001 2024-09-17T02:21:22.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.078 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:22.078 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571494+0000", 2024-09-17T02:21:22.078 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000191168 2024-09-17T02:21:22.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.078 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:22.078 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.573775+0000", 2024-09-17T02:21:22.078 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002281656 2024-09-17T02:21:22.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.078 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.078 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588668+0000", 2024-09-17T02:21:22.078 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014892699000000001 2024-09-17T02:21:22.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.079 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:22.079 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588813+0000", 2024-09-17T02:21:22.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014530700000000001 2024-09-17T02:21:22.079 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.079 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:22.079 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588906+0000", 2024-09-17T02:21:22.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2893999999999995e-05 2024-09-17T02:21:22.079 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.079 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:22.079 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.079 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.079 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:22.080 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:21:22.080 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 65.480582717999994, 2024-09-17T02:21:22.080 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030862568, 2024-09-17T02:21:22.080 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:22.080 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:22.080 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.080 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:22.080 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.080 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:22.080 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:21:22.080 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.080 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.080 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.081 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:22.081 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:21:22.081 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.081 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.081 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.081 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:22.081 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556918+0000", 2024-09-17T02:21:22.081 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0529999999999999e-06 2024-09-17T02:21:22.081 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.081 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.081 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:22.081 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556925+0000", 2024-09-17T02:21:22.081 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.6939999999999998e-06 2024-09-17T02:21:22.081 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.082 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.082 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:22.082 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556942+0000", 2024-09-17T02:21:22.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6803000000000002e-05 2024-09-17T02:21:22.082 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.082 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.082 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.082 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556955+0000", 2024-09-17T02:21:22.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2659e-05 2024-09-17T02:21:22.082 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.082 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.082 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:22.082 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558237+0000", 2024-09-17T02:21:22.083 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001282804 2024-09-17T02:21:22.083 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.083 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.083 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:22.083 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558495+0000", 2024-09-17T02:21:22.083 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000257178 2024-09-17T02:21:22.083 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.083 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.083 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:22.083 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562168+0000", 2024-09-17T02:21:22.083 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0036737110000000001 2024-09-17T02:21:22.083 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.083 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.084 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:22.084 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.570855+0000", 2024-09-17T02:21:22.084 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0086868729999999995 2024-09-17T02:21:22.084 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.084 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.084 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.084 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587568+0000", 2024-09-17T02:21:22.084 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016712444999999999 2024-09-17T02:21:22.084 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.084 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.084 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:22.084 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587677+0000", 2024-09-17T02:21:22.084 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000109879 2024-09-17T02:21:22.085 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.085 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.085 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:22.085 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587780+0000", 2024-09-17T02:21:22.085 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000102469 2024-09-17T02:21:22.085 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.085 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:22.085 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.085 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.085 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.085 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:22.085 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:21:22.085 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 65.480500586000005, 2024-09-17T02:21:22.085 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031005751000000002, 2024-09-17T02:21:22.086 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:22.086 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:22.086 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.086 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:22.086 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.086 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:22.086 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:21:22.086 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.086 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.086 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.086 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:22.086 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:21:22.086 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.086 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.086 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.086 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:22.087 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557001+0000", 2024-09-17T02:21:22.087 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.237e-06 2024-09-17T02:21:22.087 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.087 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.087 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:22.087 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557007+0000", 2024-09-17T02:21:22.087 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7270000000000001e-06 2024-09-17T02:21:22.087 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.087 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.087 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:22.087 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557025+0000", 2024-09-17T02:21:22.087 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7689999999999998e-05 2024-09-17T02:21:22.087 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.087 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557039+0000", 2024-09-17T02:21:22.088 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.385e-05 2024-09-17T02:21:22.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:22.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563783+0000", 2024-09-17T02:21:22.088 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0067437110000000003 2024-09-17T02:21:22.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:22.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564031+0000", 2024-09-17T02:21:22.088 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00024871799999999999 2024-09-17T02:21:22.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.089 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:22.089 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564518+0000", 2024-09-17T02:21:22.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00048708999999999997 2024-09-17T02:21:22.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.089 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:22.089 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572375+0000", 2024-09-17T02:21:22.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078564780000000001 2024-09-17T02:21:22.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.089 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.090 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587862+0000", 2024-09-17T02:21:22.090 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015486837999999999 2024-09-17T02:21:22.090 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.090 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.090 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:22.090 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587954+0000", 2024-09-17T02:21:22.090 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1766000000000002e-05 2024-09-17T02:21:22.090 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.090 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.090 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:22.090 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588005+0000", 2024-09-17T02:21:22.090 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1646e-05 2024-09-17T02:21:22.091 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.091 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:22.091 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.091 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.091 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.091 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28720 5.f 5:f8a7aea5:::benchmark_data_smithi001_23533_object28719:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:22.091 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:22.091 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 39.469713157999998, 2024-09-17T02:21:22.091 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.033978608, 2024-09-17T02:21:22.091 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:22.091 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:22.091 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.091 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:22.092 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:22.092 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:22.092 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28720 2024-09-17T02:21:22.092 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.092 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:22.092 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.092 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:22.092 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:22.092 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.092 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.092 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.092 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:22.092 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:22.093 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.093 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.093 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.093 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:22.093 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:22.093 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3200000000000005e-07 2024-09-17T02:21:22.093 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.093 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.093 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:22.093 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567856+0000", 2024-09-17T02:21:22.093 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8596000000000005e-05 2024-09-17T02:21:22.093 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.093 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.094 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:22.094 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567864+0000", 2024-09-17T02:21:22.094 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6040000000000004e-06 2024-09-17T02:21:22.094 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.094 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.094 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.094 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567867+0000", 2024-09-17T02:21:22.094 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7929999999999999e-06 2024-09-17T02:21:22.094 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.094 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.094 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:22.094 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567896+0000", 2024-09-17T02:21:22.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8444000000000001e-05 2024-09-17T02:21:22.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.095 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:22.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567983+0000", 2024-09-17T02:21:22.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7498999999999997e-05 2024-09-17T02:21:22.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.095 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:22.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568078+0000", 2024-09-17T02:21:22.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5050999999999995e-05 2024-09-17T02:21:22.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.096 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:22.096 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573091+0000", 2024-09-17T02:21:22.096 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050124599999999998 2024-09-17T02:21:22.096 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.096 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.096 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.096 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601705+0000", 2024-09-17T02:21:22.096 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028614298999999999 2024-09-17T02:21:22.096 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.096 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.096 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:22.096 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601741+0000", 2024-09-17T02:21:22.096 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5329e-05 2024-09-17T02:21:22.097 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.097 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.097 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:22.097 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601766+0000", 2024-09-17T02:21:22.097 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5001e-05 2024-09-17T02:21:22.097 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.097 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:22.097 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.097 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.097 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.097 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28723 5.f 5:f1a2a8f6:::benchmark_data_smithi001_23533_object28722:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:22.097 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:21:22.098 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 39.469434477999997, 2024-09-17T02:21:22.098 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.033805288000000003, 2024-09-17T02:21:22.098 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:22.098 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:22.098 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.098 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:22.098 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:22.098 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:22.098 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28723 2024-09-17T02:21:22.098 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.098 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:22.098 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.098 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:22.099 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:21:22.099 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.099 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.099 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.099 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:22.099 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:21:22.099 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.099 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.099 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.099 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:22.099 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568067+0000", 2024-09-17T02:21:22.100 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6700000000000002e-07 2024-09-17T02:21:22.100 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.100 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.100 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:22.100 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568121+0000", 2024-09-17T02:21:22.100 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4286000000000002e-05 2024-09-17T02:21:22.100 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.100 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.100 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:22.100 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568131+0000", 2024-09-17T02:21:22.100 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0288e-05 2024-09-17T02:21:22.100 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.101 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.101 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.101 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568139+0000", 2024-09-17T02:21:22.101 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5399999999999998e-06 2024-09-17T02:21:22.101 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.101 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.101 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:22.101 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569194+0000", 2024-09-17T02:21:22.101 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0010557100000000001 2024-09-17T02:21:22.101 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.101 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.101 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:22.102 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569298+0000", 2024-09-17T02:21:22.102 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000103491 2024-09-17T02:21:22.102 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.102 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.102 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:22.102 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569428+0000", 2024-09-17T02:21:22.102 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013050599999999999 2024-09-17T02:21:22.102 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.102 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.102 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:22.102 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573124+0000", 2024-09-17T02:21:22.102 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0036956810000000001 2024-09-17T02:21:22.103 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.103 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.103 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.103 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601801+0000", 2024-09-17T02:21:22.103 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028676667999999999 2024-09-17T02:21:22.103 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.103 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.103 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:22.103 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601835+0000", 2024-09-17T02:21:22.103 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4347000000000002e-05 2024-09-17T02:21:22.103 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.103 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.104 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:22.104 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601871+0000", 2024-09-17T02:21:22.104 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5803999999999998e-05 2024-09-17T02:21:22.104 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.104 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:22.104 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.104 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.104 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.104 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28729 5.9 5:9e3b1489:::benchmark_data_smithi001_23533_object28728:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:22.104 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:21:22.104 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 39.467815827000003, 2024-09-17T02:21:22.104 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.032738525999999997, 2024-09-17T02:21:22.104 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:22.105 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:22.105 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.105 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:22.105 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:22.105 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:22.105 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28729 2024-09-17T02:21:22.105 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.105 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:22.105 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.105 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:22.105 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:21:22.105 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.106 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.106 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.106 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:22.106 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:21:22.106 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.106 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.106 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.106 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:22.106 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569685+0000", 2024-09-17T02:21:22.106 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8599999999999996e-07 2024-09-17T02:21:22.106 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.106 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.106 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:22.107 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569725+0000", 2024-09-17T02:21:22.107 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0144000000000001e-05 2024-09-17T02:21:22.107 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.107 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.107 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:22.107 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569737+0000", 2024-09-17T02:21:22.107 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1752e-05 2024-09-17T02:21:22.107 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.107 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.107 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.107 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569745+0000", 2024-09-17T02:21:22.107 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6420000000000007e-06 2024-09-17T02:21:22.107 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.108 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:22.108 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569801+0000", 2024-09-17T02:21:22.108 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6110000000000003e-05 2024-09-17T02:21:22.108 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.108 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:22.108 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569944+0000", 2024-09-17T02:21:22.108 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014361500000000001 2024-09-17T02:21:22.108 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.108 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:22.108 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.570234+0000", 2024-09-17T02:21:22.108 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00028927899999999998 2024-09-17T02:21:22.109 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.109 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.109 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:22.109 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572606+0000", 2024-09-17T02:21:22.109 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023725529999999999 2024-09-17T02:21:22.109 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.109 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.109 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.109 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602361+0000", 2024-09-17T02:21:22.109 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029755031000000001 2024-09-17T02:21:22.109 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.109 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.110 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:22.110 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602397+0000", 2024-09-17T02:21:22.110 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5509000000000002e-05 2024-09-17T02:21:22.110 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.110 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.110 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:22.110 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602423+0000", 2024-09-17T02:21:22.110 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5905e-05 2024-09-17T02:21:22.110 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.110 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:22.110 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.110 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.110 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.111 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28734 5.f 5:f1a63647:::benchmark_data_smithi001_23533_object28733:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:22.111 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:21:22.111 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 39.466093340999997, 2024-09-17T02:21:22.111 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.034441100000000002, 2024-09-17T02:21:22.111 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:22.111 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:22.111 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.111 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:22.111 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:22.111 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:22.111 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28734 2024-09-17T02:21:22.111 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.111 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:22.112 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.112 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:22.112 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:21:22.112 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.112 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.112 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.112 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:22.112 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:21:22.112 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.112 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.112 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.112 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:22.113 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571408+0000", 2024-09-17T02:21:22.113 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.8899999999999998e-07 2024-09-17T02:21:22.113 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.113 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.113 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:22.113 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571464+0000", 2024-09-17T02:21:22.113 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6546999999999999e-05 2024-09-17T02:21:22.113 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.113 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.113 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:22.113 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571474+0000", 2024-09-17T02:21:22.113 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0348e-05 2024-09-17T02:21:22.113 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.114 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.114 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.114 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571480+0000", 2024-09-17T02:21:22.114 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.366e-06 2024-09-17T02:21:22.114 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.114 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.114 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:22.114 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572097+0000", 2024-09-17T02:21:22.114 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061710599999999997 2024-09-17T02:21:22.114 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.114 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.115 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:22.115 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572172+0000", 2024-09-17T02:21:22.115 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4658000000000002e-05 2024-09-17T02:21:22.115 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.115 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.115 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:22.115 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572247+0000", 2024-09-17T02:21:22.115 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5766000000000006e-05 2024-09-17T02:21:22.115 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.115 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.115 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:22.115 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573819+0000", 2024-09-17T02:21:22.115 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015713649999999999 2024-09-17T02:21:22.115 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.116 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.116 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.116 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605762+0000", 2024-09-17T02:21:22.116 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031943304999999998 2024-09-17T02:21:22.116 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.116 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.116 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:22.116 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605808+0000", 2024-09-17T02:21:22.116 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5776999999999999e-05 2024-09-17T02:21:22.116 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.116 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.116 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:22.117 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605848+0000", 2024-09-17T02:21:22.117 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9972999999999998e-05 2024-09-17T02:21:22.117 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.117 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:22.117 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.117 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.117 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.117 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:97761 5.9 5:908717b6:::benchmark_data_smithi001_23533_object97760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:22.117 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.597267+0000", 2024-09-17T02:21:22.117 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.4402328310000003, 2024-09-17T02:21:22.117 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.093254994999999993, 2024-09-17T02:21:22.117 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:22.117 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:22.118 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.118 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:22.118 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:22.118 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:22.118 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 97761 2024-09-17T02:21:22.118 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.118 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:22.118 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.118 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:22.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597267+0000", 2024-09-17T02:21:22.118 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.118 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.118 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.118 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:22.119 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597267+0000", 2024-09-17T02:21:22.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.119 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.119 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.119 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:22.119 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597268+0000", 2024-09-17T02:21:22.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6300000000000004e-07 2024-09-17T02:21:22.119 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.119 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.119 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:22.119 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597425+0000", 2024-09-17T02:21:22.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015732499999999999 2024-09-17T02:21:22.120 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.120 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.120 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:22.120 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597436+0000", 2024-09-17T02:21:22.120 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1015e-05 2024-09-17T02:21:22.120 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.120 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.120 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.120 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597443+0000", 2024-09-17T02:21:22.120 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3840000000000002e-06 2024-09-17T02:21:22.120 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.120 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.120 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:22.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597551+0000", 2024-09-17T02:21:22.121 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000108274 2024-09-17T02:21:22.121 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.121 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.121 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:22.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597683+0000", 2024-09-17T02:21:22.121 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000131645 2024-09-17T02:21:22.121 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.121 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.121 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:22.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597835+0000", 2024-09-17T02:21:22.121 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015207400000000001 2024-09-17T02:21:22.122 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.122 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.122 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:22.122 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604322+0000", 2024-09-17T02:21:22.122 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064874829999999996 2024-09-17T02:21:22.122 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.122 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.122 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.122 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690350+0000", 2024-09-17T02:21:22.122 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.086028154999999995 2024-09-17T02:21:22.122 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.122 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.122 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:22.123 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690448+0000", 2024-09-17T02:21:22.123 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8129999999999997e-05 2024-09-17T02:21:22.123 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.123 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.123 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:22.123 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690522+0000", 2024-09-17T02:21:22.123 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3746999999999997e-05 2024-09-17T02:21:22.123 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.123 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:22.123 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.123 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.123 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.123 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:97763 5.9 5:95165281:::benchmark_data_smithi001_23533_object97762:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:22.124 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.597457+0000", 2024-09-17T02:21:22.124 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.4400434850000003, 2024-09-17T02:21:22.124 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.093308472000000003, 2024-09-17T02:21:22.124 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:22.124 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:22.124 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.124 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:22.124 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:22.124 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:22.124 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 97763 2024-09-17T02:21:22.124 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.124 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:22.124 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.124 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:22.125 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597457+0000", 2024-09-17T02:21:22.125 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.125 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.125 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.125 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:22.125 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597457+0000", 2024-09-17T02:21:22.125 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.125 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.125 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.125 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:22.125 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597457+0000", 2024-09-17T02:21:22.126 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1699999999999999e-07 2024-09-17T02:21:22.126 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.126 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.126 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:22.126 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597485+0000", 2024-09-17T02:21:22.126 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7923e-05 2024-09-17T02:21:22.126 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.126 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.126 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:22.126 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597492+0000", 2024-09-17T02:21:22.126 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8990000000000004e-06 2024-09-17T02:21:22.126 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.126 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.126 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.126 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597497+0000", 2024-09-17T02:21:22.127 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8709999999999996e-06 2024-09-17T02:21:22.127 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.127 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.127 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:22.127 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599319+0000", 2024-09-17T02:21:22.127 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0018221680000000001 2024-09-17T02:21:22.127 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.127 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.127 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:22.127 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599405+0000", 2024-09-17T02:21:22.127 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6119999999999995e-05 2024-09-17T02:21:22.127 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.127 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.128 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:22.128 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599495+0000", 2024-09-17T02:21:22.128 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9963000000000006e-05 2024-09-17T02:21:22.128 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.128 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.128 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:22.128 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604325+0000", 2024-09-17T02:21:22.128 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048300829999999998 2024-09-17T02:21:22.128 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.128 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.128 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.128 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690598+0000", 2024-09-17T02:21:22.128 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.086272969000000005 2024-09-17T02:21:22.128 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.128 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.129 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:22.129 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690696+0000", 2024-09-17T02:21:22.129 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8053000000000005e-05 2024-09-17T02:21:22.129 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.129 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.129 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:22.129 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690765+0000", 2024-09-17T02:21:22.129 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9005999999999996e-05 2024-09-17T02:21:22.129 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.129 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:22.129 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.129 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.129 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.129 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:97766 5.f 5:f82e5e9e:::benchmark_data_smithi001_23533_object97765:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:22.130 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.599640+0000", 2024-09-17T02:21:22.130 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.4378597299999996, 2024-09-17T02:21:22.130 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.090645999000000005, 2024-09-17T02:21:22.130 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:22.130 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:22.130 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.130 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:22.130 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:22.130 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:22.130 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 97766 2024-09-17T02:21:22.130 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.130 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:22.130 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.130 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:22.130 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599640+0000", 2024-09-17T02:21:22.131 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.131 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.131 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.131 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:22.131 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599640+0000", 2024-09-17T02:21:22.131 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.131 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.131 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.131 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:22.131 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599641+0000", 2024-09-17T02:21:22.132 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.95e-07 2024-09-17T02:21:22.132 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.132 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.132 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:22.132 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599720+0000", 2024-09-17T02:21:22.132 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8527000000000002e-05 2024-09-17T02:21:22.132 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.132 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.132 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:22.132 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599729+0000", 2024-09-17T02:21:22.132 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4040000000000001e-06 2024-09-17T02:21:22.132 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.133 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.133 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.133 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599734+0000", 2024-09-17T02:21:22.133 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8550000000000001e-06 2024-09-17T02:21:22.133 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.133 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.133 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:22.133 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599770+0000", 2024-09-17T02:21:22.133 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6139000000000001e-05 2024-09-17T02:21:22.133 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.133 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.133 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:22.134 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599868+0000", 2024-09-17T02:21:22.134 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7816e-05 2024-09-17T02:21:22.134 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.134 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.134 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:22.134 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599946+0000", 2024-09-17T02:21:22.134 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8064000000000003e-05 2024-09-17T02:21:22.134 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.134 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.134 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:22.134 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.603915+0000", 2024-09-17T02:21:22.134 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003969017 2024-09-17T02:21:22.135 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.135 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.135 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.135 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690096+0000", 2024-09-17T02:21:22.135 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.086180997999999995 2024-09-17T02:21:22.135 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.135 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.135 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:22.135 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690212+0000", 2024-09-17T02:21:22.135 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0001155 2024-09-17T02:21:22.135 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.135 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.135 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:22.135 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690286+0000", 2024-09-17T02:21:22.136 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4684000000000005e-05 2024-09-17T02:21:22.136 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.136 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:22.136 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.136 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.136 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.136 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:97768 5.d 5:b646c3c5:::benchmark_data_smithi001_23533_object97767:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:22.136 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.601357+0000", 2024-09-17T02:21:22.136 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.4361435399999998, 2024-09-17T02:21:22.136 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.096153645999999995, 2024-09-17T02:21:22.136 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:22.136 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:22.137 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.137 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:22.137 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:22.137 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:22.137 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 97768 2024-09-17T02:21:22.137 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.137 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:22.137 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.137 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:22.137 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601357+0000", 2024-09-17T02:21:22.137 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.137 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.137 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.137 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:22.138 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601357+0000", 2024-09-17T02:21:22.138 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.138 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.138 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.138 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:22.138 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601357+0000", 2024-09-17T02:21:22.138 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3900000000000004e-07 2024-09-17T02:21:22.138 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.138 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.138 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:22.138 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601439+0000", 2024-09-17T02:21:22.138 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2139999999999996e-05 2024-09-17T02:21:22.138 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.139 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.139 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:22.139 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601452+0000", 2024-09-17T02:21:22.139 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2166e-05 2024-09-17T02:21:22.139 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.139 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.139 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.139 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601458+0000", 2024-09-17T02:21:22.139 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7340000000000002e-06 2024-09-17T02:21:22.139 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.139 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.139 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:22.139 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601498+0000", 2024-09-17T02:21:22.139 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9368e-05 2024-09-17T02:21:22.139 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.140 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.140 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:22.140 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601616+0000", 2024-09-17T02:21:22.140 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118684 2024-09-17T02:21:22.140 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.140 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.140 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:22.140 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601699+0000", 2024-09-17T02:21:22.140 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2519000000000001e-05 2024-09-17T02:21:22.140 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.140 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.140 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:22.140 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604447+0000", 2024-09-17T02:21:22.141 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027481620000000002 2024-09-17T02:21:22.141 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.141 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.141 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.141 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.697379+0000", 2024-09-17T02:21:22.141 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.092932030999999998 2024-09-17T02:21:22.141 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.141 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.141 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:22.141 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.697444+0000", 2024-09-17T02:21:22.141 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5155999999999998e-05 2024-09-17T02:21:22.141 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.141 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.142 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:22.142 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.697510+0000", 2024-09-17T02:21:22.142 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5846999999999995e-05 2024-09-17T02:21:22.142 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.142 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:22.142 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.142 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.142 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.142 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:97769 5.d 5:b3b4045f:::benchmark_data_smithi001_23533_object97768:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:22.142 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.601473+0000", 2024-09-17T02:21:22.142 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.4360274860000004, 2024-09-17T02:21:22.142 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.096303069000000005, 2024-09-17T02:21:22.143 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:22.143 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:22.143 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.143 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:22.143 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:22.143 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:22.143 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 97769 2024-09-17T02:21:22.143 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.143 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:22.143 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.143 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:22.143 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601473+0000", 2024-09-17T02:21:22.143 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.143 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.144 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.144 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:22.144 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601473+0000", 2024-09-17T02:21:22.144 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.144 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.144 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.144 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:22.144 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601473+0000", 2024-09-17T02:21:22.144 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7299999999999996e-07 2024-09-17T02:21:22.144 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.144 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.144 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:22.144 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601511+0000", 2024-09-17T02:21:22.145 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8034000000000002e-05 2024-09-17T02:21:22.145 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.145 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.145 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:22.145 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601521+0000", 2024-09-17T02:21:22.145 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0016e-05 2024-09-17T02:21:22.145 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.145 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.145 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.145 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601527+0000", 2024-09-17T02:21:22.145 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4639999999999997e-06 2024-09-17T02:21:22.145 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.145 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.145 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:22.146 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.603170+0000", 2024-09-17T02:21:22.146 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0016433089999999999 2024-09-17T02:21:22.146 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.146 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.146 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:22.146 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.603249+0000", 2024-09-17T02:21:22.146 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8699e-05 2024-09-17T02:21:22.146 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.146 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.146 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:22.146 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.603330+0000", 2024-09-17T02:21:22.146 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1489999999999994e-05 2024-09-17T02:21:22.146 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.147 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.147 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:22.147 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.605667+0000", 2024-09-17T02:21:22.147 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023371389999999998 2024-09-17T02:21:22.147 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.147 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.147 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.147 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.697612+0000", 2024-09-17T02:21:22.147 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.091944520000000002 2024-09-17T02:21:22.147 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.147 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.147 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:22.147 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.697708+0000", 2024-09-17T02:21:22.147 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6096999999999998e-05 2024-09-17T02:21:22.148 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.148 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.148 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:22.148 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.697776+0000", 2024-09-17T02:21:22.148 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7727999999999999e-05 2024-09-17T02:21:22.148 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.148 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:22.148 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.148 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.148 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.148 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:97771 5.9 5:918a4ce1:::benchmark_data_smithi001_23533_object97770:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:22.148 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.602798+0000", 2024-09-17T02:21:22.148 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.4347023170000002, 2024-09-17T02:21:22.149 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.091332647000000003, 2024-09-17T02:21:22.149 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:22.149 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:22.149 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.149 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:22.149 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:22.149 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:22.149 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 97771 2024-09-17T02:21:22.149 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.149 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:22.149 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.149 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:22.150 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.602798+0000", 2024-09-17T02:21:22.150 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.150 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.150 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.150 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:22.150 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.602798+0000", 2024-09-17T02:21:22.150 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.150 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.150 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.150 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:22.150 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.602798+0000", 2024-09-17T02:21:22.150 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4600000000000004e-07 2024-09-17T02:21:22.150 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.151 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.151 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:22.151 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.602877+0000", 2024-09-17T02:21:22.151 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8511999999999996e-05 2024-09-17T02:21:22.151 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.151 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.151 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:22.151 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.602886+0000", 2024-09-17T02:21:22.151 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.3689999999999996e-06 2024-09-17T02:21:22.151 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.151 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.151 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.151 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.602891+0000", 2024-09-17T02:21:22.151 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8250000000000004e-06 2024-09-17T02:21:22.152 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.152 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.152 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:22.152 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.602934+0000", 2024-09-17T02:21:22.152 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3025000000000002e-05 2024-09-17T02:21:22.152 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.152 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.152 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:22.152 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.603016+0000", 2024-09-17T02:21:22.152 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1718000000000006e-05 2024-09-17T02:21:22.152 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.152 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.152 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:22.152 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.603107+0000", 2024-09-17T02:21:22.153 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0588999999999996e-05 2024-09-17T02:21:22.153 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.153 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.153 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:22.153 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604720+0000", 2024-09-17T02:21:22.153 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001613831 2024-09-17T02:21:22.153 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.153 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.153 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.153 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.693951+0000", 2024-09-17T02:21:22.153 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.089231104000000006 2024-09-17T02:21:22.153 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.153 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.154 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:22.154 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.694054+0000", 2024-09-17T02:21:22.154 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000102446 2024-09-17T02:21:22.154 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.154 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.154 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:22.154 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.694130+0000", 2024-09-17T02:21:22.154 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6482000000000004e-05 2024-09-17T02:21:22.154 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.154 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:22.154 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.154 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.154 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.154 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:97772 5.3 5:c001bee5:::benchmark_data_smithi001_23533_object97771:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:22.155 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.604119+0000", 2024-09-17T02:21:22.155 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.4333814509999998, 2024-09-17T02:21:22.155 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.086607842000000004, 2024-09-17T02:21:22.155 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:22.155 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:22.155 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.155 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:22.155 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:22.155 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:22.155 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 97772 2024-09-17T02:21:22.155 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.155 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:22.155 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.156 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:22.156 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604119+0000", 2024-09-17T02:21:22.156 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.156 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.156 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.156 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:22.156 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604119+0000", 2024-09-17T02:21:22.156 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:22.156 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.156 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.156 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:22.156 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604119+0000", 2024-09-17T02:21:22.156 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.09e-07 2024-09-17T02:21:22.156 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.156 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.157 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:22.157 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604183+0000", 2024-09-17T02:21:22.157 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3659999999999997e-05 2024-09-17T02:21:22.157 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.157 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.157 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:22.157 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604195+0000", 2024-09-17T02:21:22.157 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1783999999999999e-05 2024-09-17T02:21:22.157 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.157 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.157 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.157 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604203+0000", 2024-09-17T02:21:22.157 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2390000000000002e-06 2024-09-17T02:21:22.158 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.158 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.158 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:22.158 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604256+0000", 2024-09-17T02:21:22.158 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3103000000000003e-05 2024-09-17T02:21:22.158 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.158 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.158 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:22.158 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604348+0000", 2024-09-17T02:21:22.158 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1837999999999997e-05 2024-09-17T02:21:22.158 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.158 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.159 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0,1", 2024-09-17T02:21:22.159 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604458+0000", 2024-09-17T02:21:22.159 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000110431 2024-09-17T02:21:22.159 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.159 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.159 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.159 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.606523+0000", 2024-09-17T02:21:22.159 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020649359999999999 2024-09-17T02:21:22.159 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.159 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.159 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:22.159 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.607160+0000", 2024-09-17T02:21:22.159 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00063626000000000004 2024-09-17T02:21:22.160 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.160 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.160 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.160 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690459+0000", 2024-09-17T02:21:22.160 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.083299629 2024-09-17T02:21:22.160 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.160 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.160 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:22.160 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690529+0000", 2024-09-17T02:21:22.160 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0203999999999994e-05 2024-09-17T02:21:22.160 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:22.160 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:22.160 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:22.161 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690726+0000", 2024-09-17T02:21:22.161 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000196949 2024-09-17T02:21:22.161 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.161 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:22.161 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.161 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:22.161 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:22.161 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:21:22.163 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:22.164 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:22.161+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:22.263 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:22.262+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:22.308 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:22.308 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:22.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.308 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:107044 5.9 e46/22 5:985e9e39:::benchmark_data_smithi001_23533_object107043:head v 46'6737, mlcod=46'6734)", 2024-09-17T02:21:22.308 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:22.310303+0000", 2024-09-17T02:21:22.308 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0023502380000000002, 2024-09-17T02:21:22.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002372037, 2024-09-17T02:21:22.308 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.308 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.308 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:22.308 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.310303+0000", 2024-09-17T02:21:22.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.310303+0000", 2024-09-17T02:21:22.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.310303+0000", 2024-09-17T02:21:22.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0500000000000004e-07 2024-09-17T02:21:22.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.310356+0000", 2024-09-17T02:21:22.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3242000000000003e-05 2024-09-17T02:21:22.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.310364+0000", 2024-09-17T02:21:22.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3010000000000001e-06 2024-09-17T02:21:22.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.310368+0000", 2024-09-17T02:21:22.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5700000000000003e-06 2024-09-17T02:21:22.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.310427+0000", 2024-09-17T02:21:22.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8316999999999997e-05 2024-09-17T02:21:22.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:22.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.310444+0000", 2024-09-17T02:21:22.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6905000000000002e-05 2024-09-17T02:21:22.311 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.311 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.312 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.312 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:107046 5.4 5:209d4f2e:::benchmark_data_smithi001_23533_object107045:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T02:21:22.312 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:22.311231+0000", 2024-09-17T02:21:22.312 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0014215670000000001, 2024-09-17T02:21:22.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015115619999999999, 2024-09-17T02:21:22.312 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.312 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.312 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:22.312 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:22.312 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:22.312 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:22.313 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 107046 2024-09-17T02:21:22.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.313 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.311231+0000", 2024-09-17T02:21:22.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.311231+0000", 2024-09-17T02:21:22.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.311233+0000", 2024-09-17T02:21:22.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.409e-06 2024-09-17T02:21:22.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.311348+0000", 2024-09-17T02:21:22.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115239 2024-09-17T02:21:22.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.311377+0000", 2024-09-17T02:21:22.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9456999999999999e-05 2024-09-17T02:21:22.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.311410+0000", 2024-09-17T02:21:22.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2598000000000002e-05 2024-09-17T02:21:22.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.312046+0000", 2024-09-17T02:21:22.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063613600000000004 2024-09-17T02:21:22.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:22.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.312255+0000", 2024-09-17T02:21:22.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000208278 2024-09-17T02:21:22.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:22.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.312474+0000", 2024-09-17T02:21:22.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021906599999999999 2024-09-17T02:21:22.316 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.316 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.316 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.317 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:107048 5.b 5:dabff10b:::benchmark_data_smithi001_23533_object107047:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T02:21:22.317 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:22.311427+0000", 2024-09-17T02:21:22.317 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0012259739999999999, 2024-09-17T02:21:22.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013904869999999999, 2024-09-17T02:21:22.317 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.317 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.317 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:22.317 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:22.317 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:22.317 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:22.318 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 107048 2024-09-17T02:21:22.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.318 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.311427+0000", 2024-09-17T02:21:22.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.311427+0000", 2024-09-17T02:21:22.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.311428+0000", 2024-09-17T02:21:22.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2099999999999996e-07 2024-09-17T02:21:22.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.311463+0000", 2024-09-17T02:21:22.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5871000000000003e-05 2024-09-17T02:21:22.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.311474+0000", 2024-09-17T02:21:22.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0057999999999999e-05 2024-09-17T02:21:22.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.311482+0000", 2024-09-17T02:21:22.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4290000000000001e-06 2024-09-17T02:21:22.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.311534+0000", 2024-09-17T02:21:22.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2088e-05 2024-09-17T02:21:22.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:22.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.311805+0000", 2024-09-17T02:21:22.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027104100000000002 2024-09-17T02:21:22.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:22.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.311974+0000", 2024-09-17T02:21:22.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000169357 2024-09-17T02:21:22.322 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.322 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.322 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.322 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:107045 5.a e46/22 5:50b008c2:::benchmark_data_smithi001_23533_object107044:head v 46'6752, mlcod=46'6749)", 2024-09-17T02:21:22.322 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:22.311519+0000", 2024-09-17T02:21:22.322 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0011337039999999999, 2024-09-17T02:21:22.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001365822, 2024-09-17T02:21:22.322 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.322 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.322 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:22.322 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.311519+0000", 2024-09-17T02:21:22.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.311519+0000", 2024-09-17T02:21:22.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.311520+0000", 2024-09-17T02:21:22.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6199999999999998e-07 2024-09-17T02:21:22.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.311710+0000", 2024-09-17T02:21:22.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000190361 2024-09-17T02:21:22.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.311718+0000", 2024-09-17T02:21:22.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7090000000000002e-06 2024-09-17T02:21:22.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.311723+0000", 2024-09-17T02:21:22.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5670000000000002e-06 2024-09-17T02:21:22.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.311776+0000", 2024-09-17T02:21:22.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2982000000000002e-05 2024-09-17T02:21:22.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:22.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.311795+0000", 2024-09-17T02:21:22.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8091e-05 2024-09-17T02:21:22.326 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.326 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.326 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.326 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:107047 5.3 e46/38 5:c41b436d:::benchmark_data_smithi001_23533_object107046:head v 46'6752, mlcod=46'6750)", 2024-09-17T02:21:22.327 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:22.312208+0000", 2024-09-17T02:21:22.327 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.000444998, 2024-09-17T02:21:22.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073284900000000004, 2024-09-17T02:21:22.327 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.327 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.327 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:22.327 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.312208+0000", 2024-09-17T02:21:22.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.312208+0000", 2024-09-17T02:21:22.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.312209+0000", 2024-09-17T02:21:22.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6199999999999998e-07 2024-09-17T02:21:22.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.312332+0000", 2024-09-17T02:21:22.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012303499999999999 2024-09-17T02:21:22.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.312343+0000", 2024-09-17T02:21:22.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0959e-05 2024-09-17T02:21:22.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.312348+0000", 2024-09-17T02:21:22.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9429999999999997e-06 2024-09-17T02:21:22.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.312392+0000", 2024-09-17T02:21:22.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3905000000000001e-05 2024-09-17T02:21:22.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:22.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.312463+0000", 2024-09-17T02:21:22.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1039999999999997e-05 2024-09-17T02:21:22.330 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.330 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.330 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.330 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:107031 5.e 5:747c72d8:::benchmark_data_smithi001_23533_object107030:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T02:21:22.331 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:22.303620+0000", 2024-09-17T02:21:22.331 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0090325509999999998, 2024-09-17T02:21:22.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0093809359999999994, 2024-09-17T02:21:22.331 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.331 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.331 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:22.331 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:22.331 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:22.331 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:22.331 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 107031 2024-09-17T02:21:22.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.331 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.303620+0000", 2024-09-17T02:21:22.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.303620+0000", 2024-09-17T02:21:22.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.303621+0000", 2024-09-17T02:21:22.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0800000000000004e-07 2024-09-17T02:21:22.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.303666+0000", 2024-09-17T02:21:22.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5221e-05 2024-09-17T02:21:22.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.303676+0000", 2024-09-17T02:21:22.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0052e-05 2024-09-17T02:21:22.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.303684+0000", 2024-09-17T02:21:22.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8229999999999995e-06 2024-09-17T02:21:22.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.305646+0000", 2024-09-17T02:21:22.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019622350000000001 2024-09-17T02:21:22.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:22.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.305813+0000", 2024-09-17T02:21:22.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000167038 2024-09-17T02:21:22.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:22.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.305949+0000", 2024-09-17T02:21:22.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135129 2024-09-17T02:21:22.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:22.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.309710+0000", 2024-09-17T02:21:22.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037613439999999998 2024-09-17T02:21:22.335 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.335 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.335 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.335 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:107035 5.e 5:718c619b:::benchmark_data_smithi001_23533_object107034:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T02:21:22.335 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:22.306181+0000", 2024-09-17T02:21:22.335 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0064716929999999997, 2024-09-17T02:21:22.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0068969269999999997, 2024-09-17T02:21:22.335 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.335 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.335 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:22.336 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:22.336 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:22.336 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:22.336 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 107035 2024-09-17T02:21:22.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.336 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.306181+0000", 2024-09-17T02:21:22.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.306181+0000", 2024-09-17T02:21:22.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.306182+0000", 2024-09-17T02:21:22.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.06e-06 2024-09-17T02:21:22.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.306312+0000", 2024-09-17T02:21:22.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000129524 2024-09-17T02:21:22.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.306326+0000", 2024-09-17T02:21:22.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4521e-05 2024-09-17T02:21:22.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.306335+0000", 2024-09-17T02:21:22.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1990000000000006e-06 2024-09-17T02:21:22.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.307637+0000", 2024-09-17T02:21:22.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001302304 2024-09-17T02:21:22.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:22.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.307756+0000", 2024-09-17T02:21:22.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011912 2024-09-17T02:21:22.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:22.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.307910+0000", 2024-09-17T02:21:22.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015423100000000001 2024-09-17T02:21:22.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:22.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.310977+0000", 2024-09-17T02:21:22.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030670939999999998 2024-09-17T02:21:22.339 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.339 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.339 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.340 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:107037 5.b 5:dfb6daf1:::benchmark_data_smithi001_23533_object107036:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T02:21:22.340 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:22.306349+0000", 2024-09-17T02:21:22.340 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0063036519999999999, 2024-09-17T02:21:22.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0068069330000000003, 2024-09-17T02:21:22.340 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.340 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.340 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:22.340 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:22.340 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:22.340 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:22.341 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 107037 2024-09-17T02:21:22.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.341 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.306349+0000", 2024-09-17T02:21:22.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.306349+0000", 2024-09-17T02:21:22.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.306350+0000", 2024-09-17T02:21:22.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5899999999999996e-07 2024-09-17T02:21:22.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.306385+0000", 2024-09-17T02:21:22.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5404999999999997e-05 2024-09-17T02:21:22.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.306395+0000", 2024-09-17T02:21:22.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7929999999999992e-06 2024-09-17T02:21:22.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.306402+0000", 2024-09-17T02:21:22.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7739999999999999e-06 2024-09-17T02:21:22.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.306510+0000", 2024-09-17T02:21:22.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108336 2024-09-17T02:21:22.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:22.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.306595+0000", 2024-09-17T02:21:22.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4685000000000007e-05 2024-09-17T02:21:22.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:22.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.306714+0000", 2024-09-17T02:21:22.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000119339 2024-09-17T02:21:22.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.310418+0000", 2024-09-17T02:21:22.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037032139999999998 2024-09-17T02:21:22.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:22.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:22.311090+0000", 2024-09-17T02:21:22.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067256900000000003 2024-09-17T02:21:22.345 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.345 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.345 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.345 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.345 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:21:22.345 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 8 2024-09-17T02:21:22.345 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:22.346 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:22.364 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:22.362+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:22.465 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:22.466+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:22.507 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:22.507 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:21:22.507 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:21:22.507 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:21:22.508 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:22.526 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:22.572 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:22.573+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:22.667 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:22.666+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:22.684 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:22.684 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:21:22.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:21:22.684 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:22.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.685 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:22.685 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:21:22.685 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 66.130286478000002, 2024-09-17T02:21:22.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035535028000000003, 2024-09-17T02:21:22.685 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.685 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.685 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.685 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:21:22.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:21:22.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556550+0000", 2024-09-17T02:21:22.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3500000000000001e-06 2024-09-17T02:21:22.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556566+0000", 2024-09-17T02:21:22.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5440000000000001e-05 2024-09-17T02:21:22.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556594+0000", 2024-09-17T02:21:22.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8552999999999999e-05 2024-09-17T02:21:22.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556618+0000", 2024-09-17T02:21:22.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3207e-05 2024-09-17T02:21:22.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578337+0000", 2024-09-17T02:21:22.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021719517000000001 2024-09-17T02:21:22.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:22.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578655+0000", 2024-09-17T02:21:22.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031837800000000002 2024-09-17T02:21:22.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:22.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.581374+0000", 2024-09-17T02:21:22.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002718238 2024-09-17T02:21:22.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:22.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587083+0000", 2024-09-17T02:21:22.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005708912 2024-09-17T02:21:22.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591823+0000", 2024-09-17T02:21:22.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047406080000000003 2024-09-17T02:21:22.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:22.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591972+0000", 2024-09-17T02:21:22.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014874199999999999 2024-09-17T02:21:22.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:22.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592082+0000", 2024-09-17T02:21:22.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110083 2024-09-17T02:21:22.691 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.691 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.691 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.692 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:22.692 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:21:22.692 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 66.129344990999996, 2024-09-17T02:21:22.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035128756999999997, 2024-09-17T02:21:22.692 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.692 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.692 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.692 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:21:22.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:21:22.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557491+0000", 2024-09-17T02:21:22.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.88e-06 2024-09-17T02:21:22.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557504+0000", 2024-09-17T02:21:22.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2864000000000001e-05 2024-09-17T02:21:22.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557535+0000", 2024-09-17T02:21:22.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0916e-05 2024-09-17T02:21:22.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557561+0000", 2024-09-17T02:21:22.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5602999999999999e-05 2024-09-17T02:21:22.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582290+0000", 2024-09-17T02:21:22.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024729729999999998 2024-09-17T02:21:22.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:22.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582642+0000", 2024-09-17T02:21:22.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035143499999999999 2024-09-17T02:21:22.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:22.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582959+0000", 2024-09-17T02:21:22.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031747399999999999 2024-09-17T02:21:22.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:22.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587302+0000", 2024-09-17T02:21:22.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043425169999999997 2024-09-17T02:21:22.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592391+0000", 2024-09-17T02:21:22.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050895799999999998 2024-09-17T02:21:22.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:22.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592516+0000", 2024-09-17T02:21:22.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012420500000000001 2024-09-17T02:21:22.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:22.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592617+0000", 2024-09-17T02:21:22.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010155299999999999 2024-09-17T02:21:22.698 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.698 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.698 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.699 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:22.699 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:21:22.699 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 66.129240491999994, 2024-09-17T02:21:22.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034796066, 2024-09-17T02:21:22.699 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.699 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.699 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.699 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:21:22.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:21:22.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557594+0000", 2024-09-17T02:21:22.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3769999999999999e-06 2024-09-17T02:21:22.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557683+0000", 2024-09-17T02:21:22.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8896999999999999e-05 2024-09-17T02:21:22.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557707+0000", 2024-09-17T02:21:22.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3839e-05 2024-09-17T02:21:22.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557730+0000", 2024-09-17T02:21:22.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3047000000000001e-05 2024-09-17T02:21:22.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582329+0000", 2024-09-17T02:21:22.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024599283999999999 2024-09-17T02:21:22.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:22.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582624+0000", 2024-09-17T02:21:22.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000294462 2024-09-17T02:21:22.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:22.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582936+0000", 2024-09-17T02:21:22.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031223399999999999 2024-09-17T02:21:22.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:22.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587347+0000", 2024-09-17T02:21:22.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044110340000000003 2024-09-17T02:21:22.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592165+0000", 2024-09-17T02:21:22.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048176699999999996 2024-09-17T02:21:22.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:22.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592311+0000", 2024-09-17T02:21:22.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014661899999999999 2024-09-17T02:21:22.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:22.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592389+0000", 2024-09-17T02:21:22.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7602999999999995e-05 2024-09-17T02:21:22.705 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.705 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.706 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.706 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:22.706 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:21:22.706 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 66.128722865, 2024-09-17T02:21:22.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034457472000000003, 2024-09-17T02:21:22.706 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.706 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.706 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.706 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:21:22.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:21:22.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558113+0000", 2024-09-17T02:21:22.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1639999999999999e-06 2024-09-17T02:21:22.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558125+0000", 2024-09-17T02:21:22.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2269999999999999e-05 2024-09-17T02:21:22.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558458+0000", 2024-09-17T02:21:22.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033322700000000001 2024-09-17T02:21:22.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558488+0000", 2024-09-17T02:21:22.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.951e-05 2024-09-17T02:21:22.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584514+0000", 2024-09-17T02:21:22.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026025721000000002 2024-09-17T02:21:22.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:22.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584781+0000", 2024-09-17T02:21:22.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000267142 2024-09-17T02:21:22.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:22.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585078+0000", 2024-09-17T02:21:22.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029738799999999999 2024-09-17T02:21:22.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:22.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588045+0000", 2024-09-17T02:21:22.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029673759999999999 2024-09-17T02:21:22.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592454+0000", 2024-09-17T02:21:22.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044090209999999999 2024-09-17T02:21:22.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:22.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592520+0000", 2024-09-17T02:21:22.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6032999999999996e-05 2024-09-17T02:21:22.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:22.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592568+0000", 2024-09-17T02:21:22.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7620000000000001e-05 2024-09-17T02:21:22.712 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.712 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.712 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.712 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:22.713 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:21:22.713 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 66.128081398999996, 2024-09-17T02:21:22.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034114029999999997, 2024-09-17T02:21:22.713 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.713 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.713 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.713 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:21:22.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:21:22.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558753+0000", 2024-09-17T02:21:22.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2699999999999999e-06 2024-09-17T02:21:22.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558769+0000", 2024-09-17T02:21:22.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5906e-05 2024-09-17T02:21:22.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558791+0000", 2024-09-17T02:21:22.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1342999999999999e-05 2024-09-17T02:21:22.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558806+0000", 2024-09-17T02:21:22.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5829999999999999e-05 2024-09-17T02:21:22.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584906+0000", 2024-09-17T02:21:22.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026099273999999999 2024-09-17T02:21:22.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:22.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585158+0000", 2024-09-17T02:21:22.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025194600000000002 2024-09-17T02:21:22.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:22.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585368+0000", 2024-09-17T02:21:22.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210068 2024-09-17T02:21:22.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:22.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588098+0000", 2024-09-17T02:21:22.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002730522 2024-09-17T02:21:22.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592680+0000", 2024-09-17T02:21:22.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045816019999999997 2024-09-17T02:21:22.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:22.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592774+0000", 2024-09-17T02:21:22.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3726000000000004e-05 2024-09-17T02:21:22.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:22.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592866+0000", 2024-09-17T02:21:22.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2542999999999998e-05 2024-09-17T02:21:22.719 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.719 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.719 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.720 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28720 5.f e28/22 5:f8a7aea5:::benchmark_data_smithi001_23533_object28719:head v 28'1756, mlcod=28'1754)", 2024-09-17T02:21:22.720 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:21:22.720 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.116713599000001, 2024-09-17T02:21:22.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033308717000000002, 2024-09-17T02:21:22.720 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.720 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.720 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.720 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:21:22.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:21:22.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570121+0000", 2024-09-17T02:21:22.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4e-07 2024-09-17T02:21:22.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570208+0000", 2024-09-17T02:21:22.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6945000000000002e-05 2024-09-17T02:21:22.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570222+0000", 2024-09-17T02:21:22.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4541e-05 2024-09-17T02:21:22.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570232+0000", 2024-09-17T02:21:22.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3039999999999994e-06 2024-09-17T02:21:22.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570273+0000", 2024-09-17T02:21:22.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1950999999999999e-05 2024-09-17T02:21:22.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:22.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570286+0000", 2024-09-17T02:21:22.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2268e-05 2024-09-17T02:21:22.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:22.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603312+0000", 2024-09-17T02:21:22.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033026405000000002 2024-09-17T02:21:22.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:22.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603429+0000", 2024-09-17T02:21:22.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116463 2024-09-17T02:21:22.725 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.725 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.725 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.726 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28721 5.a e28/22 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head v 28'1872, mlcod=28'1869)", 2024-09-17T02:21:22.726 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:21:22.726 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.116570093, 2024-09-17T02:21:22.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033539817999999999, 2024-09-17T02:21:22.726 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.726 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.726 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.726 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:21:22.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:21:22.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570264+0000", 2024-09-17T02:21:22.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0999999999999997e-07 2024-09-17T02:21:22.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570299+0000", 2024-09-17T02:21:22.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4876999999999998e-05 2024-09-17T02:21:22.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570310+0000", 2024-09-17T02:21:22.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0958000000000001e-05 2024-09-17T02:21:22.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570316+0000", 2024-09-17T02:21:22.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.485e-06 2024-09-17T02:21:22.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598947+0000", 2024-09-17T02:21:22.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.028631058000000001 2024-09-17T02:21:22.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:22.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598969+0000", 2024-09-17T02:21:22.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2005999999999999e-05 2024-09-17T02:21:22.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:22.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.602638+0000", 2024-09-17T02:21:22.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036690339999999998 2024-09-17T02:21:22.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:22.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603803+0000", 2024-09-17T02:21:22.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00116559 2024-09-17T02:21:22.730 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.730 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.731 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.731 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97749 5.b 5:d930ef52:::benchmark_data_smithi001_23533_object97748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:22.731 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:22.731 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.0948871789999997, 2024-09-17T02:21:22.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092964343000000005, 2024-09-17T02:21:22.731 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.731 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.731 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.732 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:22.732 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:22.732 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:22.732 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97749 2024-09-17T02:21:22.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.732 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:22.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:22.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591947+0000", 2024-09-17T02:21:22.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:21:22.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592011+0000", 2024-09-17T02:21:22.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3608000000000005e-05 2024-09-17T02:21:22.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592021+0000", 2024-09-17T02:21:22.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9979999999999998e-06 2024-09-17T02:21:22.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592028+0000", 2024-09-17T02:21:22.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1439999999999997e-06 2024-09-17T02:21:22.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593633+0000", 2024-09-17T02:21:22.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001604636 2024-09-17T02:21:22.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:22.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593757+0000", 2024-09-17T02:21:22.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012432099999999999 2024-09-17T02:21:22.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:22.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593866+0000", 2024-09-17T02:21:22.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109094 2024-09-17T02:21:22.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:22.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601190+0000", 2024-09-17T02:21:22.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073237620000000002 2024-09-17T02:21:22.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601356+0000", 2024-09-17T02:21:22.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016651900000000001 2024-09-17T02:21:22.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684618+0000", 2024-09-17T02:21:22.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083261356999999994 2024-09-17T02:21:22.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:22.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684724+0000", 2024-09-17T02:21:22.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010681800000000001 2024-09-17T02:21:22.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:22.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684911+0000", 2024-09-17T02:21:22.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186243 2024-09-17T02:21:22.738 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.738 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.738 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.738 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97752 5.b 5:d146f486:::benchmark_data_smithi001_23533_object97751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:22.738 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:22.738 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.0935344850000002, 2024-09-17T02:21:22.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091989557, 2024-09-17T02:21:22.739 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.739 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.739 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.739 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:22.739 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:22.739 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:22.739 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97752 2024-09-17T02:21:22.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.739 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:22.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:22.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593300+0000", 2024-09-17T02:21:22.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8199999999999998e-07 2024-09-17T02:21:22.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593364+0000", 2024-09-17T02:21:22.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3831999999999995e-05 2024-09-17T02:21:22.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593376+0000", 2024-09-17T02:21:22.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1800999999999999e-05 2024-09-17T02:21:22.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593382+0000", 2024-09-17T02:21:22.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6780000000000003e-06 2024-09-17T02:21:22.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595491+0000", 2024-09-17T02:21:22.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021090689999999999 2024-09-17T02:21:22.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:22.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595614+0000", 2024-09-17T02:21:22.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012321500000000001 2024-09-17T02:21:22.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:22.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595778+0000", 2024-09-17T02:21:22.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016321900000000001 2024-09-17T02:21:22.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:22.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601197+0000", 2024-09-17T02:21:22.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054195600000000003 2024-09-17T02:21:22.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601396+0000", 2024-09-17T02:21:22.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019825299999999999 2024-09-17T02:21:22.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684990+0000", 2024-09-17T02:21:22.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083594878999999997 2024-09-17T02:21:22.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:22.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685116+0000", 2024-09-17T02:21:22.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012522799999999999 2024-09-17T02:21:22.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:22.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685289+0000", 2024-09-17T02:21:22.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172941 2024-09-17T02:21:22.746 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.746 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.746 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.746 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97754 5.b 5:da0615e5:::benchmark_data_smithi001_23533_object97753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:22.746 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:22.746 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.0918965629999997, 2024-09-17T02:21:22.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092097207, 2024-09-17T02:21:22.747 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.747 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.747 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.747 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:22.747 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:22.747 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:22.747 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97754 2024-09-17T02:21:22.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.747 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:22.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:22.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594938+0000", 2024-09-17T02:21:22.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5000000000000002e-07 2024-09-17T02:21:22.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595075+0000", 2024-09-17T02:21:22.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137742 2024-09-17T02:21:22.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595087+0000", 2024-09-17T02:21:22.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1243000000000001e-05 2024-09-17T02:21:22.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595095+0000", 2024-09-17T02:21:22.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1030000000000002e-06 2024-09-17T02:21:22.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598461+0000", 2024-09-17T02:21:22.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033661170000000001 2024-09-17T02:21:22.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:22.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598540+0000", 2024-09-17T02:21:22.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8937999999999995e-05 2024-09-17T02:21:22.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:22.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598626+0000", 2024-09-17T02:21:22.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6042000000000001e-05 2024-09-17T02:21:22.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:22.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684258+0000", 2024-09-17T02:21:22.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085632394000000001 2024-09-17T02:21:22.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685369+0000", 2024-09-17T02:21:22.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001111063 2024-09-17T02:21:22.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685511+0000", 2024-09-17T02:21:22.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141965 2024-09-17T02:21:22.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:22.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685604+0000", 2024-09-17T02:21:22.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2935000000000004e-05 2024-09-17T02:21:22.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:22.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687034+0000", 2024-09-17T02:21:22.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001430015 2024-09-17T02:21:22.754 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.754 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.755 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.755 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97755 5.b 5:d36a03a1:::benchmark_data_smithi001_23533_object97754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:22.755 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:22.755 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.0917234130000004, 2024-09-17T02:21:22.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0924904, 2024-09-17T02:21:22.755 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.755 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.755 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.755 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:22.756 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:22.756 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:22.756 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97755 2024-09-17T02:21:22.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.756 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:22.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:22.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595111+0000", 2024-09-17T02:21:22.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:21:22.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595145+0000", 2024-09-17T02:21:22.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3927000000000002e-05 2024-09-17T02:21:22.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595155+0000", 2024-09-17T02:21:22.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0023e-05 2024-09-17T02:21:22.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595162+0000", 2024-09-17T02:21:22.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3950000000000003e-06 2024-09-17T02:21:22.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599821+0000", 2024-09-17T02:21:22.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046592880000000001 2024-09-17T02:21:22.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:22.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599912+0000", 2024-09-17T02:21:22.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1049000000000002e-05 2024-09-17T02:21:22.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:22.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600062+0000", 2024-09-17T02:21:22.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015001700000000001 2024-09-17T02:21:22.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:22.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685307+0000", 2024-09-17T02:21:22.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085244340000000002 2024-09-17T02:21:22.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685446+0000", 2024-09-17T02:21:22.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013955700000000001 2024-09-17T02:21:22.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687375+0000", 2024-09-17T02:21:22.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019291079999999999 2024-09-17T02:21:22.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:22.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687462+0000", 2024-09-17T02:21:22.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6148000000000003e-05 2024-09-17T02:21:22.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:22.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687600+0000", 2024-09-17T02:21:22.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013887900000000001 2024-09-17T02:21:22.762 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.762 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.762 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.763 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPush(5.3 44/38 [PushOp(5:c45b310d:::benchmark_data_smithi001_23533_object73736:head, version: 39'4672, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(5:c45b310d:::benchmark_data_smithi001_23533_object73736:head@39'4672, size: 65536, copy_subset: [(0, 65536)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 65536, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-17T02:21:22.763 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597100+0000", 2024-09-17T02:21:22.763 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.0897332930000001, 2024-09-17T02:21:22.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.089325374999999999, 2024-09-17T02:21:22.763 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.763 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.763 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:22.763 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597100+0000", 2024-09-17T02:21:22.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597100+0000", 2024-09-17T02:21:22.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597101+0000", 2024-09-17T02:21:22.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4899999999999995e-07 2024-09-17T02:21:22.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597155+0000", 2024-09-17T02:21:22.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4466999999999999e-05 2024-09-17T02:21:22.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597174+0000", 2024-09-17T02:21:22.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8393000000000002e-05 2024-09-17T02:21:22.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597189+0000", 2024-09-17T02:21:22.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5716999999999999e-05 2024-09-17T02:21:22.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684442+0000", 2024-09-17T02:21:22.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.087252918999999998 2024-09-17T02:21:22.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:22.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684479+0000", 2024-09-17T02:21:22.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6902e-05 2024-09-17T02:21:22.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:22.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.686426+0000", 2024-09-17T02:21:22.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001946328 2024-09-17T02:21:22.768 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.768 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.768 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.768 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 44/44 lb 5:c4567a04:::benchmark_data_smithi001_23533_object4200:head)", 2024-09-17T02:21:22.768 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:22.768 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.0896267870000003, 2024-09-17T02:21:22.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092483421999999996, 2024-09-17T02:21:22.769 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.769 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.769 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:22.769 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:22.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:22.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:22.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6399999999999998e-07 2024-09-17T02:21:22.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597213+0000", 2024-09-17T02:21:22.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3659999999999997e-06 2024-09-17T02:21:22.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597222+0000", 2024-09-17T02:21:22.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0510000000000002e-06 2024-09-17T02:21:22.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597228+0000", 2024-09-17T02:21:22.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1569999999999999e-06 2024-09-17T02:21:22.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689588+0000", 2024-09-17T02:21:22.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092359931000000006 2024-09-17T02:21:22.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:22.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689622+0000", 2024-09-17T02:21:22.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4425999999999999e-05 2024-09-17T02:21:22.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:22.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689690+0000", 2024-09-17T02:21:22.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8126999999999993e-05 2024-09-17T02:21:22.773 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.773 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.773 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.773 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:97759 5.a e44/22 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head v 44'6175, mlcod=44'6173)", 2024-09-17T02:21:22.774 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.599333+0000", 2024-09-17T02:21:22.774 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.0875005670000002, 2024-09-17T02:21:22.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088908582, 2024-09-17T02:21:22.774 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.774 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.774 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.774 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599333+0000", 2024-09-17T02:21:22.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599333+0000", 2024-09-17T02:21:22.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599334+0000", 2024-09-17T02:21:22.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6700000000000003e-07 2024-09-17T02:21:22.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599503+0000", 2024-09-17T02:21:22.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0001693 2024-09-17T02:21:22.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599510+0000", 2024-09-17T02:21:22.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0469999999999996e-06 2024-09-17T02:21:22.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599514+0000", 2024-09-17T02:21:22.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0069999999999999e-06 2024-09-17T02:21:22.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599559+0000", 2024-09-17T02:21:22.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4697999999999998e-05 2024-09-17T02:21:22.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:22.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599570+0000", 2024-09-17T02:21:22.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1042e-05 2024-09-17T02:21:22.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:22.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.688181+0000", 2024-09-17T02:21:22.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088611756999999999 2024-09-17T02:21:22.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:22.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.688242+0000", 2024-09-17T02:21:22.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0064e-05 2024-09-17T02:21:22.779 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.779 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.779 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.779 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97762 5.4 5:2c64abcd:::benchmark_data_smithi001_23533_object97761:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:22.779 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.599394+0000", 2024-09-17T02:21:22.779 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.0874390319999998, 2024-09-17T02:21:22.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088655857000000005, 2024-09-17T02:21:22.780 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.780 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.780 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.780 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:22.780 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:22.780 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:22.780 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97762 2024-09-17T02:21:22.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.780 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599394+0000", 2024-09-17T02:21:22.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599394+0000", 2024-09-17T02:21:22.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599395+0000", 2024-09-17T02:21:22.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.85e-07 2024-09-17T02:21:22.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599442+0000", 2024-09-17T02:21:22.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6964e-05 2024-09-17T02:21:22.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599454+0000", 2024-09-17T02:21:22.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1841999999999999e-05 2024-09-17T02:21:22.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599459+0000", 2024-09-17T02:21:22.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1000000000000003e-06 2024-09-17T02:21:22.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599511+0000", 2024-09-17T02:21:22.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1814999999999998e-05 2024-09-17T02:21:22.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:22.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599627+0000", 2024-09-17T02:21:22.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116087 2024-09-17T02:21:22.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:22.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599716+0000", 2024-09-17T02:21:22.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9174999999999999e-05 2024-09-17T02:21:22.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687757+0000", 2024-09-17T02:21:22.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088040361999999997 2024-09-17T02:21:22.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:22.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687778+0000", 2024-09-17T02:21:22.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1229e-05 2024-09-17T02:21:22.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:22.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687833+0000", 2024-09-17T02:21:22.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4928e-05 2024-09-17T02:21:22.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:22.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687916+0000", 2024-09-17T02:21:22.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3175000000000002e-05 2024-09-17T02:21:22.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:22.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.688050+0000", 2024-09-17T02:21:22.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013429499999999999 2024-09-17T02:21:22.788 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.788 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.788 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.788 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPushReply(5.4 44/36 [PushReplyOp(5:291a38c7:::benchmark_data_smithi001_23533_object22817:head)])", 2024-09-17T02:21:22.788 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.599945+0000", 2024-09-17T02:21:22.788 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.086888268, 2024-09-17T02:21:22.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.084468808000000006, 2024-09-17T02:21:22.789 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.789 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.789 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-17T02:21:22.789 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599945+0000", 2024-09-17T02:21:22.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599945+0000", 2024-09-17T02:21:22.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599945+0000", 2024-09-17T02:21:22.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1e-07 2024-09-17T02:21:22.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599949+0000", 2024-09-17T02:21:22.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2849999999999999e-06 2024-09-17T02:21:22.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599956+0000", 2024-09-17T02:21:22.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3640000000000001e-06 2024-09-17T02:21:22.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599962+0000", 2024-09-17T02:21:22.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2360000000000001e-06 2024-09-17T02:21:22.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601282+0000", 2024-09-17T02:21:22.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001319808 2024-09-17T02:21:22.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:22.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684414+0000", 2024-09-17T02:21:22.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083131905000000006 2024-09-17T02:21:22.793 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.793 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.796 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.797 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:97761 5.9 e44/22 5:908717b6:::benchmark_data_smithi001_23533_object97760:head v 44'6129, mlcod=44'6125)", 2024-09-17T02:21:22.797 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.599983+0000", 2024-09-17T02:21:22.797 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.0868504799999998, 2024-09-17T02:21:22.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091911272000000002, 2024-09-17T02:21:22.797 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.797 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.797 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:22.797 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599983+0000", 2024-09-17T02:21:22.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599983+0000", 2024-09-17T02:21:22.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599983+0000", 2024-09-17T02:21:22.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1100000000000002e-07 2024-09-17T02:21:22.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600085+0000", 2024-09-17T02:21:22.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102007 2024-09-17T02:21:22.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600094+0000", 2024-09-17T02:21:22.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1850000000000004e-06 2024-09-17T02:21:22.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600099+0000", 2024-09-17T02:21:22.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6640000000000003e-06 2024-09-17T02:21:22.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600140+0000", 2024-09-17T02:21:22.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0998999999999998e-05 2024-09-17T02:21:22.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:22.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600157+0000", 2024-09-17T02:21:22.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7122999999999999e-05 2024-09-17T02:21:22.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:22.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.691795+0000", 2024-09-17T02:21:22.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091638002999999996 2024-09-17T02:21:22.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:22.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.691894+0000", 2024-09-17T02:21:22.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8980000000000004e-05 2024-09-17T02:21:22.802 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.802 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.802 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.802 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:97749 5.b e44/38 ondisk, result = 0)", 2024-09-17T02:21:22.802 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.600115+0000", 2024-09-17T02:21:22.802 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.0867184869999997, 2024-09-17T02:21:22.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.084148770999999997, 2024-09-17T02:21:22.802 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.802 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.802 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:22.803 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600115+0000", 2024-09-17T02:21:22.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600115+0000", 2024-09-17T02:21:22.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600115+0000", 2024-09-17T02:21:22.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.39e-07 2024-09-17T02:21:22.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600119+0000", 2024-09-17T02:21:22.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3060000000000002e-06 2024-09-17T02:21:22.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600125+0000", 2024-09-17T02:21:22.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3330000000000002e-06 2024-09-17T02:21:22.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600130+0000", 2024-09-17T02:21:22.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8999999999999997e-06 2024-09-17T02:21:22.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601349+0000", 2024-09-17T02:21:22.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012192209999999999 2024-09-17T02:21:22.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:22.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601353+0000", 2024-09-17T02:21:22.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9149999999999998e-06 2024-09-17T02:21:22.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:22.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684264+0000", 2024-09-17T02:21:22.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.082910757000000002 2024-09-17T02:21:22.807 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.807 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.807 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.807 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:97754 5.b e44/38 ondisk, result = 0)", 2024-09-17T02:21:22.807 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.601431+0000", 2024-09-17T02:21:22.807 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.0854023310000001, 2024-09-17T02:21:22.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085620499000000003, 2024-09-17T02:21:22.807 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.807 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.808 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:22.808 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601431+0000", 2024-09-17T02:21:22.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601431+0000", 2024-09-17T02:21:22.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601432+0000", 2024-09-17T02:21:22.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8400000000000004e-07 2024-09-17T02:21:22.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601435+0000", 2024-09-17T02:21:22.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9969999999999999e-06 2024-09-17T02:21:22.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684720+0000", 2024-09-17T02:21:22.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083285740999999996 2024-09-17T02:21:22.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684750+0000", 2024-09-17T02:21:22.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9632999999999999e-05 2024-09-17T02:21:22.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685492+0000", 2024-09-17T02:21:22.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00074159699999999998 2024-09-17T02:21:22.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:22.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685503+0000", 2024-09-17T02:21:22.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1294999999999999e-05 2024-09-17T02:21:22.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:22.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687052+0000", 2024-09-17T02:21:22.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001548652 2024-09-17T02:21:22.812 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.812 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.812 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.812 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:97749 5.b e44/38 ondisk, result = 0)", 2024-09-17T02:21:22.812 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.601857+0000", 2024-09-17T02:21:22.812 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.0849768800000001, 2024-09-17T02:21:22.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083064447999999999, 2024-09-17T02:21:22.812 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:22.813 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:22.813 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:22.813 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:22.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:22.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601857+0000", 2024-09-17T02:21:22.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:22.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601857+0000", 2024-09-17T02:21:22.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:22.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:22.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601857+0000", 2024-09-17T02:21:22.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5799999999999999e-07 2024-09-17T02:21:22.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:22.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601862+0000", 2024-09-17T02:21:22.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1900000000000003e-06 2024-09-17T02:21:22.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:22.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684426+0000", 2024-09-17T02:21:22.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.082564018000000003 2024-09-17T02:21:22.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684443+0000", 2024-09-17T02:21:22.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6986e-05 2024-09-17T02:21:22.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:22.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684592+0000", 2024-09-17T02:21:22.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000148818 2024-09-17T02:21:22.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:22.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684607+0000", 2024-09-17T02:21:22.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5033e-05 2024-09-17T02:21:22.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:22.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:22.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:22.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684921+0000", 2024-09-17T02:21:22.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031374499999999999 2024-09-17T02:21:22.817 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.817 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.817 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.817 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:22.817 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:22.817 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:22.818 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 50 16 108037 108021 135.011 128.438 0.00401153 0.00740226 2024-09-17T02:21:22.819 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:22.818+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:22.819 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:22.919 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:22.918+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:22.974 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:22.974 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:22.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.974 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:108432 5.e e46/22 5:7c7e1801:::benchmark_data_smithi001_23533_object108431:head v 46'6806, mlcod=46'6801)", 2024-09-17T02:21:22.974 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:22.977857+0000", 2024-09-17T02:21:22.974 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0014293660000000001, 2024-09-17T02:21:22.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014512769999999999, 2024-09-17T02:21:22.975 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:22.975 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:22.975 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:22.975 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:22.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:22.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:22.977857+0000", 2024-09-17T02:21:22.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:22.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:22.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:22.977857+0000", 2024-09-17T02:21:22.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:22.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:22.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:22.977858+0000", 2024-09-17T02:21:22.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9100000000000004e-07 2024-09-17T02:21:22.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:22.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:22.977930+0000", 2024-09-17T02:21:22.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2223000000000003e-05 2024-09-17T02:21:22.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:22.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:22.977938+0000", 2024-09-17T02:21:22.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2530000000000004e-06 2024-09-17T02:21:22.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:22.977943+0000", 2024-09-17T02:21:22.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6110000000000004e-06 2024-09-17T02:21:22.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:22.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:22.977986+0000", 2024-09-17T02:21:22.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3387999999999999e-05 2024-09-17T02:21:22.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:22.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:22.978004+0000", 2024-09-17T02:21:22.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7555999999999999e-05 2024-09-17T02:21:22.978 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:22.978 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:22.978 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:22.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.978 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:108434 5.8 5:11fbe234:::benchmark_data_smithi001_23533_object108433:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T02:21:22.978 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:22.978249+0000", 2024-09-17T02:21:22.979 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001037456, 2024-09-17T02:21:22.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011014550000000001, 2024-09-17T02:21:22.979 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:22.979 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:22.979 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:22.979 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:22.979 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:22.979 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:22.979 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 108434 2024-09-17T02:21:22.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.979 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:22.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:22.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:22.978249+0000", 2024-09-17T02:21:22.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:22.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:22.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:22.978249+0000", 2024-09-17T02:21:22.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:22.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:22.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:22.978250+0000", 2024-09-17T02:21:22.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1209999999999999e-06 2024-09-17T02:21:22.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:22.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:22.978312+0000", 2024-09-17T02:21:22.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2143000000000005e-05 2024-09-17T02:21:22.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:22.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:22.978324+0000", 2024-09-17T02:21:22.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1525999999999999e-05 2024-09-17T02:21:22.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:22.978331+0000", 2024-09-17T02:21:22.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9489999999999999e-06 2024-09-17T02:21:22.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:22.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:22.978383+0000", 2024-09-17T02:21:22.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2556999999999998e-05 2024-09-17T02:21:22.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:22.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:22.978481+0000", 2024-09-17T02:21:22.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7150000000000003e-05 2024-09-17T02:21:22.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:22.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:22.978565+0000", 2024-09-17T02:21:22.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4299e-05 2024-09-17T02:21:22.983 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:22.983 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:22.983 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:22.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.984 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:108425 5.6 5:6e89c057:::benchmark_data_smithi001_23533_object108424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T02:21:22.984 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:22.973296+0000", 2024-09-17T02:21:22.984 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0059902840000000002, 2024-09-17T02:21:22.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0061309629999999997, 2024-09-17T02:21:22.984 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:22.984 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:22.984 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:22.984 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:22.984 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:22.984 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:22.985 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 108425 2024-09-17T02:21:22.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.985 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:22.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:22.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:22.973296+0000", 2024-09-17T02:21:22.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:22.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:22.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:22.973296+0000", 2024-09-17T02:21:22.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:22.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:22.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:22.973297+0000", 2024-09-17T02:21:22.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.09e-07 2024-09-17T02:21:22.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:22.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:22.973350+0000", 2024-09-17T02:21:22.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2336999999999997e-05 2024-09-17T02:21:22.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:22.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:22.973358+0000", 2024-09-17T02:21:22.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7509999999999997e-06 2024-09-17T02:21:22.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:22.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:22.973363+0000", 2024-09-17T02:21:22.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7670000000000003e-06 2024-09-17T02:21:22.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:22.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:22.973398+0000", 2024-09-17T02:21:22.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5349999999999999e-05 2024-09-17T02:21:22.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:22.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:22.973494+0000", 2024-09-17T02:21:22.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5878999999999995e-05 2024-09-17T02:21:22.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:22.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:22.973578+0000", 2024-09-17T02:21:22.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3857999999999996e-05 2024-09-17T02:21:22.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:22.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:22.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:22.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:22.979075+0000", 2024-09-17T02:21:22.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0054968439999999999 2024-09-17T02:21:22.989 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:22.989 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:22.989 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:22.989 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:22.989 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:21:22.989 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 3 2024-09-17T02:21:22.989 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:22.994 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:23.019 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:23.021+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:23.121 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:23.122+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:23.184 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:23.184 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:21:23.184 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:21:23.184 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:21:23.184 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:23.206 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:23.251 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:23.254+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:23.285 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T02:21:23.324 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:23.326+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:23.363 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:23.363 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:21:23.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:21:23.363 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:23.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.363 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:23.363 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:21:23.363 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.804226725999996, 2024-09-17T02:21:23.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022056035000000002, 2024-09-17T02:21:23.363 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:23.364 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:23.364 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:23.364 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:23.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:23.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:21:23.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:23.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:21:23.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:23.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562132+0000", 2024-09-17T02:21:23.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6300000000000001e-06 2024-09-17T02:21:23.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:23.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562142+0000", 2024-09-17T02:21:23.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.022e-05 2024-09-17T02:21:23.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:23.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562164+0000", 2024-09-17T02:21:23.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2002999999999999e-05 2024-09-17T02:21:23.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562180+0000", 2024-09-17T02:21:23.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5930000000000002e-05 2024-09-17T02:21:23.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:23.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563517+0000", 2024-09-17T02:21:23.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001336776 2024-09-17T02:21:23.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:23.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563635+0000", 2024-09-17T02:21:23.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117976 2024-09-17T02:21:23.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:23.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563819+0000", 2024-09-17T02:21:23.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018411499999999999 2024-09-17T02:21:23.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:23.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566977+0000", 2024-09-17T02:21:23.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031575990000000001 2024-09-17T02:21:23.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:23.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583917+0000", 2024-09-17T02:21:23.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016940093999999999 2024-09-17T02:21:23.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:23.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584066+0000", 2024-09-17T02:21:23.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000149746 2024-09-17T02:21:23.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:23.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584186+0000", 2024-09-17T02:21:23.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011994600000000001 2024-09-17T02:21:23.369 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.369 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:23.369 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.369 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:23.369 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:23.369 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.804046014999997, 2024-09-17T02:21:23.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023664803000000002, 2024-09-17T02:21:23.369 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:23.369 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:23.369 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:23.369 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:23.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:23.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:23.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:23.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:23.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:23.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562313+0000", 2024-09-17T02:21:23.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.764e-06 2024-09-17T02:21:23.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:23.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562323+0000", 2024-09-17T02:21:23.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0166000000000001e-05 2024-09-17T02:21:23.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:23.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562343+0000", 2024-09-17T02:21:23.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9633999999999999e-05 2024-09-17T02:21:23.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562367+0000", 2024-09-17T02:21:23.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4556e-05 2024-09-17T02:21:23.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:23.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563777+0000", 2024-09-17T02:21:23.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014102330000000001 2024-09-17T02:21:23.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:23.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563969+0000", 2024-09-17T02:21:23.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000191361 2024-09-17T02:21:23.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:23.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564148+0000", 2024-09-17T02:21:23.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017934599999999999 2024-09-17T02:21:23.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:23.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566989+0000", 2024-09-17T02:21:23.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028407010000000002 2024-09-17T02:21:23.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:23.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585770+0000", 2024-09-17T02:21:23.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018781566999999999 2024-09-17T02:21:23.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:23.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585874+0000", 2024-09-17T02:21:23.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103489 2024-09-17T02:21:23.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:23.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585976+0000", 2024-09-17T02:21:23.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101986 2024-09-17T02:21:23.374 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.374 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:23.374 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.375 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:23.375 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:23.375 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.803963135000004, 2024-09-17T02:21:23.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024118555999999999, 2024-09-17T02:21:23.375 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:23.375 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:23.375 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:23.375 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:23.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:23.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:23.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:23.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:23.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:23.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562395+0000", 2024-09-17T02:21:23.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3969999999999999e-06 2024-09-17T02:21:23.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:23.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562405+0000", 2024-09-17T02:21:23.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4229999999999994e-06 2024-09-17T02:21:23.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:23.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562427+0000", 2024-09-17T02:21:23.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759999999999998e-05 2024-09-17T02:21:23.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562444+0000", 2024-09-17T02:21:23.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7019000000000001e-05 2024-09-17T02:21:23.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:23.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564681+0000", 2024-09-17T02:21:23.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022376929999999998 2024-09-17T02:21:23.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:23.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564887+0000", 2024-09-17T02:21:23.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000206178 2024-09-17T02:21:23.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:23.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565230+0000", 2024-09-17T02:21:23.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034233499999999998 2024-09-17T02:21:23.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:23.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567000+0000", 2024-09-17T02:21:23.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017706390000000001 2024-09-17T02:21:23.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:23.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586126+0000", 2024-09-17T02:21:23.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019125672 2024-09-17T02:21:23.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:23.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586314+0000", 2024-09-17T02:21:23.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018740200000000001 2024-09-17T02:21:23.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:23.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586513+0000", 2024-09-17T02:21:23.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019903799999999999 2024-09-17T02:21:23.380 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.380 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:23.380 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.381 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:23.381 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:23.381 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.797894030999998, 2024-09-17T02:21:23.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:21:23.381 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:23.381 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:23.381 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:23.381 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:23.381 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:23.381 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:23.381 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:21:23.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.381 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:23.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:23.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:23.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:23.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:23.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:23.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:21:23.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:21:23.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:23.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:21:23.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:21:23.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:23.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:21:23.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:21:23.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:21:23.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:21:23.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:23.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:21:23.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:21:23.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:23.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:21:23.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:21:23.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:23.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:21:23.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:21:23.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:23.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:21:23.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:21:23.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:23.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:21:23.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:21:23.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:23.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:21:23.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:21:23.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:23.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:21:23.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:21:23.386 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.386 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:23.386 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.386 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:23.386 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:23.387 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.793991781000003, 2024-09-17T02:21:23.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:21:23.387 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:23.387 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:23.387 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:23.387 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:23.387 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:23.387 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:23.387 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:21:23.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.387 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:23.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:23.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:23.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:23.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:23.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:23.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:21:23.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:21:23.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:23.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:21:23.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:21:23.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:23.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:21:23.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:21:23.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:21:23.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:21:23.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:23.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:21:23.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:21:23.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:23.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:21:23.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:21:23.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:23.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:21:23.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:21:23.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:23.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:21:23.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:21:23.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:23.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:21:23.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:21:23.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:23.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:21:23.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:21:23.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:23.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:21:23.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:21:23.392 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.392 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:23.392 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.392 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71190 5.3 e39/38 5:c99e0ae2:::benchmark_data_smithi001_23533_object71189:head v 39'4516, mlcod=35'4513)", 2024-09-17T02:21:23.392 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.607413+0000", 2024-09-17T02:21:23.392 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.758943757000001, 2024-09-17T02:21:23.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023407462, 2024-09-17T02:21:23.393 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:23.393 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:23.393 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:23.393 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:23.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:23.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607413+0000", 2024-09-17T02:21:23.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:23.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607413+0000", 2024-09-17T02:21:23.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:23.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607415+0000", 2024-09-17T02:21:23.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2139999999999999e-06 2024-09-17T02:21:23.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:23.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607479+0000", 2024-09-17T02:21:23.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4374000000000004e-05 2024-09-17T02:21:23.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:23.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607496+0000", 2024-09-17T02:21:23.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6820000000000002e-05 2024-09-17T02:21:23.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607512+0000", 2024-09-17T02:21:23.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5976000000000001e-05 2024-09-17T02:21:23.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:23.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609288+0000", 2024-09-17T02:21:23.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001776311 2024-09-17T02:21:23.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:23.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609327+0000", 2024-09-17T02:21:23.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9165999999999997e-05 2024-09-17T02:21:23.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:23.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630723+0000", 2024-09-17T02:21:23.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021395290000000001 2024-09-17T02:21:23.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:23.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630821+0000", 2024-09-17T02:21:23.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8311000000000001e-05 2024-09-17T02:21:23.396 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.396 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:23.396 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.397 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71206 5.3 e39/38 5:c6c9386d:::benchmark_data_smithi001_23533_object71205:head v 39'4517, mlcod=35'4513)", 2024-09-17T02:21:23.397 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:23.397 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.756664665999999, 2024-09-17T02:21:23.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026101868, 2024-09-17T02:21:23.397 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:23.397 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:23.397 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:23.397 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:23.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:23.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:23.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:23.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:23.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:23.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609694+0000", 2024-09-17T02:21:23.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9539999999999998e-06 2024-09-17T02:21:23.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:23.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609841+0000", 2024-09-17T02:21:23.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014690800000000001 2024-09-17T02:21:23.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:23.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609872+0000", 2024-09-17T02:21:23.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0326000000000001e-05 2024-09-17T02:21:23.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609892+0000", 2024-09-17T02:21:23.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9848999999999999e-05 2024-09-17T02:21:23.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:23.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613826+0000", 2024-09-17T02:21:23.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039345140000000001 2024-09-17T02:21:23.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:23.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613908+0000", 2024-09-17T02:21:23.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2412999999999999e-05 2024-09-17T02:21:23.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:23.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635696+0000", 2024-09-17T02:21:23.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021787597999999998 2024-09-17T02:21:23.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:23.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635794+0000", 2024-09-17T02:21:23.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8306000000000004e-05 2024-09-17T02:21:23.401 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.401 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:23.401 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.401 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71210 5.3 e39/38 5:c0498d13:::benchmark_data_smithi001_23533_object71209:head v 39'4518, mlcod=35'4513)", 2024-09-17T02:21:23.401 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:23.401 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.755186699999999, 2024-09-17T02:21:23.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024703197, 2024-09-17T02:21:23.401 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:23.402 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:23.402 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:23.402 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:23.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:23.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:23.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:23.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:23.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:23.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611172+0000", 2024-09-17T02:21:23.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6470000000000001e-06 2024-09-17T02:21:23.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:23.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611344+0000", 2024-09-17T02:21:23.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000171607 2024-09-17T02:21:23.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:23.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611389+0000", 2024-09-17T02:21:23.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5738000000000002e-05 2024-09-17T02:21:23.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611407+0000", 2024-09-17T02:21:23.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7893e-05 2024-09-17T02:21:23.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:23.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617820+0000", 2024-09-17T02:21:23.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064131070000000004 2024-09-17T02:21:23.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:23.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617885+0000", 2024-09-17T02:21:23.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4442000000000004e-05 2024-09-17T02:21:23.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:23.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635806+0000", 2024-09-17T02:21:23.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017920874999999999 2024-09-17T02:21:23.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:23.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635874+0000", 2024-09-17T02:21:23.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7887999999999998e-05 2024-09-17T02:21:23.405 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.405 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:23.405 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.406 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71213 5.3 e39/38 5:ce9071a1:::benchmark_data_smithi001_23533_object71212:head v 39'4519, mlcod=35'4513)", 2024-09-17T02:21:23.406 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.613453+0000", 2024-09-17T02:21:23.406 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.752904188999999, 2024-09-17T02:21:23.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022494631000000001, 2024-09-17T02:21:23.406 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:23.406 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:23.406 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:23.406 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:23.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:23.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613453+0000", 2024-09-17T02:21:23.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:23.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613453+0000", 2024-09-17T02:21:23.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:23.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613455+0000", 2024-09-17T02:21:23.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.703e-06 2024-09-17T02:21:23.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:23.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613594+0000", 2024-09-17T02:21:23.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000139405 2024-09-17T02:21:23.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:23.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613625+0000", 2024-09-17T02:21:23.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0993e-05 2024-09-17T02:21:23.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613646+0000", 2024-09-17T02:21:23.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0761999999999999e-05 2024-09-17T02:21:23.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:23.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.620855+0000", 2024-09-17T02:21:23.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0072088270000000001 2024-09-17T02:21:23.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:23.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.620933+0000", 2024-09-17T02:21:23.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8807000000000006e-05 2024-09-17T02:21:23.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:23.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635882+0000", 2024-09-17T02:21:23.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014948530999999999 2024-09-17T02:21:23.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:23.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635948+0000", 2024-09-17T02:21:23.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5603000000000002e-05 2024-09-17T02:21:23.410 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.410 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:23.412 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.412 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71214 5.3 e39/38 5:c5e24f3f:::benchmark_data_smithi001_23533_object71213:head v 39'4520, mlcod=35'4513)", 2024-09-17T02:21:23.412 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:23.413 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.750822467999999, 2024-09-17T02:21:23.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024251297000000002, 2024-09-17T02:21:23.413 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:23.413 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:23.413 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:23.413 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:23.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:23.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:23.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:23.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:23.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:23.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615536+0000", 2024-09-17T02:21:23.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5370000000000001e-06 2024-09-17T02:21:23.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:23.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615696+0000", 2024-09-17T02:21:23.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015948700000000001 2024-09-17T02:21:23.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:23.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615723+0000", 2024-09-17T02:21:23.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7518999999999999e-05 2024-09-17T02:21:23.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615742+0000", 2024-09-17T02:21:23.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8519999999999999e-05 2024-09-17T02:21:23.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:23.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.624440+0000", 2024-09-17T02:21:23.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0086983080000000001 2024-09-17T02:21:23.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.624489+0000", 2024-09-17T02:21:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8838000000000002e-05 2024-09-17T02:21:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639673+0000", 2024-09-17T02:21:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01518451 2024-09-17T02:21:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639786+0000", 2024-09-17T02:21:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011257800000000001 2024-09-17T02:21:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71215 5.3 e39/38 5:c5603662:::benchmark_data_smithi001_23533_object71214:head v 39'4521, mlcod=35'4513)", 2024-09-17T02:21:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.617466+0000", 2024-09-17T02:21:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.748891488000002, 2024-09-17T02:21:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022395379999999999, 2024-09-17T02:21:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617466+0000", 2024-09-17T02:21:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617466+0000", 2024-09-17T02:21:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617467+0000", 2024-09-17T02:21:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3600000000000002e-07 2024-09-17T02:21:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617521+0000", 2024-09-17T02:21:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4654999999999998e-05 2024-09-17T02:21:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617548+0000", 2024-09-17T02:21:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6706000000000001e-05 2024-09-17T02:21:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617566+0000", 2024-09-17T02:21:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7989e-05 2024-09-17T02:21:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.627598+0000", 2024-09-17T02:21:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010031854 2024-09-17T02:21:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.627656+0000", 2024-09-17T02:21:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8511999999999998e-05 2024-09-17T02:21:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639794+0000", 2024-09-17T02:21:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012137445 2024-09-17T02:21:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639861+0000", 2024-09-17T02:21:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7282999999999999e-05 2024-09-17T02:21:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:71277 5.a 5:5576e9b8:::benchmark_data_smithi001_23533_object71276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.630891+0000", 2024-09-17T02:21:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.735465948000002, 2024-09-17T02:21:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022210245999999999, 2024-09-17T02:21:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71277 2024-09-17T02:21:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630891+0000", 2024-09-17T02:21:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:23.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630891+0000", 2024-09-17T02:21:23.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:23.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630893+0000", 2024-09-17T02:21:23.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-09-17T02:21:23.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:23.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630961+0000", 2024-09-17T02:21:23.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7971000000000004e-05 2024-09-17T02:21:23.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:23.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630989+0000", 2024-09-17T02:21:23.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7855999999999999e-05 2024-09-17T02:21:23.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631010+0000", 2024-09-17T02:21:23.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0888999999999999e-05 2024-09-17T02:21:23.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:23.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631123+0000", 2024-09-17T02:21:23.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011292 2024-09-17T02:21:23.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:23.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631434+0000", 2024-09-17T02:21:23.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00031039199999999999 2024-09-17T02:21:23.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:23.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631679+0000", 2024-09-17T02:21:23.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024517099999999997 2024-09-17T02:21:23.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.636619+0000", 2024-09-17T02:21:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049405339999999999 2024-09-17T02:21:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.652851+0000", 2024-09-17T02:21:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016231440999999999 2024-09-17T02:21:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.653012+0000", 2024-09-17T02:21:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016157199999999999 2024-09-17T02:21:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.653101+0000", 2024-09-17T02:21:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9190000000000005e-05 2024-09-17T02:21:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97147 5.0 5:02d17bf7:::benchmark_data_smithi001_23533_object97146:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268128+0000", 2024-09-17T02:21:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 6.0982287240000002, 2024-09-17T02:21:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022726434, 2024-09-17T02:21:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97147 2024-09-17T02:21:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268128+0000", 2024-09-17T02:21:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268128+0000", 2024-09-17T02:21:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268129+0000", 2024-09-17T02:21:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5700000000000001e-07 2024-09-17T02:21:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268194+0000", 2024-09-17T02:21:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4731000000000001e-05 2024-09-17T02:21:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:23.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268202+0000", 2024-09-17T02:21:23.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7950000000000008e-06 2024-09-17T02:21:23.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268207+0000", 2024-09-17T02:21:23.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8550000000000001e-06 2024-09-17T02:21:23.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:23.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268694+0000", 2024-09-17T02:21:23.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00048752799999999998 2024-09-17T02:21:23.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:23.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268768+0000", 2024-09-17T02:21:23.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3638000000000002e-05 2024-09-17T02:21:23.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:23.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268842+0000", 2024-09-17T02:21:23.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3928000000000001e-05 2024-09-17T02:21:23.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:23.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.285598+0000", 2024-09-17T02:21:23.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016756436 2024-09-17T02:21:23.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:23.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290771+0000", 2024-09-17T02:21:23.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051724789999999998 2024-09-17T02:21:23.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:23.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290817+0000", 2024-09-17T02:21:23.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6220999999999997e-05 2024-09-17T02:21:23.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:23.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290855+0000", 2024-09-17T02:21:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7966000000000002e-05 2024-09-17T02:21:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97148 5.5 5:a643b955:::benchmark_data_smithi001_23533_object97147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268218+0000", 2024-09-17T02:21:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 6.0981393400000004, 2024-09-17T02:21:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022628112999999998, 2024-09-17T02:21:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97148 2024-09-17T02:21:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268218+0000", 2024-09-17T02:21:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268218+0000", 2024-09-17T02:21:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268218+0000", 2024-09-17T02:21:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.53e-07 2024-09-17T02:21:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268300+0000", 2024-09-17T02:21:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2219999999999995e-05 2024-09-17T02:21:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268306+0000", 2024-09-17T02:21:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8989999999999998e-06 2024-09-17T02:21:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268310+0000", 2024-09-17T02:21:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6610000000000002e-06 2024-09-17T02:21:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268354+0000", 2024-09-17T02:21:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3782000000000002e-05 2024-09-17T02:21:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268452+0000", 2024-09-17T02:21:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8339999999999997e-05 2024-09-17T02:21:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268536+0000", 2024-09-17T02:21:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3931999999999995e-05 2024-09-17T02:21:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.286252+0000", 2024-09-17T02:21:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017715740000000001 2024-09-17T02:21:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290758+0000", 2024-09-17T02:21:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045060940000000004 2024-09-17T02:21:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290801+0000", 2024-09-17T02:21:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2818000000000002e-05 2024-09-17T02:21:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290846+0000", 2024-09-17T02:21:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5274000000000001e-05 2024-09-17T02:21:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97151 5.5 5:a0c2c072:::benchmark_data_smithi001_23533_object97150:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 6.097985059, 2024-09-17T02:21:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027297614000000001, 2024-09-17T02:21:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97151 2024-09-17T02:21:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268373+0000", 2024-09-17T02:21:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4000000000000002e-07 2024-09-17T02:21:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268423+0000", 2024-09-17T02:21:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0175e-05 2024-09-17T02:21:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268428+0000", 2024-09-17T02:21:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-17T02:21:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268431+0000", 2024-09-17T02:21:23.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.179e-06 2024-09-17T02:21:23.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:23.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283631+0000", 2024-09-17T02:21:23.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015199691 2024-09-17T02:21:23.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:23.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283740+0000", 2024-09-17T02:21:23.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109305 2024-09-17T02:21:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283863+0000", 2024-09-17T02:21:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012226699999999999 2024-09-17T02:21:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290857+0000", 2024-09-17T02:21:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069945449999999996 2024-09-17T02:21:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295595+0000", 2024-09-17T02:21:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047376750000000002 2024-09-17T02:21:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295638+0000", 2024-09-17T02:21:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3671999999999998e-05 2024-09-17T02:21:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295670+0000", 2024-09-17T02:21:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1266000000000002e-05 2024-09-17T02:21:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97248 5.c 5:3796bec5:::benchmark_data_smithi001_23533_object97247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.327358+0000", 2024-09-17T02:21:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 6.0389988160000003, 2024-09-17T02:21:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022963006000000001, 2024-09-17T02:21:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97248 2024-09-17T02:21:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.446 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:23.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:23.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327358+0000", 2024-09-17T02:21:23.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:23.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327358+0000", 2024-09-17T02:21:23.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:23.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327359+0000", 2024-09-17T02:21:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5699999999999998e-07 2024-09-17T02:21:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327382+0000", 2024-09-17T02:21:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3458000000000001e-05 2024-09-17T02:21:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327387+0000", 2024-09-17T02:21:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6149999999999999e-06 2024-09-17T02:21:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327391+0000", 2024-09-17T02:21:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8999999999999999e-06 2024-09-17T02:21:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.332084+0000", 2024-09-17T02:21:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046935240000000001 2024-09-17T02:21:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.332216+0000", 2024-09-17T02:21:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131798 2024-09-17T02:21:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.332352+0000", 2024-09-17T02:21:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013587500000000001 2024-09-17T02:21:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.338559+0000", 2024-09-17T02:21:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0062075510000000004 2024-09-17T02:21:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350237+0000", 2024-09-17T02:21:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011677121 2024-09-17T02:21:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350287+0000", 2024-09-17T02:21:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0080999999999997e-05 2024-09-17T02:21:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350321+0000", 2024-09-17T02:21:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4625999999999997e-05 2024-09-17T02:21:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97251 5.c 5:382be9a3:::benchmark_data_smithi001_23533_object97250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.328203+0000", 2024-09-17T02:21:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 6.0381545799999996, 2024-09-17T02:21:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022268999000000001, 2024-09-17T02:21:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97251 2024-09-17T02:21:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328203+0000", 2024-09-17T02:21:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328203+0000", 2024-09-17T02:21:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328203+0000", 2024-09-17T02:21:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3699999999999999e-07 2024-09-17T02:21:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:23.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328319+0000", 2024-09-17T02:21:23.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011560100000000001 2024-09-17T02:21:23.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:23.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328332+0000", 2024-09-17T02:21:23.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2978e-05 2024-09-17T02:21:23.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328340+0000", 2024-09-17T02:21:23.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4680000000000003e-06 2024-09-17T02:21:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.335525+0000", 2024-09-17T02:21:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0071852399999999999 2024-09-17T02:21:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.335650+0000", 2024-09-17T02:21:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012522299999999999 2024-09-17T02:21:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.335732+0000", 2024-09-17T02:21:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1582999999999995e-05 2024-09-17T02:21:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.346944+0000", 2024-09-17T02:21:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011211936 2024-09-17T02:21:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350332+0000", 2024-09-17T02:21:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033884140000000002 2024-09-17T02:21:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350433+0000", 2024-09-17T02:21:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010115600000000001 2024-09-17T02:21:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350472+0000", 2024-09-17T02:21:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8463000000000001e-05 2024-09-17T02:21:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97759 5.a 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.7679719580000004, 2024-09-17T02:21:23.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.089694871999999995, 2024-09-17T02:21:23.457 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:23.457 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:23.457 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:23.457 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:23.457 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:23.457 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:23.457 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97759 2024-09-17T02:21:23.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.457 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:23.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:23.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598386+0000", 2024-09-17T02:21:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999999e-07 2024-09-17T02:21:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598414+0000", 2024-09-17T02:21:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8013000000000001e-05 2024-09-17T02:21:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598420+0000", 2024-09-17T02:21:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1149999999999999e-06 2024-09-17T02:21:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598424+0000", 2024-09-17T02:21:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:21:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598479+0000", 2024-09-17T02:21:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4648999999999998e-05 2024-09-17T02:21:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598587+0000", 2024-09-17T02:21:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010853000000000001 2024-09-17T02:21:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598676+0000", 2024-09-17T02:21:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8381999999999995e-05 2024-09-17T02:21:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603766+0000", 2024-09-17T02:21:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050902559999999996 2024-09-17T02:21:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.687988+0000", 2024-09-17T02:21:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.084221753999999996 2024-09-17T02:21:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688037+0000", 2024-09-17T02:21:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-05 2024-09-17T02:21:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688080+0000", 2024-09-17T02:21:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3149999999999999e-05 2024-09-17T02:21:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97770 5.0 5:09c75033:::benchmark_data_smithi001_23533_object97769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.7628295280000001, 2024-09-17T02:21:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.086380868, 2024-09-17T02:21:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97770 2024-09-17T02:21:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603529+0000", 2024-09-17T02:21:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:21:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603593+0000", 2024-09-17T02:21:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4216999999999999e-05 2024-09-17T02:21:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603603+0000", 2024-09-17T02:21:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5179999999999993e-06 2024-09-17T02:21:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603608+0000", 2024-09-17T02:21:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2039999999999996e-06 2024-09-17T02:21:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603653+0000", 2024-09-17T02:21:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5247000000000002e-05 2024-09-17T02:21:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603758+0000", 2024-09-17T02:21:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105352 2024-09-17T02:21:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603900+0000", 2024-09-17T02:21:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014198999999999999 2024-09-17T02:21:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.606097+0000", 2024-09-17T02:21:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021969839999999999 2024-09-17T02:21:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689756+0000", 2024-09-17T02:21:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.083659077999999998 2024-09-17T02:21:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689846+0000", 2024-09-17T02:21:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9320999999999994e-05 2024-09-17T02:21:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:23.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689908+0000", 2024-09-17T02:21:23.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720999999999998e-05 2024-09-17T02:21:23.468 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.468 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:23.468 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.468 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:101263 5.0 5:01bcc612:::benchmark_data_smithi001_23533_object101262:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T02:21:23.468 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:19.421619+0000", 2024-09-17T02:21:23.468 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.9447383070000002, 2024-09-17T02:21:23.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023065922999999999, 2024-09-17T02:21:23.468 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:23.468 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 101263 2024-09-17T02:21:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421619+0000", 2024-09-17T02:21:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:23.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421619+0000", 2024-09-17T02:21:23.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:23.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:23.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421619+0000", 2024-09-17T02:21:23.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6100000000000001e-07 2024-09-17T02:21:23.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:23.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421657+0000", 2024-09-17T02:21:23.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7438999999999998e-05 2024-09-17T02:21:23.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421665+0000", 2024-09-17T02:21:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4840000000000004e-06 2024-09-17T02:21:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421671+0000", 2024-09-17T02:21:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5400000000000003e-06 2024-09-17T02:21:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.431714+0000", 2024-09-17T02:21:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0100432 2024-09-17T02:21:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.431841+0000", 2024-09-17T02:21:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000127138 2024-09-17T02:21:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.431970+0000", 2024-09-17T02:21:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012893900000000001 2024-09-17T02:21:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.436696+0000", 2024-09-17T02:21:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047262570000000002 2024-09-17T02:21:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.444604+0000", 2024-09-17T02:21:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079071479999999993 2024-09-17T02:21:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.444648+0000", 2024-09-17T02:21:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4941000000000002e-05 2024-09-17T02:21:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.444685+0000", 2024-09-17T02:21:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6276000000000003e-05 2024-09-17T02:21:23.474 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.474 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:23.474 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.474 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:23.474 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:23.474 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:23.475 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:21:23.476 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:23.478+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:23.576 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:23.577+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:23.635 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:21:23.635 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-17T02:21:23.635 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.635 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:109737 5.b e46/38 5:dbb8c514:::benchmark_data_smithi001_23533_object109736:head v 46'6774, mlcod=46'6772)", 2024-09-17T02:21:23.636 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:23.626800+0000", 2024-09-17T02:21:23.636 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.011496294000000001, 2024-09-17T02:21:23.636 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.011513666000000001, 2024-09-17T02:21:23.636 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:23.636 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:23.636 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:21:23.636 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:23.636 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.636 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:23.636 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.626800+0000", 2024-09-17T02:21:23.636 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:23.636 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.637 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.637 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:23.637 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.626800+0000", 2024-09-17T02:21:23.637 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:23.637 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.637 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.637 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:23.637 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.626800+0000", 2024-09-17T02:21:23.637 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3099999999999999e-07 2024-09-17T02:21:23.637 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.637 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.637 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:23.637 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.626804+0000", 2024-09-17T02:21:23.637 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3189999999999999e-06 2024-09-17T02:21:23.638 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.638 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.638 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:23.638 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.626809+0000", 2024-09-17T02:21:23.638 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1630000000000004e-06 2024-09-17T02:21:23.638 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.638 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.638 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.638 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.626814+0000", 2024-09-17T02:21:23.638 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7079999999999996e-06 2024-09-17T02:21:23.638 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.638 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.638 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:23.638 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.632693+0000", 2024-09-17T02:21:23.639 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0058795239999999997 2024-09-17T02:21:23.639 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.639 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.639 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:23.639 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.632718+0000", 2024-09-17T02:21:23.639 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4604e-05 2024-09-17T02:21:23.639 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:23.639 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:23.639 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:23.639 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.639 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.639 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:109740 5.b e46/38 5:d96c7a49:::benchmark_data_smithi001_23533_object109739:head v 46'6775, mlcod=46'6772)", 2024-09-17T02:21:23.639 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:23.628235+0000", 2024-09-17T02:21:23.640 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.010061389, 2024-09-17T02:21:23.640 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010134771000000001, 2024-09-17T02:21:23.640 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:23.640 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:23.640 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:21:23.640 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:23.640 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.640 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:23.640 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.628235+0000", 2024-09-17T02:21:23.640 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:23.640 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.640 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.640 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:23.640 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.628235+0000", 2024-09-17T02:21:23.641 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:23.641 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.641 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.641 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:23.641 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.628236+0000", 2024-09-17T02:21:23.641 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3099999999999997e-07 2024-09-17T02:21:23.641 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.641 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.641 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:23.641 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.628274+0000", 2024-09-17T02:21:23.641 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7868999999999999e-05 2024-09-17T02:21:23.641 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.641 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.641 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:23.642 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.628282+0000", 2024-09-17T02:21:23.642 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5760000000000006e-06 2024-09-17T02:21:23.642 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.642 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.642 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.642 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.628288+0000", 2024-09-17T02:21:23.642 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0050000000000001e-06 2024-09-17T02:21:23.642 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.642 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.642 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:23.642 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.634348+0000", 2024-09-17T02:21:23.642 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060603549999999999 2024-09-17T02:21:23.642 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.642 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.643 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:23.643 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.634368+0000", 2024-09-17T02:21:23.643 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9419000000000002e-05 2024-09-17T02:21:23.643 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:23.643 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:23.643 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:23.643 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.643 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.643 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:109741 5.b e46/38 5:d3f4ebc0:::benchmark_data_smithi001_23533_object109740:head v 46'6776, mlcod=46'6772)", 2024-09-17T02:21:23.643 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:23.630127+0000", 2024-09-17T02:21:23.643 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0081694079999999995, 2024-09-17T02:21:23.643 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0082909699999999999, 2024-09-17T02:21:23.643 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:23.643 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:23.644 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:21:23.644 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:23.644 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.644 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:23.644 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.630127+0000", 2024-09-17T02:21:23.644 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:23.644 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.644 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.644 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:23.644 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.630127+0000", 2024-09-17T02:21:23.644 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:23.644 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.644 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.645 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:23.645 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.630128+0000", 2024-09-17T02:21:23.645 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4499999999999996e-07 2024-09-17T02:21:23.645 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.645 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.645 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:23.645 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.630133+0000", 2024-09-17T02:21:23.645 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3380000000000004e-06 2024-09-17T02:21:23.645 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.645 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.645 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:23.645 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.630143+0000", 2024-09-17T02:21:23.645 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0008e-05 2024-09-17T02:21:23.645 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.646 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.646 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.646 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.630149+0000", 2024-09-17T02:21:23.646 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6359999999999999e-06 2024-09-17T02:21:23.646 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.646 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.646 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:23.646 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.635733+0000", 2024-09-17T02:21:23.646 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055844010000000001 2024-09-17T02:21:23.646 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.646 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.646 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:23.646 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.635756+0000", 2024-09-17T02:21:23.646 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2900000000000001e-05 2024-09-17T02:21:23.647 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:23.647 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:23.647 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:23.647 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.647 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.647 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "MOSDPGPushReply(5.3 46/38 [PushReplyOp(5:c76d9ff0:::benchmark_data_smithi001_23533_object68200:head)])", 2024-09-17T02:21:23.647 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:23.631374+0000", 2024-09-17T02:21:23.647 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0069225420000000003, 2024-09-17T02:21:23.647 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070838869999999996, 2024-09-17T02:21:23.647 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:23.647 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:23.647 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:23.647 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:23.647 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.648 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:23.648 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.631374+0000", 2024-09-17T02:21:23.648 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:23.648 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.648 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.648 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:23.648 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.631374+0000", 2024-09-17T02:21:23.648 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:23.648 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.648 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.648 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:23.648 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.631375+0000", 2024-09-17T02:21:23.648 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2900000000000003e-07 2024-09-17T02:21:23.648 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.648 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.649 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:23.649 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.631378+0000", 2024-09-17T02:21:23.649 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.811e-06 2024-09-17T02:21:23.649 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.649 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.649 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:23.649 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.631385+0000", 2024-09-17T02:21:23.649 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3459999999999999e-06 2024-09-17T02:21:23.649 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.649 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.649 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.649 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.631392+0000", 2024-09-17T02:21:23.649 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0119999999999999e-06 2024-09-17T02:21:23.649 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:23.650 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:23.650 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:23.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.650 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.650 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:109746 5.b e46/38)", 2024-09-17T02:21:23.650 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:23.632485+0000", 2024-09-17T02:21:23.650 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0058111660000000004, 2024-09-17T02:21:23.650 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060213300000000001, 2024-09-17T02:21:23.650 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:23.650 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:23.650 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:23.650 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:23.650 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.650 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:23.651 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.632485+0000", 2024-09-17T02:21:23.651 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:23.651 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.651 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:23.651 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.632485+0000", 2024-09-17T02:21:23.651 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:23.651 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.651 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:23.651 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.632486+0000", 2024-09-17T02:21:23.651 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.64e-07 2024-09-17T02:21:23.651 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.652 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:23.652 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.632491+0000", 2024-09-17T02:21:23.652 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0819999999999998e-06 2024-09-17T02:21:23.652 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.652 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:23.652 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.632501+0000", 2024-09-17T02:21:23.652 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.978e-06 2024-09-17T02:21:23.652 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.652 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.652 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.632508+0000", 2024-09-17T02:21:23.653 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3749999999999999e-06 2024-09-17T02:21:23.653 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:23.653 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:23.653 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:23.653 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.653 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.653 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:109748 5.d 5:ba30b0a6:::benchmark_data_smithi001_23533_object109747:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T02:21:23.653 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:23.633128+0000", 2024-09-17T02:21:23.653 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0051682250000000002, 2024-09-17T02:21:23.653 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0054330960000000001, 2024-09-17T02:21:23.653 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:23.653 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:23.653 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:23.653 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:23.654 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:23.654 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:23.654 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 109748 2024-09-17T02:21:23.654 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.654 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:23.654 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.654 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:23.654 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.633128+0000", 2024-09-17T02:21:23.654 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:23.654 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.654 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.654 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:23.654 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.633128+0000", 2024-09-17T02:21:23.654 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:23.655 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.655 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.655 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:23.655 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.633148+0000", 2024-09-17T02:21:23.655 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9623000000000002e-05 2024-09-17T02:21:23.655 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.655 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.655 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:23.655 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.633181+0000", 2024-09-17T02:21:23.655 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3461999999999999e-05 2024-09-17T02:21:23.655 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.655 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.655 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:23.655 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.633192+0000", 2024-09-17T02:21:23.656 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0423e-05 2024-09-17T02:21:23.656 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.656 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.656 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.656 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.633198+0000", 2024-09-17T02:21:23.656 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0050000000000001e-06 2024-09-17T02:21:23.656 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.656 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.656 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:23.656 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.635778+0000", 2024-09-17T02:21:23.656 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002580429 2024-09-17T02:21:23.656 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.656 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.656 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:23.657 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.635928+0000", 2024-09-17T02:21:23.657 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014939200000000001 2024-09-17T02:21:23.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.657 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.657 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:23.657 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.636080+0000", 2024-09-17T02:21:23.657 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015279099999999999 2024-09-17T02:21:23.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.657 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.657 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:23.657 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.637953+0000", 2024-09-17T02:21:23.657 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001872306 2024-09-17T02:21:23.657 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:23.658 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:23.658 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:23.658 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.658 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.658 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:109752 5.7 5:ebeea36f:::benchmark_data_smithi001_23533_object109751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T02:21:23.658 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:23.634645+0000", 2024-09-17T02:21:23.658 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0036518089999999998, 2024-09-17T02:21:23.658 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0039655230000000003, 2024-09-17T02:21:23.658 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:23.658 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:23.658 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:23.658 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:23.658 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:23.658 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:23.659 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 109752 2024-09-17T02:21:23.659 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.659 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:23.659 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.659 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:23.659 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.634645+0000", 2024-09-17T02:21:23.659 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:23.659 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.659 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.659 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:23.659 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.634645+0000", 2024-09-17T02:21:23.659 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:23.659 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.659 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.660 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:23.660 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.634646+0000", 2024-09-17T02:21:23.660 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0440000000000001e-06 2024-09-17T02:21:23.660 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.660 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.660 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:23.660 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.634691+0000", 2024-09-17T02:21:23.660 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5648000000000001e-05 2024-09-17T02:21:23.660 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.660 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.660 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:23.660 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.634722+0000", 2024-09-17T02:21:23.660 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0559999999999999e-05 2024-09-17T02:21:23.660 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.661 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.661 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.661 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.634730+0000", 2024-09-17T02:21:23.661 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5399999999999996e-06 2024-09-17T02:21:23.661 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.661 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.661 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:23.661 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.634803+0000", 2024-09-17T02:21:23.661 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2749000000000004e-05 2024-09-17T02:21:23.661 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.661 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.661 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:23.661 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.634926+0000", 2024-09-17T02:21:23.661 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000122583 2024-09-17T02:21:23.662 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.662 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.662 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:23.662 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.635063+0000", 2024-09-17T02:21:23.662 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013768499999999999 2024-09-17T02:21:23.662 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.662 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.662 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:23.662 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.637168+0000", 2024-09-17T02:21:23.662 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002104674 2024-09-17T02:21:23.662 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:23.662 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:23.662 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:23.662 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.662 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.663 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:109755 5.5 e46/22 5:a1ba62a8:::benchmark_data_smithi001_23533_object109754:head v 46'6910, mlcod=46'6908)", 2024-09-17T02:21:23.663 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:23.636140+0000", 2024-09-17T02:21:23.663 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0021562299999999999, 2024-09-17T02:21:23.663 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0025101699999999999, 2024-09-17T02:21:23.663 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:23.663 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:23.663 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:21:23.663 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:23.663 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.663 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:23.663 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.636140+0000", 2024-09-17T02:21:23.663 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:23.663 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.663 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.664 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:23.664 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.636140+0000", 2024-09-17T02:21:23.664 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:23.664 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.664 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.664 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:23.664 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.636141+0000", 2024-09-17T02:21:23.664 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.8800000000000001e-07 2024-09-17T02:21:23.664 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.664 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.664 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:23.664 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.636201+0000", 2024-09-17T02:21:23.664 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0040000000000001e-05 2024-09-17T02:21:23.665 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.665 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.665 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:23.665 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.636214+0000", 2024-09-17T02:21:23.665 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.273e-05 2024-09-17T02:21:23.665 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.665 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.665 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.665 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.636221+0000", 2024-09-17T02:21:23.665 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1999999999999997e-06 2024-09-17T02:21:23.665 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.665 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.665 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:23.666 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.637657+0000", 2024-09-17T02:21:23.666 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014362050000000001 2024-09-17T02:21:23.666 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.666 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.666 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:23.666 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.637668+0000", 2024-09-17T02:21:23.666 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0706e-05 2024-09-17T02:21:23.666 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:23.666 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:23.666 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:23.666 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.666 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.666 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:109757 5.b e46/38)", 2024-09-17T02:21:23.666 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:23.636899+0000", 2024-09-17T02:21:23.666 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0013978420000000001, 2024-09-17T02:21:23.667 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001782552, 2024-09-17T02:21:23.667 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:23.667 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:23.667 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:23.667 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:23.667 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.667 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:23.667 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.636899+0000", 2024-09-17T02:21:23.667 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:23.667 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.667 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.667 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:23.667 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.636899+0000", 2024-09-17T02:21:23.667 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:23.668 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.668 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.668 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:23.668 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.636899+0000", 2024-09-17T02:21:23.668 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.61e-07 2024-09-17T02:21:23.668 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.668 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.668 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:23.668 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.636904+0000", 2024-09-17T02:21:23.668 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6829999999999999e-06 2024-09-17T02:21:23.668 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.668 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.668 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:23.669 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.636912+0000", 2024-09-17T02:21:23.669 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3149999999999992e-06 2024-09-17T02:21:23.669 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.669 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.669 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.669 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.636918+0000", 2024-09-17T02:21:23.669 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6409999999999999e-06 2024-09-17T02:21:23.669 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:23.669 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:23.669 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:23.669 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.669 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.669 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:109754 5.6 e46/22 5:69a0747f:::benchmark_data_smithi001_23533_object109753:head v 46'6747, mlcod=46'6745)", 2024-09-17T02:21:23.669 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:23.636884+0000", 2024-09-17T02:21:23.670 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0014126220000000001, 2024-09-17T02:21:23.670 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00182198, 2024-09-17T02:21:23.670 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:23.670 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:23.670 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:21:23.670 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:23.670 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.670 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:23.670 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.636884+0000", 2024-09-17T02:21:23.670 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:23.670 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.670 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.670 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:23.670 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.636884+0000", 2024-09-17T02:21:23.671 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:23.671 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.671 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.671 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:23.671 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.636884+0000", 2024-09-17T02:21:23.671 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8999999999999996e-07 2024-09-17T02:21:23.671 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.671 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.671 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:23.671 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.636952+0000", 2024-09-17T02:21:23.671 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7433000000000003e-05 2024-09-17T02:21:23.671 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.671 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.671 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:23.672 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.636960+0000", 2024-09-17T02:21:23.672 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4819999999999994e-06 2024-09-17T02:21:23.672 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.672 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.672 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.672 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.636965+0000", 2024-09-17T02:21:23.672 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6970000000000001e-06 2024-09-17T02:21:23.672 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.672 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.672 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:23.672 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.637019+0000", 2024-09-17T02:21:23.672 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3752999999999998e-05 2024-09-17T02:21:23.672 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.673 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.673 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:23.673 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.637040+0000", 2024-09-17T02:21:23.673 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1225000000000001e-05 2024-09-17T02:21:23.673 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:23.673 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:23.673 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:23.673 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.673 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.673 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:109758 5.1 5:8e86c98f:::benchmark_data_smithi001_23533_object109757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T02:21:23.673 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:23.638455+0000", 2024-09-17T02:21:23.673 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4294967295.9998417, 2024-09-17T02:21:23.673 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00028595200000000002, 2024-09-17T02:21:23.673 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:23.674 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:23.674 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:21:23.674 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:23.674 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:23.674 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:23.674 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 109758 2024-09-17T02:21:23.674 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.674 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:23.674 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.674 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:23.674 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.638455+0000", 2024-09-17T02:21:23.674 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:23.674 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.674 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.675 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:23.675 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.638455+0000", 2024-09-17T02:21:23.675 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:23.675 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.675 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.675 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:23.675 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.638456+0000", 2024-09-17T02:21:23.675 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.263e-06 2024-09-17T02:21:23.675 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.675 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.675 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:23.675 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.638515+0000", 2024-09-17T02:21:23.675 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8814999999999998e-05 2024-09-17T02:21:23.675 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.676 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.676 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:23.676 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.638530+0000", 2024-09-17T02:21:23.676 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4593000000000001e-05 2024-09-17T02:21:23.676 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.676 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.676 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.676 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.638537+0000", 2024-09-17T02:21:23.676 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5510000000000002e-06 2024-09-17T02:21:23.676 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.676 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.676 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:23.676 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.638591+0000", 2024-09-17T02:21:23.676 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3795999999999998e-05 2024-09-17T02:21:23.677 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.677 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.677 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:23.677 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.638726+0000", 2024-09-17T02:21:23.677 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013510700000000001 2024-09-17T02:21:23.677 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:23.677 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:23.677 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:23.677 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.677 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.677 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(client.4466.0:109748 5.d e46/26 ondisk, result = 0)", 2024-09-17T02:21:23.677 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:23.638650+0000", 2024-09-17T02:21:23.677 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4294967295.9996462, 2024-09-17T02:21:23.677 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012437200000000001, 2024-09-17T02:21:23.677 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:23.678 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:23.678 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:21:23.678 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:23.678 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.678 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:23.678 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.638650+0000", 2024-09-17T02:21:23.678 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:23.678 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.678 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.678 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:23.678 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.638650+0000", 2024-09-17T02:21:23.678 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:23.678 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.679 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.679 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:23.679 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.638651+0000", 2024-09-17T02:21:23.679 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.5300000000000004e-07 2024-09-17T02:21:23.679 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.679 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.679 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:23.679 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.638654+0000", 2024-09-17T02:21:23.679 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.354e-06 2024-09-17T02:21:23.679 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.679 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.679 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:23.679 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.638664+0000", 2024-09-17T02:21:23.679 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6819999999999998e-06 2024-09-17T02:21:23.679 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.680 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.680 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:23.680 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.638669+0000", 2024-09-17T02:21:23.680 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7790000000000001e-06 2024-09-17T02:21:23.680 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.680 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.680 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:23.680 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.638727+0000", 2024-09-17T02:21:23.680 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7436999999999999e-05 2024-09-17T02:21:23.680 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:23.680 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:23.680 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:23.680 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:23.638733+0000", 2024-09-17T02:21:23.681 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0519999999999998e-06 2024-09-17T02:21:23.681 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:23.681 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:23.681 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:23.681 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:23.681 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-09-17T02:21:23.681 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 12 2024-09-17T02:21:23.681 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:21:23.682 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:23.682+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:23.683 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:21:23.774 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 51 16 110041 110025 134.819 125.25 0.00487896 0.00741266 2024-09-17T02:21:23.783 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:23.782+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:23.798 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:21:23.842 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:21:23.843 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-17T02:21:23.843 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-09-17T02:21:23.843 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-09-17T02:21:23.843 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:21:23.863 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:21:23.884 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:23.886+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:23.960 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:21:23.961 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:21:23.979 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:21:23.979 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:21:23.985 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:23.986+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:23.997 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:21:23.997 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:21:24.065 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:24.065 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:24.086 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:24.087 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:24.086+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:24.187 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:24.186+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:24.250 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:24.250 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:24.270 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:24.316 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:24.317+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:24.389 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:24.390+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:24.422 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:24.422 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:24.425 INFO:teuthology.orchestra.run.smithi001.stderr:noscrub is unset 2024-09-17T02:21:24.445 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:24.490 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:24.490+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:24.590 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:24.589+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:24.636 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:24.636 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:24.658 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:24.691 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:24.690+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:24.774 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 52 15 112075 112060 134.672 127.188 0.00805619 0.00742039 2024-09-17T02:21:24.792 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:24.793+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:24.813 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:24.814 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:24.833 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:24.893 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:24.893+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:24.894 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-17T02:21:24.894 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T02:21:24.895 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-17T02:21:24.895 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-17T02:21:24.895 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-17T02:21:24.895 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-17T02:21:24.988 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:24.989 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:24.994 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:24.994+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:25.010 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:25.054 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:21:25.054 INFO:teuthology.orchestra.run.smithi164.stdout: "success": "" 2024-09-17T02:21:25.054 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:21:25.095 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:25.097+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:25.197 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:25.194+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:25.205 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:25.205 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:25.226 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:21:25.297 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:25.298+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:25.383 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:25.383 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:25.398 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:25.398+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:25.405 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:21:25.499 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:25.498+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:25.564 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:25.564 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:25.587 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:21:25.600 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:25.601+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:25.701 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:25.702+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:25.775 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 53 16 114066 114050 134.478 124.375 0.00737034 0.00743145 2024-09-17T02:21:25.789 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:25.790 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:25.802 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:25.802+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:25.810 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:25.903 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:25.906+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:25.969 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:25.969 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:25.987 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:26.004 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:26.006+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:26.016 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:21:26.106 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:26.105+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:26.139 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:26.140 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:26.161 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:26.176 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:21:26.176 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:21:26.198 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:21:26.198 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:21:26.206 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:26.206+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:26.216 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:21:26.216 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:21:26.307 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:26.310+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:26.358 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:26.359 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:21:26.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:21:26.359 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:26.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.359 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:26.359 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:21:26.359 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 69.805523626999999, 2024-09-17T02:21:26.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035535028000000003, 2024-09-17T02:21:26.360 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:26.360 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:26.360 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:26.360 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:26.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:26.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:21:26.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:26.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:21:26.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:26.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556550+0000", 2024-09-17T02:21:26.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3500000000000001e-06 2024-09-17T02:21:26.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:26.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556566+0000", 2024-09-17T02:21:26.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5440000000000001e-05 2024-09-17T02:21:26.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:26.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556594+0000", 2024-09-17T02:21:26.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8552999999999999e-05 2024-09-17T02:21:26.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556618+0000", 2024-09-17T02:21:26.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3207e-05 2024-09-17T02:21:26.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:26.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578337+0000", 2024-09-17T02:21:26.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021719517000000001 2024-09-17T02:21:26.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:26.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578655+0000", 2024-09-17T02:21:26.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031837800000000002 2024-09-17T02:21:26.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:26.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.581374+0000", 2024-09-17T02:21:26.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002718238 2024-09-17T02:21:26.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:26.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587083+0000", 2024-09-17T02:21:26.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005708912 2024-09-17T02:21:26.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:26.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591823+0000", 2024-09-17T02:21:26.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047406080000000003 2024-09-17T02:21:26.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:26.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591972+0000", 2024-09-17T02:21:26.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014874199999999999 2024-09-17T02:21:26.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:26.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592082+0000", 2024-09-17T02:21:26.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110083 2024-09-17T02:21:26.365 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.365 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:26.365 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.365 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:26.365 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:21:26.365 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 69.804582139999994, 2024-09-17T02:21:26.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035128756999999997, 2024-09-17T02:21:26.365 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:26.365 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:26.366 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:26.366 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:26.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:26.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:21:26.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:26.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:21:26.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:26.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557491+0000", 2024-09-17T02:21:26.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.88e-06 2024-09-17T02:21:26.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:26.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557504+0000", 2024-09-17T02:21:26.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2864000000000001e-05 2024-09-17T02:21:26.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:26.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557535+0000", 2024-09-17T02:21:26.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0916e-05 2024-09-17T02:21:26.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557561+0000", 2024-09-17T02:21:26.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5602999999999999e-05 2024-09-17T02:21:26.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:26.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582290+0000", 2024-09-17T02:21:26.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024729729999999998 2024-09-17T02:21:26.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:26.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582642+0000", 2024-09-17T02:21:26.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035143499999999999 2024-09-17T02:21:26.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:26.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582959+0000", 2024-09-17T02:21:26.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031747399999999999 2024-09-17T02:21:26.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:26.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587302+0000", 2024-09-17T02:21:26.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043425169999999997 2024-09-17T02:21:26.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:26.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592391+0000", 2024-09-17T02:21:26.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050895799999999998 2024-09-17T02:21:26.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:26.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592516+0000", 2024-09-17T02:21:26.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012420500000000001 2024-09-17T02:21:26.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:26.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592617+0000", 2024-09-17T02:21:26.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010155299999999999 2024-09-17T02:21:26.370 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.370 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:26.370 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.370 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:26.370 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:21:26.371 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 69.804477641000005, 2024-09-17T02:21:26.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034796066, 2024-09-17T02:21:26.371 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:26.371 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:26.371 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:26.371 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:26.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:26.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:21:26.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:26.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:21:26.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:26.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557594+0000", 2024-09-17T02:21:26.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3769999999999999e-06 2024-09-17T02:21:26.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:26.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557683+0000", 2024-09-17T02:21:26.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8896999999999999e-05 2024-09-17T02:21:26.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:26.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557707+0000", 2024-09-17T02:21:26.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3839e-05 2024-09-17T02:21:26.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557730+0000", 2024-09-17T02:21:26.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3047000000000001e-05 2024-09-17T02:21:26.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:26.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582329+0000", 2024-09-17T02:21:26.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024599283999999999 2024-09-17T02:21:26.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:26.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582624+0000", 2024-09-17T02:21:26.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000294462 2024-09-17T02:21:26.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:26.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582936+0000", 2024-09-17T02:21:26.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031223399999999999 2024-09-17T02:21:26.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:26.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587347+0000", 2024-09-17T02:21:26.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044110340000000003 2024-09-17T02:21:26.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:26.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592165+0000", 2024-09-17T02:21:26.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048176699999999996 2024-09-17T02:21:26.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:26.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592311+0000", 2024-09-17T02:21:26.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014661899999999999 2024-09-17T02:21:26.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:26.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592389+0000", 2024-09-17T02:21:26.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7602999999999995e-05 2024-09-17T02:21:26.376 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.376 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:26.376 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.376 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:26.376 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:21:26.376 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 69.803960013999998, 2024-09-17T02:21:26.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034457472000000003, 2024-09-17T02:21:26.376 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:26.376 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:26.376 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:26.377 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:26.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:26.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:21:26.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:26.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:21:26.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:26.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558113+0000", 2024-09-17T02:21:26.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1639999999999999e-06 2024-09-17T02:21:26.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:26.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558125+0000", 2024-09-17T02:21:26.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2269999999999999e-05 2024-09-17T02:21:26.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:26.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558458+0000", 2024-09-17T02:21:26.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033322700000000001 2024-09-17T02:21:26.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558488+0000", 2024-09-17T02:21:26.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.951e-05 2024-09-17T02:21:26.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:26.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584514+0000", 2024-09-17T02:21:26.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026025721000000002 2024-09-17T02:21:26.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:26.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584781+0000", 2024-09-17T02:21:26.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000267142 2024-09-17T02:21:26.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:26.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585078+0000", 2024-09-17T02:21:26.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029738799999999999 2024-09-17T02:21:26.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:26.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588045+0000", 2024-09-17T02:21:26.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029673759999999999 2024-09-17T02:21:26.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:26.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592454+0000", 2024-09-17T02:21:26.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044090209999999999 2024-09-17T02:21:26.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:26.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592520+0000", 2024-09-17T02:21:26.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6032999999999996e-05 2024-09-17T02:21:26.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:26.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592568+0000", 2024-09-17T02:21:26.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7620000000000001e-05 2024-09-17T02:21:26.383 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.383 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:26.383 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.383 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:26.383 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:21:26.383 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 69.803318547999993, 2024-09-17T02:21:26.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034114029999999997, 2024-09-17T02:21:26.383 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:26.383 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:26.384 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:26.384 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:26.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:26.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:21:26.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:26.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:21:26.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:26.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558753+0000", 2024-09-17T02:21:26.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2699999999999999e-06 2024-09-17T02:21:26.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:26.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558769+0000", 2024-09-17T02:21:26.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5906e-05 2024-09-17T02:21:26.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:26.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558791+0000", 2024-09-17T02:21:26.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1342999999999999e-05 2024-09-17T02:21:26.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558806+0000", 2024-09-17T02:21:26.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5829999999999999e-05 2024-09-17T02:21:26.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:26.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584906+0000", 2024-09-17T02:21:26.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026099273999999999 2024-09-17T02:21:26.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:26.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585158+0000", 2024-09-17T02:21:26.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025194600000000002 2024-09-17T02:21:26.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:26.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585368+0000", 2024-09-17T02:21:26.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210068 2024-09-17T02:21:26.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:26.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588098+0000", 2024-09-17T02:21:26.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002730522 2024-09-17T02:21:26.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:26.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592680+0000", 2024-09-17T02:21:26.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045816019999999997 2024-09-17T02:21:26.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:26.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592774+0000", 2024-09-17T02:21:26.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3726000000000004e-05 2024-09-17T02:21:26.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:26.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592866+0000", 2024-09-17T02:21:26.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2542999999999998e-05 2024-09-17T02:21:26.388 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.388 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:26.389 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.389 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28720 5.f e28/22 5:f8a7aea5:::benchmark_data_smithi001_23533_object28719:head v 28'1756, mlcod=28'1754)", 2024-09-17T02:21:26.389 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:21:26.389 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.791950747999998, 2024-09-17T02:21:26.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033308717000000002, 2024-09-17T02:21:26.389 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:26.389 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:26.389 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:26.389 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:26.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:26.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:21:26.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:26.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:21:26.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:26.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570121+0000", 2024-09-17T02:21:26.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4e-07 2024-09-17T02:21:26.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:26.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570208+0000", 2024-09-17T02:21:26.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6945000000000002e-05 2024-09-17T02:21:26.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:26.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570222+0000", 2024-09-17T02:21:26.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4541e-05 2024-09-17T02:21:26.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570232+0000", 2024-09-17T02:21:26.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3039999999999994e-06 2024-09-17T02:21:26.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:26.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570273+0000", 2024-09-17T02:21:26.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1950999999999999e-05 2024-09-17T02:21:26.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:26.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570286+0000", 2024-09-17T02:21:26.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2268e-05 2024-09-17T02:21:26.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:26.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603312+0000", 2024-09-17T02:21:26.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033026405000000002 2024-09-17T02:21:26.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:26.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603429+0000", 2024-09-17T02:21:26.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116463 2024-09-17T02:21:26.394 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.394 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:26.394 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.394 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28721 5.a e28/22 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head v 28'1872, mlcod=28'1869)", 2024-09-17T02:21:26.394 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:21:26.394 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.791807241999997, 2024-09-17T02:21:26.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033539817999999999, 2024-09-17T02:21:26.394 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:26.394 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:26.394 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:26.394 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:26.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:26.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:21:26.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:26.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:21:26.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:26.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570264+0000", 2024-09-17T02:21:26.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0999999999999997e-07 2024-09-17T02:21:26.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:26.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570299+0000", 2024-09-17T02:21:26.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4876999999999998e-05 2024-09-17T02:21:26.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:26.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570310+0000", 2024-09-17T02:21:26.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0958000000000001e-05 2024-09-17T02:21:26.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570316+0000", 2024-09-17T02:21:26.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.485e-06 2024-09-17T02:21:26.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:26.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598947+0000", 2024-09-17T02:21:26.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.028631058000000001 2024-09-17T02:21:26.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:26.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598969+0000", 2024-09-17T02:21:26.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2005999999999999e-05 2024-09-17T02:21:26.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:26.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.602638+0000", 2024-09-17T02:21:26.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036690339999999998 2024-09-17T02:21:26.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:26.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603803+0000", 2024-09-17T02:21:26.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00116559 2024-09-17T02:21:26.398 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.398 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:26.398 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.399 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97749 5.b 5:d930ef52:::benchmark_data_smithi001_23533_object97748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:26.399 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:26.399 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.7701243279999996, 2024-09-17T02:21:26.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092964343000000005, 2024-09-17T02:21:26.399 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:26.399 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:26.399 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:26.399 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:26.399 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:26.399 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:26.399 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97749 2024-09-17T02:21:26.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.399 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:26.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:26.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:26.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:26.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:26.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:26.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591947+0000", 2024-09-17T02:21:26.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:21:26.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:26.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592011+0000", 2024-09-17T02:21:26.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3608000000000005e-05 2024-09-17T02:21:26.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:26.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592021+0000", 2024-09-17T02:21:26.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9979999999999998e-06 2024-09-17T02:21:26.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592028+0000", 2024-09-17T02:21:26.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1439999999999997e-06 2024-09-17T02:21:26.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:26.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593633+0000", 2024-09-17T02:21:26.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001604636 2024-09-17T02:21:26.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:26.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593757+0000", 2024-09-17T02:21:26.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012432099999999999 2024-09-17T02:21:26.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:26.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593866+0000", 2024-09-17T02:21:26.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109094 2024-09-17T02:21:26.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:26.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601190+0000", 2024-09-17T02:21:26.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073237620000000002 2024-09-17T02:21:26.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:26.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601356+0000", 2024-09-17T02:21:26.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016651900000000001 2024-09-17T02:21:26.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:26.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684618+0000", 2024-09-17T02:21:26.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083261356999999994 2024-09-17T02:21:26.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:26.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684724+0000", 2024-09-17T02:21:26.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010681800000000001 2024-09-17T02:21:26.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:26.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684911+0000", 2024-09-17T02:21:26.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186243 2024-09-17T02:21:26.405 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.405 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:26.405 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.405 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97752 5.b 5:d146f486:::benchmark_data_smithi001_23533_object97751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:26.406 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:26.406 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.7687716340000001, 2024-09-17T02:21:26.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091989557, 2024-09-17T02:21:26.406 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:26.406 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:26.406 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:26.406 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:26.406 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:26.406 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:26.406 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97752 2024-09-17T02:21:26.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.406 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:26.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:26.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:26.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:26.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:26.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:26.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593300+0000", 2024-09-17T02:21:26.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8199999999999998e-07 2024-09-17T02:21:26.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:26.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593364+0000", 2024-09-17T02:21:26.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3831999999999995e-05 2024-09-17T02:21:26.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:26.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593376+0000", 2024-09-17T02:21:26.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1800999999999999e-05 2024-09-17T02:21:26.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593382+0000", 2024-09-17T02:21:26.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6780000000000003e-06 2024-09-17T02:21:26.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:26.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595491+0000", 2024-09-17T02:21:26.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021090689999999999 2024-09-17T02:21:26.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:26.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595614+0000", 2024-09-17T02:21:26.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012321500000000001 2024-09-17T02:21:26.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:26.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595778+0000", 2024-09-17T02:21:26.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016321900000000001 2024-09-17T02:21:26.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:26.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601197+0000", 2024-09-17T02:21:26.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054195600000000003 2024-09-17T02:21:26.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:26.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601396+0000", 2024-09-17T02:21:26.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019825299999999999 2024-09-17T02:21:26.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:26.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684990+0000", 2024-09-17T02:21:26.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083594878999999997 2024-09-17T02:21:26.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:26.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685116+0000", 2024-09-17T02:21:26.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012522799999999999 2024-09-17T02:21:26.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:26.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685289+0000", 2024-09-17T02:21:26.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172941 2024-09-17T02:21:26.412 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.412 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:26.412 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.412 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97754 5.b 5:da0615e5:::benchmark_data_smithi001_23533_object97753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:26.412 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:26.412 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.7671337119999997, 2024-09-17T02:21:26.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092097207, 2024-09-17T02:21:26.413 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:26.413 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:26.413 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:26.413 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:26.413 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:26.413 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:26.413 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97754 2024-09-17T02:21:26.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.413 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:26.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:26.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:26.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:26.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:26.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:26.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594938+0000", 2024-09-17T02:21:26.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5000000000000002e-07 2024-09-17T02:21:26.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:26.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595075+0000", 2024-09-17T02:21:26.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137742 2024-09-17T02:21:26.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:26.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595087+0000", 2024-09-17T02:21:26.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1243000000000001e-05 2024-09-17T02:21:26.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595095+0000", 2024-09-17T02:21:26.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1030000000000002e-06 2024-09-17T02:21:26.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:26.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598461+0000", 2024-09-17T02:21:26.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033661170000000001 2024-09-17T02:21:26.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:26.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598540+0000", 2024-09-17T02:21:26.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8937999999999995e-05 2024-09-17T02:21:26.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:26.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598626+0000", 2024-09-17T02:21:26.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6042000000000001e-05 2024-09-17T02:21:26.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:26.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684258+0000", 2024-09-17T02:21:26.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085632394000000001 2024-09-17T02:21:26.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:26.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685369+0000", 2024-09-17T02:21:26.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001111063 2024-09-17T02:21:26.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:26.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685511+0000", 2024-09-17T02:21:26.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141965 2024-09-17T02:21:26.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:26.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685604+0000", 2024-09-17T02:21:26.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2935000000000004e-05 2024-09-17T02:21:26.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:26.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687034+0000", 2024-09-17T02:21:26.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001430015 2024-09-17T02:21:26.419 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.419 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:26.420 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.420 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97755 5.b 5:d36a03a1:::benchmark_data_smithi001_23533_object97754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:26.420 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:26.420 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.7669605619999995, 2024-09-17T02:21:26.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0924904, 2024-09-17T02:21:26.420 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:26.420 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:26.421 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:26.421 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:26.421 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:26.421 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:26.421 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97755 2024-09-17T02:21:26.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.421 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:26.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:26.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:26.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:26.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:26.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:26.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595111+0000", 2024-09-17T02:21:26.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:21:26.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:26.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595145+0000", 2024-09-17T02:21:26.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3927000000000002e-05 2024-09-17T02:21:26.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:26.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595155+0000", 2024-09-17T02:21:26.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0023e-05 2024-09-17T02:21:26.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595162+0000", 2024-09-17T02:21:26.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3950000000000003e-06 2024-09-17T02:21:26.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:26.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599821+0000", 2024-09-17T02:21:26.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046592880000000001 2024-09-17T02:21:26.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:26.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599912+0000", 2024-09-17T02:21:26.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1049000000000002e-05 2024-09-17T02:21:26.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:26.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600062+0000", 2024-09-17T02:21:26.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015001700000000001 2024-09-17T02:21:26.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:26.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685307+0000", 2024-09-17T02:21:26.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085244340000000002 2024-09-17T02:21:26.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:26.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685446+0000", 2024-09-17T02:21:26.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013955700000000001 2024-09-17T02:21:26.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:26.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687375+0000", 2024-09-17T02:21:26.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019291079999999999 2024-09-17T02:21:26.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:26.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687462+0000", 2024-09-17T02:21:26.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6148000000000003e-05 2024-09-17T02:21:26.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:26.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687600+0000", 2024-09-17T02:21:26.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013887900000000001 2024-09-17T02:21:26.427 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.427 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:26.427 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.427 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPush(5.3 44/38 [PushOp(5:c45b310d:::benchmark_data_smithi001_23533_object73736:head, version: 39'4672, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(5:c45b310d:::benchmark_data_smithi001_23533_object73736:head@39'4672, size: 65536, copy_subset: [(0, 65536)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 65536, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-17T02:21:26.427 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597100+0000", 2024-09-17T02:21:26.427 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.7649704419999992, 2024-09-17T02:21:26.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.089325374999999999, 2024-09-17T02:21:26.428 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:26.428 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:26.428 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:26.428 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:26.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:26.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597100+0000", 2024-09-17T02:21:26.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:26.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597100+0000", 2024-09-17T02:21:26.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:26.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597101+0000", 2024-09-17T02:21:26.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4899999999999995e-07 2024-09-17T02:21:26.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:26.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597155+0000", 2024-09-17T02:21:26.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4466999999999999e-05 2024-09-17T02:21:26.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:26.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597174+0000", 2024-09-17T02:21:26.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8393000000000002e-05 2024-09-17T02:21:26.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597189+0000", 2024-09-17T02:21:26.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5716999999999999e-05 2024-09-17T02:21:26.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:26.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684442+0000", 2024-09-17T02:21:26.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.087252918999999998 2024-09-17T02:21:26.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:26.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684479+0000", 2024-09-17T02:21:26.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6902e-05 2024-09-17T02:21:26.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:26.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.686426+0000", 2024-09-17T02:21:26.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001946328 2024-09-17T02:21:26.431 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.431 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:26.431 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.432 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 44/44 lb 5:c4567a04:::benchmark_data_smithi001_23533_object4200:head)", 2024-09-17T02:21:26.432 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:26.432 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.7648639359999994, 2024-09-17T02:21:26.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092483421999999996, 2024-09-17T02:21:26.432 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:26.432 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:26.432 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:26.432 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:26.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:26.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:26.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:26.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:26.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:26.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:26.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6399999999999998e-07 2024-09-17T02:21:26.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:26.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597213+0000", 2024-09-17T02:21:26.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3659999999999997e-06 2024-09-17T02:21:26.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:26.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597222+0000", 2024-09-17T02:21:26.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0510000000000002e-06 2024-09-17T02:21:26.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597228+0000", 2024-09-17T02:21:26.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1569999999999999e-06 2024-09-17T02:21:26.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:26.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689588+0000", 2024-09-17T02:21:26.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092359931000000006 2024-09-17T02:21:26.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:26.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689622+0000", 2024-09-17T02:21:26.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4425999999999999e-05 2024-09-17T02:21:26.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:26.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689690+0000", 2024-09-17T02:21:26.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8126999999999993e-05 2024-09-17T02:21:26.436 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.436 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:26.436 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.436 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:97759 5.a e44/22 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head v 44'6175, mlcod=44'6173)", 2024-09-17T02:21:26.436 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.599333+0000", 2024-09-17T02:21:26.437 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.7627377160000002, 2024-09-17T02:21:26.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088908582, 2024-09-17T02:21:26.437 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:26.437 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:26.437 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:26.437 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:26.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:26.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599333+0000", 2024-09-17T02:21:26.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:26.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599333+0000", 2024-09-17T02:21:26.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:26.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599334+0000", 2024-09-17T02:21:26.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6700000000000003e-07 2024-09-17T02:21:26.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:26.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599503+0000", 2024-09-17T02:21:26.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0001693 2024-09-17T02:21:26.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:26.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599510+0000", 2024-09-17T02:21:26.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0469999999999996e-06 2024-09-17T02:21:26.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599514+0000", 2024-09-17T02:21:26.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0069999999999999e-06 2024-09-17T02:21:26.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:26.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599559+0000", 2024-09-17T02:21:26.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4697999999999998e-05 2024-09-17T02:21:26.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:26.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599570+0000", 2024-09-17T02:21:26.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1042e-05 2024-09-17T02:21:26.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:26.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.688181+0000", 2024-09-17T02:21:26.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088611756999999999 2024-09-17T02:21:26.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:26.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.688242+0000", 2024-09-17T02:21:26.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0064e-05 2024-09-17T02:21:26.441 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.441 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:26.441 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.441 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97762 5.4 5:2c64abcd:::benchmark_data_smithi001_23533_object97761:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:26.441 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.599394+0000", 2024-09-17T02:21:26.442 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.7626761809999998, 2024-09-17T02:21:26.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088655857000000005, 2024-09-17T02:21:26.442 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:26.442 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:26.442 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:26.442 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:26.442 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:26.442 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:26.442 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97762 2024-09-17T02:21:26.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.443 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:26.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:26.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599394+0000", 2024-09-17T02:21:26.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:26.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599394+0000", 2024-09-17T02:21:26.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:26.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599395+0000", 2024-09-17T02:21:26.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.85e-07 2024-09-17T02:21:26.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:26.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599442+0000", 2024-09-17T02:21:26.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6964e-05 2024-09-17T02:21:26.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:26.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599454+0000", 2024-09-17T02:21:26.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1841999999999999e-05 2024-09-17T02:21:26.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599459+0000", 2024-09-17T02:21:26.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1000000000000003e-06 2024-09-17T02:21:26.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:26.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599511+0000", 2024-09-17T02:21:26.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1814999999999998e-05 2024-09-17T02:21:26.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:26.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599627+0000", 2024-09-17T02:21:26.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116087 2024-09-17T02:21:26.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:26.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599716+0000", 2024-09-17T02:21:26.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9174999999999999e-05 2024-09-17T02:21:26.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:26.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687757+0000", 2024-09-17T02:21:26.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088040361999999997 2024-09-17T02:21:26.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:26.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687778+0000", 2024-09-17T02:21:26.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1229e-05 2024-09-17T02:21:26.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:26.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687833+0000", 2024-09-17T02:21:26.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4928e-05 2024-09-17T02:21:26.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:26.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687916+0000", 2024-09-17T02:21:26.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3175000000000002e-05 2024-09-17T02:21:26.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:26.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.688050+0000", 2024-09-17T02:21:26.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013429499999999999 2024-09-17T02:21:26.448 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.448 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:26.449 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.449 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPushReply(5.4 44/36 [PushReplyOp(5:291a38c7:::benchmark_data_smithi001_23533_object22817:head)])", 2024-09-17T02:21:26.449 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.599945+0000", 2024-09-17T02:21:26.449 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.762125417, 2024-09-17T02:21:26.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.084468808000000006, 2024-09-17T02:21:26.449 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:26.449 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:26.449 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-17T02:21:26.449 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:26.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:26.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599945+0000", 2024-09-17T02:21:26.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:26.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599945+0000", 2024-09-17T02:21:26.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:26.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599945+0000", 2024-09-17T02:21:26.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1e-07 2024-09-17T02:21:26.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:26.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599949+0000", 2024-09-17T02:21:26.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2849999999999999e-06 2024-09-17T02:21:26.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:26.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599956+0000", 2024-09-17T02:21:26.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3640000000000001e-06 2024-09-17T02:21:26.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599962+0000", 2024-09-17T02:21:26.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2360000000000001e-06 2024-09-17T02:21:26.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:26.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601282+0000", 2024-09-17T02:21:26.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001319808 2024-09-17T02:21:26.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:26.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684414+0000", 2024-09-17T02:21:26.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083131905000000006 2024-09-17T02:21:26.452 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.452 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:26.453 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.453 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:97761 5.9 e44/22 5:908717b6:::benchmark_data_smithi001_23533_object97760:head v 44'6129, mlcod=44'6125)", 2024-09-17T02:21:26.453 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.599983+0000", 2024-09-17T02:21:26.453 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.7620876289999998, 2024-09-17T02:21:26.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091911272000000002, 2024-09-17T02:21:26.453 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:26.453 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:26.453 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:26.453 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:26.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:26.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599983+0000", 2024-09-17T02:21:26.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:26.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599983+0000", 2024-09-17T02:21:26.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:26.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599983+0000", 2024-09-17T02:21:26.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1100000000000002e-07 2024-09-17T02:21:26.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:26.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600085+0000", 2024-09-17T02:21:26.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102007 2024-09-17T02:21:26.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:26.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600094+0000", 2024-09-17T02:21:26.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1850000000000004e-06 2024-09-17T02:21:26.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600099+0000", 2024-09-17T02:21:26.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6640000000000003e-06 2024-09-17T02:21:26.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:26.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600140+0000", 2024-09-17T02:21:26.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0998999999999998e-05 2024-09-17T02:21:26.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:26.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600157+0000", 2024-09-17T02:21:26.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7122999999999999e-05 2024-09-17T02:21:26.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:26.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.691795+0000", 2024-09-17T02:21:26.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091638002999999996 2024-09-17T02:21:26.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:26.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.691894+0000", 2024-09-17T02:21:26.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8980000000000004e-05 2024-09-17T02:21:26.457 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.457 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:26.457 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.458 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:97749 5.b e44/38 ondisk, result = 0)", 2024-09-17T02:21:26.458 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.600115+0000", 2024-09-17T02:21:26.458 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.7619556359999997, 2024-09-17T02:21:26.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.084148770999999997, 2024-09-17T02:21:26.458 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:26.458 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:26.458 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:26.458 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:26.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:26.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600115+0000", 2024-09-17T02:21:26.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:26.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600115+0000", 2024-09-17T02:21:26.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:26.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600115+0000", 2024-09-17T02:21:26.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.39e-07 2024-09-17T02:21:26.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:26.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600119+0000", 2024-09-17T02:21:26.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3060000000000002e-06 2024-09-17T02:21:26.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:26.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600125+0000", 2024-09-17T02:21:26.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3330000000000002e-06 2024-09-17T02:21:26.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600130+0000", 2024-09-17T02:21:26.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8999999999999997e-06 2024-09-17T02:21:26.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:26.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601349+0000", 2024-09-17T02:21:26.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012192209999999999 2024-09-17T02:21:26.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:26.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601353+0000", 2024-09-17T02:21:26.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9149999999999998e-06 2024-09-17T02:21:26.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:26.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684264+0000", 2024-09-17T02:21:26.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.082910757000000002 2024-09-17T02:21:26.461 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.462 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:26.462 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.462 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:97754 5.b e44/38 ondisk, result = 0)", 2024-09-17T02:21:26.462 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.601431+0000", 2024-09-17T02:21:26.463 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.76063948, 2024-09-17T02:21:26.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085620499000000003, 2024-09-17T02:21:26.463 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:26.463 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:26.463 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:26.463 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:26.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:26.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601431+0000", 2024-09-17T02:21:26.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:26.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601431+0000", 2024-09-17T02:21:26.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:26.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601432+0000", 2024-09-17T02:21:26.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8400000000000004e-07 2024-09-17T02:21:26.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:26.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601435+0000", 2024-09-17T02:21:26.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9969999999999999e-06 2024-09-17T02:21:26.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:26.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684720+0000", 2024-09-17T02:21:26.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083285740999999996 2024-09-17T02:21:26.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684750+0000", 2024-09-17T02:21:26.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9632999999999999e-05 2024-09-17T02:21:26.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:26.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685492+0000", 2024-09-17T02:21:26.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00074159699999999998 2024-09-17T02:21:26.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:26.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685503+0000", 2024-09-17T02:21:26.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1294999999999999e-05 2024-09-17T02:21:26.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:26.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687052+0000", 2024-09-17T02:21:26.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001548652 2024-09-17T02:21:26.564 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.564 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:26.564 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.565 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:97749 5.b e44/38 ondisk, result = 0)", 2024-09-17T02:21:26.565 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.601857+0000", 2024-09-17T02:21:26.565 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.7602140290000001, 2024-09-17T02:21:26.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083064447999999999, 2024-09-17T02:21:26.565 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:26.565 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:26.565 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:26.565 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:26.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:26.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601857+0000", 2024-09-17T02:21:26.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:26.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601857+0000", 2024-09-17T02:21:26.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:26.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:26.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601857+0000", 2024-09-17T02:21:26.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5799999999999999e-07 2024-09-17T02:21:26.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:26.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601862+0000", 2024-09-17T02:21:26.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1900000000000003e-06 2024-09-17T02:21:26.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:26.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684426+0000", 2024-09-17T02:21:26.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.082564018000000003 2024-09-17T02:21:26.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684443+0000", 2024-09-17T02:21:26.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6986e-05 2024-09-17T02:21:26.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:26.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684592+0000", 2024-09-17T02:21:26.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000148818 2024-09-17T02:21:26.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:26.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684607+0000", 2024-09-17T02:21:26.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5033e-05 2024-09-17T02:21:26.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:26.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:26.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:26.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684921+0000", 2024-09-17T02:21:26.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031374499999999999 2024-09-17T02:21:26.569 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.569 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:26.569 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.569 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:26.569 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:26.569 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:26.569 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T02:21:26.571 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:26.570+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:26.571 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:26.671 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:26.670+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:26.730 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:26.731 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:26.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.731 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4466.0:115981 5.a e47/22)", 2024-09-17T02:21:26.731 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:26.734542+0000", 2024-09-17T02:21:26.731 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00028905899999999998, 2024-09-17T02:21:26.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030773600000000002, 2024-09-17T02:21:26.731 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:26.731 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:26.732 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:26.732 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:26.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:26.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.734542+0000", 2024-09-17T02:21:26.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:26.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:26.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.734542+0000", 2024-09-17T02:21:26.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:26.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:26.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.734542+0000", 2024-09-17T02:21:26.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7599999999999998e-07 2024-09-17T02:21:26.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:26.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.734545+0000", 2024-09-17T02:21:26.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7539999999999998e-06 2024-09-17T02:21:26.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:26.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.734551+0000", 2024-09-17T02:21:26.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3820000000000003e-06 2024-09-17T02:21:26.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.734555+0000", 2024-09-17T02:21:26.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1389999999999997e-06 2024-09-17T02:21:26.735 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:26.735 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:26.735 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:26.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.736 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:115978 5.c 5:3501891a:::benchmark_data_smithi001_23533_object115977:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T02:21:26.736 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:26.725950+0000", 2024-09-17T02:21:26.736 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0088808150000000002, 2024-09-17T02:21:26.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089533379999999999, 2024-09-17T02:21:26.736 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:26.736 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:26.736 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:26.736 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:26.737 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:26.737 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:26.737 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 115978 2024-09-17T02:21:26.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.737 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:26.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:26.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.725950+0000", 2024-09-17T02:21:26.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:26.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:26.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.725950+0000", 2024-09-17T02:21:26.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:26.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:26.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.725951+0000", 2024-09-17T02:21:26.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7300000000000005e-07 2024-09-17T02:21:26.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:26.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.725985+0000", 2024-09-17T02:21:26.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3927000000000002e-05 2024-09-17T02:21:26.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:26.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.726016+0000", 2024-09-17T02:21:26.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1062999999999997e-05 2024-09-17T02:21:26.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.726024+0000", 2024-09-17T02:21:26.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1790000000000008e-06 2024-09-17T02:21:26.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:26.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.727892+0000", 2024-09-17T02:21:26.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001867748 2024-09-17T02:21:26.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:26.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728029+0000", 2024-09-17T02:21:26.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013700799999999999 2024-09-17T02:21:26.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:26.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728227+0000", 2024-09-17T02:21:26.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000198362 2024-09-17T02:21:26.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:26.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.733677+0000", 2024-09-17T02:21:26.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0054497620000000004 2024-09-17T02:21:26.742 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:26.742 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:26.742 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:26.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.742 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:115981 5.a 5:5e8838b9:::benchmark_data_smithi001_23533_object115980:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T02:21:26.742 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:26.728282+0000", 2024-09-17T02:21:26.742 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0065493410000000002, 2024-09-17T02:21:26.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066772740000000004, 2024-09-17T02:21:26.743 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:26.743 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:26.743 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:26.743 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:26.743 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:26.743 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:26.743 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 115981 2024-09-17T02:21:26.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.743 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:26.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:26.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728282+0000", 2024-09-17T02:21:26.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:26.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:26.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728282+0000", 2024-09-17T02:21:26.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:26.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:26.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728283+0000", 2024-09-17T02:21:26.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.144e-06 2024-09-17T02:21:26.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:26.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728381+0000", 2024-09-17T02:21:26.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7726999999999995e-05 2024-09-17T02:21:26.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:26.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728394+0000", 2024-09-17T02:21:26.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3232e-05 2024-09-17T02:21:26.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728402+0000", 2024-09-17T02:21:26.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7810000000000005e-06 2024-09-17T02:21:26.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:26.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.730974+0000", 2024-09-17T02:21:26.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025722539999999999 2024-09-17T02:21:26.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:26.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.731110+0000", 2024-09-17T02:21:26.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013632999999999999 2024-09-17T02:21:26.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:26.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.731200+0000", 2024-09-17T02:21:26.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9341999999999999e-05 2024-09-17T02:21:26.747 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:26.747 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:26.747 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:26.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.747 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:115982 5.6 5:60b26e17:::benchmark_data_smithi001_23533_object115981:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T02:21:26.748 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:26.728418+0000", 2024-09-17T02:21:26.748 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0064128359999999999, 2024-09-17T02:21:26.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0065803629999999997, 2024-09-17T02:21:26.748 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:26.748 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:26.748 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:26.748 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:26.748 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:26.748 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:26.748 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 115982 2024-09-17T02:21:26.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.748 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:26.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:26.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728418+0000", 2024-09-17T02:21:26.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:26.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:26.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728418+0000", 2024-09-17T02:21:26.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:26.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:26.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728419+0000", 2024-09-17T02:21:26.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7999999999999995e-07 2024-09-17T02:21:26.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:26.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728449+0000", 2024-09-17T02:21:26.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0137e-05 2024-09-17T02:21:26.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:26.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728456+0000", 2024-09-17T02:21:26.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5410000000000003e-06 2024-09-17T02:21:26.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728463+0000", 2024-09-17T02:21:26.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4509999999999997e-06 2024-09-17T02:21:26.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:26.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728527+0000", 2024-09-17T02:21:26.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3639999999999994e-05 2024-09-17T02:21:26.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:26.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728657+0000", 2024-09-17T02:21:26.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130856 2024-09-17T02:21:26.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:26.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728864+0000", 2024-09-17T02:21:26.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020703 2024-09-17T02:21:26.752 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:26.752 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:26.752 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:26.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.753 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:115985 5.5 5:a57ee3a5:::benchmark_data_smithi001_23533_object115984:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T02:21:26.753 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:26.728545+0000", 2024-09-17T02:21:26.753 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0062858180000000003, 2024-09-17T02:21:26.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0065043999999999996, 2024-09-17T02:21:26.753 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:26.753 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:26.753 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:26.753 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:26.753 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:26.753 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:26.753 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 115985 2024-09-17T02:21:26.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.754 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:26.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:26.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728545+0000", 2024-09-17T02:21:26.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:26.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:26.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728545+0000", 2024-09-17T02:21:26.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:26.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:26.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728546+0000", 2024-09-17T02:21:26.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.68e-07 2024-09-17T02:21:26.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:26.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728630+0000", 2024-09-17T02:21:26.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3774000000000001e-05 2024-09-17T02:21:26.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:26.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728638+0000", 2024-09-17T02:21:26.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3040000000000005e-06 2024-09-17T02:21:26.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728643+0000", 2024-09-17T02:21:26.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6210000000000001e-06 2024-09-17T02:21:26.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:26.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728910+0000", 2024-09-17T02:21:26.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00026628600000000002 2024-09-17T02:21:26.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:26.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.729068+0000", 2024-09-17T02:21:26.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000157997 2024-09-17T02:21:26.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:26.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.729198+0000", 2024-09-17T02:21:26.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012990000000000001 2024-09-17T02:21:26.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:26.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.732559+0000", 2024-09-17T02:21:26.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033617429999999999 2024-09-17T02:21:26.758 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:26.758 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:26.758 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:26.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.759 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:115980 5.e e47/22 5:75ba8912:::benchmark_data_smithi001_23533_object115979:head v 47'7249, mlcod=47'7247)", 2024-09-17T02:21:26.759 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:26.728788+0000", 2024-09-17T02:21:26.759 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0060427659999999998, 2024-09-17T02:21:26.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063021370000000002, 2024-09-17T02:21:26.759 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:26.759 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:26.759 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:26.759 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:26.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:26.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728788+0000", 2024-09-17T02:21:26.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:26.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:26.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728788+0000", 2024-09-17T02:21:26.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:26.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:26.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728789+0000", 2024-09-17T02:21:26.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2899999999999999e-07 2024-09-17T02:21:26.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:26.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728840+0000", 2024-09-17T02:21:26.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1063000000000002e-05 2024-09-17T02:21:26.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:26.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728848+0000", 2024-09-17T02:21:26.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4759999999999998e-06 2024-09-17T02:21:26.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728853+0000", 2024-09-17T02:21:26.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1499999999999998e-06 2024-09-17T02:21:26.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:26.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728904+0000", 2024-09-17T02:21:26.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0896999999999997e-05 2024-09-17T02:21:26.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:26.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.728921+0000", 2024-09-17T02:21:26.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6710000000000001e-05 2024-09-17T02:21:26.762 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:26.762 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:26.763 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:26.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.763 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:115986 5.e e47/22 5:7ab4b93d:::benchmark_data_smithi001_23533_object115985:head v 47'7250, mlcod=47'7247)", 2024-09-17T02:21:26.763 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:26.730942+0000", 2024-09-17T02:21:26.763 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0038885959999999998, 2024-09-17T02:21:26.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041777630000000001, 2024-09-17T02:21:26.763 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:26.763 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:26.763 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:26.763 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:26.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:26.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.730942+0000", 2024-09-17T02:21:26.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:26.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:26.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.730942+0000", 2024-09-17T02:21:26.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:26.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:26.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.730943+0000", 2024-09-17T02:21:26.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5600000000000001e-07 2024-09-17T02:21:26.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:26.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.730973+0000", 2024-09-17T02:21:26.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9776000000000001e-05 2024-09-17T02:21:26.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:26.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.730980+0000", 2024-09-17T02:21:26.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3139999999999998e-06 2024-09-17T02:21:26.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.730985+0000", 2024-09-17T02:21:26.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2669999999999997e-06 2024-09-17T02:21:26.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:26.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.733635+0000", 2024-09-17T02:21:26.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026495490000000002 2024-09-17T02:21:26.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:26.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.733654+0000", 2024-09-17T02:21:26.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9283000000000002e-05 2024-09-17T02:21:26.767 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:26.767 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:26.767 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:26.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.767 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:115987 5.8 5:1ee9722a:::benchmark_data_smithi001_23533_object115986:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T02:21:26.767 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:26.731038+0000", 2024-09-17T02:21:26.767 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0037930220000000001, 2024-09-17T02:21:26.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041158569999999997, 2024-09-17T02:21:26.767 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:26.768 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:26.768 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:26.768 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:26.768 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:26.768 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:26.768 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 115987 2024-09-17T02:21:26.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.768 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:26.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:26.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.731038+0000", 2024-09-17T02:21:26.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:26.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:26.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.731038+0000", 2024-09-17T02:21:26.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:26.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:26.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.731039+0000", 2024-09-17T02:21:26.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0899999999999999e-06 2024-09-17T02:21:26.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:26.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.731064+0000", 2024-09-17T02:21:26.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5364999999999999e-05 2024-09-17T02:21:26.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:26.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.731072+0000", 2024-09-17T02:21:26.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6399999999999997e-06 2024-09-17T02:21:26.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.731078+0000", 2024-09-17T02:21:26.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3640000000000004e-06 2024-09-17T02:21:26.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:26.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.731127+0000", 2024-09-17T02:21:26.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8767999999999998e-05 2024-09-17T02:21:26.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:26.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.731249+0000", 2024-09-17T02:21:26.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012219499999999999 2024-09-17T02:21:26.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:26.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.731392+0000", 2024-09-17T02:21:26.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000142989 2024-09-17T02:21:26.771 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:26.772 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:26.772 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:26.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.772 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:115988 5.4 e47/36 5:251715a3:::benchmark_data_smithi001_23533_object115987:head v 47'7125, mlcod=47'7122)", 2024-09-17T02:21:26.772 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:26.731474+0000", 2024-09-17T02:21:26.772 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0033574820000000002, 2024-09-17T02:21:26.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037183580000000002, 2024-09-17T02:21:26.772 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:26.772 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:26.772 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:26.772 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:26.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:26.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.731474+0000", 2024-09-17T02:21:26.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:26.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:26.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.731474+0000", 2024-09-17T02:21:26.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:26.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:26.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.731474+0000", 2024-09-17T02:21:26.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2e-07 2024-09-17T02:21:26.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:26.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.731653+0000", 2024-09-17T02:21:26.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000178958 2024-09-17T02:21:26.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:26.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.731662+0000", 2024-09-17T02:21:26.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.789e-06 2024-09-17T02:21:26.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.731668+0000", 2024-09-17T02:21:26.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8209999999999998e-06 2024-09-17T02:21:26.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:26.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.731718+0000", 2024-09-17T02:21:26.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9982999999999999e-05 2024-09-17T02:21:26.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:26.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.731737+0000", 2024-09-17T02:21:26.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9228e-05 2024-09-17T02:21:26.775 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:26.775 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:26.776 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:26.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.776 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:115990 5.b e47/38 5:dcae7466:::benchmark_data_smithi001_23533_object115989:head v 47'7191, mlcod=47'7189)", 2024-09-17T02:21:26.776 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:26.731715+0000", 2024-09-17T02:21:26.776 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0031158480000000001, 2024-09-17T02:21:26.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035068550000000001, 2024-09-17T02:21:26.776 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:26.776 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:26.776 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:26.776 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:26.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:26.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.731715+0000", 2024-09-17T02:21:26.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:26.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:26.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.731715+0000", 2024-09-17T02:21:26.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:26.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:26.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.731716+0000", 2024-09-17T02:21:26.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9000000000000002e-07 2024-09-17T02:21:26.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:26.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.731815+0000", 2024-09-17T02:21:26.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9395999999999995e-05 2024-09-17T02:21:26.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:26.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.731829+0000", 2024-09-17T02:21:26.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3574000000000001e-05 2024-09-17T02:21:26.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.731835+0000", 2024-09-17T02:21:26.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7229999999999998e-06 2024-09-17T02:21:26.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:26.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.731893+0000", 2024-09-17T02:21:26.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8063000000000003e-05 2024-09-17T02:21:26.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:26.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.731919+0000", 2024-09-17T02:21:26.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5979999999999999e-05 2024-09-17T02:21:26.779 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:26.780 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:26.780 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:26.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.780 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:115993 5.a 5:57d4b6c9:::benchmark_data_smithi001_23533_object115992:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T02:21:26.780 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:26.733797+0000", 2024-09-17T02:21:26.780 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0010339259999999999, 2024-09-17T02:21:26.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014568300000000001, 2024-09-17T02:21:26.780 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:26.780 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:26.780 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:26.780 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:26.781 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:26.781 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:26.781 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 115993 2024-09-17T02:21:26.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.781 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:26.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:26.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.733797+0000", 2024-09-17T02:21:26.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:26.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:26.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.733797+0000", 2024-09-17T02:21:26.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:26.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:26.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.733798+0000", 2024-09-17T02:21:26.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1930000000000001e-06 2024-09-17T02:21:26.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:26.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.733845+0000", 2024-09-17T02:21:26.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6545000000000002e-05 2024-09-17T02:21:26.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:26.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.733858+0000", 2024-09-17T02:21:26.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2714999999999999e-05 2024-09-17T02:21:26.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.733865+0000", 2024-09-17T02:21:26.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5190000000000003e-06 2024-09-17T02:21:26.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:26.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.734555+0000", 2024-09-17T02:21:26.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00068970399999999997 2024-09-17T02:21:26.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:26.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.734673+0000", 2024-09-17T02:21:26.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011800599999999999 2024-09-17T02:21:26.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:26.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.734799+0000", 2024-09-17T02:21:26.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012636099999999999 2024-09-17T02:21:26.785 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:26.785 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:26.785 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:26.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.785 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:115994 5.c 5:3eeefc3f:::benchmark_data_smithi001_23533_object115993:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T02:21:26.785 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:26.733912+0000", 2024-09-17T02:21:26.785 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00091951499999999998, 2024-09-17T02:21:26.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013807089999999999, 2024-09-17T02:21:26.785 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:26.786 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:26.786 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:26.786 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:26.786 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:26.786 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:26.786 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 115994 2024-09-17T02:21:26.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.786 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:26.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:26.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.733912+0000", 2024-09-17T02:21:26.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:26.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:26.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.733912+0000", 2024-09-17T02:21:26.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:26.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:26.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.733912+0000", 2024-09-17T02:21:26.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6599999999999995e-07 2024-09-17T02:21:26.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:26.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.733974+0000", 2024-09-17T02:21:26.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2170999999999998e-05 2024-09-17T02:21:26.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:26.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.733985+0000", 2024-09-17T02:21:26.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0377000000000001e-05 2024-09-17T02:21:26.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.733990+0000", 2024-09-17T02:21:26.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4999999999999999e-06 2024-09-17T02:21:26.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:26.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.734041+0000", 2024-09-17T02:21:26.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0951000000000001e-05 2024-09-17T02:21:26.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:26.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.734192+0000", 2024-09-17T02:21:26.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015095700000000001 2024-09-17T02:21:26.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:26.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.734356+0000", 2024-09-17T02:21:26.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016380999999999999 2024-09-17T02:21:26.790 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:26.790 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:26.790 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:26.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.790 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:115992 5.4 e47/36 5:2cd98697:::benchmark_data_smithi001_23533_object115991:head v 47'7126, mlcod=47'7123)", 2024-09-17T02:21:26.790 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:26.734268+0000", 2024-09-17T02:21:26.790 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00056327199999999997, 2024-09-17T02:21:26.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010903569999999999, 2024-09-17T02:21:26.791 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:26.791 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:26.791 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:26.791 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:26.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:26.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.734268+0000", 2024-09-17T02:21:26.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:26.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:26.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.734268+0000", 2024-09-17T02:21:26.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:26.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:26.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.734268+0000", 2024-09-17T02:21:26.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3e-07 2024-09-17T02:21:26.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:26.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.734347+0000", 2024-09-17T02:21:26.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8663000000000002e-05 2024-09-17T02:21:26.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:26.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.734356+0000", 2024-09-17T02:21:26.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4460000000000001e-06 2024-09-17T02:21:26.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:26.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.734360+0000", 2024-09-17T02:21:26.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4560000000000002e-06 2024-09-17T02:21:26.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:26.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.734410+0000", 2024-09-17T02:21:26.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9840999999999999e-05 2024-09-17T02:21:26.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:26.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:26.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:26.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:26.734427+0000", 2024-09-17T02:21:26.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7382000000000001e-05 2024-09-17T02:21:26.793 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:26.794 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:26.794 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:26.794 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:26.794 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:21:26.794 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 13 2024-09-17T02:21:26.794 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:26.795 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 54 16 116084 116068 134.323 126.125 0.00685432 0.00744013 2024-09-17T02:21:26.795 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:26.794+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:26.796 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:26.896 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:26.897+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:26.949 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:26.949 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:21:26.949 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:21:26.949 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:21:26.950 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:26.972 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:27.019 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:27.022+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:27.099 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:27.098+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:27.126 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:27.126 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:21:27.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:21:27.126 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:27.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.127 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:27.127 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:21:27.127 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 70.567147340999995, 2024-09-17T02:21:27.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022056035000000002, 2024-09-17T02:21:27.127 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:27.127 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:27.127 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.127 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:27.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:27.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:21:27.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:27.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:21:27.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:27.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562132+0000", 2024-09-17T02:21:27.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6300000000000001e-06 2024-09-17T02:21:27.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:27.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562142+0000", 2024-09-17T02:21:27.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.022e-05 2024-09-17T02:21:27.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:27.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562164+0000", 2024-09-17T02:21:27.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2002999999999999e-05 2024-09-17T02:21:27.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562180+0000", 2024-09-17T02:21:27.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5930000000000002e-05 2024-09-17T02:21:27.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:27.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563517+0000", 2024-09-17T02:21:27.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001336776 2024-09-17T02:21:27.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:27.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563635+0000", 2024-09-17T02:21:27.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117976 2024-09-17T02:21:27.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:27.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563819+0000", 2024-09-17T02:21:27.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018411499999999999 2024-09-17T02:21:27.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:27.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566977+0000", 2024-09-17T02:21:27.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031575990000000001 2024-09-17T02:21:27.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583917+0000", 2024-09-17T02:21:27.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016940093999999999 2024-09-17T02:21:27.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:27.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584066+0000", 2024-09-17T02:21:27.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000149746 2024-09-17T02:21:27.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:27.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584186+0000", 2024-09-17T02:21:27.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011994600000000001 2024-09-17T02:21:27.132 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.132 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:27.132 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.132 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:27.133 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:27.133 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 70.566966629999996, 2024-09-17T02:21:27.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023664803000000002, 2024-09-17T02:21:27.133 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:27.133 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:27.133 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.133 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:27.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:27.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:27.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:27.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:27.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:27.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562313+0000", 2024-09-17T02:21:27.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.764e-06 2024-09-17T02:21:27.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:27.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562323+0000", 2024-09-17T02:21:27.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0166000000000001e-05 2024-09-17T02:21:27.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:27.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562343+0000", 2024-09-17T02:21:27.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9633999999999999e-05 2024-09-17T02:21:27.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562367+0000", 2024-09-17T02:21:27.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4556e-05 2024-09-17T02:21:27.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:27.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563777+0000", 2024-09-17T02:21:27.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014102330000000001 2024-09-17T02:21:27.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:27.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563969+0000", 2024-09-17T02:21:27.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000191361 2024-09-17T02:21:27.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564148+0000", 2024-09-17T02:21:27.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017934599999999999 2024-09-17T02:21:27.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:27.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566989+0000", 2024-09-17T02:21:27.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028407010000000002 2024-09-17T02:21:27.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585770+0000", 2024-09-17T02:21:27.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018781566999999999 2024-09-17T02:21:27.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:27.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585874+0000", 2024-09-17T02:21:27.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103489 2024-09-17T02:21:27.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:27.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585976+0000", 2024-09-17T02:21:27.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101986 2024-09-17T02:21:27.138 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.138 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:27.138 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.138 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:27.138 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:27.138 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 70.566883750000002, 2024-09-17T02:21:27.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024118555999999999, 2024-09-17T02:21:27.139 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:27.139 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:27.139 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.139 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:27.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:27.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:27.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:27.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:27.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:27.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562395+0000", 2024-09-17T02:21:27.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3969999999999999e-06 2024-09-17T02:21:27.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:27.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562405+0000", 2024-09-17T02:21:27.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4229999999999994e-06 2024-09-17T02:21:27.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:27.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562427+0000", 2024-09-17T02:21:27.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759999999999998e-05 2024-09-17T02:21:27.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562444+0000", 2024-09-17T02:21:27.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7019000000000001e-05 2024-09-17T02:21:27.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:27.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564681+0000", 2024-09-17T02:21:27.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022376929999999998 2024-09-17T02:21:27.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:27.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564887+0000", 2024-09-17T02:21:27.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000206178 2024-09-17T02:21:27.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565230+0000", 2024-09-17T02:21:27.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034233499999999998 2024-09-17T02:21:27.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:27.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567000+0000", 2024-09-17T02:21:27.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017706390000000001 2024-09-17T02:21:27.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586126+0000", 2024-09-17T02:21:27.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019125672 2024-09-17T02:21:27.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:27.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586314+0000", 2024-09-17T02:21:27.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018740200000000001 2024-09-17T02:21:27.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:27.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586513+0000", 2024-09-17T02:21:27.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019903799999999999 2024-09-17T02:21:27.144 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.144 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:27.144 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.145 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:27.145 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:27.145 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.560814645999997, 2024-09-17T02:21:27.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:21:27.145 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:27.145 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:27.145 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.145 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:27.145 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:27.145 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.145 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:21:27.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.145 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:27.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:27.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:27.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:27.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:27.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:27.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:21:27.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:21:27.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:27.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:21:27.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:21:27.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:27.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:21:27.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:21:27.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:21:27.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:21:27.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:27.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:21:27.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:21:27.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:27.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:21:27.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:21:27.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:21:27.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:21:27.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:27.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:21:27.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:21:27.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:21:27.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:21:27.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:27.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:21:27.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:21:27.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:27.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:21:27.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:21:27.150 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.150 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:27.150 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.151 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:27.151 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:27.151 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.556912396000001, 2024-09-17T02:21:27.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:21:27.151 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:27.151 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:27.151 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.151 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:27.151 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:27.151 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.151 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:21:27.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.151 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:27.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:27.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:27.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:27.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:27.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:27.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:21:27.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:21:27.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:27.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:21:27.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:21:27.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:27.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:21:27.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:21:27.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:21:27.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:21:27.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:27.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:21:27.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:21:27.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:27.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:21:27.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:21:27.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:21:27.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:21:27.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:27.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:21:27.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:21:27.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:21:27.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:21:27.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:27.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:21:27.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:21:27.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:27.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:21:27.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:21:27.156 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.156 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:27.156 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.157 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71190 5.3 e39/38 5:c99e0ae2:::benchmark_data_smithi001_23533_object71189:head v 39'4516, mlcod=35'4513)", 2024-09-17T02:21:27.157 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.607413+0000", 2024-09-17T02:21:27.157 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.521864372, 2024-09-17T02:21:27.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023407462, 2024-09-17T02:21:27.157 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:27.157 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:27.157 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.157 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:27.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:27.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607413+0000", 2024-09-17T02:21:27.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:27.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607413+0000", 2024-09-17T02:21:27.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:27.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607415+0000", 2024-09-17T02:21:27.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2139999999999999e-06 2024-09-17T02:21:27.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:27.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607479+0000", 2024-09-17T02:21:27.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4374000000000004e-05 2024-09-17T02:21:27.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:27.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607496+0000", 2024-09-17T02:21:27.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6820000000000002e-05 2024-09-17T02:21:27.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607512+0000", 2024-09-17T02:21:27.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5976000000000001e-05 2024-09-17T02:21:27.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:27.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609288+0000", 2024-09-17T02:21:27.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001776311 2024-09-17T02:21:27.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:27.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609327+0000", 2024-09-17T02:21:27.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9165999999999997e-05 2024-09-17T02:21:27.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:27.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630723+0000", 2024-09-17T02:21:27.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021395290000000001 2024-09-17T02:21:27.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:27.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630821+0000", 2024-09-17T02:21:27.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8311000000000001e-05 2024-09-17T02:21:27.162 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.162 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:27.162 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.162 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71206 5.3 e39/38 5:c6c9386d:::benchmark_data_smithi001_23533_object71205:head v 39'4517, mlcod=35'4513)", 2024-09-17T02:21:27.162 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:27.162 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.519585281000001, 2024-09-17T02:21:27.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026101868, 2024-09-17T02:21:27.163 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:27.163 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:27.163 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.163 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:27.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:27.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:27.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:27.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:27.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:27.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609694+0000", 2024-09-17T02:21:27.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9539999999999998e-06 2024-09-17T02:21:27.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:27.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609841+0000", 2024-09-17T02:21:27.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014690800000000001 2024-09-17T02:21:27.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:27.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609872+0000", 2024-09-17T02:21:27.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0326000000000001e-05 2024-09-17T02:21:27.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609892+0000", 2024-09-17T02:21:27.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9848999999999999e-05 2024-09-17T02:21:27.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:27.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613826+0000", 2024-09-17T02:21:27.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039345140000000001 2024-09-17T02:21:27.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:27.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613908+0000", 2024-09-17T02:21:27.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2412999999999999e-05 2024-09-17T02:21:27.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:27.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635696+0000", 2024-09-17T02:21:27.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021787597999999998 2024-09-17T02:21:27.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:27.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635794+0000", 2024-09-17T02:21:27.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8306000000000004e-05 2024-09-17T02:21:27.166 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.167 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:27.167 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.167 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71210 5.3 e39/38 5:c0498d13:::benchmark_data_smithi001_23533_object71209:head v 39'4518, mlcod=35'4513)", 2024-09-17T02:21:27.167 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:27.167 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.518107315000002, 2024-09-17T02:21:27.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024703197, 2024-09-17T02:21:27.167 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:27.167 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:27.167 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.167 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:27.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:27.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:27.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:27.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:27.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:27.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611172+0000", 2024-09-17T02:21:27.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6470000000000001e-06 2024-09-17T02:21:27.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:27.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611344+0000", 2024-09-17T02:21:27.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000171607 2024-09-17T02:21:27.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:27.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611389+0000", 2024-09-17T02:21:27.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5738000000000002e-05 2024-09-17T02:21:27.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611407+0000", 2024-09-17T02:21:27.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7893e-05 2024-09-17T02:21:27.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:27.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617820+0000", 2024-09-17T02:21:27.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064131070000000004 2024-09-17T02:21:27.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:27.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617885+0000", 2024-09-17T02:21:27.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4442000000000004e-05 2024-09-17T02:21:27.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:27.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635806+0000", 2024-09-17T02:21:27.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017920874999999999 2024-09-17T02:21:27.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:27.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635874+0000", 2024-09-17T02:21:27.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7887999999999998e-05 2024-09-17T02:21:27.171 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.171 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:27.171 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.171 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71213 5.3 e39/38 5:ce9071a1:::benchmark_data_smithi001_23533_object71212:head v 39'4519, mlcod=35'4513)", 2024-09-17T02:21:27.171 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.613453+0000", 2024-09-17T02:21:27.172 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.515824804000001, 2024-09-17T02:21:27.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022494631000000001, 2024-09-17T02:21:27.172 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:27.172 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:27.172 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.172 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:27.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:27.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613453+0000", 2024-09-17T02:21:27.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:27.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613453+0000", 2024-09-17T02:21:27.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:27.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613455+0000", 2024-09-17T02:21:27.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.703e-06 2024-09-17T02:21:27.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:27.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613594+0000", 2024-09-17T02:21:27.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000139405 2024-09-17T02:21:27.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:27.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613625+0000", 2024-09-17T02:21:27.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0993e-05 2024-09-17T02:21:27.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613646+0000", 2024-09-17T02:21:27.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0761999999999999e-05 2024-09-17T02:21:27.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:27.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.620855+0000", 2024-09-17T02:21:27.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0072088270000000001 2024-09-17T02:21:27.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:27.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.620933+0000", 2024-09-17T02:21:27.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8807000000000006e-05 2024-09-17T02:21:27.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:27.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635882+0000", 2024-09-17T02:21:27.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014948530999999999 2024-09-17T02:21:27.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:27.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635948+0000", 2024-09-17T02:21:27.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5603000000000002e-05 2024-09-17T02:21:27.176 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.176 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:27.176 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.176 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71214 5.3 e39/38 5:c5e24f3f:::benchmark_data_smithi001_23533_object71213:head v 39'4520, mlcod=35'4513)", 2024-09-17T02:21:27.176 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:27.176 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.513743083000001, 2024-09-17T02:21:27.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024251297000000002, 2024-09-17T02:21:27.176 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:27.176 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:27.177 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.177 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:27.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:27.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:27.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:27.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:27.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:27.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615536+0000", 2024-09-17T02:21:27.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5370000000000001e-06 2024-09-17T02:21:27.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:27.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615696+0000", 2024-09-17T02:21:27.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015948700000000001 2024-09-17T02:21:27.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:27.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615723+0000", 2024-09-17T02:21:27.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7518999999999999e-05 2024-09-17T02:21:27.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615742+0000", 2024-09-17T02:21:27.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8519999999999999e-05 2024-09-17T02:21:27.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:27.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.624440+0000", 2024-09-17T02:21:27.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0086983080000000001 2024-09-17T02:21:27.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:27.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.624489+0000", 2024-09-17T02:21:27.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8838000000000002e-05 2024-09-17T02:21:27.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:27.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639673+0000", 2024-09-17T02:21:27.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01518451 2024-09-17T02:21:27.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:27.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639786+0000", 2024-09-17T02:21:27.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011257800000000001 2024-09-17T02:21:27.180 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.180 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:27.181 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.181 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71215 5.3 e39/38 5:c5603662:::benchmark_data_smithi001_23533_object71214:head v 39'4521, mlcod=35'4513)", 2024-09-17T02:21:27.181 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.617466+0000", 2024-09-17T02:21:27.181 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.511812103, 2024-09-17T02:21:27.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022395379999999999, 2024-09-17T02:21:27.181 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:27.181 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:27.181 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.181 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:27.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:27.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617466+0000", 2024-09-17T02:21:27.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:27.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617466+0000", 2024-09-17T02:21:27.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:27.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617467+0000", 2024-09-17T02:21:27.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3600000000000002e-07 2024-09-17T02:21:27.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:27.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617521+0000", 2024-09-17T02:21:27.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4654999999999998e-05 2024-09-17T02:21:27.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:27.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617548+0000", 2024-09-17T02:21:27.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6706000000000001e-05 2024-09-17T02:21:27.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617566+0000", 2024-09-17T02:21:27.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7989e-05 2024-09-17T02:21:27.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:27.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.627598+0000", 2024-09-17T02:21:27.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010031854 2024-09-17T02:21:27.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:27.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.627656+0000", 2024-09-17T02:21:27.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8511999999999998e-05 2024-09-17T02:21:27.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:27.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639794+0000", 2024-09-17T02:21:27.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012137445 2024-09-17T02:21:27.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:27.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639861+0000", 2024-09-17T02:21:27.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7282999999999999e-05 2024-09-17T02:21:27.185 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.185 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:27.185 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.185 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:71277 5.a 5:5576e9b8:::benchmark_data_smithi001_23533_object71276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:27.186 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.630891+0000", 2024-09-17T02:21:27.186 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.498386563, 2024-09-17T02:21:27.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022210245999999999, 2024-09-17T02:21:27.186 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:27.186 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:27.186 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.186 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:27.186 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:27.186 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.186 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71277 2024-09-17T02:21:27.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.186 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:27.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:27.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630891+0000", 2024-09-17T02:21:27.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:27.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630891+0000", 2024-09-17T02:21:27.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:27.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630893+0000", 2024-09-17T02:21:27.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-09-17T02:21:27.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:27.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630961+0000", 2024-09-17T02:21:27.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7971000000000004e-05 2024-09-17T02:21:27.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:27.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630989+0000", 2024-09-17T02:21:27.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7855999999999999e-05 2024-09-17T02:21:27.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631010+0000", 2024-09-17T02:21:27.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0888999999999999e-05 2024-09-17T02:21:27.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:27.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631123+0000", 2024-09-17T02:21:27.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011292 2024-09-17T02:21:27.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:27.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631434+0000", 2024-09-17T02:21:27.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00031039199999999999 2024-09-17T02:21:27.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631679+0000", 2024-09-17T02:21:27.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024517099999999997 2024-09-17T02:21:27.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.636619+0000", 2024-09-17T02:21:27.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049405339999999999 2024-09-17T02:21:27.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:27.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.652851+0000", 2024-09-17T02:21:27.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016231440999999999 2024-09-17T02:21:27.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:27.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.653012+0000", 2024-09-17T02:21:27.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016157199999999999 2024-09-17T02:21:27.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:27.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.653101+0000", 2024-09-17T02:21:27.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9190000000000005e-05 2024-09-17T02:21:27.191 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.191 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:27.191 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.192 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97147 5.0 5:02d17bf7:::benchmark_data_smithi001_23533_object97146:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:27.192 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268128+0000", 2024-09-17T02:21:27.192 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.8611493390000007, 2024-09-17T02:21:27.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022726434, 2024-09-17T02:21:27.192 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:27.192 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:27.192 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.192 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:27.192 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:27.192 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.192 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97147 2024-09-17T02:21:27.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.193 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:27.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:27.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268128+0000", 2024-09-17T02:21:27.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:27.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268128+0000", 2024-09-17T02:21:27.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:27.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268129+0000", 2024-09-17T02:21:27.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5700000000000001e-07 2024-09-17T02:21:27.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:27.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268194+0000", 2024-09-17T02:21:27.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4731000000000001e-05 2024-09-17T02:21:27.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:27.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268202+0000", 2024-09-17T02:21:27.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7950000000000008e-06 2024-09-17T02:21:27.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268207+0000", 2024-09-17T02:21:27.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8550000000000001e-06 2024-09-17T02:21:27.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:27.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268694+0000", 2024-09-17T02:21:27.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00048752799999999998 2024-09-17T02:21:27.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:27.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268768+0000", 2024-09-17T02:21:27.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3638000000000002e-05 2024-09-17T02:21:27.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268842+0000", 2024-09-17T02:21:27.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3928000000000001e-05 2024-09-17T02:21:27.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.285598+0000", 2024-09-17T02:21:27.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016756436 2024-09-17T02:21:27.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:27.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290771+0000", 2024-09-17T02:21:27.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051724789999999998 2024-09-17T02:21:27.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:27.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290817+0000", 2024-09-17T02:21:27.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6220999999999997e-05 2024-09-17T02:21:27.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:27.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290855+0000", 2024-09-17T02:21:27.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7966000000000002e-05 2024-09-17T02:21:27.198 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.198 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:27.198 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.198 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97148 5.5 5:a643b955:::benchmark_data_smithi001_23533_object97147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:27.198 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268218+0000", 2024-09-17T02:21:27.198 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.861059955, 2024-09-17T02:21:27.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022628112999999998, 2024-09-17T02:21:27.198 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:27.198 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:27.198 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.199 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:27.199 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:27.199 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.199 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97148 2024-09-17T02:21:27.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.199 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:27.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:27.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268218+0000", 2024-09-17T02:21:27.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:27.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268218+0000", 2024-09-17T02:21:27.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:27.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268218+0000", 2024-09-17T02:21:27.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.53e-07 2024-09-17T02:21:27.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:27.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268300+0000", 2024-09-17T02:21:27.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2219999999999995e-05 2024-09-17T02:21:27.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:27.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268306+0000", 2024-09-17T02:21:27.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8989999999999998e-06 2024-09-17T02:21:27.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268310+0000", 2024-09-17T02:21:27.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6610000000000002e-06 2024-09-17T02:21:27.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:27.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268354+0000", 2024-09-17T02:21:27.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3782000000000002e-05 2024-09-17T02:21:27.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:27.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268452+0000", 2024-09-17T02:21:27.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8339999999999997e-05 2024-09-17T02:21:27.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:27.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268536+0000", 2024-09-17T02:21:27.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3931999999999995e-05 2024-09-17T02:21:27.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.286252+0000", 2024-09-17T02:21:27.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017715740000000001 2024-09-17T02:21:27.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:27.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290758+0000", 2024-09-17T02:21:27.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045060940000000004 2024-09-17T02:21:27.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:27.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290801+0000", 2024-09-17T02:21:27.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2818000000000002e-05 2024-09-17T02:21:27.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:27.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290846+0000", 2024-09-17T02:21:27.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5274000000000001e-05 2024-09-17T02:21:27.204 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.204 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:27.204 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.204 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97151 5.5 5:a0c2c072:::benchmark_data_smithi001_23533_object97150:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:27.204 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:27.204 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.8609056739999996, 2024-09-17T02:21:27.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027297614000000001, 2024-09-17T02:21:27.204 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:27.205 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:27.205 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.205 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:27.205 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:27.205 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.205 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97151 2024-09-17T02:21:27.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.205 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:27.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:27.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:27.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:27.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:27.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:27.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268373+0000", 2024-09-17T02:21:27.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4000000000000002e-07 2024-09-17T02:21:27.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:27.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268423+0000", 2024-09-17T02:21:27.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0175e-05 2024-09-17T02:21:27.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:27.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268428+0000", 2024-09-17T02:21:27.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-17T02:21:27.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268431+0000", 2024-09-17T02:21:27.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.179e-06 2024-09-17T02:21:27.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:27.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283631+0000", 2024-09-17T02:21:27.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015199691 2024-09-17T02:21:27.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:27.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283740+0000", 2024-09-17T02:21:27.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109305 2024-09-17T02:21:27.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:27.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283863+0000", 2024-09-17T02:21:27.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012226699999999999 2024-09-17T02:21:27.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:27.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290857+0000", 2024-09-17T02:21:27.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069945449999999996 2024-09-17T02:21:27.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295595+0000", 2024-09-17T02:21:27.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047376750000000002 2024-09-17T02:21:27.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:27.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295638+0000", 2024-09-17T02:21:27.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3671999999999998e-05 2024-09-17T02:21:27.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:27.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295670+0000", 2024-09-17T02:21:27.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1266000000000002e-05 2024-09-17T02:21:27.210 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.210 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:27.210 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.210 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97248 5.c 5:3796bec5:::benchmark_data_smithi001_23533_object97247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:27.210 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.327358+0000", 2024-09-17T02:21:27.210 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.801919431, 2024-09-17T02:21:27.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022963006000000001, 2024-09-17T02:21:27.211 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:27.211 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:27.211 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.211 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:27.211 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:27.211 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.211 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97248 2024-09-17T02:21:27.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.211 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:27.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:27.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327358+0000", 2024-09-17T02:21:27.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:27.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327358+0000", 2024-09-17T02:21:27.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:27.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327359+0000", 2024-09-17T02:21:27.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5699999999999998e-07 2024-09-17T02:21:27.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:27.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327382+0000", 2024-09-17T02:21:27.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3458000000000001e-05 2024-09-17T02:21:27.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:27.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327387+0000", 2024-09-17T02:21:27.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6149999999999999e-06 2024-09-17T02:21:27.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327391+0000", 2024-09-17T02:21:27.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8999999999999999e-06 2024-09-17T02:21:27.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:27.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.332084+0000", 2024-09-17T02:21:27.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046935240000000001 2024-09-17T02:21:27.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:27.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.332216+0000", 2024-09-17T02:21:27.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131798 2024-09-17T02:21:27.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:27.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.332352+0000", 2024-09-17T02:21:27.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013587500000000001 2024-09-17T02:21:27.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.338559+0000", 2024-09-17T02:21:27.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0062075510000000004 2024-09-17T02:21:27.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:27.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350237+0000", 2024-09-17T02:21:27.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011677121 2024-09-17T02:21:27.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:27.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350287+0000", 2024-09-17T02:21:27.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0080999999999997e-05 2024-09-17T02:21:27.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:27.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350321+0000", 2024-09-17T02:21:27.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4625999999999997e-05 2024-09-17T02:21:27.216 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.216 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:27.216 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.217 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97251 5.c 5:382be9a3:::benchmark_data_smithi001_23533_object97250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:27.217 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.328203+0000", 2024-09-17T02:21:27.217 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.8010751949999992, 2024-09-17T02:21:27.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022268999000000001, 2024-09-17T02:21:27.217 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:27.217 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:27.217 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.217 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:27.217 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:27.217 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.217 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97251 2024-09-17T02:21:27.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.217 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:27.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:27.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328203+0000", 2024-09-17T02:21:27.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:27.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328203+0000", 2024-09-17T02:21:27.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:27.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328203+0000", 2024-09-17T02:21:27.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3699999999999999e-07 2024-09-17T02:21:27.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:27.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328319+0000", 2024-09-17T02:21:27.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011560100000000001 2024-09-17T02:21:27.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:27.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328332+0000", 2024-09-17T02:21:27.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2978e-05 2024-09-17T02:21:27.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328340+0000", 2024-09-17T02:21:27.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4680000000000003e-06 2024-09-17T02:21:27.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:27.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.335525+0000", 2024-09-17T02:21:27.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0071852399999999999 2024-09-17T02:21:27.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:27.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.335650+0000", 2024-09-17T02:21:27.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012522299999999999 2024-09-17T02:21:27.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:27.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.335732+0000", 2024-09-17T02:21:27.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1582999999999995e-05 2024-09-17T02:21:27.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.346944+0000", 2024-09-17T02:21:27.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011211936 2024-09-17T02:21:27.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:27.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350332+0000", 2024-09-17T02:21:27.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033884140000000002 2024-09-17T02:21:27.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:27.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350433+0000", 2024-09-17T02:21:27.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010115600000000001 2024-09-17T02:21:27.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:27.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350472+0000", 2024-09-17T02:21:27.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8463000000000001e-05 2024-09-17T02:21:27.223 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.223 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:27.223 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.223 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97759 5.a 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:27.223 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:27.223 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.5308925729999991, 2024-09-17T02:21:27.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.089694871999999995, 2024-09-17T02:21:27.223 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:27.223 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:27.223 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.223 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:27.224 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:27.224 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.224 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97759 2024-09-17T02:21:27.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.224 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:27.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:27.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:27.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:27.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:27.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:27.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598386+0000", 2024-09-17T02:21:27.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999999e-07 2024-09-17T02:21:27.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:27.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598414+0000", 2024-09-17T02:21:27.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8013000000000001e-05 2024-09-17T02:21:27.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:27.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598420+0000", 2024-09-17T02:21:27.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1149999999999999e-06 2024-09-17T02:21:27.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598424+0000", 2024-09-17T02:21:27.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:21:27.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:27.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598479+0000", 2024-09-17T02:21:27.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4648999999999998e-05 2024-09-17T02:21:27.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:27.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598587+0000", 2024-09-17T02:21:27.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010853000000000001 2024-09-17T02:21:27.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598676+0000", 2024-09-17T02:21:27.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8381999999999995e-05 2024-09-17T02:21:27.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:27.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603766+0000", 2024-09-17T02:21:27.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050902559999999996 2024-09-17T02:21:27.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.687988+0000", 2024-09-17T02:21:27.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.084221753999999996 2024-09-17T02:21:27.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:27.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688037+0000", 2024-09-17T02:21:27.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-05 2024-09-17T02:21:27.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:27.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688080+0000", 2024-09-17T02:21:27.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3149999999999999e-05 2024-09-17T02:21:27.229 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.229 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:27.229 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.229 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97770 5.0 5:09c75033:::benchmark_data_smithi001_23533_object97769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:27.229 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:27.229 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.5257501429999998, 2024-09-17T02:21:27.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.086380868, 2024-09-17T02:21:27.229 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:27.230 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:27.230 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.230 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:27.230 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:27.230 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.230 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97770 2024-09-17T02:21:27.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.230 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:27.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:27.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:27.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:27.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:27.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:27.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603529+0000", 2024-09-17T02:21:27.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:21:27.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:27.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603593+0000", 2024-09-17T02:21:27.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4216999999999999e-05 2024-09-17T02:21:27.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:27.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603603+0000", 2024-09-17T02:21:27.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5179999999999993e-06 2024-09-17T02:21:27.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603608+0000", 2024-09-17T02:21:27.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2039999999999996e-06 2024-09-17T02:21:27.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:27.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603653+0000", 2024-09-17T02:21:27.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5247000000000002e-05 2024-09-17T02:21:27.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:27.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603758+0000", 2024-09-17T02:21:27.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105352 2024-09-17T02:21:27.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603900+0000", 2024-09-17T02:21:27.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014198999999999999 2024-09-17T02:21:27.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:27.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.606097+0000", 2024-09-17T02:21:27.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021969839999999999 2024-09-17T02:21:27.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689756+0000", 2024-09-17T02:21:27.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.083659077999999998 2024-09-17T02:21:27.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:27.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689846+0000", 2024-09-17T02:21:27.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9320999999999994e-05 2024-09-17T02:21:27.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:27.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689908+0000", 2024-09-17T02:21:27.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720999999999998e-05 2024-09-17T02:21:27.235 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.235 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:27.235 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.235 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:101263 5.0 5:01bcc612:::benchmark_data_smithi001_23533_object101262:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T02:21:27.236 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:19.421619+0000", 2024-09-17T02:21:27.236 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.7076589220000002, 2024-09-17T02:21:27.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023065922999999999, 2024-09-17T02:21:27.236 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:27.236 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:27.236 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.236 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:27.236 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:27.236 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.236 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 101263 2024-09-17T02:21:27.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.236 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:27.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:27.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421619+0000", 2024-09-17T02:21:27.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:27.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421619+0000", 2024-09-17T02:21:27.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:27.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:27.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421619+0000", 2024-09-17T02:21:27.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6100000000000001e-07 2024-09-17T02:21:27.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:27.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421657+0000", 2024-09-17T02:21:27.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7438999999999998e-05 2024-09-17T02:21:27.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:27.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421665+0000", 2024-09-17T02:21:27.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4840000000000004e-06 2024-09-17T02:21:27.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421671+0000", 2024-09-17T02:21:27.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5400000000000003e-06 2024-09-17T02:21:27.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:27.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.431714+0000", 2024-09-17T02:21:27.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0100432 2024-09-17T02:21:27.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:27.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.431841+0000", 2024-09-17T02:21:27.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000127138 2024-09-17T02:21:27.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.431970+0000", 2024-09-17T02:21:27.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012893900000000001 2024-09-17T02:21:27.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.436696+0000", 2024-09-17T02:21:27.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047262570000000002 2024-09-17T02:21:27.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:27.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.444604+0000", 2024-09-17T02:21:27.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079071479999999993 2024-09-17T02:21:27.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:27.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.444648+0000", 2024-09-17T02:21:27.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4941000000000002e-05 2024-09-17T02:21:27.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:27.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:27.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:27.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.444685+0000", 2024-09-17T02:21:27.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6276000000000003e-05 2024-09-17T02:21:27.241 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.241 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:27.241 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.241 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:27.241 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:27.241 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:27.243 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:27.242+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:27.243 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:21:27.344 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:27.346+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:27.399 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:21:27.400 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-17T02:21:27.400 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.400 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:117333 5.9 5:9849aca8:::benchmark_data_smithi001_23533_object117332:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T02:21:27.400 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:27.399451+0000", 2024-09-17T02:21:27.400 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0029900090000000001, 2024-09-17T02:21:27.400 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0030181439999999999, 2024-09-17T02:21:27.400 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.400 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.400 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:27.400 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:27.400 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:27.401 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.401 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 117333 2024-09-17T02:21:27.401 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.401 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.401 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.401 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.401 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.399451+0000", 2024-09-17T02:21:27.401 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.401 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.401 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.401 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.401 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.399451+0000", 2024-09-17T02:21:27.401 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.402 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.402 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.402 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.402 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.399453+0000", 2024-09-17T02:21:27.402 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.291e-06 2024-09-17T02:21:27.402 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.402 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.402 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.402 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.399592+0000", 2024-09-17T02:21:27.402 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013900300000000001 2024-09-17T02:21:27.402 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.402 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.402 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.403 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.399604+0000", 2024-09-17T02:21:27.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2007999999999999e-05 2024-09-17T02:21:27.403 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.403 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.403 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.403 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.399612+0000", 2024-09-17T02:21:27.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8620000000000003e-06 2024-09-17T02:21:27.403 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.403 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.403 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.403 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.399669+0000", 2024-09-17T02:21:27.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7738999999999997e-05 2024-09-17T02:21:27.403 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:27.404 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.399798+0000", 2024-09-17T02:21:27.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012834899999999999 2024-09-17T02:21:27.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.404 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.399947+0000", 2024-09-17T02:21:27.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014986900000000001 2024-09-17T02:21:27.404 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.404 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.404 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.405 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.405 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:117337 5.2 5:458fb4e3:::benchmark_data_smithi001_23533_object117336:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T02:21:27.405 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:27.399878+0000", 2024-09-17T02:21:27.405 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0025638639999999999, 2024-09-17T02:21:27.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0026829760000000001, 2024-09-17T02:21:27.405 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.405 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.405 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:27.405 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:27.405 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:27.405 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.405 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 117337 2024-09-17T02:21:27.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.406 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.399878+0000", 2024-09-17T02:21:27.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.399878+0000", 2024-09-17T02:21:27.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.407 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.399878+0000", 2024-09-17T02:21:27.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2999999999999999e-07 2024-09-17T02:21:27.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.407 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.407 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.399939+0000", 2024-09-17T02:21:27.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0609000000000002e-05 2024-09-17T02:21:27.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.407 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.407 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.399952+0000", 2024-09-17T02:21:27.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2663999999999999e-05 2024-09-17T02:21:27.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.399959+0000", 2024-09-17T02:21:27.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4080000000000001e-06 2024-09-17T02:21:27.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.400007+0000", 2024-09-17T02:21:27.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.774e-05 2024-09-17T02:21:27.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.408 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:27.408 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.400102+0000", 2024-09-17T02:21:27.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5532999999999995e-05 2024-09-17T02:21:27.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:27.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.400276+0000", 2024-09-17T02:21:27.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017389599999999999 2024-09-17T02:21:27.409 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.409 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.409 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.409 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:117338 5.f 5:f5ae3f24:::benchmark_data_smithi001_23533_object117337:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T02:21:27.409 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:27.400259+0000", 2024-09-17T02:21:27.410 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.002181962, 2024-09-17T02:21:27.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023812500000000001, 2024-09-17T02:21:27.410 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.410 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.410 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:27.410 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:27.410 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:27.410 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.410 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 117338 2024-09-17T02:21:27.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.410 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.410 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.400259+0000", 2024-09-17T02:21:27.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.400259+0000", 2024-09-17T02:21:27.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.400260+0000", 2024-09-17T02:21:27.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6499999999999998e-07 2024-09-17T02:21:27.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.412 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.412 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.400311+0000", 2024-09-17T02:21:27.412 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0695999999999997e-05 2024-09-17T02:21:27.412 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.412 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.412 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.412 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.400320+0000", 2024-09-17T02:21:27.412 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2029999999999998e-06 2024-09-17T02:21:27.412 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.412 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.412 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.412 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.400326+0000", 2024-09-17T02:21:27.412 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2450000000000003e-06 2024-09-17T02:21:27.412 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.413 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.400381+0000", 2024-09-17T02:21:27.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4554e-05 2024-09-17T02:21:27.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.413 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:27.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.400512+0000", 2024-09-17T02:21:27.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013121899999999999 2024-09-17T02:21:27.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.413 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.413 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.400659+0000", 2024-09-17T02:21:27.414 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014677599999999999 2024-09-17T02:21:27.414 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.414 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.414 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.414 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.414 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.414 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:117339 5.1 5:8ac16680:::benchmark_data_smithi001_23533_object117338:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T02:21:27.414 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:27.400443+0000", 2024-09-17T02:21:27.414 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.001997927, 2024-09-17T02:21:27.414 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022401169999999998, 2024-09-17T02:21:27.414 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.414 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.414 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:27.415 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:27.415 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:27.415 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.415 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 117339 2024-09-17T02:21:27.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.415 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.400443+0000", 2024-09-17T02:21:27.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.400443+0000", 2024-09-17T02:21:27.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.416 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.416 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.416 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.400444+0000", 2024-09-17T02:21:27.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3200000000000004e-07 2024-09-17T02:21:27.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.416 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.416 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.416 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.400479+0000", 2024-09-17T02:21:27.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5312999999999999e-05 2024-09-17T02:21:27.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.417 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.400487+0000", 2024-09-17T02:21:27.417 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9950000000000005e-06 2024-09-17T02:21:27.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.417 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.400493+0000", 2024-09-17T02:21:27.417 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7679999999999997e-06 2024-09-17T02:21:27.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.417 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.400537+0000", 2024-09-17T02:21:27.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3550999999999997e-05 2024-09-17T02:21:27.418 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:27.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.400686+0000", 2024-09-17T02:21:27.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014930600000000001 2024-09-17T02:21:27.418 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0,1", 2024-09-17T02:21:27.418 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.400829+0000", 2024-09-17T02:21:27.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014286100000000001 2024-09-17T02:21:27.418 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.418 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.419 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.419 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4466.0:117336 5.b e47/38 5:d29ca7d5:::benchmark_data_smithi001_23533_object117335:head v 47'7269, mlcod=47'7267)", 2024-09-17T02:21:27.419 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:27.401788+0000", 2024-09-17T02:21:27.419 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.00065371099999999996, 2024-09-17T02:21:27.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00093357300000000004, 2024-09-17T02:21:27.419 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.419 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.419 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-17T02:21:27.419 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.401788+0000", 2024-09-17T02:21:27.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.401788+0000", 2024-09-17T02:21:27.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.401788+0000", 2024-09-17T02:21:27.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0400000000000002e-07 2024-09-17T02:21:27.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.401792+0000", 2024-09-17T02:21:27.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0879999999999997e-06 2024-09-17T02:21:27.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.401799+0000", 2024-09-17T02:21:27.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2089999999999999e-06 2024-09-17T02:21:27.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.401804+0000", 2024-09-17T02:21:27.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9830000000000004e-06 2024-09-17T02:21:27.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.422 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.401969+0000", 2024-09-17T02:21:27.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016483200000000001 2024-09-17T02:21:27.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.422 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:27.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.401980+0000", 2024-09-17T02:21:27.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0550000000000001e-05 2024-09-17T02:21:27.422 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.422 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.423 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.423 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.423 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.423 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:117341 5.1 5:8d9ad118:::benchmark_data_smithi001_23533_object117340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T02:21:27.423 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:27.401788+0000", 2024-09-17T02:21:27.423 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.00065316099999999998, 2024-09-17T02:21:27.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00096621599999999999, 2024-09-17T02:21:27.423 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.423 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.423 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "reached pg", 2024-09-17T02:21:27.423 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:27.423 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:27.423 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.423 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 117341 2024-09-17T02:21:27.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.424 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.424 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.401788+0000", 2024-09-17T02:21:27.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.424 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.401788+0000", 2024-09-17T02:21:27.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.401789+0000", 2024-09-17T02:21:27.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.035e-06 2024-09-17T02:21:27.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.401846+0000", 2024-09-17T02:21:27.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6419000000000003e-05 2024-09-17T02:21:27.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.401856+0000", 2024-09-17T02:21:27.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0787e-05 2024-09-17T02:21:27.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.426 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.401864+0000", 2024-09-17T02:21:27.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7039999999999994e-06 2024-09-17T02:21:27.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.426 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.402732+0000", 2024-09-17T02:21:27.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00086829500000000005 2024-09-17T02:21:27.426 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.426 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.426 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.427 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.427 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:117342 5.9 5:90f4f113:::benchmark_data_smithi001_23533_object117341:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T02:21:27.427 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:27.402224+0000", 2024-09-17T02:21:27.427 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.00021780000000000001, 2024-09-17T02:21:27.427 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00059126299999999997, 2024-09-17T02:21:27.427 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.427 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.427 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "reached pg", 2024-09-17T02:21:27.427 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:27.427 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:27.427 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.427 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 117342 2024-09-17T02:21:27.427 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.427 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.402224+0000", 2024-09-17T02:21:27.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.428 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.402224+0000", 2024-09-17T02:21:27.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.428 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.402224+0000", 2024-09-17T02:21:27.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6400000000000001e-07 2024-09-17T02:21:27.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.429 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.402314+0000", 2024-09-17T02:21:27.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0030000000000004e-05 2024-09-17T02:21:27.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.429 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.402324+0000", 2024-09-17T02:21:27.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5270000000000004e-06 2024-09-17T02:21:27.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.430 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.402330+0000", 2024-09-17T02:21:27.430 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9399999999999999e-06 2024-09-17T02:21:27.430 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.430 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.430 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.430 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.402725+0000", 2024-09-17T02:21:27.430 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00039510100000000002 2024-09-17T02:21:27.430 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.430 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.430 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.430 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.430 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.430 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:117343 5.2 5:42bcdb90:::benchmark_data_smithi001_23533_object117342:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T02:21:27.431 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:27.402340+0000", 2024-09-17T02:21:27.431 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.000101081, 2024-09-17T02:21:27.431 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00052980499999999995, 2024-09-17T02:21:27.431 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.431 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.431 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:27.431 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:27.431 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:27.431 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.431 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 117343 2024-09-17T02:21:27.431 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.431 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.431 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.432 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.432 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.402340+0000", 2024-09-17T02:21:27.432 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.432 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.432 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.432 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.432 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.402340+0000", 2024-09-17T02:21:27.432 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.432 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.432 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.432 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.432 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.402341+0000", 2024-09-17T02:21:27.432 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.46e-07 2024-09-17T02:21:27.433 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.433 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.433 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.433 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.402376+0000", 2024-09-17T02:21:27.433 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5382000000000001e-05 2024-09-17T02:21:27.433 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.433 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.433 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.433 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.402393+0000", 2024-09-17T02:21:27.433 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6759e-05 2024-09-17T02:21:27.433 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.433 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.433 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.434 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.402398+0000", 2024-09-17T02:21:27.434 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.5459999999999999e-06 2024-09-17T02:21:27.434 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.434 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.434 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.434 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.402448+0000", 2024-09-17T02:21:27.434 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9679000000000003e-05 2024-09-17T02:21:27.435 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.435 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.435 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:27.435 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.402587+0000", 2024-09-17T02:21:27.435 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000139297 2024-09-17T02:21:27.435 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.435 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.435 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:27.435 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.402723+0000", 2024-09-17T02:21:27.435 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013572599999999999 2024-09-17T02:21:27.435 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.435 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.435 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.436 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.436 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.436 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(client.4466.0:117337 5.2 e47/22)", 2024-09-17T02:21:27.436 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:27.402839+0000", 2024-09-17T02:21:27.436 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4294967295.9996028, 2024-09-17T02:21:27.436 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.8040000000000004e-05, 2024-09-17T02:21:27.436 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.436 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.436 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:27.436 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.436 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.436 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.436 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.402839+0000", 2024-09-17T02:21:27.436 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.436 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.437 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.437 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.437 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.402839+0000", 2024-09-17T02:21:27.437 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.437 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.437 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.437 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.437 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.402839+0000", 2024-09-17T02:21:27.437 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2399999999999998e-07 2024-09-17T02:21:27.437 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.437 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.437 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.437 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.402843+0000", 2024-09-17T02:21:27.438 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0049999999999998e-06 2024-09-17T02:21:27.438 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.438 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.438 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.438 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.402853+0000", 2024-09-17T02:21:27.438 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4599999999999992e-06 2024-09-17T02:21:27.438 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.438 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.438 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.438 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:27.402859+0000", 2024-09-17T02:21:27.438 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1970000000000001e-06 2024-09-17T02:21:27.438 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.438 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.438 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.438 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.438 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-09-17T02:21:27.439 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 9 2024-09-17T02:21:27.439 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:21:27.440 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:21:27.445 INFO:teuthology.orchestra.run.smithi001.stderr:nodeep-scrub is unset 2024-09-17T02:21:27.488 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:27.490+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:27.545 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:27.545+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:27.602 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:21:27.603 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-17T02:21:27.603 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-09-17T02:21:27.603 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-09-17T02:21:27.603 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:21:27.624 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:21:27.645 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:27.646+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:27.746 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:27.746+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:27.775 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 55 16 118092 118076 134.162 125.5 0.00635747 0.007449 2024-09-17T02:21:27.822 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:21:27.822 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-09-17T02:21:27.822 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-09-17T02:21:27.822 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-17T02:21:27.822 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.822 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-17T02:21:27.822 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:21:27.822 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 83.362151690000005, 2024-09-17T02:21:27.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.15597325500000001, 2024-09-17T02:21:27.823 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.823 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.823 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.823 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:27.823 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4164", 2024-09-17T02:21:27.823 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/201892753", 2024-09-17T02:21:27.823 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 1 2024-09-17T02:21:27.823 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.823 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.823 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.823 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:21:27.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458357+0000", 2024-09-17T02:21:27.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458359+0000", 2024-09-17T02:21:27.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3929999999999998e-06 2024-09-17T02:21:27.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458373+0000", 2024-09-17T02:21:27.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4103e-05 2024-09-17T02:21:27.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458397+0000", 2024-09-17T02:21:27.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.438e-05 2024-09-17T02:21:27.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458421+0000", 2024-09-17T02:21:27.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3655999999999998e-05 2024-09-17T02:21:27.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458529+0000", 2024-09-17T02:21:27.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010752900000000001 2024-09-17T02:21:27.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for peered", 2024-09-17T02:21:27.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.458542+0000", 2024-09-17T02:21:27.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2986999999999999e-05 2024-09-17T02:21:27.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.611050+0000", 2024-09-17T02:21:27.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.1525087 2024-09-17T02:21:27.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:27.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.611529+0000", 2024-09-17T02:21:27.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00047844899999999999 2024-09-17T02:21:27.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.612061+0000", 2024-09-17T02:21:27.828 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00053230300000000003 2024-09-17T02:21:27.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.828 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.828 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:27.828 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.613451+0000", 2024-09-17T02:21:27.828 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0013897250000000001 2024-09-17T02:21:27.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.828 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.828 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.828 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614168+0000", 2024-09-17T02:21:27.828 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00071692499999999998 2024-09-17T02:21:27.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.829 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:27.829 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614265+0000", 2024-09-17T02:21:27.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7589000000000004e-05 2024-09-17T02:21:27.829 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.829 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:27.829 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:04.614330+0000", 2024-09-17T02:21:27.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4516000000000004e-05 2024-09-17T02:21:27.829 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.829 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.829 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.829 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.830 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:27.830 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:21:27.830 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 71.264128600000006, 2024-09-17T02:21:27.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030933694000000001, 2024-09-17T02:21:27.830 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.830 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.830 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.830 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:21:27.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556380+0000", 2024-09-17T02:21:27.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556381+0000", 2024-09-17T02:21:27.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2100000000000001e-06 2024-09-17T02:21:27.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556389+0000", 2024-09-17T02:21:27.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5539999999999998e-06 2024-09-17T02:21:27.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556408+0000", 2024-09-17T02:21:27.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8623000000000001e-05 2024-09-17T02:21:27.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556427+0000", 2024-09-17T02:21:27.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8566000000000001e-05 2024-09-17T02:21:27.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.833 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558741+0000", 2024-09-17T02:21:27.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023144390000000002 2024-09-17T02:21:27.833 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.833 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:27.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559040+0000", 2024-09-17T02:21:27.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029912100000000001 2024-09-17T02:21:27.833 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.833 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559222+0000", 2024-09-17T02:21:27.834 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018211200000000001 2024-09-17T02:21:27.834 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.834 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.834 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:27.834 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.566648+0000", 2024-09-17T02:21:27.834 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074257560000000004 2024-09-17T02:21:27.834 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.834 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.834 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.834 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587109+0000", 2024-09-17T02:21:27.834 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.020460685999999999 2024-09-17T02:21:27.834 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.834 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.834 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:27.835 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587232+0000", 2024-09-17T02:21:27.835 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123325 2024-09-17T02:21:27.835 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.835 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.835 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:27.835 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587313+0000", 2024-09-17T02:21:27.835 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1302000000000002e-05 2024-09-17T02:21:27.835 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.835 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.835 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.835 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.835 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.835 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:27.836 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:21:27.836 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 71.264063153999999, 2024-09-17T02:21:27.836 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031045538000000001, 2024-09-17T02:21:27.836 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.836 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.836 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.836 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.836 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.836 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.836 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:21:27.836 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.836 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.836 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556445+0000", 2024-09-17T02:21:27.837 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556446+0000", 2024-09-17T02:21:27.837 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.26e-06 2024-09-17T02:21:27.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556454+0000", 2024-09-17T02:21:27.837 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1640000000000004e-06 2024-09-17T02:21:27.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.838 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556471+0000", 2024-09-17T02:21:27.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7586000000000001e-05 2024-09-17T02:21:27.838 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.838 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.838 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.838 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556485+0000", 2024-09-17T02:21:27.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3523000000000001e-05 2024-09-17T02:21:27.838 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.838 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.838 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.838 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.559899+0000", 2024-09-17T02:21:27.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0034142140000000001 2024-09-17T02:21:27.838 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.838 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.839 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:27.839 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.560104+0000", 2024-09-17T02:21:27.839 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00020539199999999999 2024-09-17T02:21:27.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.839 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.839 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.839 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.560400+0000", 2024-09-17T02:21:27.839 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029612099999999999 2024-09-17T02:21:27.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.839 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.839 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:27.839 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.568427+0000", 2024-09-17T02:21:27.839 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0080262909999999996 2024-09-17T02:21:27.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.840 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.840 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.840 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587377+0000", 2024-09-17T02:21:27.840 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.018950765000000001 2024-09-17T02:21:27.840 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.840 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.840 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:27.840 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587445+0000", 2024-09-17T02:21:27.840 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.724e-05 2024-09-17T02:21:27.840 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.840 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.840 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:27.841 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587491+0000", 2024-09-17T02:21:27.841 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5982000000000001e-05 2024-09-17T02:21:27.841 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.841 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.841 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.841 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.841 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.841 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:27.841 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:21:27.841 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 71.264000383999999, 2024-09-17T02:21:27.841 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031435547000000001, 2024-09-17T02:21:27.842 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.842 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.842 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.842 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.842 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.842 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.842 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:21:27.842 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.842 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.842 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.842 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.842 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556508+0000", 2024-09-17T02:21:27.842 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.842 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.842 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.842 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.843 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556509+0000", 2024-09-17T02:21:27.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.06e-06 2024-09-17T02:21:27.843 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.843 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.843 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.843 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556515+0000", 2024-09-17T02:21:27.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1029999999999998e-06 2024-09-17T02:21:27.843 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.843 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.843 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.843 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556532+0000", 2024-09-17T02:21:27.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7054e-05 2024-09-17T02:21:27.843 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556545+0000", 2024-09-17T02:21:27.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3023000000000001e-05 2024-09-17T02:21:27.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561016+0000", 2024-09-17T02:21:27.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0044705150000000004 2024-09-17T02:21:27.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.844 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:27.844 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561316+0000", 2024-09-17T02:21:27.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000299895 2024-09-17T02:21:27.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.845 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.561651+0000", 2024-09-17T02:21:27.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00033519300000000001 2024-09-17T02:21:27.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:27.845 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571105+0000", 2024-09-17T02:21:27.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094540539999999999 2024-09-17T02:21:27.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587628+0000", 2024-09-17T02:21:27.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016522819000000001 2024-09-17T02:21:27.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:27.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587770+0000", 2024-09-17T02:21:27.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000142352 2024-09-17T02:21:27.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:27.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587943+0000", 2024-09-17T02:21:27.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017347900000000001 2024-09-17T02:21:27.846 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.847 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.847 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.847 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.847 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.847 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:27.847 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:21:27.847 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 71.263944653999999, 2024-09-17T02:21:27.847 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031809104999999997, 2024-09-17T02:21:27.847 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.847 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.847 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.847 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.847 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.847 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.848 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:21:27.848 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.848 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.848 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.848 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.848 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556564+0000", 2024-09-17T02:21:27.848 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.848 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.848 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.848 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.848 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556565+0000", 2024-09-17T02:21:27.848 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.116e-06 2024-09-17T02:21:27.848 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.849 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556572+0000", 2024-09-17T02:21:27.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0230000000000004e-06 2024-09-17T02:21:27.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.849 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556588+0000", 2024-09-17T02:21:27.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6643e-05 2024-09-17T02:21:27.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.849 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556606+0000", 2024-09-17T02:21:27.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7159999999999998e-05 2024-09-17T02:21:27.850 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.850 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.850 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.850 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562712+0000", 2024-09-17T02:21:27.850 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0061061630000000004 2024-09-17T02:21:27.850 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.850 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.850 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:27.850 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562919+0000", 2024-09-17T02:21:27.850 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000207309 2024-09-17T02:21:27.850 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.850 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.850 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.850 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563264+0000", 2024-09-17T02:21:27.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00034490699999999998 2024-09-17T02:21:27.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.851 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.851 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:27.851 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571812+0000", 2024-09-17T02:21:27.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0085477810000000008 2024-09-17T02:21:27.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.851 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.851 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.851 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588094+0000", 2024-09-17T02:21:27.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016282443000000001 2024-09-17T02:21:27.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.851 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.851 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:27.852 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588275+0000", 2024-09-17T02:21:27.852 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018058700000000001 2024-09-17T02:21:27.852 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.852 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.852 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:27.852 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588373+0000", 2024-09-17T02:21:27.852 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7973000000000005e-05 2024-09-17T02:21:27.852 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.852 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.852 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.852 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.852 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.852 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:27.853 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:21:27.853 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 71.263886554999999, 2024-09-17T02:21:27.853 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031950544999999997, 2024-09-17T02:21:27.853 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.853 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.853 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.853 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.853 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.853 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.853 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:21:27.853 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.853 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.854 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.854 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.854 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556622+0000", 2024-09-17T02:21:27.854 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.854 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.854 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.854 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.854 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556623+0000", 2024-09-17T02:21:27.854 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.04e-06 2024-09-17T02:21:27.854 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.854 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.854 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.854 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556631+0000", 2024-09-17T02:21:27.854 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1529999999999997e-06 2024-09-17T02:21:27.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.855 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.855 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556648+0000", 2024-09-17T02:21:27.855 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6583999999999999e-05 2024-09-17T02:21:27.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.855 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.855 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556661+0000", 2024-09-17T02:21:27.855 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3203e-05 2024-09-17T02:21:27.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.856 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.856 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564413+0000", 2024-09-17T02:21:27.856 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0077523100000000001 2024-09-17T02:21:27.856 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.856 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.856 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:27.856 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.565841+0000", 2024-09-17T02:21:27.856 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014276320000000001 2024-09-17T02:21:27.856 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.856 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.856 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.856 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.566131+0000", 2024-09-17T02:21:27.856 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029043800000000001 2024-09-17T02:21:27.857 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.857 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.857 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:27.857 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572353+0000", 2024-09-17T02:21:27.857 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.006222399 2024-09-17T02:21:27.857 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.857 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.857 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.857 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588452+0000", 2024-09-17T02:21:27.857 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016098635 2024-09-17T02:21:27.857 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.857 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:27.858 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588520+0000", 2024-09-17T02:21:27.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8040000000000006e-05 2024-09-17T02:21:27.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:27.858 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588572+0000", 2024-09-17T02:21:27.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2111000000000003e-05 2024-09-17T02:21:27.858 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.858 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.858 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.859 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.859 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:27.859 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:21:27.859 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 71.263789388999996, 2024-09-17T02:21:27.859 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.032187205000000003, 2024-09-17T02:21:27.859 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.859 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.859 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.859 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.859 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.859 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.859 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:21:27.860 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.860 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.860 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.860 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.860 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556719+0000", 2024-09-17T02:21:27.860 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.860 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.860 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.860 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.860 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556727+0000", 2024-09-17T02:21:27.860 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3000000000000002e-06 2024-09-17T02:21:27.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.861 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556736+0000", 2024-09-17T02:21:27.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4300000000000006e-06 2024-09-17T02:21:27.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.861 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556755+0000", 2024-09-17T02:21:27.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9700000000000001e-05 2024-09-17T02:21:27.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.862 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556771+0000", 2024-09-17T02:21:27.862 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5213e-05 2024-09-17T02:21:27.862 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.862 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.862 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571184+0000", 2024-09-17T02:21:27.862 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014413888999999999 2024-09-17T02:21:27.862 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.862 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:27.862 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571302+0000", 2024-09-17T02:21:27.862 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011794900000000001 2024-09-17T02:21:27.862 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.863 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.863 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.571494+0000", 2024-09-17T02:21:27.863 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000191168 2024-09-17T02:21:27.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.863 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.863 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:27.863 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.573775+0000", 2024-09-17T02:21:27.863 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002281656 2024-09-17T02:21:27.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.863 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.863 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.863 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588668+0000", 2024-09-17T02:21:27.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014892699000000001 2024-09-17T02:21:27.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.864 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:27.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588813+0000", 2024-09-17T02:21:27.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014530700000000001 2024-09-17T02:21:27.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.864 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:27.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588906+0000", 2024-09-17T02:21:27.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2893999999999995e-05 2024-09-17T02:21:27.864 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.864 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.864 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.865 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.865 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.865 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:27.865 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:21:27.865 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 71.263590957000005, 2024-09-17T02:21:27.865 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.030862568, 2024-09-17T02:21:27.865 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.865 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.865 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.865 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.865 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.865 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.866 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:21:27.866 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.866 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.866 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556917+0000", 2024-09-17T02:21:27.866 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.866 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.866 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556918+0000", 2024-09-17T02:21:27.866 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0529999999999999e-06 2024-09-17T02:21:27.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556925+0000", 2024-09-17T02:21:27.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.6939999999999998e-06 2024-09-17T02:21:27.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556942+0000", 2024-09-17T02:21:27.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6803000000000002e-05 2024-09-17T02:21:27.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556955+0000", 2024-09-17T02:21:27.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2659e-05 2024-09-17T02:21:27.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.868 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.868 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.868 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558237+0000", 2024-09-17T02:21:27.868 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001282804 2024-09-17T02:21:27.868 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.868 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.868 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:27.868 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.558495+0000", 2024-09-17T02:21:27.868 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000257178 2024-09-17T02:21:27.868 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.868 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.868 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:27.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.562168+0000", 2024-09-17T02:21:27.869 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0036737110000000001 2024-09-17T02:21:27.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:27.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.570855+0000", 2024-09-17T02:21:27.869 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0086868729999999995 2024-09-17T02:21:27.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.869 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.869 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587568+0000", 2024-09-17T02:21:27.869 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.016712444999999999 2024-09-17T02:21:27.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.870 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.870 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:27.870 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587677+0000", 2024-09-17T02:21:27.870 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000109879 2024-09-17T02:21:27.870 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.870 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.870 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:27.870 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587780+0000", 2024-09-17T02:21:27.870 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000102469 2024-09-17T02:21:27.870 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.870 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.870 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.871 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.871 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.871 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:27.871 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:21:27.871 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 71.263508825000002, 2024-09-17T02:21:27.871 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031005751000000002, 2024-09-17T02:21:27.871 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.871 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.871 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.871 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.871 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.871 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.871 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:21:27.872 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.872 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.872 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.872 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.872 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.556999+0000", 2024-09-17T02:21:27.872 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.872 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.872 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.872 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.872 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557001+0000", 2024-09-17T02:21:27.872 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.237e-06 2024-09-17T02:21:27.872 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.873 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.873 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.873 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557007+0000", 2024-09-17T02:21:27.873 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7270000000000001e-06 2024-09-17T02:21:27.873 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.873 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.873 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.873 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557025+0000", 2024-09-17T02:21:27.873 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7689999999999998e-05 2024-09-17T02:21:27.873 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.873 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.873 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.873 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.557039+0000", 2024-09-17T02:21:27.873 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.385e-05 2024-09-17T02:21:27.874 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.874 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.874 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.874 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.563783+0000", 2024-09-17T02:21:27.874 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0067437110000000003 2024-09-17T02:21:27.874 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.874 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.874 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:27.874 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564031+0000", 2024-09-17T02:21:27.874 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00024871799999999999 2024-09-17T02:21:27.874 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.874 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.875 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:27.875 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.564518+0000", 2024-09-17T02:21:27.875 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00048708999999999997 2024-09-17T02:21:27.875 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.875 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.875 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:27.875 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.572375+0000", 2024-09-17T02:21:27.875 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078564780000000001 2024-09-17T02:21:27.875 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.875 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.875 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.875 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587862+0000", 2024-09-17T02:21:27.875 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.015486837999999999 2024-09-17T02:21:27.876 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.876 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.876 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:27.876 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.587954+0000", 2024-09-17T02:21:27.876 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1766000000000002e-05 2024-09-17T02:21:27.876 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.876 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.876 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:27.876 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:16.588005+0000", 2024-09-17T02:21:27.876 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1646e-05 2024-09-17T02:21:27.876 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.876 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.876 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.876 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.877 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.877 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28720 5.f 5:f8a7aea5:::benchmark_data_smithi001_23533_object28719:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:27.877 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:27.877 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 45.252721397000002, 2024-09-17T02:21:27.877 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.033978608, 2024-09-17T02:21:27.877 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.877 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.877 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.877 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:27.877 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:27.877 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.877 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28720 2024-09-17T02:21:27.877 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.878 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.878 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.878 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.878 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:27.878 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.878 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.878 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.878 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.878 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:27.878 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.878 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.878 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.878 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.878 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567787+0000", 2024-09-17T02:21:27.879 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3200000000000005e-07 2024-09-17T02:21:27.879 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.879 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.879 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.879 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567856+0000", 2024-09-17T02:21:27.879 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8596000000000005e-05 2024-09-17T02:21:27.879 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.879 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.879 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.879 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567864+0000", 2024-09-17T02:21:27.879 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6040000000000004e-06 2024-09-17T02:21:27.879 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.879 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.880 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.880 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567867+0000", 2024-09-17T02:21:27.880 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7929999999999999e-06 2024-09-17T02:21:27.880 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.880 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.880 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.880 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567896+0000", 2024-09-17T02:21:27.880 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8444000000000001e-05 2024-09-17T02:21:27.880 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.880 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.880 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:27.880 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.567983+0000", 2024-09-17T02:21:27.880 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7498999999999997e-05 2024-09-17T02:21:27.881 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.881 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.881 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.881 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568078+0000", 2024-09-17T02:21:27.881 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5050999999999995e-05 2024-09-17T02:21:27.881 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.881 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.881 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:27.881 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573091+0000", 2024-09-17T02:21:27.881 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050124599999999998 2024-09-17T02:21:27.881 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.881 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.882 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.882 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601705+0000", 2024-09-17T02:21:27.882 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028614298999999999 2024-09-17T02:21:27.882 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.882 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.882 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:27.882 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601741+0000", 2024-09-17T02:21:27.882 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5329e-05 2024-09-17T02:21:27.882 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.882 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.882 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:27.882 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601766+0000", 2024-09-17T02:21:27.882 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5001e-05 2024-09-17T02:21:27.883 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.883 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.883 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.883 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.883 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28723 5.f 5:f1a2a8f6:::benchmark_data_smithi001_23533_object28722:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:27.883 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:21:27.883 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 45.252442717000001, 2024-09-17T02:21:27.883 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.033805288000000003, 2024-09-17T02:21:27.883 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.883 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.883 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.884 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:27.884 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:27.884 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.884 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28723 2024-09-17T02:21:27.884 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.884 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.884 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.884 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.884 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:21:27.884 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.884 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.884 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.885 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.885 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568066+0000", 2024-09-17T02:21:27.885 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.885 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.885 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.885 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.885 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568067+0000", 2024-09-17T02:21:27.885 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6700000000000002e-07 2024-09-17T02:21:27.885 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.885 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.885 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.885 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568121+0000", 2024-09-17T02:21:27.885 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4286000000000002e-05 2024-09-17T02:21:27.886 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.886 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.886 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.886 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568131+0000", 2024-09-17T02:21:27.886 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0288e-05 2024-09-17T02:21:27.886 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.886 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.886 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.886 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.568139+0000", 2024-09-17T02:21:27.886 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5399999999999998e-06 2024-09-17T02:21:27.886 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.886 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.886 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.887 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569194+0000", 2024-09-17T02:21:27.887 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0010557100000000001 2024-09-17T02:21:27.887 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.887 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.887 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:27.887 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569298+0000", 2024-09-17T02:21:27.887 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000103491 2024-09-17T02:21:27.887 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.887 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.887 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.887 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569428+0000", 2024-09-17T02:21:27.887 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013050599999999999 2024-09-17T02:21:27.887 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.887 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.887 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:27.888 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573124+0000", 2024-09-17T02:21:27.888 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0036956810000000001 2024-09-17T02:21:27.888 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.888 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.888 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.888 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601801+0000", 2024-09-17T02:21:27.888 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.028676667999999999 2024-09-17T02:21:27.888 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.888 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.888 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:27.888 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601835+0000", 2024-09-17T02:21:27.888 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4347000000000002e-05 2024-09-17T02:21:27.888 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.889 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.889 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:27.889 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.601871+0000", 2024-09-17T02:21:27.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5803999999999998e-05 2024-09-17T02:21:27.889 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.889 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.889 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.889 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.889 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.889 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28729 5.9 5:9e3b1489:::benchmark_data_smithi001_23533_object28728:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:27.889 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:21:27.889 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 45.250824066, 2024-09-17T02:21:27.889 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.032738525999999997, 2024-09-17T02:21:27.890 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.890 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.890 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.890 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:27.890 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:27.890 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.890 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28729 2024-09-17T02:21:27.890 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.890 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.890 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.890 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.890 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:21:27.891 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.891 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.891 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.891 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.891 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569684+0000", 2024-09-17T02:21:27.891 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.891 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.891 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.891 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.891 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569685+0000", 2024-09-17T02:21:27.891 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8599999999999996e-07 2024-09-17T02:21:27.891 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.892 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.892 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.892 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569725+0000", 2024-09-17T02:21:27.892 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0144000000000001e-05 2024-09-17T02:21:27.892 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.892 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.892 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.892 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569737+0000", 2024-09-17T02:21:27.892 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1752e-05 2024-09-17T02:21:27.892 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.892 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.892 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.892 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569745+0000", 2024-09-17T02:21:27.893 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6420000000000007e-06 2024-09-17T02:21:27.893 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.893 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.893 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.893 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569801+0000", 2024-09-17T02:21:27.893 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6110000000000003e-05 2024-09-17T02:21:27.893 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.893 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.893 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:27.893 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.569944+0000", 2024-09-17T02:21:27.893 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014361500000000001 2024-09-17T02:21:27.893 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.893 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.893 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.893 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.570234+0000", 2024-09-17T02:21:27.894 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00028927899999999998 2024-09-17T02:21:27.894 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.894 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.894 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:27.894 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572606+0000", 2024-09-17T02:21:27.894 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023725529999999999 2024-09-17T02:21:27.894 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.894 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.894 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.894 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602361+0000", 2024-09-17T02:21:27.894 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.029755031000000001 2024-09-17T02:21:27.894 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.894 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.894 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:27.895 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602397+0000", 2024-09-17T02:21:27.895 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5509000000000002e-05 2024-09-17T02:21:27.895 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.895 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.895 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:27.895 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.602423+0000", 2024-09-17T02:21:27.895 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5905e-05 2024-09-17T02:21:27.895 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.895 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.895 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.895 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.895 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.895 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:28734 5.f 5:f1a63647:::benchmark_data_smithi001_23533_object28733:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:27.896 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:21:27.896 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 45.249101580000001, 2024-09-17T02:21:27.896 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.034441100000000002, 2024-09-17T02:21:27.896 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.896 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.896 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.896 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:27.896 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:27.896 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.896 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 28734 2024-09-17T02:21:27.896 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.896 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.897 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.897 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.897 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:21:27.897 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.897 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.897 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.897 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.897 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571407+0000", 2024-09-17T02:21:27.897 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.897 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.897 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.897 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.897 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571408+0000", 2024-09-17T02:21:27.898 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.8899999999999998e-07 2024-09-17T02:21:27.898 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.898 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.898 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.898 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571464+0000", 2024-09-17T02:21:27.898 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6546999999999999e-05 2024-09-17T02:21:27.898 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.898 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.898 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.898 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571474+0000", 2024-09-17T02:21:27.898 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0348e-05 2024-09-17T02:21:27.898 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.898 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.898 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.899 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.571480+0000", 2024-09-17T02:21:27.899 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.366e-06 2024-09-17T02:21:27.899 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.899 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.899 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.899 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572097+0000", 2024-09-17T02:21:27.899 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061710599999999997 2024-09-17T02:21:27.899 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.899 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.899 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:27.899 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572172+0000", 2024-09-17T02:21:27.899 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4658000000000002e-05 2024-09-17T02:21:27.899 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.900 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.900 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.900 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.572247+0000", 2024-09-17T02:21:27.900 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5766000000000006e-05 2024-09-17T02:21:27.900 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.900 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.900 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:27.900 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.573819+0000", 2024-09-17T02:21:27.900 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015713649999999999 2024-09-17T02:21:27.900 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.900 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.900 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.901 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605762+0000", 2024-09-17T02:21:27.901 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.031943304999999998 2024-09-17T02:21:27.901 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.901 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.901 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:27.901 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605808+0000", 2024-09-17T02:21:27.901 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5776999999999999e-05 2024-09-17T02:21:27.901 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.901 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.901 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:27.901 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:20:42.605848+0000", 2024-09-17T02:21:27.901 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9972999999999998e-05 2024-09-17T02:21:27.901 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.902 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.902 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.902 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.902 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.902 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:97761 5.9 5:908717b6:::benchmark_data_smithi001_23533_object97760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:27.902 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.597267+0000", 2024-09-17T02:21:27.902 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 10.22324107, 2024-09-17T02:21:27.902 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.093254994999999993, 2024-09-17T02:21:27.902 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.902 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.902 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.902 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:27.902 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:27.903 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.903 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 97761 2024-09-17T02:21:27.903 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.903 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.903 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.903 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.903 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597267+0000", 2024-09-17T02:21:27.903 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.903 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.903 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.903 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.903 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597267+0000", 2024-09-17T02:21:27.903 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.904 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.904 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.904 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597268+0000", 2024-09-17T02:21:27.904 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6300000000000004e-07 2024-09-17T02:21:27.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.904 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.904 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.904 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597425+0000", 2024-09-17T02:21:27.904 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015732499999999999 2024-09-17T02:21:27.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.904 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.905 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.905 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597436+0000", 2024-09-17T02:21:27.905 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1015e-05 2024-09-17T02:21:27.905 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.905 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.905 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.905 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597443+0000", 2024-09-17T02:21:27.905 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3840000000000002e-06 2024-09-17T02:21:27.905 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.905 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.905 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.905 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597551+0000", 2024-09-17T02:21:27.905 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000108274 2024-09-17T02:21:27.905 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.905 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.906 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:27.906 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597683+0000", 2024-09-17T02:21:27.906 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000131645 2024-09-17T02:21:27.906 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.906 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.906 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.906 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597835+0000", 2024-09-17T02:21:27.906 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015207400000000001 2024-09-17T02:21:27.906 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.906 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.906 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:27.906 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604322+0000", 2024-09-17T02:21:27.906 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064874829999999996 2024-09-17T02:21:27.906 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.906 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.906 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.907 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690350+0000", 2024-09-17T02:21:27.907 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.086028154999999995 2024-09-17T02:21:27.907 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.907 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.907 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:27.907 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690448+0000", 2024-09-17T02:21:27.907 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8129999999999997e-05 2024-09-17T02:21:27.907 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.907 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.907 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:27.907 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690522+0000", 2024-09-17T02:21:27.907 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3746999999999997e-05 2024-09-17T02:21:27.907 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.908 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.908 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.908 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.908 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.908 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:97763 5.9 5:95165281:::benchmark_data_smithi001_23533_object97762:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:27.908 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.597457+0000", 2024-09-17T02:21:27.908 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 10.223051723999999, 2024-09-17T02:21:27.908 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.093308472000000003, 2024-09-17T02:21:27.908 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.908 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.908 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.908 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:27.908 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:27.908 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.909 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 97763 2024-09-17T02:21:27.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.909 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.909 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.909 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597457+0000", 2024-09-17T02:21:27.909 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.909 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.909 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597457+0000", 2024-09-17T02:21:27.909 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.910 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.910 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597457+0000", 2024-09-17T02:21:27.910 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1699999999999999e-07 2024-09-17T02:21:27.910 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.910 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.910 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.910 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597485+0000", 2024-09-17T02:21:27.910 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7923e-05 2024-09-17T02:21:27.910 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.910 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.910 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.911 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597492+0000", 2024-09-17T02:21:27.911 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8990000000000004e-06 2024-09-17T02:21:27.911 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.911 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.911 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.911 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.597497+0000", 2024-09-17T02:21:27.911 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8709999999999996e-06 2024-09-17T02:21:27.911 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.911 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.911 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.911 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599319+0000", 2024-09-17T02:21:27.911 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0018221680000000001 2024-09-17T02:21:27.911 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.912 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.912 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:27.912 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599405+0000", 2024-09-17T02:21:27.912 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6119999999999995e-05 2024-09-17T02:21:27.912 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.912 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.912 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.912 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599495+0000", 2024-09-17T02:21:27.912 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9963000000000006e-05 2024-09-17T02:21:27.912 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.912 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.912 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:27.912 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604325+0000", 2024-09-17T02:21:27.913 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048300829999999998 2024-09-17T02:21:27.913 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.913 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.913 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.913 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690598+0000", 2024-09-17T02:21:27.913 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.086272969000000005 2024-09-17T02:21:27.913 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.913 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.913 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:27.913 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690696+0000", 2024-09-17T02:21:27.913 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8053000000000005e-05 2024-09-17T02:21:27.913 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.913 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.914 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:27.914 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690765+0000", 2024-09-17T02:21:27.914 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9005999999999996e-05 2024-09-17T02:21:27.914 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.914 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.914 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.914 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.914 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.914 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:97766 5.f 5:f82e5e9e:::benchmark_data_smithi001_23533_object97765:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:27.914 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.599640+0000", 2024-09-17T02:21:27.914 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 10.220867969, 2024-09-17T02:21:27.914 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.090645999000000005, 2024-09-17T02:21:27.914 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.914 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.915 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.915 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:27.915 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:27.915 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.915 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 97766 2024-09-17T02:21:27.915 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.915 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.915 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.915 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.915 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599640+0000", 2024-09-17T02:21:27.915 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.915 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.915 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.915 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.915 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599640+0000", 2024-09-17T02:21:27.916 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.916 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.916 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.916 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.916 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599641+0000", 2024-09-17T02:21:27.916 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.95e-07 2024-09-17T02:21:27.916 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.916 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.916 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.916 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599720+0000", 2024-09-17T02:21:27.916 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8527000000000002e-05 2024-09-17T02:21:27.916 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.916 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.916 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.916 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599729+0000", 2024-09-17T02:21:27.917 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4040000000000001e-06 2024-09-17T02:21:27.917 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.917 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.917 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.917 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599734+0000", 2024-09-17T02:21:27.917 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8550000000000001e-06 2024-09-17T02:21:27.917 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.917 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.917 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.917 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599770+0000", 2024-09-17T02:21:27.917 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6139000000000001e-05 2024-09-17T02:21:27.917 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.917 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.918 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:27.918 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599868+0000", 2024-09-17T02:21:27.918 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7816e-05 2024-09-17T02:21:27.918 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.918 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.918 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.918 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.599946+0000", 2024-09-17T02:21:27.918 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8064000000000003e-05 2024-09-17T02:21:27.918 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.918 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.918 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:27.918 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.603915+0000", 2024-09-17T02:21:27.918 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003969017 2024-09-17T02:21:27.918 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.919 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.919 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.919 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690096+0000", 2024-09-17T02:21:27.919 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.086180997999999995 2024-09-17T02:21:27.919 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.919 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.919 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:27.919 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690212+0000", 2024-09-17T02:21:27.919 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0001155 2024-09-17T02:21:27.919 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.919 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.919 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:27.919 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690286+0000", 2024-09-17T02:21:27.920 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4684000000000005e-05 2024-09-17T02:21:27.920 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.920 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.920 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.920 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.920 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.920 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:97768 5.d 5:b646c3c5:::benchmark_data_smithi001_23533_object97767:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:27.920 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.601357+0000", 2024-09-17T02:21:27.920 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 10.219151779000001, 2024-09-17T02:21:27.920 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.096153645999999995, 2024-09-17T02:21:27.920 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.920 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.920 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.920 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:27.921 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:27.921 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.921 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 97768 2024-09-17T02:21:27.921 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.921 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.921 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.921 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.921 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601357+0000", 2024-09-17T02:21:27.921 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.921 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.921 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.921 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.921 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601357+0000", 2024-09-17T02:21:27.921 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.922 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.922 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.922 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.922 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601357+0000", 2024-09-17T02:21:27.922 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3900000000000004e-07 2024-09-17T02:21:27.922 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.922 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.922 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.922 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601439+0000", 2024-09-17T02:21:27.922 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2139999999999996e-05 2024-09-17T02:21:27.922 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.922 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.922 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.922 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601452+0000", 2024-09-17T02:21:27.924 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2166e-05 2024-09-17T02:21:27.925 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.925 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.925 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.925 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601458+0000", 2024-09-17T02:21:27.925 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7340000000000002e-06 2024-09-17T02:21:27.925 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.925 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.925 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.925 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601498+0000", 2024-09-17T02:21:27.925 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9368e-05 2024-09-17T02:21:27.925 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.926 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.926 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:27.926 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601616+0000", 2024-09-17T02:21:27.926 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000118684 2024-09-17T02:21:27.926 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.926 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.926 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.926 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601699+0000", 2024-09-17T02:21:27.926 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2519000000000001e-05 2024-09-17T02:21:27.926 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.926 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.927 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:27.927 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604447+0000", 2024-09-17T02:21:27.927 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027481620000000002 2024-09-17T02:21:27.927 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.927 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.927 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.927 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.697379+0000", 2024-09-17T02:21:27.927 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.092932030999999998 2024-09-17T02:21:27.927 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.927 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.927 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:27.927 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.697444+0000", 2024-09-17T02:21:27.928 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5155999999999998e-05 2024-09-17T02:21:27.928 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.928 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.928 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:27.928 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.697510+0000", 2024-09-17T02:21:27.928 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5846999999999995e-05 2024-09-17T02:21:27.928 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.928 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.928 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.928 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.928 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.928 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:97769 5.d 5:b3b4045f:::benchmark_data_smithi001_23533_object97768:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:27.928 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.601473+0000", 2024-09-17T02:21:27.929 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 10.219035724999999, 2024-09-17T02:21:27.929 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.096303069000000005, 2024-09-17T02:21:27.929 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.929 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.929 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.929 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:27.929 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:27.929 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.929 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 97769 2024-09-17T02:21:27.929 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.929 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.929 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.930 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.930 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601473+0000", 2024-09-17T02:21:27.930 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.930 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.930 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.930 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.930 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601473+0000", 2024-09-17T02:21:27.930 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.930 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.930 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.930 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.930 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601473+0000", 2024-09-17T02:21:27.931 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7299999999999996e-07 2024-09-17T02:21:27.931 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.931 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.931 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.931 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601511+0000", 2024-09-17T02:21:27.931 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8034000000000002e-05 2024-09-17T02:21:27.931 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.931 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.931 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.931 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601521+0000", 2024-09-17T02:21:27.931 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0016e-05 2024-09-17T02:21:27.931 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.931 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.931 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.931 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.601527+0000", 2024-09-17T02:21:27.932 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4639999999999997e-06 2024-09-17T02:21:27.932 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.932 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.932 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.932 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.603170+0000", 2024-09-17T02:21:27.932 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0016433089999999999 2024-09-17T02:21:27.932 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.932 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.932 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:27.932 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.603249+0000", 2024-09-17T02:21:27.932 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8699e-05 2024-09-17T02:21:27.932 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.932 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.933 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.933 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.603330+0000", 2024-09-17T02:21:27.933 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1489999999999994e-05 2024-09-17T02:21:27.933 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.933 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.933 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:27.933 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.605667+0000", 2024-09-17T02:21:27.933 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023371389999999998 2024-09-17T02:21:27.933 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.933 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.933 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.933 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.697612+0000", 2024-09-17T02:21:27.934 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.091944520000000002 2024-09-17T02:21:27.934 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.934 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.934 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:27.934 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.697708+0000", 2024-09-17T02:21:27.934 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6096999999999998e-05 2024-09-17T02:21:27.934 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.934 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.934 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:27.934 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.697776+0000", 2024-09-17T02:21:27.934 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7727999999999999e-05 2024-09-17T02:21:27.934 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.935 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.935 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.935 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.935 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.935 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:97771 5.9 5:918a4ce1:::benchmark_data_smithi001_23533_object97770:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:27.935 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.602798+0000", 2024-09-17T02:21:27.935 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 10.217710556, 2024-09-17T02:21:27.935 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.091332647000000003, 2024-09-17T02:21:27.935 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.935 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.935 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.935 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:27.935 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:27.935 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.936 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 97771 2024-09-17T02:21:27.936 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.936 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.936 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.936 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.936 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.602798+0000", 2024-09-17T02:21:27.936 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.936 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.936 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.936 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.936 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.602798+0000", 2024-09-17T02:21:27.936 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.936 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.936 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.936 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.937 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.602798+0000", 2024-09-17T02:21:27.937 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4600000000000004e-07 2024-09-17T02:21:27.937 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.937 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.937 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.937 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.602877+0000", 2024-09-17T02:21:27.937 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8511999999999996e-05 2024-09-17T02:21:27.937 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.937 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.937 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.937 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.602886+0000", 2024-09-17T02:21:27.937 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.3689999999999996e-06 2024-09-17T02:21:27.937 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.937 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.938 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.938 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.602891+0000", 2024-09-17T02:21:27.938 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8250000000000004e-06 2024-09-17T02:21:27.938 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.938 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.938 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.938 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.602934+0000", 2024-09-17T02:21:27.938 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3025000000000002e-05 2024-09-17T02:21:27.938 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.938 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.938 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:27.938 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.603016+0000", 2024-09-17T02:21:27.938 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1718000000000006e-05 2024-09-17T02:21:27.938 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.939 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.939 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:27.939 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.603107+0000", 2024-09-17T02:21:27.939 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0588999999999996e-05 2024-09-17T02:21:27.939 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.939 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.939 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:27.939 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604720+0000", 2024-09-17T02:21:27.939 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001613831 2024-09-17T02:21:27.939 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.939 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.939 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.939 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.693951+0000", 2024-09-17T02:21:27.939 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.089231104000000006 2024-09-17T02:21:27.940 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.940 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.940 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:27.940 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.694054+0000", 2024-09-17T02:21:27.940 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000102446 2024-09-17T02:21:27.940 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.940 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.940 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:27.940 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.694130+0000", 2024-09-17T02:21:27.940 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6482000000000004e-05 2024-09-17T02:21:27.940 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.940 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.941 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.941 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.941 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.941 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4466.0:97772 5.3 5:c001bee5:::benchmark_data_smithi001_23533_object97771:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:27.941 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-17T02:21:17.604119+0000", 2024-09-17T02:21:27.941 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 10.21638969, 2024-09-17T02:21:27.941 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.086607842000000004, 2024-09-17T02:21:27.941 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-17T02:21:27.941 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-17T02:21:27.941 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:27.941 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-09-17T02:21:27.941 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4466", 2024-09-17T02:21:27.941 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:27.942 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 97772 2024-09-17T02:21:27.942 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.942 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-17T02:21:27.942 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.942 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-17T02:21:27.942 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604119+0000", 2024-09-17T02:21:27.942 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.942 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.942 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.942 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-17T02:21:27.942 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604119+0000", 2024-09-17T02:21:27.942 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-17T02:21:27.942 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.942 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.942 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-17T02:21:27.942 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604119+0000", 2024-09-17T02:21:27.943 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.09e-07 2024-09-17T02:21:27.943 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.943 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.943 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-17T02:21:27.943 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604183+0000", 2024-09-17T02:21:27.943 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3659999999999997e-05 2024-09-17T02:21:27.943 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.943 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.943 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-17T02:21:27.943 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604195+0000", 2024-09-17T02:21:27.943 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1783999999999999e-05 2024-09-17T02:21:27.943 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.943 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.944 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-17T02:21:27.944 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604203+0000", 2024-09-17T02:21:27.944 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2390000000000002e-06 2024-09-17T02:21:27.944 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.944 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.944 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-17T02:21:27.944 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604256+0000", 2024-09-17T02:21:27.944 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3103000000000003e-05 2024-09-17T02:21:27.944 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.944 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.944 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-17T02:21:27.944 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604348+0000", 2024-09-17T02:21:27.944 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1837999999999997e-05 2024-09-17T02:21:27.945 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.945 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.945 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0,1", 2024-09-17T02:21:27.945 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.604458+0000", 2024-09-17T02:21:27.945 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000110431 2024-09-17T02:21:27.945 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.945 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.945 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.945 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.606523+0000", 2024-09-17T02:21:27.945 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020649359999999999 2024-09-17T02:21:27.945 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.945 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.945 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-17T02:21:27.946 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.607160+0000", 2024-09-17T02:21:27.946 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00063626000000000004 2024-09-17T02:21:27.946 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.946 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.946 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:27.946 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690459+0000", 2024-09-17T02:21:27.946 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.083299629 2024-09-17T02:21:27.946 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.946 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.946 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-17T02:21:27.946 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690529+0000", 2024-09-17T02:21:27.946 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0203999999999994e-05 2024-09-17T02:21:27.946 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-17T02:21:27.946 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-17T02:21:27.946 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-17T02:21:27.947 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-17T02:21:17.690726+0000", 2024-09-17T02:21:27.947 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000196949 2024-09-17T02:21:27.947 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.947 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.947 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.947 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-17T02:21:27.947 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-17T02:21:27.947 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:21:27.949 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:27.946+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:27.949 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:28.049 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:28.049+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:28.108 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:28.108 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:28.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.108 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:118776 5.b 5:db79810e:::benchmark_data_smithi001_23533_object118775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T02:21:28.109 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:28.112778+0000", 2024-09-17T02:21:28.109 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00085077999999999998, 2024-09-17T02:21:28.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087925999999999998, 2024-09-17T02:21:28.109 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:28.109 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:28.109 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:28.109 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:28.109 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:28.109 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:28.109 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 118776 2024-09-17T02:21:28.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.109 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:28.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:28.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112778+0000", 2024-09-17T02:21:28.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:28.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:28.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112778+0000", 2024-09-17T02:21:28.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:28.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:28.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112779+0000", 2024-09-17T02:21:28.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.018e-06 2024-09-17T02:21:28.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:28.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112909+0000", 2024-09-17T02:21:28.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012952800000000001 2024-09-17T02:21:28.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:28.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112921+0000", 2024-09-17T02:21:28.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2003e-05 2024-09-17T02:21:28.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:28.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112928+0000", 2024-09-17T02:21:28.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5700000000000004e-06 2024-09-17T02:21:28.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:28.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.113190+0000", 2024-09-17T02:21:28.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000261785 2024-09-17T02:21:28.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:28.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.113465+0000", 2024-09-17T02:21:28.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027514400000000001 2024-09-17T02:21:28.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:28.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.113646+0000", 2024-09-17T02:21:28.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000180998 2024-09-17T02:21:28.113 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:28.113 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:28.113 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:28.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.113 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:118775 5.f e48/22 5:faaa4a4d:::benchmark_data_smithi001_23533_object118774:head v 48'7449, mlcod=48'7447)", 2024-09-17T02:21:28.113 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:28.112918+0000", 2024-09-17T02:21:28.113 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00071039699999999998, 2024-09-17T02:21:28.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00082377899999999996, 2024-09-17T02:21:28.114 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:28.114 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:28.114 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:28.114 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:28.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:28.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112918+0000", 2024-09-17T02:21:28.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:28.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:28.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112918+0000", 2024-09-17T02:21:28.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:28.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:28.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112919+0000", 2024-09-17T02:21:28.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7700000000000004e-07 2024-09-17T02:21:28.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:28.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112952+0000", 2024-09-17T02:21:28.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3058000000000001e-05 2024-09-17T02:21:28.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:28.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112961+0000", 2024-09-17T02:21:28.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.507e-06 2024-09-17T02:21:28.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:28.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112966+0000", 2024-09-17T02:21:28.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8950000000000003e-06 2024-09-17T02:21:28.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:28.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.113019+0000", 2024-09-17T02:21:28.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2383000000000003e-05 2024-09-17T02:21:28.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:28.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.113040+0000", 2024-09-17T02:21:28.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0823999999999999e-05 2024-09-17T02:21:28.117 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:28.117 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:28.117 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:28.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.117 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:118768 5.0 e48/26 5:049d3608:::benchmark_data_smithi001_23533_object118767:head v 48'7401, mlcod=48'7398)", 2024-09-17T02:21:28.117 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:28.112042+0000", 2024-09-17T02:21:28.117 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0015865429999999999, 2024-09-17T02:21:28.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001758948, 2024-09-17T02:21:28.117 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:28.117 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:28.118 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:28.118 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:28.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:28.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112042+0000", 2024-09-17T02:21:28.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:28.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:28.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112042+0000", 2024-09-17T02:21:28.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:28.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:28.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112043+0000", 2024-09-17T02:21:28.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3099999999999998e-07 2024-09-17T02:21:28.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:28.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112100+0000", 2024-09-17T02:21:28.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7587999999999998e-05 2024-09-17T02:21:28.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:28.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112112+0000", 2024-09-17T02:21:28.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1141000000000001e-05 2024-09-17T02:21:28.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:28.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112119+0000", 2024-09-17T02:21:28.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4490000000000002e-06 2024-09-17T02:21:28.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:28.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112161+0000", 2024-09-17T02:21:28.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1634000000000002e-05 2024-09-17T02:21:28.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:28.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112176+0000", 2024-09-17T02:21:28.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5503e-05 2024-09-17T02:21:28.121 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:28.121 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:28.121 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:28.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.121 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:118770 5.1 e48/36 5:819236d8:::benchmark_data_smithi001_23533_object118769:head v 48'7405, mlcod=48'7401)", 2024-09-17T02:21:28.121 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:28.112215+0000", 2024-09-17T02:21:28.121 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.001413945, 2024-09-17T02:21:28.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001618045, 2024-09-17T02:21:28.121 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:28.121 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:28.121 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:28.121 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:28.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:28.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112215+0000", 2024-09-17T02:21:28.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:28.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:28.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112215+0000", 2024-09-17T02:21:28.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:28.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:28.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112215+0000", 2024-09-17T02:21:28.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3399999999999999e-07 2024-09-17T02:21:28.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:28.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112302+0000", 2024-09-17T02:21:28.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6726999999999998e-05 2024-09-17T02:21:28.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:28.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112311+0000", 2024-09-17T02:21:28.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.687e-06 2024-09-17T02:21:28.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:28.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112315+0000", 2024-09-17T02:21:28.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4830000000000001e-06 2024-09-17T02:21:28.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:28.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112365+0000", 2024-09-17T02:21:28.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9821000000000003e-05 2024-09-17T02:21:28.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:28.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:28.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:28.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:28.112386+0000", 2024-09-17T02:21:28.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0477000000000001e-05 2024-09-17T02:21:28.124 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:28.125 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:28.125 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:28.129 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:28.129 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:21:28.129 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 4 2024-09-17T02:21:28.129 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:28.130 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:28.150 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:28.150+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:28.234 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:21:28.251 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:28.254+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:28.323 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:28.323 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:21:28.323 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:21:28.323 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:21:28.323 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:28.343 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:28.352 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:28.350+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:28.404 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:21:28.404 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:21:28.422 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:21:28.422 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:21:28.441 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:21:28.441 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:21:28.453 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:28.454+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:28.502 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:28.502 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:28.523 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:28.553 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:28.554+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:28.655 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:28.654+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:28.676 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:28.676 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:28.696 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:28.755 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:28.754+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:28.775 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 56 16 120105 120089 134.013 125.812 0.00679633 0.00745733 2024-09-17T02:21:28.857 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:28.858+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:28.893 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:28.893 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:28.914 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:28.957 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:28.957+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:29.058 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:29.058+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:29.070 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:29.070 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:29.091 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:21:29.159 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:29.162+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:29.253 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:29.253 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:29.260 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:29.262+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:29.274 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T02:21:29.362 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:29.362+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:29.428 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:29.428 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:29.449 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T02:21:29.469 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T02:21:29.493 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:29.494+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:29.564 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:29.565+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:29.652 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:29.652 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:29.665 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:29.665+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:29.675 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:29.766 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:29.766+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:29.778 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 57 16 122118 122102 133.868 125.812 0.00798436 0.00746513 2024-09-17T02:21:29.830 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:29.830 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:29.851 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:29.867 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:21:29.866+0000 7fcbb8ea8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23019) UID: 0 2024-09-17T02:21:29.967 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:29.969+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:30.004 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:30.004 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:30.024 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:30.068 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:30.070+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:30.078 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-17T02:21:30.078 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T02:21:30.078 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [0, 1, 2] 2024-09-17T02:21:30.079 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi164.front.sepia.ceph.com 2024-09-17T02:21:30.079 INFO:teuthology.orchestra.console.smithi164:Power off 2024-09-17T02:21:30.079 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-09-17T02:21:30.104 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off 2024-09-17T02:21:30.170 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:30.169+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:30.222 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:30.222 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:30.244 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:30.291 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:30.294+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:30.371 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:30.374+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:30.400 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:30.400 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:30.420 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:30.444 INFO:teuthology.orchestra.run.smithi001.stderr:noscrub is set 2024-09-17T02:21:30.460 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:21:30.472 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:30.473+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:30.573 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:30.574+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:30.613 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:21:30.613 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:21:30.614 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:30.614 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:30.632 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:21:30.632 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:21:30.635 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:30.650 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:21:30.650 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:21:30.674 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:30.673+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:30.775 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:30.773+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:30.775 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 58 16 124120 124104 133.717 125.125 0.0040966 0.00747389 2024-09-17T02:21:30.830 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:30.831 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:21:30.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:21:30.831 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:30.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.831 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:30.831 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:21:30.831 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.270930480999994, 2024-09-17T02:21:30.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022056035000000002, 2024-09-17T02:21:30.832 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:30.832 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:30.832 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:30.832 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:30.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:30.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:21:30.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:30.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:21:30.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:30.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562132+0000", 2024-09-17T02:21:30.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6300000000000001e-06 2024-09-17T02:21:30.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:30.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562142+0000", 2024-09-17T02:21:30.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.022e-05 2024-09-17T02:21:30.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:30.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562164+0000", 2024-09-17T02:21:30.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2002999999999999e-05 2024-09-17T02:21:30.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:30.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562180+0000", 2024-09-17T02:21:30.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5930000000000002e-05 2024-09-17T02:21:30.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:30.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563517+0000", 2024-09-17T02:21:30.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001336776 2024-09-17T02:21:30.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:30.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563635+0000", 2024-09-17T02:21:30.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117976 2024-09-17T02:21:30.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:30.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563819+0000", 2024-09-17T02:21:30.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018411499999999999 2024-09-17T02:21:30.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:30.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566977+0000", 2024-09-17T02:21:30.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031575990000000001 2024-09-17T02:21:30.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:30.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583917+0000", 2024-09-17T02:21:30.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016940093999999999 2024-09-17T02:21:30.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:30.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584066+0000", 2024-09-17T02:21:30.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000149746 2024-09-17T02:21:30.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:30.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584186+0000", 2024-09-17T02:21:30.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011994600000000001 2024-09-17T02:21:30.838 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.838 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:30.838 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.838 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:30.838 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:30.838 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.270749769999995, 2024-09-17T02:21:30.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023664803000000002, 2024-09-17T02:21:30.838 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:30.838 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:30.839 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:30.839 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:30.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:30.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:30.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:30.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:30.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:30.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562313+0000", 2024-09-17T02:21:30.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.764e-06 2024-09-17T02:21:30.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:30.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562323+0000", 2024-09-17T02:21:30.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0166000000000001e-05 2024-09-17T02:21:30.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:30.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562343+0000", 2024-09-17T02:21:30.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9633999999999999e-05 2024-09-17T02:21:30.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:30.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562367+0000", 2024-09-17T02:21:30.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4556e-05 2024-09-17T02:21:30.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:30.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563777+0000", 2024-09-17T02:21:30.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014102330000000001 2024-09-17T02:21:30.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:30.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563969+0000", 2024-09-17T02:21:30.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000191361 2024-09-17T02:21:30.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:30.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564148+0000", 2024-09-17T02:21:30.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017934599999999999 2024-09-17T02:21:30.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:30.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566989+0000", 2024-09-17T02:21:30.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028407010000000002 2024-09-17T02:21:30.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:30.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585770+0000", 2024-09-17T02:21:30.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018781566999999999 2024-09-17T02:21:30.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:30.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585874+0000", 2024-09-17T02:21:30.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103489 2024-09-17T02:21:30.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:30.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585976+0000", 2024-09-17T02:21:30.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101986 2024-09-17T02:21:30.847 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.847 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:30.847 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.847 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:30.848 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:30.848 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.270666890000001, 2024-09-17T02:21:30.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024118555999999999, 2024-09-17T02:21:30.848 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:30.848 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:30.848 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:30.848 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:30.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:30.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:30.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:30.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:30.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:30.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562395+0000", 2024-09-17T02:21:30.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3969999999999999e-06 2024-09-17T02:21:30.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:30.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562405+0000", 2024-09-17T02:21:30.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4229999999999994e-06 2024-09-17T02:21:30.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:30.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562427+0000", 2024-09-17T02:21:30.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759999999999998e-05 2024-09-17T02:21:30.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:30.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562444+0000", 2024-09-17T02:21:30.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7019000000000001e-05 2024-09-17T02:21:30.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:30.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564681+0000", 2024-09-17T02:21:30.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022376929999999998 2024-09-17T02:21:30.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:30.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564887+0000", 2024-09-17T02:21:30.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000206178 2024-09-17T02:21:30.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:30.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565230+0000", 2024-09-17T02:21:30.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034233499999999998 2024-09-17T02:21:30.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:30.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567000+0000", 2024-09-17T02:21:30.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017706390000000001 2024-09-17T02:21:30.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:30.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586126+0000", 2024-09-17T02:21:30.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019125672 2024-09-17T02:21:30.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:30.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586314+0000", 2024-09-17T02:21:30.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018740200000000001 2024-09-17T02:21:30.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:30.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586513+0000", 2024-09-17T02:21:30.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019903799999999999 2024-09-17T02:21:30.855 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.855 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:30.856 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.856 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:30.856 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:30.856 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.264597786000003, 2024-09-17T02:21:30.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:21:30.856 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:30.856 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:30.856 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:30.856 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:30.857 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:30.857 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:30.857 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:21:30.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.857 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:30.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:30.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:30.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:30.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:30.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:30.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:21:30.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:21:30.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:30.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:21:30.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:21:30.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:30.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:21:30.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:21:30.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:30.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:21:30.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:21:30.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:30.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:21:30.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:21:30.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:30.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:21:30.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:21:30.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:30.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:21:30.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:21:30.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:30.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:21:30.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:21:30.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:30.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:21:30.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:21:30.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:30.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:21:30.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:21:30.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:30.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:21:30.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:21:30.866 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.866 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:30.866 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.867 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:30.867 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:30.867 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.260695536, 2024-09-17T02:21:30.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:21:30.867 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:30.868 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:30.868 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:30.868 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:30.868 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:30.868 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:30.869 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:21:30.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.869 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:30.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:30.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:30.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:30.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:30.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:30.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:21:30.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:21:30.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:30.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:21:30.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:21:30.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:30.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:21:30.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:21:30.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:30.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:21:30.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:21:30.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:30.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:21:30.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:21:30.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:30.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:21:30.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:21:30.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:30.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:21:30.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:21:30.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:30.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:21:30.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:21:30.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:30.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:21:30.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:21:30.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:30.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:21:30.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:21:30.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:30.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:21:30.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:21:30.875 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.875 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:30.875 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.875 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71190 5.3 e39/38 5:c99e0ae2:::benchmark_data_smithi001_23533_object71189:head v 39'4516, mlcod=35'4513)", 2024-09-17T02:21:30.875 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.607413+0000", 2024-09-17T02:21:30.875 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.225647511999998, 2024-09-17T02:21:30.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023407462, 2024-09-17T02:21:30.875 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:30.875 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:30.875 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:30.875 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:30.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:30.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607413+0000", 2024-09-17T02:21:30.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:30.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607413+0000", 2024-09-17T02:21:30.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:30.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607415+0000", 2024-09-17T02:21:30.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2139999999999999e-06 2024-09-17T02:21:30.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:30.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607479+0000", 2024-09-17T02:21:30.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4374000000000004e-05 2024-09-17T02:21:30.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:30.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607496+0000", 2024-09-17T02:21:30.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6820000000000002e-05 2024-09-17T02:21:30.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:30.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607512+0000", 2024-09-17T02:21:30.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5976000000000001e-05 2024-09-17T02:21:30.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:30.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609288+0000", 2024-09-17T02:21:30.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001776311 2024-09-17T02:21:30.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:30.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609327+0000", 2024-09-17T02:21:30.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9165999999999997e-05 2024-09-17T02:21:30.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:30.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630723+0000", 2024-09-17T02:21:30.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021395290000000001 2024-09-17T02:21:30.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:30.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630821+0000", 2024-09-17T02:21:30.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8311000000000001e-05 2024-09-17T02:21:30.879 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.879 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:30.879 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.879 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71206 5.3 e39/38 5:c6c9386d:::benchmark_data_smithi001_23533_object71205:head v 39'4517, mlcod=35'4513)", 2024-09-17T02:21:30.880 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:30.880 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.223368421, 2024-09-17T02:21:30.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026101868, 2024-09-17T02:21:30.880 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:30.880 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:30.880 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:30.880 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:30.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:30.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:30.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:30.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:30.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:30.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609694+0000", 2024-09-17T02:21:30.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9539999999999998e-06 2024-09-17T02:21:30.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:30.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609841+0000", 2024-09-17T02:21:30.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014690800000000001 2024-09-17T02:21:30.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:30.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609872+0000", 2024-09-17T02:21:30.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0326000000000001e-05 2024-09-17T02:21:30.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:30.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609892+0000", 2024-09-17T02:21:30.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9848999999999999e-05 2024-09-17T02:21:30.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:30.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613826+0000", 2024-09-17T02:21:30.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039345140000000001 2024-09-17T02:21:30.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:30.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613908+0000", 2024-09-17T02:21:30.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2412999999999999e-05 2024-09-17T02:21:30.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:30.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635696+0000", 2024-09-17T02:21:30.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021787597999999998 2024-09-17T02:21:30.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:30.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635794+0000", 2024-09-17T02:21:30.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8306000000000004e-05 2024-09-17T02:21:30.884 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.884 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:30.884 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.884 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71210 5.3 e39/38 5:c0498d13:::benchmark_data_smithi001_23533_object71209:head v 39'4518, mlcod=35'4513)", 2024-09-17T02:21:30.884 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:30.884 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.221890455, 2024-09-17T02:21:30.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024703197, 2024-09-17T02:21:30.884 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:30.884 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:30.885 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:30.885 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:30.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:30.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:30.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:30.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:30.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:30.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611172+0000", 2024-09-17T02:21:30.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6470000000000001e-06 2024-09-17T02:21:30.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:30.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611344+0000", 2024-09-17T02:21:30.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000171607 2024-09-17T02:21:30.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:30.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611389+0000", 2024-09-17T02:21:30.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5738000000000002e-05 2024-09-17T02:21:30.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:30.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611407+0000", 2024-09-17T02:21:30.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7893e-05 2024-09-17T02:21:30.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:30.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617820+0000", 2024-09-17T02:21:30.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064131070000000004 2024-09-17T02:21:30.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:30.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617885+0000", 2024-09-17T02:21:30.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4442000000000004e-05 2024-09-17T02:21:30.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:30.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635806+0000", 2024-09-17T02:21:30.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017920874999999999 2024-09-17T02:21:30.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:30.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635874+0000", 2024-09-17T02:21:30.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7887999999999998e-05 2024-09-17T02:21:30.888 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.889 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:30.889 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.889 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71213 5.3 e39/38 5:ce9071a1:::benchmark_data_smithi001_23533_object71212:head v 39'4519, mlcod=35'4513)", 2024-09-17T02:21:30.889 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.613453+0000", 2024-09-17T02:21:30.889 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.219607944, 2024-09-17T02:21:30.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022494631000000001, 2024-09-17T02:21:30.889 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:30.889 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:30.889 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:30.889 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:30.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:30.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613453+0000", 2024-09-17T02:21:30.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:30.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613453+0000", 2024-09-17T02:21:30.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:30.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613455+0000", 2024-09-17T02:21:30.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.703e-06 2024-09-17T02:21:30.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:30.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613594+0000", 2024-09-17T02:21:30.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000139405 2024-09-17T02:21:30.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:30.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613625+0000", 2024-09-17T02:21:30.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0993e-05 2024-09-17T02:21:30.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:30.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613646+0000", 2024-09-17T02:21:30.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0761999999999999e-05 2024-09-17T02:21:30.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:30.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.620855+0000", 2024-09-17T02:21:30.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0072088270000000001 2024-09-17T02:21:30.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:30.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.620933+0000", 2024-09-17T02:21:30.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8807000000000006e-05 2024-09-17T02:21:30.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:30.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635882+0000", 2024-09-17T02:21:30.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014948530999999999 2024-09-17T02:21:30.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:30.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635948+0000", 2024-09-17T02:21:30.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5603000000000002e-05 2024-09-17T02:21:30.893 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.893 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:30.893 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.893 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71214 5.3 e39/38 5:c5e24f3f:::benchmark_data_smithi001_23533_object71213:head v 39'4520, mlcod=35'4513)", 2024-09-17T02:21:30.893 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:30.893 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.217526223, 2024-09-17T02:21:30.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024251297000000002, 2024-09-17T02:21:30.894 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:30.894 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:30.894 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:30.894 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:30.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:30.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:30.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:30.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:30.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:30.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615536+0000", 2024-09-17T02:21:30.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5370000000000001e-06 2024-09-17T02:21:30.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:30.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615696+0000", 2024-09-17T02:21:30.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015948700000000001 2024-09-17T02:21:30.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:30.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615723+0000", 2024-09-17T02:21:30.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7518999999999999e-05 2024-09-17T02:21:30.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:30.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615742+0000", 2024-09-17T02:21:30.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8519999999999999e-05 2024-09-17T02:21:30.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:30.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.624440+0000", 2024-09-17T02:21:30.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0086983080000000001 2024-09-17T02:21:30.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:30.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.624489+0000", 2024-09-17T02:21:30.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8838000000000002e-05 2024-09-17T02:21:30.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:30.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639673+0000", 2024-09-17T02:21:30.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01518451 2024-09-17T02:21:30.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:30.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639786+0000", 2024-09-17T02:21:30.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011257800000000001 2024-09-17T02:21:30.897 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.897 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:30.898 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.898 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71215 5.3 e39/38 5:c5603662:::benchmark_data_smithi001_23533_object71214:head v 39'4521, mlcod=35'4513)", 2024-09-17T02:21:30.898 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.617466+0000", 2024-09-17T02:21:30.898 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.215595242999999, 2024-09-17T02:21:30.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022395379999999999, 2024-09-17T02:21:30.898 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:30.898 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:30.898 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:30.898 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:30.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:30.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617466+0000", 2024-09-17T02:21:30.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:30.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617466+0000", 2024-09-17T02:21:30.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:30.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617467+0000", 2024-09-17T02:21:30.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3600000000000002e-07 2024-09-17T02:21:30.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:30.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617521+0000", 2024-09-17T02:21:30.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4654999999999998e-05 2024-09-17T02:21:30.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:30.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617548+0000", 2024-09-17T02:21:30.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6706000000000001e-05 2024-09-17T02:21:30.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:30.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617566+0000", 2024-09-17T02:21:30.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7989e-05 2024-09-17T02:21:30.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:30.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.627598+0000", 2024-09-17T02:21:30.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010031854 2024-09-17T02:21:30.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:30.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.627656+0000", 2024-09-17T02:21:30.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8511999999999998e-05 2024-09-17T02:21:30.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:30.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639794+0000", 2024-09-17T02:21:30.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012137445 2024-09-17T02:21:30.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:30.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639861+0000", 2024-09-17T02:21:30.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7282999999999999e-05 2024-09-17T02:21:30.902 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.902 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:30.902 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.902 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:71277 5.a 5:5576e9b8:::benchmark_data_smithi001_23533_object71276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:30.902 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.630891+0000", 2024-09-17T02:21:30.902 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.202169702999999, 2024-09-17T02:21:30.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022210245999999999, 2024-09-17T02:21:30.903 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:30.903 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:30.903 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:30.903 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:30.903 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:30.903 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:30.903 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71277 2024-09-17T02:21:30.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.903 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:30.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:30.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630891+0000", 2024-09-17T02:21:30.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:30.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630891+0000", 2024-09-17T02:21:30.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:30.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630893+0000", 2024-09-17T02:21:30.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-09-17T02:21:30.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:30.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630961+0000", 2024-09-17T02:21:30.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7971000000000004e-05 2024-09-17T02:21:30.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:30.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630989+0000", 2024-09-17T02:21:30.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7855999999999999e-05 2024-09-17T02:21:30.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:30.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631010+0000", 2024-09-17T02:21:30.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0888999999999999e-05 2024-09-17T02:21:30.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:30.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631123+0000", 2024-09-17T02:21:30.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011292 2024-09-17T02:21:30.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:30.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631434+0000", 2024-09-17T02:21:30.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00031039199999999999 2024-09-17T02:21:30.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:30.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631679+0000", 2024-09-17T02:21:30.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024517099999999997 2024-09-17T02:21:30.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:30.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.636619+0000", 2024-09-17T02:21:30.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049405339999999999 2024-09-17T02:21:30.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:30.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.652851+0000", 2024-09-17T02:21:30.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016231440999999999 2024-09-17T02:21:30.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:30.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.653012+0000", 2024-09-17T02:21:30.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016157199999999999 2024-09-17T02:21:30.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:30.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.653101+0000", 2024-09-17T02:21:30.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9190000000000005e-05 2024-09-17T02:21:30.908 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.908 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:30.908 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.908 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97147 5.0 5:02d17bf7:::benchmark_data_smithi001_23533_object97146:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:30.908 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268128+0000", 2024-09-17T02:21:30.909 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.564932478999999, 2024-09-17T02:21:30.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022726434, 2024-09-17T02:21:30.909 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:30.909 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:30.909 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:30.909 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:30.909 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:30.909 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:30.909 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97147 2024-09-17T02:21:30.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.909 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:30.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:30.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268128+0000", 2024-09-17T02:21:30.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:30.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268128+0000", 2024-09-17T02:21:30.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:30.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268129+0000", 2024-09-17T02:21:30.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5700000000000001e-07 2024-09-17T02:21:30.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:30.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268194+0000", 2024-09-17T02:21:30.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4731000000000001e-05 2024-09-17T02:21:30.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:30.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268202+0000", 2024-09-17T02:21:30.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7950000000000008e-06 2024-09-17T02:21:30.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:30.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268207+0000", 2024-09-17T02:21:30.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8550000000000001e-06 2024-09-17T02:21:30.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:30.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268694+0000", 2024-09-17T02:21:30.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00048752799999999998 2024-09-17T02:21:30.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:30.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268768+0000", 2024-09-17T02:21:30.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3638000000000002e-05 2024-09-17T02:21:30.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:30.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268842+0000", 2024-09-17T02:21:30.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3928000000000001e-05 2024-09-17T02:21:30.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:30.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.285598+0000", 2024-09-17T02:21:30.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016756436 2024-09-17T02:21:30.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:30.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290771+0000", 2024-09-17T02:21:30.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051724789999999998 2024-09-17T02:21:30.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:30.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290817+0000", 2024-09-17T02:21:30.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6220999999999997e-05 2024-09-17T02:21:30.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:30.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290855+0000", 2024-09-17T02:21:30.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7966000000000002e-05 2024-09-17T02:21:30.914 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.914 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:30.914 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.914 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97148 5.5 5:a643b955:::benchmark_data_smithi001_23533_object97147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:30.914 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268218+0000", 2024-09-17T02:21:30.914 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.564843095000001, 2024-09-17T02:21:30.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022628112999999998, 2024-09-17T02:21:30.915 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:30.915 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:30.915 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:30.915 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:30.915 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:30.915 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:30.915 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97148 2024-09-17T02:21:30.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.915 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:30.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:30.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268218+0000", 2024-09-17T02:21:30.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:30.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268218+0000", 2024-09-17T02:21:30.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:30.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268218+0000", 2024-09-17T02:21:30.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.53e-07 2024-09-17T02:21:30.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:30.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268300+0000", 2024-09-17T02:21:30.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2219999999999995e-05 2024-09-17T02:21:30.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:30.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268306+0000", 2024-09-17T02:21:30.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8989999999999998e-06 2024-09-17T02:21:30.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:30.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268310+0000", 2024-09-17T02:21:30.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6610000000000002e-06 2024-09-17T02:21:30.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:30.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268354+0000", 2024-09-17T02:21:30.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3782000000000002e-05 2024-09-17T02:21:30.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:30.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268452+0000", 2024-09-17T02:21:30.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8339999999999997e-05 2024-09-17T02:21:30.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:30.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268536+0000", 2024-09-17T02:21:30.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3931999999999995e-05 2024-09-17T02:21:30.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:30.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.286252+0000", 2024-09-17T02:21:30.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017715740000000001 2024-09-17T02:21:30.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:30.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290758+0000", 2024-09-17T02:21:30.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045060940000000004 2024-09-17T02:21:30.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:30.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290801+0000", 2024-09-17T02:21:30.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2818000000000002e-05 2024-09-17T02:21:30.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:30.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290846+0000", 2024-09-17T02:21:30.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5274000000000001e-05 2024-09-17T02:21:30.920 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.920 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:30.920 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.920 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97151 5.5 5:a0c2c072:::benchmark_data_smithi001_23533_object97150:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:30.920 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:30.920 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.564688814, 2024-09-17T02:21:30.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027297614000000001, 2024-09-17T02:21:30.921 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:30.921 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:30.921 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:30.921 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:30.921 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:30.921 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:30.921 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97151 2024-09-17T02:21:30.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.921 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:30.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:30.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:30.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:30.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:30.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:30.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268373+0000", 2024-09-17T02:21:30.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4000000000000002e-07 2024-09-17T02:21:30.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:30.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268423+0000", 2024-09-17T02:21:30.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0175e-05 2024-09-17T02:21:30.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:30.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268428+0000", 2024-09-17T02:21:30.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-17T02:21:30.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:30.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268431+0000", 2024-09-17T02:21:30.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.179e-06 2024-09-17T02:21:30.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:30.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283631+0000", 2024-09-17T02:21:30.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015199691 2024-09-17T02:21:30.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:30.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283740+0000", 2024-09-17T02:21:30.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109305 2024-09-17T02:21:30.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:30.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283863+0000", 2024-09-17T02:21:30.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012226699999999999 2024-09-17T02:21:30.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:30.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290857+0000", 2024-09-17T02:21:30.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069945449999999996 2024-09-17T02:21:30.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:30.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295595+0000", 2024-09-17T02:21:30.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047376750000000002 2024-09-17T02:21:30.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:30.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295638+0000", 2024-09-17T02:21:30.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3671999999999998e-05 2024-09-17T02:21:30.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:30.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295670+0000", 2024-09-17T02:21:30.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1266000000000002e-05 2024-09-17T02:21:30.926 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.926 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:30.926 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.926 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97248 5.c 5:3796bec5:::benchmark_data_smithi001_23533_object97247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:30.926 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.327358+0000", 2024-09-17T02:21:30.926 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.505702571, 2024-09-17T02:21:30.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022963006000000001, 2024-09-17T02:21:30.926 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:30.926 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:30.927 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:30.927 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:30.927 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:30.927 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:30.927 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97248 2024-09-17T02:21:30.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.927 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:30.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:30.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327358+0000", 2024-09-17T02:21:30.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:30.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327358+0000", 2024-09-17T02:21:30.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:30.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327359+0000", 2024-09-17T02:21:30.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5699999999999998e-07 2024-09-17T02:21:30.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:30.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327382+0000", 2024-09-17T02:21:30.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3458000000000001e-05 2024-09-17T02:21:30.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:30.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327387+0000", 2024-09-17T02:21:30.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6149999999999999e-06 2024-09-17T02:21:30.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:30.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327391+0000", 2024-09-17T02:21:30.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8999999999999999e-06 2024-09-17T02:21:30.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:30.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.332084+0000", 2024-09-17T02:21:30.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046935240000000001 2024-09-17T02:21:30.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:30.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.332216+0000", 2024-09-17T02:21:30.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131798 2024-09-17T02:21:30.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:30.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.332352+0000", 2024-09-17T02:21:30.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013587500000000001 2024-09-17T02:21:30.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:30.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.338559+0000", 2024-09-17T02:21:30.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0062075510000000004 2024-09-17T02:21:30.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:30.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350237+0000", 2024-09-17T02:21:30.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011677121 2024-09-17T02:21:30.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:30.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350287+0000", 2024-09-17T02:21:30.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0080999999999997e-05 2024-09-17T02:21:30.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:30.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350321+0000", 2024-09-17T02:21:30.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4625999999999997e-05 2024-09-17T02:21:30.932 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.932 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:30.932 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.932 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97251 5.c 5:382be9a3:::benchmark_data_smithi001_23533_object97250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:30.932 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.328203+0000", 2024-09-17T02:21:30.932 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.504858335, 2024-09-17T02:21:30.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022268999000000001, 2024-09-17T02:21:30.932 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:30.933 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:30.933 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:30.933 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:30.933 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:30.933 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:30.933 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97251 2024-09-17T02:21:30.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.933 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:30.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:30.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328203+0000", 2024-09-17T02:21:30.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:30.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328203+0000", 2024-09-17T02:21:30.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:30.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328203+0000", 2024-09-17T02:21:30.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3699999999999999e-07 2024-09-17T02:21:30.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:30.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328319+0000", 2024-09-17T02:21:30.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011560100000000001 2024-09-17T02:21:30.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:30.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328332+0000", 2024-09-17T02:21:30.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2978e-05 2024-09-17T02:21:30.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:30.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328340+0000", 2024-09-17T02:21:30.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4680000000000003e-06 2024-09-17T02:21:30.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:30.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.335525+0000", 2024-09-17T02:21:30.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0071852399999999999 2024-09-17T02:21:30.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:30.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.335650+0000", 2024-09-17T02:21:30.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012522299999999999 2024-09-17T02:21:30.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:30.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.335732+0000", 2024-09-17T02:21:30.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1582999999999995e-05 2024-09-17T02:21:30.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:30.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.346944+0000", 2024-09-17T02:21:30.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011211936 2024-09-17T02:21:30.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:30.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350332+0000", 2024-09-17T02:21:30.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033884140000000002 2024-09-17T02:21:30.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:30.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350433+0000", 2024-09-17T02:21:30.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010115600000000001 2024-09-17T02:21:30.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:30.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350472+0000", 2024-09-17T02:21:30.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8463000000000001e-05 2024-09-17T02:21:30.938 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.938 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:30.938 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.938 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97759 5.a 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:30.938 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:30.938 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.234675713, 2024-09-17T02:21:30.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.089694871999999995, 2024-09-17T02:21:30.939 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:30.939 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:30.939 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:30.939 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:30.939 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:30.939 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:30.939 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97759 2024-09-17T02:21:30.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.939 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:30.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:30.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:30.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:30.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:30.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:30.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598386+0000", 2024-09-17T02:21:30.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999999e-07 2024-09-17T02:21:30.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:30.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598414+0000", 2024-09-17T02:21:30.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8013000000000001e-05 2024-09-17T02:21:30.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:30.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598420+0000", 2024-09-17T02:21:30.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1149999999999999e-06 2024-09-17T02:21:30.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:30.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598424+0000", 2024-09-17T02:21:30.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:21:30.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:30.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598479+0000", 2024-09-17T02:21:30.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4648999999999998e-05 2024-09-17T02:21:30.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:30.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598587+0000", 2024-09-17T02:21:30.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010853000000000001 2024-09-17T02:21:30.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:30.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598676+0000", 2024-09-17T02:21:30.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8381999999999995e-05 2024-09-17T02:21:30.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:30.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603766+0000", 2024-09-17T02:21:30.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050902559999999996 2024-09-17T02:21:30.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:30.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.687988+0000", 2024-09-17T02:21:30.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.084221753999999996 2024-09-17T02:21:30.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:30.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688037+0000", 2024-09-17T02:21:30.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-05 2024-09-17T02:21:30.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:30.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688080+0000", 2024-09-17T02:21:30.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3149999999999999e-05 2024-09-17T02:21:30.944 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.944 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:30.944 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.944 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97770 5.0 5:09c75033:::benchmark_data_smithi001_23533_object97769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:30.944 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:30.944 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.229533283, 2024-09-17T02:21:30.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.086380868, 2024-09-17T02:21:30.945 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:30.945 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:30.945 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:30.945 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:30.945 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:30.945 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:30.945 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97770 2024-09-17T02:21:30.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.945 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:30.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:30.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:30.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:30.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:30.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:30.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603529+0000", 2024-09-17T02:21:30.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:21:30.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:30.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603593+0000", 2024-09-17T02:21:30.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4216999999999999e-05 2024-09-17T02:21:30.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:30.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603603+0000", 2024-09-17T02:21:30.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5179999999999993e-06 2024-09-17T02:21:30.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:30.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603608+0000", 2024-09-17T02:21:30.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2039999999999996e-06 2024-09-17T02:21:30.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:30.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603653+0000", 2024-09-17T02:21:30.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5247000000000002e-05 2024-09-17T02:21:30.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:30.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603758+0000", 2024-09-17T02:21:30.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105352 2024-09-17T02:21:30.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:30.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603900+0000", 2024-09-17T02:21:30.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014198999999999999 2024-09-17T02:21:30.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:30.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.606097+0000", 2024-09-17T02:21:30.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021969839999999999 2024-09-17T02:21:30.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:30.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689756+0000", 2024-09-17T02:21:30.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.083659077999999998 2024-09-17T02:21:30.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:30.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689846+0000", 2024-09-17T02:21:30.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9320999999999994e-05 2024-09-17T02:21:30.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:30.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689908+0000", 2024-09-17T02:21:30.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720999999999998e-05 2024-09-17T02:21:30.950 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.950 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:30.950 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.950 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:101263 5.0 5:01bcc612:::benchmark_data_smithi001_23533_object101262:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T02:21:30.950 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:19.421619+0000", 2024-09-17T02:21:30.950 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 11.411442062000001, 2024-09-17T02:21:30.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023065922999999999, 2024-09-17T02:21:30.950 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:30.951 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:30.951 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:30.951 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:30.951 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:30.951 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:30.951 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 101263 2024-09-17T02:21:30.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.951 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:30.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:30.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421619+0000", 2024-09-17T02:21:30.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:30.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421619+0000", 2024-09-17T02:21:30.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:30.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:30.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421619+0000", 2024-09-17T02:21:30.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6100000000000001e-07 2024-09-17T02:21:30.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:30.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421657+0000", 2024-09-17T02:21:30.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7438999999999998e-05 2024-09-17T02:21:30.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:30.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421665+0000", 2024-09-17T02:21:30.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4840000000000004e-06 2024-09-17T02:21:30.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:30.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421671+0000", 2024-09-17T02:21:30.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5400000000000003e-06 2024-09-17T02:21:30.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:30.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.431714+0000", 2024-09-17T02:21:30.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0100432 2024-09-17T02:21:30.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:30.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.431841+0000", 2024-09-17T02:21:30.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000127138 2024-09-17T02:21:30.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:30.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.431970+0000", 2024-09-17T02:21:30.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012893900000000001 2024-09-17T02:21:30.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:30.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.436696+0000", 2024-09-17T02:21:30.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047262570000000002 2024-09-17T02:21:30.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:30.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.444604+0000", 2024-09-17T02:21:30.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079071479999999993 2024-09-17T02:21:30.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:30.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.444648+0000", 2024-09-17T02:21:30.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4941000000000002e-05 2024-09-17T02:21:30.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:30.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:30.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:30.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.444685+0000", 2024-09-17T02:21:30.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6276000000000003e-05 2024-09-17T02:21:30.956 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.956 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:30.956 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.956 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:30.956 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:30.956 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:30.958 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:30.958 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:30.957+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:31.058 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:31.057+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:31.105 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:31.105 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:31.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.106 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:124783 5.e e49/22 ondisk, result = 0)", 2024-09-17T02:21:31.106 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:31.110847+0000", 2024-09-17T02:21:31.106 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.9369999999999995e-05, 2024-09-17T02:21:31.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3570000000000001e-05, 2024-09-17T02:21:31.106 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:31.106 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:31.106 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:31.106 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:31.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:31.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.110847+0000", 2024-09-17T02:21:31.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:31.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.110847+0000", 2024-09-17T02:21:31.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:31.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.110848+0000", 2024-09-17T02:21:31.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4700000000000002e-07 2024-09-17T02:21:31.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:31.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.110852+0000", 2024-09-17T02:21:31.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1110000000000001e-06 2024-09-17T02:21:31.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:31.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.110860+0000", 2024-09-17T02:21:31.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2810000000000008e-06 2024-09-17T02:21:31.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.110866+0000", 2024-09-17T02:21:31.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6130000000000003e-06 2024-09-17T02:21:31.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:31.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.110907+0000", 2024-09-17T02:21:31.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1063000000000003e-05 2024-09-17T02:21:31.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:31.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.110911+0000", 2024-09-17T02:21:31.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.216e-06 2024-09-17T02:21:31.109 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.109 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:31.109 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.109 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:124774 5.4 5:27875554:::benchmark_data_smithi001_23533_object124773:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:31.110 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:31.101399+0000", 2024-09-17T02:21:31.110 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0095174279999999997, 2024-09-17T02:21:31.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0095741439999999997, 2024-09-17T02:21:31.110 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:31.110 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:31.110 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:31.110 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:31.110 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:31.110 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:31.110 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 124774 2024-09-17T02:21:31.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.110 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:31.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:31.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.101399+0000", 2024-09-17T02:21:31.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:31.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.101399+0000", 2024-09-17T02:21:31.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:31.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.101400+0000", 2024-09-17T02:21:31.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5099999999999998e-07 2024-09-17T02:21:31.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:31.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.101474+0000", 2024-09-17T02:21:31.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4097000000000006e-05 2024-09-17T02:21:31.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:31.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.101483+0000", 2024-09-17T02:21:31.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3100000000000006e-06 2024-09-17T02:21:31.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.101488+0000", 2024-09-17T02:21:31.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0740000000000003e-06 2024-09-17T02:21:31.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:31.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.101568+0000", 2024-09-17T02:21:31.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0494000000000006e-05 2024-09-17T02:21:31.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:31.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.101821+0000", 2024-09-17T02:21:31.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025323300000000001 2024-09-17T02:21:31.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:31.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.102013+0000", 2024-09-17T02:21:31.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019186799999999999 2024-09-17T02:21:31.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:31.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.104816+0000", 2024-09-17T02:21:31.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002802499 2024-09-17T02:21:31.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:31.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.107373+0000", 2024-09-17T02:21:31.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002557064 2024-09-17T02:21:31.114 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.115 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:31.115 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.115 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:124781 5.b 5:d16ea605:::benchmark_data_smithi001_23533_object124780:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:31.115 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:31.104649+0000", 2024-09-17T02:21:31.115 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0062679950000000002, 2024-09-17T02:21:31.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0063754989999999997, 2024-09-17T02:21:31.115 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:31.115 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:31.115 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:31.115 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:31.115 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:31.116 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:31.116 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 124781 2024-09-17T02:21:31.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.116 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:31.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:31.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.104649+0000", 2024-09-17T02:21:31.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:31.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.104649+0000", 2024-09-17T02:21:31.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:31.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.104649+0000", 2024-09-17T02:21:31.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2699999999999998e-07 2024-09-17T02:21:31.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:31.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.104767+0000", 2024-09-17T02:21:31.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011774599999999999 2024-09-17T02:21:31.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:31.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.104777+0000", 2024-09-17T02:21:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8309999999999996e-06 2024-09-17T02:21:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.104784+0000", 2024-09-17T02:21:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2749999999999998e-06 2024-09-17T02:21:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.104837+0000", 2024-09-17T02:21:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2982000000000002e-05 2024-09-17T02:21:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:31.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.104999+0000", 2024-09-17T02:21:31.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000161745 2024-09-17T02:21:31.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:31.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.105181+0000", 2024-09-17T02:21:31.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018237700000000001 2024-09-17T02:21:31.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:31.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.107506+0000", 2024-09-17T02:21:31.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023243439999999999 2024-09-17T02:21:31.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:31.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.109569+0000", 2024-09-17T02:21:31.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020634709999999999 2024-09-17T02:21:31.120 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.120 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:31.120 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.120 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:124785 5.e 5:7e8cdb2d:::benchmark_data_smithi001_23533_object124784:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:31.120 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:31.105272+0000", 2024-09-17T02:21:31.120 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0056447110000000002, 2024-09-17T02:21:31.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057994370000000002, 2024-09-17T02:21:31.120 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:31.121 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:31.121 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:31.121 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:31.121 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:31.121 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:31.121 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 124785 2024-09-17T02:21:31.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.121 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:31.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:31.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.105272+0000", 2024-09-17T02:21:31.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:31.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.105272+0000", 2024-09-17T02:21:31.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:31.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.105273+0000", 2024-09-17T02:21:31.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0500000000000003e-07 2024-09-17T02:21:31.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:31.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.105308+0000", 2024-09-17T02:21:31.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5598e-05 2024-09-17T02:21:31.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:31.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.105316+0000", 2024-09-17T02:21:31.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3799999999999994e-06 2024-09-17T02:21:31.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.105323+0000", 2024-09-17T02:21:31.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1480000000000003e-06 2024-09-17T02:21:31.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:31.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.107593+0000", 2024-09-17T02:21:31.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002269905 2024-09-17T02:21:31.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:31.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.107708+0000", 2024-09-17T02:21:31.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115423 2024-09-17T02:21:31.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:31.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.107866+0000", 2024-09-17T02:21:31.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015771900000000001 2024-09-17T02:21:31.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:31.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:31.110304+0000", 2024-09-17T02:21:31.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024386569999999999 2024-09-17T02:21:31.125 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.125 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:31.125 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.125 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.125 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:21:31.125 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 4 2024-09-17T02:21:31.125 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:31.126 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:31.159 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:31.158+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:31.260 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:31.261+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:31.324 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:31.324 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:21:31.324 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:21:31.324 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:21:31.324 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:31.347 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:31.361 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:31.362+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:31.463 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:31.466+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:31.551 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:31.551 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:21:31.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:21:31.552 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:31.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.552 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:31.552 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:21:31.552 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 74.998645330000002, 2024-09-17T02:21:31.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035535028000000003, 2024-09-17T02:21:31.552 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:31.552 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:31.552 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:31.552 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:31.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:31.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:21:31.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:31.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:21:31.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:31.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556550+0000", 2024-09-17T02:21:31.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3500000000000001e-06 2024-09-17T02:21:31.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:31.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556566+0000", 2024-09-17T02:21:31.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5440000000000001e-05 2024-09-17T02:21:31.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:31.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556594+0000", 2024-09-17T02:21:31.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8552999999999999e-05 2024-09-17T02:21:31.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556618+0000", 2024-09-17T02:21:31.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3207e-05 2024-09-17T02:21:31.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:31.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578337+0000", 2024-09-17T02:21:31.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021719517000000001 2024-09-17T02:21:31.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:31.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578655+0000", 2024-09-17T02:21:31.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031837800000000002 2024-09-17T02:21:31.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:31.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.581374+0000", 2024-09-17T02:21:31.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002718238 2024-09-17T02:21:31.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:31.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587083+0000", 2024-09-17T02:21:31.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005708912 2024-09-17T02:21:31.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:31.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591823+0000", 2024-09-17T02:21:31.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047406080000000003 2024-09-17T02:21:31.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:31.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591972+0000", 2024-09-17T02:21:31.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014874199999999999 2024-09-17T02:21:31.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:31.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592082+0000", 2024-09-17T02:21:31.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110083 2024-09-17T02:21:31.559 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.559 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:31.559 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.560 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:31.560 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:21:31.560 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 74.997703842999996, 2024-09-17T02:21:31.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035128756999999997, 2024-09-17T02:21:31.560 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:31.560 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:31.560 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:31.560 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:31.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:31.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:21:31.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:31.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:21:31.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:31.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557491+0000", 2024-09-17T02:21:31.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.88e-06 2024-09-17T02:21:31.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.562 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:31.562 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557504+0000", 2024-09-17T02:21:31.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2864000000000001e-05 2024-09-17T02:21:31.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.562 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:31.562 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557535+0000", 2024-09-17T02:21:31.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0916e-05 2024-09-17T02:21:31.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557561+0000", 2024-09-17T02:21:31.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5602999999999999e-05 2024-09-17T02:21:31.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:31.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582290+0000", 2024-09-17T02:21:31.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024729729999999998 2024-09-17T02:21:31.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:31.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582642+0000", 2024-09-17T02:21:31.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035143499999999999 2024-09-17T02:21:31.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:31.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582959+0000", 2024-09-17T02:21:31.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031747399999999999 2024-09-17T02:21:31.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:31.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587302+0000", 2024-09-17T02:21:31.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043425169999999997 2024-09-17T02:21:31.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:31.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592391+0000", 2024-09-17T02:21:31.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050895799999999998 2024-09-17T02:21:31.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:31.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592516+0000", 2024-09-17T02:21:31.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012420500000000001 2024-09-17T02:21:31.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:31.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592617+0000", 2024-09-17T02:21:31.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010155299999999999 2024-09-17T02:21:31.566 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.566 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:31.566 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.566 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:31.566 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:21:31.566 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 74.997599343999994, 2024-09-17T02:21:31.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034796066, 2024-09-17T02:21:31.566 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:31.566 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:31.567 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:31.567 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:31.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:31.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:21:31.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:31.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:21:31.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:31.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557594+0000", 2024-09-17T02:21:31.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3769999999999999e-06 2024-09-17T02:21:31.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:31.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557683+0000", 2024-09-17T02:21:31.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8896999999999999e-05 2024-09-17T02:21:31.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:31.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557707+0000", 2024-09-17T02:21:31.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3839e-05 2024-09-17T02:21:31.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557730+0000", 2024-09-17T02:21:31.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3047000000000001e-05 2024-09-17T02:21:31.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:31.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582329+0000", 2024-09-17T02:21:31.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024599283999999999 2024-09-17T02:21:31.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:31.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582624+0000", 2024-09-17T02:21:31.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000294462 2024-09-17T02:21:31.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:31.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582936+0000", 2024-09-17T02:21:31.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031223399999999999 2024-09-17T02:21:31.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:31.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587347+0000", 2024-09-17T02:21:31.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044110340000000003 2024-09-17T02:21:31.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:31.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592165+0000", 2024-09-17T02:21:31.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048176699999999996 2024-09-17T02:21:31.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:31.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592311+0000", 2024-09-17T02:21:31.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014661899999999999 2024-09-17T02:21:31.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:31.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592389+0000", 2024-09-17T02:21:31.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7602999999999995e-05 2024-09-17T02:21:31.572 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.572 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:31.572 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.572 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:31.572 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:21:31.572 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 74.997081717, 2024-09-17T02:21:31.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034457472000000003, 2024-09-17T02:21:31.572 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:31.572 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:31.572 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:31.573 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:31.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:31.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:21:31.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:31.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:21:31.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:31.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558113+0000", 2024-09-17T02:21:31.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1639999999999999e-06 2024-09-17T02:21:31.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:31.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558125+0000", 2024-09-17T02:21:31.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2269999999999999e-05 2024-09-17T02:21:31.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:31.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558458+0000", 2024-09-17T02:21:31.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033322700000000001 2024-09-17T02:21:31.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558488+0000", 2024-09-17T02:21:31.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.951e-05 2024-09-17T02:21:31.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:31.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584514+0000", 2024-09-17T02:21:31.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026025721000000002 2024-09-17T02:21:31.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:31.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584781+0000", 2024-09-17T02:21:31.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000267142 2024-09-17T02:21:31.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:31.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585078+0000", 2024-09-17T02:21:31.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029738799999999999 2024-09-17T02:21:31.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:31.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588045+0000", 2024-09-17T02:21:31.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029673759999999999 2024-09-17T02:21:31.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:31.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592454+0000", 2024-09-17T02:21:31.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044090209999999999 2024-09-17T02:21:31.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:31.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592520+0000", 2024-09-17T02:21:31.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6032999999999996e-05 2024-09-17T02:21:31.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:31.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592568+0000", 2024-09-17T02:21:31.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7620000000000001e-05 2024-09-17T02:21:31.579 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.579 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:31.579 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.579 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:31.580 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:21:31.580 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 74.996440250999996, 2024-09-17T02:21:31.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034114029999999997, 2024-09-17T02:21:31.580 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:31.580 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:31.580 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:31.580 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:31.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:31.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:21:31.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:31.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:21:31.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:31.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558753+0000", 2024-09-17T02:21:31.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2699999999999999e-06 2024-09-17T02:21:31.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:31.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558769+0000", 2024-09-17T02:21:31.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5906e-05 2024-09-17T02:21:31.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:31.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558791+0000", 2024-09-17T02:21:31.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1342999999999999e-05 2024-09-17T02:21:31.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558806+0000", 2024-09-17T02:21:31.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5829999999999999e-05 2024-09-17T02:21:31.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:31.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584906+0000", 2024-09-17T02:21:31.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026099273999999999 2024-09-17T02:21:31.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:31.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585158+0000", 2024-09-17T02:21:31.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025194600000000002 2024-09-17T02:21:31.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:31.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585368+0000", 2024-09-17T02:21:31.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210068 2024-09-17T02:21:31.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:31.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588098+0000", 2024-09-17T02:21:31.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002730522 2024-09-17T02:21:31.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:31.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592680+0000", 2024-09-17T02:21:31.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045816019999999997 2024-09-17T02:21:31.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:31.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592774+0000", 2024-09-17T02:21:31.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3726000000000004e-05 2024-09-17T02:21:31.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:31.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592866+0000", 2024-09-17T02:21:31.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2542999999999998e-05 2024-09-17T02:21:31.585 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.585 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:31.585 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.586 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28720 5.f e28/22 5:f8a7aea5:::benchmark_data_smithi001_23533_object28719:head v 28'1756, mlcod=28'1754)", 2024-09-17T02:21:31.586 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:21:31.586 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.985072451000001, 2024-09-17T02:21:31.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033308717000000002, 2024-09-17T02:21:31.586 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:31.586 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:31.586 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:31.586 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:31.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:31.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:21:31.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:31.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570120+0000", 2024-09-17T02:21:31.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:31.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570121+0000", 2024-09-17T02:21:31.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4e-07 2024-09-17T02:21:31.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:31.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570208+0000", 2024-09-17T02:21:31.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6945000000000002e-05 2024-09-17T02:21:31.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:31.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570222+0000", 2024-09-17T02:21:31.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4541e-05 2024-09-17T02:21:31.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570232+0000", 2024-09-17T02:21:31.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3039999999999994e-06 2024-09-17T02:21:31.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:31.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570273+0000", 2024-09-17T02:21:31.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1950999999999999e-05 2024-09-17T02:21:31.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:31.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570286+0000", 2024-09-17T02:21:31.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2268e-05 2024-09-17T02:21:31.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:31.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603312+0000", 2024-09-17T02:21:31.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033026405000000002 2024-09-17T02:21:31.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:31.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603429+0000", 2024-09-17T02:21:31.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116463 2024-09-17T02:21:31.590 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.590 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:31.590 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.591 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:28721 5.a e28/22 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head v 28'1872, mlcod=28'1869)", 2024-09-17T02:21:31.591 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:21:31.591 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.984928945, 2024-09-17T02:21:31.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033539817999999999, 2024-09-17T02:21:31.591 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:31.591 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:31.591 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:31.591 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:31.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:31.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:21:31.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:31.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570263+0000", 2024-09-17T02:21:31.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:31.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570264+0000", 2024-09-17T02:21:31.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0999999999999997e-07 2024-09-17T02:21:31.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:31.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570299+0000", 2024-09-17T02:21:31.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4876999999999998e-05 2024-09-17T02:21:31.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:31.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570310+0000", 2024-09-17T02:21:31.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0958000000000001e-05 2024-09-17T02:21:31.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.570316+0000", 2024-09-17T02:21:31.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.485e-06 2024-09-17T02:21:31.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:31.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598947+0000", 2024-09-17T02:21:31.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.028631058000000001 2024-09-17T02:21:31.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.598969+0000", 2024-09-17T02:21:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2005999999999999e-05 2024-09-17T02:21:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.602638+0000", 2024-09-17T02:21:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036690339999999998 2024-09-17T02:21:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:42.603803+0000", 2024-09-17T02:21:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00116559 2024-09-17T02:21:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:31.596 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.596 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97749 5.b 5:d930ef52:::benchmark_data_smithi001_23533_object97748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:31.596 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:31.596 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.963246031000001, 2024-09-17T02:21:31.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092964343000000005, 2024-09-17T02:21:31.596 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:31.596 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:31.596 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:31.596 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:31.596 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:31.596 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:31.597 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97749 2024-09-17T02:21:31.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.597 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:31.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:31.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:31.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:31.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:31.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:31.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591947+0000", 2024-09-17T02:21:31.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:21:31.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:31.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592011+0000", 2024-09-17T02:21:31.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3608000000000005e-05 2024-09-17T02:21:31.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:31.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592021+0000", 2024-09-17T02:21:31.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9979999999999998e-06 2024-09-17T02:21:31.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592028+0000", 2024-09-17T02:21:31.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1439999999999997e-06 2024-09-17T02:21:31.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:31.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593633+0000", 2024-09-17T02:21:31.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001604636 2024-09-17T02:21:31.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:31.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593757+0000", 2024-09-17T02:21:31.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012432099999999999 2024-09-17T02:21:31.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:31.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593866+0000", 2024-09-17T02:21:31.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109094 2024-09-17T02:21:31.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:31.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601190+0000", 2024-09-17T02:21:31.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073237620000000002 2024-09-17T02:21:31.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:31.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601356+0000", 2024-09-17T02:21:31.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016651900000000001 2024-09-17T02:21:31.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:31.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684618+0000", 2024-09-17T02:21:31.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083261356999999994 2024-09-17T02:21:31.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:31.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684724+0000", 2024-09-17T02:21:31.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010681800000000001 2024-09-17T02:21:31.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:31.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684911+0000", 2024-09-17T02:21:31.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186243 2024-09-17T02:21:31.611 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.611 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:31.611 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.611 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97752 5.b 5:d146f486:::benchmark_data_smithi001_23533_object97751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:31.612 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:31.612 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.961893336999999, 2024-09-17T02:21:31.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091989557, 2024-09-17T02:21:31.612 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:31.612 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:31.612 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:31.612 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:31.612 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:31.612 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:31.613 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97752 2024-09-17T02:21:31.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.617 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:31.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:31.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:31.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:31.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:31.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:31.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593300+0000", 2024-09-17T02:21:31.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8199999999999998e-07 2024-09-17T02:21:31.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:31.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593364+0000", 2024-09-17T02:21:31.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3831999999999995e-05 2024-09-17T02:21:31.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:31.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593376+0000", 2024-09-17T02:21:31.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1800999999999999e-05 2024-09-17T02:21:31.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593382+0000", 2024-09-17T02:21:31.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6780000000000003e-06 2024-09-17T02:21:31.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:31.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595491+0000", 2024-09-17T02:21:31.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021090689999999999 2024-09-17T02:21:31.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:31.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595614+0000", 2024-09-17T02:21:31.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012321500000000001 2024-09-17T02:21:31.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:31.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595778+0000", 2024-09-17T02:21:31.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016321900000000001 2024-09-17T02:21:31.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:31.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601197+0000", 2024-09-17T02:21:31.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054195600000000003 2024-09-17T02:21:31.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:31.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601396+0000", 2024-09-17T02:21:31.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019825299999999999 2024-09-17T02:21:31.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:31.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684990+0000", 2024-09-17T02:21:31.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083594878999999997 2024-09-17T02:21:31.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:31.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685116+0000", 2024-09-17T02:21:31.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012522799999999999 2024-09-17T02:21:31.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:31.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685289+0000", 2024-09-17T02:21:31.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172941 2024-09-17T02:21:31.625 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.625 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:31.625 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.626 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97754 5.b 5:da0615e5:::benchmark_data_smithi001_23533_object97753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:31.626 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:31.626 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.960255415000001, 2024-09-17T02:21:31.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092097207, 2024-09-17T02:21:31.626 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:31.626 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:31.626 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:31.627 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:31.627 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:31.627 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:31.627 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97754 2024-09-17T02:21:31.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.627 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:31.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:31.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:31.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:31.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:31.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:31.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594938+0000", 2024-09-17T02:21:31.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5000000000000002e-07 2024-09-17T02:21:31.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:31.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595075+0000", 2024-09-17T02:21:31.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137742 2024-09-17T02:21:31.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:31.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595087+0000", 2024-09-17T02:21:31.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1243000000000001e-05 2024-09-17T02:21:31.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595095+0000", 2024-09-17T02:21:31.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1030000000000002e-06 2024-09-17T02:21:31.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:31.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598461+0000", 2024-09-17T02:21:31.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033661170000000001 2024-09-17T02:21:31.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:31.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598540+0000", 2024-09-17T02:21:31.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8937999999999995e-05 2024-09-17T02:21:31.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:31.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598626+0000", 2024-09-17T02:21:31.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6042000000000001e-05 2024-09-17T02:21:31.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:31.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684258+0000", 2024-09-17T02:21:31.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085632394000000001 2024-09-17T02:21:31.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:31.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685369+0000", 2024-09-17T02:21:31.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001111063 2024-09-17T02:21:31.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:31.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685511+0000", 2024-09-17T02:21:31.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141965 2024-09-17T02:21:31.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:31.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685604+0000", 2024-09-17T02:21:31.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2935000000000004e-05 2024-09-17T02:21:31.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:31.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687034+0000", 2024-09-17T02:21:31.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001430015 2024-09-17T02:21:31.638 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.638 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:31.638 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.638 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97755 5.b 5:d36a03a1:::benchmark_data_smithi001_23533_object97754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:31.638 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:31.638 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.960082265, 2024-09-17T02:21:31.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0924904, 2024-09-17T02:21:31.638 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:31.638 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:31.639 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:31.639 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:31.639 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:31.639 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:31.639 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97755 2024-09-17T02:21:31.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.639 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:31.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:31.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:31.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:31.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:31.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:31.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595111+0000", 2024-09-17T02:21:31.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:21:31.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595145+0000", 2024-09-17T02:21:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3927000000000002e-05 2024-09-17T02:21:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595155+0000", 2024-09-17T02:21:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0023e-05 2024-09-17T02:21:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595162+0000", 2024-09-17T02:21:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3950000000000003e-06 2024-09-17T02:21:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:31.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599821+0000", 2024-09-17T02:21:31.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046592880000000001 2024-09-17T02:21:31.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:31.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599912+0000", 2024-09-17T02:21:31.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1049000000000002e-05 2024-09-17T02:21:31.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:31.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600062+0000", 2024-09-17T02:21:31.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015001700000000001 2024-09-17T02:21:31.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:31.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685307+0000", 2024-09-17T02:21:31.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085244340000000002 2024-09-17T02:21:31.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:31.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685446+0000", 2024-09-17T02:21:31.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013955700000000001 2024-09-17T02:21:31.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:31.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687375+0000", 2024-09-17T02:21:31.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019291079999999999 2024-09-17T02:21:31.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:31.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687462+0000", 2024-09-17T02:21:31.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6148000000000003e-05 2024-09-17T02:21:31.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:31.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687600+0000", 2024-09-17T02:21:31.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013887900000000001 2024-09-17T02:21:31.645 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.645 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:31.645 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.645 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPush(5.3 44/38 [PushOp(5:c45b310d:::benchmark_data_smithi001_23533_object73736:head, version: 39'4672, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(5:c45b310d:::benchmark_data_smithi001_23533_object73736:head@39'4672, size: 65536, copy_subset: [(0, 65536)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 65536, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-17T02:21:31.645 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597100+0000", 2024-09-17T02:21:31.645 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.958092145, 2024-09-17T02:21:31.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.089325374999999999, 2024-09-17T02:21:31.646 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:31.646 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:31.646 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:31.646 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:31.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:31.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597100+0000", 2024-09-17T02:21:31.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:31.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597100+0000", 2024-09-17T02:21:31.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:31.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597101+0000", 2024-09-17T02:21:31.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4899999999999995e-07 2024-09-17T02:21:31.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:31.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597155+0000", 2024-09-17T02:21:31.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4466999999999999e-05 2024-09-17T02:21:31.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:31.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597174+0000", 2024-09-17T02:21:31.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8393000000000002e-05 2024-09-17T02:21:31.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597189+0000", 2024-09-17T02:21:31.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5716999999999999e-05 2024-09-17T02:21:31.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:31.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684442+0000", 2024-09-17T02:21:31.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.087252918999999998 2024-09-17T02:21:31.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:31.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684479+0000", 2024-09-17T02:21:31.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6902e-05 2024-09-17T02:21:31.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:31.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.686426+0000", 2024-09-17T02:21:31.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001946328 2024-09-17T02:21:31.650 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.650 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:31.650 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.651 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 44/44 lb 5:c4567a04:::benchmark_data_smithi001_23533_object4200:head)", 2024-09-17T02:21:31.651 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:31.651 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.957985639, 2024-09-17T02:21:31.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092483421999999996, 2024-09-17T02:21:31.651 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:31.651 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:31.651 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:31.651 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:31.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:31.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:31.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:31.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:31.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:31.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:31.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6399999999999998e-07 2024-09-17T02:21:31.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597213+0000", 2024-09-17T02:21:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3659999999999997e-06 2024-09-17T02:21:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597222+0000", 2024-09-17T02:21:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0510000000000002e-06 2024-09-17T02:21:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597228+0000", 2024-09-17T02:21:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1569999999999999e-06 2024-09-17T02:21:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:31.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689588+0000", 2024-09-17T02:21:31.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092359931000000006 2024-09-17T02:21:31.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:31.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689622+0000", 2024-09-17T02:21:31.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4425999999999999e-05 2024-09-17T02:21:31.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:31.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689690+0000", 2024-09-17T02:21:31.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8126999999999993e-05 2024-09-17T02:21:31.655 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.655 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:31.655 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.655 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:97759 5.a e44/22 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head v 44'6175, mlcod=44'6173)", 2024-09-17T02:21:31.655 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.599333+0000", 2024-09-17T02:21:31.655 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.955859418999999, 2024-09-17T02:21:31.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088908582, 2024-09-17T02:21:31.655 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:31.655 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:31.655 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:31.655 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:31.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:31.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599333+0000", 2024-09-17T02:21:31.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:31.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599333+0000", 2024-09-17T02:21:31.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:31.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599334+0000", 2024-09-17T02:21:31.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6700000000000003e-07 2024-09-17T02:21:31.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:31.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599503+0000", 2024-09-17T02:21:31.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0001693 2024-09-17T02:21:31.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:31.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599510+0000", 2024-09-17T02:21:31.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0469999999999996e-06 2024-09-17T02:21:31.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599514+0000", 2024-09-17T02:21:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0069999999999999e-06 2024-09-17T02:21:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599559+0000", 2024-09-17T02:21:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4697999999999998e-05 2024-09-17T02:21:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599570+0000", 2024-09-17T02:21:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1042e-05 2024-09-17T02:21:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:31.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.688181+0000", 2024-09-17T02:21:31.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088611756999999999 2024-09-17T02:21:31.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:31.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.688242+0000", 2024-09-17T02:21:31.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0064e-05 2024-09-17T02:21:31.659 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.659 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:31.659 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.660 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97762 5.4 5:2c64abcd:::benchmark_data_smithi001_23533_object97761:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:31.660 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.599394+0000", 2024-09-17T02:21:31.660 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.955797884000001, 2024-09-17T02:21:31.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088655857000000005, 2024-09-17T02:21:31.660 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:31.660 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:31.660 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:31.660 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:31.660 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:31.660 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:31.660 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97762 2024-09-17T02:21:31.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.660 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:31.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:31.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599394+0000", 2024-09-17T02:21:31.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:31.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599394+0000", 2024-09-17T02:21:31.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:31.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599395+0000", 2024-09-17T02:21:31.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.85e-07 2024-09-17T02:21:31.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:31.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599442+0000", 2024-09-17T02:21:31.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6964e-05 2024-09-17T02:21:31.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599454+0000", 2024-09-17T02:21:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1841999999999999e-05 2024-09-17T02:21:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599459+0000", 2024-09-17T02:21:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1000000000000003e-06 2024-09-17T02:21:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599511+0000", 2024-09-17T02:21:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1814999999999998e-05 2024-09-17T02:21:31.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:31.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599627+0000", 2024-09-17T02:21:31.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116087 2024-09-17T02:21:31.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:31.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599716+0000", 2024-09-17T02:21:31.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9174999999999999e-05 2024-09-17T02:21:31.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:31.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687757+0000", 2024-09-17T02:21:31.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088040361999999997 2024-09-17T02:21:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687778+0000", 2024-09-17T02:21:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1229e-05 2024-09-17T02:21:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687833+0000", 2024-09-17T02:21:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4928e-05 2024-09-17T02:21:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687916+0000", 2024-09-17T02:21:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3175000000000002e-05 2024-09-17T02:21:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.688050+0000", 2024-09-17T02:21:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013429499999999999 2024-09-17T02:21:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPushReply(5.4 44/36 [PushReplyOp(5:291a38c7:::benchmark_data_smithi001_23533_object22817:head)])", 2024-09-17T02:21:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.599945+0000", 2024-09-17T02:21:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.955247119999999, 2024-09-17T02:21:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.084468808000000006, 2024-09-17T02:21:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-17T02:21:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599945+0000", 2024-09-17T02:21:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599945+0000", 2024-09-17T02:21:31.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:31.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599945+0000", 2024-09-17T02:21:31.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1e-07 2024-09-17T02:21:31.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:31.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599949+0000", 2024-09-17T02:21:31.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2849999999999999e-06 2024-09-17T02:21:31.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:31.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599956+0000", 2024-09-17T02:21:31.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3640000000000001e-06 2024-09-17T02:21:31.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599962+0000", 2024-09-17T02:21:31.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2360000000000001e-06 2024-09-17T02:21:31.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601282+0000", 2024-09-17T02:21:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001319808 2024-09-17T02:21:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684414+0000", 2024-09-17T02:21:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083131905000000006 2024-09-17T02:21:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.672 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:97761 5.9 e44/22 5:908717b6:::benchmark_data_smithi001_23533_object97760:head v 44'6129, mlcod=44'6125)", 2024-09-17T02:21:31.672 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.599983+0000", 2024-09-17T02:21:31.672 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.955209332000001, 2024-09-17T02:21:31.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091911272000000002, 2024-09-17T02:21:31.672 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:31.672 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:31.672 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:31.672 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:31.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:31.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599983+0000", 2024-09-17T02:21:31.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599983+0000", 2024-09-17T02:21:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599983+0000", 2024-09-17T02:21:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1100000000000002e-07 2024-09-17T02:21:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600085+0000", 2024-09-17T02:21:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102007 2024-09-17T02:21:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600094+0000", 2024-09-17T02:21:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1850000000000004e-06 2024-09-17T02:21:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600099+0000", 2024-09-17T02:21:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6640000000000003e-06 2024-09-17T02:21:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600140+0000", 2024-09-17T02:21:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0998999999999998e-05 2024-09-17T02:21:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600157+0000", 2024-09-17T02:21:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7122999999999999e-05 2024-09-17T02:21:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.691795+0000", 2024-09-17T02:21:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091638002999999996 2024-09-17T02:21:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:31.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.691894+0000", 2024-09-17T02:21:31.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8980000000000004e-05 2024-09-17T02:21:31.676 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.676 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:31.676 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.676 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:97749 5.b e44/38 ondisk, result = 0)", 2024-09-17T02:21:31.676 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.600115+0000", 2024-09-17T02:21:31.676 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.955077339000001, 2024-09-17T02:21:31.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.084148770999999997, 2024-09-17T02:21:31.676 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:31.676 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:31.677 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:31.677 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:31.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:31.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600115+0000", 2024-09-17T02:21:31.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:31.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600115+0000", 2024-09-17T02:21:31.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:31.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600115+0000", 2024-09-17T02:21:31.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.39e-07 2024-09-17T02:21:31.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:31.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600119+0000", 2024-09-17T02:21:31.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3060000000000002e-06 2024-09-17T02:21:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600125+0000", 2024-09-17T02:21:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3330000000000002e-06 2024-09-17T02:21:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600130+0000", 2024-09-17T02:21:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8999999999999997e-06 2024-09-17T02:21:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601349+0000", 2024-09-17T02:21:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012192209999999999 2024-09-17T02:21:31.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:31.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601353+0000", 2024-09-17T02:21:31.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9149999999999998e-06 2024-09-17T02:21:31.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:31.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684264+0000", 2024-09-17T02:21:31.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.082910757000000002 2024-09-17T02:21:31.680 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.680 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:31.680 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:97754 5.b e44/38 ondisk, result = 0)", 2024-09-17T02:21:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.601431+0000", 2024-09-17T02:21:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.953761182999999, 2024-09-17T02:21:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085620499000000003, 2024-09-17T02:21:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601431+0000", 2024-09-17T02:21:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:31.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601431+0000", 2024-09-17T02:21:31.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:31.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601432+0000", 2024-09-17T02:21:31.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8400000000000004e-07 2024-09-17T02:21:31.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:31.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601435+0000", 2024-09-17T02:21:31.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9969999999999999e-06 2024-09-17T02:21:31.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:31.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684720+0000", 2024-09-17T02:21:31.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083285740999999996 2024-09-17T02:21:31.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684750+0000", 2024-09-17T02:21:31.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9632999999999999e-05 2024-09-17T02:21:31.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:31.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685492+0000", 2024-09-17T02:21:31.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00074159699999999998 2024-09-17T02:21:31.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:31.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685503+0000", 2024-09-17T02:21:31.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1294999999999999e-05 2024-09-17T02:21:31.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:31.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687052+0000", 2024-09-17T02:21:31.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001548652 2024-09-17T02:21:31.684 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.684 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:97749 5.b e44/38 ondisk, result = 0)", 2024-09-17T02:21:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.601857+0000", 2024-09-17T02:21:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.953335731999999, 2024-09-17T02:21:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083064447999999999, 2024-09-17T02:21:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601857+0000", 2024-09-17T02:21:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601857+0000", 2024-09-17T02:21:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601857+0000", 2024-09-17T02:21:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5799999999999999e-07 2024-09-17T02:21:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:31.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601862+0000", 2024-09-17T02:21:31.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1900000000000003e-06 2024-09-17T02:21:31.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:31.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684426+0000", 2024-09-17T02:21:31.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.082564018000000003 2024-09-17T02:21:31.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684443+0000", 2024-09-17T02:21:31.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6986e-05 2024-09-17T02:21:31.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:31.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684592+0000", 2024-09-17T02:21:31.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000148818 2024-09-17T02:21:31.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:31.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684607+0000", 2024-09-17T02:21:31.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5033e-05 2024-09-17T02:21:31.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:31.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:31.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:31.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684921+0000", 2024-09-17T02:21:31.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031374499999999999 2024-09-17T02:21:31.688 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.688 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:31.689 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.689 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:31.689 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:31.689 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:31.690 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:31.691 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:31.690+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:31.775 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 59 15 126196 126181 133.651 129.812 0.00679774 0.00747759 2024-09-17T02:21:31.793 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:31.794+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:31.846 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:31.847 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:31.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.847 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:126321 5.e e49/22 5:731c5aa2:::benchmark_data_smithi001_23533_object126320:head v 49'7896, mlcod=49'7894)", 2024-09-17T02:21:31.847 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:31.847123+0000", 2024-09-17T02:21:31.847 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.004436031, 2024-09-17T02:21:31.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044506240000000002, 2024-09-17T02:21:31.847 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:31.847 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:31.847 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:31.847 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:31.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:31.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.847123+0000", 2024-09-17T02:21:31.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:31.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:31.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.847123+0000", 2024-09-17T02:21:31.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:31.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:31.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.847124+0000", 2024-09-17T02:21:31.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3e-07 2024-09-17T02:21:31.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:31.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.847197+0000", 2024-09-17T02:21:31.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3002000000000003e-05 2024-09-17T02:21:31.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:31.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.847211+0000", 2024-09-17T02:21:31.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4089e-05 2024-09-17T02:21:31.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.847217+0000", 2024-09-17T02:21:31.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0769999999999996e-06 2024-09-17T02:21:31.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:31.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.847263+0000", 2024-09-17T02:21:31.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5671999999999999e-05 2024-09-17T02:21:31.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:31.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.847280+0000", 2024-09-17T02:21:31.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6850999999999998e-05 2024-09-17T02:21:31.851 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:31.851 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:31.851 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:31.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.852 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:126322 5.4 e49/36 5:22beecf6:::benchmark_data_smithi001_23533_object126321:head v 49'7784, mlcod=49'7782)", 2024-09-17T02:21:31.852 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:31.847833+0000", 2024-09-17T02:21:31.852 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.003725992, 2024-09-17T02:21:31.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037771089999999998, 2024-09-17T02:21:31.852 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:31.852 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:31.852 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:31.852 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:31.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:31.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.847833+0000", 2024-09-17T02:21:31.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:31.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:31.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.847833+0000", 2024-09-17T02:21:31.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:31.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:31.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.847834+0000", 2024-09-17T02:21:31.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8199999999999999e-07 2024-09-17T02:21:31.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:31.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.847938+0000", 2024-09-17T02:21:31.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104044 2024-09-17T02:21:31.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:31.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.847949+0000", 2024-09-17T02:21:31.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1309e-05 2024-09-17T02:21:31.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.847955+0000", 2024-09-17T02:21:31.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7119999999999997e-06 2024-09-17T02:21:31.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:31.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.848014+0000", 2024-09-17T02:21:31.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8551000000000002e-05 2024-09-17T02:21:31.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:31.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.848032+0000", 2024-09-17T02:21:31.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8746999999999999e-05 2024-09-17T02:21:31.856 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:31.856 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:31.856 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:31.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.857 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:126329 5.4 e49/36 5:20a91dd7:::benchmark_data_smithi001_23533_object126328:head v 49'7785, mlcod=49'7782)", 2024-09-17T02:21:31.857 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:31.850413+0000", 2024-09-17T02:21:31.857 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0011457240000000001, 2024-09-17T02:21:31.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00122802, 2024-09-17T02:21:31.857 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:31.857 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:31.857 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:31.857 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:31.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:31.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.850413+0000", 2024-09-17T02:21:31.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:31.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:31.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.850413+0000", 2024-09-17T02:21:31.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:31.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:31.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.850414+0000", 2024-09-17T02:21:31.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4000000000000002e-07 2024-09-17T02:21:31.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:31.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.850552+0000", 2024-09-17T02:21:31.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138169 2024-09-17T02:21:31.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:31.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.850575+0000", 2024-09-17T02:21:31.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3008000000000001e-05 2024-09-17T02:21:31.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.850581+0000", 2024-09-17T02:21:31.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.28e-06 2024-09-17T02:21:31.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:31.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.850617+0000", 2024-09-17T02:21:31.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5277999999999997e-05 2024-09-17T02:21:31.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:31.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.850630+0000", 2024-09-17T02:21:31.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3046e-05 2024-09-17T02:21:31.861 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:31.861 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:31.861 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:31.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.861 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:126313 5.c 5:376f4df3:::benchmark_data_smithi001_23533_object126312:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:31.861 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:31.842928+0000", 2024-09-17T02:21:31.861 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0086313090000000002, 2024-09-17T02:21:31.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0087484060000000002, 2024-09-17T02:21:31.861 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:31.862 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:31.862 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:31.862 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:31.862 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:31.862 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:31.862 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 126313 2024-09-17T02:21:31.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.862 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:31.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:31.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.842928+0000", 2024-09-17T02:21:31.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:31.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:31.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.842928+0000", 2024-09-17T02:21:31.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:31.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:31.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.842929+0000", 2024-09-17T02:21:31.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2399999999999998e-07 2024-09-17T02:21:31.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:31.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.842987+0000", 2024-09-17T02:21:31.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8655e-05 2024-09-17T02:21:31.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:31.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.842996+0000", 2024-09-17T02:21:31.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6149999999999997e-06 2024-09-17T02:21:31.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.843001+0000", 2024-09-17T02:21:31.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1830000000000002e-06 2024-09-17T02:21:31.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:31.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.843051+0000", 2024-09-17T02:21:31.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0470000000000003e-05 2024-09-17T02:21:31.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:31.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.843200+0000", 2024-09-17T02:21:31.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014870399999999999 2024-09-17T02:21:31.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:31.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.843346+0000", 2024-09-17T02:21:31.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000145542 2024-09-17T02:21:31.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:31.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.846014+0000", 2024-09-17T02:21:31.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026683739999999998 2024-09-17T02:21:31.866 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:31.866 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:31.866 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:31.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.867 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:126317 5.5 5:af25e036:::benchmark_data_smithi001_23533_object126316:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:31.867 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:31.845323+0000", 2024-09-17T02:21:31.867 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0062360039999999999, 2024-09-17T02:21:31.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063980460000000001, 2024-09-17T02:21:31.867 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:31.867 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:31.867 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:31.867 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:31.867 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:31.867 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:31.868 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 126317 2024-09-17T02:21:31.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.868 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:31.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:31.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.845323+0000", 2024-09-17T02:21:31.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:31.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:31.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.845323+0000", 2024-09-17T02:21:31.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:31.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:31.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.845324+0000", 2024-09-17T02:21:31.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5900000000000005e-07 2024-09-17T02:21:31.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:31.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.845356+0000", 2024-09-17T02:21:31.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1557000000000003e-05 2024-09-17T02:21:31.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:31.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.845368+0000", 2024-09-17T02:21:31.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2592000000000001e-05 2024-09-17T02:21:31.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:31.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.845377+0000", 2024-09-17T02:21:31.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0699999999999996e-06 2024-09-17T02:21:31.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:31.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.845441+0000", 2024-09-17T02:21:31.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3139000000000007e-05 2024-09-17T02:21:31.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:31.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.845590+0000", 2024-09-17T02:21:31.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014952499999999999 2024-09-17T02:21:31.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:31.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.845789+0000", 2024-09-17T02:21:31.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000199185 2024-09-17T02:21:31.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:31.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:31.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:31.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:31.849676+0000", 2024-09-17T02:21:31.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003886282 2024-09-17T02:21:31.872 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:31.872 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:31.872 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:31.872 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:31.872 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:21:31.872 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 5 2024-09-17T02:21:31.872 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:31.874 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:31.930 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:31.930+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:31.993 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:31.994+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:32.076 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:32.076 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:21:32.077 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:21:32.077 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:21:32.077 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:32.094 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:32.094+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:32.095 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:32.195 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:32.198+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:32.296 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:21:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:21:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:21:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.736346896000001, 2024-09-17T02:21:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022056035000000002, 2024-09-17T02:21:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:21:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562130+0000", 2024-09-17T02:21:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562132+0000", 2024-09-17T02:21:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6300000000000001e-06 2024-09-17T02:21:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562142+0000", 2024-09-17T02:21:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.022e-05 2024-09-17T02:21:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562164+0000", 2024-09-17T02:21:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2002999999999999e-05 2024-09-17T02:21:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562180+0000", 2024-09-17T02:21:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5930000000000002e-05 2024-09-17T02:21:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563517+0000", 2024-09-17T02:21:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001336776 2024-09-17T02:21:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563635+0000", 2024-09-17T02:21:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117976 2024-09-17T02:21:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563819+0000", 2024-09-17T02:21:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018411499999999999 2024-09-17T02:21:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566977+0000", 2024-09-17T02:21:32.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031575990000000001 2024-09-17T02:21:32.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:32.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.583917+0000", 2024-09-17T02:21:32.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016940093999999999 2024-09-17T02:21:32.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:32.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584066+0000", 2024-09-17T02:21:32.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000149746 2024-09-17T02:21:32.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:32.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.584186+0000", 2024-09-17T02:21:32.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011994600000000001 2024-09-17T02:21:32.303 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.303 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:32.304 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.304 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:32.304 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:32.304 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.736166185000002, 2024-09-17T02:21:32.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023664803000000002, 2024-09-17T02:21:32.304 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:32.305 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:32.305 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:32.305 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:32.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:32.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:32.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:32.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:32.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:32.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562313+0000", 2024-09-17T02:21:32.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.764e-06 2024-09-17T02:21:32.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:32.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562323+0000", 2024-09-17T02:21:32.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0166000000000001e-05 2024-09-17T02:21:32.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:32.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562343+0000", 2024-09-17T02:21:32.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9633999999999999e-05 2024-09-17T02:21:32.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562367+0000", 2024-09-17T02:21:32.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4556e-05 2024-09-17T02:21:32.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:32.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563777+0000", 2024-09-17T02:21:32.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014102330000000001 2024-09-17T02:21:32.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:32.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563969+0000", 2024-09-17T02:21:32.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000191361 2024-09-17T02:21:32.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:32.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564148+0000", 2024-09-17T02:21:32.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017934599999999999 2024-09-17T02:21:32.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:32.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566989+0000", 2024-09-17T02:21:32.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028407010000000002 2024-09-17T02:21:32.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:32.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585770+0000", 2024-09-17T02:21:32.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018781566999999999 2024-09-17T02:21:32.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:32.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585874+0000", 2024-09-17T02:21:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103489 2024-09-17T02:21:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585976+0000", 2024-09-17T02:21:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101986 2024-09-17T02:21:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.736083304999994, 2024-09-17T02:21:32.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024118555999999999, 2024-09-17T02:21:32.312 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:32.312 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:32.312 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:32.312 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:32.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:32.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:32.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562395+0000", 2024-09-17T02:21:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3969999999999999e-06 2024-09-17T02:21:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562405+0000", 2024-09-17T02:21:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4229999999999994e-06 2024-09-17T02:21:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:32.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562427+0000", 2024-09-17T02:21:32.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759999999999998e-05 2024-09-17T02:21:32.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562444+0000", 2024-09-17T02:21:32.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7019000000000001e-05 2024-09-17T02:21:32.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:32.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564681+0000", 2024-09-17T02:21:32.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022376929999999998 2024-09-17T02:21:32.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:32.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564887+0000", 2024-09-17T02:21:32.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000206178 2024-09-17T02:21:32.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:32.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565230+0000", 2024-09-17T02:21:32.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034233499999999998 2024-09-17T02:21:32.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:32.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567000+0000", 2024-09-17T02:21:32.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017706390000000001 2024-09-17T02:21:32.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:32.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586126+0000", 2024-09-17T02:21:32.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019125672 2024-09-17T02:21:32.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586314+0000", 2024-09-17T02:21:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018740200000000001 2024-09-17T02:21:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586513+0000", 2024-09-17T02:21:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019903799999999999 2024-09-17T02:21:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:32.318 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:32.318 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.730014201000003, 2024-09-17T02:21:32.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:21:32.318 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:32.318 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:32.318 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:32.318 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:32.318 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:32.318 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:32.318 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:21:32.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.318 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:32.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:32.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:32.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:32.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:32.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:32.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:21:32.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:21:32.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:32.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:21:32.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:21:32.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:32.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:21:32.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:21:32.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:21:32.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:21:32.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:32.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:21:32.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:21:32.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:21:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:21:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:21:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:21:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:21:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:21:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:32.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:21:32.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:21:32.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:32.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:21:32.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:21:32.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:32.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:21:32.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:21:32.324 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.324 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:32.324 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.324 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:32.324 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:32.324 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.726111951, 2024-09-17T02:21:32.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:21:32.324 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:32.324 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:32.324 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:32.325 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:32.325 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:32.325 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:32.325 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:21:32.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.325 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:32.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:32.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:32.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:21:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:21:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:21:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:21:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:32.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:21:32.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:21:32.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:21:32.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:21:32.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:32.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:21:32.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:21:32.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:32.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:21:32.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:21:32.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:32.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:21:32.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:21:32.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:32.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:21:32.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:21:32.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:32.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:21:32.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:21:32.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:32.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:21:32.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:21:32.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:32.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:21:32.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:21:32.331 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.331 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:32.331 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.331 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71190 5.3 e39/38 5:c99e0ae2:::benchmark_data_smithi001_23533_object71189:head v 39'4516, mlcod=35'4513)", 2024-09-17T02:21:32.331 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.607413+0000", 2024-09-17T02:21:32.331 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.691063926999998, 2024-09-17T02:21:32.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023407462, 2024-09-17T02:21:32.331 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:32.331 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:32.331 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:32.331 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:32.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:32.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607413+0000", 2024-09-17T02:21:32.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:32.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607413+0000", 2024-09-17T02:21:32.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:32.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607415+0000", 2024-09-17T02:21:32.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2139999999999999e-06 2024-09-17T02:21:32.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:32.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607479+0000", 2024-09-17T02:21:32.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4374000000000004e-05 2024-09-17T02:21:32.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:32.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607496+0000", 2024-09-17T02:21:32.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6820000000000002e-05 2024-09-17T02:21:32.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607512+0000", 2024-09-17T02:21:32.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5976000000000001e-05 2024-09-17T02:21:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609288+0000", 2024-09-17T02:21:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001776311 2024-09-17T02:21:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609327+0000", 2024-09-17T02:21:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9165999999999997e-05 2024-09-17T02:21:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630723+0000", 2024-09-17T02:21:32.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021395290000000001 2024-09-17T02:21:32.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:32.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630821+0000", 2024-09-17T02:21:32.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8311000000000001e-05 2024-09-17T02:21:32.336 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.336 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:32.336 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.336 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71206 5.3 e39/38 5:c6c9386d:::benchmark_data_smithi001_23533_object71205:head v 39'4517, mlcod=35'4513)", 2024-09-17T02:21:32.337 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:32.337 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.688784836, 2024-09-17T02:21:32.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026101868, 2024-09-17T02:21:32.337 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:32.337 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:32.337 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:32.337 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:32.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:32.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:32.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:32.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:32.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:32.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609694+0000", 2024-09-17T02:21:32.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9539999999999998e-06 2024-09-17T02:21:32.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:32.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609841+0000", 2024-09-17T02:21:32.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014690800000000001 2024-09-17T02:21:32.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:32.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609872+0000", 2024-09-17T02:21:32.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0326000000000001e-05 2024-09-17T02:21:32.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609892+0000", 2024-09-17T02:21:32.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9848999999999999e-05 2024-09-17T02:21:32.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:32.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613826+0000", 2024-09-17T02:21:32.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039345140000000001 2024-09-17T02:21:32.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:32.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613908+0000", 2024-09-17T02:21:32.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2412999999999999e-05 2024-09-17T02:21:32.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:32.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635696+0000", 2024-09-17T02:21:32.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021787597999999998 2024-09-17T02:21:32.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:32.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635794+0000", 2024-09-17T02:21:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8306000000000004e-05 2024-09-17T02:21:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71210 5.3 e39/38 5:c0498d13:::benchmark_data_smithi001_23533_object71209:head v 39'4518, mlcod=35'4513)", 2024-09-17T02:21:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.68730687, 2024-09-17T02:21:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024703197, 2024-09-17T02:21:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:32.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:32.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:32.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:32.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:32.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:32.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611172+0000", 2024-09-17T02:21:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6470000000000001e-06 2024-09-17T02:21:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611344+0000", 2024-09-17T02:21:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000171607 2024-09-17T02:21:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611389+0000", 2024-09-17T02:21:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5738000000000002e-05 2024-09-17T02:21:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611407+0000", 2024-09-17T02:21:32.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7893e-05 2024-09-17T02:21:32.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:32.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617820+0000", 2024-09-17T02:21:32.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064131070000000004 2024-09-17T02:21:32.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:32.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617885+0000", 2024-09-17T02:21:32.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4442000000000004e-05 2024-09-17T02:21:32.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:32.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635806+0000", 2024-09-17T02:21:32.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017920874999999999 2024-09-17T02:21:32.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635874+0000", 2024-09-17T02:21:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7887999999999998e-05 2024-09-17T02:21:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71213 5.3 e39/38 5:ce9071a1:::benchmark_data_smithi001_23533_object71212:head v 39'4519, mlcod=35'4513)", 2024-09-17T02:21:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.613453+0000", 2024-09-17T02:21:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.685024359, 2024-09-17T02:21:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022494631000000001, 2024-09-17T02:21:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613453+0000", 2024-09-17T02:21:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613453+0000", 2024-09-17T02:21:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:32.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613455+0000", 2024-09-17T02:21:32.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.703e-06 2024-09-17T02:21:32.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:32.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613594+0000", 2024-09-17T02:21:32.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000139405 2024-09-17T02:21:32.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613625+0000", 2024-09-17T02:21:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0993e-05 2024-09-17T02:21:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613646+0000", 2024-09-17T02:21:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0761999999999999e-05 2024-09-17T02:21:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.620855+0000", 2024-09-17T02:21:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0072088270000000001 2024-09-17T02:21:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.620933+0000", 2024-09-17T02:21:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8807000000000006e-05 2024-09-17T02:21:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635882+0000", 2024-09-17T02:21:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014948530999999999 2024-09-17T02:21:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635948+0000", 2024-09-17T02:21:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5603000000000002e-05 2024-09-17T02:21:32.352 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.352 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:32.352 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.352 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71214 5.3 e39/38 5:c5e24f3f:::benchmark_data_smithi001_23533_object71213:head v 39'4520, mlcod=35'4513)", 2024-09-17T02:21:32.352 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:32.352 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.682942638, 2024-09-17T02:21:32.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024251297000000002, 2024-09-17T02:21:32.352 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:32.352 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:32.352 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:32.352 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:32.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:32.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:32.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:32.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:32.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:32.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615536+0000", 2024-09-17T02:21:32.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5370000000000001e-06 2024-09-17T02:21:32.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:32.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615696+0000", 2024-09-17T02:21:32.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015948700000000001 2024-09-17T02:21:32.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:32.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615723+0000", 2024-09-17T02:21:32.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7518999999999999e-05 2024-09-17T02:21:32.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615742+0000", 2024-09-17T02:21:32.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8519999999999999e-05 2024-09-17T02:21:32.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:32.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.624440+0000", 2024-09-17T02:21:32.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0086983080000000001 2024-09-17T02:21:32.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:32.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.624489+0000", 2024-09-17T02:21:32.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8838000000000002e-05 2024-09-17T02:21:32.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:32.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639673+0000", 2024-09-17T02:21:32.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01518451 2024-09-17T02:21:32.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:32.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639786+0000", 2024-09-17T02:21:32.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011257800000000001 2024-09-17T02:21:32.356 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.357 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:32.357 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.357 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71215 5.3 e39/38 5:c5603662:::benchmark_data_smithi001_23533_object71214:head v 39'4521, mlcod=35'4513)", 2024-09-17T02:21:32.357 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.617466+0000", 2024-09-17T02:21:32.357 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.681011657999999, 2024-09-17T02:21:32.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022395379999999999, 2024-09-17T02:21:32.357 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:32.357 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:32.357 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:32.357 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:32.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:32.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617466+0000", 2024-09-17T02:21:32.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:32.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617466+0000", 2024-09-17T02:21:32.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:32.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617467+0000", 2024-09-17T02:21:32.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3600000000000002e-07 2024-09-17T02:21:32.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:32.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617521+0000", 2024-09-17T02:21:32.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4654999999999998e-05 2024-09-17T02:21:32.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:32.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617548+0000", 2024-09-17T02:21:32.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6706000000000001e-05 2024-09-17T02:21:32.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617566+0000", 2024-09-17T02:21:32.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7989e-05 2024-09-17T02:21:32.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:32.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.627598+0000", 2024-09-17T02:21:32.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010031854 2024-09-17T02:21:32.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:32.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.627656+0000", 2024-09-17T02:21:32.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8511999999999998e-05 2024-09-17T02:21:32.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:32.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639794+0000", 2024-09-17T02:21:32.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012137445 2024-09-17T02:21:32.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:32.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639861+0000", 2024-09-17T02:21:32.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7282999999999999e-05 2024-09-17T02:21:32.362 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.362 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:32.362 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.362 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:71277 5.a 5:5576e9b8:::benchmark_data_smithi001_23533_object71276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T02:21:32.362 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.630891+0000", 2024-09-17T02:21:32.362 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.667586117999999, 2024-09-17T02:21:32.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022210245999999999, 2024-09-17T02:21:32.362 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:32.362 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:32.362 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:32.363 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:32.363 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:32.363 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:32.363 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71277 2024-09-17T02:21:32.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.363 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:32.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:32.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630891+0000", 2024-09-17T02:21:32.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:32.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630891+0000", 2024-09-17T02:21:32.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:32.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630893+0000", 2024-09-17T02:21:32.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-09-17T02:21:32.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:32.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630961+0000", 2024-09-17T02:21:32.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7971000000000004e-05 2024-09-17T02:21:32.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:32.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630989+0000", 2024-09-17T02:21:32.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7855999999999999e-05 2024-09-17T02:21:32.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631010+0000", 2024-09-17T02:21:32.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0888999999999999e-05 2024-09-17T02:21:32.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:32.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631123+0000", 2024-09-17T02:21:32.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011292 2024-09-17T02:21:32.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:32.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631434+0000", 2024-09-17T02:21:32.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00031039199999999999 2024-09-17T02:21:32.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:32.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.631679+0000", 2024-09-17T02:21:32.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024517099999999997 2024-09-17T02:21:32.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:32.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.636619+0000", 2024-09-17T02:21:32.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049405339999999999 2024-09-17T02:21:32.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:32.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.652851+0000", 2024-09-17T02:21:32.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016231440999999999 2024-09-17T02:21:32.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:32.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.653012+0000", 2024-09-17T02:21:32.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016157199999999999 2024-09-17T02:21:32.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:32.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.653101+0000", 2024-09-17T02:21:32.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9190000000000005e-05 2024-09-17T02:21:32.368 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.368 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:32.368 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.368 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97147 5.0 5:02d17bf7:::benchmark_data_smithi001_23533_object97146:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:32.368 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268128+0000", 2024-09-17T02:21:32.368 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.030348893999999, 2024-09-17T02:21:32.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022726434, 2024-09-17T02:21:32.369 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:32.369 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:32.369 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:32.369 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:32.369 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:32.369 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:32.369 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97147 2024-09-17T02:21:32.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.370 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:32.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:32.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268128+0000", 2024-09-17T02:21:32.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:32.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268128+0000", 2024-09-17T02:21:32.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:32.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268129+0000", 2024-09-17T02:21:32.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5700000000000001e-07 2024-09-17T02:21:32.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:32.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268194+0000", 2024-09-17T02:21:32.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4731000000000001e-05 2024-09-17T02:21:32.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:32.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268202+0000", 2024-09-17T02:21:32.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7950000000000008e-06 2024-09-17T02:21:32.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268207+0000", 2024-09-17T02:21:32.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8550000000000001e-06 2024-09-17T02:21:32.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:32.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268694+0000", 2024-09-17T02:21:32.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00048752799999999998 2024-09-17T02:21:32.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:32.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268768+0000", 2024-09-17T02:21:32.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3638000000000002e-05 2024-09-17T02:21:32.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:32.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268842+0000", 2024-09-17T02:21:32.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3928000000000001e-05 2024-09-17T02:21:32.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:32.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.285598+0000", 2024-09-17T02:21:32.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016756436 2024-09-17T02:21:32.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:32.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290771+0000", 2024-09-17T02:21:32.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051724789999999998 2024-09-17T02:21:32.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:32.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290817+0000", 2024-09-17T02:21:32.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6220999999999997e-05 2024-09-17T02:21:32.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:32.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290855+0000", 2024-09-17T02:21:32.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7966000000000002e-05 2024-09-17T02:21:32.375 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.375 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:32.375 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.376 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97148 5.5 5:a643b955:::benchmark_data_smithi001_23533_object97147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:32.376 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268218+0000", 2024-09-17T02:21:32.376 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.03025951, 2024-09-17T02:21:32.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022628112999999998, 2024-09-17T02:21:32.376 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:32.376 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:32.376 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:32.376 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:32.376 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:32.376 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:32.377 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97148 2024-09-17T02:21:32.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.377 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:32.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:32.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268218+0000", 2024-09-17T02:21:32.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:32.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268218+0000", 2024-09-17T02:21:32.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:32.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268218+0000", 2024-09-17T02:21:32.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.53e-07 2024-09-17T02:21:32.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:32.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268300+0000", 2024-09-17T02:21:32.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2219999999999995e-05 2024-09-17T02:21:32.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:32.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268306+0000", 2024-09-17T02:21:32.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8989999999999998e-06 2024-09-17T02:21:32.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268310+0000", 2024-09-17T02:21:32.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6610000000000002e-06 2024-09-17T02:21:32.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:32.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268354+0000", 2024-09-17T02:21:32.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3782000000000002e-05 2024-09-17T02:21:32.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:32.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268452+0000", 2024-09-17T02:21:32.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8339999999999997e-05 2024-09-17T02:21:32.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:32.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268536+0000", 2024-09-17T02:21:32.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3931999999999995e-05 2024-09-17T02:21:32.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:32.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.286252+0000", 2024-09-17T02:21:32.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017715740000000001 2024-09-17T02:21:32.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:32.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290758+0000", 2024-09-17T02:21:32.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045060940000000004 2024-09-17T02:21:32.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:32.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290801+0000", 2024-09-17T02:21:32.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2818000000000002e-05 2024-09-17T02:21:32.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:32.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290846+0000", 2024-09-17T02:21:32.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5274000000000001e-05 2024-09-17T02:21:32.383 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.383 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:32.383 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.383 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97151 5.5 5:a0c2c072:::benchmark_data_smithi001_23533_object97150:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:32.383 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:32.383 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.030105229, 2024-09-17T02:21:32.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027297614000000001, 2024-09-17T02:21:32.383 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:32.383 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:32.384 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:32.384 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:32.384 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:32.384 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:32.384 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97151 2024-09-17T02:21:32.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.384 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:32.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:32.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:32.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:32.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:32.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:32.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268373+0000", 2024-09-17T02:21:32.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4000000000000002e-07 2024-09-17T02:21:32.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:32.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268423+0000", 2024-09-17T02:21:32.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0175e-05 2024-09-17T02:21:32.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:32.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268428+0000", 2024-09-17T02:21:32.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-17T02:21:32.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268431+0000", 2024-09-17T02:21:32.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.179e-06 2024-09-17T02:21:32.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:32.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283631+0000", 2024-09-17T02:21:32.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015199691 2024-09-17T02:21:32.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:32.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283740+0000", 2024-09-17T02:21:32.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109305 2024-09-17T02:21:32.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:32.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283863+0000", 2024-09-17T02:21:32.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012226699999999999 2024-09-17T02:21:32.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:32.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290857+0000", 2024-09-17T02:21:32.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069945449999999996 2024-09-17T02:21:32.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:32.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295595+0000", 2024-09-17T02:21:32.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047376750000000002 2024-09-17T02:21:32.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:32.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295638+0000", 2024-09-17T02:21:32.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3671999999999998e-05 2024-09-17T02:21:32.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:32.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295670+0000", 2024-09-17T02:21:32.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1266000000000002e-05 2024-09-17T02:21:32.391 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.391 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:32.391 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.391 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97248 5.c 5:3796bec5:::benchmark_data_smithi001_23533_object97247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:32.391 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.327358+0000", 2024-09-17T02:21:32.391 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.971118986, 2024-09-17T02:21:32.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022963006000000001, 2024-09-17T02:21:32.391 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:32.391 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:32.391 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:32.392 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:32.392 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:32.392 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:32.392 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97248 2024-09-17T02:21:32.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.392 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:32.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:32.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327358+0000", 2024-09-17T02:21:32.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:32.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327358+0000", 2024-09-17T02:21:32.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:32.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327359+0000", 2024-09-17T02:21:32.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5699999999999998e-07 2024-09-17T02:21:32.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:32.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327382+0000", 2024-09-17T02:21:32.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3458000000000001e-05 2024-09-17T02:21:32.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:32.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327387+0000", 2024-09-17T02:21:32.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6149999999999999e-06 2024-09-17T02:21:32.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327391+0000", 2024-09-17T02:21:32.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8999999999999999e-06 2024-09-17T02:21:32.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:32.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.332084+0000", 2024-09-17T02:21:32.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046935240000000001 2024-09-17T02:21:32.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:32.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.332216+0000", 2024-09-17T02:21:32.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131798 2024-09-17T02:21:32.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:32.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.332352+0000", 2024-09-17T02:21:32.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013587500000000001 2024-09-17T02:21:32.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:32.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.338559+0000", 2024-09-17T02:21:32.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0062075510000000004 2024-09-17T02:21:32.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:32.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350237+0000", 2024-09-17T02:21:32.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011677121 2024-09-17T02:21:32.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:32.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350287+0000", 2024-09-17T02:21:32.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0080999999999997e-05 2024-09-17T02:21:32.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:32.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350321+0000", 2024-09-17T02:21:32.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4625999999999997e-05 2024-09-17T02:21:32.398 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.399 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:32.399 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.399 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97251 5.c 5:382be9a3:::benchmark_data_smithi001_23533_object97250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:32.399 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.328203+0000", 2024-09-17T02:21:32.399 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.97027475, 2024-09-17T02:21:32.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022268999000000001, 2024-09-17T02:21:32.399 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:32.400 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:32.400 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:32.400 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:32.400 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:32.400 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:32.400 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97251 2024-09-17T02:21:32.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.400 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:32.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:32.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328203+0000", 2024-09-17T02:21:32.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:32.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328203+0000", 2024-09-17T02:21:32.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:32.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328203+0000", 2024-09-17T02:21:32.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3699999999999999e-07 2024-09-17T02:21:32.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:32.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328319+0000", 2024-09-17T02:21:32.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011560100000000001 2024-09-17T02:21:32.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:32.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328332+0000", 2024-09-17T02:21:32.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2978e-05 2024-09-17T02:21:32.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328340+0000", 2024-09-17T02:21:32.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4680000000000003e-06 2024-09-17T02:21:32.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:32.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.335525+0000", 2024-09-17T02:21:32.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0071852399999999999 2024-09-17T02:21:32.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:32.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.335650+0000", 2024-09-17T02:21:32.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012522299999999999 2024-09-17T02:21:32.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:32.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.335732+0000", 2024-09-17T02:21:32.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1582999999999995e-05 2024-09-17T02:21:32.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:32.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.346944+0000", 2024-09-17T02:21:32.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011211936 2024-09-17T02:21:32.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:32.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350332+0000", 2024-09-17T02:21:32.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033884140000000002 2024-09-17T02:21:32.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:32.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350433+0000", 2024-09-17T02:21:32.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010115600000000001 2024-09-17T02:21:32.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:32.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350472+0000", 2024-09-17T02:21:32.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8463000000000001e-05 2024-09-17T02:21:32.406 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.406 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:32.406 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.407 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97759 5.a 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:32.407 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:32.407 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.700092128, 2024-09-17T02:21:32.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.089694871999999995, 2024-09-17T02:21:32.407 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:32.407 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:32.407 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:32.407 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:32.407 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:32.408 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:32.408 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97759 2024-09-17T02:21:32.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.408 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:32.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:32.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:32.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:32.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:32.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:32.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598386+0000", 2024-09-17T02:21:32.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999999e-07 2024-09-17T02:21:32.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:32.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598414+0000", 2024-09-17T02:21:32.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8013000000000001e-05 2024-09-17T02:21:32.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:32.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598420+0000", 2024-09-17T02:21:32.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1149999999999999e-06 2024-09-17T02:21:32.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598424+0000", 2024-09-17T02:21:32.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:21:32.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:32.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598479+0000", 2024-09-17T02:21:32.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4648999999999998e-05 2024-09-17T02:21:32.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:32.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598587+0000", 2024-09-17T02:21:32.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010853000000000001 2024-09-17T02:21:32.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:32.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598676+0000", 2024-09-17T02:21:32.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8381999999999995e-05 2024-09-17T02:21:32.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:32.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603766+0000", 2024-09-17T02:21:32.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050902559999999996 2024-09-17T02:21:32.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:32.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.687988+0000", 2024-09-17T02:21:32.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.084221753999999996 2024-09-17T02:21:32.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:32.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688037+0000", 2024-09-17T02:21:32.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-05 2024-09-17T02:21:32.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:32.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688080+0000", 2024-09-17T02:21:32.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3149999999999999e-05 2024-09-17T02:21:32.414 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.414 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:32.414 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.414 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97770 5.0 5:09c75033:::benchmark_data_smithi001_23533_object97769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:32.414 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:32.414 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.694949698, 2024-09-17T02:21:32.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.086380868, 2024-09-17T02:21:32.415 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:32.415 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:32.415 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:32.415 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:32.415 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:32.415 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:32.415 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97770 2024-09-17T02:21:32.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.415 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:32.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:32.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:32.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:32.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:32.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:32.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603529+0000", 2024-09-17T02:21:32.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:21:32.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:32.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603593+0000", 2024-09-17T02:21:32.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4216999999999999e-05 2024-09-17T02:21:32.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:32.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603603+0000", 2024-09-17T02:21:32.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5179999999999993e-06 2024-09-17T02:21:32.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603608+0000", 2024-09-17T02:21:32.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2039999999999996e-06 2024-09-17T02:21:32.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:32.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603653+0000", 2024-09-17T02:21:32.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5247000000000002e-05 2024-09-17T02:21:32.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:32.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603758+0000", 2024-09-17T02:21:32.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105352 2024-09-17T02:21:32.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:32.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603900+0000", 2024-09-17T02:21:32.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014198999999999999 2024-09-17T02:21:32.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:32.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.606097+0000", 2024-09-17T02:21:32.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021969839999999999 2024-09-17T02:21:32.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:32.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689756+0000", 2024-09-17T02:21:32.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.083659077999999998 2024-09-17T02:21:32.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:32.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689846+0000", 2024-09-17T02:21:32.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9320999999999994e-05 2024-09-17T02:21:32.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:32.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689908+0000", 2024-09-17T02:21:32.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720999999999998e-05 2024-09-17T02:21:32.420 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.420 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:32.420 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.420 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:101263 5.0 5:01bcc612:::benchmark_data_smithi001_23533_object101262:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T02:21:32.420 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:19.421619+0000", 2024-09-17T02:21:32.420 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.876858477000001, 2024-09-17T02:21:32.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023065922999999999, 2024-09-17T02:21:32.420 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:32.420 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:32.421 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:32.421 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:32.421 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:32.421 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:32.421 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 101263 2024-09-17T02:21:32.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.421 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:32.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:32.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421619+0000", 2024-09-17T02:21:32.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:32.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421619+0000", 2024-09-17T02:21:32.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:32.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:32.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421619+0000", 2024-09-17T02:21:32.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6100000000000001e-07 2024-09-17T02:21:32.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:32.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421657+0000", 2024-09-17T02:21:32.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7438999999999998e-05 2024-09-17T02:21:32.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:32.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421665+0000", 2024-09-17T02:21:32.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4840000000000004e-06 2024-09-17T02:21:32.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421671+0000", 2024-09-17T02:21:32.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5400000000000003e-06 2024-09-17T02:21:32.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:32.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.431714+0000", 2024-09-17T02:21:32.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0100432 2024-09-17T02:21:32.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:32.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.431841+0000", 2024-09-17T02:21:32.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000127138 2024-09-17T02:21:32.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:32.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.431970+0000", 2024-09-17T02:21:32.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012893900000000001 2024-09-17T02:21:32.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:32.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.436696+0000", 2024-09-17T02:21:32.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047262570000000002 2024-09-17T02:21:32.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:32.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.444604+0000", 2024-09-17T02:21:32.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079071479999999993 2024-09-17T02:21:32.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:32.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.444648+0000", 2024-09-17T02:21:32.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4941000000000002e-05 2024-09-17T02:21:32.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:32.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:32.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:32.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.444685+0000", 2024-09-17T02:21:32.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6276000000000003e-05 2024-09-17T02:21:32.426 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.426 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:32.426 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.426 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:32.426 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:32.426 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:32.428 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:32.297+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:32.428 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:32.429+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:32.428 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:32.471 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T02:21:32.528 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:32.530+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:32.566 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:32.566 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:32.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.566 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:127678 5.b 5:d1f84592:::benchmark_data_smithi001_23533_object127677:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:32.566 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:32.567865+0000", 2024-09-17T02:21:32.566 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0027690380000000001, 2024-09-17T02:21:32.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002798544, 2024-09-17T02:21:32.566 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:32.566 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:32.566 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:32.566 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:32.567 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:32.567 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:32.567 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 127678 2024-09-17T02:21:32.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.567 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:32.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:32.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.567865+0000", 2024-09-17T02:21:32.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:32.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.567865+0000", 2024-09-17T02:21:32.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:32.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.567872+0000", 2024-09-17T02:21:32.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7440000000000007e-06 2024-09-17T02:21:32.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:32.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.567948+0000", 2024-09-17T02:21:32.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5844000000000001e-05 2024-09-17T02:21:32.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:32.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.567971+0000", 2024-09-17T02:21:32.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2901e-05 2024-09-17T02:21:32.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.567979+0000", 2024-09-17T02:21:32.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9680000000000006e-06 2024-09-17T02:21:32.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:32.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.569707+0000", 2024-09-17T02:21:32.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001727871 2024-09-17T02:21:32.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:32.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.569832+0000", 2024-09-17T02:21:32.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012472500000000001 2024-09-17T02:21:32.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:32.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.570011+0000", 2024-09-17T02:21:32.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017955400000000001 2024-09-17T02:21:32.570 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.571 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:32.571 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.571 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:127677 5.8 e49/26 5:1719a3b5:::benchmark_data_smithi001_23533_object127676:head v 49'8102, mlcod=49'8099)", 2024-09-17T02:21:32.571 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:32.568372+0000", 2024-09-17T02:21:32.571 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0022612859999999999, 2024-09-17T02:21:32.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024157319999999999, 2024-09-17T02:21:32.571 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:32.571 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:32.571 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:32.571 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:32.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.572 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:32.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.568372+0000", 2024-09-17T02:21:32.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.572 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:32.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.568372+0000", 2024-09-17T02:21:32.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.572 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:32.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.568373+0000", 2024-09-17T02:21:32.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8700000000000005e-07 2024-09-17T02:21:32.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:32.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.568421+0000", 2024-09-17T02:21:32.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7451999999999999e-05 2024-09-17T02:21:32.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:32.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.568431+0000", 2024-09-17T02:21:32.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0481e-05 2024-09-17T02:21:32.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.568437+0000", 2024-09-17T02:21:32.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2779999999999999e-06 2024-09-17T02:21:32.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:32.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.568869+0000", 2024-09-17T02:21:32.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043123499999999997 2024-09-17T02:21:32.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:32.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.568882+0000", 2024-09-17T02:21:32.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3393e-05 2024-09-17T02:21:32.575 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.575 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:32.575 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.575 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:127679 5.a e49/22 5:52bb527d:::benchmark_data_smithi001_23533_object127678:head v 49'8040, mlcod=49'8037)", 2024-09-17T02:21:32.575 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:32.568848+0000", 2024-09-17T02:21:32.575 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0017857000000000001, 2024-09-17T02:21:32.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001974637, 2024-09-17T02:21:32.575 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:32.575 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:32.575 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:32.575 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:32.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:32.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.568848+0000", 2024-09-17T02:21:32.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:32.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.568848+0000", 2024-09-17T02:21:32.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:32.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.568849+0000", 2024-09-17T02:21:32.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3900000000000005e-07 2024-09-17T02:21:32.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:32.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.568876+0000", 2024-09-17T02:21:32.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7387000000000001e-05 2024-09-17T02:21:32.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:32.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.568886+0000", 2024-09-17T02:21:32.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8630000000000003e-06 2024-09-17T02:21:32.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.568892+0000", 2024-09-17T02:21:32.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0909999999999998e-06 2024-09-17T02:21:32.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:32.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.569669+0000", 2024-09-17T02:21:32.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077703799999999997 2024-09-17T02:21:32.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:32.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.569686+0000", 2024-09-17T02:21:32.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6833e-05 2024-09-17T02:21:32.578 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.579 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:32.579 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.579 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:127666 5.b e49/38)", 2024-09-17T02:21:32.579 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:32.569168+0000", 2024-09-17T02:21:32.579 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0014655600000000001, 2024-09-17T02:21:32.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001706089, 2024-09-17T02:21:32.579 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:32.579 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:32.579 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:32.579 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:32.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:32.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.569168+0000", 2024-09-17T02:21:32.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:32.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.569168+0000", 2024-09-17T02:21:32.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:32.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.569169+0000", 2024-09-17T02:21:32.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1399999999999997e-07 2024-09-17T02:21:32.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:32.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.569172+0000", 2024-09-17T02:21:32.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6569999999999999e-06 2024-09-17T02:21:32.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:32.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.569184+0000", 2024-09-17T02:21:32.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1671999999999999e-05 2024-09-17T02:21:32.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.569190+0000", 2024-09-17T02:21:32.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.285e-06 2024-09-17T02:21:32.582 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.582 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:32.582 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.582 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:127664 5.b e49/38)", 2024-09-17T02:21:32.582 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:32.570381+0000", 2024-09-17T02:21:32.582 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00025263899999999998, 2024-09-17T02:21:32.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00051795499999999996, 2024-09-17T02:21:32.582 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:32.583 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:32.583 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:32.583 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:32.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:32.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.570381+0000", 2024-09-17T02:21:32.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:32.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.570381+0000", 2024-09-17T02:21:32.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:32.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.570382+0000", 2024-09-17T02:21:32.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7199999999999998e-07 2024-09-17T02:21:32.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:32.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.570385+0000", 2024-09-17T02:21:32.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6500000000000002e-06 2024-09-17T02:21:32.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:32.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.570394+0000", 2024-09-17T02:21:32.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8859999999999993e-06 2024-09-17T02:21:32.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.570401+0000", 2024-09-17T02:21:32.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3799999999999999e-06 2024-09-17T02:21:32.585 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.585 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:32.585 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.586 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:127673 5.4 e49/36)", 2024-09-17T02:21:32.586 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:32.570579+0000", 2024-09-17T02:21:32.586 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.4276e-05, 2024-09-17T02:21:32.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034292099999999999, 2024-09-17T02:21:32.586 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:32.586 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:32.586 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:32.586 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:32.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:32.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.570579+0000", 2024-09-17T02:21:32.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:32.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.570579+0000", 2024-09-17T02:21:32.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:32.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.570580+0000", 2024-09-17T02:21:32.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3900000000000003e-07 2024-09-17T02:21:32.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:32.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.570586+0000", 2024-09-17T02:21:32.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4949999999999999e-06 2024-09-17T02:21:32.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:32.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.570600+0000", 2024-09-17T02:21:32.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4075e-05 2024-09-17T02:21:32.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.570606+0000", 2024-09-17T02:21:32.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9519999999999999e-06 2024-09-17T02:21:32.589 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.589 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:32.589 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.589 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:127682 5.4 5.df4d0b94 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:32.589 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:32.570777+0000", 2024-09-17T02:21:32.589 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4294967295.9998569, 2024-09-17T02:21:32.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017647299999999999, 2024-09-17T02:21:32.589 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:32.589 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:32.589 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:32.590 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:32.590 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:32.590 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:32.590 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 127682 2024-09-17T02:21:32.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.590 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:32.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:32.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.570777+0000", 2024-09-17T02:21:32.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:32.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.570777+0000", 2024-09-17T02:21:32.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:32.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.570778+0000", 2024-09-17T02:21:32.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1069999999999999e-06 2024-09-17T02:21:32.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:32.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.570870+0000", 2024-09-17T02:21:32.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2300999999999996e-05 2024-09-17T02:21:32.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:32.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.570881+0000", 2024-09-17T02:21:32.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0518e-05 2024-09-17T02:21:32.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.570888+0000", 2024-09-17T02:21:32.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8419999999999999e-06 2024-09-17T02:21:32.592 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.592 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:32.593 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.593 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:127664 5.b 5:d994c2c7:::benchmark_data_smithi001_23533_object127663:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:32.593 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:32.561918+0000", 2024-09-17T02:21:32.593 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0087158200000000009, 2024-09-17T02:21:32.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0090797450000000002, 2024-09-17T02:21:32.593 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:32.593 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:32.593 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:32.593 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:32.593 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:32.593 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:32.593 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 127664 2024-09-17T02:21:32.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.594 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:32.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:32.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.561918+0000", 2024-09-17T02:21:32.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:32.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.561918+0000", 2024-09-17T02:21:32.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:32.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.561919+0000", 2024-09-17T02:21:32.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.031e-06 2024-09-17T02:21:32.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:32.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.561956+0000", 2024-09-17T02:21:32.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6699000000000002e-05 2024-09-17T02:21:32.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:32.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.561965+0000", 2024-09-17T02:21:32.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6639999999999993e-06 2024-09-17T02:21:32.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.561972+0000", 2024-09-17T02:21:32.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7819999999999996e-06 2024-09-17T02:21:32.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:32.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.562066+0000", 2024-09-17T02:21:32.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4126e-05 2024-09-17T02:21:32.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:32.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.562190+0000", 2024-09-17T02:21:32.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012428 2024-09-17T02:21:32.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:32.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.562288+0000", 2024-09-17T02:21:32.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7869999999999996e-05 2024-09-17T02:21:32.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:32.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.566841+0000", 2024-09-17T02:21:32.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045524119999999996 2024-09-17T02:21:32.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:32.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.566857+0000", 2024-09-17T02:21:32.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6263999999999999e-05 2024-09-17T02:21:32.598 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.598 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:32.598 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.598 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:127665 5.b 5:d387841e:::benchmark_data_smithi001_23533_object127664:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:32.598 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:32.561992+0000", 2024-09-17T02:21:32.598 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.008642182, 2024-09-17T02:21:32.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0090549740000000004, 2024-09-17T02:21:32.598 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:32.599 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:32.599 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:32.599 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:32.599 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:32.599 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:32.599 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 127665 2024-09-17T02:21:32.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.599 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:32.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:32.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.561992+0000", 2024-09-17T02:21:32.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:32.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.561992+0000", 2024-09-17T02:21:32.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:32.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.561992+0000", 2024-09-17T02:21:32.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7700000000000004e-07 2024-09-17T02:21:32.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:32.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.562031+0000", 2024-09-17T02:21:32.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8455999999999999e-05 2024-09-17T02:21:32.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:32.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.562040+0000", 2024-09-17T02:21:32.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0450000000000006e-06 2024-09-17T02:21:32.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.562046+0000", 2024-09-17T02:21:32.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6370000000000002e-06 2024-09-17T02:21:32.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:32.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.564231+0000", 2024-09-17T02:21:32.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021847960000000001 2024-09-17T02:21:32.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:32.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.564394+0000", 2024-09-17T02:21:32.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016331599999999999 2024-09-17T02:21:32.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:32.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.564588+0000", 2024-09-17T02:21:32.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000193377 2024-09-17T02:21:32.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:32.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.566947+0000", 2024-09-17T02:21:32.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023594739999999999 2024-09-17T02:21:32.603 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.603 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:32.603 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.604 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:127666 5.b 5:d8e2c4bb:::benchmark_data_smithi001_23533_object127665:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:32.604 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:32.562060+0000", 2024-09-17T02:21:32.604 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0085737520000000005, 2024-09-17T02:21:32.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0090299079999999997, 2024-09-17T02:21:32.604 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:32.604 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:32.604 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:32.604 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:32.604 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:32.604 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:32.604 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 127666 2024-09-17T02:21:32.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.605 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:32.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:32.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.562060+0000", 2024-09-17T02:21:32.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:32.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.562060+0000", 2024-09-17T02:21:32.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:32.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.562061+0000", 2024-09-17T02:21:32.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2699999999999999e-07 2024-09-17T02:21:32.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:32.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.562117+0000", 2024-09-17T02:21:32.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6910000000000002e-05 2024-09-17T02:21:32.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:32.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.562126+0000", 2024-09-17T02:21:32.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3650000000000004e-06 2024-09-17T02:21:32.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.562132+0000", 2024-09-17T02:21:32.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2190000000000001e-06 2024-09-17T02:21:32.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:32.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.567034+0000", 2024-09-17T02:21:32.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049015350000000003 2024-09-17T02:21:32.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:32.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.567165+0000", 2024-09-17T02:21:32.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013103799999999999 2024-09-17T02:21:32.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:32.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.567325+0000", 2024-09-17T02:21:32.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016048399999999999 2024-09-17T02:21:32.609 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.609 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:32.610 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.610 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:127670 5.a e49/22 5:5916306a:::benchmark_data_smithi001_23533_object127669:head v 49'8039, mlcod=49'8036)", 2024-09-17T02:21:32.610 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:32.564936+0000", 2024-09-17T02:21:32.610 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0056976680000000004, 2024-09-17T02:21:32.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061924229999999999, 2024-09-17T02:21:32.610 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:32.610 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:32.610 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:32.610 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:32.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:32.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.564936+0000", 2024-09-17T02:21:32.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:32.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.564936+0000", 2024-09-17T02:21:32.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:32.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.564937+0000", 2024-09-17T02:21:32.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5700000000000002e-07 2024-09-17T02:21:32.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:32.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.565000+0000", 2024-09-17T02:21:32.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3006e-05 2024-09-17T02:21:32.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:32.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.565011+0000", 2024-09-17T02:21:32.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1453e-05 2024-09-17T02:21:32.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.565016+0000", 2024-09-17T02:21:32.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4340000000000002e-06 2024-09-17T02:21:32.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:32.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.565058+0000", 2024-09-17T02:21:32.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2626999999999997e-05 2024-09-17T02:21:32.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:32.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.565075+0000", 2024-09-17T02:21:32.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7244999999999998e-05 2024-09-17T02:21:32.613 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.613 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:32.613 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.614 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:127673 5.4 5:27614d82:::benchmark_data_smithi001_23533_object127672:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:32.614 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:32.566931+0000", 2024-09-17T02:21:32.614 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0037029739999999999, 2024-09-17T02:21:32.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042328729999999998, 2024-09-17T02:21:32.614 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:32.614 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:32.614 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:32.614 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:32.614 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:32.614 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:32.614 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 127673 2024-09-17T02:21:32.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.615 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:32.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:32.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.566931+0000", 2024-09-17T02:21:32.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:32.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.566931+0000", 2024-09-17T02:21:32.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:32.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.566932+0000", 2024-09-17T02:21:32.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4500000000000001e-06 2024-09-17T02:21:32.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:32.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.566992+0000", 2024-09-17T02:21:32.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9744999999999998e-05 2024-09-17T02:21:32.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:32.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.567004+0000", 2024-09-17T02:21:32.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1853e-05 2024-09-17T02:21:32.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.567011+0000", 2024-09-17T02:21:32.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6960000000000005e-06 2024-09-17T02:21:32.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:32.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.567364+0000", 2024-09-17T02:21:32.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035287099999999999 2024-09-17T02:21:32.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:32.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.567498+0000", 2024-09-17T02:21:32.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013346500000000001 2024-09-17T02:21:32.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:32.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.567656+0000", 2024-09-17T02:21:32.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015798299999999999 2024-09-17T02:21:32.618 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.618 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:32.618 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.618 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPushReply(5.4 49/36 [PushReplyOp(5:2f35e2e7:::benchmark_data_smithi001_23533_object121080:head)])", 2024-09-17T02:21:32.618 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:32.567554+0000", 2024-09-17T02:21:32.619 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0030797849999999998, 2024-09-17T02:21:32.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036467140000000001, 2024-09-17T02:21:32.619 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:32.619 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:32.619 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:32.619 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:32.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:32.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.567554+0000", 2024-09-17T02:21:32.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:32.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.567554+0000", 2024-09-17T02:21:32.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:32.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.567554+0000", 2024-09-17T02:21:32.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9900000000000002e-07 2024-09-17T02:21:32.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:32.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.567557+0000", 2024-09-17T02:21:32.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2799999999999999e-06 2024-09-17T02:21:32.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:32.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.567564+0000", 2024-09-17T02:21:32.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8210000000000004e-06 2024-09-17T02:21:32.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.567571+0000", 2024-09-17T02:21:32.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7259999999999996e-06 2024-09-17T02:21:32.621 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.621 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:32.621 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.621 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:127676 5.4 5:29d2dc15:::benchmark_data_smithi001_23533_object127675:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:32.621 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:32.567506+0000", 2024-09-17T02:21:32.621 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0031275220000000002, 2024-09-17T02:21:32.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037259179999999999, 2024-09-17T02:21:32.622 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:32.622 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:32.622 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:32.622 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:32.622 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:32.622 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:32.622 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 127676 2024-09-17T02:21:32.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.622 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:32.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:32.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.567506+0000", 2024-09-17T02:21:32.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:32.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.567506+0000", 2024-09-17T02:21:32.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:32.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:32.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.567507+0000", 2024-09-17T02:21:32.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8800000000000001e-07 2024-09-17T02:21:32.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:32.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.567586+0000", 2024-09-17T02:21:32.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9135999999999996e-05 2024-09-17T02:21:32.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:32.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.567598+0000", 2024-09-17T02:21:32.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2089999999999999e-05 2024-09-17T02:21:32.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:32.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.567606+0000", 2024-09-17T02:21:32.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8809999999999996e-06 2024-09-17T02:21:32.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:32.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.569809+0000", 2024-09-17T02:21:32.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022031889999999999 2024-09-17T02:21:32.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:32.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.569955+0000", 2024-09-17T02:21:32.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000145668 2024-09-17T02:21:32.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:32.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:32.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:32.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.570131+0000", 2024-09-17T02:21:32.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017575800000000001 2024-09-17T02:21:32.626 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.626 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:32.626 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.626 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:32.626 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:21:32.626 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 14 2024-09-17T02:21:32.626 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:32.627 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:32.628 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:32.630+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:32.669 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:21:32.731 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:32.729+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:32.775 INFO:tasks.radosbench.radosbench.0.smithi001.stdout:2024-09-17T02:21:32.778633+0000 min lat: 0.00147149 max lat: 2.22367 avg lat: 0.00748965 2024-09-17T02:21:32.775 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-17T02:21:32.776 INFO:tasks.radosbench.radosbench.0.smithi001.stdout: 60 1 128114 128113 133.436 120.75 0.00646937 0.00748965 2024-09-17T02:21:32.779 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:32.779 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:21:32.779 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:21:32.779 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:21:32.779 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:32.794 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:32.813 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:21:32.813 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:21:32.830 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:32.830+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:32.832 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:21:32.832 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:21:32.851 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2: {} 2024-09-17T02:21:32.851 INFO:teuthology.orchestra.run.smithi001.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T02:21:32.931 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:32.933+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:32.972 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:32.972 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:32.986 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:33.032 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:33.033+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:33.110 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:33.110 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:33.123 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:33.133 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:33.133+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:33.234 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:33.237+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:33.236 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:33.236 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:33.250 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:33.335 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:33.337+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:33.356 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:33.356 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:33.370 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:33.435 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:33.441+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:33.457 INFO:teuthology.orchestra.run.smithi001.stderr:nodeep-scrub is set 2024-09-17T02:21:33.517 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:33.517 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:33.535 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:33.584 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:33.589+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:33.638 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:33.642+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:33.723 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:33.723 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:33.739 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:33.740 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:33.738+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:33.775 INFO:tasks.radosbench.radosbench.0.smithi001.stdout:Total time run: 60.0078 2024-09-17T02:21:33.776 INFO:tasks.radosbench.radosbench.0.smithi001.stdout:Total writes made: 128114 2024-09-17T02:21:33.776 INFO:tasks.radosbench.radosbench.0.smithi001.stdout:Write size: 65536 2024-09-17T02:21:33.776 INFO:tasks.radosbench.radosbench.0.smithi001.stdout:Object size: 65536 2024-09-17T02:21:33.776 INFO:tasks.radosbench.radosbench.0.smithi001.stdout:Bandwidth (MB/sec): 133.435 2024-09-17T02:21:33.776 INFO:tasks.radosbench.radosbench.0.smithi001.stdout:Stddev Bandwidth: 48.5594 2024-09-17T02:21:33.776 INFO:tasks.radosbench.radosbench.0.smithi001.stdout:Max bandwidth (MB/sec): 247.125 2024-09-17T02:21:33.776 INFO:tasks.radosbench.radosbench.0.smithi001.stdout:Min bandwidth (MB/sec): 0 2024-09-17T02:21:33.776 INFO:tasks.radosbench.radosbench.0.smithi001.stdout:Average IOPS: 2134 2024-09-17T02:21:33.776 INFO:tasks.radosbench.radosbench.0.smithi001.stdout:Stddev IOPS: 776.973 2024-09-17T02:21:33.776 INFO:tasks.radosbench.radosbench.0.smithi001.stdout:Max IOPS: 3954 2024-09-17T02:21:33.776 INFO:tasks.radosbench.radosbench.0.smithi001.stdout:Min IOPS: 0 2024-09-17T02:21:33.776 INFO:tasks.radosbench.radosbench.0.smithi001.stdout:Average Latency(s): 0.00748967 2024-09-17T02:21:33.776 INFO:tasks.radosbench.radosbench.0.smithi001.stdout:Stddev Latency(s): 0.0345879 2024-09-17T02:21:33.777 INFO:tasks.radosbench.radosbench.0.smithi001.stdout:Max latency(s): 2.22367 2024-09-17T02:21:33.777 INFO:tasks.radosbench.radosbench.0.smithi001.stdout:Min latency(s): 0.00147149 2024-09-17T02:21:33.786 INFO:tasks.radosbench.radosbench.0.smithi001.stdout:Cleaning up (deleting benchmark objects) 2024-09-17T02:21:33.839 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:33.842+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:33.888 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:33.888 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:33.910 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:33.956 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:33.958+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:34.041 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:34.042+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:34.071 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:34.071 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:34.093 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:34.105 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-17T02:21:34.142 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:34.145+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:34.216 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-09-17T02:21:34.243 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:34.246+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:34.286 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:34.286 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:34.305 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:34.345 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:34.349+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:34.446 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:34.449+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:34.498 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:34.498 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:34.512 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:34.556 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:34.561+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:34.631 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:34.631 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:34.645 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:34.648 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:34.650+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:34.749 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:34.753+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:34.805 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:34.805 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:34.819 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:34.850 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:34.850+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:34.869 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:21:34.951 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:34.953+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:34.984 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:34.985 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:34.999 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:35.029 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:21:35.029 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:21:35.049 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:21:35.050 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:21:35.050 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:21:35.051 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:35.054+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:35.054 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:21:35.055 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:21:35.133 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:35.133 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:21:35.133 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-17T02:21:35.133 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:35.147 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:35.187 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:35.190+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:35.254 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:35.257+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:35.306 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:35.306 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:21:35.307 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:21:35.307 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:21:35.307 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:35.321 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:35.354 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:35.357+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:35.449 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:35.450 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:21:35.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:21:35.450 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:35.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.450 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:35.450 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:35.450 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.888721715000003, 2024-09-17T02:21:35.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023664803000000002, 2024-09-17T02:21:35.450 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:35.450 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:35.450 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:35.450 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:35.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:35.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:35.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:35.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:35.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:35.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562313+0000", 2024-09-17T02:21:35.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.764e-06 2024-09-17T02:21:35.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:35.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562323+0000", 2024-09-17T02:21:35.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0166000000000001e-05 2024-09-17T02:21:35.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:35.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562343+0000", 2024-09-17T02:21:35.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9633999999999999e-05 2024-09-17T02:21:35.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562367+0000", 2024-09-17T02:21:35.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4556e-05 2024-09-17T02:21:35.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:35.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563777+0000", 2024-09-17T02:21:35.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014102330000000001 2024-09-17T02:21:35.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:35.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563969+0000", 2024-09-17T02:21:35.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000191361 2024-09-17T02:21:35.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:35.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564148+0000", 2024-09-17T02:21:35.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017934599999999999 2024-09-17T02:21:35.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:35.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566989+0000", 2024-09-17T02:21:35.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028407010000000002 2024-09-17T02:21:35.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:35.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585770+0000", 2024-09-17T02:21:35.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018781566999999999 2024-09-17T02:21:35.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:35.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585874+0000", 2024-09-17T02:21:35.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103489 2024-09-17T02:21:35.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:35.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585976+0000", 2024-09-17T02:21:35.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101986 2024-09-17T02:21:35.455 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.455 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:35.455 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.456 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:35.456 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:35.456 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.888638834999995, 2024-09-17T02:21:35.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024118555999999999, 2024-09-17T02:21:35.456 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:35.456 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:35.456 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:35.457 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:35.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:35.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:35.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:35.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:35.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:35.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562395+0000", 2024-09-17T02:21:35.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3969999999999999e-06 2024-09-17T02:21:35.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:35.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562405+0000", 2024-09-17T02:21:35.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4229999999999994e-06 2024-09-17T02:21:35.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:35.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562427+0000", 2024-09-17T02:21:35.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759999999999998e-05 2024-09-17T02:21:35.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562444+0000", 2024-09-17T02:21:35.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7019000000000001e-05 2024-09-17T02:21:35.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:35.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564681+0000", 2024-09-17T02:21:35.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022376929999999998 2024-09-17T02:21:35.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:35.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564887+0000", 2024-09-17T02:21:35.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000206178 2024-09-17T02:21:35.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:35.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565230+0000", 2024-09-17T02:21:35.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034233499999999998 2024-09-17T02:21:35.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:35.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567000+0000", 2024-09-17T02:21:35.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017706390000000001 2024-09-17T02:21:35.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:35.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586126+0000", 2024-09-17T02:21:35.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019125672 2024-09-17T02:21:35.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:35.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586314+0000", 2024-09-17T02:21:35.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018740200000000001 2024-09-17T02:21:35.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:35.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586513+0000", 2024-09-17T02:21:35.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019903799999999999 2024-09-17T02:21:35.462 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.462 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:35.462 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.462 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:35.462 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:35.462 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 52.882569730999997, 2024-09-17T02:21:35.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:21:35.463 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:35.463 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:35.463 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:35.463 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:35.463 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:35.463 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:35.463 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:21:35.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.463 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:35.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:35.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:35.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:35.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:35.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:35.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:21:35.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:21:35.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:35.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:21:35.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:21:35.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:35.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:21:35.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:21:35.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:21:35.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:21:35.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:35.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:21:35.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:21:35.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:35.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:21:35.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:21:35.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:35.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:21:35.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:21:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:21:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:21:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:21:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:21:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:21:35.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:21:35.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:35.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:21:35.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:21:35.468 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.468 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:35.468 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.468 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:35.468 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 52.878667481000001, 2024-09-17T02:21:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:21:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:21:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:35.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:35.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:35.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:35.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:35.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:21:35.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:21:35.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:35.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:21:35.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:21:35.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:35.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:21:35.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:21:35.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:21:35.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:21:35.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:35.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:21:35.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:21:35.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:35.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:21:35.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:21:35.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:35.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:21:35.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:21:35.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:35.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:21:35.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:21:35.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:35.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:21:35.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:21:35.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:35.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:21:35.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:21:35.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:35.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:21:35.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:21:35.474 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.474 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:35.474 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.474 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71190 5.3 e39/38 5:c99e0ae2:::benchmark_data_smithi001_23533_object71189:head v 39'4516, mlcod=35'4513)", 2024-09-17T02:21:35.474 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.607413+0000", 2024-09-17T02:21:35.475 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.843619456999999, 2024-09-17T02:21:35.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023407462, 2024-09-17T02:21:35.475 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:35.475 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:35.475 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:35.475 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:35.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:35.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607413+0000", 2024-09-17T02:21:35.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:35.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607413+0000", 2024-09-17T02:21:35.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:35.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607415+0000", 2024-09-17T02:21:35.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2139999999999999e-06 2024-09-17T02:21:35.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:35.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607479+0000", 2024-09-17T02:21:35.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4374000000000004e-05 2024-09-17T02:21:35.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:35.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607496+0000", 2024-09-17T02:21:35.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6820000000000002e-05 2024-09-17T02:21:35.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607512+0000", 2024-09-17T02:21:35.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5976000000000001e-05 2024-09-17T02:21:35.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:35.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609288+0000", 2024-09-17T02:21:35.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001776311 2024-09-17T02:21:35.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:35.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609327+0000", 2024-09-17T02:21:35.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9165999999999997e-05 2024-09-17T02:21:35.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:35.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630723+0000", 2024-09-17T02:21:35.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021395290000000001 2024-09-17T02:21:35.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:35.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630821+0000", 2024-09-17T02:21:35.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8311000000000001e-05 2024-09-17T02:21:35.479 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.479 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:35.479 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.479 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71206 5.3 e39/38 5:c6c9386d:::benchmark_data_smithi001_23533_object71205:head v 39'4517, mlcod=35'4513)", 2024-09-17T02:21:35.479 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:35.479 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.841340366000001, 2024-09-17T02:21:35.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026101868, 2024-09-17T02:21:35.479 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:35.480 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:35.480 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:35.480 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:35.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:35.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:35.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:35.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:35.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:35.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609694+0000", 2024-09-17T02:21:35.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9539999999999998e-06 2024-09-17T02:21:35.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:35.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609841+0000", 2024-09-17T02:21:35.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014690800000000001 2024-09-17T02:21:35.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:35.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609872+0000", 2024-09-17T02:21:35.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0326000000000001e-05 2024-09-17T02:21:35.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609892+0000", 2024-09-17T02:21:35.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9848999999999999e-05 2024-09-17T02:21:35.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:35.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613826+0000", 2024-09-17T02:21:35.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039345140000000001 2024-09-17T02:21:35.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:35.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613908+0000", 2024-09-17T02:21:35.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2412999999999999e-05 2024-09-17T02:21:35.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:35.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635696+0000", 2024-09-17T02:21:35.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021787597999999998 2024-09-17T02:21:35.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:35.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635794+0000", 2024-09-17T02:21:35.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8306000000000004e-05 2024-09-17T02:21:35.484 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.484 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:35.484 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.484 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71210 5.3 e39/38 5:c0498d13:::benchmark_data_smithi001_23533_object71209:head v 39'4518, mlcod=35'4513)", 2024-09-17T02:21:35.484 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:35.484 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.839862400000001, 2024-09-17T02:21:35.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024703197, 2024-09-17T02:21:35.484 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:35.484 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:35.484 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:35.485 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:35.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:35.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:35.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:35.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:35.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:35.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611172+0000", 2024-09-17T02:21:35.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6470000000000001e-06 2024-09-17T02:21:35.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:35.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611344+0000", 2024-09-17T02:21:35.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000171607 2024-09-17T02:21:35.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:35.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611389+0000", 2024-09-17T02:21:35.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5738000000000002e-05 2024-09-17T02:21:35.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611407+0000", 2024-09-17T02:21:35.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7893e-05 2024-09-17T02:21:35.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:35.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617820+0000", 2024-09-17T02:21:35.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064131070000000004 2024-09-17T02:21:35.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:35.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617885+0000", 2024-09-17T02:21:35.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4442000000000004e-05 2024-09-17T02:21:35.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:35.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635806+0000", 2024-09-17T02:21:35.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017920874999999999 2024-09-17T02:21:35.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:35.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635874+0000", 2024-09-17T02:21:35.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7887999999999998e-05 2024-09-17T02:21:35.488 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.488 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:35.488 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.489 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71213 5.3 e39/38 5:ce9071a1:::benchmark_data_smithi001_23533_object71212:head v 39'4519, mlcod=35'4513)", 2024-09-17T02:21:35.489 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.613453+0000", 2024-09-17T02:21:35.489 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.837579889000001, 2024-09-17T02:21:35.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022494631000000001, 2024-09-17T02:21:35.489 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:35.489 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:35.489 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:35.489 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:35.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:35.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613453+0000", 2024-09-17T02:21:35.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:35.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613453+0000", 2024-09-17T02:21:35.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:35.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613455+0000", 2024-09-17T02:21:35.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.703e-06 2024-09-17T02:21:35.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:35.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613594+0000", 2024-09-17T02:21:35.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000139405 2024-09-17T02:21:35.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:35.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613625+0000", 2024-09-17T02:21:35.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0993e-05 2024-09-17T02:21:35.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613646+0000", 2024-09-17T02:21:35.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0761999999999999e-05 2024-09-17T02:21:35.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:35.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.620855+0000", 2024-09-17T02:21:35.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0072088270000000001 2024-09-17T02:21:35.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:35.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.620933+0000", 2024-09-17T02:21:35.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8807000000000006e-05 2024-09-17T02:21:35.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:35.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635882+0000", 2024-09-17T02:21:35.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014948530999999999 2024-09-17T02:21:35.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:35.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635948+0000", 2024-09-17T02:21:35.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5603000000000002e-05 2024-09-17T02:21:35.493 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.493 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:35.493 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.493 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71214 5.3 e39/38 5:c5e24f3f:::benchmark_data_smithi001_23533_object71213:head v 39'4520, mlcod=35'4513)", 2024-09-17T02:21:35.493 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:35.494 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.835498168000001, 2024-09-17T02:21:35.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024251297000000002, 2024-09-17T02:21:35.494 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:35.494 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:35.494 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:35.494 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:35.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:35.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:35.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:35.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:35.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:35.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615536+0000", 2024-09-17T02:21:35.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5370000000000001e-06 2024-09-17T02:21:35.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:35.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615696+0000", 2024-09-17T02:21:35.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015948700000000001 2024-09-17T02:21:35.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:35.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615723+0000", 2024-09-17T02:21:35.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7518999999999999e-05 2024-09-17T02:21:35.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615742+0000", 2024-09-17T02:21:35.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8519999999999999e-05 2024-09-17T02:21:35.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:35.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.624440+0000", 2024-09-17T02:21:35.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0086983080000000001 2024-09-17T02:21:35.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:35.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.624489+0000", 2024-09-17T02:21:35.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8838000000000002e-05 2024-09-17T02:21:35.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:35.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639673+0000", 2024-09-17T02:21:35.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01518451 2024-09-17T02:21:35.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:35.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639786+0000", 2024-09-17T02:21:35.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011257800000000001 2024-09-17T02:21:35.498 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.498 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:35.498 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.498 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71215 5.3 e39/38 5:c5603662:::benchmark_data_smithi001_23533_object71214:head v 39'4521, mlcod=35'4513)", 2024-09-17T02:21:35.498 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.617466+0000", 2024-09-17T02:21:35.498 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.833567188, 2024-09-17T02:21:35.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022395379999999999, 2024-09-17T02:21:35.498 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:35.499 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:35.499 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:35.499 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:35.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:35.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617466+0000", 2024-09-17T02:21:35.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:35.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617466+0000", 2024-09-17T02:21:35.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:35.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617467+0000", 2024-09-17T02:21:35.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3600000000000002e-07 2024-09-17T02:21:35.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:35.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617521+0000", 2024-09-17T02:21:35.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4654999999999998e-05 2024-09-17T02:21:35.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:35.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617548+0000", 2024-09-17T02:21:35.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6706000000000001e-05 2024-09-17T02:21:35.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617566+0000", 2024-09-17T02:21:35.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7989e-05 2024-09-17T02:21:35.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:35.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.627598+0000", 2024-09-17T02:21:35.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010031854 2024-09-17T02:21:35.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:35.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.627656+0000", 2024-09-17T02:21:35.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8511999999999998e-05 2024-09-17T02:21:35.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:35.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639794+0000", 2024-09-17T02:21:35.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012137445 2024-09-17T02:21:35.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:35.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639861+0000", 2024-09-17T02:21:35.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7282999999999999e-05 2024-09-17T02:21:35.503 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.503 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:35.503 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.503 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97147 5.0 5:02d17bf7:::benchmark_data_smithi001_23533_object97146:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:35.503 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268128+0000", 2024-09-17T02:21:35.503 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.182904424, 2024-09-17T02:21:35.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022726434, 2024-09-17T02:21:35.503 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:35.503 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:35.503 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:35.503 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:35.504 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:35.504 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:35.504 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97147 2024-09-17T02:21:35.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.504 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:35.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:35.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268128+0000", 2024-09-17T02:21:35.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:35.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268128+0000", 2024-09-17T02:21:35.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:35.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268129+0000", 2024-09-17T02:21:35.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5700000000000001e-07 2024-09-17T02:21:35.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:35.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268194+0000", 2024-09-17T02:21:35.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4731000000000001e-05 2024-09-17T02:21:35.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:35.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268202+0000", 2024-09-17T02:21:35.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7950000000000008e-06 2024-09-17T02:21:35.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268207+0000", 2024-09-17T02:21:35.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8550000000000001e-06 2024-09-17T02:21:35.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:35.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268694+0000", 2024-09-17T02:21:35.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00048752799999999998 2024-09-17T02:21:35.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:35.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268768+0000", 2024-09-17T02:21:35.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3638000000000002e-05 2024-09-17T02:21:35.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:35.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268842+0000", 2024-09-17T02:21:35.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3928000000000001e-05 2024-09-17T02:21:35.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:35.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.285598+0000", 2024-09-17T02:21:35.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016756436 2024-09-17T02:21:35.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:35.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290771+0000", 2024-09-17T02:21:35.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051724789999999998 2024-09-17T02:21:35.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:35.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290817+0000", 2024-09-17T02:21:35.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6220999999999997e-05 2024-09-17T02:21:35.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:35.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290855+0000", 2024-09-17T02:21:35.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7966000000000002e-05 2024-09-17T02:21:35.509 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.509 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:35.509 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.509 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97148 5.5 5:a643b955:::benchmark_data_smithi001_23533_object97147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:35.509 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268218+0000", 2024-09-17T02:21:35.509 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.182815040000001, 2024-09-17T02:21:35.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022628112999999998, 2024-09-17T02:21:35.510 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:35.510 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:35.510 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:35.510 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:35.510 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:35.510 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:35.510 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97148 2024-09-17T02:21:35.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.510 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:35.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:35.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268218+0000", 2024-09-17T02:21:35.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:35.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268218+0000", 2024-09-17T02:21:35.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:35.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268218+0000", 2024-09-17T02:21:35.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.53e-07 2024-09-17T02:21:35.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:35.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268300+0000", 2024-09-17T02:21:35.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2219999999999995e-05 2024-09-17T02:21:35.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:35.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268306+0000", 2024-09-17T02:21:35.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8989999999999998e-06 2024-09-17T02:21:35.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268310+0000", 2024-09-17T02:21:35.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6610000000000002e-06 2024-09-17T02:21:35.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:35.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268354+0000", 2024-09-17T02:21:35.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3782000000000002e-05 2024-09-17T02:21:35.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:35.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268452+0000", 2024-09-17T02:21:35.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8339999999999997e-05 2024-09-17T02:21:35.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:35.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268536+0000", 2024-09-17T02:21:35.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3931999999999995e-05 2024-09-17T02:21:35.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:35.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.286252+0000", 2024-09-17T02:21:35.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017715740000000001 2024-09-17T02:21:35.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:35.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290758+0000", 2024-09-17T02:21:35.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045060940000000004 2024-09-17T02:21:35.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:35.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290801+0000", 2024-09-17T02:21:35.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2818000000000002e-05 2024-09-17T02:21:35.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:35.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290846+0000", 2024-09-17T02:21:35.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5274000000000001e-05 2024-09-17T02:21:35.515 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.515 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:35.515 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.516 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97151 5.5 5:a0c2c072:::benchmark_data_smithi001_23533_object97150:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:35.516 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:35.516 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.182660759000001, 2024-09-17T02:21:35.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027297614000000001, 2024-09-17T02:21:35.516 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:35.516 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:35.516 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:35.516 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:35.516 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:35.516 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:35.516 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97151 2024-09-17T02:21:35.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.516 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:35.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:35.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:35.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:35.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:35.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:35.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268373+0000", 2024-09-17T02:21:35.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4000000000000002e-07 2024-09-17T02:21:35.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:35.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268423+0000", 2024-09-17T02:21:35.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0175e-05 2024-09-17T02:21:35.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:35.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268428+0000", 2024-09-17T02:21:35.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-17T02:21:35.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268431+0000", 2024-09-17T02:21:35.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.179e-06 2024-09-17T02:21:35.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:35.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283631+0000", 2024-09-17T02:21:35.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015199691 2024-09-17T02:21:35.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:35.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283740+0000", 2024-09-17T02:21:35.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109305 2024-09-17T02:21:35.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:35.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283863+0000", 2024-09-17T02:21:35.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012226699999999999 2024-09-17T02:21:35.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:35.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290857+0000", 2024-09-17T02:21:35.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069945449999999996 2024-09-17T02:21:35.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:35.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295595+0000", 2024-09-17T02:21:35.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047376750000000002 2024-09-17T02:21:35.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:35.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295638+0000", 2024-09-17T02:21:35.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3671999999999998e-05 2024-09-17T02:21:35.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:35.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295670+0000", 2024-09-17T02:21:35.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1266000000000002e-05 2024-09-17T02:21:35.521 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.522 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:35.522 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.522 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97248 5.c 5:3796bec5:::benchmark_data_smithi001_23533_object97247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:35.522 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.327358+0000", 2024-09-17T02:21:35.522 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.123674516000001, 2024-09-17T02:21:35.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022963006000000001, 2024-09-17T02:21:35.522 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:35.522 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:35.522 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:35.522 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:35.522 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:35.522 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:35.523 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97248 2024-09-17T02:21:35.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.523 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:35.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:35.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327358+0000", 2024-09-17T02:21:35.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:35.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327358+0000", 2024-09-17T02:21:35.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:35.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327359+0000", 2024-09-17T02:21:35.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5699999999999998e-07 2024-09-17T02:21:35.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:35.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327382+0000", 2024-09-17T02:21:35.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3458000000000001e-05 2024-09-17T02:21:35.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:35.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327387+0000", 2024-09-17T02:21:35.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6149999999999999e-06 2024-09-17T02:21:35.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327391+0000", 2024-09-17T02:21:35.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8999999999999999e-06 2024-09-17T02:21:35.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:35.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.332084+0000", 2024-09-17T02:21:35.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046935240000000001 2024-09-17T02:21:35.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:35.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.332216+0000", 2024-09-17T02:21:35.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131798 2024-09-17T02:21:35.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:35.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.332352+0000", 2024-09-17T02:21:35.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013587500000000001 2024-09-17T02:21:35.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:35.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.338559+0000", 2024-09-17T02:21:35.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0062075510000000004 2024-09-17T02:21:35.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:35.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350237+0000", 2024-09-17T02:21:35.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011677121 2024-09-17T02:21:35.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:35.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350287+0000", 2024-09-17T02:21:35.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0080999999999997e-05 2024-09-17T02:21:35.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:35.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350321+0000", 2024-09-17T02:21:35.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4625999999999997e-05 2024-09-17T02:21:35.528 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.528 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:35.528 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.528 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97251 5.c 5:382be9a3:::benchmark_data_smithi001_23533_object97250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:35.528 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.328203+0000", 2024-09-17T02:21:35.528 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.122830279999999, 2024-09-17T02:21:35.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022268999000000001, 2024-09-17T02:21:35.529 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:35.529 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:35.529 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:35.529 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:35.529 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:35.529 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:35.529 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97251 2024-09-17T02:21:35.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.529 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:35.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:35.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328203+0000", 2024-09-17T02:21:35.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:35.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328203+0000", 2024-09-17T02:21:35.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:35.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328203+0000", 2024-09-17T02:21:35.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3699999999999999e-07 2024-09-17T02:21:35.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:35.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328319+0000", 2024-09-17T02:21:35.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011560100000000001 2024-09-17T02:21:35.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:35.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328332+0000", 2024-09-17T02:21:35.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2978e-05 2024-09-17T02:21:35.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.328340+0000", 2024-09-17T02:21:35.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4680000000000003e-06 2024-09-17T02:21:35.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:35.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.335525+0000", 2024-09-17T02:21:35.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0071852399999999999 2024-09-17T02:21:35.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:35.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.335650+0000", 2024-09-17T02:21:35.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012522299999999999 2024-09-17T02:21:35.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:35.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.335732+0000", 2024-09-17T02:21:35.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1582999999999995e-05 2024-09-17T02:21:35.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:35.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.346944+0000", 2024-09-17T02:21:35.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011211936 2024-09-17T02:21:35.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:35.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350332+0000", 2024-09-17T02:21:35.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033884140000000002 2024-09-17T02:21:35.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:35.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350433+0000", 2024-09-17T02:21:35.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010115600000000001 2024-09-17T02:21:35.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:35.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350472+0000", 2024-09-17T02:21:35.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8463000000000001e-05 2024-09-17T02:21:35.534 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.534 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:35.534 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.534 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97759 5.a 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:35.534 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:35.535 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.852647657999999, 2024-09-17T02:21:35.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.089694871999999995, 2024-09-17T02:21:35.535 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:35.535 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:35.535 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:35.535 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:35.535 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:35.535 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:35.535 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97759 2024-09-17T02:21:35.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.535 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:35.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:35.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:35.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:35.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:35.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:35.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598386+0000", 2024-09-17T02:21:35.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999999e-07 2024-09-17T02:21:35.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:35.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598414+0000", 2024-09-17T02:21:35.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8013000000000001e-05 2024-09-17T02:21:35.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:35.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598420+0000", 2024-09-17T02:21:35.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1149999999999999e-06 2024-09-17T02:21:35.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598424+0000", 2024-09-17T02:21:35.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:21:35.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:35.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598479+0000", 2024-09-17T02:21:35.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4648999999999998e-05 2024-09-17T02:21:35.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:35.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598587+0000", 2024-09-17T02:21:35.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010853000000000001 2024-09-17T02:21:35.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:35.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598676+0000", 2024-09-17T02:21:35.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8381999999999995e-05 2024-09-17T02:21:35.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:35.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603766+0000", 2024-09-17T02:21:35.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050902559999999996 2024-09-17T02:21:35.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:35.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.687988+0000", 2024-09-17T02:21:35.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.084221753999999996 2024-09-17T02:21:35.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:35.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688037+0000", 2024-09-17T02:21:35.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-05 2024-09-17T02:21:35.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:35.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688080+0000", 2024-09-17T02:21:35.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3149999999999999e-05 2024-09-17T02:21:35.540 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.540 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:35.540 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.540 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97770 5.0 5:09c75033:::benchmark_data_smithi001_23533_object97769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:35.540 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:35.540 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.847505227999999, 2024-09-17T02:21:35.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.086380868, 2024-09-17T02:21:35.541 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:35.541 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:35.541 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:35.541 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:35.541 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:35.541 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:35.541 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97770 2024-09-17T02:21:35.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.541 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:35.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:35.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:35.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:35.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:35.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:35.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603529+0000", 2024-09-17T02:21:35.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:21:35.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:35.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603593+0000", 2024-09-17T02:21:35.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4216999999999999e-05 2024-09-17T02:21:35.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:35.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603603+0000", 2024-09-17T02:21:35.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5179999999999993e-06 2024-09-17T02:21:35.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603608+0000", 2024-09-17T02:21:35.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2039999999999996e-06 2024-09-17T02:21:35.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:35.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603653+0000", 2024-09-17T02:21:35.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5247000000000002e-05 2024-09-17T02:21:35.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:35.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603758+0000", 2024-09-17T02:21:35.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105352 2024-09-17T02:21:35.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:35.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603900+0000", 2024-09-17T02:21:35.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014198999999999999 2024-09-17T02:21:35.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:35.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.606097+0000", 2024-09-17T02:21:35.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021969839999999999 2024-09-17T02:21:35.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:35.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689756+0000", 2024-09-17T02:21:35.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.083659077999999998 2024-09-17T02:21:35.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:35.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689846+0000", 2024-09-17T02:21:35.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9320999999999994e-05 2024-09-17T02:21:35.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:35.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689908+0000", 2024-09-17T02:21:35.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720999999999998e-05 2024-09-17T02:21:35.546 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.546 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:35.546 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.547 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:101263 5.0 5:01bcc612:::benchmark_data_smithi001_23533_object101262:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T02:21:35.547 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:19.421619+0000", 2024-09-17T02:21:35.547 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.029414007, 2024-09-17T02:21:35.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023065922999999999, 2024-09-17T02:21:35.547 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:35.547 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:35.547 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:35.547 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:35.547 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:35.547 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:35.547 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 101263 2024-09-17T02:21:35.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.547 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:35.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:35.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421619+0000", 2024-09-17T02:21:35.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:35.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421619+0000", 2024-09-17T02:21:35.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:35.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421619+0000", 2024-09-17T02:21:35.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6100000000000001e-07 2024-09-17T02:21:35.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:35.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421657+0000", 2024-09-17T02:21:35.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7438999999999998e-05 2024-09-17T02:21:35.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:35.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421665+0000", 2024-09-17T02:21:35.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4840000000000004e-06 2024-09-17T02:21:35.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421671+0000", 2024-09-17T02:21:35.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5400000000000003e-06 2024-09-17T02:21:35.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:35.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.431714+0000", 2024-09-17T02:21:35.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0100432 2024-09-17T02:21:35.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:35.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.431841+0000", 2024-09-17T02:21:35.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000127138 2024-09-17T02:21:35.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:35.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.431970+0000", 2024-09-17T02:21:35.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012893900000000001 2024-09-17T02:21:35.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:35.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.436696+0000", 2024-09-17T02:21:35.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047262570000000002 2024-09-17T02:21:35.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:35.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.444604+0000", 2024-09-17T02:21:35.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079071479999999993 2024-09-17T02:21:35.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:35.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.444648+0000", 2024-09-17T02:21:35.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4941000000000002e-05 2024-09-17T02:21:35.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:35.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.444685+0000", 2024-09-17T02:21:35.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6276000000000003e-05 2024-09-17T02:21:35.552 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.553 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:35.553 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.553 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127513 5.c 5:3eca08e4:::benchmark_data_smithi001_23533_object127512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:35.553 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:21:35.553 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.0067288040000002, 2024-09-17T02:21:35.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046626399999999998, 2024-09-17T02:21:35.553 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:35.553 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:35.553 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:35.553 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:35.553 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:35.554 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:35.554 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127513 2024-09-17T02:21:35.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.554 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:35.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:35.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:21:35.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:35.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:21:35.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:35.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444305+0000", 2024-09-17T02:21:35.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2529999999999999e-06 2024-09-17T02:21:35.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:35.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444466+0000", 2024-09-17T02:21:35.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016069700000000001 2024-09-17T02:21:35.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:35.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444479+0000", 2024-09-17T02:21:35.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2602999999999999e-05 2024-09-17T02:21:35.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444485+0000", 2024-09-17T02:21:35.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.669e-06 2024-09-17T02:21:35.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:35.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444560+0000", 2024-09-17T02:21:35.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4276999999999994e-05 2024-09-17T02:21:35.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:35.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444656+0000", 2024-09-17T02:21:35.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6490000000000006e-05 2024-09-17T02:21:35.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.557 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:35.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444739+0000", 2024-09-17T02:21:35.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3139999999999993e-05 2024-09-17T02:21:35.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:35.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.448438+0000", 2024-09-17T02:21:35.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036985490000000002 2024-09-17T02:21:35.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:35.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490732+0000", 2024-09-17T02:21:35.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042294353999999999 2024-09-17T02:21:35.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:35.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490859+0000", 2024-09-17T02:21:35.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012708899999999999 2024-09-17T02:21:35.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:35.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490930+0000", 2024-09-17T02:21:35.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:21:35.559 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.559 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:35.559 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.559 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127514 5.c 5:39cc1feb:::benchmark_data_smithi001_23533_object127513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:35.559 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:35.560 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.0065320350000002, 2024-09-17T02:21:35.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049357228000000003, 2024-09-17T02:21:35.560 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:35.560 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:35.560 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:35.560 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:35.560 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:35.560 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:35.560 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127514 2024-09-17T02:21:35.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.560 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:35.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:35.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:35.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:35.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:35.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:35.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:35.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:35.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8599999999999998e-07 2024-09-17T02:21:35.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:35.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444554+0000", 2024-09-17T02:21:35.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3047999999999998e-05 2024-09-17T02:21:35.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:35.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444562+0000", 2024-09-17T02:21:35.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5830000000000001e-06 2024-09-17T02:21:35.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444567+0000", 2024-09-17T02:21:35.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4179999999999996e-06 2024-09-17T02:21:35.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:35.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446566+0000", 2024-09-17T02:21:35.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001998788 2024-09-17T02:21:35.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:35.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446696+0000", 2024-09-17T02:21:35.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129393 2024-09-17T02:21:35.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:35.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446794+0000", 2024-09-17T02:21:35.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8462999999999996e-05 2024-09-17T02:21:35.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:35.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.449036+0000", 2024-09-17T02:21:35.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022415880000000001 2024-09-17T02:21:35.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:35.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493737+0000", 2024-09-17T02:21:35.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044701682 2024-09-17T02:21:35.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:35.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493808+0000", 2024-09-17T02:21:35.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0846000000000006e-05 2024-09-17T02:21:35.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:35.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:35.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:35.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493858+0000", 2024-09-17T02:21:35.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9932999999999998e-05 2024-09-17T02:21:35.565 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.565 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:35.565 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.565 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:35.565 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:35.565 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:35.566 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T02:21:35.568 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:35.566+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:35.568 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:35.667 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:35.670+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:35.727 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:35.727 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:35.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129462 5.4 5.68335074 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:21:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.195818823, 2024-09-17T02:21:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.19585070800000001, 2024-09-17T02:21:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129462 2024-09-17T02:21:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:21:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:21:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:35.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534943+0000", 2024-09-17T02:21:35.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8759999999999999e-06 2024-09-17T02:21:35.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:35.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534951+0000", 2024-09-17T02:21:35.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3219999999999993e-06 2024-09-17T02:21:35.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:35.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534977+0000", 2024-09-17T02:21:35.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6245e-05 2024-09-17T02:21:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534992+0000", 2024-09-17T02:21:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4936000000000001e-05 2024-09-17T02:21:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535133+0000", 2024-09-17T02:21:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014051299999999999 2024-09-17T02:21:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:21:35.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1741000000000001e-05 2024-09-17T02:21:35.732 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.732 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:35.732 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.732 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.1 e 52/52 lb 5:85f21572:::benchmark_data_smithi001_23533_object102673:head)", 2024-09-17T02:21:35.732 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.730125+0000", 2024-09-17T02:21:35.732 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.000634805, 2024-09-17T02:21:35.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066520100000000003, 2024-09-17T02:21:35.732 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:35.732 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:35.732 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.730125+0000", 2024-09-17T02:21:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.730125+0000", 2024-09-17T02:21:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.730125+0000", 2024-09-17T02:21:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3600000000000003e-07 2024-09-17T02:21:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.730137+0000", 2024-09-17T02:21:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1568e-05 2024-09-17T02:21:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.730152+0000", 2024-09-17T02:21:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5068e-05 2024-09-17T02:21:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.730164+0000", 2024-09-17T02:21:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1473e-05 2024-09-17T02:21:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.730693+0000", 2024-09-17T02:21:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052992399999999998 2024-09-17T02:21:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.730711+0000", 2024-09-17T02:21:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7260000000000001e-05 2024-09-17T02:21:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.730790+0000", 2024-09-17T02:21:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9271999999999996e-05 2024-09-17T02:21:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129537 5.4 5.63e4c064 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:21:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.15248915499999999, 2024-09-17T02:21:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.15277338300000001, 2024-09-17T02:21:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129537 2024-09-17T02:21:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:21:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:21:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578272+0000", 2024-09-17T02:21:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.164e-06 2024-09-17T02:21:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578278+0000", 2024-09-17T02:21:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5060000000000001e-06 2024-09-17T02:21:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578294+0000", 2024-09-17T02:21:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5687000000000001e-05 2024-09-17T02:21:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578329+0000", 2024-09-17T02:21:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5311999999999997e-05 2024-09-17T02:21:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578419+0000", 2024-09-17T02:21:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0054000000000002e-05 2024-09-17T02:21:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578435+0000", 2024-09-17T02:21:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5645999999999999e-05 2024-09-17T02:21:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129505 5.4 5.e374f294 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:21:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.16905118399999999, 2024-09-17T02:21:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.16945882100000001, 2024-09-17T02:21:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129505 2024-09-17T02:21:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:21:35.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:35.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:21:35.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:35.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561710+0000", 2024-09-17T02:21:35.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7060000000000001e-06 2024-09-17T02:21:35.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561718+0000", 2024-09-17T02:21:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.542e-06 2024-09-17T02:21:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561741+0000", 2024-09-17T02:21:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3357e-05 2024-09-17T02:21:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561754+0000", 2024-09-17T02:21:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3200000000000001e-05 2024-09-17T02:21:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561867+0000", 2024-09-17T02:21:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113211 2024-09-17T02:21:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561888+0000", 2024-09-17T02:21:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0809999999999999e-05 2024-09-17T02:21:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129508 5.4 5.41ad4914 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:21:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.16771409100000001, 2024-09-17T02:21:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.16829203200000001, 2024-09-17T02:21:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:35.746 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129508 2024-09-17T02:21:35.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.746 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:35.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:35.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:21:35.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:35.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:21:35.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:35.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563047+0000", 2024-09-17T02:21:35.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.274e-06 2024-09-17T02:21:35.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:35.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563054+0000", 2024-09-17T02:21:35.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2799999999999998e-06 2024-09-17T02:21:35.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:35.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563070+0000", 2024-09-17T02:21:35.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5991999999999999e-05 2024-09-17T02:21:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563078+0000", 2024-09-17T02:21:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2390000000000002e-06 2024-09-17T02:21:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563181+0000", 2024-09-17T02:21:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102249 2024-09-17T02:21:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563199+0000", 2024-09-17T02:21:35.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8215000000000001e-05 2024-09-17T02:21:35.749 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.749 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:35.749 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.749 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129509 5.4 5.7a8aac34 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:35.749 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:21:35.749 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.16708703799999999, 2024-09-17T02:21:35.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.16775422000000001, 2024-09-17T02:21:35.749 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:35.749 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:35.749 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129509 2024-09-17T02:21:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:21:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:21:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563674+0000", 2024-09-17T02:21:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0920000000000001e-06 2024-09-17T02:21:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563679+0000", 2024-09-17T02:21:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7660000000000004e-06 2024-09-17T02:21:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563693+0000", 2024-09-17T02:21:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3139000000000001e-05 2024-09-17T02:21:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563701+0000", 2024-09-17T02:21:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9859999999999994e-06 2024-09-17T02:21:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563775+0000", 2024-09-17T02:21:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4659000000000005e-05 2024-09-17T02:21:35.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:35.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563785+0000", 2024-09-17T02:21:35.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4839999999999993e-06 2024-09-17T02:21:35.753 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.753 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:35.753 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.753 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129545 5.4 5.91266c44 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:35.753 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:21:35.754 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.146626432, 2024-09-17T02:21:35.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.14737930099999999, 2024-09-17T02:21:35.754 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:35.754 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:35.754 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:35.754 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:35.754 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:35.754 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:35.754 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129545 2024-09-17T02:21:35.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.754 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:35.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:35.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:21:35.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:35.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:21:35.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:35.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584135+0000", 2024-09-17T02:21:35.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4699999999999999e-06 2024-09-17T02:21:35.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584142+0000", 2024-09-17T02:21:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1620000000000002e-06 2024-09-17T02:21:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584170+0000", 2024-09-17T02:21:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7897000000000001e-05 2024-09-17T02:21:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584183+0000", 2024-09-17T02:21:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2814e-05 2024-09-17T02:21:35.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:35.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584299+0000", 2024-09-17T02:21:35.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116153 2024-09-17T02:21:35.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:35.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584316+0000", 2024-09-17T02:21:35.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7524999999999999e-05 2024-09-17T02:21:35.758 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.758 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:35.758 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.758 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129480 5.4 5.d19cb8d4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:35.758 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:21:35.758 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.18806435699999999, 2024-09-17T02:21:35.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.18890590400000001, 2024-09-17T02:21:35.759 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:35.759 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:35.759 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:35.759 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:35.759 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:35.759 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:35.759 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129480 2024-09-17T02:21:35.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.759 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:35.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:35.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:21:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:21:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542696+0000", 2024-09-17T02:21:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9999999999999995e-07 2024-09-17T02:21:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542701+0000", 2024-09-17T02:21:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2240000000000003e-06 2024-09-17T02:21:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542716+0000", 2024-09-17T02:21:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4970000000000001e-05 2024-09-17T02:21:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542726+0000", 2024-09-17T02:21:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2879999999999998e-06 2024-09-17T02:21:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542832+0000", 2024-09-17T02:21:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010597199999999999 2024-09-17T02:21:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542843+0000", 2024-09-17T02:21:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.098e-05 2024-09-17T02:21:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129603 5.4 5.17a555a4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.103371956, 2024-09-17T02:21:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.10429896700000001, 2024-09-17T02:21:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129603 2024-09-17T02:21:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:21:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627392+0000", 2024-09-17T02:21:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0790000000000002e-06 2024-09-17T02:21:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627403+0000", 2024-09-17T02:21:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0866000000000001e-05 2024-09-17T02:21:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627409+0000", 2024-09-17T02:21:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.305e-06 2024-09-17T02:21:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627485+0000", 2024-09-17T02:21:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6582000000000006e-05 2024-09-17T02:21:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627499+0000", 2024-09-17T02:21:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:21:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129553 5.4 5.2b58274 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:21:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.14120379599999999, 2024-09-17T02:21:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.142216962, 2024-09-17T02:21:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129553 2024-09-17T02:21:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:21:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:21:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589557+0000", 2024-09-17T02:21:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2219999999999999e-06 2024-09-17T02:21:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589562+0000", 2024-09-17T02:21:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0649999999999998e-06 2024-09-17T02:21:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589575+0000", 2024-09-17T02:21:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3129000000000001e-05 2024-09-17T02:21:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589584+0000", 2024-09-17T02:21:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6200000000000005e-06 2024-09-17T02:21:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589693+0000", 2024-09-17T02:21:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109319 2024-09-17T02:21:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589714+0000", 2024-09-17T02:21:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0849999999999999e-05 2024-09-17T02:21:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129607 5.4 5.78f1c6f4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:21:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.10184505000000001, 2024-09-17T02:21:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.10294337100000001, 2024-09-17T02:21:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129607 2024-09-17T02:21:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:21:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:21:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628916+0000", 2024-09-17T02:21:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1710000000000001e-06 2024-09-17T02:21:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628920+0000", 2024-09-17T02:21:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-17T02:21:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628935+0000", 2024-09-17T02:21:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4474000000000001e-05 2024-09-17T02:21:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628944+0000", 2024-09-17T02:21:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9940000000000006e-06 2024-09-17T02:21:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628997+0000", 2024-09-17T02:21:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3579000000000003e-05 2024-09-17T02:21:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.629006+0000", 2024-09-17T02:21:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4009999999999997e-06 2024-09-17T02:21:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129623 5.4 5.d2e8af34 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:21:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.077900763999999997, 2024-09-17T02:21:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.079085642999999997, 2024-09-17T02:21:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129623 2024-09-17T02:21:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:21:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:21:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652860+0000", 2024-09-17T02:21:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0330000000000001e-06 2024-09-17T02:21:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652864+0000", 2024-09-17T02:21:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.634e-06 2024-09-17T02:21:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652877+0000", 2024-09-17T02:21:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2591e-05 2024-09-17T02:21:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652883+0000", 2024-09-17T02:21:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1460000000000001e-06 2024-09-17T02:21:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652943+0000", 2024-09-17T02:21:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9833999999999997e-05 2024-09-17T02:21:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652950+0000", 2024-09-17T02:21:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.401e-06 2024-09-17T02:21:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129524 5.4 5.bbe53ba4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:21:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.16039568400000001, 2024-09-17T02:21:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.16166577200000001, 2024-09-17T02:21:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129524 2024-09-17T02:21:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:21:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:21:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570365+0000", 2024-09-17T02:21:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.142e-06 2024-09-17T02:21:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570369+0000", 2024-09-17T02:21:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.856e-06 2024-09-17T02:21:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570385+0000", 2024-09-17T02:21:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5855e-05 2024-09-17T02:21:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570392+0000", 2024-09-17T02:21:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5340000000000002e-06 2024-09-17T02:21:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570484+0000", 2024-09-17T02:21:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1212999999999996e-05 2024-09-17T02:21:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570498+0000", 2024-09-17T02:21:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4331000000000001e-05 2024-09-17T02:21:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129580 5.4 5.de11b7a4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:21:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.119431752, 2024-09-17T02:21:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.120786476, 2024-09-17T02:21:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129580 2024-09-17T02:21:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:21:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:21:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611329+0000", 2024-09-17T02:21:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.22e-06 2024-09-17T02:21:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611335+0000", 2024-09-17T02:21:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1129999999999997e-06 2024-09-17T02:21:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611348+0000", 2024-09-17T02:21:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2342e-05 2024-09-17T02:21:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611356+0000", 2024-09-17T02:21:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.371e-06 2024-09-17T02:21:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611419+0000", 2024-09-17T02:21:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3393999999999996e-05 2024-09-17T02:21:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611427+0000", 2024-09-17T02:21:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999997e-06 2024-09-17T02:21:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129649 5.4 5.a0e47f4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:21:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.015107857000000001, 2024-09-17T02:21:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016553139000000001, 2024-09-17T02:21:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129649 2024-09-17T02:21:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:21:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:21:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715653+0000", 2024-09-17T02:21:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3519999999999999e-06 2024-09-17T02:21:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715658+0000", 2024-09-17T02:21:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3120000000000001e-06 2024-09-17T02:21:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715677+0000", 2024-09-17T02:21:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-17T02:21:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715687+0000", 2024-09-17T02:21:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0146000000000001e-05 2024-09-17T02:21:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715821+0000", 2024-09-17T02:21:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013421 2024-09-17T02:21:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715840+0000", 2024-09-17T02:21:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8153999999999999e-05 2024-09-17T02:21:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129642 5.4 5.69ed7aa4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:21:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.046664600000000001, 2024-09-17T02:21:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.048195376999999998, 2024-09-17T02:21:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129642 2024-09-17T02:21:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:21:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:21:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684096+0000", 2024-09-17T02:21:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659999999999999e-06 2024-09-17T02:21:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684101+0000", 2024-09-17T02:21:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8110000000000002e-06 2024-09-17T02:21:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684114+0000", 2024-09-17T02:21:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2653000000000001e-05 2024-09-17T02:21:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684121+0000", 2024-09-17T02:21:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5100000000000001e-06 2024-09-17T02:21:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684181+0000", 2024-09-17T02:21:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0307999999999999e-05 2024-09-17T02:21:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684194+0000", 2024-09-17T02:21:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2916e-05 2024-09-17T02:21:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:21:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 16 2024-09-17T02:21:35.797 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:35.798 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:35.799 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:35.798+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:35.899 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:35.902+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:35.940 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:35.941 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:21:35.941 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:21:35.941 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:21:35.941 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:35.956 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:36.000 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:36.002+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:36.096 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:36.097 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:21:36.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:21:36.097 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:36.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.097 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:36.097 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:21:36.097 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 79.541286846000006, 2024-09-17T02:21:36.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035535028000000003, 2024-09-17T02:21:36.097 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:36.097 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:36.097 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.098 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:36.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:36.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:21:36.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:36.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556547+0000", 2024-09-17T02:21:36.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:36.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556550+0000", 2024-09-17T02:21:36.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3500000000000001e-06 2024-09-17T02:21:36.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:36.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556566+0000", 2024-09-17T02:21:36.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5440000000000001e-05 2024-09-17T02:21:36.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:36.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556594+0000", 2024-09-17T02:21:36.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8552999999999999e-05 2024-09-17T02:21:36.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.556618+0000", 2024-09-17T02:21:36.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3207e-05 2024-09-17T02:21:36.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:36.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578337+0000", 2024-09-17T02:21:36.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021719517000000001 2024-09-17T02:21:36.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:36.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.578655+0000", 2024-09-17T02:21:36.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031837800000000002 2024-09-17T02:21:36.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:36.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.581374+0000", 2024-09-17T02:21:36.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002718238 2024-09-17T02:21:36.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:36.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587083+0000", 2024-09-17T02:21:36.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005708912 2024-09-17T02:21:36.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591823+0000", 2024-09-17T02:21:36.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047406080000000003 2024-09-17T02:21:36.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:36.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.591972+0000", 2024-09-17T02:21:36.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014874199999999999 2024-09-17T02:21:36.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:36.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592082+0000", 2024-09-17T02:21:36.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110083 2024-09-17T02:21:36.102 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.103 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:36.103 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.103 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:36.103 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:21:36.103 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 79.540345359, 2024-09-17T02:21:36.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.035128756999999997, 2024-09-17T02:21:36.103 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:36.103 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:36.103 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.103 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:36.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:36.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:21:36.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:36.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557488+0000", 2024-09-17T02:21:36.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:36.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557491+0000", 2024-09-17T02:21:36.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.88e-06 2024-09-17T02:21:36.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:36.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557504+0000", 2024-09-17T02:21:36.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2864000000000001e-05 2024-09-17T02:21:36.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:36.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557535+0000", 2024-09-17T02:21:36.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0916e-05 2024-09-17T02:21:36.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557561+0000", 2024-09-17T02:21:36.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5602999999999999e-05 2024-09-17T02:21:36.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:36.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582290+0000", 2024-09-17T02:21:36.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024729729999999998 2024-09-17T02:21:36.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:36.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582642+0000", 2024-09-17T02:21:36.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035143499999999999 2024-09-17T02:21:36.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:36.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582959+0000", 2024-09-17T02:21:36.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031747399999999999 2024-09-17T02:21:36.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:36.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587302+0000", 2024-09-17T02:21:36.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043425169999999997 2024-09-17T02:21:36.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592391+0000", 2024-09-17T02:21:36.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050895799999999998 2024-09-17T02:21:36.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:36.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592516+0000", 2024-09-17T02:21:36.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012420500000000001 2024-09-17T02:21:36.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:36.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592617+0000", 2024-09-17T02:21:36.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010155299999999999 2024-09-17T02:21:36.108 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.109 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:36.109 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.109 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:36.109 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:21:36.109 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 79.540240859999997, 2024-09-17T02:21:36.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034796066, 2024-09-17T02:21:36.110 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:36.110 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:36.110 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.110 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:36.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:36.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:21:36.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:36.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557593+0000", 2024-09-17T02:21:36.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:36.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557594+0000", 2024-09-17T02:21:36.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3769999999999999e-06 2024-09-17T02:21:36.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:36.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557683+0000", 2024-09-17T02:21:36.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8896999999999999e-05 2024-09-17T02:21:36.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557707+0000", 2024-09-17T02:21:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3839e-05 2024-09-17T02:21:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.557730+0000", 2024-09-17T02:21:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3047000000000001e-05 2024-09-17T02:21:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582329+0000", 2024-09-17T02:21:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024599283999999999 2024-09-17T02:21:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582624+0000", 2024-09-17T02:21:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000294462 2024-09-17T02:21:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.582936+0000", 2024-09-17T02:21:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031223399999999999 2024-09-17T02:21:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.587347+0000", 2024-09-17T02:21:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044110340000000003 2024-09-17T02:21:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592165+0000", 2024-09-17T02:21:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048176699999999996 2024-09-17T02:21:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592311+0000", 2024-09-17T02:21:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014661899999999999 2024-09-17T02:21:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592389+0000", 2024-09-17T02:21:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7602999999999995e-05 2024-09-17T02:21:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:21:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 79.539723233000004, 2024-09-17T02:21:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034457472000000003, 2024-09-17T02:21:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:21:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558111+0000", 2024-09-17T02:21:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558113+0000", 2024-09-17T02:21:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1639999999999999e-06 2024-09-17T02:21:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558125+0000", 2024-09-17T02:21:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2269999999999999e-05 2024-09-17T02:21:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558458+0000", 2024-09-17T02:21:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033322700000000001 2024-09-17T02:21:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558488+0000", 2024-09-17T02:21:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.951e-05 2024-09-17T02:21:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584514+0000", 2024-09-17T02:21:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026025721000000002 2024-09-17T02:21:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584781+0000", 2024-09-17T02:21:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000267142 2024-09-17T02:21:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585078+0000", 2024-09-17T02:21:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029738799999999999 2024-09-17T02:21:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588045+0000", 2024-09-17T02:21:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029673759999999999 2024-09-17T02:21:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592454+0000", 2024-09-17T02:21:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044090209999999999 2024-09-17T02:21:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592520+0000", 2024-09-17T02:21:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6032999999999996e-05 2024-09-17T02:21:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592568+0000", 2024-09-17T02:21:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7620000000000001e-05 2024-09-17T02:21:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:21:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 79.539081766999999, 2024-09-17T02:21:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034114029999999997, 2024-09-17T02:21:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:21:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558752+0000", 2024-09-17T02:21:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558753+0000", 2024-09-17T02:21:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2699999999999999e-06 2024-09-17T02:21:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558769+0000", 2024-09-17T02:21:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5906e-05 2024-09-17T02:21:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558791+0000", 2024-09-17T02:21:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1342999999999999e-05 2024-09-17T02:21:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.558806+0000", 2024-09-17T02:21:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5829999999999999e-05 2024-09-17T02:21:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.584906+0000", 2024-09-17T02:21:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026099273999999999 2024-09-17T02:21:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585158+0000", 2024-09-17T02:21:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025194600000000002 2024-09-17T02:21:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.585368+0000", 2024-09-17T02:21:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210068 2024-09-17T02:21:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.588098+0000", 2024-09-17T02:21:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002730522 2024-09-17T02:21:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592680+0000", 2024-09-17T02:21:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045816019999999997 2024-09-17T02:21:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592774+0000", 2024-09-17T02:21:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3726000000000004e-05 2024-09-17T02:21:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:20:16.592866+0000", 2024-09-17T02:21:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2542999999999998e-05 2024-09-17T02:21:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97749 5.b 5:d930ef52:::benchmark_data_smithi001_23533_object97748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.505887547, 2024-09-17T02:21:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092964343000000005, 2024-09-17T02:21:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97749 2024-09-17T02:21:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591947+0000", 2024-09-17T02:21:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:21:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592011+0000", 2024-09-17T02:21:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3608000000000005e-05 2024-09-17T02:21:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592021+0000", 2024-09-17T02:21:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9979999999999998e-06 2024-09-17T02:21:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592028+0000", 2024-09-17T02:21:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1439999999999997e-06 2024-09-17T02:21:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593633+0000", 2024-09-17T02:21:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001604636 2024-09-17T02:21:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593757+0000", 2024-09-17T02:21:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012432099999999999 2024-09-17T02:21:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593866+0000", 2024-09-17T02:21:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109094 2024-09-17T02:21:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601190+0000", 2024-09-17T02:21:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073237620000000002 2024-09-17T02:21:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601356+0000", 2024-09-17T02:21:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016651900000000001 2024-09-17T02:21:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684618+0000", 2024-09-17T02:21:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083261356999999994 2024-09-17T02:21:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684724+0000", 2024-09-17T02:21:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010681800000000001 2024-09-17T02:21:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684911+0000", 2024-09-17T02:21:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186243 2024-09-17T02:21:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97752 5.b 5:d146f486:::benchmark_data_smithi001_23533_object97751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.504534852999999, 2024-09-17T02:21:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091989557, 2024-09-17T02:21:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97752 2024-09-17T02:21:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593300+0000", 2024-09-17T02:21:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8199999999999998e-07 2024-09-17T02:21:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593364+0000", 2024-09-17T02:21:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3831999999999995e-05 2024-09-17T02:21:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593376+0000", 2024-09-17T02:21:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1800999999999999e-05 2024-09-17T02:21:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593382+0000", 2024-09-17T02:21:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6780000000000003e-06 2024-09-17T02:21:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595491+0000", 2024-09-17T02:21:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021090689999999999 2024-09-17T02:21:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595614+0000", 2024-09-17T02:21:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012321500000000001 2024-09-17T02:21:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595778+0000", 2024-09-17T02:21:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016321900000000001 2024-09-17T02:21:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601197+0000", 2024-09-17T02:21:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054195600000000003 2024-09-17T02:21:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601396+0000", 2024-09-17T02:21:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019825299999999999 2024-09-17T02:21:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684990+0000", 2024-09-17T02:21:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083594878999999997 2024-09-17T02:21:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685116+0000", 2024-09-17T02:21:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012522799999999999 2024-09-17T02:21:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685289+0000", 2024-09-17T02:21:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172941 2024-09-17T02:21:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97754 5.b 5:da0615e5:::benchmark_data_smithi001_23533_object97753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.502896930999999, 2024-09-17T02:21:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092097207, 2024-09-17T02:21:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97754 2024-09-17T02:21:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594938+0000", 2024-09-17T02:21:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5000000000000002e-07 2024-09-17T02:21:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595075+0000", 2024-09-17T02:21:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137742 2024-09-17T02:21:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595087+0000", 2024-09-17T02:21:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1243000000000001e-05 2024-09-17T02:21:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595095+0000", 2024-09-17T02:21:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1030000000000002e-06 2024-09-17T02:21:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598461+0000", 2024-09-17T02:21:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033661170000000001 2024-09-17T02:21:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598540+0000", 2024-09-17T02:21:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8937999999999995e-05 2024-09-17T02:21:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598626+0000", 2024-09-17T02:21:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6042000000000001e-05 2024-09-17T02:21:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684258+0000", 2024-09-17T02:21:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085632394000000001 2024-09-17T02:21:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685369+0000", 2024-09-17T02:21:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001111063 2024-09-17T02:21:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685511+0000", 2024-09-17T02:21:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141965 2024-09-17T02:21:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685604+0000", 2024-09-17T02:21:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2935000000000004e-05 2024-09-17T02:21:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687034+0000", 2024-09-17T02:21:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001430015 2024-09-17T02:21:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97755 5.b 5:d36a03a1:::benchmark_data_smithi001_23533_object97754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.502723781, 2024-09-17T02:21:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0924904, 2024-09-17T02:21:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97755 2024-09-17T02:21:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595111+0000", 2024-09-17T02:21:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:21:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595145+0000", 2024-09-17T02:21:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3927000000000002e-05 2024-09-17T02:21:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595155+0000", 2024-09-17T02:21:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0023e-05 2024-09-17T02:21:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595162+0000", 2024-09-17T02:21:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3950000000000003e-06 2024-09-17T02:21:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599821+0000", 2024-09-17T02:21:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046592880000000001 2024-09-17T02:21:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599912+0000", 2024-09-17T02:21:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1049000000000002e-05 2024-09-17T02:21:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600062+0000", 2024-09-17T02:21:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015001700000000001 2024-09-17T02:21:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685307+0000", 2024-09-17T02:21:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085244340000000002 2024-09-17T02:21:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685446+0000", 2024-09-17T02:21:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013955700000000001 2024-09-17T02:21:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687375+0000", 2024-09-17T02:21:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019291079999999999 2024-09-17T02:21:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687462+0000", 2024-09-17T02:21:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6148000000000003e-05 2024-09-17T02:21:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687600+0000", 2024-09-17T02:21:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013887900000000001 2024-09-17T02:21:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPush(5.3 44/38 [PushOp(5:c45b310d:::benchmark_data_smithi001_23533_object73736:head, version: 39'4672, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(5:c45b310d:::benchmark_data_smithi001_23533_object73736:head@39'4672, size: 65536, copy_subset: [(0, 65536)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 65536, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-17T02:21:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597100+0000", 2024-09-17T02:21:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.500733661000002, 2024-09-17T02:21:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.089325374999999999, 2024-09-17T02:21:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597100+0000", 2024-09-17T02:21:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597100+0000", 2024-09-17T02:21:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597101+0000", 2024-09-17T02:21:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4899999999999995e-07 2024-09-17T02:21:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597155+0000", 2024-09-17T02:21:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4466999999999999e-05 2024-09-17T02:21:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597174+0000", 2024-09-17T02:21:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8393000000000002e-05 2024-09-17T02:21:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597189+0000", 2024-09-17T02:21:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5716999999999999e-05 2024-09-17T02:21:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684442+0000", 2024-09-17T02:21:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.087252918999999998 2024-09-17T02:21:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684479+0000", 2024-09-17T02:21:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6902e-05 2024-09-17T02:21:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.686426+0000", 2024-09-17T02:21:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001946328 2024-09-17T02:21:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 44/44 lb 5:c4567a04:::benchmark_data_smithi001_23533_object4200:head)", 2024-09-17T02:21:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.500627155, 2024-09-17T02:21:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092483421999999996, 2024-09-17T02:21:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6399999999999998e-07 2024-09-17T02:21:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597213+0000", 2024-09-17T02:21:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3659999999999997e-06 2024-09-17T02:21:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597222+0000", 2024-09-17T02:21:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0510000000000002e-06 2024-09-17T02:21:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597228+0000", 2024-09-17T02:21:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1569999999999999e-06 2024-09-17T02:21:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689588+0000", 2024-09-17T02:21:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092359931000000006 2024-09-17T02:21:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689622+0000", 2024-09-17T02:21:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4425999999999999e-05 2024-09-17T02:21:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689690+0000", 2024-09-17T02:21:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8126999999999993e-05 2024-09-17T02:21:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:97759 5.a e44/22 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head v 44'6175, mlcod=44'6173)", 2024-09-17T02:21:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.599333+0000", 2024-09-17T02:21:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.498500934999999, 2024-09-17T02:21:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088908582, 2024-09-17T02:21:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599333+0000", 2024-09-17T02:21:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599333+0000", 2024-09-17T02:21:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599334+0000", 2024-09-17T02:21:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6700000000000003e-07 2024-09-17T02:21:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599503+0000", 2024-09-17T02:21:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0001693 2024-09-17T02:21:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599510+0000", 2024-09-17T02:21:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0469999999999996e-06 2024-09-17T02:21:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599514+0000", 2024-09-17T02:21:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0069999999999999e-06 2024-09-17T02:21:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599559+0000", 2024-09-17T02:21:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4697999999999998e-05 2024-09-17T02:21:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599570+0000", 2024-09-17T02:21:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1042e-05 2024-09-17T02:21:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.688181+0000", 2024-09-17T02:21:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088611756999999999 2024-09-17T02:21:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.688242+0000", 2024-09-17T02:21:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0064e-05 2024-09-17T02:21:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97762 5.4 5:2c64abcd:::benchmark_data_smithi001_23533_object97761:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.599394+0000", 2024-09-17T02:21:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.498439399999999, 2024-09-17T02:21:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088655857000000005, 2024-09-17T02:21:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97762 2024-09-17T02:21:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599394+0000", 2024-09-17T02:21:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599394+0000", 2024-09-17T02:21:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599395+0000", 2024-09-17T02:21:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.85e-07 2024-09-17T02:21:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599442+0000", 2024-09-17T02:21:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6964e-05 2024-09-17T02:21:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599454+0000", 2024-09-17T02:21:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1841999999999999e-05 2024-09-17T02:21:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599459+0000", 2024-09-17T02:21:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1000000000000003e-06 2024-09-17T02:21:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599511+0000", 2024-09-17T02:21:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1814999999999998e-05 2024-09-17T02:21:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599627+0000", 2024-09-17T02:21:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116087 2024-09-17T02:21:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599716+0000", 2024-09-17T02:21:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9174999999999999e-05 2024-09-17T02:21:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687757+0000", 2024-09-17T02:21:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088040361999999997 2024-09-17T02:21:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687778+0000", 2024-09-17T02:21:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1229e-05 2024-09-17T02:21:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687833+0000", 2024-09-17T02:21:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4928e-05 2024-09-17T02:21:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687916+0000", 2024-09-17T02:21:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3175000000000002e-05 2024-09-17T02:21:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.688050+0000", 2024-09-17T02:21:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013429499999999999 2024-09-17T02:21:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPushReply(5.4 44/36 [PushReplyOp(5:291a38c7:::benchmark_data_smithi001_23533_object22817:head)])", 2024-09-17T02:21:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.599945+0000", 2024-09-17T02:21:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.497888635999999, 2024-09-17T02:21:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.084468808000000006, 2024-09-17T02:21:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-17T02:21:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599945+0000", 2024-09-17T02:21:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599945+0000", 2024-09-17T02:21:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599945+0000", 2024-09-17T02:21:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1e-07 2024-09-17T02:21:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599949+0000", 2024-09-17T02:21:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2849999999999999e-06 2024-09-17T02:21:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599956+0000", 2024-09-17T02:21:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3640000000000001e-06 2024-09-17T02:21:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599962+0000", 2024-09-17T02:21:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2360000000000001e-06 2024-09-17T02:21:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601282+0000", 2024-09-17T02:21:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001319808 2024-09-17T02:21:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684414+0000", 2024-09-17T02:21:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083131905000000006 2024-09-17T02:21:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:97761 5.9 e44/22 5:908717b6:::benchmark_data_smithi001_23533_object97760:head v 44'6129, mlcod=44'6125)", 2024-09-17T02:21:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.599983+0000", 2024-09-17T02:21:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.497850847999999, 2024-09-17T02:21:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091911272000000002, 2024-09-17T02:21:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599983+0000", 2024-09-17T02:21:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599983+0000", 2024-09-17T02:21:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599983+0000", 2024-09-17T02:21:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1100000000000002e-07 2024-09-17T02:21:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600085+0000", 2024-09-17T02:21:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102007 2024-09-17T02:21:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600094+0000", 2024-09-17T02:21:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1850000000000004e-06 2024-09-17T02:21:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600099+0000", 2024-09-17T02:21:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6640000000000003e-06 2024-09-17T02:21:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600140+0000", 2024-09-17T02:21:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0998999999999998e-05 2024-09-17T02:21:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600157+0000", 2024-09-17T02:21:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7122999999999999e-05 2024-09-17T02:21:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.691795+0000", 2024-09-17T02:21:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091638002999999996 2024-09-17T02:21:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.691894+0000", 2024-09-17T02:21:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8980000000000004e-05 2024-09-17T02:21:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:97749 5.b e44/38 ondisk, result = 0)", 2024-09-17T02:21:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.600115+0000", 2024-09-17T02:21:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.497718854999999, 2024-09-17T02:21:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.084148770999999997, 2024-09-17T02:21:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600115+0000", 2024-09-17T02:21:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600115+0000", 2024-09-17T02:21:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600115+0000", 2024-09-17T02:21:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.39e-07 2024-09-17T02:21:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600119+0000", 2024-09-17T02:21:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3060000000000002e-06 2024-09-17T02:21:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600125+0000", 2024-09-17T02:21:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3330000000000002e-06 2024-09-17T02:21:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600130+0000", 2024-09-17T02:21:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8999999999999997e-06 2024-09-17T02:21:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601349+0000", 2024-09-17T02:21:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012192209999999999 2024-09-17T02:21:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601353+0000", 2024-09-17T02:21:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9149999999999998e-06 2024-09-17T02:21:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684264+0000", 2024-09-17T02:21:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.082910757000000002 2024-09-17T02:21:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:97754 5.b e44/38 ondisk, result = 0)", 2024-09-17T02:21:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.601431+0000", 2024-09-17T02:21:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.496402699000001, 2024-09-17T02:21:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085620499000000003, 2024-09-17T02:21:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601431+0000", 2024-09-17T02:21:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601431+0000", 2024-09-17T02:21:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601432+0000", 2024-09-17T02:21:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8400000000000004e-07 2024-09-17T02:21:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601435+0000", 2024-09-17T02:21:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9969999999999999e-06 2024-09-17T02:21:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684720+0000", 2024-09-17T02:21:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083285740999999996 2024-09-17T02:21:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684750+0000", 2024-09-17T02:21:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9632999999999999e-05 2024-09-17T02:21:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685492+0000", 2024-09-17T02:21:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00074159699999999998 2024-09-17T02:21:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685503+0000", 2024-09-17T02:21:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1294999999999999e-05 2024-09-17T02:21:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687052+0000", 2024-09-17T02:21:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001548652 2024-09-17T02:21:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:97749 5.b e44/38 ondisk, result = 0)", 2024-09-17T02:21:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.601857+0000", 2024-09-17T02:21:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.495977247999999, 2024-09-17T02:21:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083064447999999999, 2024-09-17T02:21:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601857+0000", 2024-09-17T02:21:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601857+0000", 2024-09-17T02:21:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601857+0000", 2024-09-17T02:21:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5799999999999999e-07 2024-09-17T02:21:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601862+0000", 2024-09-17T02:21:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1900000000000003e-06 2024-09-17T02:21:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684426+0000", 2024-09-17T02:21:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.082564018000000003 2024-09-17T02:21:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684443+0000", 2024-09-17T02:21:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6986e-05 2024-09-17T02:21:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684592+0000", 2024-09-17T02:21:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000148818 2024-09-17T02:21:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684607+0000", 2024-09-17T02:21:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5033e-05 2024-09-17T02:21:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684921+0000", 2024-09-17T02:21:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031374499999999999 2024-09-17T02:21:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:127512 5.4 5:2004aa0b:::benchmark_data_smithi001_23533_object127511:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.6533323680000001, 2024-09-17T02:21:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.048602902000000003, 2024-09-17T02:21:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 127512 2024-09-17T02:21:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.444503+0000", 2024-09-17T02:21:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3340000000000001e-06 2024-09-17T02:21:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.444562+0000", 2024-09-17T02:21:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9307e-05 2024-09-17T02:21:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.444574+0000", 2024-09-17T02:21:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2139e-05 2024-09-17T02:21:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.444581+0000", 2024-09-17T02:21:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4489999999999996e-06 2024-09-17T02:21:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.444624+0000", 2024-09-17T02:21:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3069999999999999e-05 2024-09-17T02:21:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.444745+0000", 2024-09-17T02:21:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000120847 2024-09-17T02:21:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.444909+0000", 2024-09-17T02:21:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016403699999999999 2024-09-17T02:21:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.448436+0000", 2024-09-17T02:21:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003527152 2024-09-17T02:21:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.449598+0000", 2024-09-17T02:21:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001162085 2024-09-17T02:21:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.492928+0000", 2024-09-17T02:21:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.043330538000000002 2024-09-17T02:21:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.492995+0000", 2024-09-17T02:21:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6212999999999998e-05 2024-09-17T02:21:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.493104+0000", 2024-09-17T02:21:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109731 2024-09-17T02:21:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:127516 5.4 5:2cbb2fd2:::benchmark_data_smithi001_23533_object127515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:32.444840+0000", 2024-09-17T02:21:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.6529940879999998, 2024-09-17T02:21:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.050299574999999999, 2024-09-17T02:21:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 127516 2024-09-17T02:21:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.444840+0000", 2024-09-17T02:21:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.444840+0000", 2024-09-17T02:21:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.444840+0000", 2024-09-17T02:21:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6300000000000005e-07 2024-09-17T02:21:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.444988+0000", 2024-09-17T02:21:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000147565 2024-09-17T02:21:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.445005+0000", 2024-09-17T02:21:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7345000000000001e-05 2024-09-17T02:21:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.445015+0000", 2024-09-17T02:21:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0039e-05 2024-09-17T02:21:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.446963+0000", 2024-09-17T02:21:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019473660000000001 2024-09-17T02:21:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.447060+0000", 2024-09-17T02:21:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7021999999999994e-05 2024-09-17T02:21:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.447163+0000", 2024-09-17T02:21:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000103436 2024-09-17T02:21:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.448738+0000", 2024-09-17T02:21:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015750639999999999 2024-09-17T02:21:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.449973+0000", 2024-09-17T02:21:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012345050000000001 2024-09-17T02:21:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.494937+0000", 2024-09-17T02:21:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.044964474999999997 2024-09-17T02:21:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.495002+0000", 2024-09-17T02:21:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5075999999999998e-05 2024-09-17T02:21:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:32.495139+0000", 2024-09-17T02:21:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137019 2024-09-17T02:21:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:36.206 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:36.207 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:36.208 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:36.209+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:36.308 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:36.310+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:36.345 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:21:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-17T02:21:36.345 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:36.360 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:36.409 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:36.413+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:36.490 INFO:teuthology.orchestra.run.smithi001.stderr:noscrub is unset 2024-09-17T02:21:36.511 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:36.513+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:36.528 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:36.528 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:21:36.528 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:21:36.528 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:21:36.528 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:36.544 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:36.611 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:36.617+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:36.711 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:36.712 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:21:36.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:21:36.712 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:36.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.712 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:36.712 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:36.712 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 80.151964165999999, 2024-09-17T02:21:36.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023664803000000002, 2024-09-17T02:21:36.712 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:36.713 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:36.713 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.713 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:36.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:36.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:36.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:36.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562311+0000", 2024-09-17T02:21:36.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:36.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562313+0000", 2024-09-17T02:21:36.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.764e-06 2024-09-17T02:21:36.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:36.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562323+0000", 2024-09-17T02:21:36.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0166000000000001e-05 2024-09-17T02:21:36.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:36.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562343+0000", 2024-09-17T02:21:36.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9633999999999999e-05 2024-09-17T02:21:36.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562367+0000", 2024-09-17T02:21:36.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4556e-05 2024-09-17T02:21:36.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:36.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563777+0000", 2024-09-17T02:21:36.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014102330000000001 2024-09-17T02:21:36.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:36.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.563969+0000", 2024-09-17T02:21:36.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000191361 2024-09-17T02:21:36.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:36.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564148+0000", 2024-09-17T02:21:36.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017934599999999999 2024-09-17T02:21:36.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:36.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.566989+0000", 2024-09-17T02:21:36.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028407010000000002 2024-09-17T02:21:36.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585770+0000", 2024-09-17T02:21:36.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018781566999999999 2024-09-17T02:21:36.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:36.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585874+0000", 2024-09-17T02:21:36.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103489 2024-09-17T02:21:36.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:36.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.585976+0000", 2024-09-17T02:21:36.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101986 2024-09-17T02:21:36.718 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.718 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:36.719 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.719 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:36.719 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:36.719 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 80.151881286000005, 2024-09-17T02:21:36.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024118555999999999, 2024-09-17T02:21:36.719 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:36.719 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:36.719 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.719 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:36.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:36.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:36.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:36.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:36.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:36.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562395+0000", 2024-09-17T02:21:36.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3969999999999999e-06 2024-09-17T02:21:36.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:36.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562405+0000", 2024-09-17T02:21:36.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4229999999999994e-06 2024-09-17T02:21:36.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:36.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562427+0000", 2024-09-17T02:21:36.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759999999999998e-05 2024-09-17T02:21:36.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562444+0000", 2024-09-17T02:21:36.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7019000000000001e-05 2024-09-17T02:21:36.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:36.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564681+0000", 2024-09-17T02:21:36.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022376929999999998 2024-09-17T02:21:36.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:36.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564887+0000", 2024-09-17T02:21:36.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000206178 2024-09-17T02:21:36.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:36.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565230+0000", 2024-09-17T02:21:36.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034233499999999998 2024-09-17T02:21:36.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:36.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567000+0000", 2024-09-17T02:21:36.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017706390000000001 2024-09-17T02:21:36.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586126+0000", 2024-09-17T02:21:36.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019125672 2024-09-17T02:21:36.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:36.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586314+0000", 2024-09-17T02:21:36.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018740200000000001 2024-09-17T02:21:36.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:36.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586513+0000", 2024-09-17T02:21:36.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019903799999999999 2024-09-17T02:21:36.724 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.724 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:36.725 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.725 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:36.725 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:36.725 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 54.145812182, 2024-09-17T02:21:36.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:21:36.725 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:36.725 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:36.725 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.725 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:36.725 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:36.725 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:36.726 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:21:36.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.726 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:36.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:36.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:36.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:36.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:36.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:36.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:21:36.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:21:36.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:36.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:21:36.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:21:36.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:36.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:21:36.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:21:36.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:21:36.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:21:36.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:36.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:21:36.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:21:36.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:36.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:21:36.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:21:36.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:36.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:21:36.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:21:36.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:36.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:21:36.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:21:36.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:21:36.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:21:36.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:36.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:21:36.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:21:36.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:36.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:21:36.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:21:36.731 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.731 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:36.731 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.731 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:36.731 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:36.731 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 54.141909931999997, 2024-09-17T02:21:36.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:21:36.731 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:36.732 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:36.732 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.732 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:36.732 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:36.732 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:36.732 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:21:36.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.732 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:36.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:36.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:36.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:36.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:36.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:36.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:21:36.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:21:36.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:36.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:21:36.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:21:36.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:36.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:21:36.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:21:36.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:21:36.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:21:36.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:36.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:21:36.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:21:36.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:36.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:21:36.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:21:36.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:36.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:21:36.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:21:36.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:36.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:21:36.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:21:36.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:21:36.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:21:36.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:36.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:21:36.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:21:36.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:36.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:21:36.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:21:36.737 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.737 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:36.738 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.738 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71190 5.3 e39/38 5:c99e0ae2:::benchmark_data_smithi001_23533_object71189:head v 39'4516, mlcod=35'4513)", 2024-09-17T02:21:36.738 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.607413+0000", 2024-09-17T02:21:36.738 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.106861907999999, 2024-09-17T02:21:36.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023407462, 2024-09-17T02:21:36.738 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:36.738 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:36.738 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.738 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:36.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:36.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607413+0000", 2024-09-17T02:21:36.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:36.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607413+0000", 2024-09-17T02:21:36.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:36.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607415+0000", 2024-09-17T02:21:36.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2139999999999999e-06 2024-09-17T02:21:36.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:36.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607479+0000", 2024-09-17T02:21:36.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4374000000000004e-05 2024-09-17T02:21:36.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:36.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607496+0000", 2024-09-17T02:21:36.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6820000000000002e-05 2024-09-17T02:21:36.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.607512+0000", 2024-09-17T02:21:36.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5976000000000001e-05 2024-09-17T02:21:36.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:36.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609288+0000", 2024-09-17T02:21:36.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001776311 2024-09-17T02:21:36.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:36.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609327+0000", 2024-09-17T02:21:36.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9165999999999997e-05 2024-09-17T02:21:36.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:36.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630723+0000", 2024-09-17T02:21:36.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021395290000000001 2024-09-17T02:21:36.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:36.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.630821+0000", 2024-09-17T02:21:36.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8311000000000001e-05 2024-09-17T02:21:36.742 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.742 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:36.742 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.743 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71206 5.3 e39/38 5:c6c9386d:::benchmark_data_smithi001_23533_object71205:head v 39'4517, mlcod=35'4513)", 2024-09-17T02:21:36.743 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:36.743 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.104582817000001, 2024-09-17T02:21:36.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026101868, 2024-09-17T02:21:36.743 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:36.743 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:36.743 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.743 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:36.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:36.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:36.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:36.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:36.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:36.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609694+0000", 2024-09-17T02:21:36.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9539999999999998e-06 2024-09-17T02:21:36.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:36.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609841+0000", 2024-09-17T02:21:36.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014690800000000001 2024-09-17T02:21:36.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:36.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609872+0000", 2024-09-17T02:21:36.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0326000000000001e-05 2024-09-17T02:21:36.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609892+0000", 2024-09-17T02:21:36.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9848999999999999e-05 2024-09-17T02:21:36.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:36.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613826+0000", 2024-09-17T02:21:36.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039345140000000001 2024-09-17T02:21:36.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:36.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613908+0000", 2024-09-17T02:21:36.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2412999999999999e-05 2024-09-17T02:21:36.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:36.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635696+0000", 2024-09-17T02:21:36.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021787597999999998 2024-09-17T02:21:36.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:36.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635794+0000", 2024-09-17T02:21:36.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8306000000000004e-05 2024-09-17T02:21:36.747 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.747 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:36.747 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.748 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71210 5.3 e39/38 5:c0498d13:::benchmark_data_smithi001_23533_object71209:head v 39'4518, mlcod=35'4513)", 2024-09-17T02:21:36.748 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:36.748 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.103104850999998, 2024-09-17T02:21:36.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024703197, 2024-09-17T02:21:36.748 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:36.748 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:36.748 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.748 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:36.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:36.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:36.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:36.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:36.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:36.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611172+0000", 2024-09-17T02:21:36.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6470000000000001e-06 2024-09-17T02:21:36.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:36.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611344+0000", 2024-09-17T02:21:36.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000171607 2024-09-17T02:21:36.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:36.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611389+0000", 2024-09-17T02:21:36.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5738000000000002e-05 2024-09-17T02:21:36.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611407+0000", 2024-09-17T02:21:36.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7893e-05 2024-09-17T02:21:36.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:36.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617820+0000", 2024-09-17T02:21:36.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064131070000000004 2024-09-17T02:21:36.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:36.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617885+0000", 2024-09-17T02:21:36.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4442000000000004e-05 2024-09-17T02:21:36.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:36.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635806+0000", 2024-09-17T02:21:36.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017920874999999999 2024-09-17T02:21:36.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:36.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635874+0000", 2024-09-17T02:21:36.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7887999999999998e-05 2024-09-17T02:21:36.752 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.752 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:36.752 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.752 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71214 5.3 e39/38 5:c5e24f3f:::benchmark_data_smithi001_23533_object71213:head v 39'4520, mlcod=35'4513)", 2024-09-17T02:21:36.753 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:36.753 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.098740618999997, 2024-09-17T02:21:36.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024251297000000002, 2024-09-17T02:21:36.753 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:36.753 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:36.753 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.753 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:36.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:36.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:36.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:36.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:36.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:36.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615536+0000", 2024-09-17T02:21:36.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5370000000000001e-06 2024-09-17T02:21:36.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:36.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615696+0000", 2024-09-17T02:21:36.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015948700000000001 2024-09-17T02:21:36.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:36.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615723+0000", 2024-09-17T02:21:36.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7518999999999999e-05 2024-09-17T02:21:36.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615742+0000", 2024-09-17T02:21:36.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8519999999999999e-05 2024-09-17T02:21:36.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:36.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.624440+0000", 2024-09-17T02:21:36.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0086983080000000001 2024-09-17T02:21:36.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:36.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.624489+0000", 2024-09-17T02:21:36.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8838000000000002e-05 2024-09-17T02:21:36.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:36.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639673+0000", 2024-09-17T02:21:36.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01518451 2024-09-17T02:21:36.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:36.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639786+0000", 2024-09-17T02:21:36.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011257800000000001 2024-09-17T02:21:36.757 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.757 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:36.757 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.757 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97147 5.0 5:02d17bf7:::benchmark_data_smithi001_23533_object97146:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:36.757 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268128+0000", 2024-09-17T02:21:36.757 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.446146875, 2024-09-17T02:21:36.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022726434, 2024-09-17T02:21:36.758 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:36.758 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:36.758 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.758 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:36.758 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:36.758 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:36.758 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97147 2024-09-17T02:21:36.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.758 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:36.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:36.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268128+0000", 2024-09-17T02:21:36.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:36.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268128+0000", 2024-09-17T02:21:36.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:36.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268129+0000", 2024-09-17T02:21:36.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5700000000000001e-07 2024-09-17T02:21:36.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:36.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268194+0000", 2024-09-17T02:21:36.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4731000000000001e-05 2024-09-17T02:21:36.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:36.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268202+0000", 2024-09-17T02:21:36.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7950000000000008e-06 2024-09-17T02:21:36.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268207+0000", 2024-09-17T02:21:36.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8550000000000001e-06 2024-09-17T02:21:36.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:36.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268694+0000", 2024-09-17T02:21:36.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00048752799999999998 2024-09-17T02:21:36.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:36.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268768+0000", 2024-09-17T02:21:36.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3638000000000002e-05 2024-09-17T02:21:36.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:36.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268842+0000", 2024-09-17T02:21:36.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3928000000000001e-05 2024-09-17T02:21:36.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.285598+0000", 2024-09-17T02:21:36.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016756436 2024-09-17T02:21:36.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:36.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290771+0000", 2024-09-17T02:21:36.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051724789999999998 2024-09-17T02:21:36.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:36.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290817+0000", 2024-09-17T02:21:36.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6220999999999997e-05 2024-09-17T02:21:36.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:36.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290855+0000", 2024-09-17T02:21:36.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7966000000000002e-05 2024-09-17T02:21:36.763 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.763 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:36.763 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.764 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97151 5.5 5:a0c2c072:::benchmark_data_smithi001_23533_object97150:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:36.764 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:36.764 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.445903210000001, 2024-09-17T02:21:36.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027297614000000001, 2024-09-17T02:21:36.764 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:36.764 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:36.764 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.764 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:36.764 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:36.764 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:36.764 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97151 2024-09-17T02:21:36.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.765 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:36.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:36.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:36.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:36.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:36.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:36.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268373+0000", 2024-09-17T02:21:36.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4000000000000002e-07 2024-09-17T02:21:36.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:36.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268423+0000", 2024-09-17T02:21:36.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0175e-05 2024-09-17T02:21:36.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:36.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268428+0000", 2024-09-17T02:21:36.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-17T02:21:36.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268431+0000", 2024-09-17T02:21:36.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.179e-06 2024-09-17T02:21:36.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:36.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283631+0000", 2024-09-17T02:21:36.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015199691 2024-09-17T02:21:36.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:36.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283740+0000", 2024-09-17T02:21:36.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109305 2024-09-17T02:21:36.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:36.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283863+0000", 2024-09-17T02:21:36.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012226699999999999 2024-09-17T02:21:36.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:36.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290857+0000", 2024-09-17T02:21:36.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069945449999999996 2024-09-17T02:21:36.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295595+0000", 2024-09-17T02:21:36.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047376750000000002 2024-09-17T02:21:36.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:36.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295638+0000", 2024-09-17T02:21:36.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3671999999999998e-05 2024-09-17T02:21:36.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:36.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295670+0000", 2024-09-17T02:21:36.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1266000000000002e-05 2024-09-17T02:21:36.770 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.770 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:36.770 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.770 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97248 5.c 5:3796bec5:::benchmark_data_smithi001_23533_object97247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:36.770 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.327358+0000", 2024-09-17T02:21:36.770 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.386916967000001, 2024-09-17T02:21:36.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022963006000000001, 2024-09-17T02:21:36.770 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:36.771 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:36.771 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.771 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:36.771 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:36.771 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:36.771 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97248 2024-09-17T02:21:36.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.771 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:36.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:36.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327358+0000", 2024-09-17T02:21:36.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:36.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327358+0000", 2024-09-17T02:21:36.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:36.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327359+0000", 2024-09-17T02:21:36.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5699999999999998e-07 2024-09-17T02:21:36.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:36.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327382+0000", 2024-09-17T02:21:36.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3458000000000001e-05 2024-09-17T02:21:36.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:36.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327387+0000", 2024-09-17T02:21:36.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6149999999999999e-06 2024-09-17T02:21:36.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.327391+0000", 2024-09-17T02:21:36.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8999999999999999e-06 2024-09-17T02:21:36.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:36.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.332084+0000", 2024-09-17T02:21:36.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046935240000000001 2024-09-17T02:21:36.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:36.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.332216+0000", 2024-09-17T02:21:36.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131798 2024-09-17T02:21:36.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:36.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.332352+0000", 2024-09-17T02:21:36.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013587500000000001 2024-09-17T02:21:36.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.338559+0000", 2024-09-17T02:21:36.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0062075510000000004 2024-09-17T02:21:36.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:36.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350237+0000", 2024-09-17T02:21:36.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011677121 2024-09-17T02:21:36.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:36.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350287+0000", 2024-09-17T02:21:36.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0080999999999997e-05 2024-09-17T02:21:36.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:36.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.350321+0000", 2024-09-17T02:21:36.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4625999999999997e-05 2024-09-17T02:21:36.776 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.776 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:36.776 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.777 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97759 5.a 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:36.777 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:36.777 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.115890108999999, 2024-09-17T02:21:36.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.089694871999999995, 2024-09-17T02:21:36.777 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:36.777 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:36.777 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.777 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:36.777 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:36.777 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:36.777 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97759 2024-09-17T02:21:36.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.777 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:36.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:36.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:36.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:36.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:36.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:36.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598386+0000", 2024-09-17T02:21:36.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999999e-07 2024-09-17T02:21:36.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:36.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598414+0000", 2024-09-17T02:21:36.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8013000000000001e-05 2024-09-17T02:21:36.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:36.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598420+0000", 2024-09-17T02:21:36.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1149999999999999e-06 2024-09-17T02:21:36.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598424+0000", 2024-09-17T02:21:36.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:21:36.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:36.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598479+0000", 2024-09-17T02:21:36.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4648999999999998e-05 2024-09-17T02:21:36.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:36.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598587+0000", 2024-09-17T02:21:36.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010853000000000001 2024-09-17T02:21:36.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:36.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598676+0000", 2024-09-17T02:21:36.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8381999999999995e-05 2024-09-17T02:21:36.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:36.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603766+0000", 2024-09-17T02:21:36.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050902559999999996 2024-09-17T02:21:36.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.687988+0000", 2024-09-17T02:21:36.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.084221753999999996 2024-09-17T02:21:36.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:36.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688037+0000", 2024-09-17T02:21:36.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-05 2024-09-17T02:21:36.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:36.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688080+0000", 2024-09-17T02:21:36.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3149999999999999e-05 2024-09-17T02:21:36.783 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.783 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:36.783 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.783 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97770 5.0 5:09c75033:::benchmark_data_smithi001_23533_object97769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:36.783 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:36.783 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.110747678999999, 2024-09-17T02:21:36.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.086380868, 2024-09-17T02:21:36.783 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:36.783 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:36.783 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.783 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:36.784 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:36.784 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:36.784 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97770 2024-09-17T02:21:36.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.784 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:36.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:36.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:36.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:36.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:36.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:36.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603529+0000", 2024-09-17T02:21:36.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:21:36.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:36.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603593+0000", 2024-09-17T02:21:36.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4216999999999999e-05 2024-09-17T02:21:36.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:36.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603603+0000", 2024-09-17T02:21:36.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5179999999999993e-06 2024-09-17T02:21:36.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603608+0000", 2024-09-17T02:21:36.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2039999999999996e-06 2024-09-17T02:21:36.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:36.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603653+0000", 2024-09-17T02:21:36.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5247000000000002e-05 2024-09-17T02:21:36.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:36.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603758+0000", 2024-09-17T02:21:36.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105352 2024-09-17T02:21:36.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:36.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603900+0000", 2024-09-17T02:21:36.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014198999999999999 2024-09-17T02:21:36.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:36.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.606097+0000", 2024-09-17T02:21:36.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021969839999999999 2024-09-17T02:21:36.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689756+0000", 2024-09-17T02:21:36.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.083659077999999998 2024-09-17T02:21:36.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:36.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689846+0000", 2024-09-17T02:21:36.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9320999999999994e-05 2024-09-17T02:21:36.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:36.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689908+0000", 2024-09-17T02:21:36.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720999999999998e-05 2024-09-17T02:21:36.789 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.789 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:36.789 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.790 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:101263 5.0 5:01bcc612:::benchmark_data_smithi001_23533_object101262:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T02:21:36.790 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:19.421619+0000", 2024-09-17T02:21:36.790 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.292656458, 2024-09-17T02:21:36.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023065922999999999, 2024-09-17T02:21:36.790 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:36.790 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:36.790 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.790 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:36.790 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:36.790 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:36.790 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 101263 2024-09-17T02:21:36.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.790 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:36.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:36.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421619+0000", 2024-09-17T02:21:36.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:36.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421619+0000", 2024-09-17T02:21:36.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:36.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421619+0000", 2024-09-17T02:21:36.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6100000000000001e-07 2024-09-17T02:21:36.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:36.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421657+0000", 2024-09-17T02:21:36.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7438999999999998e-05 2024-09-17T02:21:36.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:36.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421665+0000", 2024-09-17T02:21:36.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4840000000000004e-06 2024-09-17T02:21:36.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.421671+0000", 2024-09-17T02:21:36.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5400000000000003e-06 2024-09-17T02:21:36.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:36.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.431714+0000", 2024-09-17T02:21:36.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0100432 2024-09-17T02:21:36.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:36.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.431841+0000", 2024-09-17T02:21:36.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000127138 2024-09-17T02:21:36.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:36.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.431970+0000", 2024-09-17T02:21:36.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012893900000000001 2024-09-17T02:21:36.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.436696+0000", 2024-09-17T02:21:36.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047262570000000002 2024-09-17T02:21:36.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:36.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.444604+0000", 2024-09-17T02:21:36.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079071479999999993 2024-09-17T02:21:36.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:36.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.444648+0000", 2024-09-17T02:21:36.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4941000000000002e-05 2024-09-17T02:21:36.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:19.444685+0000", 2024-09-17T02:21:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6276000000000003e-05 2024-09-17T02:21:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127513 5.c 5:3eca08e4:::benchmark_data_smithi001_23533_object127512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:21:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.2699712549999997, 2024-09-17T02:21:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046626399999999998, 2024-09-17T02:21:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:36.797 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:36.797 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.797 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:36.797 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:36.797 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:36.797 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127513 2024-09-17T02:21:36.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.797 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:36.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:36.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:21:36.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:36.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:21:36.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:36.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444305+0000", 2024-09-17T02:21:36.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2529999999999999e-06 2024-09-17T02:21:36.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:36.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444466+0000", 2024-09-17T02:21:36.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016069700000000001 2024-09-17T02:21:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444479+0000", 2024-09-17T02:21:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2602999999999999e-05 2024-09-17T02:21:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444485+0000", 2024-09-17T02:21:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.669e-06 2024-09-17T02:21:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:36.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444560+0000", 2024-09-17T02:21:36.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4276999999999994e-05 2024-09-17T02:21:36.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:36.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444656+0000", 2024-09-17T02:21:36.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6490000000000006e-05 2024-09-17T02:21:36.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:36.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444739+0000", 2024-09-17T02:21:36.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3139999999999993e-05 2024-09-17T02:21:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.448438+0000", 2024-09-17T02:21:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036985490000000002 2024-09-17T02:21:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490732+0000", 2024-09-17T02:21:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042294353999999999 2024-09-17T02:21:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490859+0000", 2024-09-17T02:21:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012708899999999999 2024-09-17T02:21:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490930+0000", 2024-09-17T02:21:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:21:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127514 5.c 5:39cc1feb:::benchmark_data_smithi001_23533_object127513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.2697744860000002, 2024-09-17T02:21:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049357228000000003, 2024-09-17T02:21:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127514 2024-09-17T02:21:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8599999999999998e-07 2024-09-17T02:21:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444554+0000", 2024-09-17T02:21:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3047999999999998e-05 2024-09-17T02:21:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444562+0000", 2024-09-17T02:21:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5830000000000001e-06 2024-09-17T02:21:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444567+0000", 2024-09-17T02:21:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4179999999999996e-06 2024-09-17T02:21:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446566+0000", 2024-09-17T02:21:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001998788 2024-09-17T02:21:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446696+0000", 2024-09-17T02:21:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129393 2024-09-17T02:21:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446794+0000", 2024-09-17T02:21:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8462999999999996e-05 2024-09-17T02:21:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.449036+0000", 2024-09-17T02:21:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022415880000000001 2024-09-17T02:21:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493737+0000", 2024-09-17T02:21:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044701682 2024-09-17T02:21:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493808+0000", 2024-09-17T02:21:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0846000000000006e-05 2024-09-17T02:21:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493858+0000", 2024-09-17T02:21:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9932999999999998e-05 2024-09-17T02:21:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129441 5.1 5:84c3199f:::benchmark_data_smithi001_23533_object1324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:21:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.210763998, 2024-09-17T02:21:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034387011000000002, 2024-09-17T02:21:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129441 2024-09-17T02:21:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:21:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:21:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503513+0000", 2024-09-17T02:21:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4759999999999999e-06 2024-09-17T02:21:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503518+0000", 2024-09-17T02:21:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-09-17T02:21:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503532+0000", 2024-09-17T02:21:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4049999999999999e-05 2024-09-17T02:21:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503541+0000", 2024-09-17T02:21:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5320000000000006e-06 2024-09-17T02:21:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506331+0000", 2024-09-17T02:21:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027899190000000001 2024-09-17T02:21:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506402+0000", 2024-09-17T02:21:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:21:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506477+0000", 2024-09-17T02:21:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4626e-05 2024-09-17T02:21:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509749+0000", 2024-09-17T02:21:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032726980000000001 2024-09-17T02:21:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537758+0000", 2024-09-17T02:21:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028008890000000002 2024-09-17T02:21:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537812+0000", 2024-09-17T02:21:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3300000000000001e-05 2024-09-17T02:21:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537898+0000", 2024-09-17T02:21:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6691000000000001e-05 2024-09-17T02:21:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129442 5.1 5:8f7f2a95:::benchmark_data_smithi001_23533_object1325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:21:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.2077933889999999, 2024-09-17T02:21:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031546698999999997, 2024-09-17T02:21:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129442 2024-09-17T02:21:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:21:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:21:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506483+0000", 2024-09-17T02:21:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2869999999999999e-06 2024-09-17T02:21:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506489+0000", 2024-09-17T02:21:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2330000000000003e-06 2024-09-17T02:21:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506502+0000", 2024-09-17T02:21:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2286999999999999e-05 2024-09-17T02:21:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506511+0000", 2024-09-17T02:21:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7799999999999995e-06 2024-09-17T02:21:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.507966+0000", 2024-09-17T02:21:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014541549999999999 2024-09-17T02:21:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508130+0000", 2024-09-17T02:21:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016455199999999999 2024-09-17T02:21:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508287+0000", 2024-09-17T02:21:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015730400000000001 2024-09-17T02:21:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510577+0000", 2024-09-17T02:21:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022899449999999998 2024-09-17T02:21:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537932+0000", 2024-09-17T02:21:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027354471000000002 2024-09-17T02:21:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537964+0000", 2024-09-17T02:21:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1909999999999998e-05 2024-09-17T02:21:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.538029+0000", 2024-09-17T02:21:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4775000000000002e-05 2024-09-17T02:21:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129443 5.8 5:1edfeaf8:::benchmark_data_smithi001_23533_object1326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:21:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.2043588889999999, 2024-09-17T02:21:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025315902000000001, 2024-09-17T02:21:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129443 2024-09-17T02:21:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:21:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:21:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509918+0000", 2024-09-17T02:21:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3689999999999999e-06 2024-09-17T02:21:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509923+0000", 2024-09-17T02:21:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0429999999999998e-06 2024-09-17T02:21:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509936+0000", 2024-09-17T02:21:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3234000000000001e-05 2024-09-17T02:21:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509950+0000", 2024-09-17T02:21:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3998999999999999e-05 2024-09-17T02:21:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509994+0000", 2024-09-17T02:21:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4323000000000002e-05 2024-09-17T02:21:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510095+0000", 2024-09-17T02:21:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010103300000000001 2024-09-17T02:21:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510160+0000", 2024-09-17T02:21:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4976999999999998e-05 2024-09-17T02:21:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.513304+0000", 2024-09-17T02:21:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031431330000000002 2024-09-17T02:21:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535046+0000", 2024-09-17T02:21:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021742276000000001 2024-09-17T02:21:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:21:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107759 2024-09-17T02:21:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535232+0000", 2024-09-17T02:21:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8756000000000003e-05 2024-09-17T02:21:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129448 5.3 5:c6b382db:::benchmark_data_smithi001_23533_object1331:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.517460+0000", 2024-09-17T02:21:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.196815256, 2024-09-17T02:21:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024080893999999999, 2024-09-17T02:21:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129448 2024-09-17T02:21:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.517460+0000", 2024-09-17T02:21:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.517460+0000", 2024-09-17T02:21:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.517461+0000", 2024-09-17T02:21:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5499999999999998e-07 2024-09-17T02:21:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.517464+0000", 2024-09-17T02:21:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1250000000000001e-06 2024-09-17T02:21:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.517473+0000", 2024-09-17T02:21:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2960000000000004e-06 2024-09-17T02:21:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.517481+0000", 2024-09-17T02:21:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6199999999999999e-06 2024-09-17T02:21:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.517572+0000", 2024-09-17T02:21:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1228000000000001e-05 2024-09-17T02:21:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-17T02:21:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.517580+0000", 2024-09-17T02:21:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9549999999999992e-06 2024-09-17T02:21:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.534297+0000", 2024-09-17T02:21:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016717416999999998 2024-09-17T02:21:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.534401+0000", 2024-09-17T02:21:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010380800000000001 2024-09-17T02:21:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.534490+0000", 2024-09-17T02:21:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8854e-05 2024-09-17T02:21:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.539105+0000", 2024-09-17T02:21:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004615198 2024-09-17T02:21:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.541410+0000", 2024-09-17T02:21:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023050879999999998 2024-09-17T02:21:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.541452+0000", 2024-09-17T02:21:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1372000000000003e-05 2024-09-17T02:21:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.541541+0000", 2024-09-17T02:21:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9277999999999995e-05 2024-09-17T02:21:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:36.834 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:36.836 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:36.837 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:36.841+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:36.937 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:36.941+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:36.997 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:36.997 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:36.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.997 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:130613 5.4 5:2718afd7:::benchmark_data_smithi001_23533_object2496:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T02:21:36.997 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:36.997938+0000", 2024-09-17T02:21:36.997 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0044427160000000002, 2024-09-17T02:21:36.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044632960000000003, 2024-09-17T02:21:36.997 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:36.998 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:36.998 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:36.998 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:36.998 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:36.998 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:36.998 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 130613 2024-09-17T02:21:36.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.998 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:36.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:36.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.997938+0000", 2024-09-17T02:21:36.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:36.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.997938+0000", 2024-09-17T02:21:36.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:36.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:36.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:36.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:37.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.997939+0000", 2024-09-17T02:21:37.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3700000000000001e-07 2024-09-17T02:21:37.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:37.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:37.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:37.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.997940+0000", 2024-09-17T02:21:37.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.64e-06 2024-09-17T02:21:37.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:37.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:37.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:37.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.997946+0000", 2024-09-17T02:21:37.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5210000000000002e-06 2024-09-17T02:21:37.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:37.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:37.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:37.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.997950+0000", 2024-09-17T02:21:37.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0280000000000002e-06 2024-09-17T02:21:37.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:37.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:37.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:37.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.999421+0000", 2024-09-17T02:21:37.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001471197 2024-09-17T02:21:37.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:37.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:37.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:37.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.999577+0000", 2024-09-17T02:21:37.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000156434 2024-09-17T02:21:37.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:37.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:37.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:37.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.999706+0000", 2024-09-17T02:21:37.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012844899999999999 2024-09-17T02:21:37.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:37.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:37.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:37.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:37.001553+0000", 2024-09-17T02:21:37.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018467970000000001 2024-09-17T02:21:37.003 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:37.003 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:37.003 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:37.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:37.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:37.004 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:130617 5.4 5:2c9fa15a:::benchmark_data_smithi001_23533_object2500:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T02:21:37.004 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:37.001661+0000", 2024-09-17T02:21:37.004 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00072038699999999996, 2024-09-17T02:21:37.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00079279700000000003, 2024-09-17T02:21:37.004 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:37.004 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:37.004 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:37.004 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:37.004 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:37.004 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:37.005 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 130617 2024-09-17T02:21:37.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:37.005 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:37.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:37.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:37.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:37.001661+0000", 2024-09-17T02:21:37.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:37.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:37.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:37.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:37.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:37.001661+0000", 2024-09-17T02:21:37.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:37.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:37.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:37.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:37.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:37.001662+0000", 2024-09-17T02:21:37.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2470000000000001e-06 2024-09-17T02:21:37.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:37.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:37.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:37.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:37.001666+0000", 2024-09-17T02:21:37.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5900000000000001e-06 2024-09-17T02:21:37.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:37.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:37.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:37.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:37.001677+0000", 2024-09-17T02:21:37.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0998999999999999e-05 2024-09-17T02:21:37.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:37.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:37.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:37.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:37.001683+0000", 2024-09-17T02:21:37.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1569999999999999e-06 2024-09-17T02:21:37.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:37.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:37.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:37.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:37.001720+0000", 2024-09-17T02:21:37.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7636999999999999e-05 2024-09-17T02:21:37.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:37.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:37.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:37.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:37.001792+0000", 2024-09-17T02:21:37.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1804000000000006e-05 2024-09-17T02:21:37.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:37.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:37.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:37.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:37.001886+0000", 2024-09-17T02:21:37.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3830000000000001e-05 2024-09-17T02:21:37.009 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:37.009 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:37.009 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:37.009 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:37.009 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:21:37.009 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 2 2024-09-17T02:21:37.010 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:37.021 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:37.056 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:21:37.068 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:37.073+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:37.141 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:37.141+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:37.218 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:21:37.219 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:21:37.229 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:37.229 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:37.238 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:21:37.238 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:21:37.238 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:21:37.239 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:37.238+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:37.242 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:21:37.242 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:21:37.250 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:37.341 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:37.341+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:37.441 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:37.445+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:37.453 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:37.453 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:37.476 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:37.542 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:37.542+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:37.638 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:37.638 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:37.642 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:37.642+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:37.661 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:37.744 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:37.749+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:37.845 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:37.846+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:37.858 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:37.858 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:37.877 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:37.963 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:37.966+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:38.047 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:38.049+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:38.077 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:38.077 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:38.096 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:38.148 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:38.150+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:38.218 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-17T02:21:38.249 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:38.253+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:38.258 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:38.258 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:38.279 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:38.327 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2024-09-17T02:21:38.328 INFO:teuthology.orchestra.console.smithi164:Power off completed 2024-09-17T02:21:38.368 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:38.373+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:38.451 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:38.453+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:38.483 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:38.483 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:38.506 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:38.515 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T02:21:38.552 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:38.554+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:38.653 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:38.657+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:38.708 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:38.708 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:38.727 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:38.775 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:38.778+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:38.855 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:38.854+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:38.881 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:38.881 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:38.900 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:38.904 INFO:teuthology.orchestra.run.smithi001.stderr:nodeep-scrub is unset 2024-09-17T02:21:38.991 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:38.994+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:39.057 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:39.058+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:39.101 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:39.101 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:39.120 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:39.169 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:39.170+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:39.243 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:21:39.258 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-17T02:21:39.258 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:39.261+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:39.326 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:39.327 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:39.348 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:39.359 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:39.362+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:39.400 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:21:39.401 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:21:39.419 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:21:39.419 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:21:39.419 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:21:39.422 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:21:39.423 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:21:39.460 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:39.462+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:39.503 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:39.503 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:39.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.503 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:136274 5.b 5:daf85d44:::benchmark_data_smithi001_23533_object8157:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:39.503 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:39.501256+0000", 2024-09-17T02:21:39.503 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0059352149999999998, 2024-09-17T02:21:39.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059562419999999996, 2024-09-17T02:21:39.503 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:39.503 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:39.503 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:39.503 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:39.504 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:39.504 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:39.504 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 136274 2024-09-17T02:21:39.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.504 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:39.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:39.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.501256+0000", 2024-09-17T02:21:39.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:39.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.501256+0000", 2024-09-17T02:21:39.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:39.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.501257+0000", 2024-09-17T02:21:39.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4199999999999995e-07 2024-09-17T02:21:39.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:39.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.501260+0000", 2024-09-17T02:21:39.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4319999999999999e-06 2024-09-17T02:21:39.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:39.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.501270+0000", 2024-09-17T02:21:39.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5400000000000001e-06 2024-09-17T02:21:39.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:39.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.501276+0000", 2024-09-17T02:21:39.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.387e-06 2024-09-17T02:21:39.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:39.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.503128+0000", 2024-09-17T02:21:39.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001851112 2024-09-17T02:21:39.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:39.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.503257+0000", 2024-09-17T02:21:39.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012901899999999999 2024-09-17T02:21:39.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:39.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.503375+0000", 2024-09-17T02:21:39.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011885200000000001 2024-09-17T02:21:39.508 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.508 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:39.508 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.508 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:136278 5.e 5:7d104dfb:::benchmark_data_smithi001_23533_object8161:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:39.508 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:39.502079+0000", 2024-09-17T02:21:39.508 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0051123840000000002, 2024-09-17T02:21:39.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051821660000000002, 2024-09-17T02:21:39.509 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:39.509 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:39.509 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:39.509 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:39.509 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:39.509 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:39.509 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 136278 2024-09-17T02:21:39.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.509 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:39.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:39.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.502079+0000", 2024-09-17T02:21:39.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:39.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.502079+0000", 2024-09-17T02:21:39.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:39.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.502080+0000", 2024-09-17T02:21:39.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2900000000000003e-07 2024-09-17T02:21:39.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:39.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.502083+0000", 2024-09-17T02:21:39.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9289999999999998e-06 2024-09-17T02:21:39.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:39.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.502092+0000", 2024-09-17T02:21:39.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5880000000000004e-06 2024-09-17T02:21:39.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:39.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.502100+0000", 2024-09-17T02:21:39.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2350000000000002e-06 2024-09-17T02:21:39.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:39.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.502919+0000", 2024-09-17T02:21:39.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081962300000000001 2024-09-17T02:21:39.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:39.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.503090+0000", 2024-09-17T02:21:39.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017087299999999999 2024-09-17T02:21:39.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:39.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.503211+0000", 2024-09-17T02:21:39.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012054500000000001 2024-09-17T02:21:39.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:39.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506338+0000", 2024-09-17T02:21:39.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031269129999999998 2024-09-17T02:21:39.513 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.513 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:39.513 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.513 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:136280 5.f 5:f82b3ccf:::benchmark_data_smithi001_23533_object8163:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:39.513 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:39.504029+0000", 2024-09-17T02:21:39.513 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0031629420000000002, 2024-09-17T02:21:39.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032778339999999999, 2024-09-17T02:21:39.514 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:39.514 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:39.514 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:39.514 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:39.514 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:39.514 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:39.514 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 136280 2024-09-17T02:21:39.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.514 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:39.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:39.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504029+0000", 2024-09-17T02:21:39.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:39.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504029+0000", 2024-09-17T02:21:39.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:39.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504030+0000", 2024-09-17T02:21:39.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7399999999999991e-07 2024-09-17T02:21:39.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:39.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504034+0000", 2024-09-17T02:21:39.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0369999999999996e-06 2024-09-17T02:21:39.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:39.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504043+0000", 2024-09-17T02:21:39.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2480000000000002e-06 2024-09-17T02:21:39.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:39.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504048+0000", 2024-09-17T02:21:39.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0409999999999997e-06 2024-09-17T02:21:39.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:39.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504090+0000", 2024-09-17T02:21:39.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1919999999999998e-05 2024-09-17T02:21:39.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:39.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504183+0000", 2024-09-17T02:21:39.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2893000000000007e-05 2024-09-17T02:21:39.517 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.517 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:39.517 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.518 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:136277 5.3 e54/51 5:c6946f1d:::benchmark_data_smithi001_23533_object8160:head v 54'8596, mlcod=54'8594)", 2024-09-17T02:21:39.518 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:39.504156+0000", 2024-09-17T02:21:39.518 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0030359250000000001, 2024-09-17T02:21:39.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031885770000000002, 2024-09-17T02:21:39.518 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:39.518 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:39.518 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:39.518 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:39.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:39.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504156+0000", 2024-09-17T02:21:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504156+0000", 2024-09-17T02:21:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504156+0000", 2024-09-17T02:21:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5300000000000004e-07 2024-09-17T02:21:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:39.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504170+0000", 2024-09-17T02:21:39.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3912e-05 2024-09-17T02:21:39.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:39.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504179+0000", 2024-09-17T02:21:39.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4309999999999994e-06 2024-09-17T02:21:39.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:39.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504185+0000", 2024-09-17T02:21:39.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.049e-06 2024-09-17T02:21:39.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:39.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504217+0000", 2024-09-17T02:21:39.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2094000000000001e-05 2024-09-17T02:21:39.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:39.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504228+0000", 2024-09-17T02:21:39.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1525999999999999e-05 2024-09-17T02:21:39.521 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.521 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:39.521 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:136273 5.a e54/22 5:557cfaa4:::benchmark_data_smithi001_23533_object8156:head v 54'8619, mlcod=54'8615)", 2024-09-17T02:21:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:39.504205+0000", 2024-09-17T02:21:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.002986327, 2024-09-17T02:21:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031711069999999998, 2024-09-17T02:21:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504205+0000", 2024-09-17T02:21:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:39.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504205+0000", 2024-09-17T02:21:39.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:39.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504206+0000", 2024-09-17T02:21:39.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6600000000000002e-07 2024-09-17T02:21:39.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:39.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504219+0000", 2024-09-17T02:21:39.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3278999999999999e-05 2024-09-17T02:21:39.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:39.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504226+0000", 2024-09-17T02:21:39.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3699999999999997e-06 2024-09-17T02:21:39.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:39.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504231+0000", 2024-09-17T02:21:39.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8709999999999996e-06 2024-09-17T02:21:39.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:39.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504280+0000", 2024-09-17T02:21:39.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8439999999999997e-05 2024-09-17T02:21:39.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:39.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504297+0000", 2024-09-17T02:21:39.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7363999999999998e-05 2024-09-17T02:21:39.525 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.525 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:39.525 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.526 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:136282 5.f 5:f58e90ee:::benchmark_data_smithi001_23533_object8165:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:39.526 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:39.504429+0000", 2024-09-17T02:21:39.526 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0027629460000000001, 2024-09-17T02:21:39.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029812800000000002, 2024-09-17T02:21:39.526 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:39.526 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:39.526 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:39.526 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:39.526 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:39.526 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:39.526 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 136282 2024-09-17T02:21:39.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.526 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:39.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:39.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504429+0000", 2024-09-17T02:21:39.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:39.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504429+0000", 2024-09-17T02:21:39.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:39.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504429+0000", 2024-09-17T02:21:39.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1900000000000002e-07 2024-09-17T02:21:39.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:39.528 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504432+0000", 2024-09-17T02:21:39.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9579999999999999e-06 2024-09-17T02:21:39.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:39.528 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504442+0000", 2024-09-17T02:21:39.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7380000000000006e-06 2024-09-17T02:21:39.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:39.529 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504448+0000", 2024-09-17T02:21:39.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8050000000000003e-06 2024-09-17T02:21:39.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.529 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.529 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:39.529 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.505772+0000", 2024-09-17T02:21:39.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001324782 2024-09-17T02:21:39.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.529 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.529 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:39.529 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.505917+0000", 2024-09-17T02:21:39.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014486800000000001 2024-09-17T02:21:39.529 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.529 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:39.530 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.530 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:136281 5.8 e54/26 5:128b12cf:::benchmark_data_smithi001_23533_object8164:head v 54'8658, mlcod=54'8655)", 2024-09-17T02:21:39.530 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:39.504809+0000", 2024-09-17T02:21:39.530 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0023826059999999998, 2024-09-17T02:21:39.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026357870000000001, 2024-09-17T02:21:39.530 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:39.530 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:39.530 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:39.530 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:39.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:39.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504809+0000", 2024-09-17T02:21:39.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:39.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504809+0000", 2024-09-17T02:21:39.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:39.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504810+0000", 2024-09-17T02:21:39.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0100000000000004e-07 2024-09-17T02:21:39.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:39.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504819+0000", 2024-09-17T02:21:39.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9039999999999998e-06 2024-09-17T02:21:39.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:39.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504828+0000", 2024-09-17T02:21:39.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7950000000000002e-06 2024-09-17T02:21:39.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:39.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504835+0000", 2024-09-17T02:21:39.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2269999999999998e-06 2024-09-17T02:21:39.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.533 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:39.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504883+0000", 2024-09-17T02:21:39.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8334000000000002e-05 2024-09-17T02:21:39.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.533 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:39.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.504901+0000", 2024-09-17T02:21:39.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8363999999999999e-05 2024-09-17T02:21:39.533 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.533 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:39.533 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.534 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:136284 5.b 5:d5ebb576:::benchmark_data_smithi001_23533_object8167:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:39.534 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:39.505536+0000", 2024-09-17T02:21:39.534 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.001655274, 2024-09-17T02:21:39.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001942362, 2024-09-17T02:21:39.534 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:39.534 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:39.534 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:39.534 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:39.534 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:39.534 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:39.534 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 136284 2024-09-17T02:21:39.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.535 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:39.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:39.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.505536+0000", 2024-09-17T02:21:39.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:39.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.505536+0000", 2024-09-17T02:21:39.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:39.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.505537+0000", 2024-09-17T02:21:39.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2500000000000005e-07 2024-09-17T02:21:39.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:39.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.505540+0000", 2024-09-17T02:21:39.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3469999999999999e-06 2024-09-17T02:21:39.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:39.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.505551+0000", 2024-09-17T02:21:39.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.061e-05 2024-09-17T02:21:39.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:39.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.505556+0000", 2024-09-17T02:21:39.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7339999999999999e-06 2024-09-17T02:21:39.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:39.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.505594+0000", 2024-09-17T02:21:39.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8018000000000001e-05 2024-09-17T02:21:39.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:39.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.505677+0000", 2024-09-17T02:21:39.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3194000000000003e-05 2024-09-17T02:21:39.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:39.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.505921+0000", 2024-09-17T02:21:39.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024445100000000002 2024-09-17T02:21:39.538 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.538 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:39.538 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.539 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:136264 5.b e54/51)", 2024-09-17T02:21:39.539 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:39.505770+0000", 2024-09-17T02:21:39.539 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.001421947, 2024-09-17T02:21:39.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001745665, 2024-09-17T02:21:39.539 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:39.539 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:39.539 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:39.539 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:39.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:39.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.505770+0000", 2024-09-17T02:21:39.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.540 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:39.540 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.505770+0000", 2024-09-17T02:21:39.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.540 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.540 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:39.540 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.505770+0000", 2024-09-17T02:21:39.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1100000000000001e-07 2024-09-17T02:21:39.540 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.540 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:39.540 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.505773+0000", 2024-09-17T02:21:39.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.942e-06 2024-09-17T02:21:39.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:39.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.505783+0000", 2024-09-17T02:21:39.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0385e-05 2024-09-17T02:21:39.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:39.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.505789+0000", 2024-09-17T02:21:39.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5550000000000002e-06 2024-09-17T02:21:39.541 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.541 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:39.541 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.542 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:136285 5.4 5:2a379676:::benchmark_data_smithi001_23533_object8168:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:39.542 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:39.506367+0000", 2024-09-17T02:21:39.542 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00082418599999999997, 2024-09-17T02:21:39.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001174371, 2024-09-17T02:21:39.542 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:39.542 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:39.542 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:39.542 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:39.542 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:39.542 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:39.542 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 136285 2024-09-17T02:21:39.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.543 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:39.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:39.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506367+0000", 2024-09-17T02:21:39.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:39.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506367+0000", 2024-09-17T02:21:39.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:39.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506368+0000", 2024-09-17T02:21:39.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5899999999999996e-07 2024-09-17T02:21:39.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:39.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506374+0000", 2024-09-17T02:21:39.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0780000000000001e-06 2024-09-17T02:21:39.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:39.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506384+0000", 2024-09-17T02:21:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0351e-05 2024-09-17T02:21:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506391+0000", 2024-09-17T02:21:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3099999999999997e-06 2024-09-17T02:21:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506456+0000", 2024-09-17T02:21:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5275000000000001e-05 2024-09-17T02:21:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506571+0000", 2024-09-17T02:21:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011523099999999999 2024-09-17T02:21:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506676+0000", 2024-09-17T02:21:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000104308 2024-09-17T02:21:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:136286 5.b 5.4be415eb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:39.506424+0000", 2024-09-17T02:21:39.547 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00076708699999999996, 2024-09-17T02:21:39.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011546659999999999, 2024-09-17T02:21:39.547 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:39.547 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:39.547 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:39.547 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:39.547 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:39.547 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:39.547 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 136286 2024-09-17T02:21:39.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.547 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:39.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:39.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506424+0000", 2024-09-17T02:21:39.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.548 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:39.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506424+0000", 2024-09-17T02:21:39.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.548 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:39.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506425+0000", 2024-09-17T02:21:39.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.75e-07 2024-09-17T02:21:39.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:39.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506427+0000", 2024-09-17T02:21:39.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4210000000000002e-06 2024-09-17T02:21:39.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:39.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506439+0000", 2024-09-17T02:21:39.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1523e-05 2024-09-17T02:21:39.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:39.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506451+0000", 2024-09-17T02:21:39.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2564e-05 2024-09-17T02:21:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:136287 5.e 5:76d1cac3:::benchmark_data_smithi001_23533_object8170:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:39.506632+0000", 2024-09-17T02:21:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00055981800000000001, 2024-09-17T02:21:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00098474400000000007, 2024-09-17T02:21:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:39.551 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:39.551 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 136287 2024-09-17T02:21:39.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.551 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:39.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.551 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:39.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506632+0000", 2024-09-17T02:21:39.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.551 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:39.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506632+0000", 2024-09-17T02:21:39.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:39.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506632+0000", 2024-09-17T02:21:39.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1900000000000002e-07 2024-09-17T02:21:39.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:39.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506636+0000", 2024-09-17T02:21:39.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5779999999999999e-06 2024-09-17T02:21:39.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:39.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506646+0000", 2024-09-17T02:21:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8889999999999997e-06 2024-09-17T02:21:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506652+0000", 2024-09-17T02:21:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2530000000000001e-06 2024-09-17T02:21:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506703+0000", 2024-09-17T02:21:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0555e-05 2024-09-17T02:21:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506824+0000", 2024-09-17T02:21:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121203 2024-09-17T02:21:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506953+0000", 2024-09-17T02:21:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012945 2024-09-17T02:21:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:136288 5.d 5:bb4c4978:::benchmark_data_smithi001_23533_object8171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:39.555 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:39.506995+0000", 2024-09-17T02:21:39.555 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00019652100000000001, 2024-09-17T02:21:39.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067905099999999996, 2024-09-17T02:21:39.555 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:39.555 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:39.555 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:39.555 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:39.555 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:39.555 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:39.555 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 136288 2024-09-17T02:21:39.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.556 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:39.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:39.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506995+0000", 2024-09-17T02:21:39.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:39.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506995+0000", 2024-09-17T02:21:39.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506996+0000", 2024-09-17T02:21:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9100000000000003e-07 2024-09-17T02:21:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.506999+0000", 2024-09-17T02:21:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4020000000000002e-06 2024-09-17T02:21:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.507007+0000", 2024-09-17T02:21:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8250000000000005e-06 2024-09-17T02:21:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:39.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.507013+0000", 2024-09-17T02:21:39.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5520000000000001e-06 2024-09-17T02:21:39.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:39.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.507068+0000", 2024-09-17T02:21:39.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4635999999999997e-05 2024-09-17T02:21:39.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:39.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.507186+0000", 2024-09-17T02:21:39.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117518 2024-09-17T02:21:39.559 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.559 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:39.559 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.559 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:136264 5.b 5:d6bf6c0e:::benchmark_data_smithi001_23533_object8147:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:39.559 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:39.496307+0000", 2024-09-17T02:21:39.559 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.010884293999999999, 2024-09-17T02:21:39.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011441385, 2024-09-17T02:21:39.560 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:39.560 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:39.560 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:39.560 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:39.560 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:39.560 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:39.560 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 136264 2024-09-17T02:21:39.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.560 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:39.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:39.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.496307+0000", 2024-09-17T02:21:39.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:39.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.496307+0000", 2024-09-17T02:21:39.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:39.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.496308+0000", 2024-09-17T02:21:39.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2799999999999996e-07 2024-09-17T02:21:39.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.562 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:39.562 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.496311+0000", 2024-09-17T02:21:39.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7039999999999999e-06 2024-09-17T02:21:39.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.562 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:39.562 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.496318+0000", 2024-09-17T02:21:39.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5220000000000001e-06 2024-09-17T02:21:39.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:39.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.496323+0000", 2024-09-17T02:21:39.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4149999999999998e-06 2024-09-17T02:21:39.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:39.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.499107+0000", 2024-09-17T02:21:39.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027832579999999998 2024-09-17T02:21:39.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:39.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.499240+0000", 2024-09-17T02:21:39.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013303800000000001 2024-09-17T02:21:39.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:39.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.499364+0000", 2024-09-17T02:21:39.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012382499999999999 2024-09-17T02:21:39.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:39.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:39.505146+0000", 2024-09-17T02:21:39.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057818909999999999 2024-09-17T02:21:39.564 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.564 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:39.565 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.565 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.565 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:21:39.565 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 14 2024-09-17T02:21:39.565 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:39.566 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:39.567 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:39.569+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:39.667 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:39.670+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:39.759 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:39.759 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:21:39.759 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:21:39.759 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:21:39.759 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:39.767 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:39.770+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:39.780 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:39.869 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:39.873+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:39.939 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:39.939 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:21:39.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:21:39.939 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:39.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.939 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97749 5.b 5:d930ef52:::benchmark_data_smithi001_23533_object97748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:39.939 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:39.939 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.349494308000001, 2024-09-17T02:21:39.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092964343000000005, 2024-09-17T02:21:39.940 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:39.940 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:39.940 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:39.940 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:39.940 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:39.940 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:39.940 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97749 2024-09-17T02:21:39.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.940 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:39.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:39.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:39.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:39.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:39.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:39.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591947+0000", 2024-09-17T02:21:39.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:21:39.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:39.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592011+0000", 2024-09-17T02:21:39.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3608000000000005e-05 2024-09-17T02:21:39.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:39.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592021+0000", 2024-09-17T02:21:39.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9979999999999998e-06 2024-09-17T02:21:39.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:39.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592028+0000", 2024-09-17T02:21:39.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1439999999999997e-06 2024-09-17T02:21:39.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:39.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593633+0000", 2024-09-17T02:21:39.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001604636 2024-09-17T02:21:39.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:39.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593757+0000", 2024-09-17T02:21:39.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012432099999999999 2024-09-17T02:21:39.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:39.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593866+0000", 2024-09-17T02:21:39.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109094 2024-09-17T02:21:39.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:39.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601190+0000", 2024-09-17T02:21:39.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073237620000000002 2024-09-17T02:21:39.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:39.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601356+0000", 2024-09-17T02:21:39.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016651900000000001 2024-09-17T02:21:39.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:39.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684618+0000", 2024-09-17T02:21:39.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083261356999999994 2024-09-17T02:21:39.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:39.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684724+0000", 2024-09-17T02:21:39.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010681800000000001 2024-09-17T02:21:39.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:39.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684911+0000", 2024-09-17T02:21:39.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186243 2024-09-17T02:21:39.946 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.946 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:39.946 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.946 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97752 5.b 5:d146f486:::benchmark_data_smithi001_23533_object97751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:39.946 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:39.946 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.348141613999999, 2024-09-17T02:21:39.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091989557, 2024-09-17T02:21:39.946 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:39.946 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:39.947 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:39.947 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:39.947 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:39.947 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:39.947 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97752 2024-09-17T02:21:39.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.947 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:39.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:39.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:39.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:39.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:39.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:39.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593300+0000", 2024-09-17T02:21:39.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8199999999999998e-07 2024-09-17T02:21:39.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:39.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593364+0000", 2024-09-17T02:21:39.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3831999999999995e-05 2024-09-17T02:21:39.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:39.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593376+0000", 2024-09-17T02:21:39.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1800999999999999e-05 2024-09-17T02:21:39.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:39.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593382+0000", 2024-09-17T02:21:39.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6780000000000003e-06 2024-09-17T02:21:39.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:39.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595491+0000", 2024-09-17T02:21:39.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021090689999999999 2024-09-17T02:21:39.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:39.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595614+0000", 2024-09-17T02:21:39.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012321500000000001 2024-09-17T02:21:39.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:39.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595778+0000", 2024-09-17T02:21:39.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016321900000000001 2024-09-17T02:21:39.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:39.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601197+0000", 2024-09-17T02:21:39.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054195600000000003 2024-09-17T02:21:39.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:39.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601396+0000", 2024-09-17T02:21:39.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019825299999999999 2024-09-17T02:21:39.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:39.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684990+0000", 2024-09-17T02:21:39.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083594878999999997 2024-09-17T02:21:39.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:39.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685116+0000", 2024-09-17T02:21:39.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012522799999999999 2024-09-17T02:21:39.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:39.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685289+0000", 2024-09-17T02:21:39.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172941 2024-09-17T02:21:39.952 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.953 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:39.953 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.953 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97754 5.b 5:da0615e5:::benchmark_data_smithi001_23533_object97753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:39.953 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:39.953 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.346503691999999, 2024-09-17T02:21:39.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092097207, 2024-09-17T02:21:39.953 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:39.953 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:39.953 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:39.953 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:39.953 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:39.953 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:39.954 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97754 2024-09-17T02:21:39.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.954 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:39.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:39.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:39.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:39.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:39.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:39.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594938+0000", 2024-09-17T02:21:39.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5000000000000002e-07 2024-09-17T02:21:39.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:39.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595075+0000", 2024-09-17T02:21:39.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137742 2024-09-17T02:21:39.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:39.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595087+0000", 2024-09-17T02:21:39.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1243000000000001e-05 2024-09-17T02:21:39.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:39.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595095+0000", 2024-09-17T02:21:39.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1030000000000002e-06 2024-09-17T02:21:39.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:39.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598461+0000", 2024-09-17T02:21:39.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033661170000000001 2024-09-17T02:21:39.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:39.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598540+0000", 2024-09-17T02:21:39.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8937999999999995e-05 2024-09-17T02:21:39.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:39.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598626+0000", 2024-09-17T02:21:39.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6042000000000001e-05 2024-09-17T02:21:39.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:39.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684258+0000", 2024-09-17T02:21:39.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085632394000000001 2024-09-17T02:21:39.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:39.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685369+0000", 2024-09-17T02:21:39.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001111063 2024-09-17T02:21:39.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:39.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685511+0000", 2024-09-17T02:21:39.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141965 2024-09-17T02:21:39.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:39.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685604+0000", 2024-09-17T02:21:39.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2935000000000004e-05 2024-09-17T02:21:39.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:39.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687034+0000", 2024-09-17T02:21:39.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001430015 2024-09-17T02:21:39.959 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.959 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:39.959 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.959 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97755 5.b 5:d36a03a1:::benchmark_data_smithi001_23533_object97754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:39.959 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:39.959 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.346330542, 2024-09-17T02:21:39.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0924904, 2024-09-17T02:21:39.959 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:39.960 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:39.960 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:39.960 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:39.960 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:39.960 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:39.960 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97755 2024-09-17T02:21:39.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.960 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:39.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:39.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:39.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:39.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:39.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:39.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595111+0000", 2024-09-17T02:21:39.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:21:39.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:39.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595145+0000", 2024-09-17T02:21:39.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3927000000000002e-05 2024-09-17T02:21:39.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:39.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595155+0000", 2024-09-17T02:21:39.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0023e-05 2024-09-17T02:21:39.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:39.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595162+0000", 2024-09-17T02:21:39.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3950000000000003e-06 2024-09-17T02:21:39.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:39.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599821+0000", 2024-09-17T02:21:39.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046592880000000001 2024-09-17T02:21:39.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:39.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599912+0000", 2024-09-17T02:21:39.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1049000000000002e-05 2024-09-17T02:21:39.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:39.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600062+0000", 2024-09-17T02:21:39.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015001700000000001 2024-09-17T02:21:39.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:39.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685307+0000", 2024-09-17T02:21:39.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085244340000000002 2024-09-17T02:21:39.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:39.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685446+0000", 2024-09-17T02:21:39.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013955700000000001 2024-09-17T02:21:39.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:39.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687375+0000", 2024-09-17T02:21:39.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019291079999999999 2024-09-17T02:21:39.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:39.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687462+0000", 2024-09-17T02:21:39.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6148000000000003e-05 2024-09-17T02:21:39.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:39.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687600+0000", 2024-09-17T02:21:39.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013887900000000001 2024-09-17T02:21:39.965 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.965 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:39.965 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.966 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 44/44 lb 5:c4567a04:::benchmark_data_smithi001_23533_object4200:head)", 2024-09-17T02:21:39.966 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:39.966 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.344233916, 2024-09-17T02:21:39.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092483421999999996, 2024-09-17T02:21:39.966 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:39.966 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:39.966 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:39.966 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:39.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:39.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:39.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:39.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:39.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:39.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:39.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6399999999999998e-07 2024-09-17T02:21:39.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:39.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597213+0000", 2024-09-17T02:21:39.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3659999999999997e-06 2024-09-17T02:21:39.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:39.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597222+0000", 2024-09-17T02:21:39.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0510000000000002e-06 2024-09-17T02:21:39.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:39.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597228+0000", 2024-09-17T02:21:39.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1569999999999999e-06 2024-09-17T02:21:39.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:39.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689588+0000", 2024-09-17T02:21:39.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092359931000000006 2024-09-17T02:21:39.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:39.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689622+0000", 2024-09-17T02:21:39.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4425999999999999e-05 2024-09-17T02:21:39.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:39.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689690+0000", 2024-09-17T02:21:39.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8126999999999993e-05 2024-09-17T02:21:39.969 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.969 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:39.970 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.970 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129462 5.4 5:2e0acc16:::benchmark_data_smithi001_23533_object1345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:39.970 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:21:39.970 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.4064998470000001, 2024-09-17T02:21:39.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0112774899999999, 2024-09-17T02:21:39.970 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:39.970 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:39.970 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:39.970 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:39.970 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:39.970 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:39.971 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129462 2024-09-17T02:21:39.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.971 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:39.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:39.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:21:39.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:39.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:21:39.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:39.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534943+0000", 2024-09-17T02:21:39.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8759999999999999e-06 2024-09-17T02:21:39.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:39.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534951+0000", 2024-09-17T02:21:39.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3219999999999993e-06 2024-09-17T02:21:39.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:39.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534977+0000", 2024-09-17T02:21:39.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6245e-05 2024-09-17T02:21:39.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:39.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534992+0000", 2024-09-17T02:21:39.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4936000000000001e-05 2024-09-17T02:21:39.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:39.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535133+0000", 2024-09-17T02:21:39.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014051299999999999 2024-09-17T02:21:39.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:39.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:21:39.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1741000000000001e-05 2024-09-17T02:21:39.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:39.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.533906+0000", 2024-09-17T02:21:39.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99875209300000001 2024-09-17T02:21:39.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:39.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534348+0000", 2024-09-17T02:21:39.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044128899999999998 2024-09-17T02:21:39.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:39.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534762+0000", 2024-09-17T02:21:39.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000414707 2024-09-17T02:21:39.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:39.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545024+0000", 2024-09-17T02:21:39.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010261283 2024-09-17T02:21:39.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:39.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545953+0000", 2024-09-17T02:21:39.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000929618 2024-09-17T02:21:39.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:39.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546047+0000", 2024-09-17T02:21:39.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3697999999999996e-05 2024-09-17T02:21:39.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:39.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546218+0000", 2024-09-17T02:21:39.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017116899999999999 2024-09-17T02:21:39.976 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.976 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:39.976 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.977 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129480 5.4 5:2b1d398b:::benchmark_data_smithi001_23533_object1363:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:39.977 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:21:39.977 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.3987453810000003, 2024-09-17T02:21:39.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0038926450000001, 2024-09-17T02:21:39.977 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:39.977 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:39.977 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:39.977 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:39.977 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:39.977 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:39.977 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129480 2024-09-17T02:21:39.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.977 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:39.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:39.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:21:39.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:39.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:21:39.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:39.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542696+0000", 2024-09-17T02:21:39.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9999999999999995e-07 2024-09-17T02:21:39.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:39.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542701+0000", 2024-09-17T02:21:39.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2240000000000003e-06 2024-09-17T02:21:39.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:39.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542716+0000", 2024-09-17T02:21:39.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4970000000000001e-05 2024-09-17T02:21:39.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:39.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542726+0000", 2024-09-17T02:21:39.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2879999999999998e-06 2024-09-17T02:21:39.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:39.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542832+0000", 2024-09-17T02:21:39.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010597199999999999 2024-09-17T02:21:39.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:39.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542843+0000", 2024-09-17T02:21:39.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.098e-05 2024-09-17T02:21:39.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:39.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538436+0000", 2024-09-17T02:21:39.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99559286800000002 2024-09-17T02:21:39.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:39.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538791+0000", 2024-09-17T02:21:39.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035585499999999997 2024-09-17T02:21:39.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:39.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.539144+0000", 2024-09-17T02:21:39.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035268499999999999 2024-09-17T02:21:39.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:39.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545880+0000", 2024-09-17T02:21:39.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00673552 2024-09-17T02:21:39.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:39.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546330+0000", 2024-09-17T02:21:39.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045039599999999999 2024-09-17T02:21:39.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:39.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546414+0000", 2024-09-17T02:21:39.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4468000000000005e-05 2024-09-17T02:21:39.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:39.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546588+0000", 2024-09-17T02:21:39.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017341899999999999 2024-09-17T02:21:39.983 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.983 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:39.983 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.983 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129505 5.4 5:294f2ec7:::benchmark_data_smithi001_23533_object1388:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:39.983 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:21:39.983 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.3797322080000001, 2024-09-17T02:21:39.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98589826199999997, 2024-09-17T02:21:39.983 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:39.984 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:39.984 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:39.984 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:39.984 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:39.984 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:39.984 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129505 2024-09-17T02:21:39.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.984 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:39.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:39.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:21:39.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:39.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:21:39.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:39.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561710+0000", 2024-09-17T02:21:39.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7060000000000001e-06 2024-09-17T02:21:39.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:39.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561718+0000", 2024-09-17T02:21:39.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.542e-06 2024-09-17T02:21:39.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:39.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561741+0000", 2024-09-17T02:21:39.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3357e-05 2024-09-17T02:21:39.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:39.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561754+0000", 2024-09-17T02:21:39.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3200000000000001e-05 2024-09-17T02:21:39.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:39.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561867+0000", 2024-09-17T02:21:39.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113211 2024-09-17T02:21:39.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:39.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561888+0000", 2024-09-17T02:21:39.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0809999999999999e-05 2024-09-17T02:21:39.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:39.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542140+0000", 2024-09-17T02:21:39.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98025195799999998 2024-09-17T02:21:39.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:39.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542331+0000", 2024-09-17T02:21:39.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019127599999999999 2024-09-17T02:21:39.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:39.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542517+0000", 2024-09-17T02:21:39.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000185625 2024-09-17T02:21:39.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:39.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547114+0000", 2024-09-17T02:21:39.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045968620000000002 2024-09-17T02:21:39.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:39.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547187+0000", 2024-09-17T02:21:39.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3348000000000003e-05 2024-09-17T02:21:39.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:39.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547324+0000", 2024-09-17T02:21:39.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013681699999999999 2024-09-17T02:21:39.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:39.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547607+0000", 2024-09-17T02:21:39.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028255000000000001 2024-09-17T02:21:39.990 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.990 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:39.990 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.990 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129508 5.4 5:2892b582:::benchmark_data_smithi001_23533_object1391:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:39.990 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:21:39.990 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.378395115, 2024-09-17T02:21:39.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99697919099999999, 2024-09-17T02:21:39.990 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:39.991 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:39.991 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:39.991 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:39.991 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:39.991 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:39.991 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129508 2024-09-17T02:21:39.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.991 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:39.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:39.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:21:39.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:39.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:21:39.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:39.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563047+0000", 2024-09-17T02:21:39.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.274e-06 2024-09-17T02:21:39.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:39.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563054+0000", 2024-09-17T02:21:39.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2799999999999998e-06 2024-09-17T02:21:39.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:39.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563070+0000", 2024-09-17T02:21:39.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5991999999999999e-05 2024-09-17T02:21:39.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:39.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563078+0000", 2024-09-17T02:21:39.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2390000000000002e-06 2024-09-17T02:21:39.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:39.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563181+0000", 2024-09-17T02:21:39.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102249 2024-09-17T02:21:39.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:39.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563199+0000", 2024-09-17T02:21:39.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8215000000000001e-05 2024-09-17T02:21:39.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:39.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547713+0000", 2024-09-17T02:21:39.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98451446399999998 2024-09-17T02:21:39.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:39.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548063+0000", 2024-09-17T02:21:39.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034985499999999999 2024-09-17T02:21:39.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:39.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548490+0000", 2024-09-17T02:21:39.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042658600000000001 2024-09-17T02:21:39.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:39.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555655+0000", 2024-09-17T02:21:39.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071652579999999999 2024-09-17T02:21:39.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:39.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559612+0000", 2024-09-17T02:21:39.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003957103 2024-09-17T02:21:39.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:39.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559768+0000", 2024-09-17T02:21:39.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015556899999999999 2024-09-17T02:21:39.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:39.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560025+0000", 2024-09-17T02:21:39.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025710700000000002 2024-09-17T02:21:39.997 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.997 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:39.997 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:39.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.997 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129509 5.4 5:2c35515e:::benchmark_data_smithi001_23533_object1392:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:39.997 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:21:39.997 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.3777680620000003, 2024-09-17T02:21:39.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99969384900000002, 2024-09-17T02:21:39.997 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:39.997 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:39.998 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:39.998 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:39.998 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:39.998 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:39.998 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129509 2024-09-17T02:21:39.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.998 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:39.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:39.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:21:39.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:39.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:21:39.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:39.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:39.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563674+0000", 2024-09-17T02:21:39.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0920000000000001e-06 2024-09-17T02:21:39.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:39.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:39.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563679+0000", 2024-09-17T02:21:39.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7660000000000004e-06 2024-09-17T02:21:39.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:39.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:40.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563693+0000", 2024-09-17T02:21:40.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3139000000000001e-05 2024-09-17T02:21:40.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563701+0000", 2024-09-17T02:21:40.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9859999999999994e-06 2024-09-17T02:21:40.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563775+0000", 2024-09-17T02:21:40.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4659000000000005e-05 2024-09-17T02:21:40.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:40.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563785+0000", 2024-09-17T02:21:40.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4839999999999993e-06 2024-09-17T02:21:40.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552085+0000", 2024-09-17T02:21:40.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98829986999999997 2024-09-17T02:21:40.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:40.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552554+0000", 2024-09-17T02:21:40.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046908900000000001 2024-09-17T02:21:40.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:40.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552931+0000", 2024-09-17T02:21:40.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377778 2024-09-17T02:21:40.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:40.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563106+0000", 2024-09-17T02:21:40.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010174186 2024-09-17T02:21:40.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:40.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563138+0000", 2024-09-17T02:21:40.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2495e-05 2024-09-17T02:21:40.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:40.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563225+0000", 2024-09-17T02:21:40.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6677999999999999e-05 2024-09-17T02:21:40.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:40.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563366+0000", 2024-09-17T02:21:40.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014162699999999999 2024-09-17T02:21:40.004 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.004 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:40.004 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.004 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129524 5.4 5:25dca7dd:::benchmark_data_smithi001_23533_object1407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:40.004 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:21:40.004 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.3710767080000004, 2024-09-17T02:21:40.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99999501999999996, 2024-09-17T02:21:40.004 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:40.004 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:40.004 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.004 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:40.005 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:40.005 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.005 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129524 2024-09-17T02:21:40.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.005 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:40.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:40.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:21:40.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:40.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:21:40.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:40.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570365+0000", 2024-09-17T02:21:40.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.142e-06 2024-09-17T02:21:40.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:40.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570369+0000", 2024-09-17T02:21:40.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.856e-06 2024-09-17T02:21:40.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:40.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570385+0000", 2024-09-17T02:21:40.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5855e-05 2024-09-17T02:21:40.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570392+0000", 2024-09-17T02:21:40.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5340000000000002e-06 2024-09-17T02:21:40.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570484+0000", 2024-09-17T02:21:40.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1212999999999996e-05 2024-09-17T02:21:40.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:40.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570498+0000", 2024-09-17T02:21:40.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4331000000000001e-05 2024-09-17T02:21:40.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555835+0000", 2024-09-17T02:21:40.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98533757700000002 2024-09-17T02:21:40.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:40.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556329+0000", 2024-09-17T02:21:40.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000493458 2024-09-17T02:21:40.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:40.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556784+0000", 2024-09-17T02:21:40.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045476499999999999 2024-09-17T02:21:40.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:40.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569852+0000", 2024-09-17T02:21:40.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013068270999999999 2024-09-17T02:21:40.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:40.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569958+0000", 2024-09-17T02:21:40.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106214 2024-09-17T02:21:40.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:40.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570124+0000", 2024-09-17T02:21:40.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165546 2024-09-17T02:21:40.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:40.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570359+0000", 2024-09-17T02:21:40.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023525799999999999 2024-09-17T02:21:40.010 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.011 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:40.011 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.011 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129537 5.4 5:260327c6:::benchmark_data_smithi001_23533_object1420:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:40.011 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:21:40.011 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.3631701789999999, 2024-09-17T02:21:40.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99624596499999996, 2024-09-17T02:21:40.011 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:40.011 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:40.011 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.011 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:40.011 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:40.012 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.012 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129537 2024-09-17T02:21:40.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.012 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:40.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:40.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:21:40.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:40.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:21:40.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:40.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578272+0000", 2024-09-17T02:21:40.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.164e-06 2024-09-17T02:21:40.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:40.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578278+0000", 2024-09-17T02:21:40.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5060000000000001e-06 2024-09-17T02:21:40.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:40.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578294+0000", 2024-09-17T02:21:40.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5687000000000001e-05 2024-09-17T02:21:40.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578329+0000", 2024-09-17T02:21:40.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5311999999999997e-05 2024-09-17T02:21:40.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578419+0000", 2024-09-17T02:21:40.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0054000000000002e-05 2024-09-17T02:21:40.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:40.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578435+0000", 2024-09-17T02:21:40.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5645999999999999e-05 2024-09-17T02:21:40.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560148+0000", 2024-09-17T02:21:40.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98171342299999997 2024-09-17T02:21:40.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:40.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560383+0000", 2024-09-17T02:21:40.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000234935 2024-09-17T02:21:40.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:40.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560586+0000", 2024-09-17T02:21:40.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000202909 2024-09-17T02:21:40.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:40.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570472+0000", 2024-09-17T02:21:40.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098856959999999994 2024-09-17T02:21:40.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:40.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574138+0000", 2024-09-17T02:21:40.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036660170000000001 2024-09-17T02:21:40.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:40.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574298+0000", 2024-09-17T02:21:40.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016025600000000001 2024-09-17T02:21:40.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:40.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574516+0000", 2024-09-17T02:21:40.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021835999999999999 2024-09-17T02:21:40.017 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.017 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:40.017 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.018 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129545 5.4 5:22366489:::benchmark_data_smithi001_23533_object1428:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:40.018 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:21:40.018 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.357307456, 2024-09-17T02:21:40.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99074544499999995, 2024-09-17T02:21:40.018 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:40.018 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:40.018 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.018 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:40.018 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:40.018 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.018 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129545 2024-09-17T02:21:40.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.019 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:40.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:40.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:21:40.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:40.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:21:40.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:40.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584135+0000", 2024-09-17T02:21:40.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4699999999999999e-06 2024-09-17T02:21:40.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:40.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584142+0000", 2024-09-17T02:21:40.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1620000000000002e-06 2024-09-17T02:21:40.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:40.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584170+0000", 2024-09-17T02:21:40.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7897000000000001e-05 2024-09-17T02:21:40.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584183+0000", 2024-09-17T02:21:40.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2814e-05 2024-09-17T02:21:40.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584299+0000", 2024-09-17T02:21:40.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116153 2024-09-17T02:21:40.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:40.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584316+0000", 2024-09-17T02:21:40.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7524999999999999e-05 2024-09-17T02:21:40.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563461+0000", 2024-09-17T02:21:40.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97914436699999996 2024-09-17T02:21:40.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:40.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563667+0000", 2024-09-17T02:21:40.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020689800000000001 2024-09-17T02:21:40.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:40.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563878+0000", 2024-09-17T02:21:40.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210275 2024-09-17T02:21:40.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:40.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570584+0000", 2024-09-17T02:21:40.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067066080000000002 2024-09-17T02:21:40.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:40.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574539+0000", 2024-09-17T02:21:40.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039550360000000003 2024-09-17T02:21:40.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:40.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574653+0000", 2024-09-17T02:21:40.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114003 2024-09-17T02:21:40.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:40.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574879+0000", 2024-09-17T02:21:40.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022523700000000001 2024-09-17T02:21:40.024 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.024 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:40.024 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.025 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129553 5.4 5:2e41ad40:::benchmark_data_smithi001_23533_object1436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:40.025 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:21:40.025 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.3518848200000004, 2024-09-17T02:21:40.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99213429600000003, 2024-09-17T02:21:40.025 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:40.025 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:40.025 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.025 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:40.025 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:40.025 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.025 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129553 2024-09-17T02:21:40.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.026 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:40.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:40.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:21:40.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:40.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:21:40.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:40.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589557+0000", 2024-09-17T02:21:40.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2219999999999999e-06 2024-09-17T02:21:40.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:40.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589562+0000", 2024-09-17T02:21:40.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0649999999999998e-06 2024-09-17T02:21:40.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:40.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589575+0000", 2024-09-17T02:21:40.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3129000000000001e-05 2024-09-17T02:21:40.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589584+0000", 2024-09-17T02:21:40.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6200000000000005e-06 2024-09-17T02:21:40.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589693+0000", 2024-09-17T02:21:40.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109319 2024-09-17T02:21:40.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:40.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589714+0000", 2024-09-17T02:21:40.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0849999999999999e-05 2024-09-17T02:21:40.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566273+0000", 2024-09-17T02:21:40.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97655884999999998 2024-09-17T02:21:40.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:40.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566543+0000", 2024-09-17T02:21:40.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027059099999999998 2024-09-17T02:21:40.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:40.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566832+0000", 2024-09-17T02:21:40.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028898200000000002 2024-09-17T02:21:40.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:40.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581040+0000", 2024-09-17T02:21:40.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014208001 2024-09-17T02:21:40.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:40.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581200+0000", 2024-09-17T02:21:40.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159956 2024-09-17T02:21:40.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:40.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581427+0000", 2024-09-17T02:21:40.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000226309 2024-09-17T02:21:40.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:40.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581690+0000", 2024-09-17T02:21:40.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026340199999999998 2024-09-17T02:21:40.031 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.031 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:40.031 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.032 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129580 5.4 5:25ed887b:::benchmark_data_smithi001_23533_object1463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:40.032 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:21:40.032 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.330112776, 2024-09-17T02:21:40.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98001430499999997, 2024-09-17T02:21:40.032 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:40.032 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:40.032 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.032 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:40.032 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:40.032 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.032 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129580 2024-09-17T02:21:40.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.032 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:40.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:40.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:21:40.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:40.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:21:40.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:40.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611329+0000", 2024-09-17T02:21:40.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.22e-06 2024-09-17T02:21:40.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:40.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611335+0000", 2024-09-17T02:21:40.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1129999999999997e-06 2024-09-17T02:21:40.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:40.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611348+0000", 2024-09-17T02:21:40.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2342e-05 2024-09-17T02:21:40.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611356+0000", 2024-09-17T02:21:40.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.371e-06 2024-09-17T02:21:40.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611419+0000", 2024-09-17T02:21:40.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3393999999999996e-05 2024-09-17T02:21:40.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:40.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611427+0000", 2024-09-17T02:21:40.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999997e-06 2024-09-17T02:21:40.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570705+0000", 2024-09-17T02:21:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.95927859199999999 2024-09-17T02:21:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571009+0000", 2024-09-17T02:21:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030414599999999998 2024-09-17T02:21:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571241+0000", 2024-09-17T02:21:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023106799999999999 2024-09-17T02:21:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590789+0000", 2024-09-17T02:21:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019548763 2024-09-17T02:21:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590928+0000", 2024-09-17T02:21:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000139092 2024-09-17T02:21:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591086+0000", 2024-09-17T02:21:40.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015787400000000001 2024-09-17T02:21:40.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:40.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591342+0000", 2024-09-17T02:21:40.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025589900000000002 2024-09-17T02:21:40.038 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.038 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:40.038 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.038 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129603 5.4 5:25aaa5e8:::benchmark_data_smithi001_23533_object1486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:40.038 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:40.039 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.3140529799999996, 2024-09-17T02:21:40.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96463198999999999, 2024-09-17T02:21:40.039 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:40.039 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:40.039 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.039 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:40.039 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:40.039 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.039 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129603 2024-09-17T02:21:40.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.039 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:40.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:40.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:40.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:40.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:40.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:40.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:40.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:21:40.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:40.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627392+0000", 2024-09-17T02:21:40.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0790000000000002e-06 2024-09-17T02:21:40.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:40.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627403+0000", 2024-09-17T02:21:40.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0866000000000001e-05 2024-09-17T02:21:40.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627409+0000", 2024-09-17T02:21:40.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.305e-06 2024-09-17T02:21:40.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627485+0000", 2024-09-17T02:21:40.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6582000000000006e-05 2024-09-17T02:21:40.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:40.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627499+0000", 2024-09-17T02:21:40.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:21:40.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574991+0000", 2024-09-17T02:21:40.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94749182300000001 2024-09-17T02:21:40.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:40.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575377+0000", 2024-09-17T02:21:40.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038629400000000003 2024-09-17T02:21:40.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:40.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575665+0000", 2024-09-17T02:21:40.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028759499999999997 2024-09-17T02:21:40.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:40.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590802+0000", 2024-09-17T02:21:40.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015136479 2024-09-17T02:21:40.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:40.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591614+0000", 2024-09-17T02:21:40.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081293100000000003 2024-09-17T02:21:40.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:40.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591764+0000", 2024-09-17T02:21:40.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014932199999999999 2024-09-17T02:21:40.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:40.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592020+0000", 2024-09-17T02:21:40.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025585099999999997 2024-09-17T02:21:40.044 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.045 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:40.045 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.045 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129607 5.4 5:2f638f1e:::benchmark_data_smithi001_23533_object1490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:40.045 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:21:40.045 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.312526074, 2024-09-17T02:21:40.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96352375899999998, 2024-09-17T02:21:40.045 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:40.045 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:40.045 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.045 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:40.045 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:40.045 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.046 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129607 2024-09-17T02:21:40.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.046 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:40.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:40.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:21:40.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:40.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:21:40.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:40.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628916+0000", 2024-09-17T02:21:40.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1710000000000001e-06 2024-09-17T02:21:40.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:40.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628920+0000", 2024-09-17T02:21:40.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-17T02:21:40.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:40.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628935+0000", 2024-09-17T02:21:40.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4474000000000001e-05 2024-09-17T02:21:40.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628944+0000", 2024-09-17T02:21:40.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9940000000000006e-06 2024-09-17T02:21:40.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628997+0000", 2024-09-17T02:21:40.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3579000000000003e-05 2024-09-17T02:21:40.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:40.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.629006+0000", 2024-09-17T02:21:40.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4009999999999997e-06 2024-09-17T02:21:40.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.577862+0000", 2024-09-17T02:21:40.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.948856335 2024-09-17T02:21:40.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:40.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578167+0000", 2024-09-17T02:21:40.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030532399999999999 2024-09-17T02:21:40.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:40.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578532+0000", 2024-09-17T02:21:40.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036428200000000001 2024-09-17T02:21:40.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:40.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591442+0000", 2024-09-17T02:21:40.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012910374000000001 2024-09-17T02:21:40.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:40.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592164+0000", 2024-09-17T02:21:40.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072242499999999996 2024-09-17T02:21:40.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:40.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592267+0000", 2024-09-17T02:21:40.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102205 2024-09-17T02:21:40.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:40.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592438+0000", 2024-09-17T02:21:40.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017165299999999999 2024-09-17T02:21:40.051 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.051 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:40.051 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.051 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129623 5.4 5:2cf5174b:::benchmark_data_smithi001_23533_object1506:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:40.051 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:21:40.051 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.2885817880000001, 2024-09-17T02:21:40.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94334114499999999, 2024-09-17T02:21:40.051 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:40.051 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:40.051 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.051 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:40.052 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:40.052 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.052 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129623 2024-09-17T02:21:40.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.052 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:40.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:40.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:21:40.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:40.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:21:40.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:40.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652860+0000", 2024-09-17T02:21:40.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0330000000000001e-06 2024-09-17T02:21:40.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:40.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652864+0000", 2024-09-17T02:21:40.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.634e-06 2024-09-17T02:21:40.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:40.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652877+0000", 2024-09-17T02:21:40.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2591e-05 2024-09-17T02:21:40.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652883+0000", 2024-09-17T02:21:40.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1460000000000001e-06 2024-09-17T02:21:40.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652943+0000", 2024-09-17T02:21:40.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9833999999999997e-05 2024-09-17T02:21:40.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:40.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652950+0000", 2024-09-17T02:21:40.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.401e-06 2024-09-17T02:21:40.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581800+0000", 2024-09-17T02:21:40.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.92884935700000004 2024-09-17T02:21:40.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:40.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582122+0000", 2024-09-17T02:21:40.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032185200000000002 2024-09-17T02:21:40.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:40.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582689+0000", 2024-09-17T02:21:40.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056750400000000003 2024-09-17T02:21:40.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:40.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591458+0000", 2024-09-17T02:21:40.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008768685 2024-09-17T02:21:40.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:40.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595856+0000", 2024-09-17T02:21:40.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043977909999999999 2024-09-17T02:21:40.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:40.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595955+0000", 2024-09-17T02:21:40.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9166000000000006e-05 2024-09-17T02:21:40.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:40.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596200+0000", 2024-09-17T02:21:40.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024515099999999998 2024-09-17T02:21:40.057 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.057 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:40.057 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.057 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129642 5.4 5:255eb796:::benchmark_data_smithi001_23533_object1525:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:40.057 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:21:40.058 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.2573456240000001, 2024-09-17T02:21:40.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.91257397299999998, 2024-09-17T02:21:40.058 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:40.058 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:40.058 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.058 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:40.058 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:40.058 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.058 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129642 2024-09-17T02:21:40.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.058 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:40.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:40.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:21:40.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:40.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:21:40.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:40.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684096+0000", 2024-09-17T02:21:40.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659999999999999e-06 2024-09-17T02:21:40.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:40.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684101+0000", 2024-09-17T02:21:40.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8110000000000002e-06 2024-09-17T02:21:40.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:40.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684114+0000", 2024-09-17T02:21:40.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2653000000000001e-05 2024-09-17T02:21:40.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684121+0000", 2024-09-17T02:21:40.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5100000000000001e-06 2024-09-17T02:21:40.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684181+0000", 2024-09-17T02:21:40.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0307999999999999e-05 2024-09-17T02:21:40.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:40.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684194+0000", 2024-09-17T02:21:40.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2916e-05 2024-09-17T02:21:40.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.587917+0000", 2024-09-17T02:21:40.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.90372220400000003 2024-09-17T02:21:40.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:40.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588215+0000", 2024-09-17T02:21:40.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029845400000000003 2024-09-17T02:21:40.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:40.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588470+0000", 2024-09-17T02:21:40.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025455399999999999 2024-09-17T02:21:40.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:40.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596318+0000", 2024-09-17T02:21:40.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078485589999999997 2024-09-17T02:21:40.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:40.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596354+0000", 2024-09-17T02:21:40.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5976999999999998e-05 2024-09-17T02:21:40.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:40.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596449+0000", 2024-09-17T02:21:40.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4728999999999994e-05 2024-09-17T02:21:40.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:40.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596669+0000", 2024-09-17T02:21:40.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220132 2024-09-17T02:21:40.064 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.064 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:40.064 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.064 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129649 5.4 5:2fe27050:::benchmark_data_smithi001_23533_object1532:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:40.064 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:21:40.064 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.2257888809999997, 2024-09-17T02:21:40.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.88508119100000004, 2024-09-17T02:21:40.064 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:40.064 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:40.064 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.064 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:40.064 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:40.065 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.065 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129649 2024-09-17T02:21:40.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.065 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:40.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:40.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:21:40.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:40.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:21:40.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:40.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715653+0000", 2024-09-17T02:21:40.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3519999999999999e-06 2024-09-17T02:21:40.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:40.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715658+0000", 2024-09-17T02:21:40.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3120000000000001e-06 2024-09-17T02:21:40.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:40.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715677+0000", 2024-09-17T02:21:40.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-17T02:21:40.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715687+0000", 2024-09-17T02:21:40.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0146000000000001e-05 2024-09-17T02:21:40.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715821+0000", 2024-09-17T02:21:40.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013421 2024-09-17T02:21:40.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:40.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715840+0000", 2024-09-17T02:21:40.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8153999999999999e-05 2024-09-17T02:21:40.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592528+0000", 2024-09-17T02:21:40.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.87668860000000004 2024-09-17T02:21:40.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:40.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592702+0000", 2024-09-17T02:21:40.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017429300000000001 2024-09-17T02:21:40.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:40.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592945+0000", 2024-09-17T02:21:40.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000242048 2024-09-17T02:21:40.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:40.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600234+0000", 2024-09-17T02:21:40.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072897600000000002 2024-09-17T02:21:40.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:40.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600494+0000", 2024-09-17T02:21:40.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000259984 2024-09-17T02:21:40.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:40.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600555+0000", 2024-09-17T02:21:40.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1138999999999999e-05 2024-09-17T02:21:40.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:40.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600733+0000", 2024-09-17T02:21:40.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017753300000000001 2024-09-17T02:21:40.070 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.070 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:40.070 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.070 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.070 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:40.070 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:40.072 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:40.072 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:40.077+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:40.175 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:40.174+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:40.226 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:40.226 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:40.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.226 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:137985 5.a 5:5e5e1d04:::benchmark_data_smithi001_23533_object9868:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:40.226 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.221704+0000", 2024-09-17T02:21:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0089221230000000006, 2024-09-17T02:21:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089471340000000007, 2024-09-17T02:21:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 137985 2024-09-17T02:21:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.221704+0000", 2024-09-17T02:21:40.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.221704+0000", 2024-09-17T02:21:40.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.221704+0000", 2024-09-17T02:21:40.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2399999999999998e-07 2024-09-17T02:21:40.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.221706+0000", 2024-09-17T02:21:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1459999999999999e-06 2024-09-17T02:21:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.221712+0000", 2024-09-17T02:21:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1369999999999999e-06 2024-09-17T02:21:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.221718+0000", 2024-09-17T02:21:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2939999999999996e-06 2024-09-17T02:21:40.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.227524+0000", 2024-09-17T02:21:40.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058062740000000002 2024-09-17T02:21:40.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.227635+0000", 2024-09-17T02:21:40.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111066 2024-09-17T02:21:40.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:40.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.227736+0000", 2024-09-17T02:21:40.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010101400000000001 2024-09-17T02:21:40.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:40.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230342+0000", 2024-09-17T02:21:40.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002606297 2024-09-17T02:21:40.231 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.231 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.231 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.231 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:137991 5.c 5:32d57200:::benchmark_data_smithi001_23533_object9874:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:40.232 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.227279+0000", 2024-09-17T02:21:40.232 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.003346389, 2024-09-17T02:21:40.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034677309999999999, 2024-09-17T02:21:40.232 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.232 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.232 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:40.232 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:40.232 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:40.232 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.232 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 137991 2024-09-17T02:21:40.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.232 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.227279+0000", 2024-09-17T02:21:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.227279+0000", 2024-09-17T02:21:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.227280+0000", 2024-09-17T02:21:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7700000000000003e-07 2024-09-17T02:21:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.227284+0000", 2024-09-17T02:21:40.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2629999999999997e-06 2024-09-17T02:21:40.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.227294+0000", 2024-09-17T02:21:40.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4469999999999995e-06 2024-09-17T02:21:40.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.227302+0000", 2024-09-17T02:21:40.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1159999999999999e-06 2024-09-17T02:21:40.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.227790+0000", 2024-09-17T02:21:40.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000488059 2024-09-17T02:21:40.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.227894+0000", 2024-09-17T02:21:40.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010381400000000001 2024-09-17T02:21:40.237 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.237 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.237 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.237 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:137992 5.8 5:199c5216:::benchmark_data_smithi001_23533_object9875:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:40.237 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.227315+0000", 2024-09-17T02:21:40.237 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.003310969, 2024-09-17T02:21:40.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00350016, 2024-09-17T02:21:40.237 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.237 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.238 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:40.238 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:40.238 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:40.238 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.238 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 137992 2024-09-17T02:21:40.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.238 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.227315+0000", 2024-09-17T02:21:40.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.227315+0000", 2024-09-17T02:21:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.227315+0000", 2024-09-17T02:21:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0500000000000004e-07 2024-09-17T02:21:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.227318+0000", 2024-09-17T02:21:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.525e-06 2024-09-17T02:21:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.227324+0000", 2024-09-17T02:21:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.528e-06 2024-09-17T02:21:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.227329+0000", 2024-09-17T02:21:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.091e-06 2024-09-17T02:21:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.227378+0000", 2024-09-17T02:21:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8736999999999998e-05 2024-09-17T02:21:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.227482+0000", 2024-09-17T02:21:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104005 2024-09-17T02:21:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.227580+0000", 2024-09-17T02:21:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7687000000000002e-05 2024-09-17T02:21:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:137994 5.8 5:161c96f6:::benchmark_data_smithi001_23533_object9877:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.229687+0000", 2024-09-17T02:21:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00093864299999999996, 2024-09-17T02:21:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001193204, 2024-09-17T02:21:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 137994 2024-09-17T02:21:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.229687+0000", 2024-09-17T02:21:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.229687+0000", 2024-09-17T02:21:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.229688+0000", 2024-09-17T02:21:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6700000000000003e-07 2024-09-17T02:21:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.229691+0000", 2024-09-17T02:21:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1319999999999998e-06 2024-09-17T02:21:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.229699+0000", 2024-09-17T02:21:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8849999999999999e-06 2024-09-17T02:21:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.229705+0000", 2024-09-17T02:21:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0929999999999999e-06 2024-09-17T02:21:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.229779+0000", 2024-09-17T02:21:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3924000000000006e-05 2024-09-17T02:21:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.229920+0000", 2024-09-17T02:21:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014126500000000001 2024-09-17T02:21:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230036+0000", 2024-09-17T02:21:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011615 2024-09-17T02:21:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:137997 5.2 5:4663ca6c:::benchmark_data_smithi001_23533_object9880:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.230277+0000", 2024-09-17T02:21:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.000348919, 2024-09-17T02:21:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000670136, 2024-09-17T02:21:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 137997 2024-09-17T02:21:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230277+0000", 2024-09-17T02:21:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230277+0000", 2024-09-17T02:21:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230278+0000", 2024-09-17T02:21:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5899999999999995e-07 2024-09-17T02:21:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230284+0000", 2024-09-17T02:21:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.64e-06 2024-09-17T02:21:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230291+0000", 2024-09-17T02:21:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8469999999999998e-06 2024-09-17T02:21:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230297+0000", 2024-09-17T02:21:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2430000000000002e-06 2024-09-17T02:21:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230361+0000", 2024-09-17T02:21:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4206000000000002e-05 2024-09-17T02:21:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230437+0000", 2024-09-17T02:21:40.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5210000000000007e-05 2024-09-17T02:21:40.250 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.250 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.250 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.250 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:137998 5.1 5:88a826ca:::benchmark_data_smithi001_23533_object9881:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:40.250 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.230309+0000", 2024-09-17T02:21:40.250 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00031691500000000002, 2024-09-17T02:21:40.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00069961000000000003, 2024-09-17T02:21:40.250 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 137998 2024-09-17T02:21:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230309+0000", 2024-09-17T02:21:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230309+0000", 2024-09-17T02:21:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230309+0000", 2024-09-17T02:21:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7e-07 2024-09-17T02:21:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230312+0000", 2024-09-17T02:21:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6520000000000002e-06 2024-09-17T02:21:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230320+0000", 2024-09-17T02:21:40.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8509999999999999e-06 2024-09-17T02:21:40.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230326+0000", 2024-09-17T02:21:40.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9190000000000004e-06 2024-09-17T02:21:40.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230364+0000", 2024-09-17T02:21:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8673000000000001e-05 2024-09-17T02:21:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230502+0000", 2024-09-17T02:21:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000137353 2024-09-17T02:21:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230614+0000", 2024-09-17T02:21:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000112246 2024-09-17T02:21:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:137999 5.c 5:3ee2a37f:::benchmark_data_smithi001_23533_object9882:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.230334+0000", 2024-09-17T02:21:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00029218499999999998, 2024-09-17T02:21:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00073941299999999996, 2024-09-17T02:21:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 137999 2024-09-17T02:21:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230334+0000", 2024-09-17T02:21:40.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230334+0000", 2024-09-17T02:21:40.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230334+0000", 2024-09-17T02:21:40.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7100000000000002e-07 2024-09-17T02:21:40.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230336+0000", 2024-09-17T02:21:40.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4090000000000001e-06 2024-09-17T02:21:40.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230343+0000", 2024-09-17T02:21:40.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.438e-06 2024-09-17T02:21:40.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230348+0000", 2024-09-17T02:21:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1529999999999996e-06 2024-09-17T02:21:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230466+0000", 2024-09-17T02:21:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117917 2024-09-17T02:21:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230573+0000", 2024-09-17T02:21:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010691099999999999 2024-09-17T02:21:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:138000 5.8 5.4b4e1928 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.230359+0000", 2024-09-17T02:21:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00026663000000000001, 2024-09-17T02:21:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00077252400000000002, 2024-09-17T02:21:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 138000 2024-09-17T02:21:40.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.260 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230359+0000", 2024-09-17T02:21:40.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230359+0000", 2024-09-17T02:21:40.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230360+0000", 2024-09-17T02:21:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.06e-07 2024-09-17T02:21:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230362+0000", 2024-09-17T02:21:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1119999999999999e-06 2024-09-17T02:21:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230368+0000", 2024-09-17T02:21:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7059999999999998e-06 2024-09-17T02:21:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230374+0000", 2024-09-17T02:21:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.152e-06 2024-09-17T02:21:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:138002 5.2 5.7cd3102 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.230384+0000", 2024-09-17T02:21:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00024204200000000001, 2024-09-17T02:21:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00079473200000000003, 2024-09-17T02:21:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 138002 2024-09-17T02:21:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230384+0000", 2024-09-17T02:21:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230384+0000", 2024-09-17T02:21:40.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230384+0000", 2024-09-17T02:21:40.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4400000000000001e-07 2024-09-17T02:21:40.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230386+0000", 2024-09-17T02:21:40.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2620000000000001e-06 2024-09-17T02:21:40.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230392+0000", 2024-09-17T02:21:40.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0719999999999996e-06 2024-09-17T02:21:40.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230398+0000", 2024-09-17T02:21:40.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2490000000000001e-06 2024-09-17T02:21:40.265 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.265 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.265 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.266 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:137996 5.e e54/22 5:78997350:::benchmark_data_smithi001_23533_object9879:head v 54'8630, mlcod=54'8628)", 2024-09-17T02:21:40.266 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.230871+0000", 2024-09-17T02:21:40.266 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9997549, 2024-09-17T02:21:40.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00035775299999999999, 2024-09-17T02:21:40.266 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.266 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.266 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:40.266 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230871+0000", 2024-09-17T02:21:40.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230871+0000", 2024-09-17T02:21:40.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230872+0000", 2024-09-17T02:21:40.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3799999999999997e-07 2024-09-17T02:21:40.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230877+0000", 2024-09-17T02:21:40.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0549999999999999e-06 2024-09-17T02:21:40.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230887+0000", 2024-09-17T02:21:40.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0293e-05 2024-09-17T02:21:40.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230893+0000", 2024-09-17T02:21:40.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3740000000000003e-06 2024-09-17T02:21:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230938+0000", 2024-09-17T02:21:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4555000000000003e-05 2024-09-17T02:21:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.230956+0000", 2024-09-17T02:21:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7863000000000002e-05 2024-09-17T02:21:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.270 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:21:40.270 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 10 2024-09-17T02:21:40.270 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:40.271 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:40.273 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:40.277+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:40.373 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:40.377+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:40.469 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:40.469 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:21:40.470 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:21:40.470 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:21:40.470 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:40.474 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:40.474+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:40.489 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:40.575 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:40.578+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:40.676 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:40.678+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:40.683 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:40.683 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:21:40.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:21:40.683 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:40.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.683 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T02:21:40.683 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:40.684 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 84.123718143000005, 2024-09-17T02:21:40.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024118555999999999, 2024-09-17T02:21:40.684 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.684 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.684 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.684 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:40.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562394+0000", 2024-09-17T02:21:40.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562395+0000", 2024-09-17T02:21:40.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3969999999999999e-06 2024-09-17T02:21:40.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562405+0000", 2024-09-17T02:21:40.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4229999999999994e-06 2024-09-17T02:21:40.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562427+0000", 2024-09-17T02:21:40.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759999999999998e-05 2024-09-17T02:21:40.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.562444+0000", 2024-09-17T02:21:40.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7019000000000001e-05 2024-09-17T02:21:40.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564681+0000", 2024-09-17T02:21:40.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022376929999999998 2024-09-17T02:21:40.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.564887+0000", 2024-09-17T02:21:40.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000206178 2024-09-17T02:21:40.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:40.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.565230+0000", 2024-09-17T02:21:40.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034233499999999998 2024-09-17T02:21:40.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:40.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.567000+0000", 2024-09-17T02:21:40.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017706390000000001 2024-09-17T02:21:40.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:40.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586126+0000", 2024-09-17T02:21:40.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019125672 2024-09-17T02:21:40.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:40.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586314+0000", 2024-09-17T02:21:40.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018740200000000001 2024-09-17T02:21:40.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:40.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:16.586513+0000", 2024-09-17T02:21:40.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019903799999999999 2024-09-17T02:21:40.689 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.689 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.689 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.689 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:40.689 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:40.689 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 58.117649039, 2024-09-17T02:21:40.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:21:40.690 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.690 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.690 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.690 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:40.690 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:40.690 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.690 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:21:40.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.690 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:40.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:40.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:21:40.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:21:40.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:21:40.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:21:40.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:21:40.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:21:40.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:21:40.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:21:40.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:21:40.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:21:40.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:21:40.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:21:40.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:40.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:21:40.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:21:40.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:40.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:21:40.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:21:40.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:40.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:21:40.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:21:40.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:40.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:21:40.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:21:40.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:40.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:21:40.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:21:40.695 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.695 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.695 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.695 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:40.695 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:40.695 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 58.113746788999997, 2024-09-17T02:21:40.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:21:40.696 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.696 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.696 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.696 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:40.696 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:40.696 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.696 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:21:40.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.696 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:40.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:40.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:21:40.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:21:40.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:21:40.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:21:40.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:21:40.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:21:40.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:21:40.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:21:40.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:21:40.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:21:40.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:21:40.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:21:40.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:40.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:21:40.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:21:40.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:40.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:21:40.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:21:40.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:40.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:21:40.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:21:40.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:40.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:21:40.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:21:40.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:40.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:21:40.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:21:40.701 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.701 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.701 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.702 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71206 5.3 e39/38 5:c6c9386d:::benchmark_data_smithi001_23533_object71205:head v 39'4517, mlcod=35'4513)", 2024-09-17T02:21:40.702 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:40.702 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.076419674, 2024-09-17T02:21:40.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026101868, 2024-09-17T02:21:40.702 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.702 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.702 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.702 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:40.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:40.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609694+0000", 2024-09-17T02:21:40.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9539999999999998e-06 2024-09-17T02:21:40.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609841+0000", 2024-09-17T02:21:40.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014690800000000001 2024-09-17T02:21:40.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609872+0000", 2024-09-17T02:21:40.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0326000000000001e-05 2024-09-17T02:21:40.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609892+0000", 2024-09-17T02:21:40.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9848999999999999e-05 2024-09-17T02:21:40.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613826+0000", 2024-09-17T02:21:40.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039345140000000001 2024-09-17T02:21:40.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613908+0000", 2024-09-17T02:21:40.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2412999999999999e-05 2024-09-17T02:21:40.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:40.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635696+0000", 2024-09-17T02:21:40.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021787597999999998 2024-09-17T02:21:40.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:40.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635794+0000", 2024-09-17T02:21:40.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8306000000000004e-05 2024-09-17T02:21:40.706 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.706 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.706 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.706 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71210 5.3 e39/38 5:c0498d13:::benchmark_data_smithi001_23533_object71209:head v 39'4518, mlcod=35'4513)", 2024-09-17T02:21:40.706 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:40.706 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.074941707999997, 2024-09-17T02:21:40.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024703197, 2024-09-17T02:21:40.706 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.707 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.707 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.707 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:40.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:40.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611172+0000", 2024-09-17T02:21:40.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6470000000000001e-06 2024-09-17T02:21:40.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611344+0000", 2024-09-17T02:21:40.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000171607 2024-09-17T02:21:40.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611389+0000", 2024-09-17T02:21:40.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5738000000000002e-05 2024-09-17T02:21:40.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611407+0000", 2024-09-17T02:21:40.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7893e-05 2024-09-17T02:21:40.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617820+0000", 2024-09-17T02:21:40.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064131070000000004 2024-09-17T02:21:40.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617885+0000", 2024-09-17T02:21:40.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4442000000000004e-05 2024-09-17T02:21:40.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:40.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635806+0000", 2024-09-17T02:21:40.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017920874999999999 2024-09-17T02:21:40.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:40.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635874+0000", 2024-09-17T02:21:40.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7887999999999998e-05 2024-09-17T02:21:40.710 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.710 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.711 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.711 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71214 5.3 e39/38 5:c5e24f3f:::benchmark_data_smithi001_23533_object71213:head v 39'4520, mlcod=35'4513)", 2024-09-17T02:21:40.711 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:40.711 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.070577475999997, 2024-09-17T02:21:40.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024251297000000002, 2024-09-17T02:21:40.711 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.711 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.711 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.711 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:40.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615535+0000", 2024-09-17T02:21:40.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615536+0000", 2024-09-17T02:21:40.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5370000000000001e-06 2024-09-17T02:21:40.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615696+0000", 2024-09-17T02:21:40.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015948700000000001 2024-09-17T02:21:40.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615723+0000", 2024-09-17T02:21:40.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7518999999999999e-05 2024-09-17T02:21:40.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.615742+0000", 2024-09-17T02:21:40.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8519999999999999e-05 2024-09-17T02:21:40.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.624440+0000", 2024-09-17T02:21:40.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0086983080000000001 2024-09-17T02:21:40.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.624489+0000", 2024-09-17T02:21:40.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8838000000000002e-05 2024-09-17T02:21:40.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:40.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639673+0000", 2024-09-17T02:21:40.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01518451 2024-09-17T02:21:40.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:40.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.639786+0000", 2024-09-17T02:21:40.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011257800000000001 2024-09-17T02:21:40.715 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.715 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.715 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.715 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97151 5.5 5:a0c2c072:::benchmark_data_smithi001_23533_object97150:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:40.715 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:40.716 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.417740067, 2024-09-17T02:21:40.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027297614000000001, 2024-09-17T02:21:40.716 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.716 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.716 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.716 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:40.716 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:40.716 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.716 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97151 2024-09-17T02:21:40.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.716 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:40.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:40.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268373+0000", 2024-09-17T02:21:40.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4000000000000002e-07 2024-09-17T02:21:40.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268423+0000", 2024-09-17T02:21:40.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0175e-05 2024-09-17T02:21:40.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268428+0000", 2024-09-17T02:21:40.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-17T02:21:40.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268431+0000", 2024-09-17T02:21:40.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.179e-06 2024-09-17T02:21:40.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283631+0000", 2024-09-17T02:21:40.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015199691 2024-09-17T02:21:40.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283740+0000", 2024-09-17T02:21:40.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109305 2024-09-17T02:21:40.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:40.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283863+0000", 2024-09-17T02:21:40.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012226699999999999 2024-09-17T02:21:40.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:40.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290857+0000", 2024-09-17T02:21:40.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069945449999999996 2024-09-17T02:21:40.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:40.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295595+0000", 2024-09-17T02:21:40.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047376750000000002 2024-09-17T02:21:40.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:40.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295638+0000", 2024-09-17T02:21:40.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3671999999999998e-05 2024-09-17T02:21:40.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:40.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295670+0000", 2024-09-17T02:21:40.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1266000000000002e-05 2024-09-17T02:21:40.721 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.721 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.721 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.722 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97759 5.a 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:40.722 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:40.722 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.087726966000002, 2024-09-17T02:21:40.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.089694871999999995, 2024-09-17T02:21:40.722 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.722 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.722 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.722 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:40.722 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:40.722 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.722 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97759 2024-09-17T02:21:40.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.722 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:40.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:40.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598386+0000", 2024-09-17T02:21:40.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999999e-07 2024-09-17T02:21:40.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598414+0000", 2024-09-17T02:21:40.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8013000000000001e-05 2024-09-17T02:21:40.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598420+0000", 2024-09-17T02:21:40.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1149999999999999e-06 2024-09-17T02:21:40.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598424+0000", 2024-09-17T02:21:40.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:21:40.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598479+0000", 2024-09-17T02:21:40.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4648999999999998e-05 2024-09-17T02:21:40.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598587+0000", 2024-09-17T02:21:40.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010853000000000001 2024-09-17T02:21:40.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:40.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598676+0000", 2024-09-17T02:21:40.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8381999999999995e-05 2024-09-17T02:21:40.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:40.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603766+0000", 2024-09-17T02:21:40.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050902559999999996 2024-09-17T02:21:40.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:40.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.687988+0000", 2024-09-17T02:21:40.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.084221753999999996 2024-09-17T02:21:40.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:40.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688037+0000", 2024-09-17T02:21:40.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-05 2024-09-17T02:21:40.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:40.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688080+0000", 2024-09-17T02:21:40.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3149999999999999e-05 2024-09-17T02:21:40.727 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.727 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.727 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.728 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97770 5.0 5:09c75033:::benchmark_data_smithi001_23533_object97769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:40.728 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:40.728 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.082584535999999, 2024-09-17T02:21:40.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.086380868, 2024-09-17T02:21:40.728 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.728 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.728 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.728 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:40.728 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:40.728 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.728 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97770 2024-09-17T02:21:40.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.728 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:40.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:40.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603529+0000", 2024-09-17T02:21:40.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:21:40.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603593+0000", 2024-09-17T02:21:40.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4216999999999999e-05 2024-09-17T02:21:40.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603603+0000", 2024-09-17T02:21:40.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5179999999999993e-06 2024-09-17T02:21:40.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603608+0000", 2024-09-17T02:21:40.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2039999999999996e-06 2024-09-17T02:21:40.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603653+0000", 2024-09-17T02:21:40.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5247000000000002e-05 2024-09-17T02:21:40.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603758+0000", 2024-09-17T02:21:40.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105352 2024-09-17T02:21:40.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:40.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603900+0000", 2024-09-17T02:21:40.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014198999999999999 2024-09-17T02:21:40.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:40.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.606097+0000", 2024-09-17T02:21:40.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021969839999999999 2024-09-17T02:21:40.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:40.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689756+0000", 2024-09-17T02:21:40.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.083659077999999998 2024-09-17T02:21:40.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:40.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689846+0000", 2024-09-17T02:21:40.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9320999999999994e-05 2024-09-17T02:21:40.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:40.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689908+0000", 2024-09-17T02:21:40.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720999999999998e-05 2024-09-17T02:21:40.733 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.734 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.734 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.734 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127513 5.c 5:3eca08e4:::benchmark_data_smithi001_23533_object127512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:40.734 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:21:40.734 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.2418081119999993, 2024-09-17T02:21:40.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046626399999999998, 2024-09-17T02:21:40.734 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.734 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.734 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.734 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:40.734 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:40.735 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.735 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127513 2024-09-17T02:21:40.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.735 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:21:40.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:21:40.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444305+0000", 2024-09-17T02:21:40.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2529999999999999e-06 2024-09-17T02:21:40.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444466+0000", 2024-09-17T02:21:40.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016069700000000001 2024-09-17T02:21:40.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444479+0000", 2024-09-17T02:21:40.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2602999999999999e-05 2024-09-17T02:21:40.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444485+0000", 2024-09-17T02:21:40.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.669e-06 2024-09-17T02:21:40.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444560+0000", 2024-09-17T02:21:40.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4276999999999994e-05 2024-09-17T02:21:40.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444656+0000", 2024-09-17T02:21:40.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6490000000000006e-05 2024-09-17T02:21:40.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:40.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444739+0000", 2024-09-17T02:21:40.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3139999999999993e-05 2024-09-17T02:21:40.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:40.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.448438+0000", 2024-09-17T02:21:40.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036985490000000002 2024-09-17T02:21:40.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:40.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490732+0000", 2024-09-17T02:21:40.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042294353999999999 2024-09-17T02:21:40.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:40.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490859+0000", 2024-09-17T02:21:40.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012708899999999999 2024-09-17T02:21:40.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:40.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490930+0000", 2024-09-17T02:21:40.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:21:40.739 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.739 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.739 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.740 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127514 5.c 5:39cc1feb:::benchmark_data_smithi001_23533_object127513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:40.740 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:40.740 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.2416113430000006, 2024-09-17T02:21:40.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049357228000000003, 2024-09-17T02:21:40.740 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.740 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.740 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.740 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:40.740 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:40.740 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.740 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127514 2024-09-17T02:21:40.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.740 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:40.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:40.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:40.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8599999999999998e-07 2024-09-17T02:21:40.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444554+0000", 2024-09-17T02:21:40.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3047999999999998e-05 2024-09-17T02:21:40.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444562+0000", 2024-09-17T02:21:40.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5830000000000001e-06 2024-09-17T02:21:40.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444567+0000", 2024-09-17T02:21:40.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4179999999999996e-06 2024-09-17T02:21:40.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446566+0000", 2024-09-17T02:21:40.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001998788 2024-09-17T02:21:40.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446696+0000", 2024-09-17T02:21:40.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129393 2024-09-17T02:21:40.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:40.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446794+0000", 2024-09-17T02:21:40.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8462999999999996e-05 2024-09-17T02:21:40.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:40.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.449036+0000", 2024-09-17T02:21:40.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022415880000000001 2024-09-17T02:21:40.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:40.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493737+0000", 2024-09-17T02:21:40.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044701682 2024-09-17T02:21:40.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:40.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493808+0000", 2024-09-17T02:21:40.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0846000000000006e-05 2024-09-17T02:21:40.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:40.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493858+0000", 2024-09-17T02:21:40.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9932999999999998e-05 2024-09-17T02:21:40.745 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.745 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.745 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.745 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129441 5.1 5:84c3199f:::benchmark_data_smithi001_23533_object1324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:40.746 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:21:40.746 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.1826008550000005, 2024-09-17T02:21:40.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034387011000000002, 2024-09-17T02:21:40.746 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.746 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.746 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.746 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:40.746 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:40.746 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.746 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129441 2024-09-17T02:21:40.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.746 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:21:40.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:21:40.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503513+0000", 2024-09-17T02:21:40.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4759999999999999e-06 2024-09-17T02:21:40.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503518+0000", 2024-09-17T02:21:40.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-09-17T02:21:40.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503532+0000", 2024-09-17T02:21:40.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4049999999999999e-05 2024-09-17T02:21:40.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503541+0000", 2024-09-17T02:21:40.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5320000000000006e-06 2024-09-17T02:21:40.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506331+0000", 2024-09-17T02:21:40.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027899190000000001 2024-09-17T02:21:40.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506402+0000", 2024-09-17T02:21:40.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:21:40.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:40.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506477+0000", 2024-09-17T02:21:40.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4626e-05 2024-09-17T02:21:40.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:40.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509749+0000", 2024-09-17T02:21:40.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032726980000000001 2024-09-17T02:21:40.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:40.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537758+0000", 2024-09-17T02:21:40.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028008890000000002 2024-09-17T02:21:40.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:40.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537812+0000", 2024-09-17T02:21:40.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3300000000000001e-05 2024-09-17T02:21:40.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:40.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537898+0000", 2024-09-17T02:21:40.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6691000000000001e-05 2024-09-17T02:21:40.751 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.751 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.751 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.751 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129442 5.1 5:8f7f2a95:::benchmark_data_smithi001_23533_object1325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:40.751 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:21:40.751 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.1796302460000003, 2024-09-17T02:21:40.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031546698999999997, 2024-09-17T02:21:40.751 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.751 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.751 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.751 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:40.752 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:40.752 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.752 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129442 2024-09-17T02:21:40.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.752 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:21:40.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:21:40.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506483+0000", 2024-09-17T02:21:40.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2869999999999999e-06 2024-09-17T02:21:40.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506489+0000", 2024-09-17T02:21:40.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2330000000000003e-06 2024-09-17T02:21:40.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506502+0000", 2024-09-17T02:21:40.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2286999999999999e-05 2024-09-17T02:21:40.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506511+0000", 2024-09-17T02:21:40.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7799999999999995e-06 2024-09-17T02:21:40.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.507966+0000", 2024-09-17T02:21:40.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014541549999999999 2024-09-17T02:21:40.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508130+0000", 2024-09-17T02:21:40.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016455199999999999 2024-09-17T02:21:40.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:40.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508287+0000", 2024-09-17T02:21:40.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015730400000000001 2024-09-17T02:21:40.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:40.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510577+0000", 2024-09-17T02:21:40.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022899449999999998 2024-09-17T02:21:40.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:40.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537932+0000", 2024-09-17T02:21:40.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027354471000000002 2024-09-17T02:21:40.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:40.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537964+0000", 2024-09-17T02:21:40.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1909999999999998e-05 2024-09-17T02:21:40.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:40.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.538029+0000", 2024-09-17T02:21:40.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4775000000000002e-05 2024-09-17T02:21:40.757 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.757 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.757 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.757 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129443 5.8 5:1edfeaf8:::benchmark_data_smithi001_23533_object1326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:40.757 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:21:40.757 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.1761957460000003, 2024-09-17T02:21:40.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025315902000000001, 2024-09-17T02:21:40.757 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.757 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.757 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.757 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:40.758 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:40.758 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.758 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129443 2024-09-17T02:21:40.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.758 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:21:40.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:21:40.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509918+0000", 2024-09-17T02:21:40.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3689999999999999e-06 2024-09-17T02:21:40.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509923+0000", 2024-09-17T02:21:40.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0429999999999998e-06 2024-09-17T02:21:40.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509936+0000", 2024-09-17T02:21:40.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3234000000000001e-05 2024-09-17T02:21:40.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509950+0000", 2024-09-17T02:21:40.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3998999999999999e-05 2024-09-17T02:21:40.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509994+0000", 2024-09-17T02:21:40.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4323000000000002e-05 2024-09-17T02:21:40.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510095+0000", 2024-09-17T02:21:40.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010103300000000001 2024-09-17T02:21:40.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:40.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510160+0000", 2024-09-17T02:21:40.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4976999999999998e-05 2024-09-17T02:21:40.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:40.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.513304+0000", 2024-09-17T02:21:40.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031431330000000002 2024-09-17T02:21:40.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:40.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535046+0000", 2024-09-17T02:21:40.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021742276000000001 2024-09-17T02:21:40.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:40.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:21:40.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107759 2024-09-17T02:21:40.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:40.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535232+0000", 2024-09-17T02:21:40.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8756000000000003e-05 2024-09-17T02:21:40.763 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.763 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.763 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.763 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129448 5.3 5:c6b382db:::benchmark_data_smithi001_23533_object1331:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:40.763 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.517460+0000", 2024-09-17T02:21:40.763 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.1686521130000003, 2024-09-17T02:21:40.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024080893999999999, 2024-09-17T02:21:40.763 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.763 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.763 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.763 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:40.763 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:40.764 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.764 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129448 2024-09-17T02:21:40.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.764 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.517460+0000", 2024-09-17T02:21:40.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.517460+0000", 2024-09-17T02:21:40.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.517461+0000", 2024-09-17T02:21:40.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5499999999999998e-07 2024-09-17T02:21:40.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.517464+0000", 2024-09-17T02:21:40.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1250000000000001e-06 2024-09-17T02:21:40.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.517473+0000", 2024-09-17T02:21:40.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2960000000000004e-06 2024-09-17T02:21:40.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.517481+0000", 2024-09-17T02:21:40.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6199999999999999e-06 2024-09-17T02:21:40.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.517572+0000", 2024-09-17T02:21:40.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1228000000000001e-05 2024-09-17T02:21:40.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-17T02:21:40.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.517580+0000", 2024-09-17T02:21:40.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9549999999999992e-06 2024-09-17T02:21:40.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.534297+0000", 2024-09-17T02:21:40.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016717416999999998 2024-09-17T02:21:40.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.534401+0000", 2024-09-17T02:21:40.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010380800000000001 2024-09-17T02:21:40.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:40.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.534490+0000", 2024-09-17T02:21:40.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8854e-05 2024-09-17T02:21:40.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:40.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.539105+0000", 2024-09-17T02:21:40.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004615198 2024-09-17T02:21:40.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:40.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.541410+0000", 2024-09-17T02:21:40.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023050879999999998 2024-09-17T02:21:40.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:40.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.541452+0000", 2024-09-17T02:21:40.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1372000000000003e-05 2024-09-17T02:21:40.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:40.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.541541+0000", 2024-09-17T02:21:40.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9277999999999995e-05 2024-09-17T02:21:40.769 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.769 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.769 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.770 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:138243 5.b e54/51 5:d91391c1:::benchmark_data_smithi001_23533_object10126:head v 54'8566, mlcod=54'8564)", 2024-09-17T02:21:40.770 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.334890+0000", 2024-09-17T02:21:40.770 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.35122181899999999, 2024-09-17T02:21:40.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025015253000000001, 2024-09-17T02:21:40.770 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.770 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.770 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.770 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.334890+0000", 2024-09-17T02:21:40.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.334890+0000", 2024-09-17T02:21:40.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.334891+0000", 2024-09-17T02:21:40.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8400000000000003e-07 2024-09-17T02:21:40.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.334895+0000", 2024-09-17T02:21:40.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.472e-06 2024-09-17T02:21:40.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.334901+0000", 2024-09-17T02:21:40.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3640000000000004e-06 2024-09-17T02:21:40.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.334905+0000", 2024-09-17T02:21:40.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4440000000000001e-06 2024-09-17T02:21:40.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.334952+0000", 2024-09-17T02:21:40.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6264000000000003e-05 2024-09-17T02:21:40.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.334973+0000", 2024-09-17T02:21:40.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1648e-05 2024-09-17T02:21:40.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:40.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.359846+0000", 2024-09-17T02:21:40.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024872834 2024-09-17T02:21:40.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:40.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.359906+0000", 2024-09-17T02:21:40.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9342999999999997e-05 2024-09-17T02:21:40.774 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.774 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.774 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.774 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:138247 5.3 5:caf01f60:::benchmark_data_smithi001_23533_object10130:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:40.774 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.335014+0000", 2024-09-17T02:21:40.774 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.35109817300000001, 2024-09-17T02:21:40.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026419469000000001, 2024-09-17T02:21:40.774 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.775 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.775 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.775 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:40.775 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:40.775 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.775 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 138247 2024-09-17T02:21:40.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.775 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335014+0000", 2024-09-17T02:21:40.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335014+0000", 2024-09-17T02:21:40.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335015+0000", 2024-09-17T02:21:40.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3600000000000004e-07 2024-09-17T02:21:40.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335017+0000", 2024-09-17T02:21:40.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5749999999999999e-06 2024-09-17T02:21:40.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335024+0000", 2024-09-17T02:21:40.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8379999999999996e-06 2024-09-17T02:21:40.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335029+0000", 2024-09-17T02:21:40.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.22e-06 2024-09-17T02:21:40.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335083+0000", 2024-09-17T02:21:40.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3600000000000002e-05 2024-09-17T02:21:40.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335229+0000", 2024-09-17T02:21:40.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000146098 2024-09-17T02:21:40.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:40.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335349+0000", 2024-09-17T02:21:40.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120631 2024-09-17T02:21:40.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:40.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.357942+0000", 2024-09-17T02:21:40.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022592457 2024-09-17T02:21:40.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:40.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.361286+0000", 2024-09-17T02:21:40.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003343623 2024-09-17T02:21:40.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:40.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.361338+0000", 2024-09-17T02:21:40.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2323e-05 2024-09-17T02:21:40.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:40.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.361433+0000", 2024-09-17T02:21:40.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5568000000000004e-05 2024-09-17T02:21:40.781 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.781 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.781 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.781 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:138244 5.b e54/51 5:d38c94c4:::benchmark_data_smithi001_23533_object10127:head v 54'8567, mlcod=54'8564)", 2024-09-17T02:21:40.781 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.336586+0000", 2024-09-17T02:21:40.781 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.34952578299999998, 2024-09-17T02:21:40.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026602741999999999, 2024-09-17T02:21:40.782 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.782 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.782 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.782 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336586+0000", 2024-09-17T02:21:40.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336586+0000", 2024-09-17T02:21:40.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336587+0000", 2024-09-17T02:21:40.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0600000000000001e-07 2024-09-17T02:21:40.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336590+0000", 2024-09-17T02:21:40.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3110000000000001e-06 2024-09-17T02:21:40.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336597+0000", 2024-09-17T02:21:40.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0639999999999996e-06 2024-09-17T02:21:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336602+0000", 2024-09-17T02:21:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3599999999999998e-06 2024-09-17T02:21:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336645+0000", 2024-09-17T02:21:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3628999999999999e-05 2024-09-17T02:21:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336666+0000", 2024-09-17T02:21:40.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0604000000000001e-05 2024-09-17T02:21:40.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:40.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363143+0000", 2024-09-17T02:21:40.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026477055999999999 2024-09-17T02:21:40.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:40.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363189+0000", 2024-09-17T02:21:40.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6312e-05 2024-09-17T02:21:40.785 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.785 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.785 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.786 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:138259 5.3 5:c08b4023:::benchmark_data_smithi001_23533_object10142:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:40.786 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.337063+0000", 2024-09-17T02:21:40.786 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.34904896499999999, 2024-09-17T02:21:40.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027773173000000002, 2024-09-17T02:21:40.786 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.786 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.786 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.786 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:40.786 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:40.786 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.786 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 138259 2024-09-17T02:21:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337063+0000", 2024-09-17T02:21:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337063+0000", 2024-09-17T02:21:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337064+0000", 2024-09-17T02:21:40.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-17T02:21:40.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337066+0000", 2024-09-17T02:21:40.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.03e-06 2024-09-17T02:21:40.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337072+0000", 2024-09-17T02:21:40.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5119999999999997e-06 2024-09-17T02:21:40.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337077+0000", 2024-09-17T02:21:40.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.454e-06 2024-09-17T02:21:40.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.352990+0000", 2024-09-17T02:21:40.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015913116000000001 2024-09-17T02:21:40.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.353136+0000", 2024-09-17T02:21:40.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000146117 2024-09-17T02:21:40.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.353253+0000", 2024-09-17T02:21:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117359 2024-09-17T02:21:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.358284+0000", 2024-09-17T02:21:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050306689999999998 2024-09-17T02:21:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.364738+0000", 2024-09-17T02:21:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064539410000000004 2024-09-17T02:21:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.364768+0000", 2024-09-17T02:21:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0086999999999998e-05 2024-09-17T02:21:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.364836+0000", 2024-09-17T02:21:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8549999999999999e-05 2024-09-17T02:21:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:138249 5.b e54/51 5:dcbad32d:::benchmark_data_smithi001_23533_object10132:head v 54'8568, mlcod=54'8564)", 2024-09-17T02:21:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.338016+0000", 2024-09-17T02:21:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.34809662499999999, 2024-09-17T02:21:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025210803, 2024-09-17T02:21:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338016+0000", 2024-09-17T02:21:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338016+0000", 2024-09-17T02:21:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338017+0000", 2024-09-17T02:21:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.28e-06 2024-09-17T02:21:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338022+0000", 2024-09-17T02:21:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0950000000000003e-06 2024-09-17T02:21:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338032+0000", 2024-09-17T02:21:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7140000000000005e-06 2024-09-17T02:21:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338038+0000", 2024-09-17T02:21:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1029999999999998e-06 2024-09-17T02:21:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.349300+0000", 2024-09-17T02:21:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01126216 2024-09-17T02:21:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.349359+0000", 2024-09-17T02:21:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9206999999999997e-05 2024-09-17T02:21:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363192+0000", 2024-09-17T02:21:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013833253 2024-09-17T02:21:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363226+0000", 2024-09-17T02:21:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3991e-05 2024-09-17T02:21:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:40.796 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:40.797 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:40.798+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:40.798 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:40.898 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:40.901+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:40.929 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T02:21:40.959 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:40.959 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:40.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.959 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:139622 5.a e54/22 5:57536f28:::benchmark_data_smithi001_23533_object11505:head v 54'8813, mlcod=54'8810)", 2024-09-17T02:21:40.959 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:40.963594+0000", 2024-09-17T02:21:40.959 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00044501000000000002, 2024-09-17T02:21:40.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046881199999999998, 2024-09-17T02:21:40.959 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:40.959 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:40.959 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:40.960 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:40.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:40.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963594+0000", 2024-09-17T02:21:40.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:40.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963594+0000", 2024-09-17T02:21:40.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:40.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963595+0000", 2024-09-17T02:21:40.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1800000000000005e-07 2024-09-17T02:21:40.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:40.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963608+0000", 2024-09-17T02:21:40.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3502e-05 2024-09-17T02:21:40.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:40.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963622+0000", 2024-09-17T02:21:40.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.384e-05 2024-09-17T02:21:40.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963629+0000", 2024-09-17T02:21:40.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9310000000000002e-06 2024-09-17T02:21:40.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963675+0000", 2024-09-17T02:21:40.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6295000000000003e-05 2024-09-17T02:21:40.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:40.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963686+0000", 2024-09-17T02:21:40.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0508e-05 2024-09-17T02:21:40.963 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.963 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:40.963 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.963 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:139630 5.3 e54/51 5:c2d46016:::benchmark_data_smithi001_23533_object11513:head v 54'8825, mlcod=54'8822)", 2024-09-17T02:21:40.963 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:40.963645+0000", 2024-09-17T02:21:40.963 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00039401200000000001, 2024-09-17T02:21:40.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000482678, 2024-09-17T02:21:40.963 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:40.963 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:40.963 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:40.963 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:40.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:40.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963645+0000", 2024-09-17T02:21:40.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:40.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963645+0000", 2024-09-17T02:21:40.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:40.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963645+0000", 2024-09-17T02:21:40.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0499999999999999e-07 2024-09-17T02:21:40.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:40.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963658+0000", 2024-09-17T02:21:40.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2734999999999999e-05 2024-09-17T02:21:40.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:40.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963669+0000", 2024-09-17T02:21:40.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0991e-05 2024-09-17T02:21:40.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963674+0000", 2024-09-17T02:21:40.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4140000000000002e-06 2024-09-17T02:21:40.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963719+0000", 2024-09-17T02:21:40.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4147000000000003e-05 2024-09-17T02:21:40.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:40.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963738+0000", 2024-09-17T02:21:40.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9905999999999999e-05 2024-09-17T02:21:40.966 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.967 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:40.967 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.967 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.1 e 54/54 lb 5:883a7ab7:::benchmark_data_smithi001_23533_object125103:head)", 2024-09-17T02:21:40.967 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:40.963761+0000", 2024-09-17T02:21:40.967 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00027827599999999999, 2024-09-17T02:21:40.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042457900000000002, 2024-09-17T02:21:40.967 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:40.967 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:40.967 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:40.967 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:40.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:40.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963761+0000", 2024-09-17T02:21:40.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:40.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963761+0000", 2024-09-17T02:21:40.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:40.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963761+0000", 2024-09-17T02:21:40.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2399999999999999e-07 2024-09-17T02:21:40.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:40.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963766+0000", 2024-09-17T02:21:40.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1030000000000001e-06 2024-09-17T02:21:40.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:40.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963777+0000", 2024-09-17T02:21:40.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.13e-05 2024-09-17T02:21:40.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963781+0000", 2024-09-17T02:21:40.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8399999999999997e-06 2024-09-17T02:21:40.970 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.970 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:40.970 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.970 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:139631 5.b 5:d03419d0:::benchmark_data_smithi001_23533_object11514:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:40.970 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:40.963930+0000", 2024-09-17T02:21:40.970 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.000108966, 2024-09-17T02:21:40.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030820199999999999, 2024-09-17T02:21:40.970 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:40.970 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:40.970 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:40.970 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:40.971 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:40.971 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.971 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 139631 2024-09-17T02:21:40.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.971 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:40.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:40.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963930+0000", 2024-09-17T02:21:40.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:40.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963930+0000", 2024-09-17T02:21:40.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:40.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963930+0000", 2024-09-17T02:21:40.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0500000000000003e-07 2024-09-17T02:21:40.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:40.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963933+0000", 2024-09-17T02:21:40.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7269999999999999e-06 2024-09-17T02:21:40.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:40.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963948+0000", 2024-09-17T02:21:40.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4791e-05 2024-09-17T02:21:40.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963953+0000", 2024-09-17T02:21:40.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5410000000000002e-06 2024-09-17T02:21:40.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.963990+0000", 2024-09-17T02:21:40.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7772999999999999e-05 2024-09-17T02:21:40.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:40.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.964097+0000", 2024-09-17T02:21:40.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106205 2024-09-17T02:21:40.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:40.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.964199+0000", 2024-09-17T02:21:40.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102081 2024-09-17T02:21:40.974 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.974 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:40.974 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.975 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:139609 5.b 5:d3ed2181:::benchmark_data_smithi001_23533_object11492:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:40.975 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:40.952802+0000", 2024-09-17T02:21:40.975 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.011237297, 2024-09-17T02:21:40.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011512201, 2024-09-17T02:21:40.975 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:40.975 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:40.975 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:40.975 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:40.975 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:40.975 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.975 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 139609 2024-09-17T02:21:40.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.975 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:40.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:40.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.952802+0000", 2024-09-17T02:21:40.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:40.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.952802+0000", 2024-09-17T02:21:40.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:40.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.952802+0000", 2024-09-17T02:21:40.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.78e-07 2024-09-17T02:21:40.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:40.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.952807+0000", 2024-09-17T02:21:40.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0899999999999998e-06 2024-09-17T02:21:40.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:40.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.952818+0000", 2024-09-17T02:21:40.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1875000000000001e-05 2024-09-17T02:21:40.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.952826+0000", 2024-09-17T02:21:40.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5059999999999998e-06 2024-09-17T02:21:40.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.956025+0000", 2024-09-17T02:21:40.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031989150000000001 2024-09-17T02:21:40.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:40.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.956152+0000", 2024-09-17T02:21:40.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012765899999999999 2024-09-17T02:21:40.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:40.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.956284+0000", 2024-09-17T02:21:40.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013190399999999999 2024-09-17T02:21:40.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:40.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.959340+0000", 2024-09-17T02:21:40.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030560880000000002 2024-09-17T02:21:40.979 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.979 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:40.979 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.980 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:139621 5.b 5:da47c1a9:::benchmark_data_smithi001_23533_object11504:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:40.980 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:40.957578+0000", 2024-09-17T02:21:40.980 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0064604570000000002, 2024-09-17T02:21:40.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0068126150000000002, 2024-09-17T02:21:40.980 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:40.980 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:40.980 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:40.980 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:40.980 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:40.980 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.980 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 139621 2024-09-17T02:21:40.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.981 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:40.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:40.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.957578+0000", 2024-09-17T02:21:40.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:40.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.957578+0000", 2024-09-17T02:21:40.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:40.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.957579+0000", 2024-09-17T02:21:40.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8599999999999997e-07 2024-09-17T02:21:40.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:40.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.957583+0000", 2024-09-17T02:21:40.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0670000000000002e-06 2024-09-17T02:21:40.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:40.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.957596+0000", 2024-09-17T02:21:40.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2369e-05 2024-09-17T02:21:40.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.957602+0000", 2024-09-17T02:21:40.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7139999999999996e-06 2024-09-17T02:21:40.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.957788+0000", 2024-09-17T02:21:40.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018534399999999999 2024-09-17T02:21:40.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:40.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.957941+0000", 2024-09-17T02:21:40.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000153585 2024-09-17T02:21:40.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:40.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.958081+0000", 2024-09-17T02:21:40.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013998600000000001 2024-09-17T02:21:40.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:40.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.961085+0000", 2024-09-17T02:21:40.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030037330000000002 2024-09-17T02:21:40.984 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.984 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:40.984 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.985 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:139627 5.b 5:d16cd976:::benchmark_data_smithi001_23533_object11510:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:40.985 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:40.959362+0000", 2024-09-17T02:21:40.985 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0046771549999999997, 2024-09-17T02:21:40.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005105811, 2024-09-17T02:21:40.985 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:40.985 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:40.985 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:40.985 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:40.985 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:40.985 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.985 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 139627 2024-09-17T02:21:40.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.985 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:40.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:40.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.959362+0000", 2024-09-17T02:21:40.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:40.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.959362+0000", 2024-09-17T02:21:40.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:40.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.959362+0000", 2024-09-17T02:21:40.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7000000000000004e-07 2024-09-17T02:21:40.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:40.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.959366+0000", 2024-09-17T02:21:40.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.647e-06 2024-09-17T02:21:40.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:40.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.959385+0000", 2024-09-17T02:21:40.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8873999999999999e-05 2024-09-17T02:21:40.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.959391+0000", 2024-09-17T02:21:40.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3509999999999998e-06 2024-09-17T02:21:40.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.959439+0000", 2024-09-17T02:21:40.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7750000000000002e-05 2024-09-17T02:21:40.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:40.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.959579+0000", 2024-09-17T02:21:40.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000140376 2024-09-17T02:21:40.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:40.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.959709+0000", 2024-09-17T02:21:40.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012996000000000001 2024-09-17T02:21:40.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:40.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.961205+0000", 2024-09-17T02:21:40.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014954930000000001 2024-09-17T02:21:40.989 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.989 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:40.989 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.990 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:139629 5.e 5:7146c10a:::benchmark_data_smithi001_23533_object11512:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:40.990 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:40.960586+0000", 2024-09-17T02:21:40.990 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0034528800000000002, 2024-09-17T02:21:40.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039603499999999996, 2024-09-17T02:21:40.990 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:40.990 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:40.990 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:40.990 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:40.990 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:40.990 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:40.990 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 139629 2024-09-17T02:21:40.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.990 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:40.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:40.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.960586+0000", 2024-09-17T02:21:40.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:40.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.960586+0000", 2024-09-17T02:21:40.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:40.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:40.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.960587+0000", 2024-09-17T02:21:40.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3799999999999996e-07 2024-09-17T02:21:40.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:40.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.960590+0000", 2024-09-17T02:21:40.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3050000000000001e-06 2024-09-17T02:21:40.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:40.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.960599+0000", 2024-09-17T02:21:40.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2490000000000007e-06 2024-09-17T02:21:40.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:40.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.960604+0000", 2024-09-17T02:21:40.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4610000000000001e-06 2024-09-17T02:21:40.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:40.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.960651+0000", 2024-09-17T02:21:40.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6999999999999997e-05 2024-09-17T02:21:40.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:40.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.960763+0000", 2024-09-17T02:21:40.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112695 2024-09-17T02:21:40.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:40.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.960864+0000", 2024-09-17T02:21:40.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010094000000000001 2024-09-17T02:21:40.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:40.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:40.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:40.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:40.962550+0000", 2024-09-17T02:21:40.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016857759999999999 2024-09-17T02:21:40.994 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.994 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:40.994 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.994 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:40.994 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:21:40.994 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 8 2024-09-17T02:21:40.995 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:40.996 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:40.999 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:40.998+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:41.100 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:41.102+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:41.191 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:41.191 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:21:41.191 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:21:41.191 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:21:41.192 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:41.202 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:41.205+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:41.208 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:41.302 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:41.305+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:41.403 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:41.406+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:41.409 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:41.409 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:21:41.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:21:41.409 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:41.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.410 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97749 5.b 5:d930ef52:::benchmark_data_smithi001_23533_object97748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:41.410 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:41.410 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 23.820096056000001, 2024-09-17T02:21:41.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092964343000000005, 2024-09-17T02:21:41.410 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:41.410 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:41.410 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:41.410 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:41.410 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:41.410 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.410 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97749 2024-09-17T02:21:41.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.410 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:41.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:41.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:41.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:41.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:41.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:41.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591947+0000", 2024-09-17T02:21:41.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:21:41.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:41.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592011+0000", 2024-09-17T02:21:41.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3608000000000005e-05 2024-09-17T02:21:41.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:41.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592021+0000", 2024-09-17T02:21:41.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9979999999999998e-06 2024-09-17T02:21:41.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592028+0000", 2024-09-17T02:21:41.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1439999999999997e-06 2024-09-17T02:21:41.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593633+0000", 2024-09-17T02:21:41.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001604636 2024-09-17T02:21:41.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:41.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593757+0000", 2024-09-17T02:21:41.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012432099999999999 2024-09-17T02:21:41.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593866+0000", 2024-09-17T02:21:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109094 2024-09-17T02:21:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601190+0000", 2024-09-17T02:21:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073237620000000002 2024-09-17T02:21:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601356+0000", 2024-09-17T02:21:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016651900000000001 2024-09-17T02:21:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684618+0000", 2024-09-17T02:21:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083261356999999994 2024-09-17T02:21:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684724+0000", 2024-09-17T02:21:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010681800000000001 2024-09-17T02:21:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684911+0000", 2024-09-17T02:21:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186243 2024-09-17T02:21:41.416 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.416 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:41.416 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.416 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97752 5.b 5:d146f486:::benchmark_data_smithi001_23533_object97751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:41.416 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:41.416 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 23.818743361999999, 2024-09-17T02:21:41.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091989557, 2024-09-17T02:21:41.416 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:41.416 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:41.416 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:41.416 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97752 2024-09-17T02:21:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:41.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593300+0000", 2024-09-17T02:21:41.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8199999999999998e-07 2024-09-17T02:21:41.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:41.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593364+0000", 2024-09-17T02:21:41.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3831999999999995e-05 2024-09-17T02:21:41.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:41.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593376+0000", 2024-09-17T02:21:41.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1800999999999999e-05 2024-09-17T02:21:41.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593382+0000", 2024-09-17T02:21:41.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6780000000000003e-06 2024-09-17T02:21:41.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595491+0000", 2024-09-17T02:21:41.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021090689999999999 2024-09-17T02:21:41.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595614+0000", 2024-09-17T02:21:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012321500000000001 2024-09-17T02:21:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595778+0000", 2024-09-17T02:21:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016321900000000001 2024-09-17T02:21:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601197+0000", 2024-09-17T02:21:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054195600000000003 2024-09-17T02:21:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:41.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601396+0000", 2024-09-17T02:21:41.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019825299999999999 2024-09-17T02:21:41.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:41.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684990+0000", 2024-09-17T02:21:41.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083594878999999997 2024-09-17T02:21:41.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:41.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685116+0000", 2024-09-17T02:21:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012522799999999999 2024-09-17T02:21:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685289+0000", 2024-09-17T02:21:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172941 2024-09-17T02:21:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97754 5.b 5:da0615e5:::benchmark_data_smithi001_23533_object97753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 23.817105439999999, 2024-09-17T02:21:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092097207, 2024-09-17T02:21:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97754 2024-09-17T02:21:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:41.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:41.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:41.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594938+0000", 2024-09-17T02:21:41.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5000000000000002e-07 2024-09-17T02:21:41.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:41.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595075+0000", 2024-09-17T02:21:41.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137742 2024-09-17T02:21:41.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:41.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595087+0000", 2024-09-17T02:21:41.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1243000000000001e-05 2024-09-17T02:21:41.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595095+0000", 2024-09-17T02:21:41.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1030000000000002e-06 2024-09-17T02:21:41.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598461+0000", 2024-09-17T02:21:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033661170000000001 2024-09-17T02:21:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598540+0000", 2024-09-17T02:21:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8937999999999995e-05 2024-09-17T02:21:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598626+0000", 2024-09-17T02:21:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6042000000000001e-05 2024-09-17T02:21:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:41.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684258+0000", 2024-09-17T02:21:41.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085632394000000001 2024-09-17T02:21:41.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:41.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685369+0000", 2024-09-17T02:21:41.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001111063 2024-09-17T02:21:41.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:41.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685511+0000", 2024-09-17T02:21:41.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141965 2024-09-17T02:21:41.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:41.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685604+0000", 2024-09-17T02:21:41.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2935000000000004e-05 2024-09-17T02:21:41.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:41.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687034+0000", 2024-09-17T02:21:41.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001430015 2024-09-17T02:21:41.428 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.428 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:41.428 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.429 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97755 5.b 5:d36a03a1:::benchmark_data_smithi001_23533_object97754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:41.429 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:41.429 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 23.81693229, 2024-09-17T02:21:41.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0924904, 2024-09-17T02:21:41.429 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:41.429 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:41.429 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:41.429 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:41.429 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:41.429 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.429 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97755 2024-09-17T02:21:41.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.430 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:41.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:41.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:41.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:41.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:41.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:41.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595111+0000", 2024-09-17T02:21:41.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:21:41.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:41.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595145+0000", 2024-09-17T02:21:41.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3927000000000002e-05 2024-09-17T02:21:41.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:41.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595155+0000", 2024-09-17T02:21:41.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0023e-05 2024-09-17T02:21:41.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595162+0000", 2024-09-17T02:21:41.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3950000000000003e-06 2024-09-17T02:21:41.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599821+0000", 2024-09-17T02:21:41.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046592880000000001 2024-09-17T02:21:41.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:41.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599912+0000", 2024-09-17T02:21:41.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1049000000000002e-05 2024-09-17T02:21:41.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:41.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600062+0000", 2024-09-17T02:21:41.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015001700000000001 2024-09-17T02:21:41.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:41.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685307+0000", 2024-09-17T02:21:41.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085244340000000002 2024-09-17T02:21:41.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:41.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685446+0000", 2024-09-17T02:21:41.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013955700000000001 2024-09-17T02:21:41.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:41.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687375+0000", 2024-09-17T02:21:41.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019291079999999999 2024-09-17T02:21:41.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:41.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687462+0000", 2024-09-17T02:21:41.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6148000000000003e-05 2024-09-17T02:21:41.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:41.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687600+0000", 2024-09-17T02:21:41.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013887900000000001 2024-09-17T02:21:41.435 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.435 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:41.435 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.435 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 44/44 lb 5:c4567a04:::benchmark_data_smithi001_23533_object4200:head)", 2024-09-17T02:21:41.435 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:41.435 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 23.814835664, 2024-09-17T02:21:41.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092483421999999996, 2024-09-17T02:21:41.435 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:41.435 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:41.435 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:41.435 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:41.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:41.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:41.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:41.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:41.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:41.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:41.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6399999999999998e-07 2024-09-17T02:21:41.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:41.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597213+0000", 2024-09-17T02:21:41.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3659999999999997e-06 2024-09-17T02:21:41.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:41.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597222+0000", 2024-09-17T02:21:41.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0510000000000002e-06 2024-09-17T02:21:41.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597228+0000", 2024-09-17T02:21:41.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1569999999999999e-06 2024-09-17T02:21:41.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689588+0000", 2024-09-17T02:21:41.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092359931000000006 2024-09-17T02:21:41.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:41.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689622+0000", 2024-09-17T02:21:41.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4425999999999999e-05 2024-09-17T02:21:41.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:41.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689690+0000", 2024-09-17T02:21:41.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8126999999999993e-05 2024-09-17T02:21:41.439 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.439 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:41.439 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.439 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129462 5.4 5:2e0acc16:::benchmark_data_smithi001_23533_object1345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:41.439 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:21:41.439 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.8771015950000001, 2024-09-17T02:21:41.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0112774899999999, 2024-09-17T02:21:41.439 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:41.439 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:41.440 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:41.440 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:41.440 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:41.440 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.440 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129462 2024-09-17T02:21:41.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.440 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:41.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:41.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:21:41.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:41.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:21:41.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:41.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534943+0000", 2024-09-17T02:21:41.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8759999999999999e-06 2024-09-17T02:21:41.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:41.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534951+0000", 2024-09-17T02:21:41.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3219999999999993e-06 2024-09-17T02:21:41.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:41.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534977+0000", 2024-09-17T02:21:41.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6245e-05 2024-09-17T02:21:41.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534992+0000", 2024-09-17T02:21:41.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4936000000000001e-05 2024-09-17T02:21:41.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535133+0000", 2024-09-17T02:21:41.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014051299999999999 2024-09-17T02:21:41.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:41.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:21:41.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1741000000000001e-05 2024-09-17T02:21:41.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.533906+0000", 2024-09-17T02:21:41.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99875209300000001 2024-09-17T02:21:41.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:41.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534348+0000", 2024-09-17T02:21:41.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044128899999999998 2024-09-17T02:21:41.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:41.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534762+0000", 2024-09-17T02:21:41.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000414707 2024-09-17T02:21:41.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:41.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545024+0000", 2024-09-17T02:21:41.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010261283 2024-09-17T02:21:41.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:41.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545953+0000", 2024-09-17T02:21:41.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000929618 2024-09-17T02:21:41.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:41.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546047+0000", 2024-09-17T02:21:41.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3697999999999996e-05 2024-09-17T02:21:41.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:41.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546218+0000", 2024-09-17T02:21:41.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017116899999999999 2024-09-17T02:21:41.445 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.445 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:41.446 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.446 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129480 5.4 5:2b1d398b:::benchmark_data_smithi001_23533_object1363:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:41.446 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:21:41.446 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.8693471290000003, 2024-09-17T02:21:41.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0038926450000001, 2024-09-17T02:21:41.446 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:41.446 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:41.446 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:41.446 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:41.446 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:41.446 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.446 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129480 2024-09-17T02:21:41.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.447 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:41.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:41.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:21:41.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:41.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:21:41.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:41.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542696+0000", 2024-09-17T02:21:41.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9999999999999995e-07 2024-09-17T02:21:41.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:41.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542701+0000", 2024-09-17T02:21:41.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2240000000000003e-06 2024-09-17T02:21:41.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:41.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542716+0000", 2024-09-17T02:21:41.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4970000000000001e-05 2024-09-17T02:21:41.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542726+0000", 2024-09-17T02:21:41.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2879999999999998e-06 2024-09-17T02:21:41.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542832+0000", 2024-09-17T02:21:41.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010597199999999999 2024-09-17T02:21:41.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:41.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542843+0000", 2024-09-17T02:21:41.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.098e-05 2024-09-17T02:21:41.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538436+0000", 2024-09-17T02:21:41.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99559286800000002 2024-09-17T02:21:41.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:41.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538791+0000", 2024-09-17T02:21:41.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035585499999999997 2024-09-17T02:21:41.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:41.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.539144+0000", 2024-09-17T02:21:41.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035268499999999999 2024-09-17T02:21:41.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:41.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545880+0000", 2024-09-17T02:21:41.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00673552 2024-09-17T02:21:41.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:41.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546330+0000", 2024-09-17T02:21:41.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045039599999999999 2024-09-17T02:21:41.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:41.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546414+0000", 2024-09-17T02:21:41.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4468000000000005e-05 2024-09-17T02:21:41.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:41.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546588+0000", 2024-09-17T02:21:41.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017341899999999999 2024-09-17T02:21:41.452 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.452 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:41.452 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.452 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129505 5.4 5:294f2ec7:::benchmark_data_smithi001_23533_object1388:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:41.452 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:21:41.452 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.8503339560000001, 2024-09-17T02:21:41.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98589826199999997, 2024-09-17T02:21:41.453 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:41.453 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:41.453 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:41.453 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:41.453 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:41.453 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.453 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129505 2024-09-17T02:21:41.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.453 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:41.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:41.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:21:41.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:41.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:21:41.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:41.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561710+0000", 2024-09-17T02:21:41.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7060000000000001e-06 2024-09-17T02:21:41.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:41.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561718+0000", 2024-09-17T02:21:41.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.542e-06 2024-09-17T02:21:41.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:41.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561741+0000", 2024-09-17T02:21:41.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3357e-05 2024-09-17T02:21:41.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561754+0000", 2024-09-17T02:21:41.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3200000000000001e-05 2024-09-17T02:21:41.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561867+0000", 2024-09-17T02:21:41.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113211 2024-09-17T02:21:41.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:41.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561888+0000", 2024-09-17T02:21:41.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0809999999999999e-05 2024-09-17T02:21:41.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542140+0000", 2024-09-17T02:21:41.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98025195799999998 2024-09-17T02:21:41.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:41.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542331+0000", 2024-09-17T02:21:41.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019127599999999999 2024-09-17T02:21:41.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:41.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542517+0000", 2024-09-17T02:21:41.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000185625 2024-09-17T02:21:41.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:41.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547114+0000", 2024-09-17T02:21:41.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045968620000000002 2024-09-17T02:21:41.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:41.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547187+0000", 2024-09-17T02:21:41.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3348000000000003e-05 2024-09-17T02:21:41.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:41.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547324+0000", 2024-09-17T02:21:41.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013681699999999999 2024-09-17T02:21:41.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:41.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547607+0000", 2024-09-17T02:21:41.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028255000000000001 2024-09-17T02:21:41.459 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.459 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:41.459 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.459 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129508 5.4 5:2892b582:::benchmark_data_smithi001_23533_object1391:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:41.459 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:21:41.459 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.848996863, 2024-09-17T02:21:41.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99697919099999999, 2024-09-17T02:21:41.459 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:41.459 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:41.459 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:41.459 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:41.460 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:41.460 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.460 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129508 2024-09-17T02:21:41.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.460 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:41.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:41.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:21:41.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:41.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:21:41.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:41.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563047+0000", 2024-09-17T02:21:41.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.274e-06 2024-09-17T02:21:41.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:41.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563054+0000", 2024-09-17T02:21:41.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2799999999999998e-06 2024-09-17T02:21:41.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:41.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563070+0000", 2024-09-17T02:21:41.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5991999999999999e-05 2024-09-17T02:21:41.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563078+0000", 2024-09-17T02:21:41.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2390000000000002e-06 2024-09-17T02:21:41.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563181+0000", 2024-09-17T02:21:41.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102249 2024-09-17T02:21:41.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:41.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563199+0000", 2024-09-17T02:21:41.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8215000000000001e-05 2024-09-17T02:21:41.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547713+0000", 2024-09-17T02:21:41.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98451446399999998 2024-09-17T02:21:41.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:41.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548063+0000", 2024-09-17T02:21:41.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034985499999999999 2024-09-17T02:21:41.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:41.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548490+0000", 2024-09-17T02:21:41.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042658600000000001 2024-09-17T02:21:41.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:41.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555655+0000", 2024-09-17T02:21:41.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071652579999999999 2024-09-17T02:21:41.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:41.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559612+0000", 2024-09-17T02:21:41.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003957103 2024-09-17T02:21:41.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:41.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559768+0000", 2024-09-17T02:21:41.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015556899999999999 2024-09-17T02:21:41.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:41.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560025+0000", 2024-09-17T02:21:41.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025710700000000002 2024-09-17T02:21:41.465 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.465 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:41.465 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.466 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129509 5.4 5:2c35515e:::benchmark_data_smithi001_23533_object1392:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:41.466 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:21:41.466 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.8483698100000003, 2024-09-17T02:21:41.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99969384900000002, 2024-09-17T02:21:41.466 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:41.466 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:41.466 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:41.467 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:41.467 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:41.468 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.468 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129509 2024-09-17T02:21:41.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.468 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:41.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:41.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:21:41.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:41.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:21:41.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:41.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563674+0000", 2024-09-17T02:21:41.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0920000000000001e-06 2024-09-17T02:21:41.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:41.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563679+0000", 2024-09-17T02:21:41.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7660000000000004e-06 2024-09-17T02:21:41.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:41.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563693+0000", 2024-09-17T02:21:41.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3139000000000001e-05 2024-09-17T02:21:41.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563701+0000", 2024-09-17T02:21:41.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9859999999999994e-06 2024-09-17T02:21:41.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563775+0000", 2024-09-17T02:21:41.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4659000000000005e-05 2024-09-17T02:21:41.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:41.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563785+0000", 2024-09-17T02:21:41.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4839999999999993e-06 2024-09-17T02:21:41.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552085+0000", 2024-09-17T02:21:41.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98829986999999997 2024-09-17T02:21:41.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:41.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552554+0000", 2024-09-17T02:21:41.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046908900000000001 2024-09-17T02:21:41.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:41.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552931+0000", 2024-09-17T02:21:41.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377778 2024-09-17T02:21:41.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:41.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563106+0000", 2024-09-17T02:21:41.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010174186 2024-09-17T02:21:41.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:41.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563138+0000", 2024-09-17T02:21:41.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2495e-05 2024-09-17T02:21:41.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:41.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563225+0000", 2024-09-17T02:21:41.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6677999999999999e-05 2024-09-17T02:21:41.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:41.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563366+0000", 2024-09-17T02:21:41.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014162699999999999 2024-09-17T02:21:41.473 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.473 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:41.473 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.474 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129524 5.4 5:25dca7dd:::benchmark_data_smithi001_23533_object1407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:41.474 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:21:41.474 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.8416784560000004, 2024-09-17T02:21:41.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99999501999999996, 2024-09-17T02:21:41.474 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:41.474 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:41.474 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:41.474 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:41.474 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:41.474 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.474 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129524 2024-09-17T02:21:41.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.474 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:41.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:41.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:21:41.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:41.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:21:41.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:41.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570365+0000", 2024-09-17T02:21:41.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.142e-06 2024-09-17T02:21:41.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:41.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570369+0000", 2024-09-17T02:21:41.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.856e-06 2024-09-17T02:21:41.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:41.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570385+0000", 2024-09-17T02:21:41.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5855e-05 2024-09-17T02:21:41.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570392+0000", 2024-09-17T02:21:41.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5340000000000002e-06 2024-09-17T02:21:41.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570484+0000", 2024-09-17T02:21:41.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1212999999999996e-05 2024-09-17T02:21:41.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:41.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570498+0000", 2024-09-17T02:21:41.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4331000000000001e-05 2024-09-17T02:21:41.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555835+0000", 2024-09-17T02:21:41.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98533757700000002 2024-09-17T02:21:41.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:41.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556329+0000", 2024-09-17T02:21:41.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000493458 2024-09-17T02:21:41.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:41.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556784+0000", 2024-09-17T02:21:41.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045476499999999999 2024-09-17T02:21:41.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:41.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569852+0000", 2024-09-17T02:21:41.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013068270999999999 2024-09-17T02:21:41.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:41.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569958+0000", 2024-09-17T02:21:41.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106214 2024-09-17T02:21:41.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:41.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570124+0000", 2024-09-17T02:21:41.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165546 2024-09-17T02:21:41.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.480 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:41.480 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570359+0000", 2024-09-17T02:21:41.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023525799999999999 2024-09-17T02:21:41.480 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.480 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:41.480 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.480 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129537 5.4 5:260327c6:::benchmark_data_smithi001_23533_object1420:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:41.480 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:21:41.480 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.8337719269999999, 2024-09-17T02:21:41.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99624596499999996, 2024-09-17T02:21:41.480 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:41.481 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:41.481 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:41.481 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:41.481 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:41.481 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.481 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129537 2024-09-17T02:21:41.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.481 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:41.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.481 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:41.481 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:21:41.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:41.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:21:41.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:41.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578272+0000", 2024-09-17T02:21:41.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.164e-06 2024-09-17T02:21:41.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:41.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578278+0000", 2024-09-17T02:21:41.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5060000000000001e-06 2024-09-17T02:21:41.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:41.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578294+0000", 2024-09-17T02:21:41.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5687000000000001e-05 2024-09-17T02:21:41.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578329+0000", 2024-09-17T02:21:41.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5311999999999997e-05 2024-09-17T02:21:41.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578419+0000", 2024-09-17T02:21:41.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0054000000000002e-05 2024-09-17T02:21:41.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:41.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578435+0000", 2024-09-17T02:21:41.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5645999999999999e-05 2024-09-17T02:21:41.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560148+0000", 2024-09-17T02:21:41.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98171342299999997 2024-09-17T02:21:41.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:41.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560383+0000", 2024-09-17T02:21:41.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000234935 2024-09-17T02:21:41.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:41.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560586+0000", 2024-09-17T02:21:41.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000202909 2024-09-17T02:21:41.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:41.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570472+0000", 2024-09-17T02:21:41.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098856959999999994 2024-09-17T02:21:41.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:41.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574138+0000", 2024-09-17T02:21:41.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036660170000000001 2024-09-17T02:21:41.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:41.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574298+0000", 2024-09-17T02:21:41.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016025600000000001 2024-09-17T02:21:41.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:41.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574516+0000", 2024-09-17T02:21:41.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021835999999999999 2024-09-17T02:21:41.486 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.487 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:41.487 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.487 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129545 5.4 5:22366489:::benchmark_data_smithi001_23533_object1428:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:41.487 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:21:41.487 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.827909204, 2024-09-17T02:21:41.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99074544499999995, 2024-09-17T02:21:41.487 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:41.487 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:41.487 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:41.487 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:41.487 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:41.488 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.488 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129545 2024-09-17T02:21:41.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.488 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:41.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.488 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:41.488 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:21:41.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.488 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:41.488 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:21:41.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:41.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584135+0000", 2024-09-17T02:21:41.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4699999999999999e-06 2024-09-17T02:21:41.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:41.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584142+0000", 2024-09-17T02:21:41.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1620000000000002e-06 2024-09-17T02:21:41.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:41.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584170+0000", 2024-09-17T02:21:41.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7897000000000001e-05 2024-09-17T02:21:41.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584183+0000", 2024-09-17T02:21:41.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2814e-05 2024-09-17T02:21:41.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584299+0000", 2024-09-17T02:21:41.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116153 2024-09-17T02:21:41.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:41.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584316+0000", 2024-09-17T02:21:41.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7524999999999999e-05 2024-09-17T02:21:41.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563461+0000", 2024-09-17T02:21:41.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97914436699999996 2024-09-17T02:21:41.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:41.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563667+0000", 2024-09-17T02:21:41.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020689800000000001 2024-09-17T02:21:41.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:41.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563878+0000", 2024-09-17T02:21:41.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210275 2024-09-17T02:21:41.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:41.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570584+0000", 2024-09-17T02:21:41.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067066080000000002 2024-09-17T02:21:41.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:41.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574539+0000", 2024-09-17T02:21:41.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039550360000000003 2024-09-17T02:21:41.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:41.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574653+0000", 2024-09-17T02:21:41.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114003 2024-09-17T02:21:41.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.493 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:41.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574879+0000", 2024-09-17T02:21:41.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022523700000000001 2024-09-17T02:21:41.493 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.493 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:41.493 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.493 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129553 5.4 5:2e41ad40:::benchmark_data_smithi001_23533_object1436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:41.493 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:21:41.494 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.8224865680000004, 2024-09-17T02:21:41.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99213429600000003, 2024-09-17T02:21:41.494 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:41.494 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:41.494 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:41.494 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:41.494 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:41.494 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.494 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129553 2024-09-17T02:21:41.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.494 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:41.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:41.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:21:41.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:41.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:21:41.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:41.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589557+0000", 2024-09-17T02:21:41.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2219999999999999e-06 2024-09-17T02:21:41.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:41.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589562+0000", 2024-09-17T02:21:41.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0649999999999998e-06 2024-09-17T02:21:41.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:41.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589575+0000", 2024-09-17T02:21:41.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3129000000000001e-05 2024-09-17T02:21:41.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589584+0000", 2024-09-17T02:21:41.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6200000000000005e-06 2024-09-17T02:21:41.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589693+0000", 2024-09-17T02:21:41.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109319 2024-09-17T02:21:41.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:41.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589714+0000", 2024-09-17T02:21:41.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0849999999999999e-05 2024-09-17T02:21:41.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566273+0000", 2024-09-17T02:21:41.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97655884999999998 2024-09-17T02:21:41.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:41.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566543+0000", 2024-09-17T02:21:41.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027059099999999998 2024-09-17T02:21:41.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:41.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566832+0000", 2024-09-17T02:21:41.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028898200000000002 2024-09-17T02:21:41.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:41.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581040+0000", 2024-09-17T02:21:41.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014208001 2024-09-17T02:21:41.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:41.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581200+0000", 2024-09-17T02:21:41.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159956 2024-09-17T02:21:41.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:41.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581427+0000", 2024-09-17T02:21:41.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000226309 2024-09-17T02:21:41.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:41.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581690+0000", 2024-09-17T02:21:41.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026340199999999998 2024-09-17T02:21:41.500 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.500 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:41.500 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.500 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129580 5.4 5:25ed887b:::benchmark_data_smithi001_23533_object1463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:41.500 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:21:41.500 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.800714524, 2024-09-17T02:21:41.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98001430499999997, 2024-09-17T02:21:41.500 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:41.500 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:41.500 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:41.501 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:41.501 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:41.501 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.501 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129580 2024-09-17T02:21:41.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.501 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:41.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:41.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:21:41.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:41.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:21:41.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:41.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611329+0000", 2024-09-17T02:21:41.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.22e-06 2024-09-17T02:21:41.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:41.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611335+0000", 2024-09-17T02:21:41.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1129999999999997e-06 2024-09-17T02:21:41.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:41.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611348+0000", 2024-09-17T02:21:41.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2342e-05 2024-09-17T02:21:41.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611356+0000", 2024-09-17T02:21:41.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.371e-06 2024-09-17T02:21:41.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611419+0000", 2024-09-17T02:21:41.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3393999999999996e-05 2024-09-17T02:21:41.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:41.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611427+0000", 2024-09-17T02:21:41.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999997e-06 2024-09-17T02:21:41.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570705+0000", 2024-09-17T02:21:41.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.95927859199999999 2024-09-17T02:21:41.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:41.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571009+0000", 2024-09-17T02:21:41.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030414599999999998 2024-09-17T02:21:41.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:41.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571241+0000", 2024-09-17T02:21:41.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023106799999999999 2024-09-17T02:21:41.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:41.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590789+0000", 2024-09-17T02:21:41.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019548763 2024-09-17T02:21:41.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:41.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590928+0000", 2024-09-17T02:21:41.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000139092 2024-09-17T02:21:41.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:41.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591086+0000", 2024-09-17T02:21:41.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015787400000000001 2024-09-17T02:21:41.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:41.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591342+0000", 2024-09-17T02:21:41.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025589900000000002 2024-09-17T02:21:41.506 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.506 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:41.507 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.507 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129603 5.4 5:25aaa5e8:::benchmark_data_smithi001_23533_object1486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:41.507 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:41.507 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.7846547279999996, 2024-09-17T02:21:41.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96463198999999999, 2024-09-17T02:21:41.507 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:41.507 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:41.507 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:41.507 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:41.507 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:41.507 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.507 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129603 2024-09-17T02:21:41.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.508 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:41.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:41.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:41.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:41.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:41.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:41.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:41.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:21:41.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:41.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627392+0000", 2024-09-17T02:21:41.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0790000000000002e-06 2024-09-17T02:21:41.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:41.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627403+0000", 2024-09-17T02:21:41.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0866000000000001e-05 2024-09-17T02:21:41.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627409+0000", 2024-09-17T02:21:41.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.305e-06 2024-09-17T02:21:41.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627485+0000", 2024-09-17T02:21:41.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6582000000000006e-05 2024-09-17T02:21:41.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:41.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627499+0000", 2024-09-17T02:21:41.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:21:41.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574991+0000", 2024-09-17T02:21:41.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94749182300000001 2024-09-17T02:21:41.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:41.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575377+0000", 2024-09-17T02:21:41.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038629400000000003 2024-09-17T02:21:41.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:41.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575665+0000", 2024-09-17T02:21:41.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028759499999999997 2024-09-17T02:21:41.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:41.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590802+0000", 2024-09-17T02:21:41.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015136479 2024-09-17T02:21:41.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:41.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591614+0000", 2024-09-17T02:21:41.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081293100000000003 2024-09-17T02:21:41.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:41.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591764+0000", 2024-09-17T02:21:41.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014932199999999999 2024-09-17T02:21:41.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:41.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592020+0000", 2024-09-17T02:21:41.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025585099999999997 2024-09-17T02:21:41.513 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.513 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:41.513 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.513 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129607 5.4 5:2f638f1e:::benchmark_data_smithi001_23533_object1490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:41.513 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:21:41.514 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.783127822, 2024-09-17T02:21:41.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96352375899999998, 2024-09-17T02:21:41.514 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:41.514 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:41.514 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:41.514 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:41.514 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:41.514 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.514 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129607 2024-09-17T02:21:41.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.514 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:41.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:41.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:21:41.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:41.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:21:41.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:41.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628916+0000", 2024-09-17T02:21:41.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1710000000000001e-06 2024-09-17T02:21:41.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:41.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628920+0000", 2024-09-17T02:21:41.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-17T02:21:41.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:41.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628935+0000", 2024-09-17T02:21:41.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4474000000000001e-05 2024-09-17T02:21:41.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628944+0000", 2024-09-17T02:21:41.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9940000000000006e-06 2024-09-17T02:21:41.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628997+0000", 2024-09-17T02:21:41.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3579000000000003e-05 2024-09-17T02:21:41.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:41.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.629006+0000", 2024-09-17T02:21:41.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4009999999999997e-06 2024-09-17T02:21:41.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.577862+0000", 2024-09-17T02:21:41.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.948856335 2024-09-17T02:21:41.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:41.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578167+0000", 2024-09-17T02:21:41.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030532399999999999 2024-09-17T02:21:41.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:41.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578532+0000", 2024-09-17T02:21:41.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036428200000000001 2024-09-17T02:21:41.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:41.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591442+0000", 2024-09-17T02:21:41.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012910374000000001 2024-09-17T02:21:41.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:41.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592164+0000", 2024-09-17T02:21:41.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072242499999999996 2024-09-17T02:21:41.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:41.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592267+0000", 2024-09-17T02:21:41.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102205 2024-09-17T02:21:41.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:41.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592438+0000", 2024-09-17T02:21:41.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017165299999999999 2024-09-17T02:21:41.520 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.520 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:41.520 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.520 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129623 5.4 5:2cf5174b:::benchmark_data_smithi001_23533_object1506:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:41.520 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:21:41.520 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.7591835360000001, 2024-09-17T02:21:41.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94334114499999999, 2024-09-17T02:21:41.520 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:41.520 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:41.520 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:41.521 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:41.521 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:41.521 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.521 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129623 2024-09-17T02:21:41.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.521 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:41.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:41.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:21:41.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:41.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:21:41.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:41.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652860+0000", 2024-09-17T02:21:41.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0330000000000001e-06 2024-09-17T02:21:41.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:41.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652864+0000", 2024-09-17T02:21:41.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.634e-06 2024-09-17T02:21:41.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:41.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652877+0000", 2024-09-17T02:21:41.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2591e-05 2024-09-17T02:21:41.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652883+0000", 2024-09-17T02:21:41.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1460000000000001e-06 2024-09-17T02:21:41.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652943+0000", 2024-09-17T02:21:41.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9833999999999997e-05 2024-09-17T02:21:41.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:41.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652950+0000", 2024-09-17T02:21:41.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.401e-06 2024-09-17T02:21:41.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581800+0000", 2024-09-17T02:21:41.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.92884935700000004 2024-09-17T02:21:41.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:41.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582122+0000", 2024-09-17T02:21:41.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032185200000000002 2024-09-17T02:21:41.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:41.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582689+0000", 2024-09-17T02:21:41.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056750400000000003 2024-09-17T02:21:41.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:41.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591458+0000", 2024-09-17T02:21:41.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008768685 2024-09-17T02:21:41.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:41.526 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595856+0000", 2024-09-17T02:21:41.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043977909999999999 2024-09-17T02:21:41.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.526 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.526 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:41.526 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595955+0000", 2024-09-17T02:21:41.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9166000000000006e-05 2024-09-17T02:21:41.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.526 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.526 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:41.526 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596200+0000", 2024-09-17T02:21:41.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024515099999999998 2024-09-17T02:21:41.526 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.526 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:41.527 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.527 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129642 5.4 5:255eb796:::benchmark_data_smithi001_23533_object1525:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:41.527 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:21:41.527 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.727947372, 2024-09-17T02:21:41.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.91257397299999998, 2024-09-17T02:21:41.527 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:41.527 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:41.527 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:41.527 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:41.527 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:41.527 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.527 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129642 2024-09-17T02:21:41.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.528 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:41.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:41.528 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:21:41.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:41.528 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:21:41.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:41.529 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684096+0000", 2024-09-17T02:21:41.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659999999999999e-06 2024-09-17T02:21:41.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.529 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.529 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:41.529 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684101+0000", 2024-09-17T02:21:41.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8110000000000002e-06 2024-09-17T02:21:41.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.529 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.529 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:41.529 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684114+0000", 2024-09-17T02:21:41.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2653000000000001e-05 2024-09-17T02:21:41.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684121+0000", 2024-09-17T02:21:41.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5100000000000001e-06 2024-09-17T02:21:41.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684181+0000", 2024-09-17T02:21:41.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0307999999999999e-05 2024-09-17T02:21:41.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:41.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684194+0000", 2024-09-17T02:21:41.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2916e-05 2024-09-17T02:21:41.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.587917+0000", 2024-09-17T02:21:41.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.90372220400000003 2024-09-17T02:21:41.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:41.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588215+0000", 2024-09-17T02:21:41.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029845400000000003 2024-09-17T02:21:41.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:41.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588470+0000", 2024-09-17T02:21:41.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025455399999999999 2024-09-17T02:21:41.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:41.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596318+0000", 2024-09-17T02:21:41.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078485589999999997 2024-09-17T02:21:41.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:41.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596354+0000", 2024-09-17T02:21:41.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5976999999999998e-05 2024-09-17T02:21:41.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:41.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596449+0000", 2024-09-17T02:21:41.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4728999999999994e-05 2024-09-17T02:21:41.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.533 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:41.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596669+0000", 2024-09-17T02:21:41.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220132 2024-09-17T02:21:41.533 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.533 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:41.533 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.533 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129649 5.4 5:2fe27050:::benchmark_data_smithi001_23533_object1532:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:41.533 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:21:41.534 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.6963906289999997, 2024-09-17T02:21:41.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.88508119100000004, 2024-09-17T02:21:41.534 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:41.534 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:41.534 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:41.534 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:41.534 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:41.534 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.534 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129649 2024-09-17T02:21:41.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.534 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:41.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:41.534 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:21:41.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:41.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:21:41.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:41.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:41.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715653+0000", 2024-09-17T02:21:41.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3519999999999999e-06 2024-09-17T02:21:41.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:41.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715658+0000", 2024-09-17T02:21:41.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3120000000000001e-06 2024-09-17T02:21:41.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:41.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715677+0000", 2024-09-17T02:21:41.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-17T02:21:41.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715687+0000", 2024-09-17T02:21:41.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0146000000000001e-05 2024-09-17T02:21:41.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715821+0000", 2024-09-17T02:21:41.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013421 2024-09-17T02:21:41.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:41.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715840+0000", 2024-09-17T02:21:41.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8153999999999999e-05 2024-09-17T02:21:41.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:41.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592528+0000", 2024-09-17T02:21:41.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.87668860000000004 2024-09-17T02:21:41.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:41.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592702+0000", 2024-09-17T02:21:41.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017429300000000001 2024-09-17T02:21:41.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:41.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592945+0000", 2024-09-17T02:21:41.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000242048 2024-09-17T02:21:41.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:41.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600234+0000", 2024-09-17T02:21:41.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072897600000000002 2024-09-17T02:21:41.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:41.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600494+0000", 2024-09-17T02:21:41.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000259984 2024-09-17T02:21:41.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:41.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600555+0000", 2024-09-17T02:21:41.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1138999999999999e-05 2024-09-17T02:21:41.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:41.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:41.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:41.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600733+0000", 2024-09-17T02:21:41.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017753300000000001 2024-09-17T02:21:41.540 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.540 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:41.540 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.540 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:41.540 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:41.540 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:41.540 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:21:41.542 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:41.543 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:41.545+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:41.643 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:41.642+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:41.702 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:41.702 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:41.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.702 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:141336 5.2 5:47c9c113:::benchmark_data_smithi001_23533_object13219:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:41.702 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:41.695105+0000", 2024-09-17T02:21:41.702 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.010946834000000001, 2024-09-17T02:21:41.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010970137, 2024-09-17T02:21:41.702 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:41.702 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:41.703 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:41.703 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:41.703 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:41.703 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.703 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 141336 2024-09-17T02:21:41.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.703 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:41.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:41.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.695105+0000", 2024-09-17T02:21:41.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:41.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:41.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.695105+0000", 2024-09-17T02:21:41.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:41.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:41.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.695106+0000", 2024-09-17T02:21:41.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.051e-06 2024-09-17T02:21:41.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:41.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.695112+0000", 2024-09-17T02:21:41.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.519e-06 2024-09-17T02:21:41.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:41.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.695124+0000", 2024-09-17T02:21:41.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2259000000000001e-05 2024-09-17T02:21:41.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.695173+0000", 2024-09-17T02:21:41.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8891000000000003e-05 2024-09-17T02:21:41.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:41.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.698673+0000", 2024-09-17T02:21:41.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035004229999999999 2024-09-17T02:21:41.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:41.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.698795+0000", 2024-09-17T02:21:41.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000121675 2024-09-17T02:21:41.706 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:41.706 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:41.707 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:41.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.707 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:141337 5.2 5:4c0a740d:::benchmark_data_smithi001_23533_object13220:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:41.707 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:41.695414+0000", 2024-09-17T02:21:41.707 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.010638142999999999, 2024-09-17T02:21:41.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010731397, 2024-09-17T02:21:41.707 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:41.707 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:41.707 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:41.707 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:41.707 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:41.707 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.707 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 141337 2024-09-17T02:21:41.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.708 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:41.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:41.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.695414+0000", 2024-09-17T02:21:41.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:41.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:41.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.695414+0000", 2024-09-17T02:21:41.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:41.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:41.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.695415+0000", 2024-09-17T02:21:41.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0500000000000002e-07 2024-09-17T02:21:41.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:41.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.695419+0000", 2024-09-17T02:21:41.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7799999999999998e-06 2024-09-17T02:21:41.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:41.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.695427+0000", 2024-09-17T02:21:41.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8890000000000008e-06 2024-09-17T02:21:41.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.695434+0000", 2024-09-17T02:21:41.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6259999999999997e-06 2024-09-17T02:21:41.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:41.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.700922+0000", 2024-09-17T02:21:41.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0054877119999999996 2024-09-17T02:21:41.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:41.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701035+0000", 2024-09-17T02:21:41.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000113082 2024-09-17T02:21:41.711 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:41.711 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:41.711 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:41.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.711 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:141342 5.2 5:4fdb1155:::benchmark_data_smithi001_23533_object13225:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:41.711 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:41.696864+0000", 2024-09-17T02:21:41.711 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0091881940000000002, 2024-09-17T02:21:41.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0093432740000000004, 2024-09-17T02:21:41.711 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:41.711 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:41.711 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:41.712 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:41.712 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:41.712 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.712 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 141342 2024-09-17T02:21:41.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.712 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:41.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:41.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.696864+0000", 2024-09-17T02:21:41.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:41.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:41.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.696864+0000", 2024-09-17T02:21:41.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:41.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:41.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.696865+0000", 2024-09-17T02:21:41.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2900000000000002e-07 2024-09-17T02:21:41.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:41.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.696870+0000", 2024-09-17T02:21:41.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6500000000000004e-06 2024-09-17T02:21:41.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:41.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.696879+0000", 2024-09-17T02:21:41.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0520000000000007e-06 2024-09-17T02:21:41.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.696885+0000", 2024-09-17T02:21:41.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5320000000000003e-06 2024-09-17T02:21:41.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:41.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.702994+0000", 2024-09-17T02:21:41.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0061093440000000001 2024-09-17T02:21:41.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:41.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.703143+0000", 2024-09-17T02:21:41.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000148956 2024-09-17T02:21:41.715 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:41.716 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:41.716 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:41.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.716 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:141347 5.0 5:0faeca76:::benchmark_data_smithi001_23533_object13230:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:41.716 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:41.700601+0000", 2024-09-17T02:21:41.716 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0054514150000000003, 2024-09-17T02:21:41.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056674009999999999, 2024-09-17T02:21:41.716 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:41.716 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:41.716 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:41.716 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:41.716 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:41.717 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.717 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 141347 2024-09-17T02:21:41.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.717 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:41.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:41.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.700601+0000", 2024-09-17T02:21:41.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:41.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:41.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.700601+0000", 2024-09-17T02:21:41.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:41.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:41.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.700602+0000", 2024-09-17T02:21:41.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1289999999999999e-06 2024-09-17T02:21:41.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:41.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.700607+0000", 2024-09-17T02:21:41.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6650000000000002e-06 2024-09-17T02:21:41.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:41.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.700617+0000", 2024-09-17T02:21:41.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0715e-05 2024-09-17T02:21:41.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.700624+0000", 2024-09-17T02:21:41.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9419999999999998e-06 2024-09-17T02:21:41.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:41.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.700665+0000", 2024-09-17T02:21:41.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1322000000000002e-05 2024-09-17T02:21:41.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:41.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.700790+0000", 2024-09-17T02:21:41.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012433999999999999 2024-09-17T02:21:41.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:41.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.700867+0000", 2024-09-17T02:21:41.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7064000000000006e-05 2024-09-17T02:21:41.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:41.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705504+0000", 2024-09-17T02:21:41.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046370689999999997 2024-09-17T02:21:41.721 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:41.721 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:41.721 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:41.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.721 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:141348 5.2 5.48f2d752 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:41.721 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:41.701289+0000", 2024-09-17T02:21:41.721 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0047626810000000004, 2024-09-17T02:21:41.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050487279999999997, 2024-09-17T02:21:41.721 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:41.722 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:41.722 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:41.722 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:41.722 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:41.722 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.722 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 141348 2024-09-17T02:21:41.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.722 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:41.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:41.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701289+0000", 2024-09-17T02:21:41.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:41.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:41.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701289+0000", 2024-09-17T02:21:41.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:41.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:41.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701290+0000", 2024-09-17T02:21:41.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6400000000000001e-07 2024-09-17T02:21:41.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:41.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701293+0000", 2024-09-17T02:21:41.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0630000000000002e-06 2024-09-17T02:21:41.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:41.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701305+0000", 2024-09-17T02:21:41.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.148e-05 2024-09-17T02:21:41.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701310+0000", 2024-09-17T02:21:41.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9869999999999999e-06 2024-09-17T02:21:41.724 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:41.724 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:41.724 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:41.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.725 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:141349 5.8 5:137d3358:::benchmark_data_smithi001_23533_object13232:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:41.725 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:41.701320+0000", 2024-09-17T02:21:41.725 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0047322220000000003, 2024-09-17T02:21:41.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050710360000000001, 2024-09-17T02:21:41.725 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:41.725 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:41.725 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:41.725 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:41.725 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:41.725 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.725 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 141349 2024-09-17T02:21:41.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.726 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:41.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:41.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701320+0000", 2024-09-17T02:21:41.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:41.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:41.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701320+0000", 2024-09-17T02:21:41.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:41.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:41.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701320+0000", 2024-09-17T02:21:41.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1100000000000002e-07 2024-09-17T02:21:41.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:41.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701322+0000", 2024-09-17T02:21:41.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6980000000000001e-06 2024-09-17T02:21:41.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:41.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701327+0000", 2024-09-17T02:21:41.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0010000000000001e-06 2024-09-17T02:21:41.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701330+0000", 2024-09-17T02:21:41.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4400000000000001e-06 2024-09-17T02:21:41.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:41.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.702627+0000", 2024-09-17T02:21:41.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012967759999999999 2024-09-17T02:21:41.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:41.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.702738+0000", 2024-09-17T02:21:41.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000110642 2024-09-17T02:21:41.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:41.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.702835+0000", 2024-09-17T02:21:41.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7485999999999995e-05 2024-09-17T02:21:41.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:41.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705699+0000", 2024-09-17T02:21:41.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002863516 2024-09-17T02:21:41.730 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:41.730 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:41.730 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:41.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.730 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:141350 5.3 5:cec4e7e1:::benchmark_data_smithi001_23533_object13233:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:41.730 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:41.701335+0000", 2024-09-17T02:21:41.730 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0047170399999999996, 2024-09-17T02:21:41.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051259369999999997, 2024-09-17T02:21:41.730 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:41.730 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:41.731 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:41.731 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:41.731 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:41.731 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.731 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 141350 2024-09-17T02:21:41.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.731 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:41.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:41.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701335+0000", 2024-09-17T02:21:41.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:41.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:41.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701335+0000", 2024-09-17T02:21:41.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:41.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:41.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701335+0000", 2024-09-17T02:21:41.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7000000000000001e-07 2024-09-17T02:21:41.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:41.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701337+0000", 2024-09-17T02:21:41.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.279e-06 2024-09-17T02:21:41.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:41.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701341+0000", 2024-09-17T02:21:41.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2740000000000001e-06 2024-09-17T02:21:41.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701344+0000", 2024-09-17T02:21:41.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9909999999999998e-06 2024-09-17T02:21:41.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:41.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701387+0000", 2024-09-17T02:21:41.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2679000000000003e-05 2024-09-17T02:21:41.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:41.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701527+0000", 2024-09-17T02:21:41.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014011399999999999 2024-09-17T02:21:41.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:41.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701647+0000", 2024-09-17T02:21:41.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000119855 2024-09-17T02:21:41.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:41.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705098+0000", 2024-09-17T02:21:41.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034514659999999998 2024-09-17T02:21:41.735 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:41.735 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:41.735 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:41.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.735 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:141353 5.a 5:55605e84:::benchmark_data_smithi001_23533_object13236:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:41.735 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:41.701426+0000", 2024-09-17T02:21:41.735 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0046260720000000002, 2024-09-17T02:21:41.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051258639999999999, 2024-09-17T02:21:41.735 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:41.736 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:41.736 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:41.736 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:41.736 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:41.736 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.736 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 141353 2024-09-17T02:21:41.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.736 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:41.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:41.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701426+0000", 2024-09-17T02:21:41.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:41.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:41.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701426+0000", 2024-09-17T02:21:41.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:41.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:41.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701427+0000", 2024-09-17T02:21:41.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8500000000000002e-07 2024-09-17T02:21:41.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:41.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701429+0000", 2024-09-17T02:21:41.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9649999999999998e-06 2024-09-17T02:21:41.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:41.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701433+0000", 2024-09-17T02:21:41.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9479999999999999e-06 2024-09-17T02:21:41.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701437+0000", 2024-09-17T02:21:41.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2289999999999999e-06 2024-09-17T02:21:41.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:41.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705071+0000", 2024-09-17T02:21:41.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036339620000000001 2024-09-17T02:21:41.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:41.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705182+0000", 2024-09-17T02:21:41.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011116 2024-09-17T02:21:41.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:41.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705253+0000", 2024-09-17T02:21:41.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1369000000000001e-05 2024-09-17T02:21:41.739 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:41.739 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:41.740 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:41.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.740 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:141351 5.e e54/22 5:722c9e20:::benchmark_data_smithi001_23533_object13234:head v 54'8844, mlcod=54'8842)", 2024-09-17T02:21:41.740 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:41.701707+0000", 2024-09-17T02:21:41.740 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.004345069, 2024-09-17T02:21:41.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049105700000000004, 2024-09-17T02:21:41.740 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:41.740 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:41.740 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:41.740 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:41.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:41.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701707+0000", 2024-09-17T02:21:41.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:41.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:41.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701707+0000", 2024-09-17T02:21:41.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:41.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:41.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701707+0000", 2024-09-17T02:21:41.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2300000000000002e-07 2024-09-17T02:21:41.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:41.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701711+0000", 2024-09-17T02:21:41.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2789999999999999e-06 2024-09-17T02:21:41.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:41.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701716+0000", 2024-09-17T02:21:41.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9200000000000003e-06 2024-09-17T02:21:41.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701719+0000", 2024-09-17T02:21:41.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0989999999999999e-06 2024-09-17T02:21:41.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:41.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701756+0000", 2024-09-17T02:21:41.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6859000000000001e-05 2024-09-17T02:21:41.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:41.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.701768+0000", 2024-09-17T02:21:41.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2547e-05 2024-09-17T02:21:41.743 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:41.743 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:41.743 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:41.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.744 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:141354 5.e e54/22 5:7eb1d972:::benchmark_data_smithi001_23533_object13237:head v 54'8845, mlcod=54'8842)", 2024-09-17T02:21:41.744 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:41.704984+0000", 2024-09-17T02:21:41.744 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0010684309999999999, 2024-09-17T02:21:41.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016867869999999999, 2024-09-17T02:21:41.744 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:41.744 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:41.744 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:41.744 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:41.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:41.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.704984+0000", 2024-09-17T02:21:41.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:41.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:41.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.704984+0000", 2024-09-17T02:21:41.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:41.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:41.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.704984+0000", 2024-09-17T02:21:41.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6199999999999998e-07 2024-09-17T02:21:41.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:41.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.704990+0000", 2024-09-17T02:21:41.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4269999999999999e-06 2024-09-17T02:21:41.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:41.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.704998+0000", 2024-09-17T02:21:41.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4100000000000008e-06 2024-09-17T02:21:41.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705007+0000", 2024-09-17T02:21:41.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7299999999999994e-06 2024-09-17T02:21:41.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:41.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705058+0000", 2024-09-17T02:21:41.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1159999999999998e-05 2024-09-17T02:21:41.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:41.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705079+0000", 2024-09-17T02:21:41.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0517999999999999e-05 2024-09-17T02:21:41.747 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:41.747 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:41.747 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:41.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.747 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:141355 5.7 5:e15aa829:::benchmark_data_smithi001_23533_object13238:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:41.748 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:41.705056+0000", 2024-09-17T02:21:41.748 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00099599999999999992, 2024-09-17T02:21:41.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00166859, 2024-09-17T02:21:41.748 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:41.748 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:41.748 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:41.748 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:41.748 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:41.748 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.748 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 141355 2024-09-17T02:21:41.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.748 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:41.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:41.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705056+0000", 2024-09-17T02:21:41.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:41.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:41.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705056+0000", 2024-09-17T02:21:41.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:41.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:41.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705057+0000", 2024-09-17T02:21:41.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9800000000000002e-07 2024-09-17T02:21:41.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:41.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705060+0000", 2024-09-17T02:21:41.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4060000000000001e-06 2024-09-17T02:21:41.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:41.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705069+0000", 2024-09-17T02:21:41.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3760000000000008e-06 2024-09-17T02:21:41.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705075+0000", 2024-09-17T02:21:41.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7950000000000004e-06 2024-09-17T02:21:41.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:41.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705129+0000", 2024-09-17T02:21:41.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4780000000000001e-05 2024-09-17T02:21:41.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:41.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705247+0000", 2024-09-17T02:21:41.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117521 2024-09-17T02:21:41.751 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:41.751 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:41.752 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:41.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.752 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:141356 5.c 5:39fa8168:::benchmark_data_smithi001_23533_object13239:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:41.752 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:41.705376+0000", 2024-09-17T02:21:41.752 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00067574900000000001, 2024-09-17T02:21:41.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001407487, 2024-09-17T02:21:41.752 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:41.752 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:41.752 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:41.752 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:41.752 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:41.752 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.753 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 141356 2024-09-17T02:21:41.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.753 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:41.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:41.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705376+0000", 2024-09-17T02:21:41.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:41.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:41.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705376+0000", 2024-09-17T02:21:41.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:41.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:41.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705377+0000", 2024-09-17T02:21:41.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4399999999999998e-07 2024-09-17T02:21:41.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:41.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705381+0000", 2024-09-17T02:21:41.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8240000000000001e-06 2024-09-17T02:21:41.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:41.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705391+0000", 2024-09-17T02:21:41.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0057e-05 2024-09-17T02:21:41.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705398+0000", 2024-09-17T02:21:41.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5830000000000003e-06 2024-09-17T02:21:41.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:41.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705457+0000", 2024-09-17T02:21:41.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8763e-05 2024-09-17T02:21:41.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:41.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705606+0000", 2024-09-17T02:21:41.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014894800000000001 2024-09-17T02:21:41.756 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:41.756 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:41.756 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:41.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.756 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:141357 5.a 5.5de297fa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:41.756 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:41.705422+0000", 2024-09-17T02:21:41.756 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00063016899999999998, 2024-09-17T02:21:41.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014190610000000001, 2024-09-17T02:21:41.756 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:41.757 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:41.757 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:41.757 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:41.757 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:41.757 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:41.757 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 141357 2024-09-17T02:21:41.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.757 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:41.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:41.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705422+0000", 2024-09-17T02:21:41.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:41.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:41.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705422+0000", 2024-09-17T02:21:41.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:41.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:41.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705422+0000", 2024-09-17T02:21:41.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6100000000000001e-07 2024-09-17T02:21:41.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:41.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705425+0000", 2024-09-17T02:21:41.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.666e-06 2024-09-17T02:21:41.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:41.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705432+0000", 2024-09-17T02:21:41.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7519999999999999e-06 2024-09-17T02:21:41.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:41.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:41.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:41.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.705437+0000", 2024-09-17T02:21:41.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.87e-06 2024-09-17T02:21:41.760 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:41.760 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:41.760 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:41.760 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:41.760 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:21:41.760 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 13 2024-09-17T02:21:41.760 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:41.761 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:21:41.762 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:21:41.762 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:21:41.763 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:41.763 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:41.762+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:41.764 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:21:41.764 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:21:41.764 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:21:41.764 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:21:41.863 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:41.865+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:41.933 INFO:teuthology.orchestra.run.smithi001.stderr:noscrub is set 2024-09-17T02:21:41.950 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:41.951 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:41.963 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:41.969+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:41.969 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:42.065 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:42.069+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:42.114 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:42.114 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:42.135 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:42.166 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:42.166+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:42.286 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:42.286 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:42.300 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:42.305 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:42.266+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:42.368 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:42.373+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:42.458 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:42.458 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:42.470 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:42.470+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:42.479 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:42.571 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:42.577+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:42.670 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:42.673+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:42.679 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:42.680 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:42.700 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:42.771 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:42.770+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:42.859 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:42.859 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:42.873 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:42.877+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:42.878 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:42.972 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:42.977+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:43.071 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:43.072 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:43.073 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:43.077+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:43.091 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:43.173 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:43.177+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:43.243 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:43.243 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:43.262 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:43.274 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:43.274+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:43.375 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:43.381+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:43.422 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:43.422 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:43.430 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-09-17T02:21:43.430 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T02:21:43.431 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-09-17T02:21:43.431 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-17T02:21:43.431 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-17T02:21:43.431 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-09-17T02:21:43.442 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:43.484 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:43.489+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:43.578 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:43.578+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:43.582 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:43.582 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "" 2024-09-17T02:21:43.582 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:43.643 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:43.644 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:43.663 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:43.678 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:43.678+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:43.766 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:21:43.779 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:43.781+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:43.812 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:43.812 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:43.832 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:43.881 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:43.882+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:43.929 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:21:43.930 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:21:43.948 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:21:43.949 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:21:43.949 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:21:43.952 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:21:43.952 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:21:43.962 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T02:21:43.981 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:43.982+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:43.988 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:43.988 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:43.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:43.988 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:146235 5.1 5:8fb9a8b3:::benchmark_data_smithi001_23533_object18118:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T02:21:43.988 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:43.980682+0000", 2024-09-17T02:21:43.988 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.011225532999999999, 2024-09-17T02:21:43.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011248620000000001, 2024-09-17T02:21:43.988 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:43.988 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:43.989 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:43.989 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:43.989 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:43.989 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:43.989 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 146235 2024-09-17T02:21:43.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:43.989 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:43.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:43.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:43.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.980682+0000", 2024-09-17T02:21:43.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:43.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:43.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:43.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:43.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.980682+0000", 2024-09-17T02:21:43.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:43.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:43.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:43.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:43.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.980683+0000", 2024-09-17T02:21:43.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8099999999999998e-07 2024-09-17T02:21:43.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:43.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:43.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:43.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.980685+0000", 2024-09-17T02:21:43.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8649999999999999e-06 2024-09-17T02:21:43.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:43.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:43.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:43.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.980690+0000", 2024-09-17T02:21:43.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6380000000000001e-06 2024-09-17T02:21:43.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:43.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:43.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:43.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.980695+0000", 2024-09-17T02:21:43.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6809999999999997e-06 2024-09-17T02:21:43.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:43.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:43.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:43.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.982714+0000", 2024-09-17T02:21:43.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020193590000000001 2024-09-17T02:21:43.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:43.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:43.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:43.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.982831+0000", 2024-09-17T02:21:43.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000116734 2024-09-17T02:21:43.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:43.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:43.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:43.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.982937+0000", 2024-09-17T02:21:43.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106086 2024-09-17T02:21:43.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:43.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:43.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:43.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.986918+0000", 2024-09-17T02:21:43.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003981269 2024-09-17T02:21:43.993 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:43.993 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:43.993 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:43.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:43.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:43.993 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:146247 5.c 5:352a3717:::benchmark_data_smithi001_23533_object18130:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T02:21:43.993 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:43.985348+0000", 2024-09-17T02:21:43.993 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.006559339, 2024-09-17T02:21:43.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066625649999999996, 2024-09-17T02:21:43.994 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:43.994 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:43.994 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:43.994 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:43.994 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:43.994 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:43.994 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 146247 2024-09-17T02:21:43.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:43.994 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:43.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:43.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:43.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.985348+0000", 2024-09-17T02:21:43.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:43.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:43.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:43.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:43.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.985348+0000", 2024-09-17T02:21:43.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:43.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:43.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:43.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:43.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.985349+0000", 2024-09-17T02:21:43.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4199999999999996e-07 2024-09-17T02:21:43.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:43.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:43.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:43.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.985352+0000", 2024-09-17T02:21:43.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2669999999999998e-06 2024-09-17T02:21:43.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:43.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:43.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:43.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.985358+0000", 2024-09-17T02:21:43.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4299999999999997e-06 2024-09-17T02:21:43.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:43.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:43.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:43.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.985362+0000", 2024-09-17T02:21:43.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1110000000000001e-06 2024-09-17T02:21:43.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:43.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:43.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:43.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.985540+0000", 2024-09-17T02:21:43.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000178474 2024-09-17T02:21:43.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:43.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:43.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:43.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.985698+0000", 2024-09-17T02:21:43.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015724900000000001 2024-09-17T02:21:43.997 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:43.997 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:43.997 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:43.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:43.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:43.998 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:146252 5.c 5:30c4fe0d:::benchmark_data_smithi001_23533_object18135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T02:21:43.998 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:43.986146+0000", 2024-09-17T02:21:43.998 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0057617040000000003, 2024-09-17T02:21:43.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005933738, 2024-09-17T02:21:43.998 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:43.998 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:43.998 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:43.998 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:43.998 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:43.998 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:43.998 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 146252 2024-09-17T02:21:43.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:43.998 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:43.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:43.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:43.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.986146+0000", 2024-09-17T02:21:43.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:43.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:43.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:43.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:43.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.986146+0000", 2024-09-17T02:21:43.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:43.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:43.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:43.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:43.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.986147+0000", 2024-09-17T02:21:43.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9599999999999999e-07 2024-09-17T02:21:44.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.986150+0000", 2024-09-17T02:21:44.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2389999999999998e-06 2024-09-17T02:21:44.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.986158+0000", 2024-09-17T02:21:44.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4300000000000006e-06 2024-09-17T02:21:44.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.986165+0000", 2024-09-17T02:21:44.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7100000000000001e-06 2024-09-17T02:21:44.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988057+0000", 2024-09-17T02:21:44.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001891572 2024-09-17T02:21:44.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988177+0000", 2024-09-17T02:21:44.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120347 2024-09-17T02:21:44.001 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.001 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.001 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.002 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:146253 5.1 5:89b4e57c:::benchmark_data_smithi001_23533_object18136:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T02:21:44.002 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:43.986178+0000", 2024-09-17T02:21:44.002 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0057299730000000002, 2024-09-17T02:21:44.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0059624389999999999, 2024-09-17T02:21:44.002 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.002 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.002 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:44.002 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:44.002 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:44.002 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.002 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 146253 2024-09-17T02:21:44.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.003 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.986178+0000", 2024-09-17T02:21:44.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.986178+0000", 2024-09-17T02:21:44.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.986178+0000", 2024-09-17T02:21:44.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1100000000000001e-07 2024-09-17T02:21:44.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.986180+0000", 2024-09-17T02:21:44.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9520000000000001e-06 2024-09-17T02:21:44.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.986197+0000", 2024-09-17T02:21:44.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6928000000000001e-05 2024-09-17T02:21:44.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.986202+0000", 2024-09-17T02:21:44.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.113e-06 2024-09-17T02:21:44.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.987161+0000", 2024-09-17T02:21:44.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00095876999999999996 2024-09-17T02:21:44.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.987284+0000", 2024-09-17T02:21:44.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012312900000000001 2024-09-17T02:21:44.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:44.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.987393+0000", 2024-09-17T02:21:44.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010836300000000001 2024-09-17T02:21:44.006 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.006 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.006 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.006 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:146250 5.b e55/51 5:d85fcb52:::benchmark_data_smithi001_23533_object18133:head v 55'9056, mlcod=55'9054)", 2024-09-17T02:21:44.006 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:43.986277+0000", 2024-09-17T02:21:44.006 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0056303489999999998, 2024-09-17T02:21:44.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0059298839999999998, 2024-09-17T02:21:44.007 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.007 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.007 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:44.007 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.986277+0000", 2024-09-17T02:21:44.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.986277+0000", 2024-09-17T02:21:44.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.986278+0000", 2024-09-17T02:21:44.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.46e-07 2024-09-17T02:21:44.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.986285+0000", 2024-09-17T02:21:44.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7630000000000003e-06 2024-09-17T02:21:44.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.986292+0000", 2024-09-17T02:21:44.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2089999999999999e-06 2024-09-17T02:21:44.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.986297+0000", 2024-09-17T02:21:44.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1100000000000002e-06 2024-09-17T02:21:44.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.987665+0000", 2024-09-17T02:21:44.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001367647 2024-09-17T02:21:44.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.987683+0000", 2024-09-17T02:21:44.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8196e-05 2024-09-17T02:21:44.010 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.010 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.010 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.010 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:146254 5.1 5:894f3ee6:::benchmark_data_smithi001_23533_object18137:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T02:21:44.010 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:43.987980+0000", 2024-09-17T02:21:44.011 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0039278799999999999, 2024-09-17T02:21:44.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042819950000000002, 2024-09-17T02:21:44.011 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.011 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.011 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:44.011 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:44.011 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:44.011 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.011 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 146254 2024-09-17T02:21:44.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.011 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.987980+0000", 2024-09-17T02:21:44.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.987980+0000", 2024-09-17T02:21:44.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.987981+0000", 2024-09-17T02:21:44.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.093e-06 2024-09-17T02:21:44.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.987985+0000", 2024-09-17T02:21:44.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.754e-06 2024-09-17T02:21:44.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.987996+0000", 2024-09-17T02:21:44.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0981e-05 2024-09-17T02:21:44.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988002+0000", 2024-09-17T02:21:44.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6120000000000004e-06 2024-09-17T02:21:44.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.990513+0000", 2024-09-17T02:21:44.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025104620000000002 2024-09-17T02:21:44.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.990594+0000", 2024-09-17T02:21:44.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1408000000000004e-05 2024-09-17T02:21:44.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:44.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.990698+0000", 2024-09-17T02:21:44.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104011 2024-09-17T02:21:44.015 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.015 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.015 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.015 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:146251 5.b e55/51 5:d3591b14:::benchmark_data_smithi001_23533_object18134:head v 55'9057, mlcod=55'9054)", 2024-09-17T02:21:44.015 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:43.988050+0000", 2024-09-17T02:21:44.015 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0038574939999999999, 2024-09-17T02:21:44.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042765140000000004, 2024-09-17T02:21:44.015 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.015 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.015 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:44.016 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988050+0000", 2024-09-17T02:21:44.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988050+0000", 2024-09-17T02:21:44.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988051+0000", 2024-09-17T02:21:44.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.82e-07 2024-09-17T02:21:44.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988057+0000", 2024-09-17T02:21:44.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6499999999999999e-06 2024-09-17T02:21:44.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988065+0000", 2024-09-17T02:21:44.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8439999999999998e-06 2024-09-17T02:21:44.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988070+0000", 2024-09-17T02:21:44.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9439999999999996e-06 2024-09-17T02:21:44.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.989649+0000", 2024-09-17T02:21:44.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001578266 2024-09-17T02:21:44.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.989669+0000", 2024-09-17T02:21:44.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0044e-05 2024-09-17T02:21:44.019 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.019 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.019 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.019 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:146257 5.2 5:40ae6afa:::benchmark_data_smithi001_23533_object18140:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T02:21:44.019 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:43.988202+0000", 2024-09-17T02:21:44.019 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0037056860000000001, 2024-09-17T02:21:44.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041814479999999999, 2024-09-17T02:21:44.019 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.019 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.019 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:44.020 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:44.020 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:44.020 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.020 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 146257 2024-09-17T02:21:44.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.020 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988202+0000", 2024-09-17T02:21:44.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988202+0000", 2024-09-17T02:21:44.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988203+0000", 2024-09-17T02:21:44.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2500000000000005e-07 2024-09-17T02:21:44.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988206+0000", 2024-09-17T02:21:44.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7999999999999999e-06 2024-09-17T02:21:44.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988214+0000", 2024-09-17T02:21:44.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1969999999999996e-06 2024-09-17T02:21:44.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988219+0000", 2024-09-17T02:21:44.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5339999999999999e-06 2024-09-17T02:21:44.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988263+0000", 2024-09-17T02:21:44.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3776000000000002e-05 2024-09-17T02:21:44.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988341+0000", 2024-09-17T02:21:44.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8267000000000001e-05 2024-09-17T02:21:44.023 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.023 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.023 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.023 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:146258 5.5 5:aad62874:::benchmark_data_smithi001_23533_object18141:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T02:21:44.023 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:43.988352+0000", 2024-09-17T02:21:44.023 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0035553630000000002, 2024-09-17T02:21:44.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040910390000000003, 2024-09-17T02:21:44.024 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.024 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.024 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:44.024 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:44.024 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:44.024 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.024 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 146258 2024-09-17T02:21:44.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.024 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988352+0000", 2024-09-17T02:21:44.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988352+0000", 2024-09-17T02:21:44.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988353+0000", 2024-09-17T02:21:44.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9599999999999999e-07 2024-09-17T02:21:44.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988356+0000", 2024-09-17T02:21:44.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6589999999999999e-06 2024-09-17T02:21:44.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988368+0000", 2024-09-17T02:21:44.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2463000000000001e-05 2024-09-17T02:21:44.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988373+0000", 2024-09-17T02:21:44.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1869999999999996e-06 2024-09-17T02:21:44.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988421+0000", 2024-09-17T02:21:44.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7259000000000003e-05 2024-09-17T02:21:44.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988529+0000", 2024-09-17T02:21:44.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000108353 2024-09-17T02:21:44.027 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.027 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.027 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.028 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:146259 5.2 5:4d057609:::benchmark_data_smithi001_23533_object18142:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T02:21:44.028 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:43.988920+0000", 2024-09-17T02:21:44.028 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0029874010000000002, 2024-09-17T02:21:44.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035824519999999999, 2024-09-17T02:21:44.028 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.028 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.028 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:44.028 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:44.028 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:44.028 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.028 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 146259 2024-09-17T02:21:44.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.028 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988920+0000", 2024-09-17T02:21:44.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988920+0000", 2024-09-17T02:21:44.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988921+0000", 2024-09-17T02:21:44.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5000000000000002e-07 2024-09-17T02:21:44.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988924+0000", 2024-09-17T02:21:44.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.083e-06 2024-09-17T02:21:44.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988934+0000", 2024-09-17T02:21:44.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3600000000000002e-06 2024-09-17T02:21:44.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.988939+0000", 2024-09-17T02:21:44.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2159999999999997e-06 2024-09-17T02:21:44.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.990616+0000", 2024-09-17T02:21:44.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016776479999999999 2024-09-17T02:21:44.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.990720+0000", 2024-09-17T02:21:44.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103762 2024-09-17T02:21:44.031 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.031 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.031 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.032 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:146260 5.c 5:3597d97d:::benchmark_data_smithi001_23533_object18143:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T02:21:44.032 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:43.989810+0000", 2024-09-17T02:21:44.032 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.002097546, 2024-09-17T02:21:44.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027534040000000001, 2024-09-17T02:21:44.032 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.032 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.032 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:44.032 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:44.032 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:44.032 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.032 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 146260 2024-09-17T02:21:44.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.032 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.989810+0000", 2024-09-17T02:21:44.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.989810+0000", 2024-09-17T02:21:44.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.989811+0000", 2024-09-17T02:21:44.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5499999999999997e-07 2024-09-17T02:21:44.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.989816+0000", 2024-09-17T02:21:44.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4009999999999999e-06 2024-09-17T02:21:44.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.989825+0000", 2024-09-17T02:21:44.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4590000000000004e-06 2024-09-17T02:21:44.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.989832+0000", 2024-09-17T02:21:44.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7850000000000003e-06 2024-09-17T02:21:44.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.990293+0000", 2024-09-17T02:21:44.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00046130200000000002 2024-09-17T02:21:44.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.990361+0000", 2024-09-17T02:21:44.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8337000000000007e-05 2024-09-17T02:21:44.035 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.035 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.035 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.036 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4466.0:146253 5.1 e55/51)", 2024-09-17T02:21:44.036 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:43.990152+0000", 2024-09-17T02:21:44.036 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0017562210000000001, 2024-09-17T02:21:44.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024748280000000001, 2024-09-17T02:21:44.036 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.036 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.036 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:44.036 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.990152+0000", 2024-09-17T02:21:44.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.990152+0000", 2024-09-17T02:21:44.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.990152+0000", 2024-09-17T02:21:44.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0999999999999999e-07 2024-09-17T02:21:44.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.990155+0000", 2024-09-17T02:21:44.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5150000000000001e-06 2024-09-17T02:21:44.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.990161+0000", 2024-09-17T02:21:44.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8279999999999997e-06 2024-09-17T02:21:44.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.990167+0000", 2024-09-17T02:21:44.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5230000000000003e-06 2024-09-17T02:21:44.038 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.038 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.038 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.039 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:146261 5.8 5:156717be:::benchmark_data_smithi001_23533_object18144:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T02:21:44.039 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:43.990213+0000", 2024-09-17T02:21:44.039 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001695268, 2024-09-17T02:21:44.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024645510000000002, 2024-09-17T02:21:44.039 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.039 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.039 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:44.039 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:44.039 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:44.039 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.039 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 146261 2024-09-17T02:21:44.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.039 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.990213+0000", 2024-09-17T02:21:44.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.990213+0000", 2024-09-17T02:21:44.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.990213+0000", 2024-09-17T02:21:44.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4300000000000003e-07 2024-09-17T02:21:44.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.990217+0000", 2024-09-17T02:21:44.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.349e-06 2024-09-17T02:21:44.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.990230+0000", 2024-09-17T02:21:44.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3004e-05 2024-09-17T02:21:44.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.990238+0000", 2024-09-17T02:21:44.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6270000000000006e-06 2024-09-17T02:21:44.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.990532+0000", 2024-09-17T02:21:44.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00029346500000000002 2024-09-17T02:21:44.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.990645+0000", 2024-09-17T02:21:44.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000113096 2024-09-17T02:21:44.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:44.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.990756+0000", 2024-09-17T02:21:44.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011122 2024-09-17T02:21:44.043 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.043 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.043 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.043 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:146265 5.3 5:c8694bf7:::benchmark_data_smithi001_23533_object18148:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T02:21:44.043 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:43.992347+0000", 2024-09-17T02:21:44.043 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9995608, 2024-09-17T02:21:44.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00040852400000000001, 2024-09-17T02:21:44.043 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.043 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.043 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:44.044 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:44.044 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:44.044 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.044 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 146265 2024-09-17T02:21:44.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.044 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.992347+0000", 2024-09-17T02:21:44.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.992347+0000", 2024-09-17T02:21:44.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.992348+0000", 2024-09-17T02:21:44.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9999999999999997e-07 2024-09-17T02:21:44.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.992351+0000", 2024-09-17T02:21:44.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1810000000000001e-06 2024-09-17T02:21:44.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.992358+0000", 2024-09-17T02:21:44.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8029999999999999e-06 2024-09-17T02:21:44.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.992363+0000", 2024-09-17T02:21:44.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8509999999999998e-06 2024-09-17T02:21:44.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.992401+0000", 2024-09-17T02:21:44.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8330000000000001e-05 2024-09-17T02:21:44.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.992472+0000", 2024-09-17T02:21:44.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0899e-05 2024-09-17T02:21:44.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:44.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:43.992535+0000", 2024-09-17T02:21:44.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3381999999999997e-05 2024-09-17T02:21:44.047 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.047 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.047 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.047 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.047 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:21:44.047 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 14 2024-09-17T02:21:44.048 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:44.049 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:44.092 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:44.094+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:44.183 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:44.182+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:44.241 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:44.241 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:21:44.241 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:21:44.241 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:21:44.241 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:44.261 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:44.303 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:44.306+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:44.384 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:44.389+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:44.461 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:44.461 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:21:44.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:21:44.461 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:44.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.461 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:44.461 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:44.461 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 61.895278200999996, 2024-09-17T02:21:44.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:21:44.462 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.462 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.462 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:44.462 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:44.462 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:44.462 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.462 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:21:44.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.462 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:44.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:44.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:21:44.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:21:44.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:21:44.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:21:44.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:21:44.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:21:44.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:21:44.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:21:44.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:21:44.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:21:44.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:21:44.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:21:44.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:44.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:21:44.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:21:44.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:44.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:21:44.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:21:44.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:44.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:21:44.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:21:44.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:44.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:21:44.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:21:44.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:44.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:21:44.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:21:44.467 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.467 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.468 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.468 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:44.468 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:44.468 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 61.891375951000001, 2024-09-17T02:21:44.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:21:44.468 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.468 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.468 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:44.468 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:44.468 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:44.469 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.469 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:21:44.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.469 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:44.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:44.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:21:44.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:21:44.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:21:44.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:21:44.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:21:44.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:21:44.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:21:44.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:21:44.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:21:44.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:21:44.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:21:44.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:21:44.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:44.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:21:44.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:21:44.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:44.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:21:44.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:21:44.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:44.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:21:44.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:21:44.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:44.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:21:44.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:21:44.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:44.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:21:44.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:21:44.474 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.474 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.474 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.474 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71206 5.3 e39/38 5:c6c9386d:::benchmark_data_smithi001_23533_object71205:head v 39'4517, mlcod=35'4513)", 2024-09-17T02:21:44.474 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:44.474 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.854048835999997, 2024-09-17T02:21:44.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026101868, 2024-09-17T02:21:44.474 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.475 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.475 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:44.475 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:44.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:44.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609694+0000", 2024-09-17T02:21:44.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9539999999999998e-06 2024-09-17T02:21:44.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609841+0000", 2024-09-17T02:21:44.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014690800000000001 2024-09-17T02:21:44.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609872+0000", 2024-09-17T02:21:44.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0326000000000001e-05 2024-09-17T02:21:44.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609892+0000", 2024-09-17T02:21:44.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9848999999999999e-05 2024-09-17T02:21:44.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613826+0000", 2024-09-17T02:21:44.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039345140000000001 2024-09-17T02:21:44.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613908+0000", 2024-09-17T02:21:44.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2412999999999999e-05 2024-09-17T02:21:44.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:44.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635696+0000", 2024-09-17T02:21:44.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021787597999999998 2024-09-17T02:21:44.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:44.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635794+0000", 2024-09-17T02:21:44.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8306000000000004e-05 2024-09-17T02:21:44.478 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.479 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.479 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.479 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71210 5.3 e39/38 5:c0498d13:::benchmark_data_smithi001_23533_object71209:head v 39'4518, mlcod=35'4513)", 2024-09-17T02:21:44.479 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:44.479 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.852570870000001, 2024-09-17T02:21:44.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024703197, 2024-09-17T02:21:44.479 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.479 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.479 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:44.479 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:44.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:44.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611172+0000", 2024-09-17T02:21:44.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6470000000000001e-06 2024-09-17T02:21:44.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611344+0000", 2024-09-17T02:21:44.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000171607 2024-09-17T02:21:44.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611389+0000", 2024-09-17T02:21:44.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5738000000000002e-05 2024-09-17T02:21:44.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611407+0000", 2024-09-17T02:21:44.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7893e-05 2024-09-17T02:21:44.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617820+0000", 2024-09-17T02:21:44.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064131070000000004 2024-09-17T02:21:44.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617885+0000", 2024-09-17T02:21:44.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4442000000000004e-05 2024-09-17T02:21:44.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:44.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635806+0000", 2024-09-17T02:21:44.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017920874999999999 2024-09-17T02:21:44.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:44.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635874+0000", 2024-09-17T02:21:44.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7887999999999998e-05 2024-09-17T02:21:44.483 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.483 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.483 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.484 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97151 5.5 5:a0c2c072:::benchmark_data_smithi001_23533_object97150:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:44.484 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:44.484 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.195369229000001, 2024-09-17T02:21:44.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027297614000000001, 2024-09-17T02:21:44.484 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.484 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.484 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:44.484 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:44.484 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:44.484 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.484 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97151 2024-09-17T02:21:44.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.485 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:44.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:44.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268373+0000", 2024-09-17T02:21:44.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4000000000000002e-07 2024-09-17T02:21:44.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268423+0000", 2024-09-17T02:21:44.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0175e-05 2024-09-17T02:21:44.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268428+0000", 2024-09-17T02:21:44.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-17T02:21:44.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268431+0000", 2024-09-17T02:21:44.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.179e-06 2024-09-17T02:21:44.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283631+0000", 2024-09-17T02:21:44.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015199691 2024-09-17T02:21:44.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283740+0000", 2024-09-17T02:21:44.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109305 2024-09-17T02:21:44.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:44.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283863+0000", 2024-09-17T02:21:44.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012226699999999999 2024-09-17T02:21:44.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:44.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290857+0000", 2024-09-17T02:21:44.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069945449999999996 2024-09-17T02:21:44.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:44.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295595+0000", 2024-09-17T02:21:44.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047376750000000002 2024-09-17T02:21:44.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:44.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295638+0000", 2024-09-17T02:21:44.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3671999999999998e-05 2024-09-17T02:21:44.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:44.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295670+0000", 2024-09-17T02:21:44.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1266000000000002e-05 2024-09-17T02:21:44.489 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.490 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.490 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.490 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97759 5.a 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:44.490 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:44.490 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.865356127999998, 2024-09-17T02:21:44.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.089694871999999995, 2024-09-17T02:21:44.490 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.490 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.490 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:44.490 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:44.490 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:44.491 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.491 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97759 2024-09-17T02:21:44.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.491 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:44.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:44.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598386+0000", 2024-09-17T02:21:44.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999999e-07 2024-09-17T02:21:44.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598414+0000", 2024-09-17T02:21:44.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8013000000000001e-05 2024-09-17T02:21:44.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598420+0000", 2024-09-17T02:21:44.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1149999999999999e-06 2024-09-17T02:21:44.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598424+0000", 2024-09-17T02:21:44.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:21:44.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598479+0000", 2024-09-17T02:21:44.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4648999999999998e-05 2024-09-17T02:21:44.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598587+0000", 2024-09-17T02:21:44.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010853000000000001 2024-09-17T02:21:44.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:44.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598676+0000", 2024-09-17T02:21:44.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8381999999999995e-05 2024-09-17T02:21:44.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:44.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603766+0000", 2024-09-17T02:21:44.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050902559999999996 2024-09-17T02:21:44.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:44.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.687988+0000", 2024-09-17T02:21:44.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.084221753999999996 2024-09-17T02:21:44.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:44.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688037+0000", 2024-09-17T02:21:44.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-05 2024-09-17T02:21:44.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:44.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688080+0000", 2024-09-17T02:21:44.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3149999999999999e-05 2024-09-17T02:21:44.496 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.496 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.496 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.496 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97770 5.0 5:09c75033:::benchmark_data_smithi001_23533_object97769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:44.496 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:44.496 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.860213697999999, 2024-09-17T02:21:44.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.086380868, 2024-09-17T02:21:44.496 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.496 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.497 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:44.497 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:44.497 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:44.497 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.497 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97770 2024-09-17T02:21:44.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.497 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:44.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:44.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603529+0000", 2024-09-17T02:21:44.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:21:44.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603593+0000", 2024-09-17T02:21:44.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4216999999999999e-05 2024-09-17T02:21:44.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603603+0000", 2024-09-17T02:21:44.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5179999999999993e-06 2024-09-17T02:21:44.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603608+0000", 2024-09-17T02:21:44.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2039999999999996e-06 2024-09-17T02:21:44.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603653+0000", 2024-09-17T02:21:44.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5247000000000002e-05 2024-09-17T02:21:44.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603758+0000", 2024-09-17T02:21:44.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105352 2024-09-17T02:21:44.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:44.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603900+0000", 2024-09-17T02:21:44.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014198999999999999 2024-09-17T02:21:44.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:44.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.606097+0000", 2024-09-17T02:21:44.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021969839999999999 2024-09-17T02:21:44.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:44.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689756+0000", 2024-09-17T02:21:44.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.083659077999999998 2024-09-17T02:21:44.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:44.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689846+0000", 2024-09-17T02:21:44.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9320999999999994e-05 2024-09-17T02:21:44.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:44.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689908+0000", 2024-09-17T02:21:44.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720999999999998e-05 2024-09-17T02:21:44.502 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.502 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.502 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.502 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127513 5.c 5:3eca08e4:::benchmark_data_smithi001_23533_object127512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:44.502 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:21:44.503 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.019437274, 2024-09-17T02:21:44.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046626399999999998, 2024-09-17T02:21:44.503 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.503 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.503 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:44.503 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:44.503 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:44.503 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.503 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127513 2024-09-17T02:21:44.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.503 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:21:44.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:21:44.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444305+0000", 2024-09-17T02:21:44.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2529999999999999e-06 2024-09-17T02:21:44.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444466+0000", 2024-09-17T02:21:44.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016069700000000001 2024-09-17T02:21:44.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444479+0000", 2024-09-17T02:21:44.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2602999999999999e-05 2024-09-17T02:21:44.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444485+0000", 2024-09-17T02:21:44.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.669e-06 2024-09-17T02:21:44.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444560+0000", 2024-09-17T02:21:44.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4276999999999994e-05 2024-09-17T02:21:44.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444656+0000", 2024-09-17T02:21:44.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6490000000000006e-05 2024-09-17T02:21:44.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:44.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444739+0000", 2024-09-17T02:21:44.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3139999999999993e-05 2024-09-17T02:21:44.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:44.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.448438+0000", 2024-09-17T02:21:44.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036985490000000002 2024-09-17T02:21:44.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:44.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490732+0000", 2024-09-17T02:21:44.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042294353999999999 2024-09-17T02:21:44.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:44.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490859+0000", 2024-09-17T02:21:44.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012708899999999999 2024-09-17T02:21:44.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:44.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490930+0000", 2024-09-17T02:21:44.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:21:44.508 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.508 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.508 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.509 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127514 5.c 5:39cc1feb:::benchmark_data_smithi001_23533_object127513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:44.509 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:44.509 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.019240505000001, 2024-09-17T02:21:44.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049357228000000003, 2024-09-17T02:21:44.509 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.509 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.509 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:44.509 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:44.509 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:44.509 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.509 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127514 2024-09-17T02:21:44.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.510 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:44.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:44.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:44.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8599999999999998e-07 2024-09-17T02:21:44.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444554+0000", 2024-09-17T02:21:44.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3047999999999998e-05 2024-09-17T02:21:44.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444562+0000", 2024-09-17T02:21:44.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5830000000000001e-06 2024-09-17T02:21:44.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444567+0000", 2024-09-17T02:21:44.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4179999999999996e-06 2024-09-17T02:21:44.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446566+0000", 2024-09-17T02:21:44.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001998788 2024-09-17T02:21:44.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446696+0000", 2024-09-17T02:21:44.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129393 2024-09-17T02:21:44.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:44.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446794+0000", 2024-09-17T02:21:44.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8462999999999996e-05 2024-09-17T02:21:44.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:44.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.449036+0000", 2024-09-17T02:21:44.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022415880000000001 2024-09-17T02:21:44.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:44.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493737+0000", 2024-09-17T02:21:44.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044701682 2024-09-17T02:21:44.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:44.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493808+0000", 2024-09-17T02:21:44.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0846000000000006e-05 2024-09-17T02:21:44.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:44.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493858+0000", 2024-09-17T02:21:44.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9932999999999998e-05 2024-09-17T02:21:44.515 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.515 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.515 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.515 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129441 5.1 5:84c3199f:::benchmark_data_smithi001_23533_object1324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:44.515 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:21:44.515 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.9602300170000007, 2024-09-17T02:21:44.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034387011000000002, 2024-09-17T02:21:44.515 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.515 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.515 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:44.515 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:44.516 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:44.516 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.516 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129441 2024-09-17T02:21:44.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.516 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:21:44.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:21:44.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503513+0000", 2024-09-17T02:21:44.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4759999999999999e-06 2024-09-17T02:21:44.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503518+0000", 2024-09-17T02:21:44.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-09-17T02:21:44.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503532+0000", 2024-09-17T02:21:44.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4049999999999999e-05 2024-09-17T02:21:44.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503541+0000", 2024-09-17T02:21:44.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5320000000000006e-06 2024-09-17T02:21:44.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506331+0000", 2024-09-17T02:21:44.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027899190000000001 2024-09-17T02:21:44.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506402+0000", 2024-09-17T02:21:44.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:21:44.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:44.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506477+0000", 2024-09-17T02:21:44.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4626e-05 2024-09-17T02:21:44.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:44.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509749+0000", 2024-09-17T02:21:44.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032726980000000001 2024-09-17T02:21:44.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:44.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537758+0000", 2024-09-17T02:21:44.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028008890000000002 2024-09-17T02:21:44.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:44.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537812+0000", 2024-09-17T02:21:44.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3300000000000001e-05 2024-09-17T02:21:44.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:44.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537898+0000", 2024-09-17T02:21:44.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6691000000000001e-05 2024-09-17T02:21:44.521 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.521 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.521 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.521 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129442 5.1 5:8f7f2a95:::benchmark_data_smithi001_23533_object1325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:44.521 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:21:44.522 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.9572594080000005, 2024-09-17T02:21:44.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031546698999999997, 2024-09-17T02:21:44.522 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.522 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.522 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:44.522 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:44.522 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:44.522 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.522 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129442 2024-09-17T02:21:44.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.522 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:21:44.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:21:44.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506483+0000", 2024-09-17T02:21:44.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2869999999999999e-06 2024-09-17T02:21:44.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506489+0000", 2024-09-17T02:21:44.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2330000000000003e-06 2024-09-17T02:21:44.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506502+0000", 2024-09-17T02:21:44.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2286999999999999e-05 2024-09-17T02:21:44.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506511+0000", 2024-09-17T02:21:44.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7799999999999995e-06 2024-09-17T02:21:44.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.507966+0000", 2024-09-17T02:21:44.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014541549999999999 2024-09-17T02:21:44.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508130+0000", 2024-09-17T02:21:44.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016455199999999999 2024-09-17T02:21:44.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:44.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508287+0000", 2024-09-17T02:21:44.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015730400000000001 2024-09-17T02:21:44.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:44.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510577+0000", 2024-09-17T02:21:44.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022899449999999998 2024-09-17T02:21:44.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:44.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537932+0000", 2024-09-17T02:21:44.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027354471000000002 2024-09-17T02:21:44.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:44.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537964+0000", 2024-09-17T02:21:44.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1909999999999998e-05 2024-09-17T02:21:44.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:44.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.538029+0000", 2024-09-17T02:21:44.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4775000000000002e-05 2024-09-17T02:21:44.528 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.528 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.528 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.528 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129443 5.8 5:1edfeaf8:::benchmark_data_smithi001_23533_object1326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:44.528 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:21:44.528 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.9538249079999996, 2024-09-17T02:21:44.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025315902000000001, 2024-09-17T02:21:44.528 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.528 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.528 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:44.529 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:44.529 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:44.529 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.529 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129443 2024-09-17T02:21:44.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.529 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:21:44.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:21:44.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509918+0000", 2024-09-17T02:21:44.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3689999999999999e-06 2024-09-17T02:21:44.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509923+0000", 2024-09-17T02:21:44.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0429999999999998e-06 2024-09-17T02:21:44.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509936+0000", 2024-09-17T02:21:44.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3234000000000001e-05 2024-09-17T02:21:44.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509950+0000", 2024-09-17T02:21:44.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3998999999999999e-05 2024-09-17T02:21:44.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509994+0000", 2024-09-17T02:21:44.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4323000000000002e-05 2024-09-17T02:21:44.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510095+0000", 2024-09-17T02:21:44.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010103300000000001 2024-09-17T02:21:44.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:44.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510160+0000", 2024-09-17T02:21:44.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4976999999999998e-05 2024-09-17T02:21:44.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:44.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.513304+0000", 2024-09-17T02:21:44.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031431330000000002 2024-09-17T02:21:44.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:44.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535046+0000", 2024-09-17T02:21:44.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021742276000000001 2024-09-17T02:21:44.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:44.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:21:44.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107759 2024-09-17T02:21:44.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:44.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535232+0000", 2024-09-17T02:21:44.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8756000000000003e-05 2024-09-17T02:21:44.534 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.534 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.534 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.534 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:138243 5.b e54/51 5:d91391c1:::benchmark_data_smithi001_23533_object10126:head v 54'8566, mlcod=54'8564)", 2024-09-17T02:21:44.534 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.334890+0000", 2024-09-17T02:21:44.534 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.1288509810000003, 2024-09-17T02:21:44.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025015253000000001, 2024-09-17T02:21:44.535 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.535 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.535 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:44.535 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.334890+0000", 2024-09-17T02:21:44.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.334890+0000", 2024-09-17T02:21:44.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.334891+0000", 2024-09-17T02:21:44.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8400000000000003e-07 2024-09-17T02:21:44.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.334895+0000", 2024-09-17T02:21:44.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.472e-06 2024-09-17T02:21:44.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.334901+0000", 2024-09-17T02:21:44.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3640000000000004e-06 2024-09-17T02:21:44.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.334905+0000", 2024-09-17T02:21:44.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4440000000000001e-06 2024-09-17T02:21:44.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.334952+0000", 2024-09-17T02:21:44.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6264000000000003e-05 2024-09-17T02:21:44.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.334973+0000", 2024-09-17T02:21:44.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1648e-05 2024-09-17T02:21:44.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:44.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.359846+0000", 2024-09-17T02:21:44.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024872834 2024-09-17T02:21:44.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:44.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.359906+0000", 2024-09-17T02:21:44.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9342999999999997e-05 2024-09-17T02:21:44.539 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.539 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.539 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.539 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:138247 5.3 5:caf01f60:::benchmark_data_smithi001_23533_object10130:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:44.539 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.335014+0000", 2024-09-17T02:21:44.539 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.1287273349999998, 2024-09-17T02:21:44.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026419469000000001, 2024-09-17T02:21:44.539 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.540 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.540 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:44.540 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:44.540 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:44.540 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.540 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 138247 2024-09-17T02:21:44.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.540 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335014+0000", 2024-09-17T02:21:44.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335014+0000", 2024-09-17T02:21:44.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335015+0000", 2024-09-17T02:21:44.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3600000000000004e-07 2024-09-17T02:21:44.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335017+0000", 2024-09-17T02:21:44.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5749999999999999e-06 2024-09-17T02:21:44.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335024+0000", 2024-09-17T02:21:44.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8379999999999996e-06 2024-09-17T02:21:44.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335029+0000", 2024-09-17T02:21:44.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.22e-06 2024-09-17T02:21:44.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335083+0000", 2024-09-17T02:21:44.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3600000000000002e-05 2024-09-17T02:21:44.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335229+0000", 2024-09-17T02:21:44.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000146098 2024-09-17T02:21:44.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:44.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335349+0000", 2024-09-17T02:21:44.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120631 2024-09-17T02:21:44.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:44.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.357942+0000", 2024-09-17T02:21:44.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022592457 2024-09-17T02:21:44.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:44.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.361286+0000", 2024-09-17T02:21:44.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003343623 2024-09-17T02:21:44.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:44.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.361338+0000", 2024-09-17T02:21:44.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2323e-05 2024-09-17T02:21:44.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:44.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.361433+0000", 2024-09-17T02:21:44.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5568000000000004e-05 2024-09-17T02:21:44.545 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.545 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.545 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.545 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:138244 5.b e54/51 5:d38c94c4:::benchmark_data_smithi001_23533_object10127:head v 54'8567, mlcod=54'8564)", 2024-09-17T02:21:44.546 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.336586+0000", 2024-09-17T02:21:44.546 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.127154945, 2024-09-17T02:21:44.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026602741999999999, 2024-09-17T02:21:44.546 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.546 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.546 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:44.546 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336586+0000", 2024-09-17T02:21:44.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336586+0000", 2024-09-17T02:21:44.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336587+0000", 2024-09-17T02:21:44.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0600000000000001e-07 2024-09-17T02:21:44.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336590+0000", 2024-09-17T02:21:44.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3110000000000001e-06 2024-09-17T02:21:44.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336597+0000", 2024-09-17T02:21:44.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0639999999999996e-06 2024-09-17T02:21:44.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336602+0000", 2024-09-17T02:21:44.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3599999999999998e-06 2024-09-17T02:21:44.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336645+0000", 2024-09-17T02:21:44.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3628999999999999e-05 2024-09-17T02:21:44.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336666+0000", 2024-09-17T02:21:44.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0604000000000001e-05 2024-09-17T02:21:44.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:44.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363143+0000", 2024-09-17T02:21:44.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026477055999999999 2024-09-17T02:21:44.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:44.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363189+0000", 2024-09-17T02:21:44.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6312e-05 2024-09-17T02:21:44.550 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.550 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.550 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.550 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:138259 5.3 5:c08b4023:::benchmark_data_smithi001_23533_object10142:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:44.550 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.337063+0000", 2024-09-17T02:21:44.550 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.1266781269999999, 2024-09-17T02:21:44.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027773173000000002, 2024-09-17T02:21:44.551 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.551 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.551 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:44.551 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:44.551 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:44.551 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.551 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 138259 2024-09-17T02:21:44.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.551 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337063+0000", 2024-09-17T02:21:44.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337063+0000", 2024-09-17T02:21:44.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337064+0000", 2024-09-17T02:21:44.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-17T02:21:44.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337066+0000", 2024-09-17T02:21:44.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.03e-06 2024-09-17T02:21:44.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337072+0000", 2024-09-17T02:21:44.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5119999999999997e-06 2024-09-17T02:21:44.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337077+0000", 2024-09-17T02:21:44.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.454e-06 2024-09-17T02:21:44.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.352990+0000", 2024-09-17T02:21:44.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015913116000000001 2024-09-17T02:21:44.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.353136+0000", 2024-09-17T02:21:44.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000146117 2024-09-17T02:21:44.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:44.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.353253+0000", 2024-09-17T02:21:44.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117359 2024-09-17T02:21:44.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:44.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.358284+0000", 2024-09-17T02:21:44.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050306689999999998 2024-09-17T02:21:44.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:44.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.364738+0000", 2024-09-17T02:21:44.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064539410000000004 2024-09-17T02:21:44.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:44.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.364768+0000", 2024-09-17T02:21:44.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0086999999999998e-05 2024-09-17T02:21:44.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:44.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.364836+0000", 2024-09-17T02:21:44.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8549999999999999e-05 2024-09-17T02:21:44.556 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.556 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.556 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.557 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:138249 5.b e54/51 5:dcbad32d:::benchmark_data_smithi001_23533_object10132:head v 54'8568, mlcod=54'8564)", 2024-09-17T02:21:44.557 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.338016+0000", 2024-09-17T02:21:44.557 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.1257257870000004, 2024-09-17T02:21:44.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025210803, 2024-09-17T02:21:44.557 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.557 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.557 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:44.557 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.557 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338016+0000", 2024-09-17T02:21:44.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338016+0000", 2024-09-17T02:21:44.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338017+0000", 2024-09-17T02:21:44.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.28e-06 2024-09-17T02:21:44.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338022+0000", 2024-09-17T02:21:44.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0950000000000003e-06 2024-09-17T02:21:44.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338032+0000", 2024-09-17T02:21:44.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7140000000000005e-06 2024-09-17T02:21:44.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338038+0000", 2024-09-17T02:21:44.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1029999999999998e-06 2024-09-17T02:21:44.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.349300+0000", 2024-09-17T02:21:44.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01126216 2024-09-17T02:21:44.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.349359+0000", 2024-09-17T02:21:44.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9206999999999997e-05 2024-09-17T02:21:44.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:44.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363192+0000", 2024-09-17T02:21:44.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013833253 2024-09-17T02:21:44.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:44.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363226+0000", 2024-09-17T02:21:44.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3991e-05 2024-09-17T02:21:44.561 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.561 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.561 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.561 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:139574 5.a 5:55e1b723:::benchmark_data_smithi001_23533_object11457:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:44.561 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.927338+0000", 2024-09-17T02:21:44.562 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.5364031840000001, 2024-09-17T02:21:44.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024987447999999999, 2024-09-17T02:21:44.562 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.562 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.562 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:44.562 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:44.562 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:44.562 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.562 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 139574 2024-09-17T02:21:44.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.562 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.927338+0000", 2024-09-17T02:21:44.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.927338+0000", 2024-09-17T02:21:44.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.927339+0000", 2024-09-17T02:21:44.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:21:44.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.927342+0000", 2024-09-17T02:21:44.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1099999999999999e-06 2024-09-17T02:21:44.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.927350+0000", 2024-09-17T02:21:44.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0639999999999994e-06 2024-09-17T02:21:44.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.927357+0000", 2024-09-17T02:21:44.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2280000000000001e-06 2024-09-17T02:21:44.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.929425+0000", 2024-09-17T02:21:44.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020674780000000002 2024-09-17T02:21:44.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.929528+0000", 2024-09-17T02:21:44.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102866 2024-09-17T02:21:44.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:44.566 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.929623+0000", 2024-09-17T02:21:44.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5117000000000004e-05 2024-09-17T02:21:44.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.566 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:44.566 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.934966+0000", 2024-09-17T02:21:44.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053428850000000003 2024-09-17T02:21:44.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.566 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:44.566 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.952258+0000", 2024-09-17T02:21:44.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01729197 2024-09-17T02:21:44.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:44.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.952302+0000", 2024-09-17T02:21:44.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4623999999999998e-05 2024-09-17T02:21:44.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:44.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.952326+0000", 2024-09-17T02:21:44.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3263000000000001e-05 2024-09-17T02:21:44.567 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.567 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.567 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.568 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:139587 5.1 5:801d98ef:::benchmark_data_smithi001_23533_object11470:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:44.568 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.931670+0000", 2024-09-17T02:21:44.568 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.5320710480000002, 2024-09-17T02:21:44.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025666268999999999, 2024-09-17T02:21:44.568 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.568 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.568 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:44.568 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:44.568 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:44.568 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.568 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 139587 2024-09-17T02:21:44.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.569 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931670+0000", 2024-09-17T02:21:44.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931670+0000", 2024-09-17T02:21:44.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931671+0000", 2024-09-17T02:21:44.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.034e-06 2024-09-17T02:21:44.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931677+0000", 2024-09-17T02:21:44.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4580000000000001e-06 2024-09-17T02:21:44.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931690+0000", 2024-09-17T02:21:44.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3152999999999999e-05 2024-09-17T02:21:44.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931699+0000", 2024-09-17T02:21:44.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3100000000000006e-06 2024-09-17T02:21:44.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931779+0000", 2024-09-17T02:21:44.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0284000000000006e-05 2024-09-17T02:21:44.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931968+0000", 2024-09-17T02:21:44.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018853399999999999 2024-09-17T02:21:44.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:44.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.932149+0000", 2024-09-17T02:21:44.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018114699999999999 2024-09-17T02:21:44.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:44.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.935163+0000", 2024-09-17T02:21:44.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030143169999999999 2024-09-17T02:21:44.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:44.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.957199+0000", 2024-09-17T02:21:44.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022035255 2024-09-17T02:21:44.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:44.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.957247+0000", 2024-09-17T02:21:44.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8319999999999998e-05 2024-09-17T02:21:44.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:44.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.957337+0000", 2024-09-17T02:21:44.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9456999999999994e-05 2024-09-17T02:21:44.573 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.574 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.574 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.574 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:140178 5.1 5:8f77d9ee:::benchmark_data_smithi001_23533_object12061:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:44.574 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:21:44.574 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.276285557, 2024-09-17T02:21:44.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025269478000000001, 2024-09-17T02:21:44.574 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:44.574 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:44.574 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:44.574 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:44.574 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:44.574 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.575 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 140178 2024-09-17T02:21:44.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.575 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:44.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:44.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:21:44.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:44.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:21:44.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:44.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:44.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:21:44.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0500000000000004e-07 2024-09-17T02:21:44.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:44.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187459+0000", 2024-09-17T02:21:44.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5299999999999999e-06 2024-09-17T02:21:44.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:44.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187468+0000", 2024-09-17T02:21:44.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3130000000000004e-06 2024-09-17T02:21:44.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187473+0000", 2024-09-17T02:21:44.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-09-17T02:21:44.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:44.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.192476+0000", 2024-09-17T02:21:44.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050035339999999996 2024-09-17T02:21:44.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:44.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.192603+0000", 2024-09-17T02:21:44.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012652299999999999 2024-09-17T02:21:44.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:44.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.192719+0000", 2024-09-17T02:21:44.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011568700000000001 2024-09-17T02:21:44.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:44.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.196336+0000", 2024-09-17T02:21:44.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003617178 2024-09-17T02:21:44.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:44.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.212470+0000", 2024-09-17T02:21:44.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016134402999999999 2024-09-17T02:21:44.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:44.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.212522+0000", 2024-09-17T02:21:44.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1480000000000002e-05 2024-09-17T02:21:44.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:44.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:44.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:44.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.212725+0000", 2024-09-17T02:21:44.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020359100000000001 2024-09-17T02:21:44.580 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.580 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.580 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.580 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:44.580 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:44.580 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:44.581 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:44.585+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:44.582 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:44.682 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:44.682+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:44.737 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:44.737 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:44.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.737 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:147949 5.a e55/22 5:5e97c6e3:::benchmark_data_smithi001_23533_object19832:head v 55'9372, mlcod=55'9370)", 2024-09-17T02:21:44.737 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:44.741257+0000", 2024-09-17T02:21:44.737 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00097373499999999999, 2024-09-17T02:21:44.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000992321, 2024-09-17T02:21:44.738 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:44.738 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:44.738 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:44.738 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:44.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:44.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.741257+0000", 2024-09-17T02:21:44.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:44.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:44.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.741257+0000", 2024-09-17T02:21:44.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:44.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:44.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.741258+0000", 2024-09-17T02:21:44.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9999999999999997e-07 2024-09-17T02:21:44.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:44.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.741276+0000", 2024-09-17T02:21:44.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7850999999999999e-05 2024-09-17T02:21:44.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:44.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.741286+0000", 2024-09-17T02:21:44.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0234999999999999e-05 2024-09-17T02:21:44.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.741291+0000", 2024-09-17T02:21:44.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1739999999999999e-06 2024-09-17T02:21:44.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:44.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.741340+0000", 2024-09-17T02:21:44.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8736999999999998e-05 2024-09-17T02:21:44.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:44.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.741357+0000", 2024-09-17T02:21:44.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7306999999999999e-05 2024-09-17T02:21:44.741 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:44.741 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:44.741 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:44.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.741 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:147945 5.e 5:74c570c8:::benchmark_data_smithi001_23533_object19828:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T02:21:44.741 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:44.737602+0000", 2024-09-17T02:21:44.741 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0046285780000000004, 2024-09-17T02:21:44.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046901959999999998, 2024-09-17T02:21:44.742 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:44.742 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:44.742 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:44.742 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:44.742 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:44.742 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.742 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 147945 2024-09-17T02:21:44.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.742 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:44.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:44.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.737602+0000", 2024-09-17T02:21:44.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:44.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:44.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.737602+0000", 2024-09-17T02:21:44.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:44.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:44.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.737603+0000", 2024-09-17T02:21:44.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2899999999999999e-07 2024-09-17T02:21:44.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:44.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.737604+0000", 2024-09-17T02:21:44.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6640000000000001e-06 2024-09-17T02:21:44.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:44.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.737620+0000", 2024-09-17T02:21:44.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5988999999999999e-05 2024-09-17T02:21:44.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.737624+0000", 2024-09-17T02:21:44.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6169999999999998e-06 2024-09-17T02:21:44.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:44.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.737667+0000", 2024-09-17T02:21:44.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3353999999999999e-05 2024-09-17T02:21:44.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:44.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.737757+0000", 2024-09-17T02:21:44.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0038999999999996e-05 2024-09-17T02:21:44.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:44.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.737820+0000", 2024-09-17T02:21:44.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2575000000000003e-05 2024-09-17T02:21:44.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:44.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.739458+0000", 2024-09-17T02:21:44.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016376330000000001 2024-09-17T02:21:44.746 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:44.746 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:44.747 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:44.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.748 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:147950 5.b 5:dc975573:::benchmark_data_smithi001_23533_object19833:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T02:21:44.748 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:44.740331+0000", 2024-09-17T02:21:44.748 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.001900026, 2024-09-17T02:21:44.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020075190000000001, 2024-09-17T02:21:44.748 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:44.748 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:44.748 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:44.748 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:44.748 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:44.749 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.749 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 147950 2024-09-17T02:21:44.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.749 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:44.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:44.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740331+0000", 2024-09-17T02:21:44.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:44.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:44.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740331+0000", 2024-09-17T02:21:44.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:44.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:44.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740332+0000", 2024-09-17T02:21:44.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5899999999999995e-07 2024-09-17T02:21:44.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:44.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740335+0000", 2024-09-17T02:21:44.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.371e-06 2024-09-17T02:21:44.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:44.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740345+0000", 2024-09-17T02:21:44.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8390000000000002e-06 2024-09-17T02:21:44.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740350+0000", 2024-09-17T02:21:44.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0139999999999998e-06 2024-09-17T02:21:44.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:44.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740386+0000", 2024-09-17T02:21:44.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5843000000000002e-05 2024-09-17T02:21:44.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:44.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740474+0000", 2024-09-17T02:21:44.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7872000000000002e-05 2024-09-17T02:21:44.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:44.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740540+0000", 2024-09-17T02:21:44.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6628e-05 2024-09-17T02:21:44.752 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:44.752 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:44.752 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:44.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.753 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:147953 5.9 5:9c518ed7:::benchmark_data_smithi001_23533_object19836:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T02:21:44.753 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:44.740363+0000", 2024-09-17T02:21:44.753 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0018678729999999999, 2024-09-17T02:21:44.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020235449999999999, 2024-09-17T02:21:44.753 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:44.753 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:44.753 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:44.753 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:44.753 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:44.754 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.754 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 147953 2024-09-17T02:21:44.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.754 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:44.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:44.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740363+0000", 2024-09-17T02:21:44.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:44.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:44.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740363+0000", 2024-09-17T02:21:44.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:44.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:44.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740363+0000", 2024-09-17T02:21:44.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3599999999999999e-07 2024-09-17T02:21:44.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:44.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740368+0000", 2024-09-17T02:21:44.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8180000000000003e-06 2024-09-17T02:21:44.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:44.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740373+0000", 2024-09-17T02:21:44.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4410000000000003e-06 2024-09-17T02:21:44.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740376+0000", 2024-09-17T02:21:44.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0709999999999999e-06 2024-09-17T02:21:44.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:44.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740405+0000", 2024-09-17T02:21:44.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9754999999999999e-05 2024-09-17T02:21:44.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:44.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740477+0000", 2024-09-17T02:21:44.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1051999999999997e-05 2024-09-17T02:21:44.757 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:44.757 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:44.757 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:44.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.757 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:147954 5.e 5:7570a6ce:::benchmark_data_smithi001_23533_object19837:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T02:21:44.757 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:44.740392+0000", 2024-09-17T02:21:44.757 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0018385470000000001, 2024-09-17T02:21:44.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002037526, 2024-09-17T02:21:44.758 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:44.758 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:44.758 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:44.758 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:44.758 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:44.758 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.758 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 147954 2024-09-17T02:21:44.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.758 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:44.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:44.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740392+0000", 2024-09-17T02:21:44.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:44.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:44.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740392+0000", 2024-09-17T02:21:44.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:44.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:44.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740393+0000", 2024-09-17T02:21:44.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2799999999999996e-07 2024-09-17T02:21:44.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:44.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740396+0000", 2024-09-17T02:21:44.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8720000000000002e-06 2024-09-17T02:21:44.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:44.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740404+0000", 2024-09-17T02:21:44.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5669999999999995e-06 2024-09-17T02:21:44.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740409+0000", 2024-09-17T02:21:44.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7430000000000002e-06 2024-09-17T02:21:44.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:44.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740448+0000", 2024-09-17T02:21:44.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9144000000000003e-05 2024-09-17T02:21:44.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:44.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740525+0000", 2024-09-17T02:21:44.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6977999999999994e-05 2024-09-17T02:21:44.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:44.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740620+0000", 2024-09-17T02:21:44.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4310999999999999e-05 2024-09-17T02:21:44.762 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:44.762 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:44.762 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:44.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.762 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:147955 5.9 5:9ad19c1e:::benchmark_data_smithi001_23533_object19838:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T02:21:44.762 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:44.740549+0000", 2024-09-17T02:21:44.762 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.001682085, 2024-09-17T02:21:44.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019382259999999999, 2024-09-17T02:21:44.763 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:44.763 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:44.763 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:44.763 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:44.763 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:44.763 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:44.763 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 147955 2024-09-17T02:21:44.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.763 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:44.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:44.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740549+0000", 2024-09-17T02:21:44.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:44.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:44.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740549+0000", 2024-09-17T02:21:44.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:44.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:44.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740550+0000", 2024-09-17T02:21:44.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1999999999999999e-07 2024-09-17T02:21:44.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:44.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740553+0000", 2024-09-17T02:21:44.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5889999999999999e-06 2024-09-17T02:21:44.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:44.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740563+0000", 2024-09-17T02:21:44.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0282000000000001e-05 2024-09-17T02:21:44.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740571+0000", 2024-09-17T02:21:44.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1280000000000002e-06 2024-09-17T02:21:44.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:44.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.742258+0000", 2024-09-17T02:21:44.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001687233 2024-09-17T02:21:44.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:44.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.742376+0000", 2024-09-17T02:21:44.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118535 2024-09-17T02:21:44.766 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:44.766 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:44.766 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:44.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.767 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:147952 5.3 e55/51 5:c9905a19:::benchmark_data_smithi001_23533_object19835:head v 55'9342, mlcod=55'9340)", 2024-09-17T02:21:44.767 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:44.740689+0000", 2024-09-17T02:21:44.767 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0015419190000000001, 2024-09-17T02:21:44.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001848719, 2024-09-17T02:21:44.767 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:44.767 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:44.767 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:44.767 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:44.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:44.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740689+0000", 2024-09-17T02:21:44.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:44.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:44.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740689+0000", 2024-09-17T02:21:44.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:44.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:44.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740690+0000", 2024-09-17T02:21:44.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8999999999999996e-07 2024-09-17T02:21:44.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:44.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740694+0000", 2024-09-17T02:21:44.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6129999999999997e-06 2024-09-17T02:21:44.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:44.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740703+0000", 2024-09-17T02:21:44.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8079999999999994e-06 2024-09-17T02:21:44.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:44.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740709+0000", 2024-09-17T02:21:44.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0050000000000001e-06 2024-09-17T02:21:44.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:44.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740754+0000", 2024-09-17T02:21:44.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4654000000000003e-05 2024-09-17T02:21:44.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:44.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:44.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:44.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:44.740772+0000", 2024-09-17T02:21:44.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8360999999999999e-05 2024-09-17T02:21:44.770 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:44.770 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:44.770 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:44.770 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:44.770 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:21:44.770 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 7 2024-09-17T02:21:44.771 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:44.772 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:44.783 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:44.786+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:44.884 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:44.889+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:44.922 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:21:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:21:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:21:44.923 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:44.942 INFO:teuthology.orchestra.run.smithi001.stderr:nodeep-scrub is set 2024-09-17T02:21:44.943 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:44.985 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:44.986+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:45.086 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~6s 2024-09-17T02:21:45.086 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:45.089+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:45.142 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:45.142 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:21:45.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:21:45.142 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:45.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.142 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97749 5.b 5:d930ef52:::benchmark_data_smithi001_23533_object97748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:45.142 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:45.142 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 27.552752386999998, 2024-09-17T02:21:45.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092964343000000005, 2024-09-17T02:21:45.142 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:45.142 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:45.143 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.143 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:45.143 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:45.143 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.143 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97749 2024-09-17T02:21:45.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.143 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:45.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:45.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:45.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:45.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:45.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:45.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591947+0000", 2024-09-17T02:21:45.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:21:45.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:45.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592011+0000", 2024-09-17T02:21:45.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3608000000000005e-05 2024-09-17T02:21:45.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:45.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592021+0000", 2024-09-17T02:21:45.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9979999999999998e-06 2024-09-17T02:21:45.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592028+0000", 2024-09-17T02:21:45.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1439999999999997e-06 2024-09-17T02:21:45.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593633+0000", 2024-09-17T02:21:45.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001604636 2024-09-17T02:21:45.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:45.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593757+0000", 2024-09-17T02:21:45.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012432099999999999 2024-09-17T02:21:45.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:45.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593866+0000", 2024-09-17T02:21:45.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109094 2024-09-17T02:21:45.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:45.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601190+0000", 2024-09-17T02:21:45.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073237620000000002 2024-09-17T02:21:45.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601356+0000", 2024-09-17T02:21:45.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016651900000000001 2024-09-17T02:21:45.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684618+0000", 2024-09-17T02:21:45.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083261356999999994 2024-09-17T02:21:45.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:45.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684724+0000", 2024-09-17T02:21:45.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010681800000000001 2024-09-17T02:21:45.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:45.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684911+0000", 2024-09-17T02:21:45.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186243 2024-09-17T02:21:45.148 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.148 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:45.148 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.149 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97752 5.b 5:d146f486:::benchmark_data_smithi001_23533_object97751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:45.149 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:45.149 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 27.551399693, 2024-09-17T02:21:45.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091989557, 2024-09-17T02:21:45.149 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:45.149 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:45.149 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.149 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:45.149 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:45.149 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.149 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97752 2024-09-17T02:21:45.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.150 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:45.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:45.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:45.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:45.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:45.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:45.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593300+0000", 2024-09-17T02:21:45.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8199999999999998e-07 2024-09-17T02:21:45.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:45.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593364+0000", 2024-09-17T02:21:45.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3831999999999995e-05 2024-09-17T02:21:45.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:45.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593376+0000", 2024-09-17T02:21:45.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1800999999999999e-05 2024-09-17T02:21:45.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593382+0000", 2024-09-17T02:21:45.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6780000000000003e-06 2024-09-17T02:21:45.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595491+0000", 2024-09-17T02:21:45.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021090689999999999 2024-09-17T02:21:45.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:45.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595614+0000", 2024-09-17T02:21:45.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012321500000000001 2024-09-17T02:21:45.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:45.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595778+0000", 2024-09-17T02:21:45.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016321900000000001 2024-09-17T02:21:45.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:45.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601197+0000", 2024-09-17T02:21:45.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054195600000000003 2024-09-17T02:21:45.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601396+0000", 2024-09-17T02:21:45.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019825299999999999 2024-09-17T02:21:45.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684990+0000", 2024-09-17T02:21:45.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083594878999999997 2024-09-17T02:21:45.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:45.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685116+0000", 2024-09-17T02:21:45.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012522799999999999 2024-09-17T02:21:45.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:45.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685289+0000", 2024-09-17T02:21:45.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172941 2024-09-17T02:21:45.156 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.156 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:45.156 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.156 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97754 5.b 5:da0615e5:::benchmark_data_smithi001_23533_object97753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:45.156 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:45.157 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 27.549761771, 2024-09-17T02:21:45.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092097207, 2024-09-17T02:21:45.157 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:45.157 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:45.157 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.157 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:45.157 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:45.157 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.157 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97754 2024-09-17T02:21:45.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.157 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:45.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:45.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:45.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:45.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:45.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:45.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594938+0000", 2024-09-17T02:21:45.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5000000000000002e-07 2024-09-17T02:21:45.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:45.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595075+0000", 2024-09-17T02:21:45.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137742 2024-09-17T02:21:45.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:45.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595087+0000", 2024-09-17T02:21:45.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1243000000000001e-05 2024-09-17T02:21:45.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595095+0000", 2024-09-17T02:21:45.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1030000000000002e-06 2024-09-17T02:21:45.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598461+0000", 2024-09-17T02:21:45.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033661170000000001 2024-09-17T02:21:45.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:45.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598540+0000", 2024-09-17T02:21:45.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8937999999999995e-05 2024-09-17T02:21:45.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:45.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598626+0000", 2024-09-17T02:21:45.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6042000000000001e-05 2024-09-17T02:21:45.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:45.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684258+0000", 2024-09-17T02:21:45.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085632394000000001 2024-09-17T02:21:45.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685369+0000", 2024-09-17T02:21:45.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001111063 2024-09-17T02:21:45.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685511+0000", 2024-09-17T02:21:45.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141965 2024-09-17T02:21:45.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:45.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685604+0000", 2024-09-17T02:21:45.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2935000000000004e-05 2024-09-17T02:21:45.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:45.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687034+0000", 2024-09-17T02:21:45.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001430015 2024-09-17T02:21:45.162 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.162 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:45.163 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.163 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97755 5.b 5:d36a03a1:::benchmark_data_smithi001_23533_object97754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:45.163 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:45.163 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 27.549588621000002, 2024-09-17T02:21:45.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0924904, 2024-09-17T02:21:45.163 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:45.163 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:45.163 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.163 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:45.163 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:45.163 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.163 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97755 2024-09-17T02:21:45.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.164 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:45.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:45.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:45.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:45.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:45.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:45.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595111+0000", 2024-09-17T02:21:45.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:21:45.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:45.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595145+0000", 2024-09-17T02:21:45.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3927000000000002e-05 2024-09-17T02:21:45.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:45.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595155+0000", 2024-09-17T02:21:45.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0023e-05 2024-09-17T02:21:45.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595162+0000", 2024-09-17T02:21:45.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3950000000000003e-06 2024-09-17T02:21:45.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599821+0000", 2024-09-17T02:21:45.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046592880000000001 2024-09-17T02:21:45.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:45.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599912+0000", 2024-09-17T02:21:45.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1049000000000002e-05 2024-09-17T02:21:45.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:45.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600062+0000", 2024-09-17T02:21:45.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015001700000000001 2024-09-17T02:21:45.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:45.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685307+0000", 2024-09-17T02:21:45.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085244340000000002 2024-09-17T02:21:45.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685446+0000", 2024-09-17T02:21:45.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013955700000000001 2024-09-17T02:21:45.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687375+0000", 2024-09-17T02:21:45.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019291079999999999 2024-09-17T02:21:45.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:45.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687462+0000", 2024-09-17T02:21:45.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6148000000000003e-05 2024-09-17T02:21:45.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:45.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687600+0000", 2024-09-17T02:21:45.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013887900000000001 2024-09-17T02:21:45.169 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.169 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:45.169 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.169 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 44/44 lb 5:c4567a04:::benchmark_data_smithi001_23533_object4200:head)", 2024-09-17T02:21:45.169 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:45.169 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 27.547491995000001, 2024-09-17T02:21:45.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092483421999999996, 2024-09-17T02:21:45.170 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:45.170 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:45.170 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:45.170 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:45.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:45.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:45.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:45.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:45.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:45.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:45.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6399999999999998e-07 2024-09-17T02:21:45.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:45.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597213+0000", 2024-09-17T02:21:45.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3659999999999997e-06 2024-09-17T02:21:45.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:45.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597222+0000", 2024-09-17T02:21:45.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0510000000000002e-06 2024-09-17T02:21:45.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597228+0000", 2024-09-17T02:21:45.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1569999999999999e-06 2024-09-17T02:21:45.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689588+0000", 2024-09-17T02:21:45.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092359931000000006 2024-09-17T02:21:45.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:45.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689622+0000", 2024-09-17T02:21:45.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4425999999999999e-05 2024-09-17T02:21:45.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:45.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689690+0000", 2024-09-17T02:21:45.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8126999999999993e-05 2024-09-17T02:21:45.173 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.173 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:45.173 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.173 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129462 5.4 5:2e0acc16:::benchmark_data_smithi001_23533_object1345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:45.173 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:21:45.174 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.6097579260000003, 2024-09-17T02:21:45.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0112774899999999, 2024-09-17T02:21:45.174 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:45.174 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:45.174 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.174 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:45.174 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:45.174 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.174 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129462 2024-09-17T02:21:45.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.174 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:45.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:45.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:21:45.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:45.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:21:45.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:45.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534943+0000", 2024-09-17T02:21:45.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8759999999999999e-06 2024-09-17T02:21:45.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:45.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534951+0000", 2024-09-17T02:21:45.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3219999999999993e-06 2024-09-17T02:21:45.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:45.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534977+0000", 2024-09-17T02:21:45.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6245e-05 2024-09-17T02:21:45.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534992+0000", 2024-09-17T02:21:45.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4936000000000001e-05 2024-09-17T02:21:45.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535133+0000", 2024-09-17T02:21:45.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014051299999999999 2024-09-17T02:21:45.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:45.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:21:45.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1741000000000001e-05 2024-09-17T02:21:45.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.533906+0000", 2024-09-17T02:21:45.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99875209300000001 2024-09-17T02:21:45.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:45.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534348+0000", 2024-09-17T02:21:45.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044128899999999998 2024-09-17T02:21:45.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:45.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534762+0000", 2024-09-17T02:21:45.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000414707 2024-09-17T02:21:45.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:45.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545024+0000", 2024-09-17T02:21:45.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010261283 2024-09-17T02:21:45.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545953+0000", 2024-09-17T02:21:45.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000929618 2024-09-17T02:21:45.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:45.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546047+0000", 2024-09-17T02:21:45.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3697999999999996e-05 2024-09-17T02:21:45.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:45.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546218+0000", 2024-09-17T02:21:45.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017116899999999999 2024-09-17T02:21:45.180 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.180 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:45.180 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.180 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129480 5.4 5:2b1d398b:::benchmark_data_smithi001_23533_object1363:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:45.180 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:21:45.180 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.6020034600000006, 2024-09-17T02:21:45.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0038926450000001, 2024-09-17T02:21:45.181 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:45.181 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:45.181 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.181 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:45.181 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:45.181 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.181 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129480 2024-09-17T02:21:45.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.181 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:45.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:45.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:21:45.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:45.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:21:45.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:45.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542696+0000", 2024-09-17T02:21:45.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9999999999999995e-07 2024-09-17T02:21:45.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:45.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542701+0000", 2024-09-17T02:21:45.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2240000000000003e-06 2024-09-17T02:21:45.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:45.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542716+0000", 2024-09-17T02:21:45.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4970000000000001e-05 2024-09-17T02:21:45.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542726+0000", 2024-09-17T02:21:45.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2879999999999998e-06 2024-09-17T02:21:45.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542832+0000", 2024-09-17T02:21:45.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010597199999999999 2024-09-17T02:21:45.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:45.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542843+0000", 2024-09-17T02:21:45.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.098e-05 2024-09-17T02:21:45.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538436+0000", 2024-09-17T02:21:45.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99559286800000002 2024-09-17T02:21:45.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:45.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538791+0000", 2024-09-17T02:21:45.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035585499999999997 2024-09-17T02:21:45.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:45.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.539144+0000", 2024-09-17T02:21:45.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035268499999999999 2024-09-17T02:21:45.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:45.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545880+0000", 2024-09-17T02:21:45.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00673552 2024-09-17T02:21:45.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546330+0000", 2024-09-17T02:21:45.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045039599999999999 2024-09-17T02:21:45.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:45.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546414+0000", 2024-09-17T02:21:45.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4468000000000005e-05 2024-09-17T02:21:45.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:45.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546588+0000", 2024-09-17T02:21:45.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017341899999999999 2024-09-17T02:21:45.186 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.187 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:45.187 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.187 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129505 5.4 5:294f2ec7:::benchmark_data_smithi001_23533_object1388:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:45.187 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:21:45.187 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.5829902869999994, 2024-09-17T02:21:45.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98589826199999997, 2024-09-17T02:21:45.187 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:45.187 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:45.187 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.187 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:45.187 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:45.188 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.188 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129505 2024-09-17T02:21:45.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.188 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:45.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:45.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:21:45.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:45.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:21:45.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:45.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561710+0000", 2024-09-17T02:21:45.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7060000000000001e-06 2024-09-17T02:21:45.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:45.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561718+0000", 2024-09-17T02:21:45.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.542e-06 2024-09-17T02:21:45.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:45.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561741+0000", 2024-09-17T02:21:45.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3357e-05 2024-09-17T02:21:45.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561754+0000", 2024-09-17T02:21:45.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3200000000000001e-05 2024-09-17T02:21:45.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561867+0000", 2024-09-17T02:21:45.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113211 2024-09-17T02:21:45.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:45.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561888+0000", 2024-09-17T02:21:45.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0809999999999999e-05 2024-09-17T02:21:45.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542140+0000", 2024-09-17T02:21:45.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98025195799999998 2024-09-17T02:21:45.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:45.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542331+0000", 2024-09-17T02:21:45.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019127599999999999 2024-09-17T02:21:45.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:45.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542517+0000", 2024-09-17T02:21:45.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000185625 2024-09-17T02:21:45.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547114+0000", 2024-09-17T02:21:45.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045968620000000002 2024-09-17T02:21:45.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:45.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547187+0000", 2024-09-17T02:21:45.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3348000000000003e-05 2024-09-17T02:21:45.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:45.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547324+0000", 2024-09-17T02:21:45.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013681699999999999 2024-09-17T02:21:45.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:45.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547607+0000", 2024-09-17T02:21:45.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028255000000000001 2024-09-17T02:21:45.194 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.194 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:45.194 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.194 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129508 5.4 5:2892b582:::benchmark_data_smithi001_23533_object1391:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:45.194 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:21:45.194 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.5816531939999994, 2024-09-17T02:21:45.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99697919099999999, 2024-09-17T02:21:45.194 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:45.194 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:45.194 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.194 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:45.194 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:45.195 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.195 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129508 2024-09-17T02:21:45.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.195 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:45.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:45.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:21:45.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:45.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:21:45.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563047+0000", 2024-09-17T02:21:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.274e-06 2024-09-17T02:21:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563054+0000", 2024-09-17T02:21:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2799999999999998e-06 2024-09-17T02:21:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563070+0000", 2024-09-17T02:21:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5991999999999999e-05 2024-09-17T02:21:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563078+0000", 2024-09-17T02:21:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2390000000000002e-06 2024-09-17T02:21:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563181+0000", 2024-09-17T02:21:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102249 2024-09-17T02:21:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563199+0000", 2024-09-17T02:21:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8215000000000001e-05 2024-09-17T02:21:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547713+0000", 2024-09-17T02:21:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98451446399999998 2024-09-17T02:21:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548063+0000", 2024-09-17T02:21:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034985499999999999 2024-09-17T02:21:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548490+0000", 2024-09-17T02:21:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042658600000000001 2024-09-17T02:21:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555655+0000", 2024-09-17T02:21:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071652579999999999 2024-09-17T02:21:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559612+0000", 2024-09-17T02:21:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003957103 2024-09-17T02:21:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559768+0000", 2024-09-17T02:21:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015556899999999999 2024-09-17T02:21:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560025+0000", 2024-09-17T02:21:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025710700000000002 2024-09-17T02:21:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129509 5.4 5:2c35515e:::benchmark_data_smithi001_23533_object1392:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:21:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.5810261410000006, 2024-09-17T02:21:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99969384900000002, 2024-09-17T02:21:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129509 2024-09-17T02:21:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:21:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:21:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563674+0000", 2024-09-17T02:21:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0920000000000001e-06 2024-09-17T02:21:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563679+0000", 2024-09-17T02:21:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7660000000000004e-06 2024-09-17T02:21:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:45.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563693+0000", 2024-09-17T02:21:45.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3139000000000001e-05 2024-09-17T02:21:45.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563701+0000", 2024-09-17T02:21:45.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9859999999999994e-06 2024-09-17T02:21:45.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563775+0000", 2024-09-17T02:21:45.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4659000000000005e-05 2024-09-17T02:21:45.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563785+0000", 2024-09-17T02:21:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4839999999999993e-06 2024-09-17T02:21:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552085+0000", 2024-09-17T02:21:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98829986999999997 2024-09-17T02:21:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552554+0000", 2024-09-17T02:21:45.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046908900000000001 2024-09-17T02:21:45.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:45.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552931+0000", 2024-09-17T02:21:45.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377778 2024-09-17T02:21:45.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563106+0000", 2024-09-17T02:21:45.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010174186 2024-09-17T02:21:45.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:45.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563138+0000", 2024-09-17T02:21:45.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2495e-05 2024-09-17T02:21:45.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:45.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563225+0000", 2024-09-17T02:21:45.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6677999999999999e-05 2024-09-17T02:21:45.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:45.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563366+0000", 2024-09-17T02:21:45.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014162699999999999 2024-09-17T02:21:45.208 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.208 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:45.208 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.208 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129524 5.4 5:25dca7dd:::benchmark_data_smithi001_23533_object1407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:45.208 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:21:45.208 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.5743347869999997, 2024-09-17T02:21:45.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99999501999999996, 2024-09-17T02:21:45.208 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:45.208 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:45.208 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.208 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:45.209 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:45.209 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.209 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129524 2024-09-17T02:21:45.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.209 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:45.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:45.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:21:45.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:45.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:21:45.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:45.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570365+0000", 2024-09-17T02:21:45.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.142e-06 2024-09-17T02:21:45.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:45.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570369+0000", 2024-09-17T02:21:45.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.856e-06 2024-09-17T02:21:45.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:45.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570385+0000", 2024-09-17T02:21:45.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5855e-05 2024-09-17T02:21:45.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570392+0000", 2024-09-17T02:21:45.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5340000000000002e-06 2024-09-17T02:21:45.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570484+0000", 2024-09-17T02:21:45.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1212999999999996e-05 2024-09-17T02:21:45.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:45.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570498+0000", 2024-09-17T02:21:45.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4331000000000001e-05 2024-09-17T02:21:45.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555835+0000", 2024-09-17T02:21:45.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98533757700000002 2024-09-17T02:21:45.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:45.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556329+0000", 2024-09-17T02:21:45.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000493458 2024-09-17T02:21:45.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:45.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556784+0000", 2024-09-17T02:21:45.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045476499999999999 2024-09-17T02:21:45.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569852+0000", 2024-09-17T02:21:45.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013068270999999999 2024-09-17T02:21:45.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:45.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569958+0000", 2024-09-17T02:21:45.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106214 2024-09-17T02:21:45.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:45.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570124+0000", 2024-09-17T02:21:45.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165546 2024-09-17T02:21:45.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:45.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570359+0000", 2024-09-17T02:21:45.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023525799999999999 2024-09-17T02:21:45.214 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.215 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:45.215 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.215 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129537 5.4 5:260327c6:::benchmark_data_smithi001_23533_object1420:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:45.215 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:21:45.215 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.5664282580000002, 2024-09-17T02:21:45.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99624596499999996, 2024-09-17T02:21:45.215 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:45.215 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:45.215 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.215 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:45.215 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:45.215 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.216 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129537 2024-09-17T02:21:45.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.216 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:45.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:45.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:21:45.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:45.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:21:45.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:45.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578272+0000", 2024-09-17T02:21:45.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.164e-06 2024-09-17T02:21:45.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:45.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578278+0000", 2024-09-17T02:21:45.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5060000000000001e-06 2024-09-17T02:21:45.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:45.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578294+0000", 2024-09-17T02:21:45.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5687000000000001e-05 2024-09-17T02:21:45.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578329+0000", 2024-09-17T02:21:45.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5311999999999997e-05 2024-09-17T02:21:45.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578419+0000", 2024-09-17T02:21:45.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0054000000000002e-05 2024-09-17T02:21:45.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:45.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578435+0000", 2024-09-17T02:21:45.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5645999999999999e-05 2024-09-17T02:21:45.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560148+0000", 2024-09-17T02:21:45.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98171342299999997 2024-09-17T02:21:45.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:45.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560383+0000", 2024-09-17T02:21:45.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000234935 2024-09-17T02:21:45.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:45.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560586+0000", 2024-09-17T02:21:45.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000202909 2024-09-17T02:21:45.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570472+0000", 2024-09-17T02:21:45.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098856959999999994 2024-09-17T02:21:45.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:45.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574138+0000", 2024-09-17T02:21:45.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036660170000000001 2024-09-17T02:21:45.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:45.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574298+0000", 2024-09-17T02:21:45.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016025600000000001 2024-09-17T02:21:45.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:45.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574516+0000", 2024-09-17T02:21:45.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021835999999999999 2024-09-17T02:21:45.222 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.222 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:45.222 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.222 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129545 5.4 5:22366489:::benchmark_data_smithi001_23533_object1428:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:45.222 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:21:45.222 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.5605655350000003, 2024-09-17T02:21:45.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99074544499999995, 2024-09-17T02:21:45.223 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:45.223 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:45.223 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.223 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:45.223 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:45.223 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.223 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129545 2024-09-17T02:21:45.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.223 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:45.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:45.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:21:45.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:45.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:21:45.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:45.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584135+0000", 2024-09-17T02:21:45.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4699999999999999e-06 2024-09-17T02:21:45.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:45.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584142+0000", 2024-09-17T02:21:45.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1620000000000002e-06 2024-09-17T02:21:45.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:45.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584170+0000", 2024-09-17T02:21:45.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7897000000000001e-05 2024-09-17T02:21:45.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584183+0000", 2024-09-17T02:21:45.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2814e-05 2024-09-17T02:21:45.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584299+0000", 2024-09-17T02:21:45.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116153 2024-09-17T02:21:45.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:45.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584316+0000", 2024-09-17T02:21:45.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7524999999999999e-05 2024-09-17T02:21:45.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563461+0000", 2024-09-17T02:21:45.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97914436699999996 2024-09-17T02:21:45.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:45.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563667+0000", 2024-09-17T02:21:45.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020689800000000001 2024-09-17T02:21:45.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:45.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563878+0000", 2024-09-17T02:21:45.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210275 2024-09-17T02:21:45.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570584+0000", 2024-09-17T02:21:45.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067066080000000002 2024-09-17T02:21:45.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:45.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574539+0000", 2024-09-17T02:21:45.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039550360000000003 2024-09-17T02:21:45.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:45.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574653+0000", 2024-09-17T02:21:45.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114003 2024-09-17T02:21:45.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:45.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574879+0000", 2024-09-17T02:21:45.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022523700000000001 2024-09-17T02:21:45.229 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.229 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:45.229 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.229 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129553 5.4 5:2e41ad40:::benchmark_data_smithi001_23533_object1436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:45.229 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:21:45.229 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.5551428989999998, 2024-09-17T02:21:45.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99213429600000003, 2024-09-17T02:21:45.230 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:45.230 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:45.230 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.230 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:45.230 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:45.230 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.230 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129553 2024-09-17T02:21:45.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.230 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:45.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:45.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:21:45.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:45.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:21:45.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:45.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589557+0000", 2024-09-17T02:21:45.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2219999999999999e-06 2024-09-17T02:21:45.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:45.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589562+0000", 2024-09-17T02:21:45.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0649999999999998e-06 2024-09-17T02:21:45.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:45.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589575+0000", 2024-09-17T02:21:45.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3129000000000001e-05 2024-09-17T02:21:45.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589584+0000", 2024-09-17T02:21:45.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6200000000000005e-06 2024-09-17T02:21:45.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589693+0000", 2024-09-17T02:21:45.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109319 2024-09-17T02:21:45.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:45.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589714+0000", 2024-09-17T02:21:45.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0849999999999999e-05 2024-09-17T02:21:45.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566273+0000", 2024-09-17T02:21:45.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97655884999999998 2024-09-17T02:21:45.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:45.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566543+0000", 2024-09-17T02:21:45.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027059099999999998 2024-09-17T02:21:45.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:45.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566832+0000", 2024-09-17T02:21:45.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028898200000000002 2024-09-17T02:21:45.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:45.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581040+0000", 2024-09-17T02:21:45.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014208001 2024-09-17T02:21:45.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581200+0000", 2024-09-17T02:21:45.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159956 2024-09-17T02:21:45.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:45.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581427+0000", 2024-09-17T02:21:45.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000226309 2024-09-17T02:21:45.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:45.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581690+0000", 2024-09-17T02:21:45.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026340199999999998 2024-09-17T02:21:45.236 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.236 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:45.236 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.236 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129580 5.4 5:25ed887b:::benchmark_data_smithi001_23533_object1463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:45.236 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:21:45.236 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.5333708549999994, 2024-09-17T02:21:45.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98001430499999997, 2024-09-17T02:21:45.236 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:45.237 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:45.237 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.237 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:45.237 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:45.237 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.237 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129580 2024-09-17T02:21:45.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.237 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:45.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:45.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:21:45.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:45.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:21:45.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:45.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611329+0000", 2024-09-17T02:21:45.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.22e-06 2024-09-17T02:21:45.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:45.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611335+0000", 2024-09-17T02:21:45.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1129999999999997e-06 2024-09-17T02:21:45.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:45.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611348+0000", 2024-09-17T02:21:45.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2342e-05 2024-09-17T02:21:45.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611356+0000", 2024-09-17T02:21:45.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.371e-06 2024-09-17T02:21:45.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611419+0000", 2024-09-17T02:21:45.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3393999999999996e-05 2024-09-17T02:21:45.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:45.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611427+0000", 2024-09-17T02:21:45.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999997e-06 2024-09-17T02:21:45.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570705+0000", 2024-09-17T02:21:45.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.95927859199999999 2024-09-17T02:21:45.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:45.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571009+0000", 2024-09-17T02:21:45.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030414599999999998 2024-09-17T02:21:45.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:45.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571241+0000", 2024-09-17T02:21:45.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023106799999999999 2024-09-17T02:21:45.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:45.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590789+0000", 2024-09-17T02:21:45.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019548763 2024-09-17T02:21:45.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590928+0000", 2024-09-17T02:21:45.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000139092 2024-09-17T02:21:45.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:45.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591086+0000", 2024-09-17T02:21:45.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015787400000000001 2024-09-17T02:21:45.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:45.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591342+0000", 2024-09-17T02:21:45.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025589900000000002 2024-09-17T02:21:45.243 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.243 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:45.243 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.243 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129603 5.4 5:25aaa5e8:::benchmark_data_smithi001_23533_object1486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:45.243 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:45.243 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.5173110590000007, 2024-09-17T02:21:45.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96463198999999999, 2024-09-17T02:21:45.243 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:45.243 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:45.243 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.244 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:45.244 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:45.244 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.244 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129603 2024-09-17T02:21:45.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.244 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:45.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:45.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:45.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:45.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:45.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:45.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:45.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:21:45.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:45.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627392+0000", 2024-09-17T02:21:45.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0790000000000002e-06 2024-09-17T02:21:45.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:45.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627403+0000", 2024-09-17T02:21:45.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0866000000000001e-05 2024-09-17T02:21:45.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627409+0000", 2024-09-17T02:21:45.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.305e-06 2024-09-17T02:21:45.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627485+0000", 2024-09-17T02:21:45.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6582000000000006e-05 2024-09-17T02:21:45.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:45.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627499+0000", 2024-09-17T02:21:45.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:21:45.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574991+0000", 2024-09-17T02:21:45.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94749182300000001 2024-09-17T02:21:45.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:45.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575377+0000", 2024-09-17T02:21:45.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038629400000000003 2024-09-17T02:21:45.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:45.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575665+0000", 2024-09-17T02:21:45.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028759499999999997 2024-09-17T02:21:45.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:45.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590802+0000", 2024-09-17T02:21:45.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015136479 2024-09-17T02:21:45.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591614+0000", 2024-09-17T02:21:45.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081293100000000003 2024-09-17T02:21:45.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:45.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591764+0000", 2024-09-17T02:21:45.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014932199999999999 2024-09-17T02:21:45.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:45.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592020+0000", 2024-09-17T02:21:45.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025585099999999997 2024-09-17T02:21:45.250 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.250 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:45.250 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.250 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129607 5.4 5:2f638f1e:::benchmark_data_smithi001_23533_object1490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:45.250 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:21:45.250 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.5157841530000002, 2024-09-17T02:21:45.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96352375899999998, 2024-09-17T02:21:45.250 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:45.250 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:45.250 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.251 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:45.251 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:45.251 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.251 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129607 2024-09-17T02:21:45.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.251 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:45.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:45.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:21:45.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:45.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:21:45.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:45.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628916+0000", 2024-09-17T02:21:45.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1710000000000001e-06 2024-09-17T02:21:45.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:45.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628920+0000", 2024-09-17T02:21:45.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-17T02:21:45.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:45.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628935+0000", 2024-09-17T02:21:45.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4474000000000001e-05 2024-09-17T02:21:45.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628944+0000", 2024-09-17T02:21:45.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9940000000000006e-06 2024-09-17T02:21:45.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628997+0000", 2024-09-17T02:21:45.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3579000000000003e-05 2024-09-17T02:21:45.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:45.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.629006+0000", 2024-09-17T02:21:45.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4009999999999997e-06 2024-09-17T02:21:45.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.577862+0000", 2024-09-17T02:21:45.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.948856335 2024-09-17T02:21:45.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:45.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578167+0000", 2024-09-17T02:21:45.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030532399999999999 2024-09-17T02:21:45.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:45.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578532+0000", 2024-09-17T02:21:45.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036428200000000001 2024-09-17T02:21:45.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:45.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591442+0000", 2024-09-17T02:21:45.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012910374000000001 2024-09-17T02:21:45.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592164+0000", 2024-09-17T02:21:45.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072242499999999996 2024-09-17T02:21:45.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:45.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592267+0000", 2024-09-17T02:21:45.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102205 2024-09-17T02:21:45.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:45.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592438+0000", 2024-09-17T02:21:45.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017165299999999999 2024-09-17T02:21:45.256 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.256 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:45.257 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.257 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129623 5.4 5:2cf5174b:::benchmark_data_smithi001_23533_object1506:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:45.257 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:21:45.257 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.4918398669999995, 2024-09-17T02:21:45.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94334114499999999, 2024-09-17T02:21:45.257 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:45.257 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:45.257 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.257 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:45.257 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:45.257 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.258 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129623 2024-09-17T02:21:45.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.258 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:45.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:45.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:21:45.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:45.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:21:45.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:45.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652860+0000", 2024-09-17T02:21:45.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0330000000000001e-06 2024-09-17T02:21:45.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:45.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652864+0000", 2024-09-17T02:21:45.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.634e-06 2024-09-17T02:21:45.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:45.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652877+0000", 2024-09-17T02:21:45.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2591e-05 2024-09-17T02:21:45.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652883+0000", 2024-09-17T02:21:45.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1460000000000001e-06 2024-09-17T02:21:45.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652943+0000", 2024-09-17T02:21:45.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9833999999999997e-05 2024-09-17T02:21:45.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:45.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652950+0000", 2024-09-17T02:21:45.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.401e-06 2024-09-17T02:21:45.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581800+0000", 2024-09-17T02:21:45.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.92884935700000004 2024-09-17T02:21:45.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:45.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582122+0000", 2024-09-17T02:21:45.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032185200000000002 2024-09-17T02:21:45.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:45.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582689+0000", 2024-09-17T02:21:45.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056750400000000003 2024-09-17T02:21:45.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:45.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591458+0000", 2024-09-17T02:21:45.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008768685 2024-09-17T02:21:45.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595856+0000", 2024-09-17T02:21:45.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043977909999999999 2024-09-17T02:21:45.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:45.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595955+0000", 2024-09-17T02:21:45.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9166000000000006e-05 2024-09-17T02:21:45.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:45.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596200+0000", 2024-09-17T02:21:45.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024515099999999998 2024-09-17T02:21:45.263 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.264 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:45.264 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.264 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129642 5.4 5:255eb796:::benchmark_data_smithi001_23533_object1525:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:45.264 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:21:45.264 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.4606037030000003, 2024-09-17T02:21:45.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.91257397299999998, 2024-09-17T02:21:45.264 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:45.264 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:45.264 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.264 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:45.265 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:45.265 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.265 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129642 2024-09-17T02:21:45.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.265 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:45.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:45.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:21:45.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:45.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:21:45.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:45.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684096+0000", 2024-09-17T02:21:45.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659999999999999e-06 2024-09-17T02:21:45.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:45.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684101+0000", 2024-09-17T02:21:45.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8110000000000002e-06 2024-09-17T02:21:45.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:45.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684114+0000", 2024-09-17T02:21:45.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2653000000000001e-05 2024-09-17T02:21:45.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684121+0000", 2024-09-17T02:21:45.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5100000000000001e-06 2024-09-17T02:21:45.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684181+0000", 2024-09-17T02:21:45.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0307999999999999e-05 2024-09-17T02:21:45.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:45.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684194+0000", 2024-09-17T02:21:45.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2916e-05 2024-09-17T02:21:45.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.587917+0000", 2024-09-17T02:21:45.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.90372220400000003 2024-09-17T02:21:45.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:45.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588215+0000", 2024-09-17T02:21:45.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029845400000000003 2024-09-17T02:21:45.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:45.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588470+0000", 2024-09-17T02:21:45.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025455399999999999 2024-09-17T02:21:45.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596318+0000", 2024-09-17T02:21:45.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078485589999999997 2024-09-17T02:21:45.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:45.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596354+0000", 2024-09-17T02:21:45.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5976999999999998e-05 2024-09-17T02:21:45.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:45.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596449+0000", 2024-09-17T02:21:45.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4728999999999994e-05 2024-09-17T02:21:45.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:45.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596669+0000", 2024-09-17T02:21:45.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220132 2024-09-17T02:21:45.271 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.271 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:45.271 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.271 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129649 5.4 5:2fe27050:::benchmark_data_smithi001_23533_object1532:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:45.271 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:21:45.271 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.4290469600000009, 2024-09-17T02:21:45.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.88508119100000004, 2024-09-17T02:21:45.271 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:45.271 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:45.271 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.271 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:45.272 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:45.272 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.272 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129649 2024-09-17T02:21:45.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.272 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:45.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.272 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:45.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:21:45.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.272 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:45.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:21:45.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:45.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:45.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715653+0000", 2024-09-17T02:21:45.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3519999999999999e-06 2024-09-17T02:21:45.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:45.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715658+0000", 2024-09-17T02:21:45.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3120000000000001e-06 2024-09-17T02:21:45.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:45.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715677+0000", 2024-09-17T02:21:45.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-17T02:21:45.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715687+0000", 2024-09-17T02:21:45.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0146000000000001e-05 2024-09-17T02:21:45.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715821+0000", 2024-09-17T02:21:45.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013421 2024-09-17T02:21:45.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:45.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715840+0000", 2024-09-17T02:21:45.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8153999999999999e-05 2024-09-17T02:21:45.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:45.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592528+0000", 2024-09-17T02:21:45.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.87668860000000004 2024-09-17T02:21:45.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:45.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592702+0000", 2024-09-17T02:21:45.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017429300000000001 2024-09-17T02:21:45.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:45.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592945+0000", 2024-09-17T02:21:45.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000242048 2024-09-17T02:21:45.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:45.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600234+0000", 2024-09-17T02:21:45.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072897600000000002 2024-09-17T02:21:45.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600494+0000", 2024-09-17T02:21:45.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000259984 2024-09-17T02:21:45.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:45.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600555+0000", 2024-09-17T02:21:45.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1138999999999999e-05 2024-09-17T02:21:45.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:45.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:45.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:45.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600733+0000", 2024-09-17T02:21:45.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017753300000000001 2024-09-17T02:21:45.278 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.278 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:45.278 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.278 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:45.278 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:45.278 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:45.279 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:45.280 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:45.281+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:45.380 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:45.385+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:45.438 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:45.438 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:45.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.439 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:149596 5.0 5:08378e32:::benchmark_data_smithi001_23533_object21479:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:45.439 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.437288+0000", 2024-09-17T02:21:45.439 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0048821250000000002, 2024-09-17T02:21:45.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004909666, 2024-09-17T02:21:45.439 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.439 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.439 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:45.439 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.439 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.439 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.439 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 149596 2024-09-17T02:21:45.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.439 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437288+0000", 2024-09-17T02:21:45.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437288+0000", 2024-09-17T02:21:45.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437289+0000", 2024-09-17T02:21:45.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.302e-06 2024-09-17T02:21:45.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437294+0000", 2024-09-17T02:21:45.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6639999999999997e-06 2024-09-17T02:21:45.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437304+0000", 2024-09-17T02:21:45.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0147e-05 2024-09-17T02:21:45.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437311+0000", 2024-09-17T02:21:45.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8870000000000003e-06 2024-09-17T02:21:45.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437398+0000", 2024-09-17T02:21:45.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7107000000000005e-05 2024-09-17T02:21:45.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437525+0000", 2024-09-17T02:21:45.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012702899999999999 2024-09-17T02:21:45.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:45.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437628+0000", 2024-09-17T02:21:45.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103095 2024-09-17T02:21:45.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.442200+0000", 2024-09-17T02:21:45.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045723389999999999 2024-09-17T02:21:45.444 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.444 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.444 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.444 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:149597 5.a 5:5572bfdc:::benchmark_data_smithi001_23533_object21480:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:45.444 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.437330+0000", 2024-09-17T02:21:45.445 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0048402080000000004, 2024-09-17T02:21:45.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049624489999999999, 2024-09-17T02:21:45.445 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.445 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.445 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:45.445 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.445 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.445 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.445 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 149597 2024-09-17T02:21:45.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.445 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437330+0000", 2024-09-17T02:21:45.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437330+0000", 2024-09-17T02:21:45.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437330+0000", 2024-09-17T02:21:45.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2599999999999998e-07 2024-09-17T02:21:45.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437333+0000", 2024-09-17T02:21:45.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.92e-06 2024-09-17T02:21:45.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437339+0000", 2024-09-17T02:21:45.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4590000000000003e-06 2024-09-17T02:21:45.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437344+0000", 2024-09-17T02:21:45.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9099999999999996e-06 2024-09-17T02:21:45.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437510+0000", 2024-09-17T02:21:45.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016562200000000001 2024-09-17T02:21:45.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437611+0000", 2024-09-17T02:21:45.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010068000000000001 2024-09-17T02:21:45.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437709+0000", 2024-09-17T02:21:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8318000000000003e-05 2024-09-17T02:21:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:149599 5.0 5:0b6a020a:::benchmark_data_smithi001_23533_object21482:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.437802+0000", 2024-09-17T02:21:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0043681140000000002, 2024-09-17T02:21:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004570981, 2024-09-17T02:21:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.450 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.450 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:45.450 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.450 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.450 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.450 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 149599 2024-09-17T02:21:45.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.450 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437802+0000", 2024-09-17T02:21:45.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437802+0000", 2024-09-17T02:21:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437802+0000", 2024-09-17T02:21:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.61e-07 2024-09-17T02:21:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437805+0000", 2024-09-17T02:21:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6029999999999999e-06 2024-09-17T02:21:45.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437814+0000", 2024-09-17T02:21:45.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0699999999999996e-06 2024-09-17T02:21:45.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437820+0000", 2024-09-17T02:21:45.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0739999999999998e-06 2024-09-17T02:21:45.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.439844+0000", 2024-09-17T02:21:45.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020240200000000001 2024-09-17T02:21:45.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.439941+0000", 2024-09-17T02:21:45.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7120000000000005e-05 2024-09-17T02:21:45.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:45.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440089+0000", 2024-09-17T02:21:45.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000148061 2024-09-17T02:21:45.453 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.454 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.454 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.454 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:149600 5.6 5:6ebde156:::benchmark_data_smithi001_23533_object21483:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:45.454 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.437829+0000", 2024-09-17T02:21:45.454 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0043403629999999999, 2024-09-17T02:21:45.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046257190000000004, 2024-09-17T02:21:45.454 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.454 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.454 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:45.454 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.454 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 149600 2024-09-17T02:21:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437829+0000", 2024-09-17T02:21:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437829+0000", 2024-09-17T02:21:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437830+0000", 2024-09-17T02:21:45.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3099999999999998e-07 2024-09-17T02:21:45.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437832+0000", 2024-09-17T02:21:45.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.046e-06 2024-09-17T02:21:45.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437837+0000", 2024-09-17T02:21:45.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6030000000000004e-06 2024-09-17T02:21:45.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437842+0000", 2024-09-17T02:21:45.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4519999999999999e-06 2024-09-17T02:21:45.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437913+0000", 2024-09-17T02:21:45.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0835999999999997e-05 2024-09-17T02:21:45.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.438018+0000", 2024-09-17T02:21:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104788 2024-09-17T02:21:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:149601 5.1 5:8f6c2bda:::benchmark_data_smithi001_23533_object21484:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.437851+0000", 2024-09-17T02:21:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0043187929999999996, 2024-09-17T02:21:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046770090000000002, 2024-09-17T02:21:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 149601 2024-09-17T02:21:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437851+0000", 2024-09-17T02:21:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437851+0000", 2024-09-17T02:21:45.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437851+0000", 2024-09-17T02:21:45.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-17T02:21:45.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437853+0000", 2024-09-17T02:21:45.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8899999999999999e-06 2024-09-17T02:21:45.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437858+0000", 2024-09-17T02:21:45.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.322e-06 2024-09-17T02:21:45.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.437863+0000", 2024-09-17T02:21:45.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4390000000000002e-06 2024-09-17T02:21:45.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.438193+0000", 2024-09-17T02:21:45.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033051400000000001 2024-09-17T02:21:45.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.438299+0000", 2024-09-17T02:21:45.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010527999999999999 2024-09-17T02:21:45.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:45.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.438408+0000", 2024-09-17T02:21:45.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109547 2024-09-17T02:21:45.462 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.462 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.463 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.463 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:149603 5.0 5:00aa790b:::benchmark_data_smithi001_23533_object21486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:45.463 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.440550+0000", 2024-09-17T02:21:45.463 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0016197200000000001, 2024-09-17T02:21:45.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020433140000000001, 2024-09-17T02:21:45.463 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.463 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.463 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:45.463 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.463 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.463 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.464 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 149603 2024-09-17T02:21:45.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.464 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440550+0000", 2024-09-17T02:21:45.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440550+0000", 2024-09-17T02:21:45.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440551+0000", 2024-09-17T02:21:45.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0599999999999999e-07 2024-09-17T02:21:45.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440555+0000", 2024-09-17T02:21:45.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0929999999999996e-06 2024-09-17T02:21:45.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440563+0000", 2024-09-17T02:21:45.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4500000000000004e-06 2024-09-17T02:21:45.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440571+0000", 2024-09-17T02:21:45.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7279999999999995e-06 2024-09-17T02:21:45.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.442243+0000", 2024-09-17T02:21:45.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016717430000000001 2024-09-17T02:21:45.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.442369+0000", 2024-09-17T02:21:45.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012650399999999999 2024-09-17T02:21:45.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:45.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.442469+0000", 2024-09-17T02:21:45.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9413000000000005e-05 2024-09-17T02:21:45.467 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.467 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.467 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.467 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:149604 5.7 5:ea098ba2:::benchmark_data_smithi001_23533_object21487:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:45.467 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.440584+0000", 2024-09-17T02:21:45.467 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001585403, 2024-09-17T02:21:45.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002046019, 2024-09-17T02:21:45.468 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.468 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.468 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:45.468 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.468 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.468 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.468 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 149604 2024-09-17T02:21:45.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.468 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440584+0000", 2024-09-17T02:21:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440584+0000", 2024-09-17T02:21:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440585+0000", 2024-09-17T02:21:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3900000000000005e-07 2024-09-17T02:21:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440587+0000", 2024-09-17T02:21:45.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3810000000000002e-06 2024-09-17T02:21:45.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440594+0000", 2024-09-17T02:21:45.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.596e-06 2024-09-17T02:21:45.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440599+0000", 2024-09-17T02:21:45.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0000000000000004e-06 2024-09-17T02:21:45.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440643+0000", 2024-09-17T02:21:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4221000000000002e-05 2024-09-17T02:21:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440760+0000", 2024-09-17T02:21:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000116543 2024-09-17T02:21:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.472 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:149605 5.0 5.928bac90 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:45.472 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.440610+0000", 2024-09-17T02:21:45.472 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0015593060000000001, 2024-09-17T02:21:45.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020545509999999999, 2024-09-17T02:21:45.472 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.472 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.472 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:45.472 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.472 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.472 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.472 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 149605 2024-09-17T02:21:45.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.472 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440610+0000", 2024-09-17T02:21:45.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440610+0000", 2024-09-17T02:21:45.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440611+0000", 2024-09-17T02:21:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6400000000000003e-07 2024-09-17T02:21:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440614+0000", 2024-09-17T02:21:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8949999999999998e-06 2024-09-17T02:21:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440621+0000", 2024-09-17T02:21:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7229999999999998e-06 2024-09-17T02:21:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440628+0000", 2024-09-17T02:21:45.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0509999999999999e-06 2024-09-17T02:21:45.475 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.475 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.475 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.475 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:149607 5.2 5:41c6158f:::benchmark_data_smithi001_23533_object21490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:45.475 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.440635+0000", 2024-09-17T02:21:45.475 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0015350159999999999, 2024-09-17T02:21:45.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020618440000000002, 2024-09-17T02:21:45.475 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.475 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 149607 2024-09-17T02:21:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440635+0000", 2024-09-17T02:21:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440635+0000", 2024-09-17T02:21:45.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440635+0000", 2024-09-17T02:21:45.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7899999999999999e-07 2024-09-17T02:21:45.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440638+0000", 2024-09-17T02:21:45.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5239999999999999e-06 2024-09-17T02:21:45.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440644+0000", 2024-09-17T02:21:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5209999999999999e-06 2024-09-17T02:21:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440649+0000", 2024-09-17T02:21:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8269999999999997e-06 2024-09-17T02:21:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440690+0000", 2024-09-17T02:21:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.108e-05 2024-09-17T02:21:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440822+0000", 2024-09-17T02:21:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013224800000000001 2024-09-17T02:21:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:149608 5.7 5.3ea247e7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.440660+0000", 2024-09-17T02:21:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0015097979999999999, 2024-09-17T02:21:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020964709999999999, 2024-09-17T02:21:45.480 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.480 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.480 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:45.480 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.480 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.480 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.480 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 149608 2024-09-17T02:21:45.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.480 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440660+0000", 2024-09-17T02:21:45.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440660+0000", 2024-09-17T02:21:45.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440660+0000", 2024-09-17T02:21:45.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6399999999999998e-07 2024-09-17T02:21:45.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440676+0000", 2024-09-17T02:21:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5586999999999998e-05 2024-09-17T02:21:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440683+0000", 2024-09-17T02:21:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8220000000000001e-06 2024-09-17T02:21:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440688+0000", 2024-09-17T02:21:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1699999999999996e-06 2024-09-17T02:21:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.483 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.483 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:149609 5.c 5:319e2434:::benchmark_data_smithi001_23533_object21492:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:45.483 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.440700+0000", 2024-09-17T02:21:45.483 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001469847, 2024-09-17T02:21:45.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021112980000000002, 2024-09-17T02:21:45.483 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.483 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.483 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:45.483 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.483 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.483 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.484 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 149609 2024-09-17T02:21:45.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.484 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440700+0000", 2024-09-17T02:21:45.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440700+0000", 2024-09-17T02:21:45.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440700+0000", 2024-09-17T02:21:45.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1799999999999995e-07 2024-09-17T02:21:45.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440702+0000", 2024-09-17T02:21:45.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.097e-06 2024-09-17T02:21:45.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440710+0000", 2024-09-17T02:21:45.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4699999999999996e-06 2024-09-17T02:21:45.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440715+0000", 2024-09-17T02:21:45.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9080000000000003e-06 2024-09-17T02:21:45.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440769+0000", 2024-09-17T02:21:45.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4568999999999999e-05 2024-09-17T02:21:45.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440878+0000", 2024-09-17T02:21:45.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000108334 2024-09-17T02:21:45.487 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.487 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.487 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.487 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:149610 5.c 5.a3d9fc2c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:45.487 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.440735+0000", 2024-09-17T02:21:45.487 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0014343820000000001, 2024-09-17T02:21:45.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002140327, 2024-09-17T02:21:45.487 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.487 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.487 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:45.488 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.488 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.488 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.488 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 149610 2024-09-17T02:21:45.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.488 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440735+0000", 2024-09-17T02:21:45.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440735+0000", 2024-09-17T02:21:45.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440736+0000", 2024-09-17T02:21:45.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7999999999999995e-07 2024-09-17T02:21:45.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440739+0000", 2024-09-17T02:21:45.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8449999999999999e-06 2024-09-17T02:21:45.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440746+0000", 2024-09-17T02:21:45.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1579999999999999e-06 2024-09-17T02:21:45.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440752+0000", 2024-09-17T02:21:45.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5809999999999996e-06 2024-09-17T02:21:45.490 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.490 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.490 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.491 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:149611 5.5 5:a6ca668d:::benchmark_data_smithi001_23533_object21494:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:45.491 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.440761+0000", 2024-09-17T02:21:45.491 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0014088359999999999, 2024-09-17T02:21:45.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021725809999999998, 2024-09-17T02:21:45.491 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.491 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.491 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:45.491 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.491 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.491 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.491 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 149611 2024-09-17T02:21:45.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.492 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440761+0000", 2024-09-17T02:21:45.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440761+0000", 2024-09-17T02:21:45.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440761+0000", 2024-09-17T02:21:45.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3599999999999999e-07 2024-09-17T02:21:45.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440763+0000", 2024-09-17T02:21:45.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1430000000000001e-06 2024-09-17T02:21:45.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440770+0000", 2024-09-17T02:21:45.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2419999999999997e-06 2024-09-17T02:21:45.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440775+0000", 2024-09-17T02:21:45.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9810000000000003e-06 2024-09-17T02:21:45.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440817+0000", 2024-09-17T02:21:45.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2107999999999997e-05 2024-09-17T02:21:45.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440936+0000", 2024-09-17T02:21:45.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000118709 2024-09-17T02:21:45.495 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.495 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.495 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.495 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:149585 5.a 5:5659edc3:::benchmark_data_smithi001_23533_object21468:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:45.495 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.431293+0000", 2024-09-17T02:21:45.495 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.010876267, 2024-09-17T02:21:45.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011709179, 2024-09-17T02:21:45.496 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.496 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.496 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:45.496 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.496 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.496 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.496 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 149585 2024-09-17T02:21:45.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.496 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.431293+0000", 2024-09-17T02:21:45.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.431293+0000", 2024-09-17T02:21:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.431294+0000", 2024-09-17T02:21:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7800000000000002e-07 2024-09-17T02:21:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.431296+0000", 2024-09-17T02:21:45.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.345e-06 2024-09-17T02:21:45.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.431303+0000", 2024-09-17T02:21:45.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6460000000000004e-06 2024-09-17T02:21:45.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.431308+0000", 2024-09-17T02:21:45.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1800000000000004e-06 2024-09-17T02:21:45.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.434950+0000", 2024-09-17T02:21:45.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036415969999999999 2024-09-17T02:21:45.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.435052+0000", 2024-09-17T02:21:45.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102136 2024-09-17T02:21:45.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:45.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.435148+0000", 2024-09-17T02:21:45.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6428999999999994e-05 2024-09-17T02:21:45.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:45.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.440185+0000", 2024-09-17T02:21:45.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050368119999999999 2024-09-17T02:21:45.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.500 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.500 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:21:45.500 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 14 2024-09-17T02:21:45.500 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:45.502 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:45.502 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:45.505+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:45.602 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:45.605+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:45.656 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:45.656 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:21:45.656 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:21:45.656 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:21:45.656 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:45.677 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:45.723 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:45.725+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:45.805 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:45.805+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:45.832 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:45.832 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:21:45.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:21:45.832 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:45.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.832 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:45.832 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:45.832 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 63.266637821000003, 2024-09-17T02:21:45.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:21:45.832 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.832 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.833 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.833 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.833 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.833 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.833 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:21:45.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.833 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:45.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:45.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:21:45.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:21:45.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:21:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:21:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:21:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:21:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:21:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:21:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:21:45.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:21:45.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:21:45.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:21:45.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:45.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:21:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:21:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:21:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:21:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:21:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:21:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:45.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:21:45.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:21:45.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:45.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:21:45.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:21:45.838 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.838 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.838 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.839 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:45.839 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:45.839 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 63.262735571, 2024-09-17T02:21:45.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:21:45.839 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.839 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.839 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.839 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.839 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.839 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.839 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:21:45.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.839 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:45.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:45.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:21:45.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:21:45.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:21:45.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:21:45.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:21:45.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:21:45.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:21:45.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:21:45.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:21:45.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:21:45.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:21:45.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:21:45.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:45.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:21:45.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:21:45.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:45.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:21:45.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:21:45.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:21:45.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:21:45.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:45.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:21:45.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:21:45.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:45.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:21:45.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:21:45.844 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.844 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.845 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.845 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71206 5.3 e39/38 5:c6c9386d:::benchmark_data_smithi001_23533_object71205:head v 39'4517, mlcod=35'4513)", 2024-09-17T02:21:45.845 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:45.845 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 41.225408455999997, 2024-09-17T02:21:45.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026101868, 2024-09-17T02:21:45.845 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.845 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.845 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.845 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:45.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:45.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609694+0000", 2024-09-17T02:21:45.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9539999999999998e-06 2024-09-17T02:21:45.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609841+0000", 2024-09-17T02:21:45.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014690800000000001 2024-09-17T02:21:45.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609872+0000", 2024-09-17T02:21:45.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0326000000000001e-05 2024-09-17T02:21:45.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609892+0000", 2024-09-17T02:21:45.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9848999999999999e-05 2024-09-17T02:21:45.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613826+0000", 2024-09-17T02:21:45.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039345140000000001 2024-09-17T02:21:45.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613908+0000", 2024-09-17T02:21:45.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2412999999999999e-05 2024-09-17T02:21:45.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:45.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635696+0000", 2024-09-17T02:21:45.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021787597999999998 2024-09-17T02:21:45.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:45.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635794+0000", 2024-09-17T02:21:45.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8306000000000004e-05 2024-09-17T02:21:45.849 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.849 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.849 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.849 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71210 5.3 e39/38 5:c0498d13:::benchmark_data_smithi001_23533_object71209:head v 39'4518, mlcod=35'4513)", 2024-09-17T02:21:45.850 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:45.850 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 41.223930490000001, 2024-09-17T02:21:45.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024703197, 2024-09-17T02:21:45.850 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.850 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.850 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.850 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:45.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611170+0000", 2024-09-17T02:21:45.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611172+0000", 2024-09-17T02:21:45.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6470000000000001e-06 2024-09-17T02:21:45.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611344+0000", 2024-09-17T02:21:45.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000171607 2024-09-17T02:21:45.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611389+0000", 2024-09-17T02:21:45.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5738000000000002e-05 2024-09-17T02:21:45.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.611407+0000", 2024-09-17T02:21:45.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7893e-05 2024-09-17T02:21:45.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617820+0000", 2024-09-17T02:21:45.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064131070000000004 2024-09-17T02:21:45.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.617885+0000", 2024-09-17T02:21:45.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4442000000000004e-05 2024-09-17T02:21:45.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:45.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635806+0000", 2024-09-17T02:21:45.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017920874999999999 2024-09-17T02:21:45.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:45.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635874+0000", 2024-09-17T02:21:45.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7887999999999998e-05 2024-09-17T02:21:45.854 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.854 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.854 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.854 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97151 5.5 5:a0c2c072:::benchmark_data_smithi001_23533_object97150:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:45.854 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:45.854 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.566728849, 2024-09-17T02:21:45.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027297614000000001, 2024-09-17T02:21:45.854 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.855 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.855 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.855 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.855 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.855 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.855 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97151 2024-09-17T02:21:45.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.855 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:45.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:45.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268373+0000", 2024-09-17T02:21:45.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4000000000000002e-07 2024-09-17T02:21:45.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268423+0000", 2024-09-17T02:21:45.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0175e-05 2024-09-17T02:21:45.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268428+0000", 2024-09-17T02:21:45.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-17T02:21:45.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268431+0000", 2024-09-17T02:21:45.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.179e-06 2024-09-17T02:21:45.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283631+0000", 2024-09-17T02:21:45.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015199691 2024-09-17T02:21:45.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283740+0000", 2024-09-17T02:21:45.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109305 2024-09-17T02:21:45.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:45.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283863+0000", 2024-09-17T02:21:45.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012226699999999999 2024-09-17T02:21:45.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:45.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290857+0000", 2024-09-17T02:21:45.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069945449999999996 2024-09-17T02:21:45.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295595+0000", 2024-09-17T02:21:45.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047376750000000002 2024-09-17T02:21:45.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:45.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295638+0000", 2024-09-17T02:21:45.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3671999999999998e-05 2024-09-17T02:21:45.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:45.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295670+0000", 2024-09-17T02:21:45.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1266000000000002e-05 2024-09-17T02:21:45.860 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.860 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.860 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.860 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97759 5.a 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:45.860 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:45.861 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.236715748000002, 2024-09-17T02:21:45.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.089694871999999995, 2024-09-17T02:21:45.861 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.861 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.861 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.861 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.861 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.861 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.861 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97759 2024-09-17T02:21:45.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.861 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:45.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:45.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598386+0000", 2024-09-17T02:21:45.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999999e-07 2024-09-17T02:21:45.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598414+0000", 2024-09-17T02:21:45.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8013000000000001e-05 2024-09-17T02:21:45.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598420+0000", 2024-09-17T02:21:45.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1149999999999999e-06 2024-09-17T02:21:45.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598424+0000", 2024-09-17T02:21:45.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:21:45.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598479+0000", 2024-09-17T02:21:45.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4648999999999998e-05 2024-09-17T02:21:45.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598587+0000", 2024-09-17T02:21:45.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010853000000000001 2024-09-17T02:21:45.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:45.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598676+0000", 2024-09-17T02:21:45.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8381999999999995e-05 2024-09-17T02:21:45.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:45.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603766+0000", 2024-09-17T02:21:45.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050902559999999996 2024-09-17T02:21:45.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.687988+0000", 2024-09-17T02:21:45.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.084221753999999996 2024-09-17T02:21:45.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:45.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688037+0000", 2024-09-17T02:21:45.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-05 2024-09-17T02:21:45.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:45.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688080+0000", 2024-09-17T02:21:45.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3149999999999999e-05 2024-09-17T02:21:45.866 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.866 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.866 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.867 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97770 5.0 5:09c75033:::benchmark_data_smithi001_23533_object97769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:45.867 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:45.867 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.231573317999999, 2024-09-17T02:21:45.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.086380868, 2024-09-17T02:21:45.867 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.867 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.867 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.867 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.867 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.867 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.867 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97770 2024-09-17T02:21:45.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.867 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:45.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:45.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603529+0000", 2024-09-17T02:21:45.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:21:45.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603593+0000", 2024-09-17T02:21:45.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4216999999999999e-05 2024-09-17T02:21:45.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603603+0000", 2024-09-17T02:21:45.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5179999999999993e-06 2024-09-17T02:21:45.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603608+0000", 2024-09-17T02:21:45.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2039999999999996e-06 2024-09-17T02:21:45.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603653+0000", 2024-09-17T02:21:45.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5247000000000002e-05 2024-09-17T02:21:45.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603758+0000", 2024-09-17T02:21:45.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105352 2024-09-17T02:21:45.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:45.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603900+0000", 2024-09-17T02:21:45.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014198999999999999 2024-09-17T02:21:45.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:45.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.606097+0000", 2024-09-17T02:21:45.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021969839999999999 2024-09-17T02:21:45.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689756+0000", 2024-09-17T02:21:45.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.083659077999999998 2024-09-17T02:21:45.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:45.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689846+0000", 2024-09-17T02:21:45.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9320999999999994e-05 2024-09-17T02:21:45.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:45.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689908+0000", 2024-09-17T02:21:45.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720999999999998e-05 2024-09-17T02:21:45.873 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.873 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.873 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.873 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127513 5.c 5:3eca08e4:::benchmark_data_smithi001_23533_object127512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:45.873 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:21:45.873 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.390796893999999, 2024-09-17T02:21:45.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046626399999999998, 2024-09-17T02:21:45.873 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.874 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.874 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.874 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.874 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.874 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.874 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127513 2024-09-17T02:21:45.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.874 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:21:45.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:21:45.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444305+0000", 2024-09-17T02:21:45.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2529999999999999e-06 2024-09-17T02:21:45.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444466+0000", 2024-09-17T02:21:45.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016069700000000001 2024-09-17T02:21:45.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444479+0000", 2024-09-17T02:21:45.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2602999999999999e-05 2024-09-17T02:21:45.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444485+0000", 2024-09-17T02:21:45.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.669e-06 2024-09-17T02:21:45.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444560+0000", 2024-09-17T02:21:45.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4276999999999994e-05 2024-09-17T02:21:45.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444656+0000", 2024-09-17T02:21:45.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6490000000000006e-05 2024-09-17T02:21:45.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:45.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444739+0000", 2024-09-17T02:21:45.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3139999999999993e-05 2024-09-17T02:21:45.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:45.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.448438+0000", 2024-09-17T02:21:45.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036985490000000002 2024-09-17T02:21:45.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490732+0000", 2024-09-17T02:21:45.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042294353999999999 2024-09-17T02:21:45.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:45.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490859+0000", 2024-09-17T02:21:45.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012708899999999999 2024-09-17T02:21:45.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:45.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490930+0000", 2024-09-17T02:21:45.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:21:45.879 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.879 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.879 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.879 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127514 5.c 5:39cc1feb:::benchmark_data_smithi001_23533_object127513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:45.880 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:45.880 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.390600125000001, 2024-09-17T02:21:45.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049357228000000003, 2024-09-17T02:21:45.880 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.880 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.880 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.880 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.880 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.880 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.880 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127514 2024-09-17T02:21:45.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.880 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:45.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:45.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:45.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8599999999999998e-07 2024-09-17T02:21:45.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444554+0000", 2024-09-17T02:21:45.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3047999999999998e-05 2024-09-17T02:21:45.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444562+0000", 2024-09-17T02:21:45.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5830000000000001e-06 2024-09-17T02:21:45.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444567+0000", 2024-09-17T02:21:45.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4179999999999996e-06 2024-09-17T02:21:45.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446566+0000", 2024-09-17T02:21:45.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001998788 2024-09-17T02:21:45.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446696+0000", 2024-09-17T02:21:45.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129393 2024-09-17T02:21:45.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:45.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446794+0000", 2024-09-17T02:21:45.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8462999999999996e-05 2024-09-17T02:21:45.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:45.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.449036+0000", 2024-09-17T02:21:45.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022415880000000001 2024-09-17T02:21:45.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493737+0000", 2024-09-17T02:21:45.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044701682 2024-09-17T02:21:45.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:45.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493808+0000", 2024-09-17T02:21:45.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0846000000000006e-05 2024-09-17T02:21:45.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:45.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493858+0000", 2024-09-17T02:21:45.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9932999999999998e-05 2024-09-17T02:21:45.886 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.886 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.886 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.886 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129441 5.1 5:84c3199f:::benchmark_data_smithi001_23533_object1324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:45.886 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:21:45.886 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.331589637, 2024-09-17T02:21:45.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034387011000000002, 2024-09-17T02:21:45.886 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.886 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.886 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.886 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.886 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.887 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.887 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129441 2024-09-17T02:21:45.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.887 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:21:45.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:21:45.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503513+0000", 2024-09-17T02:21:45.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4759999999999999e-06 2024-09-17T02:21:45.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503518+0000", 2024-09-17T02:21:45.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-09-17T02:21:45.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503532+0000", 2024-09-17T02:21:45.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4049999999999999e-05 2024-09-17T02:21:45.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503541+0000", 2024-09-17T02:21:45.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5320000000000006e-06 2024-09-17T02:21:45.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506331+0000", 2024-09-17T02:21:45.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027899190000000001 2024-09-17T02:21:45.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506402+0000", 2024-09-17T02:21:45.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:21:45.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:45.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506477+0000", 2024-09-17T02:21:45.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4626e-05 2024-09-17T02:21:45.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:45.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509749+0000", 2024-09-17T02:21:45.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032726980000000001 2024-09-17T02:21:45.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537758+0000", 2024-09-17T02:21:45.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028008890000000002 2024-09-17T02:21:45.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:45.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537812+0000", 2024-09-17T02:21:45.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3300000000000001e-05 2024-09-17T02:21:45.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:45.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537898+0000", 2024-09-17T02:21:45.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6691000000000001e-05 2024-09-17T02:21:45.891 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.891 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.892 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.892 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129442 5.1 5:8f7f2a95:::benchmark_data_smithi001_23533_object1325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:45.892 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:21:45.892 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.328619028, 2024-09-17T02:21:45.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031546698999999997, 2024-09-17T02:21:45.892 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.892 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.892 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.892 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.892 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.893 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.893 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129442 2024-09-17T02:21:45.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.893 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:21:45.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:21:45.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506483+0000", 2024-09-17T02:21:45.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2869999999999999e-06 2024-09-17T02:21:45.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506489+0000", 2024-09-17T02:21:45.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2330000000000003e-06 2024-09-17T02:21:45.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506502+0000", 2024-09-17T02:21:45.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2286999999999999e-05 2024-09-17T02:21:45.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506511+0000", 2024-09-17T02:21:45.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7799999999999995e-06 2024-09-17T02:21:45.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.507966+0000", 2024-09-17T02:21:45.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014541549999999999 2024-09-17T02:21:45.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508130+0000", 2024-09-17T02:21:45.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016455199999999999 2024-09-17T02:21:45.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:45.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508287+0000", 2024-09-17T02:21:45.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015730400000000001 2024-09-17T02:21:45.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:45.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510577+0000", 2024-09-17T02:21:45.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022899449999999998 2024-09-17T02:21:45.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537932+0000", 2024-09-17T02:21:45.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027354471000000002 2024-09-17T02:21:45.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:45.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537964+0000", 2024-09-17T02:21:45.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1909999999999998e-05 2024-09-17T02:21:45.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:45.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.538029+0000", 2024-09-17T02:21:45.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4775000000000002e-05 2024-09-17T02:21:45.898 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.898 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.898 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.898 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129443 5.8 5:1edfeaf8:::benchmark_data_smithi001_23533_object1326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:45.898 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:21:45.898 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.325184527999999, 2024-09-17T02:21:45.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025315902000000001, 2024-09-17T02:21:45.898 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.898 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.899 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.899 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.899 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.899 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.899 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129443 2024-09-17T02:21:45.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.899 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:21:45.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:21:45.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509918+0000", 2024-09-17T02:21:45.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3689999999999999e-06 2024-09-17T02:21:45.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509923+0000", 2024-09-17T02:21:45.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0429999999999998e-06 2024-09-17T02:21:45.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509936+0000", 2024-09-17T02:21:45.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3234000000000001e-05 2024-09-17T02:21:45.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509950+0000", 2024-09-17T02:21:45.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3998999999999999e-05 2024-09-17T02:21:45.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509994+0000", 2024-09-17T02:21:45.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4323000000000002e-05 2024-09-17T02:21:45.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510095+0000", 2024-09-17T02:21:45.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010103300000000001 2024-09-17T02:21:45.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:45.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510160+0000", 2024-09-17T02:21:45.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4976999999999998e-05 2024-09-17T02:21:45.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:45.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.513304+0000", 2024-09-17T02:21:45.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031431330000000002 2024-09-17T02:21:45.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535046+0000", 2024-09-17T02:21:45.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021742276000000001 2024-09-17T02:21:45.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:45.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:21:45.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107759 2024-09-17T02:21:45.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:45.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535232+0000", 2024-09-17T02:21:45.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8756000000000003e-05 2024-09-17T02:21:45.904 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.904 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.904 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.904 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:138243 5.b e54/51 5:d91391c1:::benchmark_data_smithi001_23533_object10126:head v 54'8566, mlcod=54'8564)", 2024-09-17T02:21:45.904 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.334890+0000", 2024-09-17T02:21:45.905 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.500210601, 2024-09-17T02:21:45.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025015253000000001, 2024-09-17T02:21:45.905 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.905 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.905 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.905 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.334890+0000", 2024-09-17T02:21:45.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.334890+0000", 2024-09-17T02:21:45.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.334891+0000", 2024-09-17T02:21:45.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8400000000000003e-07 2024-09-17T02:21:45.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.334895+0000", 2024-09-17T02:21:45.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.472e-06 2024-09-17T02:21:45.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.334901+0000", 2024-09-17T02:21:45.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3640000000000004e-06 2024-09-17T02:21:45.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.334905+0000", 2024-09-17T02:21:45.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4440000000000001e-06 2024-09-17T02:21:45.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.334952+0000", 2024-09-17T02:21:45.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6264000000000003e-05 2024-09-17T02:21:45.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.334973+0000", 2024-09-17T02:21:45.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1648e-05 2024-09-17T02:21:45.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:45.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.359846+0000", 2024-09-17T02:21:45.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024872834 2024-09-17T02:21:45.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:45.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.359906+0000", 2024-09-17T02:21:45.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9342999999999997e-05 2024-09-17T02:21:45.909 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.909 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.909 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.909 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:138247 5.3 5:caf01f60:::benchmark_data_smithi001_23533_object10130:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:45.909 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.335014+0000", 2024-09-17T02:21:45.909 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.5000869550000004, 2024-09-17T02:21:45.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026419469000000001, 2024-09-17T02:21:45.909 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.910 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.910 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.910 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.910 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.910 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.910 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 138247 2024-09-17T02:21:45.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.910 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335014+0000", 2024-09-17T02:21:45.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335014+0000", 2024-09-17T02:21:45.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335015+0000", 2024-09-17T02:21:45.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3600000000000004e-07 2024-09-17T02:21:45.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335017+0000", 2024-09-17T02:21:45.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5749999999999999e-06 2024-09-17T02:21:45.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335024+0000", 2024-09-17T02:21:45.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8379999999999996e-06 2024-09-17T02:21:45.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335029+0000", 2024-09-17T02:21:45.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.22e-06 2024-09-17T02:21:45.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335083+0000", 2024-09-17T02:21:45.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3600000000000002e-05 2024-09-17T02:21:45.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335229+0000", 2024-09-17T02:21:45.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000146098 2024-09-17T02:21:45.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:45.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335349+0000", 2024-09-17T02:21:45.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120631 2024-09-17T02:21:45.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.357942+0000", 2024-09-17T02:21:45.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022592457 2024-09-17T02:21:45.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:45.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.361286+0000", 2024-09-17T02:21:45.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003343623 2024-09-17T02:21:45.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:45.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.361338+0000", 2024-09-17T02:21:45.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2323e-05 2024-09-17T02:21:45.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:45.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.361433+0000", 2024-09-17T02:21:45.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5568000000000004e-05 2024-09-17T02:21:45.916 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.916 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.916 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.916 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:138244 5.b e54/51 5:d38c94c4:::benchmark_data_smithi001_23533_object10127:head v 54'8567, mlcod=54'8564)", 2024-09-17T02:21:45.916 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.336586+0000", 2024-09-17T02:21:45.916 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.4985145649999998, 2024-09-17T02:21:45.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026602741999999999, 2024-09-17T02:21:45.916 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.916 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.916 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.917 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336586+0000", 2024-09-17T02:21:45.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336586+0000", 2024-09-17T02:21:45.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336587+0000", 2024-09-17T02:21:45.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0600000000000001e-07 2024-09-17T02:21:45.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336590+0000", 2024-09-17T02:21:45.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3110000000000001e-06 2024-09-17T02:21:45.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336597+0000", 2024-09-17T02:21:45.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0639999999999996e-06 2024-09-17T02:21:45.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336602+0000", 2024-09-17T02:21:45.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3599999999999998e-06 2024-09-17T02:21:45.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336645+0000", 2024-09-17T02:21:45.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3628999999999999e-05 2024-09-17T02:21:45.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336666+0000", 2024-09-17T02:21:45.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0604000000000001e-05 2024-09-17T02:21:45.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:45.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363143+0000", 2024-09-17T02:21:45.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026477055999999999 2024-09-17T02:21:45.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:45.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363189+0000", 2024-09-17T02:21:45.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6312e-05 2024-09-17T02:21:45.921 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.921 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.921 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.921 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:138259 5.3 5:c08b4023:::benchmark_data_smithi001_23533_object10142:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:45.921 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.337063+0000", 2024-09-17T02:21:45.921 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.4980377469999997, 2024-09-17T02:21:45.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027773173000000002, 2024-09-17T02:21:45.921 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.921 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.921 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.922 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.922 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.922 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.922 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 138259 2024-09-17T02:21:45.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.922 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337063+0000", 2024-09-17T02:21:45.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337063+0000", 2024-09-17T02:21:45.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337064+0000", 2024-09-17T02:21:45.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-17T02:21:45.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337066+0000", 2024-09-17T02:21:45.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.03e-06 2024-09-17T02:21:45.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337072+0000", 2024-09-17T02:21:45.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5119999999999997e-06 2024-09-17T02:21:45.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337077+0000", 2024-09-17T02:21:45.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.454e-06 2024-09-17T02:21:45.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.352990+0000", 2024-09-17T02:21:45.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015913116000000001 2024-09-17T02:21:45.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.353136+0000", 2024-09-17T02:21:45.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000146117 2024-09-17T02:21:45.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:45.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.353253+0000", 2024-09-17T02:21:45.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117359 2024-09-17T02:21:45.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.358284+0000", 2024-09-17T02:21:45.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050306689999999998 2024-09-17T02:21:45.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:45.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.364738+0000", 2024-09-17T02:21:45.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064539410000000004 2024-09-17T02:21:45.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:45.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.364768+0000", 2024-09-17T02:21:45.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0086999999999998e-05 2024-09-17T02:21:45.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:45.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.364836+0000", 2024-09-17T02:21:45.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8549999999999999e-05 2024-09-17T02:21:45.927 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.927 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.927 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.927 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:138249 5.b e54/51 5:dcbad32d:::benchmark_data_smithi001_23533_object10132:head v 54'8568, mlcod=54'8564)", 2024-09-17T02:21:45.927 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.338016+0000", 2024-09-17T02:21:45.927 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.4970854070000001, 2024-09-17T02:21:45.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025210803, 2024-09-17T02:21:45.927 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.927 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.927 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.928 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338016+0000", 2024-09-17T02:21:45.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338016+0000", 2024-09-17T02:21:45.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338017+0000", 2024-09-17T02:21:45.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.28e-06 2024-09-17T02:21:45.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338022+0000", 2024-09-17T02:21:45.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0950000000000003e-06 2024-09-17T02:21:45.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338032+0000", 2024-09-17T02:21:45.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7140000000000005e-06 2024-09-17T02:21:45.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338038+0000", 2024-09-17T02:21:45.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1029999999999998e-06 2024-09-17T02:21:45.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.349300+0000", 2024-09-17T02:21:45.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01126216 2024-09-17T02:21:45.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.349359+0000", 2024-09-17T02:21:45.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9206999999999997e-05 2024-09-17T02:21:45.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:45.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363192+0000", 2024-09-17T02:21:45.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013833253 2024-09-17T02:21:45.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:45.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363226+0000", 2024-09-17T02:21:45.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3991e-05 2024-09-17T02:21:45.932 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.932 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.932 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.932 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:139574 5.a 5:55e1b723:::benchmark_data_smithi001_23533_object11457:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:45.932 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.927338+0000", 2024-09-17T02:21:45.932 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.9077628039999999, 2024-09-17T02:21:45.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024987447999999999, 2024-09-17T02:21:45.932 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.932 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.932 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.932 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.933 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.933 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.933 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 139574 2024-09-17T02:21:45.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.933 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.927338+0000", 2024-09-17T02:21:45.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.927338+0000", 2024-09-17T02:21:45.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.927339+0000", 2024-09-17T02:21:45.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:21:45.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.927342+0000", 2024-09-17T02:21:45.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1099999999999999e-06 2024-09-17T02:21:45.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.927350+0000", 2024-09-17T02:21:45.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0639999999999994e-06 2024-09-17T02:21:45.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.927357+0000", 2024-09-17T02:21:45.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2280000000000001e-06 2024-09-17T02:21:45.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.929425+0000", 2024-09-17T02:21:45.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020674780000000002 2024-09-17T02:21:45.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.929528+0000", 2024-09-17T02:21:45.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102866 2024-09-17T02:21:45.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:45.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.929623+0000", 2024-09-17T02:21:45.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5117000000000004e-05 2024-09-17T02:21:45.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:45.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.934966+0000", 2024-09-17T02:21:45.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053428850000000003 2024-09-17T02:21:45.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.952258+0000", 2024-09-17T02:21:45.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01729197 2024-09-17T02:21:45.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:45.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.952302+0000", 2024-09-17T02:21:45.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4623999999999998e-05 2024-09-17T02:21:45.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:45.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.952326+0000", 2024-09-17T02:21:45.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3263000000000001e-05 2024-09-17T02:21:45.938 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.938 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.938 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.938 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:139587 5.1 5:801d98ef:::benchmark_data_smithi001_23533_object11470:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:45.938 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.931670+0000", 2024-09-17T02:21:45.938 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.9034306680000004, 2024-09-17T02:21:45.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025666268999999999, 2024-09-17T02:21:45.939 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.939 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.939 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.939 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.939 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.939 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.939 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 139587 2024-09-17T02:21:45.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.939 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931670+0000", 2024-09-17T02:21:45.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931670+0000", 2024-09-17T02:21:45.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931671+0000", 2024-09-17T02:21:45.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.034e-06 2024-09-17T02:21:45.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931677+0000", 2024-09-17T02:21:45.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4580000000000001e-06 2024-09-17T02:21:45.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931690+0000", 2024-09-17T02:21:45.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3152999999999999e-05 2024-09-17T02:21:45.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931699+0000", 2024-09-17T02:21:45.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3100000000000006e-06 2024-09-17T02:21:45.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931779+0000", 2024-09-17T02:21:45.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0284000000000006e-05 2024-09-17T02:21:45.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931968+0000", 2024-09-17T02:21:45.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018853399999999999 2024-09-17T02:21:45.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:45.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.932149+0000", 2024-09-17T02:21:45.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018114699999999999 2024-09-17T02:21:45.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:45.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.935163+0000", 2024-09-17T02:21:45.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030143169999999999 2024-09-17T02:21:45.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.957199+0000", 2024-09-17T02:21:45.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022035255 2024-09-17T02:21:45.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:45.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.957247+0000", 2024-09-17T02:21:45.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8319999999999998e-05 2024-09-17T02:21:45.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:45.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.957337+0000", 2024-09-17T02:21:45.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9456999999999994e-05 2024-09-17T02:21:45.944 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.944 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.944 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.944 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:140178 5.1 5:8f77d9ee:::benchmark_data_smithi001_23533_object12061:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:45.944 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:21:45.945 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6476451770000002, 2024-09-17T02:21:45.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025269478000000001, 2024-09-17T02:21:45.945 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:45.945 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:45.945 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:45.945 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:45.945 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:45.945 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:45.945 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 140178 2024-09-17T02:21:45.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.945 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:45.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:45.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:21:45.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:45.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:21:45.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:45.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:45.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:21:45.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0500000000000004e-07 2024-09-17T02:21:45.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:45.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187459+0000", 2024-09-17T02:21:45.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5299999999999999e-06 2024-09-17T02:21:45.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:45.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187468+0000", 2024-09-17T02:21:45.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3130000000000004e-06 2024-09-17T02:21:45.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:45.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187473+0000", 2024-09-17T02:21:45.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-09-17T02:21:45.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:45.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.192476+0000", 2024-09-17T02:21:45.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050035339999999996 2024-09-17T02:21:45.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:45.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.192603+0000", 2024-09-17T02:21:45.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012652299999999999 2024-09-17T02:21:45.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:45.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.192719+0000", 2024-09-17T02:21:45.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011568700000000001 2024-09-17T02:21:45.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:45.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.196336+0000", 2024-09-17T02:21:45.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003617178 2024-09-17T02:21:45.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:45.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.212470+0000", 2024-09-17T02:21:45.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016134402999999999 2024-09-17T02:21:45.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:45.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.212522+0000", 2024-09-17T02:21:45.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1480000000000002e-05 2024-09-17T02:21:45.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:45.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:45.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:45.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.212725+0000", 2024-09-17T02:21:45.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020359100000000001 2024-09-17T02:21:45.950 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.950 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.950 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.950 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:45.950 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:45.951 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:45.952 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:45.957+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:45.952 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:45.953 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:21:46.052 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:46.053+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:46.106 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:46.106 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:46.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.106 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:151072 5.b 5:d57a1aba:::benchmark_data_smithi001_23533_object22955:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:46.106 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:46.108112+0000", 2024-09-17T02:21:46.106 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0027653, 2024-09-17T02:21:46.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027824590000000001, 2024-09-17T02:21:46.106 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:46.106 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:46.106 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:46.106 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:46.107 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:46.107 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:46.107 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 151072 2024-09-17T02:21:46.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.107 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:46.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:46.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.108112+0000", 2024-09-17T02:21:46.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:46.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:46.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.108112+0000", 2024-09-17T02:21:46.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:46.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:46.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.108113+0000", 2024-09-17T02:21:46.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0160000000000001e-06 2024-09-17T02:21:46.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:46.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.108117+0000", 2024-09-17T02:21:46.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9199999999999997e-06 2024-09-17T02:21:46.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:46.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.108127+0000", 2024-09-17T02:21:46.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0866000000000001e-05 2024-09-17T02:21:46.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:46.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.108146+0000", 2024-09-17T02:21:46.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8431999999999999e-05 2024-09-17T02:21:46.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:46.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.108205+0000", 2024-09-17T02:21:46.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9351000000000001e-05 2024-09-17T02:21:46.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:46.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.108313+0000", 2024-09-17T02:21:46.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107519 2024-09-17T02:21:46.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:46.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.108385+0000", 2024-09-17T02:21:46.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2256999999999996e-05 2024-09-17T02:21:46.110 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:46.111 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:46.111 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:46.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.111 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:151059 5.a e56/22 5:50cbaaf2:::benchmark_data_smithi001_23533_object22942:head v 56'9575, mlcod=56'9572)", 2024-09-17T02:21:46.111 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:46.108980+0000", 2024-09-17T02:21:46.111 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0018970090000000001, 2024-09-17T02:21:46.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019602450000000002, 2024-09-17T02:21:46.111 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:46.111 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:46.111 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:46.111 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:46.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:46.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.108980+0000", 2024-09-17T02:21:46.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:46.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:46.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.108980+0000", 2024-09-17T02:21:46.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:46.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:46.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.108981+0000", 2024-09-17T02:21:46.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6000000000000003e-07 2024-09-17T02:21:46.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:46.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.108986+0000", 2024-09-17T02:21:46.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6219999999999997e-06 2024-09-17T02:21:46.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:46.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.108999+0000", 2024-09-17T02:21:46.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2345e-05 2024-09-17T02:21:46.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:46.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.109006+0000", 2024-09-17T02:21:46.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0400000000000004e-06 2024-09-17T02:21:46.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:46.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.109058+0000", 2024-09-17T02:21:46.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2933000000000003e-05 2024-09-17T02:21:46.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:46.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.109079+0000", 2024-09-17T02:21:46.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0108000000000001e-05 2024-09-17T02:21:46.115 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:46.115 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:46.115 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:46.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.115 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:151076 5.b 5:dd19c745:::benchmark_data_smithi001_23533_object22959:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:46.116 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:46.109648+0000", 2024-09-17T02:21:46.116 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.001228963, 2024-09-17T02:21:46.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001331867, 2024-09-17T02:21:46.116 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:46.116 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:46.116 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:46.116 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:46.116 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:46.116 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:46.116 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 151076 2024-09-17T02:21:46.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.116 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:46.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:46.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.109648+0000", 2024-09-17T02:21:46.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:46.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:46.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.109648+0000", 2024-09-17T02:21:46.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:46.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:46.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.109649+0000", 2024-09-17T02:21:46.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8100000000000002e-07 2024-09-17T02:21:46.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:46.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.109652+0000", 2024-09-17T02:21:46.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7519999999999998e-06 2024-09-17T02:21:46.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:46.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.109664+0000", 2024-09-17T02:21:46.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1056000000000001e-05 2024-09-17T02:21:46.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:46.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.109671+0000", 2024-09-17T02:21:46.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2579999999999998e-06 2024-09-17T02:21:46.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:46.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.109775+0000", 2024-09-17T02:21:46.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000103954 2024-09-17T02:21:46.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:46.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.109908+0000", 2024-09-17T02:21:46.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013324800000000001 2024-09-17T02:21:46.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:46.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.110043+0000", 2024-09-17T02:21:46.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013547 2024-09-17T02:21:46.121 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:46.121 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:46.121 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:46.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.121 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:151068 5.b e56/51)", 2024-09-17T02:21:46.121 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:46.110082+0000", 2024-09-17T02:21:46.121 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00079479300000000002, 2024-09-17T02:21:46.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00094635100000000001, 2024-09-17T02:21:46.121 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:46.121 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:46.121 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:46.122 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:46.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:46.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.110082+0000", 2024-09-17T02:21:46.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:46.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:46.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.110082+0000", 2024-09-17T02:21:46.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:46.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:46.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.110083+0000", 2024-09-17T02:21:46.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0200000000000001e-07 2024-09-17T02:21:46.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:46.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.110087+0000", 2024-09-17T02:21:46.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9910000000000004e-06 2024-09-17T02:21:46.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:46.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.110098+0000", 2024-09-17T02:21:46.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1541e-05 2024-09-17T02:21:46.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:46.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.110107+0000", 2024-09-17T02:21:46.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4600000000000003e-06 2024-09-17T02:21:46.124 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:46.124 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:46.124 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:46.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.124 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.1 e 56/56 lb 5:8a4e479f:::benchmark_data_smithi001_23533_object105023:head)", 2024-09-17T02:21:46.124 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:46.110625+0000", 2024-09-17T02:21:46.124 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.000251418, 2024-09-17T02:21:46.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045710899999999998, 2024-09-17T02:21:46.125 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:46.125 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:46.125 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:46.125 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:46.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:46.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.110625+0000", 2024-09-17T02:21:46.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:46.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:46.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.110625+0000", 2024-09-17T02:21:46.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:46.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:46.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.110626+0000", 2024-09-17T02:21:46.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5900000000000003e-07 2024-09-17T02:21:46.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:46.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.110636+0000", 2024-09-17T02:21:46.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0039e-05 2024-09-17T02:21:46.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:46.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.110645+0000", 2024-09-17T02:21:46.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.217e-06 2024-09-17T02:21:46.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:46.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.110652+0000", 2024-09-17T02:21:46.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4339999999999997e-06 2024-09-17T02:21:46.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:46.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.111047+0000", 2024-09-17T02:21:46.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00039537600000000002 2024-09-17T02:21:46.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:46.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.111062+0000", 2024-09-17T02:21:46.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5367999999999999e-05 2024-09-17T02:21:46.128 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:46.128 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:46.128 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:46.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.129 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:151068 5.b 5:d84bf7b6:::benchmark_data_smithi001_23533_object22951:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:46.129 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:46.105990+0000", 2024-09-17T02:21:46.129 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0048873090000000003, 2024-09-17T02:21:46.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051613930000000002, 2024-09-17T02:21:46.129 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:46.129 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:46.129 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:46.129 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:46.129 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:46.129 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:46.129 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 151068 2024-09-17T02:21:46.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.130 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:46.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:46.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.105990+0000", 2024-09-17T02:21:46.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:46.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:46.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.105990+0000", 2024-09-17T02:21:46.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:46.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:46.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.105990+0000", 2024-09-17T02:21:46.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5400000000000001e-07 2024-09-17T02:21:46.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:46.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.105997+0000", 2024-09-17T02:21:46.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4239999999999998e-06 2024-09-17T02:21:46.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:46.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.106006+0000", 2024-09-17T02:21:46.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3500000000000003e-06 2024-09-17T02:21:46.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:46.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.106012+0000", 2024-09-17T02:21:46.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3810000000000004e-06 2024-09-17T02:21:46.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:46.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.106060+0000", 2024-09-17T02:21:46.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.791e-05 2024-09-17T02:21:46.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:46.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.106136+0000", 2024-09-17T02:21:46.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5669999999999999e-05 2024-09-17T02:21:46.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:46.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.106201+0000", 2024-09-17T02:21:46.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4999999999999994e-05 2024-09-17T02:21:46.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:46.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:46.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:46.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:46.109749+0000", 2024-09-17T02:21:46.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003547859 2024-09-17T02:21:46.133 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:46.133 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:46.134 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:46.134 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:46.134 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:21:46.134 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 6 2024-09-17T02:21:46.134 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:46.134 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:21:46.135 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:21:46.136 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:21:46.136 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:46.137 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:21:46.137 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:21:46.137 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:21:46.137 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:21:46.153 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:46.153+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:46.254 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:46.257+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:46.290 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:46.290 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:46.310 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:46.396 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:46.401+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:46.455 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:46.457+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:46.504 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:46.505 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:46.523 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:46.567 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:46.573+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:46.657 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:46.657+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:46.676 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:46.676 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:46.696 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:46.758 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:46.761+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:46.858 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:46.857+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:46.896 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:46.896 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:46.915 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:46.963 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:46.965+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:46.966 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T02:21:47.061 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:47.061+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:47.117 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:47.117 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:47.136 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:47.180 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:47.185+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:47.262 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:47.261+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:47.287 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:47.287 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:47.306 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:47.363 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:47.361+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:47.464 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:47.469+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:47.499 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:47.499 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:47.516 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:47.565 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:47.565+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:47.693 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:47.694 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:47.707 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:47.710 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:47.669+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:47.767 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:47.765+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:47.861 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:47.862 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:47.868 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:47.869+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:47.882 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:47.960 INFO:teuthology.orchestra.run.smithi001.stderr:noscrub is unset 2024-09-17T02:21:47.968 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:47.969+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:48.069 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:48.073+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:48.074 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:48.074 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:48.093 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:48.139 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:21:48.179 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:48.181+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:48.271 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:48.273+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:48.289 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:48.289 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:48.296 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:21:48.297 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:21:48.309 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:48.315 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:21:48.315 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:21:48.315 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:21:48.319 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:21:48.319 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:21:48.372 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:48.377+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:48.461 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:48.461 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:48.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.461 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:156199 5.3 e57/51 5:ca99c435:::benchmark_data_smithi001_23533_object28082:head v 57'9859, mlcod=57'9857)", 2024-09-17T02:21:48.461 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:48.466085+0000", 2024-09-17T02:21:48.461 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.000164427, 2024-09-17T02:21:48.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000179736, 2024-09-17T02:21:48.461 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:48.461 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:48.461 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:48.461 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:48.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:48.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:48.466085+0000", 2024-09-17T02:21:48.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:48.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:48.466085+0000", 2024-09-17T02:21:48.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:48.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:48.466085+0000", 2024-09-17T02:21:48.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7800000000000002e-07 2024-09-17T02:21:48.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:48.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:48.466089+0000", 2024-09-17T02:21:48.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.614e-06 2024-09-17T02:21:48.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:48.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:48.466097+0000", 2024-09-17T02:21:48.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3340000000000002e-06 2024-09-17T02:21:48.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:48.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:48.466104+0000", 2024-09-17T02:21:48.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.421e-06 2024-09-17T02:21:48.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:48.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:48.466137+0000", 2024-09-17T02:21:48.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3278999999999998e-05 2024-09-17T02:21:48.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:48.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:48.466149+0000", 2024-09-17T02:21:48.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1773999999999999e-05 2024-09-17T02:21:48.464 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.464 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:48.464 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.465 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.465 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:21:48.465 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 1 2024-09-17T02:21:48.465 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:48.473 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:48.473+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:48.479 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:48.574 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:48.577+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:48.602 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-09-17T02:21:48.602 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2024-09-17T02:21:48.602 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi164.front.sepia.ceph.com 2024-09-17T02:21:48.602 INFO:teuthology.orchestra.console.smithi164:Power on 2024-09-17T02:21:48.602 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-09-17T02:21:48.628 DEBUG:teuthology.orchestra.console.smithi164:power on output: Chassis Power Control: Up/On 2024-09-17T02:21:48.676 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:48.676 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:21:48.676 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:21:48.676 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:21:48.676 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:48.676 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:48.677+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:48.693 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:48.777 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:48.777+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:48.877 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:48.880+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:48.897 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:48.897 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:21:48.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:21:48.897 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:48.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.897 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97749 5.b 5:d930ef52:::benchmark_data_smithi001_23533_object97748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:48.897 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:48.898 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.307842922999999, 2024-09-17T02:21:48.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092964343000000005, 2024-09-17T02:21:48.898 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:48.898 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:48.898 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:48.898 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:48.898 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:48.898 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:48.898 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97749 2024-09-17T02:21:48.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.898 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:48.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:48.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:48.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:48.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:48.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:48.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591947+0000", 2024-09-17T02:21:48.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:21:48.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:48.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592011+0000", 2024-09-17T02:21:48.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3608000000000005e-05 2024-09-17T02:21:48.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:48.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592021+0000", 2024-09-17T02:21:48.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9979999999999998e-06 2024-09-17T02:21:48.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:48.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592028+0000", 2024-09-17T02:21:48.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1439999999999997e-06 2024-09-17T02:21:48.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:48.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593633+0000", 2024-09-17T02:21:48.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001604636 2024-09-17T02:21:48.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:48.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593757+0000", 2024-09-17T02:21:48.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012432099999999999 2024-09-17T02:21:48.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:48.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593866+0000", 2024-09-17T02:21:48.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109094 2024-09-17T02:21:48.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:48.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601190+0000", 2024-09-17T02:21:48.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073237620000000002 2024-09-17T02:21:48.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:48.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601356+0000", 2024-09-17T02:21:48.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016651900000000001 2024-09-17T02:21:48.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:48.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684618+0000", 2024-09-17T02:21:48.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083261356999999994 2024-09-17T02:21:48.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:48.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684724+0000", 2024-09-17T02:21:48.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010681800000000001 2024-09-17T02:21:48.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:48.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684911+0000", 2024-09-17T02:21:48.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186243 2024-09-17T02:21:48.904 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.904 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:48.904 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.904 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97752 5.b 5:d146f486:::benchmark_data_smithi001_23533_object97751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:48.904 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:48.905 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.306490229000001, 2024-09-17T02:21:48.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091989557, 2024-09-17T02:21:48.905 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:48.905 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:48.905 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:48.905 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:48.905 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:48.905 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:48.905 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97752 2024-09-17T02:21:48.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.905 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:48.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:48.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:48.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:48.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:48.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:48.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593300+0000", 2024-09-17T02:21:48.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8199999999999998e-07 2024-09-17T02:21:48.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:48.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593364+0000", 2024-09-17T02:21:48.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3831999999999995e-05 2024-09-17T02:21:48.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:48.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593376+0000", 2024-09-17T02:21:48.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1800999999999999e-05 2024-09-17T02:21:48.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:48.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593382+0000", 2024-09-17T02:21:48.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6780000000000003e-06 2024-09-17T02:21:48.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:48.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595491+0000", 2024-09-17T02:21:48.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021090689999999999 2024-09-17T02:21:48.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:48.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595614+0000", 2024-09-17T02:21:48.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012321500000000001 2024-09-17T02:21:48.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:48.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595778+0000", 2024-09-17T02:21:48.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016321900000000001 2024-09-17T02:21:48.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:48.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601197+0000", 2024-09-17T02:21:48.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054195600000000003 2024-09-17T02:21:48.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:48.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601396+0000", 2024-09-17T02:21:48.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019825299999999999 2024-09-17T02:21:48.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:48.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684990+0000", 2024-09-17T02:21:48.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083594878999999997 2024-09-17T02:21:48.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:48.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685116+0000", 2024-09-17T02:21:48.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012522799999999999 2024-09-17T02:21:48.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:48.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685289+0000", 2024-09-17T02:21:48.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172941 2024-09-17T02:21:48.911 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.911 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:48.911 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.911 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97754 5.b 5:da0615e5:::benchmark_data_smithi001_23533_object97753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:48.911 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:48.911 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.304852307000001, 2024-09-17T02:21:48.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092097207, 2024-09-17T02:21:48.911 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:48.911 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:48.911 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:48.912 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:48.912 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:48.912 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:48.912 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97754 2024-09-17T02:21:48.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.912 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:48.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:48.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:48.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:48.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:48.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:48.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594938+0000", 2024-09-17T02:21:48.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5000000000000002e-07 2024-09-17T02:21:48.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:48.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595075+0000", 2024-09-17T02:21:48.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137742 2024-09-17T02:21:48.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:48.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595087+0000", 2024-09-17T02:21:48.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1243000000000001e-05 2024-09-17T02:21:48.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:48.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595095+0000", 2024-09-17T02:21:48.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1030000000000002e-06 2024-09-17T02:21:48.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:48.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598461+0000", 2024-09-17T02:21:48.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033661170000000001 2024-09-17T02:21:48.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:48.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598540+0000", 2024-09-17T02:21:48.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8937999999999995e-05 2024-09-17T02:21:48.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:48.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598626+0000", 2024-09-17T02:21:48.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6042000000000001e-05 2024-09-17T02:21:48.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:48.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684258+0000", 2024-09-17T02:21:48.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085632394000000001 2024-09-17T02:21:48.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:48.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685369+0000", 2024-09-17T02:21:48.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001111063 2024-09-17T02:21:48.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:48.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685511+0000", 2024-09-17T02:21:48.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141965 2024-09-17T02:21:48.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:48.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685604+0000", 2024-09-17T02:21:48.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2935000000000004e-05 2024-09-17T02:21:48.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:48.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687034+0000", 2024-09-17T02:21:48.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001430015 2024-09-17T02:21:48.917 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.917 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:48.917 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.917 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97755 5.b 5:d36a03a1:::benchmark_data_smithi001_23533_object97754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:48.918 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:48.918 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.304679156999999, 2024-09-17T02:21:48.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0924904, 2024-09-17T02:21:48.918 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:48.918 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:48.918 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:48.918 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:48.918 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:48.918 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:48.918 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97755 2024-09-17T02:21:48.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.918 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:48.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:48.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:48.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:48.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:48.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:48.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595111+0000", 2024-09-17T02:21:48.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:21:48.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:48.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595145+0000", 2024-09-17T02:21:48.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3927000000000002e-05 2024-09-17T02:21:48.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:48.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595155+0000", 2024-09-17T02:21:48.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0023e-05 2024-09-17T02:21:48.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:48.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595162+0000", 2024-09-17T02:21:48.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3950000000000003e-06 2024-09-17T02:21:48.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:48.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599821+0000", 2024-09-17T02:21:48.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046592880000000001 2024-09-17T02:21:48.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:48.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599912+0000", 2024-09-17T02:21:48.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1049000000000002e-05 2024-09-17T02:21:48.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:48.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600062+0000", 2024-09-17T02:21:48.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015001700000000001 2024-09-17T02:21:48.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:48.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685307+0000", 2024-09-17T02:21:48.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085244340000000002 2024-09-17T02:21:48.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:48.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685446+0000", 2024-09-17T02:21:48.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013955700000000001 2024-09-17T02:21:48.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:48.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687375+0000", 2024-09-17T02:21:48.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019291079999999999 2024-09-17T02:21:48.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:48.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687462+0000", 2024-09-17T02:21:48.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6148000000000003e-05 2024-09-17T02:21:48.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:48.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687600+0000", 2024-09-17T02:21:48.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013887900000000001 2024-09-17T02:21:48.924 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.924 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:48.924 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.924 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 44/44 lb 5:c4567a04:::benchmark_data_smithi001_23533_object4200:head)", 2024-09-17T02:21:48.924 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:48.924 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.302582530999999, 2024-09-17T02:21:48.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092483421999999996, 2024-09-17T02:21:48.924 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:48.924 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:48.925 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:48.925 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:48.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:48.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:48.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:48.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:48.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:48.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:48.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6399999999999998e-07 2024-09-17T02:21:48.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:48.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597213+0000", 2024-09-17T02:21:48.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3659999999999997e-06 2024-09-17T02:21:48.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:48.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597222+0000", 2024-09-17T02:21:48.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0510000000000002e-06 2024-09-17T02:21:48.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:48.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597228+0000", 2024-09-17T02:21:48.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1569999999999999e-06 2024-09-17T02:21:48.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:48.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689588+0000", 2024-09-17T02:21:48.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092359931000000006 2024-09-17T02:21:48.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:48.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689622+0000", 2024-09-17T02:21:48.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4425999999999999e-05 2024-09-17T02:21:48.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:48.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689690+0000", 2024-09-17T02:21:48.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8126999999999993e-05 2024-09-17T02:21:48.928 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.929 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:48.929 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.929 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129462 5.4 5:2e0acc16:::benchmark_data_smithi001_23533_object1345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:48.929 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:21:48.929 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.364848461999999, 2024-09-17T02:21:48.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0112774899999999, 2024-09-17T02:21:48.929 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:48.929 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:48.930 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:48.930 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:48.930 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:48.930 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:48.930 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129462 2024-09-17T02:21:48.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.930 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:48.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:48.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:21:48.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:48.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:21:48.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:48.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534943+0000", 2024-09-17T02:21:48.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8759999999999999e-06 2024-09-17T02:21:48.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:48.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534951+0000", 2024-09-17T02:21:48.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3219999999999993e-06 2024-09-17T02:21:48.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:48.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534977+0000", 2024-09-17T02:21:48.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6245e-05 2024-09-17T02:21:48.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:48.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534992+0000", 2024-09-17T02:21:48.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4936000000000001e-05 2024-09-17T02:21:48.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:48.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535133+0000", 2024-09-17T02:21:48.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014051299999999999 2024-09-17T02:21:48.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:48.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:21:48.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1741000000000001e-05 2024-09-17T02:21:48.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:48.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.533906+0000", 2024-09-17T02:21:48.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99875209300000001 2024-09-17T02:21:48.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:48.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534348+0000", 2024-09-17T02:21:48.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044128899999999998 2024-09-17T02:21:48.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:48.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534762+0000", 2024-09-17T02:21:48.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000414707 2024-09-17T02:21:48.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:48.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545024+0000", 2024-09-17T02:21:48.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010261283 2024-09-17T02:21:48.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:48.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545953+0000", 2024-09-17T02:21:48.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000929618 2024-09-17T02:21:48.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:48.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546047+0000", 2024-09-17T02:21:48.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3697999999999996e-05 2024-09-17T02:21:48.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:48.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546218+0000", 2024-09-17T02:21:48.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017116899999999999 2024-09-17T02:21:48.936 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.936 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:48.936 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.936 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129480 5.4 5:2b1d398b:::benchmark_data_smithi001_23533_object1363:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:48.936 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:21:48.936 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.357093996, 2024-09-17T02:21:48.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0038926450000001, 2024-09-17T02:21:48.936 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:48.936 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:48.936 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:48.937 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:48.937 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:48.937 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:48.937 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129480 2024-09-17T02:21:48.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.937 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:48.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:48.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:21:48.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:48.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:21:48.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:48.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542696+0000", 2024-09-17T02:21:48.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9999999999999995e-07 2024-09-17T02:21:48.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:48.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542701+0000", 2024-09-17T02:21:48.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2240000000000003e-06 2024-09-17T02:21:48.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:48.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542716+0000", 2024-09-17T02:21:48.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4970000000000001e-05 2024-09-17T02:21:48.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:48.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542726+0000", 2024-09-17T02:21:48.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2879999999999998e-06 2024-09-17T02:21:48.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:48.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542832+0000", 2024-09-17T02:21:48.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010597199999999999 2024-09-17T02:21:48.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:48.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542843+0000", 2024-09-17T02:21:48.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.098e-05 2024-09-17T02:21:48.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:48.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538436+0000", 2024-09-17T02:21:48.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99559286800000002 2024-09-17T02:21:48.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:48.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538791+0000", 2024-09-17T02:21:48.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035585499999999997 2024-09-17T02:21:48.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:48.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.539144+0000", 2024-09-17T02:21:48.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035268499999999999 2024-09-17T02:21:48.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:48.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545880+0000", 2024-09-17T02:21:48.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00673552 2024-09-17T02:21:48.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:48.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546330+0000", 2024-09-17T02:21:48.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045039599999999999 2024-09-17T02:21:48.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:48.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546414+0000", 2024-09-17T02:21:48.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4468000000000005e-05 2024-09-17T02:21:48.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:48.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546588+0000", 2024-09-17T02:21:48.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017341899999999999 2024-09-17T02:21:48.943 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.943 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:48.943 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.943 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129505 5.4 5:294f2ec7:::benchmark_data_smithi001_23533_object1388:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:48.943 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:21:48.943 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.338080823, 2024-09-17T02:21:48.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98589826199999997, 2024-09-17T02:21:48.943 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:48.943 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:48.943 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:48.943 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:48.944 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:48.944 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:48.944 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129505 2024-09-17T02:21:48.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.944 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:48.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:48.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:21:48.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:48.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:21:48.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:48.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561710+0000", 2024-09-17T02:21:48.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7060000000000001e-06 2024-09-17T02:21:48.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:48.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561718+0000", 2024-09-17T02:21:48.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.542e-06 2024-09-17T02:21:48.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:48.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561741+0000", 2024-09-17T02:21:48.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3357e-05 2024-09-17T02:21:48.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:48.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561754+0000", 2024-09-17T02:21:48.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3200000000000001e-05 2024-09-17T02:21:48.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:48.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561867+0000", 2024-09-17T02:21:48.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113211 2024-09-17T02:21:48.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:48.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561888+0000", 2024-09-17T02:21:48.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0809999999999999e-05 2024-09-17T02:21:48.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:48.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542140+0000", 2024-09-17T02:21:48.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98025195799999998 2024-09-17T02:21:48.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:48.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542331+0000", 2024-09-17T02:21:48.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019127599999999999 2024-09-17T02:21:48.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:48.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542517+0000", 2024-09-17T02:21:48.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000185625 2024-09-17T02:21:48.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:48.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547114+0000", 2024-09-17T02:21:48.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045968620000000002 2024-09-17T02:21:48.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:48.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547187+0000", 2024-09-17T02:21:48.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3348000000000003e-05 2024-09-17T02:21:48.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:48.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547324+0000", 2024-09-17T02:21:48.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013681699999999999 2024-09-17T02:21:48.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:48.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547607+0000", 2024-09-17T02:21:48.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028255000000000001 2024-09-17T02:21:48.950 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.950 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:48.950 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.950 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129508 5.4 5:2892b582:::benchmark_data_smithi001_23533_object1391:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:48.950 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:21:48.950 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.33674373, 2024-09-17T02:21:48.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99697919099999999, 2024-09-17T02:21:48.950 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:48.950 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:48.950 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:48.951 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:48.951 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:48.951 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:48.951 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129508 2024-09-17T02:21:48.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.951 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:48.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:48.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:21:48.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:48.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:21:48.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:48.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563047+0000", 2024-09-17T02:21:48.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.274e-06 2024-09-17T02:21:48.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:48.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563054+0000", 2024-09-17T02:21:48.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2799999999999998e-06 2024-09-17T02:21:48.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:48.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563070+0000", 2024-09-17T02:21:48.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5991999999999999e-05 2024-09-17T02:21:48.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:48.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563078+0000", 2024-09-17T02:21:48.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2390000000000002e-06 2024-09-17T02:21:48.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:48.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563181+0000", 2024-09-17T02:21:48.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102249 2024-09-17T02:21:48.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:48.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563199+0000", 2024-09-17T02:21:48.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8215000000000001e-05 2024-09-17T02:21:48.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:48.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547713+0000", 2024-09-17T02:21:48.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98451446399999998 2024-09-17T02:21:48.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:48.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548063+0000", 2024-09-17T02:21:48.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034985499999999999 2024-09-17T02:21:48.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:48.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548490+0000", 2024-09-17T02:21:48.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042658600000000001 2024-09-17T02:21:48.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:48.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555655+0000", 2024-09-17T02:21:48.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071652579999999999 2024-09-17T02:21:48.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:48.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559612+0000", 2024-09-17T02:21:48.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003957103 2024-09-17T02:21:48.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:48.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559768+0000", 2024-09-17T02:21:48.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015556899999999999 2024-09-17T02:21:48.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:48.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560025+0000", 2024-09-17T02:21:48.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025710700000000002 2024-09-17T02:21:48.957 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.957 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:48.957 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.957 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129509 5.4 5:2c35515e:::benchmark_data_smithi001_23533_object1392:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:48.957 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:21:48.957 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.336116677, 2024-09-17T02:21:48.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99969384900000002, 2024-09-17T02:21:48.957 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:48.957 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:48.958 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:48.958 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:48.958 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:48.958 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:48.958 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129509 2024-09-17T02:21:48.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.958 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:48.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:48.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:21:48.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:48.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:21:48.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:48.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563674+0000", 2024-09-17T02:21:48.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0920000000000001e-06 2024-09-17T02:21:48.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:48.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563679+0000", 2024-09-17T02:21:48.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7660000000000004e-06 2024-09-17T02:21:48.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:48.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563693+0000", 2024-09-17T02:21:48.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3139000000000001e-05 2024-09-17T02:21:48.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:48.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563701+0000", 2024-09-17T02:21:48.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9859999999999994e-06 2024-09-17T02:21:48.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:48.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563775+0000", 2024-09-17T02:21:48.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4659000000000005e-05 2024-09-17T02:21:48.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:48.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563785+0000", 2024-09-17T02:21:48.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4839999999999993e-06 2024-09-17T02:21:48.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:48.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552085+0000", 2024-09-17T02:21:48.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98829986999999997 2024-09-17T02:21:48.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:48.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552554+0000", 2024-09-17T02:21:48.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046908900000000001 2024-09-17T02:21:48.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:48.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552931+0000", 2024-09-17T02:21:48.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377778 2024-09-17T02:21:48.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:48.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563106+0000", 2024-09-17T02:21:48.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010174186 2024-09-17T02:21:48.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:48.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563138+0000", 2024-09-17T02:21:48.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2495e-05 2024-09-17T02:21:48.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:48.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563225+0000", 2024-09-17T02:21:48.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6677999999999999e-05 2024-09-17T02:21:48.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:48.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563366+0000", 2024-09-17T02:21:48.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014162699999999999 2024-09-17T02:21:48.964 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.964 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:48.964 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.964 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129524 5.4 5:25dca7dd:::benchmark_data_smithi001_23533_object1407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:48.964 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:21:48.964 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.329425323000001, 2024-09-17T02:21:48.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99999501999999996, 2024-09-17T02:21:48.964 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:48.964 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:48.964 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:48.965 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:48.965 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:48.965 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:48.965 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129524 2024-09-17T02:21:48.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.965 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:48.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:48.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:21:48.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:48.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:21:48.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:48.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570365+0000", 2024-09-17T02:21:48.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.142e-06 2024-09-17T02:21:48.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:48.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570369+0000", 2024-09-17T02:21:48.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.856e-06 2024-09-17T02:21:48.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:48.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570385+0000", 2024-09-17T02:21:48.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5855e-05 2024-09-17T02:21:48.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:48.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570392+0000", 2024-09-17T02:21:48.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5340000000000002e-06 2024-09-17T02:21:48.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:48.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570484+0000", 2024-09-17T02:21:48.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1212999999999996e-05 2024-09-17T02:21:48.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:48.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570498+0000", 2024-09-17T02:21:48.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4331000000000001e-05 2024-09-17T02:21:48.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:48.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555835+0000", 2024-09-17T02:21:48.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98533757700000002 2024-09-17T02:21:48.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:48.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556329+0000", 2024-09-17T02:21:48.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000493458 2024-09-17T02:21:48.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:48.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556784+0000", 2024-09-17T02:21:48.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045476499999999999 2024-09-17T02:21:48.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:48.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569852+0000", 2024-09-17T02:21:48.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013068270999999999 2024-09-17T02:21:48.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:48.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569958+0000", 2024-09-17T02:21:48.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106214 2024-09-17T02:21:48.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:48.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570124+0000", 2024-09-17T02:21:48.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165546 2024-09-17T02:21:48.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:48.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570359+0000", 2024-09-17T02:21:48.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023525799999999999 2024-09-17T02:21:48.970 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.970 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:48.970 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.971 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129537 5.4 5:260327c6:::benchmark_data_smithi001_23533_object1420:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:48.971 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:21:48.971 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.321518793999999, 2024-09-17T02:21:48.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99624596499999996, 2024-09-17T02:21:48.971 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:48.971 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:48.971 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:48.971 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:48.971 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:48.971 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:48.971 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129537 2024-09-17T02:21:48.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.972 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:48.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:48.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:21:48.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:48.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:21:48.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:48.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578272+0000", 2024-09-17T02:21:48.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.164e-06 2024-09-17T02:21:48.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:48.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578278+0000", 2024-09-17T02:21:48.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5060000000000001e-06 2024-09-17T02:21:48.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:48.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578294+0000", 2024-09-17T02:21:48.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5687000000000001e-05 2024-09-17T02:21:48.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:48.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578329+0000", 2024-09-17T02:21:48.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5311999999999997e-05 2024-09-17T02:21:48.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:48.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578419+0000", 2024-09-17T02:21:48.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0054000000000002e-05 2024-09-17T02:21:48.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578435+0000", 2024-09-17T02:21:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5645999999999999e-05 2024-09-17T02:21:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560148+0000", 2024-09-17T02:21:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98171342299999997 2024-09-17T02:21:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560383+0000", 2024-09-17T02:21:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000234935 2024-09-17T02:21:48.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:48.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560586+0000", 2024-09-17T02:21:48.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000202909 2024-09-17T02:21:48.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:48.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570472+0000", 2024-09-17T02:21:48.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098856959999999994 2024-09-17T02:21:48.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:48.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574138+0000", 2024-09-17T02:21:48.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036660170000000001 2024-09-17T02:21:48.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:48.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574298+0000", 2024-09-17T02:21:48.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016025600000000001 2024-09-17T02:21:48.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:48.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574516+0000", 2024-09-17T02:21:48.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021835999999999999 2024-09-17T02:21:48.977 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.978 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:48.978 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.978 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129545 5.4 5:22366489:::benchmark_data_smithi001_23533_object1428:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:48.978 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:21:48.978 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.315656070999999, 2024-09-17T02:21:48.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99074544499999995, 2024-09-17T02:21:48.978 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:48.978 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:48.978 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:48.978 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:48.978 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:48.978 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129545 2024-09-17T02:21:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:21:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:21:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:48.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584135+0000", 2024-09-17T02:21:48.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4699999999999999e-06 2024-09-17T02:21:48.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:48.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584142+0000", 2024-09-17T02:21:48.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1620000000000002e-06 2024-09-17T02:21:48.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:48.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584170+0000", 2024-09-17T02:21:48.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7897000000000001e-05 2024-09-17T02:21:48.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:48.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584183+0000", 2024-09-17T02:21:48.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2814e-05 2024-09-17T02:21:48.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:48.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584299+0000", 2024-09-17T02:21:48.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116153 2024-09-17T02:21:48.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584316+0000", 2024-09-17T02:21:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7524999999999999e-05 2024-09-17T02:21:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563461+0000", 2024-09-17T02:21:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97914436699999996 2024-09-17T02:21:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563667+0000", 2024-09-17T02:21:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020689800000000001 2024-09-17T02:21:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563878+0000", 2024-09-17T02:21:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210275 2024-09-17T02:21:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570584+0000", 2024-09-17T02:21:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067066080000000002 2024-09-17T02:21:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574539+0000", 2024-09-17T02:21:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039550360000000003 2024-09-17T02:21:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:48.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574653+0000", 2024-09-17T02:21:48.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114003 2024-09-17T02:21:48.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:48.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574879+0000", 2024-09-17T02:21:48.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022523700000000001 2024-09-17T02:21:48.984 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.984 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:48.984 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.985 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129553 5.4 5:2e41ad40:::benchmark_data_smithi001_23533_object1436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:48.985 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:21:48.985 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.310233435000001, 2024-09-17T02:21:48.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99213429600000003, 2024-09-17T02:21:48.985 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:48.985 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:48.985 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:48.985 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:48.985 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:48.985 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:48.985 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129553 2024-09-17T02:21:48.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.985 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:48.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:48.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:21:48.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:48.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:21:48.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:48.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589557+0000", 2024-09-17T02:21:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2219999999999999e-06 2024-09-17T02:21:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589562+0000", 2024-09-17T02:21:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0649999999999998e-06 2024-09-17T02:21:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589575+0000", 2024-09-17T02:21:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3129000000000001e-05 2024-09-17T02:21:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:48.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589584+0000", 2024-09-17T02:21:48.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6200000000000005e-06 2024-09-17T02:21:48.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:48.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589693+0000", 2024-09-17T02:21:48.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109319 2024-09-17T02:21:48.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:48.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589714+0000", 2024-09-17T02:21:48.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0849999999999999e-05 2024-09-17T02:21:48.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:48.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566273+0000", 2024-09-17T02:21:48.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97655884999999998 2024-09-17T02:21:48.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:48.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566543+0000", 2024-09-17T02:21:48.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027059099999999998 2024-09-17T02:21:48.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566832+0000", 2024-09-17T02:21:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028898200000000002 2024-09-17T02:21:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581040+0000", 2024-09-17T02:21:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014208001 2024-09-17T02:21:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581200+0000", 2024-09-17T02:21:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159956 2024-09-17T02:21:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581427+0000", 2024-09-17T02:21:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000226309 2024-09-17T02:21:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581690+0000", 2024-09-17T02:21:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026340199999999998 2024-09-17T02:21:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.992 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129580 5.4 5:25ed887b:::benchmark_data_smithi001_23533_object1463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:48.992 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:21:48.992 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.288461391, 2024-09-17T02:21:48.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98001430499999997, 2024-09-17T02:21:48.992 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:48.992 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:48.992 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:48.992 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:48.992 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:48.992 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:48.992 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129580 2024-09-17T02:21:48.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.993 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:48.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:48.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:21:48.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:48.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:21:48.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:48.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:48.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611329+0000", 2024-09-17T02:21:48.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.22e-06 2024-09-17T02:21:48.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:48.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611335+0000", 2024-09-17T02:21:48.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1129999999999997e-06 2024-09-17T02:21:48.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:48.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611348+0000", 2024-09-17T02:21:48.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2342e-05 2024-09-17T02:21:48.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:48.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611356+0000", 2024-09-17T02:21:48.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.371e-06 2024-09-17T02:21:48.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:48.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611419+0000", 2024-09-17T02:21:48.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3393999999999996e-05 2024-09-17T02:21:48.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:48.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611427+0000", 2024-09-17T02:21:48.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999997e-06 2024-09-17T02:21:48.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:48.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570705+0000", 2024-09-17T02:21:48.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.95927859199999999 2024-09-17T02:21:48.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:48.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571009+0000", 2024-09-17T02:21:48.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030414599999999998 2024-09-17T02:21:48.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:48.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571241+0000", 2024-09-17T02:21:48.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023106799999999999 2024-09-17T02:21:48.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:48.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590789+0000", 2024-09-17T02:21:48.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019548763 2024-09-17T02:21:48.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:48.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590928+0000", 2024-09-17T02:21:48.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000139092 2024-09-17T02:21:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591086+0000", 2024-09-17T02:21:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015787400000000001 2024-09-17T02:21:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591342+0000", 2024-09-17T02:21:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025589900000000002 2024-09-17T02:21:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:48.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:48.999 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129603 5.4 5:25aaa5e8:::benchmark_data_smithi001_23533_object1486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:48.999 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:48.999 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.272401595, 2024-09-17T02:21:48.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96463198999999999, 2024-09-17T02:21:48.999 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:48.999 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:48.999 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:48.999 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:48.999 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:48.999 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:48.999 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129603 2024-09-17T02:21:48.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.000 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:49.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:49.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:49.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:49.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:49.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:49.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:49.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:21:49.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:49.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627392+0000", 2024-09-17T02:21:49.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0790000000000002e-06 2024-09-17T02:21:49.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:49.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627403+0000", 2024-09-17T02:21:49.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0866000000000001e-05 2024-09-17T02:21:49.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627409+0000", 2024-09-17T02:21:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.305e-06 2024-09-17T02:21:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627485+0000", 2024-09-17T02:21:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6582000000000006e-05 2024-09-17T02:21:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627499+0000", 2024-09-17T02:21:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:21:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:49.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574991+0000", 2024-09-17T02:21:49.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94749182300000001 2024-09-17T02:21:49.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:49.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575377+0000", 2024-09-17T02:21:49.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038629400000000003 2024-09-17T02:21:49.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:49.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575665+0000", 2024-09-17T02:21:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028759499999999997 2024-09-17T02:21:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590802+0000", 2024-09-17T02:21:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015136479 2024-09-17T02:21:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591614+0000", 2024-09-17T02:21:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081293100000000003 2024-09-17T02:21:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:49.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591764+0000", 2024-09-17T02:21:49.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014932199999999999 2024-09-17T02:21:49.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:49.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592020+0000", 2024-09-17T02:21:49.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025585099999999997 2024-09-17T02:21:49.005 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.005 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:49.005 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.005 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129607 5.4 5:2f638f1e:::benchmark_data_smithi001_23533_object1490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:21:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.270874688999999, 2024-09-17T02:21:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96352375899999998, 2024-09-17T02:21:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129607 2024-09-17T02:21:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:49.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:21:49.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:49.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:21:49.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:49.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628916+0000", 2024-09-17T02:21:49.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1710000000000001e-06 2024-09-17T02:21:49.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:49.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628920+0000", 2024-09-17T02:21:49.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-17T02:21:49.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:49.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628935+0000", 2024-09-17T02:21:49.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4474000000000001e-05 2024-09-17T02:21:49.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628944+0000", 2024-09-17T02:21:49.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9940000000000006e-06 2024-09-17T02:21:49.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:49.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628997+0000", 2024-09-17T02:21:49.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3579000000000003e-05 2024-09-17T02:21:49.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:49.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.629006+0000", 2024-09-17T02:21:49.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4009999999999997e-06 2024-09-17T02:21:49.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:49.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.577862+0000", 2024-09-17T02:21:49.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.948856335 2024-09-17T02:21:49.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:49.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578167+0000", 2024-09-17T02:21:49.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030532399999999999 2024-09-17T02:21:49.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:49.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578532+0000", 2024-09-17T02:21:49.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036428200000000001 2024-09-17T02:21:49.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:49.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591442+0000", 2024-09-17T02:21:49.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012910374000000001 2024-09-17T02:21:49.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:49.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592164+0000", 2024-09-17T02:21:49.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072242499999999996 2024-09-17T02:21:49.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:49.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592267+0000", 2024-09-17T02:21:49.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102205 2024-09-17T02:21:49.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:49.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592438+0000", 2024-09-17T02:21:49.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017165299999999999 2024-09-17T02:21:49.013 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.013 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:49.013 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.013 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129623 5.4 5:2cf5174b:::benchmark_data_smithi001_23533_object1506:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:49.013 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:21:49.013 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.246930403, 2024-09-17T02:21:49.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94334114499999999, 2024-09-17T02:21:49.013 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:49.013 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:49.014 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:49.014 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:49.014 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:49.014 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.014 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129623 2024-09-17T02:21:49.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.014 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:49.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:49.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:21:49.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:49.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:21:49.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:49.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652860+0000", 2024-09-17T02:21:49.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0330000000000001e-06 2024-09-17T02:21:49.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:49.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652864+0000", 2024-09-17T02:21:49.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.634e-06 2024-09-17T02:21:49.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:49.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652877+0000", 2024-09-17T02:21:49.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2591e-05 2024-09-17T02:21:49.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652883+0000", 2024-09-17T02:21:49.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1460000000000001e-06 2024-09-17T02:21:49.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652943+0000", 2024-09-17T02:21:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9833999999999997e-05 2024-09-17T02:21:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652950+0000", 2024-09-17T02:21:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.401e-06 2024-09-17T02:21:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581800+0000", 2024-09-17T02:21:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.92884935700000004 2024-09-17T02:21:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582122+0000", 2024-09-17T02:21:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032185200000000002 2024-09-17T02:21:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582689+0000", 2024-09-17T02:21:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056750400000000003 2024-09-17T02:21:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591458+0000", 2024-09-17T02:21:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008768685 2024-09-17T02:21:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595856+0000", 2024-09-17T02:21:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043977909999999999 2024-09-17T02:21:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595955+0000", 2024-09-17T02:21:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9166000000000006e-05 2024-09-17T02:21:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596200+0000", 2024-09-17T02:21:49.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024515099999999998 2024-09-17T02:21:49.020 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.020 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:49.020 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.020 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129642 5.4 5:255eb796:::benchmark_data_smithi001_23533_object1525:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:49.020 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:21:49.020 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.215694238999999, 2024-09-17T02:21:49.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.91257397299999998, 2024-09-17T02:21:49.020 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:49.020 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:49.021 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:49.021 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:49.021 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:49.021 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.021 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129642 2024-09-17T02:21:49.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.021 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:49.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:49.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:21:49.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:21:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684096+0000", 2024-09-17T02:21:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659999999999999e-06 2024-09-17T02:21:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684101+0000", 2024-09-17T02:21:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8110000000000002e-06 2024-09-17T02:21:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:49.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684114+0000", 2024-09-17T02:21:49.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2653000000000001e-05 2024-09-17T02:21:49.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684121+0000", 2024-09-17T02:21:49.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5100000000000001e-06 2024-09-17T02:21:49.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:49.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684181+0000", 2024-09-17T02:21:49.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0307999999999999e-05 2024-09-17T02:21:49.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:49.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684194+0000", 2024-09-17T02:21:49.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2916e-05 2024-09-17T02:21:49.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:49.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.587917+0000", 2024-09-17T02:21:49.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.90372220400000003 2024-09-17T02:21:49.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:49.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588215+0000", 2024-09-17T02:21:49.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029845400000000003 2024-09-17T02:21:49.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:49.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588470+0000", 2024-09-17T02:21:49.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025455399999999999 2024-09-17T02:21:49.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:49.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596318+0000", 2024-09-17T02:21:49.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078485589999999997 2024-09-17T02:21:49.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:49.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596354+0000", 2024-09-17T02:21:49.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5976999999999998e-05 2024-09-17T02:21:49.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:49.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596449+0000", 2024-09-17T02:21:49.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4728999999999994e-05 2024-09-17T02:21:49.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:49.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596669+0000", 2024-09-17T02:21:49.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220132 2024-09-17T02:21:49.027 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.027 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:49.027 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.027 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129649 5.4 5:2fe27050:::benchmark_data_smithi001_23533_object1532:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:49.027 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:21:49.028 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.184137496, 2024-09-17T02:21:49.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.88508119100000004, 2024-09-17T02:21:49.028 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:49.028 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:49.028 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:49.028 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:49.028 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:49.028 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.028 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129649 2024-09-17T02:21:49.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.028 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:49.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:49.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:21:49.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:49.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:21:49.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:49.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715653+0000", 2024-09-17T02:21:49.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3519999999999999e-06 2024-09-17T02:21:49.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:49.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715658+0000", 2024-09-17T02:21:49.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3120000000000001e-06 2024-09-17T02:21:49.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:49.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715677+0000", 2024-09-17T02:21:49.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-17T02:21:49.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715687+0000", 2024-09-17T02:21:49.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0146000000000001e-05 2024-09-17T02:21:49.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:49.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715821+0000", 2024-09-17T02:21:49.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013421 2024-09-17T02:21:49.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:49.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715840+0000", 2024-09-17T02:21:49.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8153999999999999e-05 2024-09-17T02:21:49.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:49.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592528+0000", 2024-09-17T02:21:49.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.87668860000000004 2024-09-17T02:21:49.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:49.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592702+0000", 2024-09-17T02:21:49.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017429300000000001 2024-09-17T02:21:49.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:49.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592945+0000", 2024-09-17T02:21:49.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000242048 2024-09-17T02:21:49.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:49.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600234+0000", 2024-09-17T02:21:49.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072897600000000002 2024-09-17T02:21:49.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:49.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600494+0000", 2024-09-17T02:21:49.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000259984 2024-09-17T02:21:49.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:49.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600555+0000", 2024-09-17T02:21:49.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1138999999999999e-05 2024-09-17T02:21:49.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:49.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600733+0000", 2024-09-17T02:21:49.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017753300000000001 2024-09-17T02:21:49.034 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.034 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:49.034 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.034 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.034 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:49.034 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:49.036 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:49.036 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:49.036+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:49.136 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:49.140+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:49.194 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:49.194 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:49.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.194 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:157871 5.0 5:05740d5c:::benchmark_data_smithi001_23533_object29754:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-17T02:21:49.194 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:49.190614+0000", 2024-09-17T02:21:49.194 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0068570580000000001, 2024-09-17T02:21:49.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0068825659999999997, 2024-09-17T02:21:49.194 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.194 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.195 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:49.195 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.195 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.195 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.195 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157871 2024-09-17T02:21:49.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.195 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.190614+0000", 2024-09-17T02:21:49.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.190614+0000", 2024-09-17T02:21:49.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.190615+0000", 2024-09-17T02:21:49.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3e-07 2024-09-17T02:21:49.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.190618+0000", 2024-09-17T02:21:49.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.568e-06 2024-09-17T02:21:49.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.190626+0000", 2024-09-17T02:21:49.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0639999999999994e-06 2024-09-17T02:21:49.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.190633+0000", 2024-09-17T02:21:49.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2489999999999998e-06 2024-09-17T02:21:49.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.191539+0000", 2024-09-17T02:21:49.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00090648599999999997 2024-09-17T02:21:49.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.191644+0000", 2024-09-17T02:21:49.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010493900000000001 2024-09-17T02:21:49.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:49.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.191961+0000", 2024-09-17T02:21:49.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00031722899999999998 2024-09-17T02:21:49.198 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.198 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.198 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.199 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:157873 5.a 5:5edcec57:::benchmark_data_smithi001_23533_object29756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-17T02:21:49.199 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:49.191083+0000", 2024-09-17T02:21:49.199 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0063882310000000003, 2024-09-17T02:21:49.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0065017870000000002, 2024-09-17T02:21:49.199 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.199 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.199 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:49.199 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.199 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.199 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.200 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157873 2024-09-17T02:21:49.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.200 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.191083+0000", 2024-09-17T02:21:49.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.191083+0000", 2024-09-17T02:21:49.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.191084+0000", 2024-09-17T02:21:49.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5799999999999998e-07 2024-09-17T02:21:49.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.191088+0000", 2024-09-17T02:21:49.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9759999999999997e-06 2024-09-17T02:21:49.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.191098+0000", 2024-09-17T02:21:49.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7799999999999995e-06 2024-09-17T02:21:49.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.191104+0000", 2024-09-17T02:21:49.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6599999999999998e-06 2024-09-17T02:21:49.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.191174+0000", 2024-09-17T02:21:49.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0216999999999995e-05 2024-09-17T02:21:49.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.191292+0000", 2024-09-17T02:21:49.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117606 2024-09-17T02:21:49.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:49.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.191641+0000", 2024-09-17T02:21:49.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000348995 2024-09-17T02:21:49.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:49.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.195812+0000", 2024-09-17T02:21:49.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041714849999999999 2024-09-17T02:21:49.203 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.203 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.204 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.204 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:157874 5.6 5:61f48ddb:::benchmark_data_smithi001_23533_object29757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-17T02:21:49.204 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:49.193674+0000", 2024-09-17T02:21:49.204 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0037972769999999999, 2024-09-17T02:21:49.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039924469999999997, 2024-09-17T02:21:49.204 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.204 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.204 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:49.204 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.204 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.204 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.204 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157874 2024-09-17T02:21:49.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.205 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.193674+0000", 2024-09-17T02:21:49.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.193674+0000", 2024-09-17T02:21:49.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.193675+0000", 2024-09-17T02:21:49.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0330000000000001e-06 2024-09-17T02:21:49.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.193678+0000", 2024-09-17T02:21:49.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8459999999999999e-06 2024-09-17T02:21:49.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.193684+0000", 2024-09-17T02:21:49.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4640000000000003e-06 2024-09-17T02:21:49.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.193690+0000", 2024-09-17T02:21:49.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4539999999999998e-06 2024-09-17T02:21:49.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.193755+0000", 2024-09-17T02:21:49.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4985000000000002e-05 2024-09-17T02:21:49.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.193861+0000", 2024-09-17T02:21:49.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106084 2024-09-17T02:21:49.208 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.208 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.208 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.208 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:157877 5.c 5:34a74fa7:::benchmark_data_smithi001_23533_object29760:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-17T02:21:49.208 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:49.194127+0000", 2024-09-17T02:21:49.208 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0033438130000000002, 2024-09-17T02:21:49.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036095910000000001, 2024-09-17T02:21:49.208 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.208 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.208 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:49.208 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.209 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.209 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.209 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157877 2024-09-17T02:21:49.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.209 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194127+0000", 2024-09-17T02:21:49.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194127+0000", 2024-09-17T02:21:49.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194128+0000", 2024-09-17T02:21:49.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3900000000000004e-07 2024-09-17T02:21:49.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194132+0000", 2024-09-17T02:21:49.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7189999999999999e-06 2024-09-17T02:21:49.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194141+0000", 2024-09-17T02:21:49.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6199999999999994e-06 2024-09-17T02:21:49.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194148+0000", 2024-09-17T02:21:49.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.601e-06 2024-09-17T02:21:49.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194185+0000", 2024-09-17T02:21:49.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6881000000000001e-05 2024-09-17T02:21:49.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194266+0000", 2024-09-17T02:21:49.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0761999999999997e-05 2024-09-17T02:21:49.212 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.212 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.212 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.212 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:157878 5.7 5:ee9e333c:::benchmark_data_smithi001_23533_object29761:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-17T02:21:49.212 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:49.194219+0000", 2024-09-17T02:21:49.212 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0032521199999999998, 2024-09-17T02:21:49.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035819210000000001, 2024-09-17T02:21:49.213 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.213 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.213 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:49.213 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.213 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.213 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.213 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157878 2024-09-17T02:21:49.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.213 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194219+0000", 2024-09-17T02:21:49.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194219+0000", 2024-09-17T02:21:49.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194220+0000", 2024-09-17T02:21:49.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2099999999999996e-07 2024-09-17T02:21:49.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194223+0000", 2024-09-17T02:21:49.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0230000000000001e-06 2024-09-17T02:21:49.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194233+0000", 2024-09-17T02:21:49.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0064999999999999e-05 2024-09-17T02:21:49.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194239+0000", 2024-09-17T02:21:49.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9510000000000003e-06 2024-09-17T02:21:49.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194366+0000", 2024-09-17T02:21:49.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000126883 2024-09-17T02:21:49.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194473+0000", 2024-09-17T02:21:49.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010761599999999999 2024-09-17T02:21:49.216 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.216 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.216 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.217 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:157879 5.0 5:08ab0e69:::benchmark_data_smithi001_23533_object29762:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-17T02:21:49.217 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:49.194336+0000", 2024-09-17T02:21:49.217 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0031347010000000002, 2024-09-17T02:21:49.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035309899999999999, 2024-09-17T02:21:49.217 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.217 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.217 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:49.217 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.217 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.217 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.217 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157879 2024-09-17T02:21:49.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.217 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194336+0000", 2024-09-17T02:21:49.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194336+0000", 2024-09-17T02:21:49.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194337+0000", 2024-09-17T02:21:49.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6100000000000001e-07 2024-09-17T02:21:49.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194339+0000", 2024-09-17T02:21:49.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.57e-06 2024-09-17T02:21:49.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194346+0000", 2024-09-17T02:21:49.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6449999999999999e-06 2024-09-17T02:21:49.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194351+0000", 2024-09-17T02:21:49.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9860000000000002e-06 2024-09-17T02:21:49.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194956+0000", 2024-09-17T02:21:49.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00060450499999999997 2024-09-17T02:21:49.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.195079+0000", 2024-09-17T02:21:49.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012292 2024-09-17T02:21:49.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:49.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.195171+0000", 2024-09-17T02:21:49.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2727999999999997e-05 2024-09-17T02:21:49.221 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.221 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.221 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.221 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:157882 5.8 5:1d46133b:::benchmark_data_smithi001_23533_object29765:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-17T02:21:49.221 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:49.194831+0000", 2024-09-17T02:21:49.221 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0026405360000000002, 2024-09-17T02:21:49.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031162550000000001, 2024-09-17T02:21:49.222 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.222 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.222 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:49.222 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.222 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.222 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.222 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157882 2024-09-17T02:21:49.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.222 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194831+0000", 2024-09-17T02:21:49.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194831+0000", 2024-09-17T02:21:49.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194831+0000", 2024-09-17T02:21:49.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0999999999999998e-07 2024-09-17T02:21:49.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194834+0000", 2024-09-17T02:21:49.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.977e-06 2024-09-17T02:21:49.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194843+0000", 2024-09-17T02:21:49.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4940000000000003e-06 2024-09-17T02:21:49.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194848+0000", 2024-09-17T02:21:49.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6110000000000001e-06 2024-09-17T02:21:49.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.196451+0000", 2024-09-17T02:21:49.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001602589 2024-09-17T02:21:49.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.196520+0000", 2024-09-17T02:21:49.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8734999999999998e-05 2024-09-17T02:21:49.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:49.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.196578+0000", 2024-09-17T02:21:49.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8059000000000001e-05 2024-09-17T02:21:49.226 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.226 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.226 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.226 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:157883 5.0 5:09b01aef:::benchmark_data_smithi001_23533_object29766:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-17T02:21:49.226 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:49.194938+0000", 2024-09-17T02:21:49.226 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0025331149999999998, 2024-09-17T02:21:49.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003094458, 2024-09-17T02:21:49.226 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.226 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.226 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:49.226 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.226 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.227 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.227 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157883 2024-09-17T02:21:49.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.227 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194938+0000", 2024-09-17T02:21:49.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194938+0000", 2024-09-17T02:21:49.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194939+0000", 2024-09-17T02:21:49.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.82e-07 2024-09-17T02:21:49.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194942+0000", 2024-09-17T02:21:49.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1590000000000002e-06 2024-09-17T02:21:49.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194949+0000", 2024-09-17T02:21:49.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6260000000000003e-06 2024-09-17T02:21:49.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.194955+0000", 2024-09-17T02:21:49.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1819999999999997e-06 2024-09-17T02:21:49.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.197189+0000", 2024-09-17T02:21:49.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002234106 2024-09-17T02:21:49.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.197288+0000", 2024-09-17T02:21:49.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9246000000000005e-05 2024-09-17T02:21:49.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:49.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.197382+0000", 2024-09-17T02:21:49.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4401000000000006e-05 2024-09-17T02:21:49.230 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.230 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.230 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.231 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:157884 5.6 5:6340895d:::benchmark_data_smithi001_23533_object29767:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-17T02:21:49.231 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:49.195058+0000", 2024-09-17T02:21:49.231 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0024130919999999999, 2024-09-17T02:21:49.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030532440000000001, 2024-09-17T02:21:49.231 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.231 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.231 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:49.231 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.231 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.231 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.231 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157884 2024-09-17T02:21:49.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.232 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.195058+0000", 2024-09-17T02:21:49.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.195058+0000", 2024-09-17T02:21:49.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.195059+0000", 2024-09-17T02:21:49.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8999999999999996e-07 2024-09-17T02:21:49.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.195061+0000", 2024-09-17T02:21:49.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.644e-06 2024-09-17T02:21:49.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.195071+0000", 2024-09-17T02:21:49.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6099999999999995e-06 2024-09-17T02:21:49.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.195076+0000", 2024-09-17T02:21:49.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9049999999999996e-06 2024-09-17T02:21:49.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.195960+0000", 2024-09-17T02:21:49.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00088450699999999998 2024-09-17T02:21:49.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.196035+0000", 2024-09-17T02:21:49.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4497000000000002e-05 2024-09-17T02:21:49.235 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.235 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.235 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.235 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:157881 5.4 e57/52 5:20bfff76:::benchmark_data_smithi001_23533_object29764:head v 57'9717, mlcod=57'9715)", 2024-09-17T02:21:49.235 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:49.195159+0000", 2024-09-17T02:21:49.235 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0023120739999999999, 2024-09-17T02:21:49.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030184779999999998, 2024-09-17T02:21:49.235 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.236 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.236 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:49.236 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.195159+0000", 2024-09-17T02:21:49.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.195159+0000", 2024-09-17T02:21:49.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.195160+0000", 2024-09-17T02:21:49.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1200000000000003e-07 2024-09-17T02:21:49.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.195166+0000", 2024-09-17T02:21:49.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4459999999999998e-06 2024-09-17T02:21:49.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.195174+0000", 2024-09-17T02:21:49.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3610000000000001e-06 2024-09-17T02:21:49.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.195179+0000", 2024-09-17T02:21:49.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9479999999999999e-06 2024-09-17T02:21:49.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.196560+0000", 2024-09-17T02:21:49.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001380446 2024-09-17T02:21:49.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.196579+0000", 2024-09-17T02:21:49.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9029e-05 2024-09-17T02:21:49.239 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.239 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.239 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.239 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:157886 5.c 5:30933983:::benchmark_data_smithi001_23533_object29769:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-17T02:21:49.239 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:49.196980+0000", 2024-09-17T02:21:49.239 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00049107000000000003, 2024-09-17T02:21:49.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012592790000000001, 2024-09-17T02:21:49.240 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.240 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.240 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:49.240 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.240 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.240 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.240 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157886 2024-09-17T02:21:49.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.240 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.196980+0000", 2024-09-17T02:21:49.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.196980+0000", 2024-09-17T02:21:49.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.196981+0000", 2024-09-17T02:21:49.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7699999999999992e-07 2024-09-17T02:21:49.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.196985+0000", 2024-09-17T02:21:49.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9319999999999998e-06 2024-09-17T02:21:49.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.196996+0000", 2024-09-17T02:21:49.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1248e-05 2024-09-17T02:21:49.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.197003+0000", 2024-09-17T02:21:49.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9059999999999996e-06 2024-09-17T02:21:49.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.197048+0000", 2024-09-17T02:21:49.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5169000000000001e-05 2024-09-17T02:21:49.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.197218+0000", 2024-09-17T02:21:49.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016979500000000001 2024-09-17T02:21:49.243 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.243 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.243 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.244 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:157888 5.2 5:4df21a13:::benchmark_data_smithi001_23533_object29771:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-17T02:21:49.244 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:49.197564+0000", 2024-09-17T02:21:49.244 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.999907, 2024-09-17T02:21:49.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00074620999999999997, 2024-09-17T02:21:49.244 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.244 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.244 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:49.244 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.244 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.244 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.244 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157888 2024-09-17T02:21:49.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.245 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.197564+0000", 2024-09-17T02:21:49.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.197564+0000", 2024-09-17T02:21:49.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.197565+0000", 2024-09-17T02:21:49.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1699999999999997e-07 2024-09-17T02:21:49.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.197568+0000", 2024-09-17T02:21:49.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0010000000000002e-06 2024-09-17T02:21:49.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.197577+0000", 2024-09-17T02:21:49.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7590000000000003e-06 2024-09-17T02:21:49.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.197583+0000", 2024-09-17T02:21:49.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0499999999999997e-06 2024-09-17T02:21:49.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.198051+0000", 2024-09-17T02:21:49.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00046850400000000001 2024-09-17T02:21:49.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.198174+0000", 2024-09-17T02:21:49.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012261100000000001 2024-09-17T02:21:49.248 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.248 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.248 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.248 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:157887 5.4 e57/52 5:284f8f9c:::benchmark_data_smithi001_23533_object29770:head v 57'9718, mlcod=57'9715)", 2024-09-17T02:21:49.248 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:49.197813+0000", 2024-09-17T02:21:49.248 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9996581, 2024-09-17T02:21:49.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00056187299999999995, 2024-09-17T02:21:49.248 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.248 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.248 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:49.248 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.197813+0000", 2024-09-17T02:21:49.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.197813+0000", 2024-09-17T02:21:49.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.197814+0000", 2024-09-17T02:21:49.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9100000000000004e-07 2024-09-17T02:21:49.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.197818+0000", 2024-09-17T02:21:49.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3440000000000003e-06 2024-09-17T02:21:49.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.197825+0000", 2024-09-17T02:21:49.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1409999999999999e-06 2024-09-17T02:21:49.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.197830+0000", 2024-09-17T02:21:49.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.899e-06 2024-09-17T02:21:49.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.198320+0000", 2024-09-17T02:21:49.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00048966199999999997 2024-09-17T02:21:49.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.198339+0000", 2024-09-17T02:21:49.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9009999999999999e-05 2024-09-17T02:21:49.251 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.252 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.252 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.252 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:157889 5.6 5.d5cee926 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-17T02:21:49.252 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:49.198391+0000", 2024-09-17T02:21:49.252 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9990807, 2024-09-17T02:21:49.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4268999999999999e-05, 2024-09-17T02:21:49.252 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.252 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.252 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:49.252 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.252 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.253 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.253 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157889 2024-09-17T02:21:49.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.253 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.198391+0000", 2024-09-17T02:21:49.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.198391+0000", 2024-09-17T02:21:49.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.198391+0000", 2024-09-17T02:21:49.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7800000000000001e-07 2024-09-17T02:21:49.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.198395+0000", 2024-09-17T02:21:49.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9580000000000001e-06 2024-09-17T02:21:49.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.198405+0000", 2024-09-17T02:21:49.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3340000000000008e-06 2024-09-17T02:21:49.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:49.198411+0000", 2024-09-17T02:21:49.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4869999999999999e-06 2024-09-17T02:21:49.255 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.255 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.255 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.255 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.255 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:21:49.255 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 14 2024-09-17T02:21:49.256 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:49.257 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:49.258 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:49.257+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:49.358 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:49.360+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:49.448 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:49.449 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:21:49.449 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:21:49.449 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:21:49.449 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:49.459 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:49.460+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:49.469 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:49.560 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:49.564+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:49.630 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:49.631 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:21:49.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:21:49.631 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:49.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.631 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:49.631 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:49.631 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 67.064618813999999, 2024-09-17T02:21:49.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:21:49.631 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.631 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.631 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:49.631 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.632 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.632 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.632 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:21:49.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.632 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:49.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:21:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:21:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:21:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:21:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:21:49.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:21:49.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:21:49.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:21:49.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:21:49.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:21:49.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:21:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:21:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:21:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:21:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:21:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:21:49.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:49.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:21:49.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:21:49.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:49.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:21:49.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:21:49.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:49.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:21:49.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:21:49.637 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.637 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.637 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.637 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:49.637 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:49.637 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 67.060716564000003, 2024-09-17T02:21:49.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:21:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:21:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:21:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:21:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:21:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:21:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:21:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:21:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:21:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:21:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:21:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:21:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:21:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:21:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:21:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:21:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:21:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:21:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:21:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:21:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:21:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:21:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:21:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:21:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71206 5.3 e39/38 5:c6c9386d:::benchmark_data_smithi001_23533_object71205:head v 39'4517, mlcod=35'4513)", 2024-09-17T02:21:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 45.023389449, 2024-09-17T02:21:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026101868, 2024-09-17T02:21:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609694+0000", 2024-09-17T02:21:49.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9539999999999998e-06 2024-09-17T02:21:49.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609841+0000", 2024-09-17T02:21:49.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014690800000000001 2024-09-17T02:21:49.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609872+0000", 2024-09-17T02:21:49.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0326000000000001e-05 2024-09-17T02:21:49.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609892+0000", 2024-09-17T02:21:49.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9848999999999999e-05 2024-09-17T02:21:49.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613826+0000", 2024-09-17T02:21:49.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039345140000000001 2024-09-17T02:21:49.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613908+0000", 2024-09-17T02:21:49.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2412999999999999e-05 2024-09-17T02:21:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635696+0000", 2024-09-17T02:21:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021787597999999998 2024-09-17T02:21:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635794+0000", 2024-09-17T02:21:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8306000000000004e-05 2024-09-17T02:21:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97151 5.5 5:a0c2c072:::benchmark_data_smithi001_23533_object97150:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.364709842000003, 2024-09-17T02:21:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027297614000000001, 2024-09-17T02:21:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97151 2024-09-17T02:21:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.649 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:49.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:49.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268373+0000", 2024-09-17T02:21:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4000000000000002e-07 2024-09-17T02:21:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268423+0000", 2024-09-17T02:21:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0175e-05 2024-09-17T02:21:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268428+0000", 2024-09-17T02:21:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-17T02:21:49.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268431+0000", 2024-09-17T02:21:49.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.179e-06 2024-09-17T02:21:49.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283631+0000", 2024-09-17T02:21:49.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015199691 2024-09-17T02:21:49.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283740+0000", 2024-09-17T02:21:49.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109305 2024-09-17T02:21:49.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:49.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283863+0000", 2024-09-17T02:21:49.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012226699999999999 2024-09-17T02:21:49.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:49.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290857+0000", 2024-09-17T02:21:49.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069945449999999996 2024-09-17T02:21:49.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:49.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295595+0000", 2024-09-17T02:21:49.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047376750000000002 2024-09-17T02:21:49.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:49.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295638+0000", 2024-09-17T02:21:49.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3671999999999998e-05 2024-09-17T02:21:49.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:49.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295670+0000", 2024-09-17T02:21:49.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1266000000000002e-05 2024-09-17T02:21:49.654 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.654 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.654 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.654 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97759 5.a 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:49.654 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:49.654 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.034696740999998, 2024-09-17T02:21:49.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.089694871999999995, 2024-09-17T02:21:49.655 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.655 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.655 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:49.655 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.655 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.655 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.655 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97759 2024-09-17T02:21:49.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.655 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:49.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:49.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598386+0000", 2024-09-17T02:21:49.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999999e-07 2024-09-17T02:21:49.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598414+0000", 2024-09-17T02:21:49.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8013000000000001e-05 2024-09-17T02:21:49.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598420+0000", 2024-09-17T02:21:49.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1149999999999999e-06 2024-09-17T02:21:49.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598424+0000", 2024-09-17T02:21:49.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:21:49.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598479+0000", 2024-09-17T02:21:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4648999999999998e-05 2024-09-17T02:21:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598587+0000", 2024-09-17T02:21:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010853000000000001 2024-09-17T02:21:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598676+0000", 2024-09-17T02:21:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8381999999999995e-05 2024-09-17T02:21:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:49.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603766+0000", 2024-09-17T02:21:49.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050902559999999996 2024-09-17T02:21:49.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:49.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.687988+0000", 2024-09-17T02:21:49.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.084221753999999996 2024-09-17T02:21:49.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:49.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688037+0000", 2024-09-17T02:21:49.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-05 2024-09-17T02:21:49.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:49.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688080+0000", 2024-09-17T02:21:49.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3149999999999999e-05 2024-09-17T02:21:49.662 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.662 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.662 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.662 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97770 5.0 5:09c75033:::benchmark_data_smithi001_23533_object97769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:49.662 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:49.663 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.029554310999998, 2024-09-17T02:21:49.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.086380868, 2024-09-17T02:21:49.663 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.663 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.663 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:49.663 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.663 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.663 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.663 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97770 2024-09-17T02:21:49.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.663 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:49.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:49.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603529+0000", 2024-09-17T02:21:49.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:21:49.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603593+0000", 2024-09-17T02:21:49.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4216999999999999e-05 2024-09-17T02:21:49.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603603+0000", 2024-09-17T02:21:49.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5179999999999993e-06 2024-09-17T02:21:49.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603608+0000", 2024-09-17T02:21:49.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2039999999999996e-06 2024-09-17T02:21:49.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603653+0000", 2024-09-17T02:21:49.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5247000000000002e-05 2024-09-17T02:21:49.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603758+0000", 2024-09-17T02:21:49.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105352 2024-09-17T02:21:49.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:49.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603900+0000", 2024-09-17T02:21:49.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014198999999999999 2024-09-17T02:21:49.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:49.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.606097+0000", 2024-09-17T02:21:49.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021969839999999999 2024-09-17T02:21:49.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:49.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689756+0000", 2024-09-17T02:21:49.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.083659077999999998 2024-09-17T02:21:49.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:49.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689846+0000", 2024-09-17T02:21:49.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9320999999999994e-05 2024-09-17T02:21:49.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:49.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689908+0000", 2024-09-17T02:21:49.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720999999999998e-05 2024-09-17T02:21:49.669 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.669 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.669 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.670 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127513 5.c 5:3eca08e4:::benchmark_data_smithi001_23533_object127512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:49.670 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:21:49.670 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.188777887000001, 2024-09-17T02:21:49.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046626399999999998, 2024-09-17T02:21:49.670 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.670 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.670 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:49.670 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.670 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.670 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.670 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127513 2024-09-17T02:21:49.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.670 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:21:49.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:21:49.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444305+0000", 2024-09-17T02:21:49.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2529999999999999e-06 2024-09-17T02:21:49.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444466+0000", 2024-09-17T02:21:49.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016069700000000001 2024-09-17T02:21:49.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444479+0000", 2024-09-17T02:21:49.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2602999999999999e-05 2024-09-17T02:21:49.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444485+0000", 2024-09-17T02:21:49.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.669e-06 2024-09-17T02:21:49.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444560+0000", 2024-09-17T02:21:49.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4276999999999994e-05 2024-09-17T02:21:49.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444656+0000", 2024-09-17T02:21:49.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6490000000000006e-05 2024-09-17T02:21:49.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:49.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444739+0000", 2024-09-17T02:21:49.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3139999999999993e-05 2024-09-17T02:21:49.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:49.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.448438+0000", 2024-09-17T02:21:49.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036985490000000002 2024-09-17T02:21:49.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:49.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490732+0000", 2024-09-17T02:21:49.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042294353999999999 2024-09-17T02:21:49.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:49.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490859+0000", 2024-09-17T02:21:49.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012708899999999999 2024-09-17T02:21:49.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:49.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490930+0000", 2024-09-17T02:21:49.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:21:49.675 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.675 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.676 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.676 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127514 5.c 5:39cc1feb:::benchmark_data_smithi001_23533_object127513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:49.676 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:49.676 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.188581117999998, 2024-09-17T02:21:49.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049357228000000003, 2024-09-17T02:21:49.676 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.676 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.676 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:49.676 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.676 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.677 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.677 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127514 2024-09-17T02:21:49.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.677 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:49.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:49.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:49.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8599999999999998e-07 2024-09-17T02:21:49.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444554+0000", 2024-09-17T02:21:49.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3047999999999998e-05 2024-09-17T02:21:49.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444562+0000", 2024-09-17T02:21:49.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5830000000000001e-06 2024-09-17T02:21:49.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444567+0000", 2024-09-17T02:21:49.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4179999999999996e-06 2024-09-17T02:21:49.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446566+0000", 2024-09-17T02:21:49.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001998788 2024-09-17T02:21:49.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446696+0000", 2024-09-17T02:21:49.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129393 2024-09-17T02:21:49.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:49.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446794+0000", 2024-09-17T02:21:49.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8462999999999996e-05 2024-09-17T02:21:49.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:49.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.449036+0000", 2024-09-17T02:21:49.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022415880000000001 2024-09-17T02:21:49.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:49.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493737+0000", 2024-09-17T02:21:49.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044701682 2024-09-17T02:21:49.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:49.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493808+0000", 2024-09-17T02:21:49.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0846000000000006e-05 2024-09-17T02:21:49.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:49.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493858+0000", 2024-09-17T02:21:49.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9932999999999998e-05 2024-09-17T02:21:49.682 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.682 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.682 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.682 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129441 5.1 5:84c3199f:::benchmark_data_smithi001_23533_object1324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:49.682 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:21:49.682 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.12957063, 2024-09-17T02:21:49.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034387011000000002, 2024-09-17T02:21:49.682 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.682 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.683 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:49.683 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.683 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.683 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.683 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129441 2024-09-17T02:21:49.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.683 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:21:49.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:21:49.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503513+0000", 2024-09-17T02:21:49.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4759999999999999e-06 2024-09-17T02:21:49.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503518+0000", 2024-09-17T02:21:49.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-09-17T02:21:49.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503532+0000", 2024-09-17T02:21:49.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4049999999999999e-05 2024-09-17T02:21:49.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503541+0000", 2024-09-17T02:21:49.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5320000000000006e-06 2024-09-17T02:21:49.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506331+0000", 2024-09-17T02:21:49.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027899190000000001 2024-09-17T02:21:49.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506402+0000", 2024-09-17T02:21:49.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:21:49.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:49.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506477+0000", 2024-09-17T02:21:49.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4626e-05 2024-09-17T02:21:49.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:49.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509749+0000", 2024-09-17T02:21:49.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032726980000000001 2024-09-17T02:21:49.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:49.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537758+0000", 2024-09-17T02:21:49.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028008890000000002 2024-09-17T02:21:49.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:49.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537812+0000", 2024-09-17T02:21:49.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3300000000000001e-05 2024-09-17T02:21:49.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:49.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537898+0000", 2024-09-17T02:21:49.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6691000000000001e-05 2024-09-17T02:21:49.688 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.688 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.688 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.688 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129442 5.1 5:8f7f2a95:::benchmark_data_smithi001_23533_object1325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:49.688 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:21:49.689 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.126600021, 2024-09-17T02:21:49.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031546698999999997, 2024-09-17T02:21:49.689 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.689 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.689 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:49.689 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.689 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.689 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.689 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129442 2024-09-17T02:21:49.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.689 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:21:49.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:21:49.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506483+0000", 2024-09-17T02:21:49.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2869999999999999e-06 2024-09-17T02:21:49.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506489+0000", 2024-09-17T02:21:49.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2330000000000003e-06 2024-09-17T02:21:49.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506502+0000", 2024-09-17T02:21:49.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2286999999999999e-05 2024-09-17T02:21:49.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506511+0000", 2024-09-17T02:21:49.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7799999999999995e-06 2024-09-17T02:21:49.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.507966+0000", 2024-09-17T02:21:49.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014541549999999999 2024-09-17T02:21:49.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508130+0000", 2024-09-17T02:21:49.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016455199999999999 2024-09-17T02:21:49.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:49.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508287+0000", 2024-09-17T02:21:49.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015730400000000001 2024-09-17T02:21:49.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:49.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510577+0000", 2024-09-17T02:21:49.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022899449999999998 2024-09-17T02:21:49.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:49.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537932+0000", 2024-09-17T02:21:49.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027354471000000002 2024-09-17T02:21:49.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:49.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537964+0000", 2024-09-17T02:21:49.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1909999999999998e-05 2024-09-17T02:21:49.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:49.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.538029+0000", 2024-09-17T02:21:49.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4775000000000002e-05 2024-09-17T02:21:49.694 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.694 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.694 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.695 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129443 5.8 5:1edfeaf8:::benchmark_data_smithi001_23533_object1326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:49.695 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:21:49.695 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.123165521000001, 2024-09-17T02:21:49.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025315902000000001, 2024-09-17T02:21:49.695 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.695 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.695 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:49.695 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.695 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.695 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.695 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129443 2024-09-17T02:21:49.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.695 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:21:49.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:21:49.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509918+0000", 2024-09-17T02:21:49.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3689999999999999e-06 2024-09-17T02:21:49.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509923+0000", 2024-09-17T02:21:49.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0429999999999998e-06 2024-09-17T02:21:49.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509936+0000", 2024-09-17T02:21:49.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3234000000000001e-05 2024-09-17T02:21:49.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509950+0000", 2024-09-17T02:21:49.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3998999999999999e-05 2024-09-17T02:21:49.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509994+0000", 2024-09-17T02:21:49.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4323000000000002e-05 2024-09-17T02:21:49.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510095+0000", 2024-09-17T02:21:49.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010103300000000001 2024-09-17T02:21:49.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:49.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510160+0000", 2024-09-17T02:21:49.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4976999999999998e-05 2024-09-17T02:21:49.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:49.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.513304+0000", 2024-09-17T02:21:49.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031431330000000002 2024-09-17T02:21:49.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:49.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535046+0000", 2024-09-17T02:21:49.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021742276000000001 2024-09-17T02:21:49.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:49.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:21:49.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107759 2024-09-17T02:21:49.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:49.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535232+0000", 2024-09-17T02:21:49.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8756000000000003e-05 2024-09-17T02:21:49.700 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.700 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.700 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.701 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:138247 5.3 5:caf01f60:::benchmark_data_smithi001_23533_object10130:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:49.701 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.335014+0000", 2024-09-17T02:21:49.701 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.2980679479999999, 2024-09-17T02:21:49.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026419469000000001, 2024-09-17T02:21:49.701 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.701 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.701 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:49.701 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.701 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.701 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.701 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 138247 2024-09-17T02:21:49.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.702 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335014+0000", 2024-09-17T02:21:49.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335014+0000", 2024-09-17T02:21:49.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335015+0000", 2024-09-17T02:21:49.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3600000000000004e-07 2024-09-17T02:21:49.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335017+0000", 2024-09-17T02:21:49.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5749999999999999e-06 2024-09-17T02:21:49.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335024+0000", 2024-09-17T02:21:49.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8379999999999996e-06 2024-09-17T02:21:49.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335029+0000", 2024-09-17T02:21:49.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.22e-06 2024-09-17T02:21:49.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335083+0000", 2024-09-17T02:21:49.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3600000000000002e-05 2024-09-17T02:21:49.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335229+0000", 2024-09-17T02:21:49.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000146098 2024-09-17T02:21:49.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:49.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335349+0000", 2024-09-17T02:21:49.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120631 2024-09-17T02:21:49.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:49.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.357942+0000", 2024-09-17T02:21:49.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022592457 2024-09-17T02:21:49.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:49.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.361286+0000", 2024-09-17T02:21:49.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003343623 2024-09-17T02:21:49.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:49.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.361338+0000", 2024-09-17T02:21:49.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2323e-05 2024-09-17T02:21:49.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:49.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.361433+0000", 2024-09-17T02:21:49.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5568000000000004e-05 2024-09-17T02:21:49.708 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.708 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.708 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.708 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:138244 5.b e54/51 5:d38c94c4:::benchmark_data_smithi001_23533_object10127:head v 54'8567, mlcod=54'8564)", 2024-09-17T02:21:49.708 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.336586+0000", 2024-09-17T02:21:49.708 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.2964955580000002, 2024-09-17T02:21:49.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026602741999999999, 2024-09-17T02:21:49.709 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.709 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.709 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:49.709 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336586+0000", 2024-09-17T02:21:49.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336586+0000", 2024-09-17T02:21:49.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336587+0000", 2024-09-17T02:21:49.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0600000000000001e-07 2024-09-17T02:21:49.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336590+0000", 2024-09-17T02:21:49.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3110000000000001e-06 2024-09-17T02:21:49.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336597+0000", 2024-09-17T02:21:49.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0639999999999996e-06 2024-09-17T02:21:49.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336602+0000", 2024-09-17T02:21:49.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3599999999999998e-06 2024-09-17T02:21:49.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336645+0000", 2024-09-17T02:21:49.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3628999999999999e-05 2024-09-17T02:21:49.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336666+0000", 2024-09-17T02:21:49.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0604000000000001e-05 2024-09-17T02:21:49.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:49.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363143+0000", 2024-09-17T02:21:49.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026477055999999999 2024-09-17T02:21:49.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:49.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363189+0000", 2024-09-17T02:21:49.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6312e-05 2024-09-17T02:21:49.713 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.713 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.713 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.713 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:138259 5.3 5:c08b4023:::benchmark_data_smithi001_23533_object10142:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:49.713 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.337063+0000", 2024-09-17T02:21:49.713 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.2960187399999992, 2024-09-17T02:21:49.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027773173000000002, 2024-09-17T02:21:49.713 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.713 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.713 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:49.713 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.714 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.714 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.714 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 138259 2024-09-17T02:21:49.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.714 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337063+0000", 2024-09-17T02:21:49.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337063+0000", 2024-09-17T02:21:49.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337064+0000", 2024-09-17T02:21:49.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-17T02:21:49.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337066+0000", 2024-09-17T02:21:49.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.03e-06 2024-09-17T02:21:49.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337072+0000", 2024-09-17T02:21:49.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5119999999999997e-06 2024-09-17T02:21:49.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337077+0000", 2024-09-17T02:21:49.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.454e-06 2024-09-17T02:21:49.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.352990+0000", 2024-09-17T02:21:49.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015913116000000001 2024-09-17T02:21:49.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.353136+0000", 2024-09-17T02:21:49.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000146117 2024-09-17T02:21:49.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:49.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.353253+0000", 2024-09-17T02:21:49.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117359 2024-09-17T02:21:49.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:49.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.358284+0000", 2024-09-17T02:21:49.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050306689999999998 2024-09-17T02:21:49.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:49.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.364738+0000", 2024-09-17T02:21:49.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064539410000000004 2024-09-17T02:21:49.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:49.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.364768+0000", 2024-09-17T02:21:49.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0086999999999998e-05 2024-09-17T02:21:49.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:49.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.364836+0000", 2024-09-17T02:21:49.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8549999999999999e-05 2024-09-17T02:21:49.719 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.719 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.719 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.719 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:138249 5.b e54/51 5:dcbad32d:::benchmark_data_smithi001_23533_object10132:head v 54'8568, mlcod=54'8564)", 2024-09-17T02:21:49.720 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.338016+0000", 2024-09-17T02:21:49.720 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.2950663999999996, 2024-09-17T02:21:49.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025210803, 2024-09-17T02:21:49.720 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.720 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.720 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:49.720 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338016+0000", 2024-09-17T02:21:49.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338016+0000", 2024-09-17T02:21:49.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338017+0000", 2024-09-17T02:21:49.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.28e-06 2024-09-17T02:21:49.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338022+0000", 2024-09-17T02:21:49.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0950000000000003e-06 2024-09-17T02:21:49.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338032+0000", 2024-09-17T02:21:49.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7140000000000005e-06 2024-09-17T02:21:49.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338038+0000", 2024-09-17T02:21:49.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1029999999999998e-06 2024-09-17T02:21:49.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.349300+0000", 2024-09-17T02:21:49.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01126216 2024-09-17T02:21:49.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.349359+0000", 2024-09-17T02:21:49.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9206999999999997e-05 2024-09-17T02:21:49.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:49.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363192+0000", 2024-09-17T02:21:49.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013833253 2024-09-17T02:21:49.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:49.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363226+0000", 2024-09-17T02:21:49.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3991e-05 2024-09-17T02:21:49.724 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.724 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.724 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.724 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:139587 5.1 5:801d98ef:::benchmark_data_smithi001_23533_object11470:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:49.724 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.931670+0000", 2024-09-17T02:21:49.724 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7014116609999999, 2024-09-17T02:21:49.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025666268999999999, 2024-09-17T02:21:49.725 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.725 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.725 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:49.725 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.725 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.725 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.725 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 139587 2024-09-17T02:21:49.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.725 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931670+0000", 2024-09-17T02:21:49.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931670+0000", 2024-09-17T02:21:49.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931671+0000", 2024-09-17T02:21:49.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.034e-06 2024-09-17T02:21:49.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931677+0000", 2024-09-17T02:21:49.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4580000000000001e-06 2024-09-17T02:21:49.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931690+0000", 2024-09-17T02:21:49.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3152999999999999e-05 2024-09-17T02:21:49.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931699+0000", 2024-09-17T02:21:49.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3100000000000006e-06 2024-09-17T02:21:49.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931779+0000", 2024-09-17T02:21:49.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0284000000000006e-05 2024-09-17T02:21:49.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931968+0000", 2024-09-17T02:21:49.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018853399999999999 2024-09-17T02:21:49.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:49.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.932149+0000", 2024-09-17T02:21:49.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018114699999999999 2024-09-17T02:21:49.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:49.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.935163+0000", 2024-09-17T02:21:49.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030143169999999999 2024-09-17T02:21:49.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:49.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.957199+0000", 2024-09-17T02:21:49.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022035255 2024-09-17T02:21:49.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:49.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.957247+0000", 2024-09-17T02:21:49.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8319999999999998e-05 2024-09-17T02:21:49.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:49.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.957337+0000", 2024-09-17T02:21:49.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9456999999999994e-05 2024-09-17T02:21:49.730 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.730 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.730 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:140178 5.1 5:8f77d9ee:::benchmark_data_smithi001_23533_object12061:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:21:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4456261700000006, 2024-09-17T02:21:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025269478000000001, 2024-09-17T02:21:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 140178 2024-09-17T02:21:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:21:49.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:21:49.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:21:49.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0500000000000004e-07 2024-09-17T02:21:49.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187459+0000", 2024-09-17T02:21:49.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5299999999999999e-06 2024-09-17T02:21:49.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187468+0000", 2024-09-17T02:21:49.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3130000000000004e-06 2024-09-17T02:21:49.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187473+0000", 2024-09-17T02:21:49.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-09-17T02:21:49.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.192476+0000", 2024-09-17T02:21:49.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050035339999999996 2024-09-17T02:21:49.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.192603+0000", 2024-09-17T02:21:49.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012652299999999999 2024-09-17T02:21:49.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:49.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.192719+0000", 2024-09-17T02:21:49.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011568700000000001 2024-09-17T02:21:49.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:49.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.196336+0000", 2024-09-17T02:21:49.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003617178 2024-09-17T02:21:49.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:49.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.212470+0000", 2024-09-17T02:21:49.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016134402999999999 2024-09-17T02:21:49.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:49.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.212522+0000", 2024-09-17T02:21:49.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1480000000000002e-05 2024-09-17T02:21:49.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:49.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.212725+0000", 2024-09-17T02:21:49.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020359100000000001 2024-09-17T02:21:49.736 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.736 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.736 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:150456 5.2 5:4ee9ae1c:::benchmark_data_smithi001_23533_object22339:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.838305+0000", 2024-09-17T02:21:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.7947769440000001, 2024-09-17T02:21:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026350045999999998, 2024-09-17T02:21:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 150456 2024-09-17T02:21:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838305+0000", 2024-09-17T02:21:49.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838305+0000", 2024-09-17T02:21:49.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838305+0000", 2024-09-17T02:21:49.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4999999999999998e-07 2024-09-17T02:21:49.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838308+0000", 2024-09-17T02:21:49.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.187e-06 2024-09-17T02:21:49.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838314+0000", 2024-09-17T02:21:49.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2400000000000004e-06 2024-09-17T02:21:49.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838318+0000", 2024-09-17T02:21:49.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5020000000000003e-06 2024-09-17T02:21:49.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.840927+0000", 2024-09-17T02:21:49.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026083690000000001 2024-09-17T02:21:49.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.841037+0000", 2024-09-17T02:21:49.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109888 2024-09-17T02:21:49.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:49.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.864539+0000", 2024-09-17T02:21:49.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023502788 2024-09-17T02:21:49.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:49.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.864586+0000", 2024-09-17T02:21:49.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6554999999999997e-05 2024-09-17T02:21:49.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:49.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.864655+0000", 2024-09-17T02:21:49.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9066999999999994e-05 2024-09-17T02:21:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:150458 5.a 5:59b62890:::benchmark_data_smithi001_23533_object22341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:21:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.794756214, 2024-09-17T02:21:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028150173000000001, 2024-09-17T02:21:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.743 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.743 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 150458 2024-09-17T02:21:49.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.743 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:21:49.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:21:49.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:21:49.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7800000000000002e-07 2024-09-17T02:21:49.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838328+0000", 2024-09-17T02:21:49.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.838e-06 2024-09-17T02:21:49.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838335+0000", 2024-09-17T02:21:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1999999999999997e-06 2024-09-17T02:21:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838340+0000", 2024-09-17T02:21:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7389999999999999e-06 2024-09-17T02:21:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849082+0000", 2024-09-17T02:21:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01074174 2024-09-17T02:21:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849192+0000", 2024-09-17T02:21:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011040300000000001 2024-09-17T02:21:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849297+0000", 2024-09-17T02:21:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104764 2024-09-17T02:21:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.857853+0000", 2024-09-17T02:21:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085558490000000008 2024-09-17T02:21:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866430+0000", 2024-09-17T02:21:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085768140000000003 2024-09-17T02:21:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866454+0000", 2024-09-17T02:21:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4428000000000001e-05 2024-09-17T02:21:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:49.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866476+0000", 2024-09-17T02:21:49.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.192e-05 2024-09-17T02:21:49.748 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.748 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.748 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.748 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:150461 5.a 5:58886edc:::benchmark_data_smithi001_23533_object22344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:49.748 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.838709+0000", 2024-09-17T02:21:49.748 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.7943728999999999, 2024-09-17T02:21:49.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027819366000000002, 2024-09-17T02:21:49.748 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:49.748 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:49.749 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:49.749 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:49.749 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:49.749 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.749 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 150461 2024-09-17T02:21:49.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.749 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:49.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:49.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838709+0000", 2024-09-17T02:21:49.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838709+0000", 2024-09-17T02:21:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838710+0000", 2024-09-17T02:21:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9399999999999995e-07 2024-09-17T02:21:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838712+0000", 2024-09-17T02:21:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.57e-06 2024-09-17T02:21:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838843+0000", 2024-09-17T02:21:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130469 2024-09-17T02:21:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838925+0000", 2024-09-17T02:21:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2622999999999998e-05 2024-09-17T02:21:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.855341+0000", 2024-09-17T02:21:49.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016415965000000001 2024-09-17T02:21:49.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:49.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.855509+0000", 2024-09-17T02:21:49.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016805800000000001 2024-09-17T02:21:49.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:49.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.855638+0000", 2024-09-17T02:21:49.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012901199999999999 2024-09-17T02:21:49.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.860084+0000", 2024-09-17T02:21:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044458650000000002 2024-09-17T02:21:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866486+0000", 2024-09-17T02:21:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064016919999999996 2024-09-17T02:21:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866505+0000", 2024-09-17T02:21:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9667e-05 2024-09-17T02:21:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866528+0000", 2024-09-17T02:21:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2951000000000001e-05 2024-09-17T02:21:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:49.754 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:49.756 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:49.757+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:49.756 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:49.857 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:49.857+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:49.910 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:49.910 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:49.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.910 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:159495 5.e 5:7642a7f2:::benchmark_data_smithi001_23533_object31378:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-17T02:21:49.910 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:49.909215+0000", 2024-09-17T02:21:49.910 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.005135611, 2024-09-17T02:21:49.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051596469999999998, 2024-09-17T02:21:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 159495 2024-09-17T02:21:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.909215+0000", 2024-09-17T02:21:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:49.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.909215+0000", 2024-09-17T02:21:49.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:49.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.909215+0000", 2024-09-17T02:21:49.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0199999999999998e-07 2024-09-17T02:21:49.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.909217+0000", 2024-09-17T02:21:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.849e-06 2024-09-17T02:21:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.909231+0000", 2024-09-17T02:21:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4324e-05 2024-09-17T02:21:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.909238+0000", 2024-09-17T02:21:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0209999999999996e-06 2024-09-17T02:21:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:49.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.910993+0000", 2024-09-17T02:21:49.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017555209999999999 2024-09-17T02:21:49.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:49.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.911117+0000", 2024-09-17T02:21:49.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012391600000000001 2024-09-17T02:21:49.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:49.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.911243+0000", 2024-09-17T02:21:49.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012585299999999999 2024-09-17T02:21:49.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:49.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.912735+0000", 2024-09-17T02:21:49.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001492511 2024-09-17T02:21:49.915 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.915 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:49.915 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.915 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:159498 5.b 5:d9a46b7a:::benchmark_data_smithi001_23533_object31381:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-17T02:21:49.915 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:49.910343+0000", 2024-09-17T02:21:49.916 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0040077749999999999, 2024-09-17T02:21:49.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041199610000000001, 2024-09-17T02:21:49.916 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:49.916 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:49.916 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:49.916 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:49.916 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:49.916 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.916 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 159498 2024-09-17T02:21:49.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.916 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:49.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:49.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.910343+0000", 2024-09-17T02:21:49.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:49.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.910343+0000", 2024-09-17T02:21:49.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:49.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.910344+0000", 2024-09-17T02:21:49.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0049999999999999e-06 2024-09-17T02:21:49.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:49.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.910348+0000", 2024-09-17T02:21:49.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5340000000000001e-06 2024-09-17T02:21:49.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:49.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.910362+0000", 2024-09-17T02:21:49.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.324e-05 2024-09-17T02:21:49.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.910369+0000", 2024-09-17T02:21:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7810000000000005e-06 2024-09-17T02:21:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.910419+0000", 2024-09-17T02:21:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9128000000000001e-05 2024-09-17T02:21:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.910535+0000", 2024-09-17T02:21:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116291 2024-09-17T02:21:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:49.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.910648+0000", 2024-09-17T02:21:49.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113483 2024-09-17T02:21:49.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:49.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.912399+0000", 2024-09-17T02:21:49.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001750227 2024-09-17T02:21:49.920 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.920 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:49.920 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.921 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:159502 5.3 e57/51 5:c9dbc6f9:::benchmark_data_smithi001_23533_object31385:head v 57'10058, mlcod=57'10056)", 2024-09-17T02:21:49.921 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:49.913403+0000", 2024-09-17T02:21:49.921 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00094735399999999997, 2024-09-17T02:21:49.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011375140000000001, 2024-09-17T02:21:49.921 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:49.921 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:49.921 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:49.921 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:49.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:49.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913403+0000", 2024-09-17T02:21:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913403+0000", 2024-09-17T02:21:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913404+0000", 2024-09-17T02:21:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5899999999999995e-07 2024-09-17T02:21:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913423+0000", 2024-09-17T02:21:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9055e-05 2024-09-17T02:21:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913452+0000", 2024-09-17T02:21:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8507e-05 2024-09-17T02:21:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913478+0000", 2024-09-17T02:21:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6225999999999999e-05 2024-09-17T02:21:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913530+0000", 2024-09-17T02:21:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1780000000000002e-05 2024-09-17T02:21:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913552+0000", 2024-09-17T02:21:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2396e-05 2024-09-17T02:21:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.925 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:159499 5.0 e57/26 5:01b754cd:::benchmark_data_smithi001_23533_object31382:head v 57'9912, mlcod=57'9909)", 2024-09-17T02:21:49.925 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:49.913497+0000", 2024-09-17T02:21:49.925 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00085358999999999999, 2024-09-17T02:21:49.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011012420000000001, 2024-09-17T02:21:49.925 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:49.925 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:49.925 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:49.925 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:49.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:49.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913497+0000", 2024-09-17T02:21:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913497+0000", 2024-09-17T02:21:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913497+0000", 2024-09-17T02:21:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7399999999999999e-07 2024-09-17T02:21:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913501+0000", 2024-09-17T02:21:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8639999999999998e-06 2024-09-17T02:21:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913509+0000", 2024-09-17T02:21:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9219999999999997e-06 2024-09-17T02:21:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913515+0000", 2024-09-17T02:21:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4129999999999997e-06 2024-09-17T02:21:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913547+0000", 2024-09-17T02:21:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1971999999999998e-05 2024-09-17T02:21:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913558+0000", 2024-09-17T02:21:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1289e-05 2024-09-17T02:21:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:159500 5.8 e57/26 5:1bd5a257:::benchmark_data_smithi001_23533_object31383:head v 57'10105, mlcod=57'10103)", 2024-09-17T02:21:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:49.913527+0000", 2024-09-17T02:21:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.000823685, 2024-09-17T02:21:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011295700000000001, 2024-09-17T02:21:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913527+0000", 2024-09-17T02:21:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:49.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913527+0000", 2024-09-17T02:21:49.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:49.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913527+0000", 2024-09-17T02:21:49.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1800000000000002e-07 2024-09-17T02:21:49.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:49.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913542+0000", 2024-09-17T02:21:49.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4521e-05 2024-09-17T02:21:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913552+0000", 2024-09-17T02:21:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0662999999999999e-05 2024-09-17T02:21:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913559+0000", 2024-09-17T02:21:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5039999999999999e-06 2024-09-17T02:21:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913588+0000", 2024-09-17T02:21:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9553e-05 2024-09-17T02:21:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913601+0000", 2024-09-17T02:21:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2231e-05 2024-09-17T02:21:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.1 e 57/57 lb 5:8bdd8ca0:::benchmark_data_smithi001_23533_object60920:head)", 2024-09-17T02:21:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:49.913674+0000", 2024-09-17T02:21:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00067621000000000001, 2024-09-17T02:21:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00103776, 2024-09-17T02:21:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913674+0000", 2024-09-17T02:21:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:49.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913674+0000", 2024-09-17T02:21:49.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:49.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913675+0000", 2024-09-17T02:21:49.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4099999999999999e-07 2024-09-17T02:21:49.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:49.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913683+0000", 2024-09-17T02:21:49.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8939999999999993e-06 2024-09-17T02:21:49.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913692+0000", 2024-09-17T02:21:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1970000000000002e-06 2024-09-17T02:21:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913699+0000", 2024-09-17T02:21:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7469999999999999e-06 2024-09-17T02:21:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:159503 5.a e57/22 5:5c3017df:::benchmark_data_smithi001_23533_object31386:head v 57'10120, mlcod=57'10118)", 2024-09-17T02:21:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:49.913745+0000", 2024-09-17T02:21:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00060548799999999995, 2024-09-17T02:21:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010149790000000001, 2024-09-17T02:21:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913745+0000", 2024-09-17T02:21:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913745+0000", 2024-09-17T02:21:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913746+0000", 2024-09-17T02:21:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6199999999999998e-07 2024-09-17T02:21:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913750+0000", 2024-09-17T02:21:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7029999999999997e-06 2024-09-17T02:21:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913766+0000", 2024-09-17T02:21:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5227e-05 2024-09-17T02:21:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913772+0000", 2024-09-17T02:21:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.781e-06 2024-09-17T02:21:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913813+0000", 2024-09-17T02:21:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0136000000000003e-05 2024-09-17T02:21:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913830+0000", 2024-09-17T02:21:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7487999999999999e-05 2024-09-17T02:21:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.940 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:159504 5.e 5:748545d0:::benchmark_data_smithi001_23533_object31387:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-17T02:21:49.940 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:49.913817+0000", 2024-09-17T02:21:49.940 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00053374900000000003, 2024-09-17T02:21:49.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001002296, 2024-09-17T02:21:49.940 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:49.940 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:49.940 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:49.940 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:49.940 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:49.940 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.940 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 159504 2024-09-17T02:21:49.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.940 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:49.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:49.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913817+0000", 2024-09-17T02:21:49.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:49.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913817+0000", 2024-09-17T02:21:49.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:49.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913818+0000", 2024-09-17T02:21:49.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7899999999999997e-07 2024-09-17T02:21:49.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:49.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913822+0000", 2024-09-17T02:21:49.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8010000000000001e-06 2024-09-17T02:21:49.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:49.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913833+0000", 2024-09-17T02:21:49.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1674e-05 2024-09-17T02:21:49.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913841+0000", 2024-09-17T02:21:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4900000000000003e-06 2024-09-17T02:21:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.913897+0000", 2024-09-17T02:21:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6647000000000002e-05 2024-09-17T02:21:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.914005+0000", 2024-09-17T02:21:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010786 2024-09-17T02:21:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.914139+0000", 2024-09-17T02:21:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000133836 2024-09-17T02:21:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:159489 5.e 5:760a1c15:::benchmark_data_smithi001_23533_object31372:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-17T02:21:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:49.907648+0000", 2024-09-17T02:21:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0067029489999999997, 2024-09-17T02:21:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072454709999999999, 2024-09-17T02:21:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 159489 2024-09-17T02:21:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.907648+0000", 2024-09-17T02:21:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.907648+0000", 2024-09-17T02:21:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.907649+0000", 2024-09-17T02:21:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3399999999999997e-07 2024-09-17T02:21:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.907653+0000", 2024-09-17T02:21:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5059999999999997e-06 2024-09-17T02:21:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.907666+0000", 2024-09-17T02:21:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2456999999999999e-05 2024-09-17T02:21:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.907673+0000", 2024-09-17T02:21:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9700000000000002e-06 2024-09-17T02:21:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.907718+0000", 2024-09-17T02:21:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5600999999999999e-05 2024-09-17T02:21:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.907791+0000", 2024-09-17T02:21:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2896000000000001e-05 2024-09-17T02:21:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.907852+0000", 2024-09-17T02:21:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1294e-05 2024-09-17T02:21:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.910972+0000", 2024-09-17T02:21:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031199219999999998 2024-09-17T02:21:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:159491 5.e 5:77fa9bdf:::benchmark_data_smithi001_23533_object31374:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-17T02:21:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:49.909148+0000", 2024-09-17T02:21:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0052025140000000001, 2024-09-17T02:21:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0058217310000000001, 2024-09-17T02:21:49.950 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:49.950 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:49.950 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:49.950 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:49.950 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:49.950 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:49.950 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 159491 2024-09-17T02:21:49.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.950 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:49.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:49.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.909148+0000", 2024-09-17T02:21:49.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:49.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.909148+0000", 2024-09-17T02:21:49.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:49.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:49.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.909149+0000", 2024-09-17T02:21:49.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6700000000000003e-07 2024-09-17T02:21:49.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:49.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.909152+0000", 2024-09-17T02:21:49.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2890000000000002e-06 2024-09-17T02:21:49.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:49.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.909162+0000", 2024-09-17T02:21:49.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6399999999999992e-06 2024-09-17T02:21:49.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:49.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.909166+0000", 2024-09-17T02:21:49.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.702e-06 2024-09-17T02:21:49.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.909320+0000", 2024-09-17T02:21:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015358200000000001 2024-09-17T02:21:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.909422+0000", 2024-09-17T02:21:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102371 2024-09-17T02:21:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.909524+0000", 2024-09-17T02:21:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010192 2024-09-17T02:21:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:49.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:49.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:49.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:49.912550+0000", 2024-09-17T02:21:49.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030256010000000002 2024-09-17T02:21:49.954 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.954 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:49.954 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.954 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:49.954 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:21:49.954 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 10 2024-09-17T02:21:49.954 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:49.955 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:49.956 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:49.960+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:49.984 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T02:21:50.058 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:50.060+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:50.107 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:50.108 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:21:50.108 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:21:50.108 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:21:50.108 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:50.127 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:50.158 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:50.157+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:50.259 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:50.260+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:50.320 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:21:50.329 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:50.329 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:21:50.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:21:50.329 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:50.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.329 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97749 5.b 5:d930ef52:::benchmark_data_smithi001_23533_object97748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:50.329 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:50.329 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 32.739805775000001, 2024-09-17T02:21:50.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092964343000000005, 2024-09-17T02:21:50.330 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:50.330 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:50.330 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:50.330 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:50.330 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:50.330 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:50.330 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97749 2024-09-17T02:21:50.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.331 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:50.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:50.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:50.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:50.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:50.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:50.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591947+0000", 2024-09-17T02:21:50.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:21:50.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:50.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592011+0000", 2024-09-17T02:21:50.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3608000000000005e-05 2024-09-17T02:21:50.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:50.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592021+0000", 2024-09-17T02:21:50.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9979999999999998e-06 2024-09-17T02:21:50.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:50.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592028+0000", 2024-09-17T02:21:50.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1439999999999997e-06 2024-09-17T02:21:50.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593633+0000", 2024-09-17T02:21:50.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001604636 2024-09-17T02:21:50.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:50.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593757+0000", 2024-09-17T02:21:50.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012432099999999999 2024-09-17T02:21:50.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:50.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593866+0000", 2024-09-17T02:21:50.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109094 2024-09-17T02:21:50.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:50.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601190+0000", 2024-09-17T02:21:50.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073237620000000002 2024-09-17T02:21:50.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:50.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601356+0000", 2024-09-17T02:21:50.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016651900000000001 2024-09-17T02:21:50.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:50.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684618+0000", 2024-09-17T02:21:50.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083261356999999994 2024-09-17T02:21:50.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:50.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684724+0000", 2024-09-17T02:21:50.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010681800000000001 2024-09-17T02:21:50.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:50.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684911+0000", 2024-09-17T02:21:50.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186243 2024-09-17T02:21:50.337 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.337 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:50.337 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.338 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97752 5.b 5:d146f486:::benchmark_data_smithi001_23533_object97751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:50.338 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:50.338 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 32.738453081000003, 2024-09-17T02:21:50.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091989557, 2024-09-17T02:21:50.338 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:50.338 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:50.338 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:50.338 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:50.338 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:50.338 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:50.338 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97752 2024-09-17T02:21:50.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.339 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:50.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:50.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:50.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:50.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:50.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:50.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593300+0000", 2024-09-17T02:21:50.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8199999999999998e-07 2024-09-17T02:21:50.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:50.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593364+0000", 2024-09-17T02:21:50.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3831999999999995e-05 2024-09-17T02:21:50.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:50.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593376+0000", 2024-09-17T02:21:50.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1800999999999999e-05 2024-09-17T02:21:50.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:50.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593382+0000", 2024-09-17T02:21:50.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6780000000000003e-06 2024-09-17T02:21:50.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595491+0000", 2024-09-17T02:21:50.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021090689999999999 2024-09-17T02:21:50.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:50.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595614+0000", 2024-09-17T02:21:50.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012321500000000001 2024-09-17T02:21:50.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:50.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595778+0000", 2024-09-17T02:21:50.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016321900000000001 2024-09-17T02:21:50.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:50.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601197+0000", 2024-09-17T02:21:50.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054195600000000003 2024-09-17T02:21:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601396+0000", 2024-09-17T02:21:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019825299999999999 2024-09-17T02:21:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684990+0000", 2024-09-17T02:21:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083594878999999997 2024-09-17T02:21:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685116+0000", 2024-09-17T02:21:50.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012522799999999999 2024-09-17T02:21:50.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:50.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685289+0000", 2024-09-17T02:21:50.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172941 2024-09-17T02:21:50.344 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.344 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:50.344 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.344 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97754 5.b 5:da0615e5:::benchmark_data_smithi001_23533_object97753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:50.345 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:50.345 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 32.736815159000002, 2024-09-17T02:21:50.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092097207, 2024-09-17T02:21:50.345 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:50.345 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:50.345 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:50.345 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:50.345 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:50.345 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:50.345 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97754 2024-09-17T02:21:50.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.345 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:50.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:50.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:50.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:50.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:50.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:50.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594938+0000", 2024-09-17T02:21:50.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5000000000000002e-07 2024-09-17T02:21:50.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:50.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595075+0000", 2024-09-17T02:21:50.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137742 2024-09-17T02:21:50.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:50.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595087+0000", 2024-09-17T02:21:50.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1243000000000001e-05 2024-09-17T02:21:50.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:50.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595095+0000", 2024-09-17T02:21:50.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1030000000000002e-06 2024-09-17T02:21:50.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598461+0000", 2024-09-17T02:21:50.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033661170000000001 2024-09-17T02:21:50.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:50.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598540+0000", 2024-09-17T02:21:50.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8937999999999995e-05 2024-09-17T02:21:50.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:50.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598626+0000", 2024-09-17T02:21:50.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6042000000000001e-05 2024-09-17T02:21:50.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:50.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684258+0000", 2024-09-17T02:21:50.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085632394000000001 2024-09-17T02:21:50.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:50.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685369+0000", 2024-09-17T02:21:50.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001111063 2024-09-17T02:21:50.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:50.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685511+0000", 2024-09-17T02:21:50.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141965 2024-09-17T02:21:50.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:50.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685604+0000", 2024-09-17T02:21:50.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2935000000000004e-05 2024-09-17T02:21:50.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:50.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687034+0000", 2024-09-17T02:21:50.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001430015 2024-09-17T02:21:50.351 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.351 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:50.351 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.351 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97755 5.b 5:d36a03a1:::benchmark_data_smithi001_23533_object97754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:50.351 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:50.351 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 32.736642009000001, 2024-09-17T02:21:50.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0924904, 2024-09-17T02:21:50.351 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:50.351 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:50.352 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:50.352 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:50.352 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:50.352 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:50.352 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97755 2024-09-17T02:21:50.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.352 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:50.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:50.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:50.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595111+0000", 2024-09-17T02:21:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:21:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595145+0000", 2024-09-17T02:21:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3927000000000002e-05 2024-09-17T02:21:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595155+0000", 2024-09-17T02:21:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0023e-05 2024-09-17T02:21:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595162+0000", 2024-09-17T02:21:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3950000000000003e-06 2024-09-17T02:21:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599821+0000", 2024-09-17T02:21:50.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046592880000000001 2024-09-17T02:21:50.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:50.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599912+0000", 2024-09-17T02:21:50.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1049000000000002e-05 2024-09-17T02:21:50.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:50.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600062+0000", 2024-09-17T02:21:50.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015001700000000001 2024-09-17T02:21:50.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:50.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685307+0000", 2024-09-17T02:21:50.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085244340000000002 2024-09-17T02:21:50.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:50.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685446+0000", 2024-09-17T02:21:50.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013955700000000001 2024-09-17T02:21:50.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:50.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687375+0000", 2024-09-17T02:21:50.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019291079999999999 2024-09-17T02:21:50.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:50.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687462+0000", 2024-09-17T02:21:50.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6148000000000003e-05 2024-09-17T02:21:50.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:50.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687600+0000", 2024-09-17T02:21:50.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013887900000000001 2024-09-17T02:21:50.357 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.357 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:50.357 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.358 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 44/44 lb 5:c4567a04:::benchmark_data_smithi001_23533_object4200:head)", 2024-09-17T02:21:50.358 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:50.358 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 32.734545382999997, 2024-09-17T02:21:50.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092483421999999996, 2024-09-17T02:21:50.358 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:50.358 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:50.358 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:50.358 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:50.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:50.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:50.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:50.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:50.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:50.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:50.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6399999999999998e-07 2024-09-17T02:21:50.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:50.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597213+0000", 2024-09-17T02:21:50.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3659999999999997e-06 2024-09-17T02:21:50.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:50.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597222+0000", 2024-09-17T02:21:50.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0510000000000002e-06 2024-09-17T02:21:50.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:50.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597228+0000", 2024-09-17T02:21:50.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1569999999999999e-06 2024-09-17T02:21:50.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689588+0000", 2024-09-17T02:21:50.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092359931000000006 2024-09-17T02:21:50.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:50.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689622+0000", 2024-09-17T02:21:50.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4425999999999999e-05 2024-09-17T02:21:50.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:50.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689690+0000", 2024-09-17T02:21:50.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8126999999999993e-05 2024-09-17T02:21:50.363 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.363 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:50.364 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.364 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129462 5.4 5:2e0acc16:::benchmark_data_smithi001_23533_object1345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:50.364 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:21:50.364 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.796811313999999, 2024-09-17T02:21:50.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0112774899999999, 2024-09-17T02:21:50.364 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:50.364 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:50.364 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:50.364 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:50.365 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:50.365 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:50.365 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129462 2024-09-17T02:21:50.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.365 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:50.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:50.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:21:50.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:50.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:21:50.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:50.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534943+0000", 2024-09-17T02:21:50.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8759999999999999e-06 2024-09-17T02:21:50.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:50.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534951+0000", 2024-09-17T02:21:50.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3219999999999993e-06 2024-09-17T02:21:50.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:50.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534977+0000", 2024-09-17T02:21:50.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6245e-05 2024-09-17T02:21:50.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:50.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534992+0000", 2024-09-17T02:21:50.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4936000000000001e-05 2024-09-17T02:21:50.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535133+0000", 2024-09-17T02:21:50.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014051299999999999 2024-09-17T02:21:50.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:50.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:21:50.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1741000000000001e-05 2024-09-17T02:21:50.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.533906+0000", 2024-09-17T02:21:50.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99875209300000001 2024-09-17T02:21:50.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:50.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534348+0000", 2024-09-17T02:21:50.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044128899999999998 2024-09-17T02:21:50.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:50.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534762+0000", 2024-09-17T02:21:50.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000414707 2024-09-17T02:21:50.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:50.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545024+0000", 2024-09-17T02:21:50.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010261283 2024-09-17T02:21:50.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:50.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545953+0000", 2024-09-17T02:21:50.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000929618 2024-09-17T02:21:50.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:50.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546047+0000", 2024-09-17T02:21:50.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3697999999999996e-05 2024-09-17T02:21:50.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:50.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546218+0000", 2024-09-17T02:21:50.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017116899999999999 2024-09-17T02:21:50.371 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.371 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:50.371 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.371 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129480 5.4 5:2b1d398b:::benchmark_data_smithi001_23533_object1363:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:50.371 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:21:50.371 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.789056848, 2024-09-17T02:21:50.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0038926450000001, 2024-09-17T02:21:50.371 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:50.372 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:50.372 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:50.372 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:50.372 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:50.372 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:50.372 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129480 2024-09-17T02:21:50.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.372 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:50.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:50.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:21:50.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:50.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:21:50.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:50.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542696+0000", 2024-09-17T02:21:50.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9999999999999995e-07 2024-09-17T02:21:50.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:50.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542701+0000", 2024-09-17T02:21:50.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2240000000000003e-06 2024-09-17T02:21:50.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:50.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542716+0000", 2024-09-17T02:21:50.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4970000000000001e-05 2024-09-17T02:21:50.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:50.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542726+0000", 2024-09-17T02:21:50.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2879999999999998e-06 2024-09-17T02:21:50.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542832+0000", 2024-09-17T02:21:50.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010597199999999999 2024-09-17T02:21:50.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:50.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542843+0000", 2024-09-17T02:21:50.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.098e-05 2024-09-17T02:21:50.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538436+0000", 2024-09-17T02:21:50.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99559286800000002 2024-09-17T02:21:50.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:50.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538791+0000", 2024-09-17T02:21:50.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035585499999999997 2024-09-17T02:21:50.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:50.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.539144+0000", 2024-09-17T02:21:50.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035268499999999999 2024-09-17T02:21:50.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:50.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545880+0000", 2024-09-17T02:21:50.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00673552 2024-09-17T02:21:50.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:50.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546330+0000", 2024-09-17T02:21:50.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045039599999999999 2024-09-17T02:21:50.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:50.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546414+0000", 2024-09-17T02:21:50.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4468000000000005e-05 2024-09-17T02:21:50.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:50.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546588+0000", 2024-09-17T02:21:50.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017341899999999999 2024-09-17T02:21:50.378 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.378 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:50.378 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.378 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129505 5.4 5:294f2ec7:::benchmark_data_smithi001_23533_object1388:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:50.378 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:21:50.378 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.770043675, 2024-09-17T02:21:50.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98589826199999997, 2024-09-17T02:21:50.379 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:50.379 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:50.379 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:50.379 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:50.379 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:50.379 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:50.379 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129505 2024-09-17T02:21:50.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.379 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:50.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:50.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:21:50.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:50.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:21:50.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:50.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561710+0000", 2024-09-17T02:21:50.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7060000000000001e-06 2024-09-17T02:21:50.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:50.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561718+0000", 2024-09-17T02:21:50.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.542e-06 2024-09-17T02:21:50.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:50.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561741+0000", 2024-09-17T02:21:50.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3357e-05 2024-09-17T02:21:50.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:50.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561754+0000", 2024-09-17T02:21:50.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3200000000000001e-05 2024-09-17T02:21:50.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561867+0000", 2024-09-17T02:21:50.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113211 2024-09-17T02:21:50.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:50.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561888+0000", 2024-09-17T02:21:50.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0809999999999999e-05 2024-09-17T02:21:50.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542140+0000", 2024-09-17T02:21:50.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98025195799999998 2024-09-17T02:21:50.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:50.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542331+0000", 2024-09-17T02:21:50.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019127599999999999 2024-09-17T02:21:50.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:50.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542517+0000", 2024-09-17T02:21:50.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000185625 2024-09-17T02:21:50.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:50.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547114+0000", 2024-09-17T02:21:50.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045968620000000002 2024-09-17T02:21:50.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:50.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547187+0000", 2024-09-17T02:21:50.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3348000000000003e-05 2024-09-17T02:21:50.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:50.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547324+0000", 2024-09-17T02:21:50.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013681699999999999 2024-09-17T02:21:50.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:50.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547607+0000", 2024-09-17T02:21:50.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028255000000000001 2024-09-17T02:21:50.385 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.385 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:50.386 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.386 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129508 5.4 5:2892b582:::benchmark_data_smithi001_23533_object1391:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:50.386 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:21:50.386 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.768706582, 2024-09-17T02:21:50.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99697919099999999, 2024-09-17T02:21:50.386 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:50.386 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:50.386 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:50.386 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:50.386 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129508 2024-09-17T02:21:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:21:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:21:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:50.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563047+0000", 2024-09-17T02:21:50.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.274e-06 2024-09-17T02:21:50.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:50.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563054+0000", 2024-09-17T02:21:50.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2799999999999998e-06 2024-09-17T02:21:50.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:50.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563070+0000", 2024-09-17T02:21:50.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5991999999999999e-05 2024-09-17T02:21:50.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:50.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563078+0000", 2024-09-17T02:21:50.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2390000000000002e-06 2024-09-17T02:21:50.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563181+0000", 2024-09-17T02:21:50.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102249 2024-09-17T02:21:50.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:50.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563199+0000", 2024-09-17T02:21:50.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8215000000000001e-05 2024-09-17T02:21:50.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547713+0000", 2024-09-17T02:21:50.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98451446399999998 2024-09-17T02:21:50.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:50.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548063+0000", 2024-09-17T02:21:50.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034985499999999999 2024-09-17T02:21:50.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:50.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548490+0000", 2024-09-17T02:21:50.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042658600000000001 2024-09-17T02:21:50.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:50.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555655+0000", 2024-09-17T02:21:50.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071652579999999999 2024-09-17T02:21:50.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:50.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559612+0000", 2024-09-17T02:21:50.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003957103 2024-09-17T02:21:50.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:50.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559768+0000", 2024-09-17T02:21:50.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015556899999999999 2024-09-17T02:21:50.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:50.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560025+0000", 2024-09-17T02:21:50.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025710700000000002 2024-09-17T02:21:50.393 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.393 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:50.393 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.393 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129509 5.4 5:2c35515e:::benchmark_data_smithi001_23533_object1392:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:50.393 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:21:50.393 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.768079529, 2024-09-17T02:21:50.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99969384900000002, 2024-09-17T02:21:50.393 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:50.394 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:50.394 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:50.394 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:50.394 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:50.394 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:50.394 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129509 2024-09-17T02:21:50.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.394 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:50.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:50.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:21:50.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:50.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:21:50.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:50.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563674+0000", 2024-09-17T02:21:50.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0920000000000001e-06 2024-09-17T02:21:50.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:50.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563679+0000", 2024-09-17T02:21:50.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7660000000000004e-06 2024-09-17T02:21:50.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:50.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563693+0000", 2024-09-17T02:21:50.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3139000000000001e-05 2024-09-17T02:21:50.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:50.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563701+0000", 2024-09-17T02:21:50.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9859999999999994e-06 2024-09-17T02:21:50.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563775+0000", 2024-09-17T02:21:50.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4659000000000005e-05 2024-09-17T02:21:50.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:50.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563785+0000", 2024-09-17T02:21:50.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4839999999999993e-06 2024-09-17T02:21:50.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552085+0000", 2024-09-17T02:21:50.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98829986999999997 2024-09-17T02:21:50.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:50.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552554+0000", 2024-09-17T02:21:50.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046908900000000001 2024-09-17T02:21:50.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:50.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552931+0000", 2024-09-17T02:21:50.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377778 2024-09-17T02:21:50.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:50.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563106+0000", 2024-09-17T02:21:50.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010174186 2024-09-17T02:21:50.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:50.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563138+0000", 2024-09-17T02:21:50.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2495e-05 2024-09-17T02:21:50.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:50.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563225+0000", 2024-09-17T02:21:50.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6677999999999999e-05 2024-09-17T02:21:50.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:50.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563366+0000", 2024-09-17T02:21:50.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014162699999999999 2024-09-17T02:21:50.400 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.400 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:50.400 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.400 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129524 5.4 5:25dca7dd:::benchmark_data_smithi001_23533_object1407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:50.400 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:21:50.400 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.761388175, 2024-09-17T02:21:50.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99999501999999996, 2024-09-17T02:21:50.401 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:50.401 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:50.401 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:50.401 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:50.401 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:50.401 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:50.401 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129524 2024-09-17T02:21:50.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.401 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:50.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:50.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:21:50.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:50.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:21:50.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:50.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570365+0000", 2024-09-17T02:21:50.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.142e-06 2024-09-17T02:21:50.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:50.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570369+0000", 2024-09-17T02:21:50.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.856e-06 2024-09-17T02:21:50.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:50.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570385+0000", 2024-09-17T02:21:50.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5855e-05 2024-09-17T02:21:50.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:50.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570392+0000", 2024-09-17T02:21:50.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5340000000000002e-06 2024-09-17T02:21:50.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570484+0000", 2024-09-17T02:21:50.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1212999999999996e-05 2024-09-17T02:21:50.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:50.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570498+0000", 2024-09-17T02:21:50.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4331000000000001e-05 2024-09-17T02:21:50.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555835+0000", 2024-09-17T02:21:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98533757700000002 2024-09-17T02:21:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556329+0000", 2024-09-17T02:21:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000493458 2024-09-17T02:21:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556784+0000", 2024-09-17T02:21:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045476499999999999 2024-09-17T02:21:50.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:50.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569852+0000", 2024-09-17T02:21:50.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013068270999999999 2024-09-17T02:21:50.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:50.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569958+0000", 2024-09-17T02:21:50.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106214 2024-09-17T02:21:50.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:50.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570124+0000", 2024-09-17T02:21:50.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165546 2024-09-17T02:21:50.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:50.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570359+0000", 2024-09-17T02:21:50.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023525799999999999 2024-09-17T02:21:50.407 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.407 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:50.407 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.407 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129537 5.4 5:260327c6:::benchmark_data_smithi001_23533_object1420:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:50.407 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:21:50.408 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.753481646000001, 2024-09-17T02:21:50.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99624596499999996, 2024-09-17T02:21:50.408 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:50.408 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:50.408 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:50.408 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:50.408 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:50.408 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:50.408 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129537 2024-09-17T02:21:50.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.408 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:50.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:50.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:21:50.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:50.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:21:50.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:50.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578272+0000", 2024-09-17T02:21:50.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.164e-06 2024-09-17T02:21:50.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:50.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578278+0000", 2024-09-17T02:21:50.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5060000000000001e-06 2024-09-17T02:21:50.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:50.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578294+0000", 2024-09-17T02:21:50.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5687000000000001e-05 2024-09-17T02:21:50.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:50.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578329+0000", 2024-09-17T02:21:50.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5311999999999997e-05 2024-09-17T02:21:50.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578419+0000", 2024-09-17T02:21:50.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0054000000000002e-05 2024-09-17T02:21:50.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:50.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578435+0000", 2024-09-17T02:21:50.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5645999999999999e-05 2024-09-17T02:21:50.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560148+0000", 2024-09-17T02:21:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98171342299999997 2024-09-17T02:21:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560383+0000", 2024-09-17T02:21:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000234935 2024-09-17T02:21:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560586+0000", 2024-09-17T02:21:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000202909 2024-09-17T02:21:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:50.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570472+0000", 2024-09-17T02:21:50.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098856959999999994 2024-09-17T02:21:50.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:50.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574138+0000", 2024-09-17T02:21:50.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036660170000000001 2024-09-17T02:21:50.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:50.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574298+0000", 2024-09-17T02:21:50.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016025600000000001 2024-09-17T02:21:50.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:50.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574516+0000", 2024-09-17T02:21:50.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021835999999999999 2024-09-17T02:21:50.414 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.414 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:50.414 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.414 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129545 5.4 5:22366489:::benchmark_data_smithi001_23533_object1428:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:21:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.747618922999999, 2024-09-17T02:21:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99074544499999995, 2024-09-17T02:21:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129545 2024-09-17T02:21:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:50.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:21:50.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:50.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:21:50.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:50.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584135+0000", 2024-09-17T02:21:50.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4699999999999999e-06 2024-09-17T02:21:50.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:50.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584142+0000", 2024-09-17T02:21:50.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1620000000000002e-06 2024-09-17T02:21:50.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:50.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584170+0000", 2024-09-17T02:21:50.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7897000000000001e-05 2024-09-17T02:21:50.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:50.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584183+0000", 2024-09-17T02:21:50.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2814e-05 2024-09-17T02:21:50.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584299+0000", 2024-09-17T02:21:50.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116153 2024-09-17T02:21:50.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:50.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584316+0000", 2024-09-17T02:21:50.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7524999999999999e-05 2024-09-17T02:21:50.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563461+0000", 2024-09-17T02:21:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97914436699999996 2024-09-17T02:21:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563667+0000", 2024-09-17T02:21:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020689800000000001 2024-09-17T02:21:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563878+0000", 2024-09-17T02:21:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210275 2024-09-17T02:21:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:50.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570584+0000", 2024-09-17T02:21:50.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067066080000000002 2024-09-17T02:21:50.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:50.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574539+0000", 2024-09-17T02:21:50.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039550360000000003 2024-09-17T02:21:50.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:50.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574653+0000", 2024-09-17T02:21:50.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114003 2024-09-17T02:21:50.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:50.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574879+0000", 2024-09-17T02:21:50.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022523700000000001 2024-09-17T02:21:50.421 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.421 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:50.421 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.421 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129553 5.4 5:2e41ad40:::benchmark_data_smithi001_23533_object1436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:50.421 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:21:50.421 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.742196287000001, 2024-09-17T02:21:50.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99213429600000003, 2024-09-17T02:21:50.422 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:50.422 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:50.422 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:50.422 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:50.422 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:50.422 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:50.422 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129553 2024-09-17T02:21:50.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.422 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:50.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:50.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:21:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:21:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589557+0000", 2024-09-17T02:21:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2219999999999999e-06 2024-09-17T02:21:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:50.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589562+0000", 2024-09-17T02:21:50.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0649999999999998e-06 2024-09-17T02:21:50.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:50.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589575+0000", 2024-09-17T02:21:50.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3129000000000001e-05 2024-09-17T02:21:50.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:50.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589584+0000", 2024-09-17T02:21:50.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6200000000000005e-06 2024-09-17T02:21:50.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589693+0000", 2024-09-17T02:21:50.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109319 2024-09-17T02:21:50.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:50.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589714+0000", 2024-09-17T02:21:50.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0849999999999999e-05 2024-09-17T02:21:50.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566273+0000", 2024-09-17T02:21:50.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97655884999999998 2024-09-17T02:21:50.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:50.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566543+0000", 2024-09-17T02:21:50.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027059099999999998 2024-09-17T02:21:50.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:50.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566832+0000", 2024-09-17T02:21:50.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028898200000000002 2024-09-17T02:21:50.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:50.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581040+0000", 2024-09-17T02:21:50.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014208001 2024-09-17T02:21:50.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:50.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581200+0000", 2024-09-17T02:21:50.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159956 2024-09-17T02:21:50.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:50.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581427+0000", 2024-09-17T02:21:50.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000226309 2024-09-17T02:21:50.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:50.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581690+0000", 2024-09-17T02:21:50.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026340199999999998 2024-09-17T02:21:50.428 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.428 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:50.428 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.428 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129580 5.4 5:25ed887b:::benchmark_data_smithi001_23533_object1463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:50.428 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:21:50.429 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.720424243, 2024-09-17T02:21:50.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98001430499999997, 2024-09-17T02:21:50.429 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:50.429 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:50.429 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:50.429 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:50.429 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:50.429 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:50.429 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129580 2024-09-17T02:21:50.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.429 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:50.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:50.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:21:50.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:50.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:21:50.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:50.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611329+0000", 2024-09-17T02:21:50.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.22e-06 2024-09-17T02:21:50.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:50.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611335+0000", 2024-09-17T02:21:50.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1129999999999997e-06 2024-09-17T02:21:50.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:50.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611348+0000", 2024-09-17T02:21:50.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2342e-05 2024-09-17T02:21:50.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:50.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611356+0000", 2024-09-17T02:21:50.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.371e-06 2024-09-17T02:21:50.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611419+0000", 2024-09-17T02:21:50.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3393999999999996e-05 2024-09-17T02:21:50.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:50.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611427+0000", 2024-09-17T02:21:50.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999997e-06 2024-09-17T02:21:50.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570705+0000", 2024-09-17T02:21:50.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.95927859199999999 2024-09-17T02:21:50.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:50.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571009+0000", 2024-09-17T02:21:50.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030414599999999998 2024-09-17T02:21:50.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:50.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571241+0000", 2024-09-17T02:21:50.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023106799999999999 2024-09-17T02:21:50.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:50.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590789+0000", 2024-09-17T02:21:50.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019548763 2024-09-17T02:21:50.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:50.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590928+0000", 2024-09-17T02:21:50.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000139092 2024-09-17T02:21:50.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591086+0000", 2024-09-17T02:21:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015787400000000001 2024-09-17T02:21:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591342+0000", 2024-09-17T02:21:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025589900000000002 2024-09-17T02:21:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.436 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129603 5.4 5:25aaa5e8:::benchmark_data_smithi001_23533_object1486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:50.436 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:50.436 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.704364447, 2024-09-17T02:21:50.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96463198999999999, 2024-09-17T02:21:50.436 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:50.436 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:50.436 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:50.436 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:50.436 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:50.436 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:50.436 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129603 2024-09-17T02:21:50.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.436 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:50.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:50.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:50.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:50.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:50.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:50.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:50.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:21:50.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:50.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627392+0000", 2024-09-17T02:21:50.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0790000000000002e-06 2024-09-17T02:21:50.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:50.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627403+0000", 2024-09-17T02:21:50.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0866000000000001e-05 2024-09-17T02:21:50.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627409+0000", 2024-09-17T02:21:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.305e-06 2024-09-17T02:21:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627485+0000", 2024-09-17T02:21:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6582000000000006e-05 2024-09-17T02:21:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627499+0000", 2024-09-17T02:21:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:21:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574991+0000", 2024-09-17T02:21:50.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94749182300000001 2024-09-17T02:21:50.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:50.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575377+0000", 2024-09-17T02:21:50.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038629400000000003 2024-09-17T02:21:50.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:50.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575665+0000", 2024-09-17T02:21:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028759499999999997 2024-09-17T02:21:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590802+0000", 2024-09-17T02:21:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015136479 2024-09-17T02:21:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591614+0000", 2024-09-17T02:21:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081293100000000003 2024-09-17T02:21:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:50.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591764+0000", 2024-09-17T02:21:50.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014932199999999999 2024-09-17T02:21:50.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:50.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592020+0000", 2024-09-17T02:21:50.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025585099999999997 2024-09-17T02:21:50.442 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.442 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:50.442 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.442 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129607 5.4 5:2f638f1e:::benchmark_data_smithi001_23533_object1490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:50.443 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:21:50.443 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.702837540999999, 2024-09-17T02:21:50.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96352375899999998, 2024-09-17T02:21:50.443 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:50.443 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:50.443 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:50.443 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:50.443 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:50.443 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:50.443 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129607 2024-09-17T02:21:50.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.443 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:50.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:50.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:21:50.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:50.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:21:50.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:50.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628916+0000", 2024-09-17T02:21:50.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1710000000000001e-06 2024-09-17T02:21:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628920+0000", 2024-09-17T02:21:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-17T02:21:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628935+0000", 2024-09-17T02:21:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4474000000000001e-05 2024-09-17T02:21:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628944+0000", 2024-09-17T02:21:50.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9940000000000006e-06 2024-09-17T02:21:50.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628997+0000", 2024-09-17T02:21:50.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3579000000000003e-05 2024-09-17T02:21:50.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:50.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.629006+0000", 2024-09-17T02:21:50.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4009999999999997e-06 2024-09-17T02:21:50.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.577862+0000", 2024-09-17T02:21:50.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.948856335 2024-09-17T02:21:50.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:50.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578167+0000", 2024-09-17T02:21:50.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030532399999999999 2024-09-17T02:21:50.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:50.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578532+0000", 2024-09-17T02:21:50.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036428200000000001 2024-09-17T02:21:50.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:50.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591442+0000", 2024-09-17T02:21:50.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012910374000000001 2024-09-17T02:21:50.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:50.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592164+0000", 2024-09-17T02:21:50.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072242499999999996 2024-09-17T02:21:50.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592267+0000", 2024-09-17T02:21:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102205 2024-09-17T02:21:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592438+0000", 2024-09-17T02:21:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017165299999999999 2024-09-17T02:21:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129623 5.4 5:2cf5174b:::benchmark_data_smithi001_23533_object1506:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:21:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.678893255, 2024-09-17T02:21:50.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94334114499999999, 2024-09-17T02:21:50.450 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:50.450 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:50.450 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:50.450 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:50.450 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:50.450 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:50.450 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129623 2024-09-17T02:21:50.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.450 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:50.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:50.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:21:50.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:50.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:21:50.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:50.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652860+0000", 2024-09-17T02:21:50.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0330000000000001e-06 2024-09-17T02:21:50.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:50.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652864+0000", 2024-09-17T02:21:50.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.634e-06 2024-09-17T02:21:50.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:50.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652877+0000", 2024-09-17T02:21:50.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2591e-05 2024-09-17T02:21:50.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:50.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652883+0000", 2024-09-17T02:21:50.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1460000000000001e-06 2024-09-17T02:21:50.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652943+0000", 2024-09-17T02:21:50.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9833999999999997e-05 2024-09-17T02:21:50.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:50.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652950+0000", 2024-09-17T02:21:50.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.401e-06 2024-09-17T02:21:50.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581800+0000", 2024-09-17T02:21:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.92884935700000004 2024-09-17T02:21:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582122+0000", 2024-09-17T02:21:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032185200000000002 2024-09-17T02:21:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582689+0000", 2024-09-17T02:21:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056750400000000003 2024-09-17T02:21:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:50.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591458+0000", 2024-09-17T02:21:50.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008768685 2024-09-17T02:21:50.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:50.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595856+0000", 2024-09-17T02:21:50.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043977909999999999 2024-09-17T02:21:50.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:50.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595955+0000", 2024-09-17T02:21:50.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9166000000000006e-05 2024-09-17T02:21:50.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:50.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596200+0000", 2024-09-17T02:21:50.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024515099999999998 2024-09-17T02:21:50.456 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.456 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:50.456 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.456 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129642 5.4 5:255eb796:::benchmark_data_smithi001_23533_object1525:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:50.456 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:21:50.456 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.647657090999999, 2024-09-17T02:21:50.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.91257397299999998, 2024-09-17T02:21:50.457 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:50.457 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:50.457 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:50.457 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:50.457 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:50.457 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:50.457 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129642 2024-09-17T02:21:50.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.457 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:50.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:50.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:21:50.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:50.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:21:50.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:50.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684096+0000", 2024-09-17T02:21:50.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659999999999999e-06 2024-09-17T02:21:50.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:50.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684101+0000", 2024-09-17T02:21:50.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8110000000000002e-06 2024-09-17T02:21:50.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:50.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684114+0000", 2024-09-17T02:21:50.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2653000000000001e-05 2024-09-17T02:21:50.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:50.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684121+0000", 2024-09-17T02:21:50.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5100000000000001e-06 2024-09-17T02:21:50.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684181+0000", 2024-09-17T02:21:50.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0307999999999999e-05 2024-09-17T02:21:50.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:50.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684194+0000", 2024-09-17T02:21:50.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2916e-05 2024-09-17T02:21:50.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.587917+0000", 2024-09-17T02:21:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.90372220400000003 2024-09-17T02:21:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588215+0000", 2024-09-17T02:21:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029845400000000003 2024-09-17T02:21:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588470+0000", 2024-09-17T02:21:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025455399999999999 2024-09-17T02:21:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:50.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596318+0000", 2024-09-17T02:21:50.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078485589999999997 2024-09-17T02:21:50.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:50.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596354+0000", 2024-09-17T02:21:50.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5976999999999998e-05 2024-09-17T02:21:50.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:50.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596449+0000", 2024-09-17T02:21:50.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4728999999999994e-05 2024-09-17T02:21:50.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:50.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596669+0000", 2024-09-17T02:21:50.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220132 2024-09-17T02:21:50.463 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.463 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:50.463 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.463 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129649 5.4 5:2fe27050:::benchmark_data_smithi001_23533_object1532:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:50.464 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:21:50.464 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.616100348, 2024-09-17T02:21:50.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.88508119100000004, 2024-09-17T02:21:50.464 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:50.464 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:50.464 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:50.464 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:50.464 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:50.464 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:50.464 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129649 2024-09-17T02:21:50.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.464 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:50.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:50.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:21:50.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:50.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:21:50.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:50.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:50.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715653+0000", 2024-09-17T02:21:50.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3519999999999999e-06 2024-09-17T02:21:50.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:50.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715658+0000", 2024-09-17T02:21:50.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3120000000000001e-06 2024-09-17T02:21:50.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:50.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715677+0000", 2024-09-17T02:21:50.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-17T02:21:50.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:50.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715687+0000", 2024-09-17T02:21:50.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0146000000000001e-05 2024-09-17T02:21:50.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715821+0000", 2024-09-17T02:21:50.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013421 2024-09-17T02:21:50.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:50.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715840+0000", 2024-09-17T02:21:50.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8153999999999999e-05 2024-09-17T02:21:50.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:50.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592528+0000", 2024-09-17T02:21:50.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.87668860000000004 2024-09-17T02:21:50.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:50.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592702+0000", 2024-09-17T02:21:50.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017429300000000001 2024-09-17T02:21:50.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:50.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592945+0000", 2024-09-17T02:21:50.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000242048 2024-09-17T02:21:50.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:50.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600234+0000", 2024-09-17T02:21:50.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072897600000000002 2024-09-17T02:21:50.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:50.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600494+0000", 2024-09-17T02:21:50.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000259984 2024-09-17T02:21:50.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:50.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600555+0000", 2024-09-17T02:21:50.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1138999999999999e-05 2024-09-17T02:21:50.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:50.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:50.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:50.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600733+0000", 2024-09-17T02:21:50.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017753300000000001 2024-09-17T02:21:50.471 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.471 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:50.471 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.471 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:50.471 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:50.471 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:50.472 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:21:50.473 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:21:50.473 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:50.476 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:50.476+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:50.488 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:21:50.488 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:21:50.488 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:21:50.491 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:21:50.492 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:21:50.573 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:50.576+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:50.621 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:50.621 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:50.641 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:50.692 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:50.693+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:50.776 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:50.777+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:50.796 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:50.796 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:50.815 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:50.876 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:50.880+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:50.977 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~12s 2024-09-17T02:21:50.978 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:50.977+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:50.978 INFO:teuthology.orchestra.run.smithi001.stderr:nodeep-scrub is unset 2024-09-17T02:21:51.014 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:51.014 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:51.036 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:51.079 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:51.081+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:51.178 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:51.180+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:51.187 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:51.187 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:51.207 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:51.279 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:51.281+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:51.381 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:51.384+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:51.395 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:51.395 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:51.414 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:51.500 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:51.504+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:51.583 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:51.581+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:51.608 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:51.608 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:51.627 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:51.684 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:51.685+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:51.778 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:51.778 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:51.784 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:51.785+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:51.799 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:51.885 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:51.885+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:51.986 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:51.988+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:51.990 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:51.991 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:52.011 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:52.087 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:52.088+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:52.188 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:52.189+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:52.215 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:52.215 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:52.236 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:52.290 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:52.292+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:52.376 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:52.376 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:52.390 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:52.389+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:52.392 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:52.491 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:52.492+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:52.492 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:21:52.588 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:52.588 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:52.592 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:52.593+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:52.607 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:52.628 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-17T02:21:52.652 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:21:52.653 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:21:52.671 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:21:52.671 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:21:52.671 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:21:52.675 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:21:52.675 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:21:52.693 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:52.693+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:52.740 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2024-09-17T02:21:52.794 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:52.796+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:52.799 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:52.799 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:21:52.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:21:52.800 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:52.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.800 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97749 5.b 5:d930ef52:::benchmark_data_smithi001_23533_object97748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:52.800 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:52.800 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.209342220000003, 2024-09-17T02:21:52.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092964343000000005, 2024-09-17T02:21:52.800 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:52.800 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:52.800 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:52.800 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:52.800 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:52.801 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:52.801 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97749 2024-09-17T02:21:52.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.801 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:52.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:52.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:52.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:52.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:52.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:52.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591947+0000", 2024-09-17T02:21:52.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:21:52.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:52.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592011+0000", 2024-09-17T02:21:52.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3608000000000005e-05 2024-09-17T02:21:52.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:52.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592021+0000", 2024-09-17T02:21:52.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9979999999999998e-06 2024-09-17T02:21:52.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:52.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592028+0000", 2024-09-17T02:21:52.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1439999999999997e-06 2024-09-17T02:21:52.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593633+0000", 2024-09-17T02:21:52.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001604636 2024-09-17T02:21:52.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:52.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593757+0000", 2024-09-17T02:21:52.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012432099999999999 2024-09-17T02:21:52.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:52.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593866+0000", 2024-09-17T02:21:52.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109094 2024-09-17T02:21:52.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:52.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601190+0000", 2024-09-17T02:21:52.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073237620000000002 2024-09-17T02:21:52.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:52.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601356+0000", 2024-09-17T02:21:52.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016651900000000001 2024-09-17T02:21:52.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:52.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684618+0000", 2024-09-17T02:21:52.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083261356999999994 2024-09-17T02:21:52.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:52.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684724+0000", 2024-09-17T02:21:52.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010681800000000001 2024-09-17T02:21:52.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:52.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684911+0000", 2024-09-17T02:21:52.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186243 2024-09-17T02:21:52.807 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.807 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:52.807 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.807 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97752 5.b 5:d146f486:::benchmark_data_smithi001_23533_object97751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:52.808 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:52.808 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.207989525999999, 2024-09-17T02:21:52.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091989557, 2024-09-17T02:21:52.808 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:52.808 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:52.808 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:52.808 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:52.808 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:52.808 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:52.808 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97752 2024-09-17T02:21:52.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.808 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:52.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:52.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:52.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:52.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:52.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:52.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593300+0000", 2024-09-17T02:21:52.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8199999999999998e-07 2024-09-17T02:21:52.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:52.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593364+0000", 2024-09-17T02:21:52.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3831999999999995e-05 2024-09-17T02:21:52.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:52.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593376+0000", 2024-09-17T02:21:52.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1800999999999999e-05 2024-09-17T02:21:52.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:52.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593382+0000", 2024-09-17T02:21:52.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6780000000000003e-06 2024-09-17T02:21:52.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595491+0000", 2024-09-17T02:21:52.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021090689999999999 2024-09-17T02:21:52.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:52.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595614+0000", 2024-09-17T02:21:52.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012321500000000001 2024-09-17T02:21:52.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:52.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595778+0000", 2024-09-17T02:21:52.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016321900000000001 2024-09-17T02:21:52.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:52.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601197+0000", 2024-09-17T02:21:52.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054195600000000003 2024-09-17T02:21:52.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:52.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601396+0000", 2024-09-17T02:21:52.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019825299999999999 2024-09-17T02:21:52.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:52.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684990+0000", 2024-09-17T02:21:52.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083594878999999997 2024-09-17T02:21:52.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:52.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685116+0000", 2024-09-17T02:21:52.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012522799999999999 2024-09-17T02:21:52.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:52.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685289+0000", 2024-09-17T02:21:52.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172941 2024-09-17T02:21:52.815 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.815 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:52.815 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.815 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97754 5.b 5:da0615e5:::benchmark_data_smithi001_23533_object97753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:52.815 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:52.815 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.206351603999998, 2024-09-17T02:21:52.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092097207, 2024-09-17T02:21:52.815 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:52.815 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:52.815 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:52.815 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:52.816 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:52.816 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:52.816 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97754 2024-09-17T02:21:52.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.816 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:52.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:52.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:52.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:52.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:52.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:52.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594938+0000", 2024-09-17T02:21:52.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5000000000000002e-07 2024-09-17T02:21:52.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:52.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595075+0000", 2024-09-17T02:21:52.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137742 2024-09-17T02:21:52.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:52.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595087+0000", 2024-09-17T02:21:52.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1243000000000001e-05 2024-09-17T02:21:52.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:52.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595095+0000", 2024-09-17T02:21:52.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1030000000000002e-06 2024-09-17T02:21:52.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598461+0000", 2024-09-17T02:21:52.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033661170000000001 2024-09-17T02:21:52.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:52.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598540+0000", 2024-09-17T02:21:52.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8937999999999995e-05 2024-09-17T02:21:52.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:52.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598626+0000", 2024-09-17T02:21:52.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6042000000000001e-05 2024-09-17T02:21:52.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:52.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684258+0000", 2024-09-17T02:21:52.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085632394000000001 2024-09-17T02:21:52.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:52.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685369+0000", 2024-09-17T02:21:52.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001111063 2024-09-17T02:21:52.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:52.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685511+0000", 2024-09-17T02:21:52.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141965 2024-09-17T02:21:52.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:52.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685604+0000", 2024-09-17T02:21:52.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2935000000000004e-05 2024-09-17T02:21:52.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:52.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687034+0000", 2024-09-17T02:21:52.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001430015 2024-09-17T02:21:52.821 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.821 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:52.821 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.822 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97755 5.b 5:d36a03a1:::benchmark_data_smithi001_23533_object97754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:52.822 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:52.822 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.206178454000003, 2024-09-17T02:21:52.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0924904, 2024-09-17T02:21:52.822 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:52.822 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:52.822 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:52.822 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:52.822 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:52.822 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:52.822 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97755 2024-09-17T02:21:52.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.823 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:52.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:52.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:52.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:52.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:52.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:52.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595111+0000", 2024-09-17T02:21:52.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:21:52.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:52.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595145+0000", 2024-09-17T02:21:52.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3927000000000002e-05 2024-09-17T02:21:52.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:52.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595155+0000", 2024-09-17T02:21:52.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0023e-05 2024-09-17T02:21:52.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:52.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595162+0000", 2024-09-17T02:21:52.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3950000000000003e-06 2024-09-17T02:21:52.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599821+0000", 2024-09-17T02:21:52.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046592880000000001 2024-09-17T02:21:52.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:52.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599912+0000", 2024-09-17T02:21:52.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1049000000000002e-05 2024-09-17T02:21:52.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:52.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600062+0000", 2024-09-17T02:21:52.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015001700000000001 2024-09-17T02:21:52.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:52.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685307+0000", 2024-09-17T02:21:52.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085244340000000002 2024-09-17T02:21:52.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:52.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685446+0000", 2024-09-17T02:21:52.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013955700000000001 2024-09-17T02:21:52.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:52.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687375+0000", 2024-09-17T02:21:52.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019291079999999999 2024-09-17T02:21:52.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:52.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687462+0000", 2024-09-17T02:21:52.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6148000000000003e-05 2024-09-17T02:21:52.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:52.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687600+0000", 2024-09-17T02:21:52.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013887900000000001 2024-09-17T02:21:52.828 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.828 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:52.828 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.828 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 44/44 lb 5:c4567a04:::benchmark_data_smithi001_23533_object4200:head)", 2024-09-17T02:21:52.828 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:52.828 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.204081828, 2024-09-17T02:21:52.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092483421999999996, 2024-09-17T02:21:52.829 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:52.829 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:52.829 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:52.829 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:52.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:52.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:52.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:52.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:52.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:52.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:52.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6399999999999998e-07 2024-09-17T02:21:52.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:52.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597213+0000", 2024-09-17T02:21:52.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3659999999999997e-06 2024-09-17T02:21:52.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:52.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597222+0000", 2024-09-17T02:21:52.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0510000000000002e-06 2024-09-17T02:21:52.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:52.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597228+0000", 2024-09-17T02:21:52.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1569999999999999e-06 2024-09-17T02:21:52.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689588+0000", 2024-09-17T02:21:52.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092359931000000006 2024-09-17T02:21:52.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:52.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689622+0000", 2024-09-17T02:21:52.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4425999999999999e-05 2024-09-17T02:21:52.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:52.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689690+0000", 2024-09-17T02:21:52.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8126999999999993e-05 2024-09-17T02:21:52.832 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.832 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:52.832 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.833 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129462 5.4 5:2e0acc16:::benchmark_data_smithi001_23533_object1345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:52.833 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:21:52.833 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.266347758999999, 2024-09-17T02:21:52.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0112774899999999, 2024-09-17T02:21:52.833 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:52.833 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:52.833 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:52.833 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:52.833 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:52.833 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:52.833 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129462 2024-09-17T02:21:52.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.833 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:52.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:52.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:21:52.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:52.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:21:52.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:52.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534943+0000", 2024-09-17T02:21:52.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8759999999999999e-06 2024-09-17T02:21:52.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:52.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534951+0000", 2024-09-17T02:21:52.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3219999999999993e-06 2024-09-17T02:21:52.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:52.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534977+0000", 2024-09-17T02:21:52.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6245e-05 2024-09-17T02:21:52.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:52.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534992+0000", 2024-09-17T02:21:52.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4936000000000001e-05 2024-09-17T02:21:52.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535133+0000", 2024-09-17T02:21:52.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014051299999999999 2024-09-17T02:21:52.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:52.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:21:52.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1741000000000001e-05 2024-09-17T02:21:52.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.533906+0000", 2024-09-17T02:21:52.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99875209300000001 2024-09-17T02:21:52.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:52.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534348+0000", 2024-09-17T02:21:52.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044128899999999998 2024-09-17T02:21:52.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:52.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534762+0000", 2024-09-17T02:21:52.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000414707 2024-09-17T02:21:52.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:52.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545024+0000", 2024-09-17T02:21:52.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010261283 2024-09-17T02:21:52.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:52.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545953+0000", 2024-09-17T02:21:52.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000929618 2024-09-17T02:21:52.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:52.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546047+0000", 2024-09-17T02:21:52.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3697999999999996e-05 2024-09-17T02:21:52.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:52.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546218+0000", 2024-09-17T02:21:52.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017116899999999999 2024-09-17T02:21:52.839 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.839 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:52.839 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.839 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129480 5.4 5:2b1d398b:::benchmark_data_smithi001_23533_object1363:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:52.839 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:21:52.840 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.258593293000001, 2024-09-17T02:21:52.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0038926450000001, 2024-09-17T02:21:52.840 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:52.840 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:52.840 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:52.840 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:52.840 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:52.840 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:52.840 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129480 2024-09-17T02:21:52.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.840 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:52.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:52.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:21:52.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:52.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:21:52.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:52.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542696+0000", 2024-09-17T02:21:52.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9999999999999995e-07 2024-09-17T02:21:52.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:52.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542701+0000", 2024-09-17T02:21:52.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2240000000000003e-06 2024-09-17T02:21:52.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:52.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542716+0000", 2024-09-17T02:21:52.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4970000000000001e-05 2024-09-17T02:21:52.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:52.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542726+0000", 2024-09-17T02:21:52.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2879999999999998e-06 2024-09-17T02:21:52.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542832+0000", 2024-09-17T02:21:52.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010597199999999999 2024-09-17T02:21:52.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:52.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542843+0000", 2024-09-17T02:21:52.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.098e-05 2024-09-17T02:21:52.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538436+0000", 2024-09-17T02:21:52.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99559286800000002 2024-09-17T02:21:52.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:52.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538791+0000", 2024-09-17T02:21:52.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035585499999999997 2024-09-17T02:21:52.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:52.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.539144+0000", 2024-09-17T02:21:52.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035268499999999999 2024-09-17T02:21:52.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:52.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545880+0000", 2024-09-17T02:21:52.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00673552 2024-09-17T02:21:52.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:52.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546330+0000", 2024-09-17T02:21:52.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045039599999999999 2024-09-17T02:21:52.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:52.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546414+0000", 2024-09-17T02:21:52.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4468000000000005e-05 2024-09-17T02:21:52.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:52.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546588+0000", 2024-09-17T02:21:52.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017341899999999999 2024-09-17T02:21:52.846 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.846 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:52.846 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.846 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129505 5.4 5:294f2ec7:::benchmark_data_smithi001_23533_object1388:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:52.846 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:21:52.846 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.239580119999999, 2024-09-17T02:21:52.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98589826199999997, 2024-09-17T02:21:52.847 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:52.847 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:52.847 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:52.847 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:52.847 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:52.847 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:52.847 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129505 2024-09-17T02:21:52.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.847 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:52.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:52.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:21:52.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:52.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:21:52.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:52.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561710+0000", 2024-09-17T02:21:52.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7060000000000001e-06 2024-09-17T02:21:52.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:52.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561718+0000", 2024-09-17T02:21:52.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.542e-06 2024-09-17T02:21:52.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:52.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561741+0000", 2024-09-17T02:21:52.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3357e-05 2024-09-17T02:21:52.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:52.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561754+0000", 2024-09-17T02:21:52.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3200000000000001e-05 2024-09-17T02:21:52.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561867+0000", 2024-09-17T02:21:52.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113211 2024-09-17T02:21:52.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:52.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561888+0000", 2024-09-17T02:21:52.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0809999999999999e-05 2024-09-17T02:21:52.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542140+0000", 2024-09-17T02:21:52.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98025195799999998 2024-09-17T02:21:52.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:52.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542331+0000", 2024-09-17T02:21:52.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019127599999999999 2024-09-17T02:21:52.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:52.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542517+0000", 2024-09-17T02:21:52.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000185625 2024-09-17T02:21:52.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:52.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547114+0000", 2024-09-17T02:21:52.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045968620000000002 2024-09-17T02:21:52.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:52.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547187+0000", 2024-09-17T02:21:52.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3348000000000003e-05 2024-09-17T02:21:52.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:52.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547324+0000", 2024-09-17T02:21:52.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013681699999999999 2024-09-17T02:21:52.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:52.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547607+0000", 2024-09-17T02:21:52.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028255000000000001 2024-09-17T02:21:52.853 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.853 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:52.853 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.853 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129508 5.4 5:2892b582:::benchmark_data_smithi001_23533_object1391:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:52.854 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:21:52.854 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.238243026999999, 2024-09-17T02:21:52.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99697919099999999, 2024-09-17T02:21:52.854 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:52.854 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:52.854 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:52.854 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:52.854 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:52.854 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:52.854 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129508 2024-09-17T02:21:52.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.855 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:52.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:52.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:21:52.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:52.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:21:52.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:52.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563047+0000", 2024-09-17T02:21:52.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.274e-06 2024-09-17T02:21:52.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:52.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563054+0000", 2024-09-17T02:21:52.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2799999999999998e-06 2024-09-17T02:21:52.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:52.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563070+0000", 2024-09-17T02:21:52.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5991999999999999e-05 2024-09-17T02:21:52.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:52.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563078+0000", 2024-09-17T02:21:52.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2390000000000002e-06 2024-09-17T02:21:52.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563181+0000", 2024-09-17T02:21:52.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102249 2024-09-17T02:21:52.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:52.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563199+0000", 2024-09-17T02:21:52.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8215000000000001e-05 2024-09-17T02:21:52.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547713+0000", 2024-09-17T02:21:52.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98451446399999998 2024-09-17T02:21:52.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:52.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548063+0000", 2024-09-17T02:21:52.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034985499999999999 2024-09-17T02:21:52.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:52.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548490+0000", 2024-09-17T02:21:52.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042658600000000001 2024-09-17T02:21:52.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:52.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555655+0000", 2024-09-17T02:21:52.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071652579999999999 2024-09-17T02:21:52.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:52.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559612+0000", 2024-09-17T02:21:52.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003957103 2024-09-17T02:21:52.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:52.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559768+0000", 2024-09-17T02:21:52.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015556899999999999 2024-09-17T02:21:52.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:52.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560025+0000", 2024-09-17T02:21:52.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025710700000000002 2024-09-17T02:21:52.860 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.860 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:52.860 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.861 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129509 5.4 5:2c35515e:::benchmark_data_smithi001_23533_object1392:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:52.861 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:21:52.861 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.237615974000001, 2024-09-17T02:21:52.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99969384900000002, 2024-09-17T02:21:52.861 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:52.861 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:52.861 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:52.861 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:52.861 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:52.861 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:52.861 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129509 2024-09-17T02:21:52.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.861 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:52.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:52.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:21:52.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:52.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:21:52.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:52.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563674+0000", 2024-09-17T02:21:52.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0920000000000001e-06 2024-09-17T02:21:52.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:52.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563679+0000", 2024-09-17T02:21:52.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7660000000000004e-06 2024-09-17T02:21:52.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:52.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563693+0000", 2024-09-17T02:21:52.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3139000000000001e-05 2024-09-17T02:21:52.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:52.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563701+0000", 2024-09-17T02:21:52.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9859999999999994e-06 2024-09-17T02:21:52.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563775+0000", 2024-09-17T02:21:52.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4659000000000005e-05 2024-09-17T02:21:52.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:52.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563785+0000", 2024-09-17T02:21:52.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4839999999999993e-06 2024-09-17T02:21:52.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552085+0000", 2024-09-17T02:21:52.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98829986999999997 2024-09-17T02:21:52.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:52.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552554+0000", 2024-09-17T02:21:52.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046908900000000001 2024-09-17T02:21:52.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:52.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552931+0000", 2024-09-17T02:21:52.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377778 2024-09-17T02:21:52.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:52.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563106+0000", 2024-09-17T02:21:52.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010174186 2024-09-17T02:21:52.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:52.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563138+0000", 2024-09-17T02:21:52.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2495e-05 2024-09-17T02:21:52.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:52.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563225+0000", 2024-09-17T02:21:52.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6677999999999999e-05 2024-09-17T02:21:52.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:52.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563366+0000", 2024-09-17T02:21:52.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014162699999999999 2024-09-17T02:21:52.867 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.867 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:52.867 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.867 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129524 5.4 5:25dca7dd:::benchmark_data_smithi001_23533_object1407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:52.868 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:21:52.868 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.23092462, 2024-09-17T02:21:52.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99999501999999996, 2024-09-17T02:21:52.868 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:52.868 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:52.868 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:52.868 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:52.868 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:52.868 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:52.868 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129524 2024-09-17T02:21:52.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.868 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:52.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:52.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:21:52.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:52.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:21:52.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:52.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570365+0000", 2024-09-17T02:21:52.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.142e-06 2024-09-17T02:21:52.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:52.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570369+0000", 2024-09-17T02:21:52.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.856e-06 2024-09-17T02:21:52.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:52.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570385+0000", 2024-09-17T02:21:52.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5855e-05 2024-09-17T02:21:52.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:52.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570392+0000", 2024-09-17T02:21:52.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5340000000000002e-06 2024-09-17T02:21:52.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570484+0000", 2024-09-17T02:21:52.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1212999999999996e-05 2024-09-17T02:21:52.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:52.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570498+0000", 2024-09-17T02:21:52.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4331000000000001e-05 2024-09-17T02:21:52.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555835+0000", 2024-09-17T02:21:52.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98533757700000002 2024-09-17T02:21:52.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:52.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556329+0000", 2024-09-17T02:21:52.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000493458 2024-09-17T02:21:52.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:52.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556784+0000", 2024-09-17T02:21:52.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045476499999999999 2024-09-17T02:21:52.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:52.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569852+0000", 2024-09-17T02:21:52.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013068270999999999 2024-09-17T02:21:52.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:52.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569958+0000", 2024-09-17T02:21:52.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106214 2024-09-17T02:21:52.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:52.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570124+0000", 2024-09-17T02:21:52.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165546 2024-09-17T02:21:52.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:52.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570359+0000", 2024-09-17T02:21:52.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023525799999999999 2024-09-17T02:21:52.874 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.874 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:52.874 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.874 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129537 5.4 5:260327c6:::benchmark_data_smithi001_23533_object1420:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:52.874 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:21:52.874 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.223018091, 2024-09-17T02:21:52.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99624596499999996, 2024-09-17T02:21:52.875 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:52.875 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:52.875 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:52.875 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:52.875 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:52.875 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:52.875 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129537 2024-09-17T02:21:52.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.875 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:52.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:52.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:21:52.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:52.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:21:52.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:52.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578272+0000", 2024-09-17T02:21:52.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.164e-06 2024-09-17T02:21:52.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:52.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578278+0000", 2024-09-17T02:21:52.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5060000000000001e-06 2024-09-17T02:21:52.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:52.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578294+0000", 2024-09-17T02:21:52.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5687000000000001e-05 2024-09-17T02:21:52.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:52.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578329+0000", 2024-09-17T02:21:52.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5311999999999997e-05 2024-09-17T02:21:52.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578419+0000", 2024-09-17T02:21:52.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0054000000000002e-05 2024-09-17T02:21:52.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:52.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578435+0000", 2024-09-17T02:21:52.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5645999999999999e-05 2024-09-17T02:21:52.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560148+0000", 2024-09-17T02:21:52.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98171342299999997 2024-09-17T02:21:52.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:52.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560383+0000", 2024-09-17T02:21:52.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000234935 2024-09-17T02:21:52.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:52.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560586+0000", 2024-09-17T02:21:52.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000202909 2024-09-17T02:21:52.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:52.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570472+0000", 2024-09-17T02:21:52.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098856959999999994 2024-09-17T02:21:52.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:52.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574138+0000", 2024-09-17T02:21:52.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036660170000000001 2024-09-17T02:21:52.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:52.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574298+0000", 2024-09-17T02:21:52.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016025600000000001 2024-09-17T02:21:52.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:52.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574516+0000", 2024-09-17T02:21:52.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021835999999999999 2024-09-17T02:21:52.881 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.881 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:52.881 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.881 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129545 5.4 5:22366489:::benchmark_data_smithi001_23533_object1428:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:52.881 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:21:52.881 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.217155368, 2024-09-17T02:21:52.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99074544499999995, 2024-09-17T02:21:52.882 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:52.882 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:52.882 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:52.882 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:52.882 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:52.882 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:52.882 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129545 2024-09-17T02:21:52.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.882 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:52.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:52.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:21:52.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:52.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:21:52.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:52.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584135+0000", 2024-09-17T02:21:52.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4699999999999999e-06 2024-09-17T02:21:52.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:52.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584142+0000", 2024-09-17T02:21:52.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1620000000000002e-06 2024-09-17T02:21:52.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:52.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584170+0000", 2024-09-17T02:21:52.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7897000000000001e-05 2024-09-17T02:21:52.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:52.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584183+0000", 2024-09-17T02:21:52.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2814e-05 2024-09-17T02:21:52.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584299+0000", 2024-09-17T02:21:52.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116153 2024-09-17T02:21:52.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:52.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584316+0000", 2024-09-17T02:21:52.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7524999999999999e-05 2024-09-17T02:21:52.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563461+0000", 2024-09-17T02:21:52.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97914436699999996 2024-09-17T02:21:52.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:52.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563667+0000", 2024-09-17T02:21:52.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020689800000000001 2024-09-17T02:21:52.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:52.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563878+0000", 2024-09-17T02:21:52.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210275 2024-09-17T02:21:52.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:52.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570584+0000", 2024-09-17T02:21:52.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067066080000000002 2024-09-17T02:21:52.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:52.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574539+0000", 2024-09-17T02:21:52.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039550360000000003 2024-09-17T02:21:52.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:52.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574653+0000", 2024-09-17T02:21:52.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114003 2024-09-17T02:21:52.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:52.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574879+0000", 2024-09-17T02:21:52.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022523700000000001 2024-09-17T02:21:52.888 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.888 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:52.888 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.888 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129553 5.4 5:2e41ad40:::benchmark_data_smithi001_23533_object1436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:52.888 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:21:52.888 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.211732732000002, 2024-09-17T02:21:52.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99213429600000003, 2024-09-17T02:21:52.888 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:52.888 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:52.889 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:52.889 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:52.889 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:52.889 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:52.889 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129553 2024-09-17T02:21:52.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.889 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:52.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:52.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:21:52.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:52.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:21:52.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:52.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589557+0000", 2024-09-17T02:21:52.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2219999999999999e-06 2024-09-17T02:21:52.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:52.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589562+0000", 2024-09-17T02:21:52.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0649999999999998e-06 2024-09-17T02:21:52.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:52.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589575+0000", 2024-09-17T02:21:52.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3129000000000001e-05 2024-09-17T02:21:52.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:52.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589584+0000", 2024-09-17T02:21:52.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6200000000000005e-06 2024-09-17T02:21:52.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589693+0000", 2024-09-17T02:21:52.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109319 2024-09-17T02:21:52.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:52.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589714+0000", 2024-09-17T02:21:52.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0849999999999999e-05 2024-09-17T02:21:52.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566273+0000", 2024-09-17T02:21:52.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97655884999999998 2024-09-17T02:21:52.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:52.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566543+0000", 2024-09-17T02:21:52.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027059099999999998 2024-09-17T02:21:52.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:52.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566832+0000", 2024-09-17T02:21:52.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028898200000000002 2024-09-17T02:21:52.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:52.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581040+0000", 2024-09-17T02:21:52.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014208001 2024-09-17T02:21:52.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:52.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581200+0000", 2024-09-17T02:21:52.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159956 2024-09-17T02:21:52.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:52.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581427+0000", 2024-09-17T02:21:52.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000226309 2024-09-17T02:21:52.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:52.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581690+0000", 2024-09-17T02:21:52.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026340199999999998 2024-09-17T02:21:52.895 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.895 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:52.895 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.895 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129580 5.4 5:25ed887b:::benchmark_data_smithi001_23533_object1463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:52.895 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:21:52.895 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.189960687999999, 2024-09-17T02:21:52.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98001430499999997, 2024-09-17T02:21:52.895 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:52.895 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:52.896 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:52.896 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:52.896 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:52.896 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:52.896 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129580 2024-09-17T02:21:52.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.896 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:52.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:52.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:21:52.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:52.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:21:52.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:52.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611329+0000", 2024-09-17T02:21:52.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.22e-06 2024-09-17T02:21:52.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:52.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611335+0000", 2024-09-17T02:21:52.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1129999999999997e-06 2024-09-17T02:21:52.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:52.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611348+0000", 2024-09-17T02:21:52.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2342e-05 2024-09-17T02:21:52.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:52.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611356+0000", 2024-09-17T02:21:52.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.371e-06 2024-09-17T02:21:52.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611419+0000", 2024-09-17T02:21:52.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3393999999999996e-05 2024-09-17T02:21:52.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:52.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611427+0000", 2024-09-17T02:21:52.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999997e-06 2024-09-17T02:21:52.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570705+0000", 2024-09-17T02:21:52.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.95927859199999999 2024-09-17T02:21:52.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:52.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571009+0000", 2024-09-17T02:21:52.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030414599999999998 2024-09-17T02:21:52.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:52.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571241+0000", 2024-09-17T02:21:52.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023106799999999999 2024-09-17T02:21:52.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:52.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590789+0000", 2024-09-17T02:21:52.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019548763 2024-09-17T02:21:52.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:52.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590928+0000", 2024-09-17T02:21:52.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000139092 2024-09-17T02:21:52.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:52.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591086+0000", 2024-09-17T02:21:52.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015787400000000001 2024-09-17T02:21:52.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:52.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591342+0000", 2024-09-17T02:21:52.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025589900000000002 2024-09-17T02:21:52.902 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.902 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:52.902 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.902 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129603 5.4 5:25aaa5e8:::benchmark_data_smithi001_23533_object1486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:52.902 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:52.902 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.173900891999999, 2024-09-17T02:21:52.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96463198999999999, 2024-09-17T02:21:52.902 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:52.902 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:52.902 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:52.902 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:52.902 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:52.903 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:52.903 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129603 2024-09-17T02:21:52.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.903 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:52.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:52.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:52.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:52.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:52.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:52.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:52.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:21:52.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:52.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627392+0000", 2024-09-17T02:21:52.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0790000000000002e-06 2024-09-17T02:21:52.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:52.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627403+0000", 2024-09-17T02:21:52.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0866000000000001e-05 2024-09-17T02:21:52.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:52.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627409+0000", 2024-09-17T02:21:52.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.305e-06 2024-09-17T02:21:52.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627485+0000", 2024-09-17T02:21:52.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6582000000000006e-05 2024-09-17T02:21:52.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:52.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627499+0000", 2024-09-17T02:21:52.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:21:52.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574991+0000", 2024-09-17T02:21:52.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94749182300000001 2024-09-17T02:21:52.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:52.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575377+0000", 2024-09-17T02:21:52.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038629400000000003 2024-09-17T02:21:52.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:52.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575665+0000", 2024-09-17T02:21:52.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028759499999999997 2024-09-17T02:21:52.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:52.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590802+0000", 2024-09-17T02:21:52.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015136479 2024-09-17T02:21:52.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:52.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591614+0000", 2024-09-17T02:21:52.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081293100000000003 2024-09-17T02:21:52.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:52.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591764+0000", 2024-09-17T02:21:52.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014932199999999999 2024-09-17T02:21:52.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:52.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592020+0000", 2024-09-17T02:21:52.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025585099999999997 2024-09-17T02:21:52.908 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.909 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:52.909 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.909 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129607 5.4 5:2f638f1e:::benchmark_data_smithi001_23533_object1490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:52.909 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:21:52.909 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.172373986, 2024-09-17T02:21:52.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96352375899999998, 2024-09-17T02:21:52.909 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:52.909 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:52.909 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:52.909 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:52.909 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:52.910 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:52.910 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129607 2024-09-17T02:21:52.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.910 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:52.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:52.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:21:52.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:52.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:21:52.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:52.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628916+0000", 2024-09-17T02:21:52.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1710000000000001e-06 2024-09-17T02:21:52.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:52.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628920+0000", 2024-09-17T02:21:52.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-17T02:21:52.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:52.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628935+0000", 2024-09-17T02:21:52.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4474000000000001e-05 2024-09-17T02:21:52.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:52.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628944+0000", 2024-09-17T02:21:52.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9940000000000006e-06 2024-09-17T02:21:52.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628997+0000", 2024-09-17T02:21:52.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3579000000000003e-05 2024-09-17T02:21:52.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:52.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.629006+0000", 2024-09-17T02:21:52.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4009999999999997e-06 2024-09-17T02:21:52.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.577862+0000", 2024-09-17T02:21:52.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.948856335 2024-09-17T02:21:52.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:52.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578167+0000", 2024-09-17T02:21:52.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030532399999999999 2024-09-17T02:21:52.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:52.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578532+0000", 2024-09-17T02:21:52.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036428200000000001 2024-09-17T02:21:52.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:52.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591442+0000", 2024-09-17T02:21:52.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012910374000000001 2024-09-17T02:21:52.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:52.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592164+0000", 2024-09-17T02:21:52.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072242499999999996 2024-09-17T02:21:52.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:52.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592267+0000", 2024-09-17T02:21:52.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102205 2024-09-17T02:21:52.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:52.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592438+0000", 2024-09-17T02:21:52.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017165299999999999 2024-09-17T02:21:52.915 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.915 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:52.915 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.916 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129623 5.4 5:2cf5174b:::benchmark_data_smithi001_23533_object1506:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:52.916 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:21:52.916 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.148429700000001, 2024-09-17T02:21:52.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94334114499999999, 2024-09-17T02:21:52.916 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:52.916 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:52.916 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:52.916 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:52.916 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:52.916 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:52.916 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129623 2024-09-17T02:21:52.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.917 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:52.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:52.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:21:52.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:52.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:21:52.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:52.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652860+0000", 2024-09-17T02:21:52.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0330000000000001e-06 2024-09-17T02:21:52.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:52.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652864+0000", 2024-09-17T02:21:52.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.634e-06 2024-09-17T02:21:52.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:52.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652877+0000", 2024-09-17T02:21:52.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2591e-05 2024-09-17T02:21:52.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:52.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652883+0000", 2024-09-17T02:21:52.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1460000000000001e-06 2024-09-17T02:21:52.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652943+0000", 2024-09-17T02:21:52.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9833999999999997e-05 2024-09-17T02:21:52.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:52.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652950+0000", 2024-09-17T02:21:52.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.401e-06 2024-09-17T02:21:52.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581800+0000", 2024-09-17T02:21:52.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.92884935700000004 2024-09-17T02:21:52.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:52.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582122+0000", 2024-09-17T02:21:52.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032185200000000002 2024-09-17T02:21:52.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:52.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582689+0000", 2024-09-17T02:21:52.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056750400000000003 2024-09-17T02:21:52.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:52.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591458+0000", 2024-09-17T02:21:52.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008768685 2024-09-17T02:21:52.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:52.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595856+0000", 2024-09-17T02:21:52.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043977909999999999 2024-09-17T02:21:52.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:52.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595955+0000", 2024-09-17T02:21:52.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9166000000000006e-05 2024-09-17T02:21:52.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:52.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596200+0000", 2024-09-17T02:21:52.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024515099999999998 2024-09-17T02:21:52.922 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.922 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:52.922 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.923 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129642 5.4 5:255eb796:::benchmark_data_smithi001_23533_object1525:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:52.923 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:21:52.923 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.117193535999998, 2024-09-17T02:21:52.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.91257397299999998, 2024-09-17T02:21:52.923 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:52.923 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:52.923 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:52.923 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:52.923 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:52.923 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:52.923 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129642 2024-09-17T02:21:52.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.923 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:52.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:52.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:21:52.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:52.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:21:52.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:52.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684096+0000", 2024-09-17T02:21:52.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659999999999999e-06 2024-09-17T02:21:52.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:52.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684101+0000", 2024-09-17T02:21:52.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8110000000000002e-06 2024-09-17T02:21:52.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:52.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684114+0000", 2024-09-17T02:21:52.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2653000000000001e-05 2024-09-17T02:21:52.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:52.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684121+0000", 2024-09-17T02:21:52.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5100000000000001e-06 2024-09-17T02:21:52.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684181+0000", 2024-09-17T02:21:52.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0307999999999999e-05 2024-09-17T02:21:52.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:52.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684194+0000", 2024-09-17T02:21:52.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2916e-05 2024-09-17T02:21:52.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.587917+0000", 2024-09-17T02:21:52.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.90372220400000003 2024-09-17T02:21:52.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:52.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588215+0000", 2024-09-17T02:21:52.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029845400000000003 2024-09-17T02:21:52.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:52.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588470+0000", 2024-09-17T02:21:52.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025455399999999999 2024-09-17T02:21:52.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:52.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596318+0000", 2024-09-17T02:21:52.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078485589999999997 2024-09-17T02:21:52.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:52.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596354+0000", 2024-09-17T02:21:52.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5976999999999998e-05 2024-09-17T02:21:52.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:52.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596449+0000", 2024-09-17T02:21:52.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4728999999999994e-05 2024-09-17T02:21:52.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:52.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596669+0000", 2024-09-17T02:21:52.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220132 2024-09-17T02:21:52.929 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.929 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:52.929 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.929 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129649 5.4 5:2fe27050:::benchmark_data_smithi001_23533_object1532:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:52.929 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:21:52.930 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.085636792999999, 2024-09-17T02:21:52.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.88508119100000004, 2024-09-17T02:21:52.930 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:52.930 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:52.930 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:52.930 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:52.930 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:52.930 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:52.930 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129649 2024-09-17T02:21:52.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.930 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:52.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:52.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:21:52.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:52.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:21:52.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:52.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:52.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715653+0000", 2024-09-17T02:21:52.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3519999999999999e-06 2024-09-17T02:21:52.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:52.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715658+0000", 2024-09-17T02:21:52.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3120000000000001e-06 2024-09-17T02:21:52.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:52.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715677+0000", 2024-09-17T02:21:52.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-17T02:21:52.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:52.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715687+0000", 2024-09-17T02:21:52.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0146000000000001e-05 2024-09-17T02:21:52.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715821+0000", 2024-09-17T02:21:52.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013421 2024-09-17T02:21:52.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:52.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715840+0000", 2024-09-17T02:21:52.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8153999999999999e-05 2024-09-17T02:21:52.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:52.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592528+0000", 2024-09-17T02:21:52.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.87668860000000004 2024-09-17T02:21:52.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:52.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592702+0000", 2024-09-17T02:21:52.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017429300000000001 2024-09-17T02:21:52.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:52.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592945+0000", 2024-09-17T02:21:52.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000242048 2024-09-17T02:21:52.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:52.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600234+0000", 2024-09-17T02:21:52.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072897600000000002 2024-09-17T02:21:52.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:52.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600494+0000", 2024-09-17T02:21:52.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000259984 2024-09-17T02:21:52.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:52.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600555+0000", 2024-09-17T02:21:52.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1138999999999999e-05 2024-09-17T02:21:52.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:52.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:52.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:52.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600733+0000", 2024-09-17T02:21:52.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017753300000000001 2024-09-17T02:21:52.939 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.939 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:52.939 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.939 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:52.939 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:52.939 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:52.940 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:52.941+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:52.941 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:53.003 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T02:21:53.041 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:53.041+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:53.101 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:53.101 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:53.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.101 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:166498 5.3 5:cf0e468b:::benchmark_data_smithi001_23533_object38381:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-17T02:21:53.101 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:53.101298+0000", 2024-09-17T02:21:53.101 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0032957120000000001, 2024-09-17T02:21:53.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033208209999999998, 2024-09-17T02:21:53.101 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.102 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.102 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:53.102 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:53.102 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:53.102 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.102 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 166498 2024-09-17T02:21:53.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.102 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101298+0000", 2024-09-17T02:21:53.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101298+0000", 2024-09-17T02:21:53.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101299+0000", 2024-09-17T02:21:53.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6199999999999996e-07 2024-09-17T02:21:53.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101303+0000", 2024-09-17T02:21:53.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1559999999999997e-06 2024-09-17T02:21:53.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101314+0000", 2024-09-17T02:21:53.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0634e-05 2024-09-17T02:21:53.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101321+0000", 2024-09-17T02:21:53.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9689999999999997e-06 2024-09-17T02:21:53.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101373+0000", 2024-09-17T02:21:53.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1935000000000003e-05 2024-09-17T02:21:53.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101499+0000", 2024-09-17T02:21:53.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012595999999999999 2024-09-17T02:21:53.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:53.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101603+0000", 2024-09-17T02:21:53.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104893 2024-09-17T02:21:53.106 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.106 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.106 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.106 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:166499 5.c 5:31300e37:::benchmark_data_smithi001_23533_object38382:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-17T02:21:53.107 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:53.101362+0000", 2024-09-17T02:21:53.107 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.003232132, 2024-09-17T02:21:53.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003330843, 2024-09-17T02:21:53.107 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.107 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.107 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:53.107 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:53.107 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:53.107 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.107 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 166499 2024-09-17T02:21:53.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.107 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101362+0000", 2024-09-17T02:21:53.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101362+0000", 2024-09-17T02:21:53.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101362+0000", 2024-09-17T02:21:53.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.06e-07 2024-09-17T02:21:53.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101365+0000", 2024-09-17T02:21:53.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.943e-06 2024-09-17T02:21:53.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101372+0000", 2024-09-17T02:21:53.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2049999999999996e-06 2024-09-17T02:21:53.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101378+0000", 2024-09-17T02:21:53.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6550000000000001e-06 2024-09-17T02:21:53.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101421+0000", 2024-09-17T02:21:53.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2592999999999997e-05 2024-09-17T02:21:53.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101533+0000", 2024-09-17T02:21:53.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011239 2024-09-17T02:21:53.110 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.110 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.111 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.111 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:166500 5.3 5:cddde330:::benchmark_data_smithi001_23533_object38383:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-17T02:21:53.111 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:53.101398+0000", 2024-09-17T02:21:53.111 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0031958749999999999, 2024-09-17T02:21:53.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033560399999999998, 2024-09-17T02:21:53.111 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.111 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.111 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:53.111 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:53.111 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:53.111 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.112 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 166500 2024-09-17T02:21:53.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.112 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101398+0000", 2024-09-17T02:21:53.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101398+0000", 2024-09-17T02:21:53.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101398+0000", 2024-09-17T02:21:53.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2399999999999998e-07 2024-09-17T02:21:53.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101401+0000", 2024-09-17T02:21:53.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4729999999999999e-06 2024-09-17T02:21:53.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101408+0000", 2024-09-17T02:21:53.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8229999999999997e-06 2024-09-17T02:21:53.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101413+0000", 2024-09-17T02:21:53.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4099999999999999e-06 2024-09-17T02:21:53.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.103713+0000", 2024-09-17T02:21:53.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002299387 2024-09-17T02:21:53.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.103838+0000", 2024-09-17T02:21:53.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012515399999999999 2024-09-17T02:21:53.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:53.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.103957+0000", 2024-09-17T02:21:53.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000119636 2024-09-17T02:21:53.115 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.115 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.115 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.116 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:166501 5.7 5:e623afbd:::benchmark_data_smithi001_23533_object38384:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-17T02:21:53.116 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:53.101425+0000", 2024-09-17T02:21:53.116 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0031682809999999998, 2024-09-17T02:21:53.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033934379999999999, 2024-09-17T02:21:53.116 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.116 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.116 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:53.116 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:53.116 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:53.116 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.116 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 166501 2024-09-17T02:21:53.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.116 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101425+0000", 2024-09-17T02:21:53.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101425+0000", 2024-09-17T02:21:53.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101426+0000", 2024-09-17T02:21:53.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4299999999999998e-07 2024-09-17T02:21:53.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101428+0000", 2024-09-17T02:21:53.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1950000000000002e-06 2024-09-17T02:21:53.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101434+0000", 2024-09-17T02:21:53.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.913e-06 2024-09-17T02:21:53.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101441+0000", 2024-09-17T02:21:53.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6359999999999997e-06 2024-09-17T02:21:53.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.102425+0000", 2024-09-17T02:21:53.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00098400799999999997 2024-09-17T02:21:53.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.102534+0000", 2024-09-17T02:21:53.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109677 2024-09-17T02:21:53.120 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.120 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.120 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.120 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:166502 5.7 5:e9d7ada9:::benchmark_data_smithi001_23533_object38385:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-17T02:21:53.120 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:53.101471+0000", 2024-09-17T02:21:53.120 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0031223840000000002, 2024-09-17T02:21:53.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034083910000000002, 2024-09-17T02:21:53.120 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.120 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.120 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:53.121 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:53.121 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:53.121 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.121 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 166502 2024-09-17T02:21:53.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.121 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101471+0000", 2024-09-17T02:21:53.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101471+0000", 2024-09-17T02:21:53.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101472+0000", 2024-09-17T02:21:53.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1500000000000004e-07 2024-09-17T02:21:53.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101475+0000", 2024-09-17T02:21:53.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.695e-06 2024-09-17T02:21:53.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101482+0000", 2024-09-17T02:21:53.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.934e-06 2024-09-17T02:21:53.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.101488+0000", 2024-09-17T02:21:53.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9649999999999996e-06 2024-09-17T02:21:53.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.104232+0000", 2024-09-17T02:21:53.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027448899999999998 2024-09-17T02:21:53.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.104349+0000", 2024-09-17T02:21:53.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000116963 2024-09-17T02:21:53.124 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.124 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.124 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.124 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:166504 5.4 e58/52 5:25e39b0b:::benchmark_data_smithi001_23533_object38387:head v 58'10244, mlcod=58'10242)", 2024-09-17T02:21:53.124 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:53.103275+0000", 2024-09-17T02:21:53.124 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00131883, 2024-09-17T02:21:53.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016779010000000001, 2024-09-17T02:21:53.125 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.125 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.125 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:53.125 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.103275+0000", 2024-09-17T02:21:53.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.103275+0000", 2024-09-17T02:21:53.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.103275+0000", 2024-09-17T02:21:53.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2900000000000004e-07 2024-09-17T02:21:53.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.103281+0000", 2024-09-17T02:21:53.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1900000000000003e-06 2024-09-17T02:21:53.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.103293+0000", 2024-09-17T02:21:53.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2194999999999999e-05 2024-09-17T02:21:53.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.103298+0000", 2024-09-17T02:21:53.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0839999999999999e-06 2024-09-17T02:21:53.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.103343+0000", 2024-09-17T02:21:53.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5266000000000003e-05 2024-09-17T02:21:53.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.103359+0000", 2024-09-17T02:21:53.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5951e-05 2024-09-17T02:21:53.128 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.128 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.128 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.128 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4466.0:166498 5.3 e58/51)", 2024-09-17T02:21:53.128 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:53.103951+0000", 2024-09-17T02:21:53.128 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00064232799999999995, 2024-09-17T02:21:53.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001050788, 2024-09-17T02:21:53.129 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.129 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.129 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:53.129 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.103951+0000", 2024-09-17T02:21:53.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.103951+0000", 2024-09-17T02:21:53.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.103952+0000", 2024-09-17T02:21:53.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8400000000000004e-07 2024-09-17T02:21:53.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.103956+0000", 2024-09-17T02:21:53.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6669999999999998e-06 2024-09-17T02:21:53.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.103966+0000", 2024-09-17T02:21:53.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0511e-05 2024-09-17T02:21:53.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.103974+0000", 2024-09-17T02:21:53.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4460000000000004e-06 2024-09-17T02:21:53.131 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.131 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.131 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.131 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:166505 5.e e58/22 5:7c2c5036:::benchmark_data_smithi001_23533_object38388:head v 58'10455, mlcod=58'10452)", 2024-09-17T02:21:53.131 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:53.104451+0000", 2024-09-17T02:21:53.131 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.000142769, 2024-09-17T02:21:53.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00059603499999999997, 2024-09-17T02:21:53.132 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.132 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.132 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:53.132 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.104451+0000", 2024-09-17T02:21:53.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.104451+0000", 2024-09-17T02:21:53.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.104452+0000", 2024-09-17T02:21:53.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2900000000000004e-07 2024-09-17T02:21:53.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.104456+0000", 2024-09-17T02:21:53.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3780000000000003e-06 2024-09-17T02:21:53.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.104466+0000", 2024-09-17T02:21:53.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8679999999999994e-06 2024-09-17T02:21:53.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.104472+0000", 2024-09-17T02:21:53.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0909999999999998e-06 2024-09-17T02:21:53.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.104514+0000", 2024-09-17T02:21:53.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1918000000000001e-05 2024-09-17T02:21:53.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.104531+0000", 2024-09-17T02:21:53.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7150999999999999e-05 2024-09-17T02:21:53.135 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.135 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.135 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.135 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:166489 5.7 5:e2e67871:::benchmark_data_smithi001_23533_object38372:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-17T02:21:53.135 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:53.093437+0000", 2024-09-17T02:21:53.135 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.011156532, 2024-09-17T02:21:53.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011664570000000001, 2024-09-17T02:21:53.136 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.136 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.136 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:53.136 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:53.136 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:53.136 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.136 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 166489 2024-09-17T02:21:53.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.136 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.093437+0000", 2024-09-17T02:21:53.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.093437+0000", 2024-09-17T02:21:53.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.093438+0000", 2024-09-17T02:21:53.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0200000000000002e-07 2024-09-17T02:21:53.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.093440+0000", 2024-09-17T02:21:53.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6359999999999998e-06 2024-09-17T02:21:53.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.093451+0000", 2024-09-17T02:21:53.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0173000000000001e-05 2024-09-17T02:21:53.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.093456+0000", 2024-09-17T02:21:53.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.524e-06 2024-09-17T02:21:53.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.093508+0000", 2024-09-17T02:21:53.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1857999999999997e-05 2024-09-17T02:21:53.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.093638+0000", 2024-09-17T02:21:53.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013036100000000001 2024-09-17T02:21:53.142 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.142 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.142 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.142 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:166490 5.7 5:e477de66:::benchmark_data_smithi001_23533_object38373:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-17T02:21:53.142 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:53.093472+0000", 2024-09-17T02:21:53.143 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.011121723, 2024-09-17T02:21:53.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011690924, 2024-09-17T02:21:53.143 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.143 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.143 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:53.143 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:53.143 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:53.143 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.143 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 166490 2024-09-17T02:21:53.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.143 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.093472+0000", 2024-09-17T02:21:53.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.093472+0000", 2024-09-17T02:21:53.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.093473+0000", 2024-09-17T02:21:53.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.68e-07 2024-09-17T02:21:53.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.093476+0000", 2024-09-17T02:21:53.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1879999999999998e-06 2024-09-17T02:21:53.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.093483+0000", 2024-09-17T02:21:53.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.622e-06 2024-09-17T02:21:53.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.093490+0000", 2024-09-17T02:21:53.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1990000000000003e-06 2024-09-17T02:21:53.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.095419+0000", 2024-09-17T02:21:53.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001928936 2024-09-17T02:21:53.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.095531+0000", 2024-09-17T02:21:53.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000112674 2024-09-17T02:21:53.146 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.147 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.147 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.147 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:166492 5.7 5:e15e9c76:::benchmark_data_smithi001_23533_object38375:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-17T02:21:53.147 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:53.097125+0000", 2024-09-17T02:21:53.147 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0074685699999999999, 2024-09-17T02:21:53.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0080976380000000008, 2024-09-17T02:21:53.147 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.147 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.147 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:53.147 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:53.147 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:53.148 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.148 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 166492 2024-09-17T02:21:53.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.148 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.097125+0000", 2024-09-17T02:21:53.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.097125+0000", 2024-09-17T02:21:53.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.097126+0000", 2024-09-17T02:21:53.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9800000000000003e-07 2024-09-17T02:21:53.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.097129+0000", 2024-09-17T02:21:53.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5300000000000001e-06 2024-09-17T02:21:53.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.097137+0000", 2024-09-17T02:21:53.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3139999999999998e-06 2024-09-17T02:21:53.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.097142+0000", 2024-09-17T02:21:53.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1240000000000004e-06 2024-09-17T02:21:53.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.097377+0000", 2024-09-17T02:21:53.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000235484 2024-09-17T02:21:53.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.097482+0000", 2024-09-17T02:21:53.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010430899999999999 2024-09-17T02:21:53.151 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.151 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.151 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.151 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:166494 5.7 5:e9080f6d:::benchmark_data_smithi001_23533_object38377:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-17T02:21:53.151 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:53.097173+0000", 2024-09-17T02:21:53.151 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00742051, 2024-09-17T02:21:53.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081089850000000008, 2024-09-17T02:21:53.151 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.151 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.152 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:53.152 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:53.152 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:53.152 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.152 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 166494 2024-09-17T02:21:53.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.152 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.097173+0000", 2024-09-17T02:21:53.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.097173+0000", 2024-09-17T02:21:53.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.097174+0000", 2024-09-17T02:21:53.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7399999999999999e-07 2024-09-17T02:21:53.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.097175+0000", 2024-09-17T02:21:53.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3570000000000001e-06 2024-09-17T02:21:53.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.097178+0000", 2024-09-17T02:21:53.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4319999999999999e-06 2024-09-17T02:21:53.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.097181+0000", 2024-09-17T02:21:53.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.875e-06 2024-09-17T02:21:53.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.099107+0000", 2024-09-17T02:21:53.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001926166 2024-09-17T02:21:53.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.099250+0000", 2024-09-17T02:21:53.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014271800000000001 2024-09-17T02:21:53.155 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.155 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.155 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.155 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:166495 5.7 5:e1138561:::benchmark_data_smithi001_23533_object38378:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-17T02:21:53.156 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:53.097841+0000", 2024-09-17T02:21:53.156 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0067526799999999996, 2024-09-17T02:21:53.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0075008590000000003, 2024-09-17T02:21:53.156 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.156 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.156 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:53.156 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:53.156 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:53.156 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.156 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 166495 2024-09-17T02:21:53.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.156 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.097841+0000", 2024-09-17T02:21:53.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.097841+0000", 2024-09-17T02:21:53.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.097842+0000", 2024-09-17T02:21:53.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6300000000000005e-07 2024-09-17T02:21:53.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.097846+0000", 2024-09-17T02:21:53.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.087e-06 2024-09-17T02:21:53.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.097856+0000", 2024-09-17T02:21:53.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0305999999999999e-05 2024-09-17T02:21:53.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.097863+0000", 2024-09-17T02:21:53.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8419999999999999e-06 2024-09-17T02:21:53.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.100862+0000", 2024-09-17T02:21:53.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029988089999999998 2024-09-17T02:21:53.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:53.100953+0000", 2024-09-17T02:21:53.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1082999999999995e-05 2024-09-17T02:21:53.159 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.159 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.159 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.159 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.159 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:21:53.160 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 13 2024-09-17T02:21:53.160 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:53.161 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:53.162 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:53.161+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:53.262 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:53.264+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:53.356 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:53.356 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:21:53.356 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:21:53.357 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:21:53.357 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:53.363 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:53.361+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:53.376 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:53.464 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:53.468+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:53.565 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:53.565+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:53.573 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:53.574 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:21:53.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:21:53.574 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:53.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.574 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:53.574 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:53.574 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 71.007606930999998, 2024-09-17T02:21:53.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:21:53.574 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.574 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.574 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:53.574 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:53.574 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:53.574 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.575 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:21:53.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.575 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:53.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:53.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:21:53.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:21:53.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:21:53.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:21:53.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:21:53.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:21:53.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:21:53.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:21:53.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:21:53.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:21:53.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:21:53.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:21:53.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:53.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:21:53.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:21:53.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:53.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:21:53.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:21:53.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:53.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:21:53.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:21:53.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:53.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:21:53.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:21:53.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:53.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:21:53.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:21:53.579 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.579 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.580 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.580 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:53.580 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:53.580 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 71.003704681000002, 2024-09-17T02:21:53.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:21:53.580 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.580 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.580 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:53.580 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:53.580 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:53.580 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.581 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:21:53.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.581 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:53.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:53.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.582 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:21:53.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:21:53.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.582 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:21:53.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:21:53.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.582 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:21:53.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:21:53.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:21:53.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:21:53.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:21:53.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:21:53.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:21:53.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:21:53.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:53.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:21:53.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:21:53.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:53.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:21:53.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:21:53.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:53.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:21:53.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:21:53.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:53.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:21:53.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:21:53.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:53.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:21:53.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:21:53.585 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.585 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.586 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.586 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71206 5.3 e39/38 5:c6c9386d:::benchmark_data_smithi001_23533_object71205:head v 39'4517, mlcod=35'4513)", 2024-09-17T02:21:53.586 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:53.586 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.966377565999998, 2024-09-17T02:21:53.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026101868, 2024-09-17T02:21:53.586 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.586 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.586 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:53.586 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.586 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:53.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:53.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609694+0000", 2024-09-17T02:21:53.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9539999999999998e-06 2024-09-17T02:21:53.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609841+0000", 2024-09-17T02:21:53.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014690800000000001 2024-09-17T02:21:53.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609872+0000", 2024-09-17T02:21:53.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0326000000000001e-05 2024-09-17T02:21:53.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609892+0000", 2024-09-17T02:21:53.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9848999999999999e-05 2024-09-17T02:21:53.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.589 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.589 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613826+0000", 2024-09-17T02:21:53.589 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039345140000000001 2024-09-17T02:21:53.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.589 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.589 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613908+0000", 2024-09-17T02:21:53.589 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2412999999999999e-05 2024-09-17T02:21:53.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.589 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:53.589 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635696+0000", 2024-09-17T02:21:53.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021787597999999998 2024-09-17T02:21:53.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.590 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:53.590 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635794+0000", 2024-09-17T02:21:53.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8306000000000004e-05 2024-09-17T02:21:53.590 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.590 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.590 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.590 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97151 5.5 5:a0c2c072:::benchmark_data_smithi001_23533_object97150:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:53.590 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:53.590 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.307697959000002, 2024-09-17T02:21:53.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027297614000000001, 2024-09-17T02:21:53.591 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.591 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.591 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:53.591 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:53.591 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:53.591 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.591 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97151 2024-09-17T02:21:53.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.591 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:53.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:53.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268373+0000", 2024-09-17T02:21:53.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4000000000000002e-07 2024-09-17T02:21:53.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268423+0000", 2024-09-17T02:21:53.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0175e-05 2024-09-17T02:21:53.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268428+0000", 2024-09-17T02:21:53.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-17T02:21:53.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268431+0000", 2024-09-17T02:21:53.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.179e-06 2024-09-17T02:21:53.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.594 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283631+0000", 2024-09-17T02:21:53.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015199691 2024-09-17T02:21:53.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.594 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283740+0000", 2024-09-17T02:21:53.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109305 2024-09-17T02:21:53.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.594 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:53.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283863+0000", 2024-09-17T02:21:53.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012226699999999999 2024-09-17T02:21:53.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:53.595 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290857+0000", 2024-09-17T02:21:53.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069945449999999996 2024-09-17T02:21:53.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:53.595 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295595+0000", 2024-09-17T02:21:53.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047376750000000002 2024-09-17T02:21:53.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:53.595 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295638+0000", 2024-09-17T02:21:53.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3671999999999998e-05 2024-09-17T02:21:53.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:53.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295670+0000", 2024-09-17T02:21:53.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1266000000000002e-05 2024-09-17T02:21:53.596 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.596 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.596 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.596 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97759 5.a 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:53.596 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:53.597 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 35.977684858000003, 2024-09-17T02:21:53.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.089694871999999995, 2024-09-17T02:21:53.597 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.597 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.597 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:53.597 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:53.597 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:53.597 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.597 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97759 2024-09-17T02:21:53.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.597 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:53.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:53.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598386+0000", 2024-09-17T02:21:53.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999999e-07 2024-09-17T02:21:53.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598414+0000", 2024-09-17T02:21:53.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8013000000000001e-05 2024-09-17T02:21:53.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598420+0000", 2024-09-17T02:21:53.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1149999999999999e-06 2024-09-17T02:21:53.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598424+0000", 2024-09-17T02:21:53.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:21:53.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598479+0000", 2024-09-17T02:21:53.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4648999999999998e-05 2024-09-17T02:21:53.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598587+0000", 2024-09-17T02:21:53.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010853000000000001 2024-09-17T02:21:53.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:53.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598676+0000", 2024-09-17T02:21:53.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8381999999999995e-05 2024-09-17T02:21:53.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:53.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603766+0000", 2024-09-17T02:21:53.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050902559999999996 2024-09-17T02:21:53.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:53.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.687988+0000", 2024-09-17T02:21:53.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.084221753999999996 2024-09-17T02:21:53.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:53.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688037+0000", 2024-09-17T02:21:53.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-05 2024-09-17T02:21:53.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:53.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688080+0000", 2024-09-17T02:21:53.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3149999999999999e-05 2024-09-17T02:21:53.602 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.602 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.602 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.602 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97770 5.0 5:09c75033:::benchmark_data_smithi001_23533_object97769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:53.602 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:53.602 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 35.972542427999997, 2024-09-17T02:21:53.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.086380868, 2024-09-17T02:21:53.603 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.603 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.603 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:53.603 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:53.603 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:53.603 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.603 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97770 2024-09-17T02:21:53.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.603 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:53.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:53.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603529+0000", 2024-09-17T02:21:53.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:21:53.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603593+0000", 2024-09-17T02:21:53.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4216999999999999e-05 2024-09-17T02:21:53.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.605 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603603+0000", 2024-09-17T02:21:53.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5179999999999993e-06 2024-09-17T02:21:53.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.605 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603608+0000", 2024-09-17T02:21:53.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2039999999999996e-06 2024-09-17T02:21:53.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603653+0000", 2024-09-17T02:21:53.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5247000000000002e-05 2024-09-17T02:21:53.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603758+0000", 2024-09-17T02:21:53.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105352 2024-09-17T02:21:53.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:53.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603900+0000", 2024-09-17T02:21:53.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014198999999999999 2024-09-17T02:21:53.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:53.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.606097+0000", 2024-09-17T02:21:53.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021969839999999999 2024-09-17T02:21:53.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:53.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689756+0000", 2024-09-17T02:21:53.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.083659077999999998 2024-09-17T02:21:53.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:53.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689846+0000", 2024-09-17T02:21:53.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9320999999999994e-05 2024-09-17T02:21:53.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:53.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689908+0000", 2024-09-17T02:21:53.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720999999999998e-05 2024-09-17T02:21:53.608 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.608 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.608 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.608 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127513 5.c 5:3eca08e4:::benchmark_data_smithi001_23533_object127512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:53.608 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:21:53.608 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.131766003999999, 2024-09-17T02:21:53.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046626399999999998, 2024-09-17T02:21:53.609 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.609 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.609 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:53.609 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:53.609 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:53.609 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.609 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127513 2024-09-17T02:21:53.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.609 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.609 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:21:53.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:21:53.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444305+0000", 2024-09-17T02:21:53.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2529999999999999e-06 2024-09-17T02:21:53.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444466+0000", 2024-09-17T02:21:53.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016069700000000001 2024-09-17T02:21:53.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444479+0000", 2024-09-17T02:21:53.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2602999999999999e-05 2024-09-17T02:21:53.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444485+0000", 2024-09-17T02:21:53.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.669e-06 2024-09-17T02:21:53.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444560+0000", 2024-09-17T02:21:53.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4276999999999994e-05 2024-09-17T02:21:53.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444656+0000", 2024-09-17T02:21:53.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6490000000000006e-05 2024-09-17T02:21:53.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:53.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444739+0000", 2024-09-17T02:21:53.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3139999999999993e-05 2024-09-17T02:21:53.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:53.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.448438+0000", 2024-09-17T02:21:53.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036985490000000002 2024-09-17T02:21:53.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:53.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490732+0000", 2024-09-17T02:21:53.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042294353999999999 2024-09-17T02:21:53.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:53.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490859+0000", 2024-09-17T02:21:53.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012708899999999999 2024-09-17T02:21:53.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:53.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490930+0000", 2024-09-17T02:21:53.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:21:53.614 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.614 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.614 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.614 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127514 5.c 5:39cc1feb:::benchmark_data_smithi001_23533_object127513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:53.614 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:53.614 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.131569235000001, 2024-09-17T02:21:53.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049357228000000003, 2024-09-17T02:21:53.615 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.615 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.615 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:53.615 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:53.615 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:53.615 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.615 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127514 2024-09-17T02:21:53.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.615 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:53.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:53.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:53.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8599999999999998e-07 2024-09-17T02:21:53.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444554+0000", 2024-09-17T02:21:53.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3047999999999998e-05 2024-09-17T02:21:53.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444562+0000", 2024-09-17T02:21:53.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5830000000000001e-06 2024-09-17T02:21:53.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444567+0000", 2024-09-17T02:21:53.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4179999999999996e-06 2024-09-17T02:21:53.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446566+0000", 2024-09-17T02:21:53.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001998788 2024-09-17T02:21:53.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446696+0000", 2024-09-17T02:21:53.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129393 2024-09-17T02:21:53.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:53.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446794+0000", 2024-09-17T02:21:53.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8462999999999996e-05 2024-09-17T02:21:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.449036+0000", 2024-09-17T02:21:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022415880000000001 2024-09-17T02:21:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493737+0000", 2024-09-17T02:21:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044701682 2024-09-17T02:21:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493808+0000", 2024-09-17T02:21:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0846000000000006e-05 2024-09-17T02:21:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493858+0000", 2024-09-17T02:21:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9932999999999998e-05 2024-09-17T02:21:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129441 5.1 5:84c3199f:::benchmark_data_smithi001_23533_object1324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:21:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.072558746999999, 2024-09-17T02:21:53.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034387011000000002, 2024-09-17T02:21:53.621 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.621 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.621 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:53.621 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:53.621 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:53.621 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.621 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129441 2024-09-17T02:21:53.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.621 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:21:53.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:21:53.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503513+0000", 2024-09-17T02:21:53.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4759999999999999e-06 2024-09-17T02:21:53.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503518+0000", 2024-09-17T02:21:53.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-09-17T02:21:53.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503532+0000", 2024-09-17T02:21:53.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4049999999999999e-05 2024-09-17T02:21:53.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503541+0000", 2024-09-17T02:21:53.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5320000000000006e-06 2024-09-17T02:21:53.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506331+0000", 2024-09-17T02:21:53.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027899190000000001 2024-09-17T02:21:53.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506402+0000", 2024-09-17T02:21:53.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:21:53.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:53.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506477+0000", 2024-09-17T02:21:53.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4626e-05 2024-09-17T02:21:53.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:53.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509749+0000", 2024-09-17T02:21:53.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032726980000000001 2024-09-17T02:21:53.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:53.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537758+0000", 2024-09-17T02:21:53.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028008890000000002 2024-09-17T02:21:53.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:53.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537812+0000", 2024-09-17T02:21:53.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3300000000000001e-05 2024-09-17T02:21:53.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:53.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537898+0000", 2024-09-17T02:21:53.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6691000000000001e-05 2024-09-17T02:21:53.626 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.626 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.626 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.626 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129442 5.1 5:8f7f2a95:::benchmark_data_smithi001_23533_object1325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:53.626 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:21:53.626 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.069588138, 2024-09-17T02:21:53.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031546698999999997, 2024-09-17T02:21:53.627 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.627 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.627 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:53.627 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:53.627 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:53.627 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.627 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129442 2024-09-17T02:21:53.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.627 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:21:53.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:21:53.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506483+0000", 2024-09-17T02:21:53.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2869999999999999e-06 2024-09-17T02:21:53.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506489+0000", 2024-09-17T02:21:53.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2330000000000003e-06 2024-09-17T02:21:53.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506502+0000", 2024-09-17T02:21:53.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2286999999999999e-05 2024-09-17T02:21:53.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506511+0000", 2024-09-17T02:21:53.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7799999999999995e-06 2024-09-17T02:21:53.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.507966+0000", 2024-09-17T02:21:53.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014541549999999999 2024-09-17T02:21:53.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508130+0000", 2024-09-17T02:21:53.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016455199999999999 2024-09-17T02:21:53.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:53.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508287+0000", 2024-09-17T02:21:53.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015730400000000001 2024-09-17T02:21:53.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:53.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510577+0000", 2024-09-17T02:21:53.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022899449999999998 2024-09-17T02:21:53.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:53.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537932+0000", 2024-09-17T02:21:53.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027354471000000002 2024-09-17T02:21:53.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:53.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537964+0000", 2024-09-17T02:21:53.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1909999999999998e-05 2024-09-17T02:21:53.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:53.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.538029+0000", 2024-09-17T02:21:53.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4775000000000002e-05 2024-09-17T02:21:53.632 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.632 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.632 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.632 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129443 5.8 5:1edfeaf8:::benchmark_data_smithi001_23533_object1326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:53.632 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:21:53.632 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.066153637999999, 2024-09-17T02:21:53.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025315902000000001, 2024-09-17T02:21:53.632 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.632 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.633 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:53.633 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:53.633 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:53.633 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.633 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129443 2024-09-17T02:21:53.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.633 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:21:53.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:21:53.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509918+0000", 2024-09-17T02:21:53.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3689999999999999e-06 2024-09-17T02:21:53.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509923+0000", 2024-09-17T02:21:53.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0429999999999998e-06 2024-09-17T02:21:53.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509936+0000", 2024-09-17T02:21:53.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3234000000000001e-05 2024-09-17T02:21:53.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509950+0000", 2024-09-17T02:21:53.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3998999999999999e-05 2024-09-17T02:21:53.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509994+0000", 2024-09-17T02:21:53.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4323000000000002e-05 2024-09-17T02:21:53.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510095+0000", 2024-09-17T02:21:53.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010103300000000001 2024-09-17T02:21:53.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:53.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510160+0000", 2024-09-17T02:21:53.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4976999999999998e-05 2024-09-17T02:21:53.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:53.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.513304+0000", 2024-09-17T02:21:53.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031431330000000002 2024-09-17T02:21:53.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:53.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535046+0000", 2024-09-17T02:21:53.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021742276000000001 2024-09-17T02:21:53.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:53.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:21:53.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107759 2024-09-17T02:21:53.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535232+0000", 2024-09-17T02:21:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8756000000000003e-05 2024-09-17T02:21:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:138247 5.3 5:caf01f60:::benchmark_data_smithi001_23533_object10130:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.335014+0000", 2024-09-17T02:21:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.241056065, 2024-09-17T02:21:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026419469000000001, 2024-09-17T02:21:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:53.639 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:53.639 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:53.639 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.639 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 138247 2024-09-17T02:21:53.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.639 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335014+0000", 2024-09-17T02:21:53.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335014+0000", 2024-09-17T02:21:53.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335015+0000", 2024-09-17T02:21:53.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3600000000000004e-07 2024-09-17T02:21:53.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335017+0000", 2024-09-17T02:21:53.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5749999999999999e-06 2024-09-17T02:21:53.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335024+0000", 2024-09-17T02:21:53.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8379999999999996e-06 2024-09-17T02:21:53.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335029+0000", 2024-09-17T02:21:53.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.22e-06 2024-09-17T02:21:53.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335083+0000", 2024-09-17T02:21:53.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3600000000000002e-05 2024-09-17T02:21:53.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335229+0000", 2024-09-17T02:21:53.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000146098 2024-09-17T02:21:53.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:53.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335349+0000", 2024-09-17T02:21:53.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120631 2024-09-17T02:21:53.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:53.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.357942+0000", 2024-09-17T02:21:53.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022592457 2024-09-17T02:21:53.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:53.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.361286+0000", 2024-09-17T02:21:53.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003343623 2024-09-17T02:21:53.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:53.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.361338+0000", 2024-09-17T02:21:53.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2323e-05 2024-09-17T02:21:53.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:53.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.361433+0000", 2024-09-17T02:21:53.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5568000000000004e-05 2024-09-17T02:21:53.644 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.644 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.644 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.644 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:138244 5.b e54/51 5:d38c94c4:::benchmark_data_smithi001_23533_object10127:head v 54'8567, mlcod=54'8564)", 2024-09-17T02:21:53.644 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.336586+0000", 2024-09-17T02:21:53.644 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.239483675000001, 2024-09-17T02:21:53.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026602741999999999, 2024-09-17T02:21:53.644 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.644 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.644 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:53.644 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336586+0000", 2024-09-17T02:21:53.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336586+0000", 2024-09-17T02:21:53.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336587+0000", 2024-09-17T02:21:53.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0600000000000001e-07 2024-09-17T02:21:53.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336590+0000", 2024-09-17T02:21:53.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3110000000000001e-06 2024-09-17T02:21:53.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336597+0000", 2024-09-17T02:21:53.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0639999999999996e-06 2024-09-17T02:21:53.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336602+0000", 2024-09-17T02:21:53.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3599999999999998e-06 2024-09-17T02:21:53.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336645+0000", 2024-09-17T02:21:53.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3628999999999999e-05 2024-09-17T02:21:53.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336666+0000", 2024-09-17T02:21:53.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0604000000000001e-05 2024-09-17T02:21:53.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:53.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363143+0000", 2024-09-17T02:21:53.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026477055999999999 2024-09-17T02:21:53.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:53.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363189+0000", 2024-09-17T02:21:53.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6312e-05 2024-09-17T02:21:53.648 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.648 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.648 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.648 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:138259 5.3 5:c08b4023:::benchmark_data_smithi001_23533_object10142:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:53.648 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.337063+0000", 2024-09-17T02:21:53.648 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.239006857, 2024-09-17T02:21:53.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027773173000000002, 2024-09-17T02:21:53.649 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.649 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.649 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:53.649 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:53.649 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:53.649 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.649 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 138259 2024-09-17T02:21:53.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.649 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337063+0000", 2024-09-17T02:21:53.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337063+0000", 2024-09-17T02:21:53.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337064+0000", 2024-09-17T02:21:53.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-17T02:21:53.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337066+0000", 2024-09-17T02:21:53.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.03e-06 2024-09-17T02:21:53.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337072+0000", 2024-09-17T02:21:53.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5119999999999997e-06 2024-09-17T02:21:53.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337077+0000", 2024-09-17T02:21:53.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.454e-06 2024-09-17T02:21:53.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.352990+0000", 2024-09-17T02:21:53.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015913116000000001 2024-09-17T02:21:53.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.353136+0000", 2024-09-17T02:21:53.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000146117 2024-09-17T02:21:53.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:53.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.353253+0000", 2024-09-17T02:21:53.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117359 2024-09-17T02:21:53.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:53.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.358284+0000", 2024-09-17T02:21:53.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050306689999999998 2024-09-17T02:21:53.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:53.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.364738+0000", 2024-09-17T02:21:53.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064539410000000004 2024-09-17T02:21:53.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:53.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.364768+0000", 2024-09-17T02:21:53.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0086999999999998e-05 2024-09-17T02:21:53.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:53.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.364836+0000", 2024-09-17T02:21:53.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8549999999999999e-05 2024-09-17T02:21:53.654 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.654 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.654 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.654 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:138249 5.b e54/51 5:dcbad32d:::benchmark_data_smithi001_23533_object10132:head v 54'8568, mlcod=54'8564)", 2024-09-17T02:21:53.654 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.338016+0000", 2024-09-17T02:21:53.654 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.238054517, 2024-09-17T02:21:53.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025210803, 2024-09-17T02:21:53.655 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.655 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.655 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:53.655 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338016+0000", 2024-09-17T02:21:53.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338016+0000", 2024-09-17T02:21:53.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338017+0000", 2024-09-17T02:21:53.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.28e-06 2024-09-17T02:21:53.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338022+0000", 2024-09-17T02:21:53.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0950000000000003e-06 2024-09-17T02:21:53.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338032+0000", 2024-09-17T02:21:53.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7140000000000005e-06 2024-09-17T02:21:53.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338038+0000", 2024-09-17T02:21:53.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1029999999999998e-06 2024-09-17T02:21:53.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.349300+0000", 2024-09-17T02:21:53.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01126216 2024-09-17T02:21:53.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.349359+0000", 2024-09-17T02:21:53.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9206999999999997e-05 2024-09-17T02:21:53.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:53.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363192+0000", 2024-09-17T02:21:53.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013833253 2024-09-17T02:21:53.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:53.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363226+0000", 2024-09-17T02:21:53.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3991e-05 2024-09-17T02:21:53.658 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.659 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.659 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.659 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:139587 5.1 5:801d98ef:::benchmark_data_smithi001_23533_object11470:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:53.659 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.931670+0000", 2024-09-17T02:21:53.659 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.644399778, 2024-09-17T02:21:53.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025666268999999999, 2024-09-17T02:21:53.659 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.659 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.659 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:53.659 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:53.659 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:53.659 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.660 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 139587 2024-09-17T02:21:53.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.660 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931670+0000", 2024-09-17T02:21:53.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931670+0000", 2024-09-17T02:21:53.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931671+0000", 2024-09-17T02:21:53.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.034e-06 2024-09-17T02:21:53.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931677+0000", 2024-09-17T02:21:53.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4580000000000001e-06 2024-09-17T02:21:53.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931690+0000", 2024-09-17T02:21:53.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3152999999999999e-05 2024-09-17T02:21:53.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931699+0000", 2024-09-17T02:21:53.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3100000000000006e-06 2024-09-17T02:21:53.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931779+0000", 2024-09-17T02:21:53.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0284000000000006e-05 2024-09-17T02:21:53.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931968+0000", 2024-09-17T02:21:53.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018853399999999999 2024-09-17T02:21:53.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:53.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.932149+0000", 2024-09-17T02:21:53.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018114699999999999 2024-09-17T02:21:53.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:53.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.935163+0000", 2024-09-17T02:21:53.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030143169999999999 2024-09-17T02:21:53.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:53.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.957199+0000", 2024-09-17T02:21:53.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022035255 2024-09-17T02:21:53.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:53.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.957247+0000", 2024-09-17T02:21:53.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8319999999999998e-05 2024-09-17T02:21:53.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:53.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.957337+0000", 2024-09-17T02:21:53.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9456999999999994e-05 2024-09-17T02:21:53.664 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.664 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.665 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.665 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:140178 5.1 5:8f77d9ee:::benchmark_data_smithi001_23533_object12061:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:53.665 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:21:53.665 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.388614286999999, 2024-09-17T02:21:53.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025269478000000001, 2024-09-17T02:21:53.665 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.665 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.665 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:53.665 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:53.665 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:53.665 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.665 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 140178 2024-09-17T02:21:53.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.666 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:21:53.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:21:53.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:21:53.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0500000000000004e-07 2024-09-17T02:21:53.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187459+0000", 2024-09-17T02:21:53.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5299999999999999e-06 2024-09-17T02:21:53.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187468+0000", 2024-09-17T02:21:53.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3130000000000004e-06 2024-09-17T02:21:53.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187473+0000", 2024-09-17T02:21:53.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-09-17T02:21:53.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.192476+0000", 2024-09-17T02:21:53.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050035339999999996 2024-09-17T02:21:53.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.192603+0000", 2024-09-17T02:21:53.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012652299999999999 2024-09-17T02:21:53.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:53.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.192719+0000", 2024-09-17T02:21:53.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011568700000000001 2024-09-17T02:21:53.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:53.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.196336+0000", 2024-09-17T02:21:53.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003617178 2024-09-17T02:21:53.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:53.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.212470+0000", 2024-09-17T02:21:53.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016134402999999999 2024-09-17T02:21:53.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:53.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.212522+0000", 2024-09-17T02:21:53.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1480000000000002e-05 2024-09-17T02:21:53.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:53.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.212725+0000", 2024-09-17T02:21:53.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020359100000000001 2024-09-17T02:21:53.670 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.670 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.670 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.671 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:150456 5.2 5:4ee9ae1c:::benchmark_data_smithi001_23533_object22339:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:53.671 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.838305+0000", 2024-09-17T02:21:53.671 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.7377650610000002, 2024-09-17T02:21:53.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026350045999999998, 2024-09-17T02:21:53.671 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.671 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.671 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:53.671 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:53.671 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:53.671 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.671 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 150456 2024-09-17T02:21:53.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.672 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838305+0000", 2024-09-17T02:21:53.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838305+0000", 2024-09-17T02:21:53.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838305+0000", 2024-09-17T02:21:53.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4999999999999998e-07 2024-09-17T02:21:53.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838308+0000", 2024-09-17T02:21:53.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.187e-06 2024-09-17T02:21:53.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838314+0000", 2024-09-17T02:21:53.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2400000000000004e-06 2024-09-17T02:21:53.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838318+0000", 2024-09-17T02:21:53.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5020000000000003e-06 2024-09-17T02:21:53.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.840927+0000", 2024-09-17T02:21:53.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026083690000000001 2024-09-17T02:21:53.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.841037+0000", 2024-09-17T02:21:53.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109888 2024-09-17T02:21:53.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:53.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.864539+0000", 2024-09-17T02:21:53.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023502788 2024-09-17T02:21:53.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:53.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.864586+0000", 2024-09-17T02:21:53.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6554999999999997e-05 2024-09-17T02:21:53.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:53.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.864655+0000", 2024-09-17T02:21:53.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9066999999999994e-05 2024-09-17T02:21:53.676 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.676 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.676 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.676 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:150458 5.a 5:59b62890:::benchmark_data_smithi001_23533_object22341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:53.676 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:21:53.676 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.737744331, 2024-09-17T02:21:53.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028150173000000001, 2024-09-17T02:21:53.676 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.676 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.677 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:53.677 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:53.677 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:53.677 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.677 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 150458 2024-09-17T02:21:53.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.677 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:21:53.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:21:53.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:21:53.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7800000000000002e-07 2024-09-17T02:21:53.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838328+0000", 2024-09-17T02:21:53.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.838e-06 2024-09-17T02:21:53.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838335+0000", 2024-09-17T02:21:53.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1999999999999997e-06 2024-09-17T02:21:53.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838340+0000", 2024-09-17T02:21:53.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7389999999999999e-06 2024-09-17T02:21:53.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849082+0000", 2024-09-17T02:21:53.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01074174 2024-09-17T02:21:53.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849192+0000", 2024-09-17T02:21:53.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011040300000000001 2024-09-17T02:21:53.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:53.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849297+0000", 2024-09-17T02:21:53.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104764 2024-09-17T02:21:53.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:53.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.857853+0000", 2024-09-17T02:21:53.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085558490000000008 2024-09-17T02:21:53.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:53.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866430+0000", 2024-09-17T02:21:53.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085768140000000003 2024-09-17T02:21:53.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:53.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866454+0000", 2024-09-17T02:21:53.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4428000000000001e-05 2024-09-17T02:21:53.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:53.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866476+0000", 2024-09-17T02:21:53.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.192e-05 2024-09-17T02:21:53.682 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.682 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.682 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.682 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:150461 5.a 5:58886edc:::benchmark_data_smithi001_23533_object22344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:53.682 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.838709+0000", 2024-09-17T02:21:53.682 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.7373610169999996, 2024-09-17T02:21:53.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027819366000000002, 2024-09-17T02:21:53.682 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:53.682 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:53.683 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:53.683 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:53.683 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:53.683 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.683 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 150461 2024-09-17T02:21:53.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.683 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:53.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:53.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838709+0000", 2024-09-17T02:21:53.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:53.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838709+0000", 2024-09-17T02:21:53.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:53.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:53.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838710+0000", 2024-09-17T02:21:53.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9399999999999995e-07 2024-09-17T02:21:53.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:53.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838712+0000", 2024-09-17T02:21:53.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.57e-06 2024-09-17T02:21:53.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:53.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838843+0000", 2024-09-17T02:21:53.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130469 2024-09-17T02:21:53.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838925+0000", 2024-09-17T02:21:53.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2622999999999998e-05 2024-09-17T02:21:53.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:53.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.855341+0000", 2024-09-17T02:21:53.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016415965000000001 2024-09-17T02:21:53.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:53.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.855509+0000", 2024-09-17T02:21:53.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016805800000000001 2024-09-17T02:21:53.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:53.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.855638+0000", 2024-09-17T02:21:53.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012901199999999999 2024-09-17T02:21:53.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:53.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.860084+0000", 2024-09-17T02:21:53.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044458650000000002 2024-09-17T02:21:53.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:53.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866486+0000", 2024-09-17T02:21:53.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064016919999999996 2024-09-17T02:21:53.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:53.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866505+0000", 2024-09-17T02:21:53.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9667e-05 2024-09-17T02:21:53.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:53.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:53.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:53.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866528+0000", 2024-09-17T02:21:53.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2951000000000001e-05 2024-09-17T02:21:53.688 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.688 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.688 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.688 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:53.688 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:53.688 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:53.690 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:53.690 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:53.692+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:53.793 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:53.796+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:53.842 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:53.842 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:53.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.842 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:168146 5.8 e58/26 5:199c6304:::benchmark_data_smithi001_23533_object40029:head v 58'10669, mlcod=58'10666)", 2024-09-17T02:21:53.842 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:53.840896+0000", 2024-09-17T02:21:53.842 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0053302979999999998, 2024-09-17T02:21:53.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0053640720000000001, 2024-09-17T02:21:53.843 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:53.843 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:53.843 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:53.843 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:53.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:53.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.840896+0000", 2024-09-17T02:21:53.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:53.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:53.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.840896+0000", 2024-09-17T02:21:53.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:53.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:53.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.840897+0000", 2024-09-17T02:21:53.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5700000000000002e-07 2024-09-17T02:21:53.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:53.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.840901+0000", 2024-09-17T02:21:53.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7520000000000004e-06 2024-09-17T02:21:53.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:53.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.840919+0000", 2024-09-17T02:21:53.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7638e-05 2024-09-17T02:21:53.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.840925+0000", 2024-09-17T02:21:53.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.545e-06 2024-09-17T02:21:53.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:53.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.840963+0000", 2024-09-17T02:21:53.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7375e-05 2024-09-17T02:21:53.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:53.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.840976+0000", 2024-09-17T02:21:53.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2849e-05 2024-09-17T02:21:53.846 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:53.846 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:53.846 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:53.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.846 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:168155 5.3 e58/51 5:c36f72b7:::benchmark_data_smithi001_23533_object40038:head v 58'10631, mlcod=58'10628)", 2024-09-17T02:21:53.846 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:53.842143+0000", 2024-09-17T02:21:53.847 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0040831139999999997, 2024-09-17T02:21:53.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041600760000000004, 2024-09-17T02:21:53.847 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:53.847 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:53.847 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:53.847 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:53.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:53.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.842143+0000", 2024-09-17T02:21:53.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:53.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:53.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.842143+0000", 2024-09-17T02:21:53.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:53.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:53.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.842144+0000", 2024-09-17T02:21:53.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3200000000000004e-07 2024-09-17T02:21:53.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:53.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.842149+0000", 2024-09-17T02:21:53.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4920000000000001e-06 2024-09-17T02:21:53.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:53.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.842163+0000", 2024-09-17T02:21:53.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3444999999999999e-05 2024-09-17T02:21:53.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.842170+0000", 2024-09-17T02:21:53.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3329999999999999e-06 2024-09-17T02:21:53.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:53.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.842227+0000", 2024-09-17T02:21:53.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6725999999999999e-05 2024-09-17T02:21:53.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:53.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.842249+0000", 2024-09-17T02:21:53.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1865000000000002e-05 2024-09-17T02:21:53.850 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:53.850 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:53.850 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:53.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.851 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:168149 5.8 e58/26 5:15476081:::benchmark_data_smithi001_23533_object40032:head v 58'10670, mlcod=58'10666)", 2024-09-17T02:21:53.851 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:53.842626+0000", 2024-09-17T02:21:53.851 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0035997109999999998, 2024-09-17T02:21:53.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003709642, 2024-09-17T02:21:53.851 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:53.851 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:53.851 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:53.851 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:53.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:53.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.842626+0000", 2024-09-17T02:21:53.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:53.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:53.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.842626+0000", 2024-09-17T02:21:53.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:53.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:53.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.842627+0000", 2024-09-17T02:21:53.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2900000000000003e-07 2024-09-17T02:21:53.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:53.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.842632+0000", 2024-09-17T02:21:53.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7949999999999998e-06 2024-09-17T02:21:53.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:53.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.842644+0000", 2024-09-17T02:21:53.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2435999999999999e-05 2024-09-17T02:21:53.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.842652+0000", 2024-09-17T02:21:53.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8939999999999993e-06 2024-09-17T02:21:53.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:53.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.842959+0000", 2024-09-17T02:21:53.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030619799999999998 2024-09-17T02:21:53.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:53.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.842971+0000", 2024-09-17T02:21:53.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2695e-05 2024-09-17T02:21:53.854 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:53.854 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:53.854 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:53.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.854 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:168157 5.b 5:db4164dd:::benchmark_data_smithi001_23533_object40040:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-17T02:21:53.855 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:53.844113+0000", 2024-09-17T02:21:53.855 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0021134359999999998, 2024-09-17T02:21:53.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022577690000000002, 2024-09-17T02:21:53.855 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:53.855 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:53.855 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:53.855 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:53.855 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:53.855 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.855 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 168157 2024-09-17T02:21:53.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.855 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:53.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:53.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844113+0000", 2024-09-17T02:21:53.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:53.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:53.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844113+0000", 2024-09-17T02:21:53.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:53.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:53.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844114+0000", 2024-09-17T02:21:53.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1990000000000001e-06 2024-09-17T02:21:53.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:53.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844119+0000", 2024-09-17T02:21:53.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1699999999999996e-06 2024-09-17T02:21:53.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:53.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844140+0000", 2024-09-17T02:21:53.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0981000000000001e-05 2024-09-17T02:21:53.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844150+0000", 2024-09-17T02:21:53.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7729999999999994e-06 2024-09-17T02:21:53.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:53.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844194+0000", 2024-09-17T02:21:53.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4206000000000003e-05 2024-09-17T02:21:53.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:53.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844305+0000", 2024-09-17T02:21:53.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110627 2024-09-17T02:21:53.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:53.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844431+0000", 2024-09-17T02:21:53.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012602800000000001 2024-09-17T02:21:53.859 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:53.859 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:53.859 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:53.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.859 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:168158 5.4 5:2ee4f442:::benchmark_data_smithi001_23533_object40041:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-17T02:21:53.859 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:53.844188+0000", 2024-09-17T02:21:53.859 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0020378140000000002, 2024-09-17T02:21:53.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022251979999999998, 2024-09-17T02:21:53.860 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:53.860 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:53.860 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:53.860 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:53.860 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:53.860 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.860 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 168158 2024-09-17T02:21:53.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.860 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:53.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:53.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844188+0000", 2024-09-17T02:21:53.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:53.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:53.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844188+0000", 2024-09-17T02:21:53.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:53.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:53.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844189+0000", 2024-09-17T02:21:53.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1299999999999999e-07 2024-09-17T02:21:53.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:53.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844193+0000", 2024-09-17T02:21:53.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7419999999999999e-06 2024-09-17T02:21:53.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:53.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844203+0000", 2024-09-17T02:21:53.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0487e-05 2024-09-17T02:21:53.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844211+0000", 2024-09-17T02:21:53.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1890000000000001e-06 2024-09-17T02:21:53.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:53.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844279+0000", 2024-09-17T02:21:53.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8201000000000007e-05 2024-09-17T02:21:53.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:53.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844406+0000", 2024-09-17T02:21:53.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012684400000000001 2024-09-17T02:21:53.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:53.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844527+0000", 2024-09-17T02:21:53.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012097899999999999 2024-09-17T02:21:53.864 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:53.864 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:53.864 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:53.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.864 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:168159 5.4 5:214330b2:::benchmark_data_smithi001_23533_object40042:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-17T02:21:53.864 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:53.844240+0000", 2024-09-17T02:21:53.864 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0019861319999999998, 2024-09-17T02:21:53.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002212823, 2024-09-17T02:21:53.864 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:53.864 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:53.864 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:53.865 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:53.865 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:53.865 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:53.865 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 168159 2024-09-17T02:21:53.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.865 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:53.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:53.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844240+0000", 2024-09-17T02:21:53.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:53.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:53.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844240+0000", 2024-09-17T02:21:53.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:53.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:53.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844241+0000", 2024-09-17T02:21:53.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8400000000000004e-07 2024-09-17T02:21:53.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:53.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844244+0000", 2024-09-17T02:21:53.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9859999999999999e-06 2024-09-17T02:21:53.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:53.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844255+0000", 2024-09-17T02:21:53.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1195e-05 2024-09-17T02:21:53.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844262+0000", 2024-09-17T02:21:53.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3649999999999998e-06 2024-09-17T02:21:53.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:53.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.846309+0000", 2024-09-17T02:21:53.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020469310000000001 2024-09-17T02:21:53.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:53.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.846420+0000", 2024-09-17T02:21:53.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110742 2024-09-17T02:21:53.868 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:53.868 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:53.868 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:53.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.868 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:168150 5.8 e58/26 5:18b27a8e:::benchmark_data_smithi001_23533_object40033:head v 58'10671, mlcod=58'10666)", 2024-09-17T02:21:53.868 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:53.844300+0000", 2024-09-17T02:21:53.868 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0019260869999999999, 2024-09-17T02:21:53.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021892069999999999, 2024-09-17T02:21:53.869 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:53.869 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:53.869 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:53.869 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:53.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:53.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844300+0000", 2024-09-17T02:21:53.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:53.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:53.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844300+0000", 2024-09-17T02:21:53.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:53.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:53.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844301+0000", 2024-09-17T02:21:53.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4999999999999998e-07 2024-09-17T02:21:53.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:53.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844306+0000", 2024-09-17T02:21:53.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0089999999999998e-06 2024-09-17T02:21:53.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:53.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844315+0000", 2024-09-17T02:21:53.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3440000000000007e-06 2024-09-17T02:21:53.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844321+0000", 2024-09-17T02:21:53.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.964e-06 2024-09-17T02:21:53.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:53.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844582+0000", 2024-09-17T02:21:53.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026119700000000001 2024-09-17T02:21:53.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:53.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844593+0000", 2024-09-17T02:21:53.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1134e-05 2024-09-17T02:21:53.872 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:53.872 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:53.872 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:53.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.872 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:168160 5.a e58/22 5:5cdb3fcb:::benchmark_data_smithi001_23533_object40043:head v 58'10645, mlcod=58'10643)", 2024-09-17T02:21:53.872 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:53.844677+0000", 2024-09-17T02:21:53.872 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.001549618, 2024-09-17T02:21:53.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001872643, 2024-09-17T02:21:53.873 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:53.873 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:53.873 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:53.873 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:53.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:53.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844677+0000", 2024-09-17T02:21:53.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:53.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:53.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844677+0000", 2024-09-17T02:21:53.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:53.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:53.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844677+0000", 2024-09-17T02:21:53.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3799999999999997e-07 2024-09-17T02:21:53.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:53.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844683+0000", 2024-09-17T02:21:53.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3340000000000001e-06 2024-09-17T02:21:53.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:53.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844694+0000", 2024-09-17T02:21:53.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1759999999999999e-05 2024-09-17T02:21:53.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844701+0000", 2024-09-17T02:21:53.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6409999999999996e-06 2024-09-17T02:21:53.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:53.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844757+0000", 2024-09-17T02:21:53.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6298999999999997e-05 2024-09-17T02:21:53.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:53.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844775+0000", 2024-09-17T02:21:53.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7938999999999999e-05 2024-09-17T02:21:53.876 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:53.876 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:53.876 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:53.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.876 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:168153 5.1 e58/51 5:8e703137:::benchmark_data_smithi001_23533_object40036:head v 58'10424, mlcod=58'10421)", 2024-09-17T02:21:53.876 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:53.844717+0000", 2024-09-17T02:21:53.876 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0015095849999999999, 2024-09-17T02:21:53.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018802109999999999, 2024-09-17T02:21:53.876 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:53.877 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:53.877 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:53.877 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:53.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:53.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844717+0000", 2024-09-17T02:21:53.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:53.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:53.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844717+0000", 2024-09-17T02:21:53.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:53.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:53.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844717+0000", 2024-09-17T02:21:53.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7599999999999998e-07 2024-09-17T02:21:53.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:53.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844720+0000", 2024-09-17T02:21:53.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0910000000000001e-06 2024-09-17T02:21:53.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:53.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844736+0000", 2024-09-17T02:21:53.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5608999999999999e-05 2024-09-17T02:21:53.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844741+0000", 2024-09-17T02:21:53.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.242e-06 2024-09-17T02:21:53.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:53.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844777+0000", 2024-09-17T02:21:53.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5961999999999999e-05 2024-09-17T02:21:53.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:53.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.844794+0000", 2024-09-17T02:21:53.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7246999999999999e-05 2024-09-17T02:21:53.880 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:53.880 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:53.880 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:53.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.880 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:168151 5.0 e58/26 5:021d8348:::benchmark_data_smithi001_23533_object40034:head v 58'10426, mlcod=58'10423)", 2024-09-17T02:21:53.880 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:53.845781+0000", 2024-09-17T02:21:53.880 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00044486299999999999, 2024-09-17T02:21:53.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00084720300000000004, 2024-09-17T02:21:53.880 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:53.880 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:53.881 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:53.881 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:53.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:53.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.845781+0000", 2024-09-17T02:21:53.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:53.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:53.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.845781+0000", 2024-09-17T02:21:53.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:53.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:53.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.845782+0000", 2024-09-17T02:21:53.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1699999999999997e-07 2024-09-17T02:21:53.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:53.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.845787+0000", 2024-09-17T02:21:53.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0429999999999998e-06 2024-09-17T02:21:53.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:53.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.845799+0000", 2024-09-17T02:21:53.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2199e-05 2024-09-17T02:21:53.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:53.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.845806+0000", 2024-09-17T02:21:53.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6579999999999996e-06 2024-09-17T02:21:53.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:53.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.846014+0000", 2024-09-17T02:21:53.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000207672 2024-09-17T02:21:53.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:53.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:53.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:53.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:53.846033+0000", 2024-09-17T02:21:53.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9125000000000001e-05 2024-09-17T02:21:53.883 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:53.884 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:53.884 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:53.884 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:53.884 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:21:53.884 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 10 2024-09-17T02:21:53.884 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:53.885 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:53.928 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:53.932+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:53.992 INFO:teuthology.orchestra.run.smithi001.stderr:noscrub is set 2024-09-17T02:21:53.995 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:53.996+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:54.080 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:54.080 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:21:54.080 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:21:54.080 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:21:54.080 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:54.095 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:54.093+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:54.097 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:54.197 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:54.197+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:54.298 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:54.298 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:21:54.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:21:54.298 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:54.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.298 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97749 5.b 5:d930ef52:::benchmark_data_smithi001_23533_object97748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:54.299 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:54.299 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.708597142999999, 2024-09-17T02:21:54.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092964343000000005, 2024-09-17T02:21:54.299 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:54.299 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:54.299 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:54.299 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:54.299 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:54.299 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.299 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97749 2024-09-17T02:21:54.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.299 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:54.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:54.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:54.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:54.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:54.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:54.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591947+0000", 2024-09-17T02:21:54.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:21:54.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:54.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592011+0000", 2024-09-17T02:21:54.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3608000000000005e-05 2024-09-17T02:21:54.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:54.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592021+0000", 2024-09-17T02:21:54.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9979999999999998e-06 2024-09-17T02:21:54.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592028+0000", 2024-09-17T02:21:54.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1439999999999997e-06 2024-09-17T02:21:54.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593633+0000", 2024-09-17T02:21:54.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001604636 2024-09-17T02:21:54.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:54.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593757+0000", 2024-09-17T02:21:54.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012432099999999999 2024-09-17T02:21:54.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:54.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593866+0000", 2024-09-17T02:21:54.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109094 2024-09-17T02:21:54.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:54.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601190+0000", 2024-09-17T02:21:54.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073237620000000002 2024-09-17T02:21:54.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:54.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601356+0000", 2024-09-17T02:21:54.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016651900000000001 2024-09-17T02:21:54.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:54.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684618+0000", 2024-09-17T02:21:54.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083261356999999994 2024-09-17T02:21:54.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:54.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684724+0000", 2024-09-17T02:21:54.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010681800000000001 2024-09-17T02:21:54.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:54.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684911+0000", 2024-09-17T02:21:54.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186243 2024-09-17T02:21:54.305 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.305 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:54.305 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.305 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97752 5.b 5:d146f486:::benchmark_data_smithi001_23533_object97751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:54.305 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:54.305 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.707244449000001, 2024-09-17T02:21:54.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091989557, 2024-09-17T02:21:54.305 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:54.306 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:54.306 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:54.306 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:54.306 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:54.306 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.306 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97752 2024-09-17T02:21:54.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.306 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:54.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:54.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:54.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:54.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:54.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:54.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593300+0000", 2024-09-17T02:21:54.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8199999999999998e-07 2024-09-17T02:21:54.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:54.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593364+0000", 2024-09-17T02:21:54.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3831999999999995e-05 2024-09-17T02:21:54.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:54.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593376+0000", 2024-09-17T02:21:54.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1800999999999999e-05 2024-09-17T02:21:54.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593382+0000", 2024-09-17T02:21:54.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6780000000000003e-06 2024-09-17T02:21:54.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595491+0000", 2024-09-17T02:21:54.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021090689999999999 2024-09-17T02:21:54.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:54.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595614+0000", 2024-09-17T02:21:54.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012321500000000001 2024-09-17T02:21:54.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:54.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595778+0000", 2024-09-17T02:21:54.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016321900000000001 2024-09-17T02:21:54.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:54.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601197+0000", 2024-09-17T02:21:54.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054195600000000003 2024-09-17T02:21:54.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:54.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601396+0000", 2024-09-17T02:21:54.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019825299999999999 2024-09-17T02:21:54.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:54.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684990+0000", 2024-09-17T02:21:54.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083594878999999997 2024-09-17T02:21:54.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:54.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685116+0000", 2024-09-17T02:21:54.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012522799999999999 2024-09-17T02:21:54.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:54.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685289+0000", 2024-09-17T02:21:54.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172941 2024-09-17T02:21:54.311 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.311 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:54.311 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.312 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97754 5.b 5:da0615e5:::benchmark_data_smithi001_23533_object97753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:54.312 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:54.312 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.705606527, 2024-09-17T02:21:54.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092097207, 2024-09-17T02:21:54.312 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:54.312 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:54.312 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:54.312 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:54.312 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:54.312 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.312 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97754 2024-09-17T02:21:54.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.313 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:54.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:54.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:54.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:54.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:54.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:54.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594938+0000", 2024-09-17T02:21:54.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5000000000000002e-07 2024-09-17T02:21:54.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:54.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595075+0000", 2024-09-17T02:21:54.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137742 2024-09-17T02:21:54.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:54.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595087+0000", 2024-09-17T02:21:54.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1243000000000001e-05 2024-09-17T02:21:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595095+0000", 2024-09-17T02:21:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1030000000000002e-06 2024-09-17T02:21:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598461+0000", 2024-09-17T02:21:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033661170000000001 2024-09-17T02:21:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598540+0000", 2024-09-17T02:21:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8937999999999995e-05 2024-09-17T02:21:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598626+0000", 2024-09-17T02:21:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6042000000000001e-05 2024-09-17T02:21:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684258+0000", 2024-09-17T02:21:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085632394000000001 2024-09-17T02:21:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:54.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685369+0000", 2024-09-17T02:21:54.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001111063 2024-09-17T02:21:54.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:54.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685511+0000", 2024-09-17T02:21:54.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141965 2024-09-17T02:21:54.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:54.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685604+0000", 2024-09-17T02:21:54.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2935000000000004e-05 2024-09-17T02:21:54.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:54.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687034+0000", 2024-09-17T02:21:54.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001430015 2024-09-17T02:21:54.318 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.318 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:54.318 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.318 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97755 5.b 5:d36a03a1:::benchmark_data_smithi001_23533_object97754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:54.318 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:54.319 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.705433376999999, 2024-09-17T02:21:54.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0924904, 2024-09-17T02:21:54.319 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:54.319 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:54.319 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:54.319 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:54.319 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:54.319 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.319 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97755 2024-09-17T02:21:54.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.319 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:54.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595111+0000", 2024-09-17T02:21:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:21:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:54.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595145+0000", 2024-09-17T02:21:54.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3927000000000002e-05 2024-09-17T02:21:54.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:54.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595155+0000", 2024-09-17T02:21:54.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0023e-05 2024-09-17T02:21:54.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595162+0000", 2024-09-17T02:21:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3950000000000003e-06 2024-09-17T02:21:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599821+0000", 2024-09-17T02:21:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046592880000000001 2024-09-17T02:21:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599912+0000", 2024-09-17T02:21:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1049000000000002e-05 2024-09-17T02:21:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600062+0000", 2024-09-17T02:21:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015001700000000001 2024-09-17T02:21:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685307+0000", 2024-09-17T02:21:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085244340000000002 2024-09-17T02:21:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685446+0000", 2024-09-17T02:21:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013955700000000001 2024-09-17T02:21:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687375+0000", 2024-09-17T02:21:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019291079999999999 2024-09-17T02:21:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687462+0000", 2024-09-17T02:21:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6148000000000003e-05 2024-09-17T02:21:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687600+0000", 2024-09-17T02:21:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013887900000000001 2024-09-17T02:21:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 44/44 lb 5:c4567a04:::benchmark_data_smithi001_23533_object4200:head)", 2024-09-17T02:21:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.703336751000002, 2024-09-17T02:21:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092483421999999996, 2024-09-17T02:21:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:54.326 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:54.326 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:54.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:54.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:54.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6399999999999998e-07 2024-09-17T02:21:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597213+0000", 2024-09-17T02:21:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3659999999999997e-06 2024-09-17T02:21:54.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:54.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597222+0000", 2024-09-17T02:21:54.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0510000000000002e-06 2024-09-17T02:21:54.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597228+0000", 2024-09-17T02:21:54.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1569999999999999e-06 2024-09-17T02:21:54.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689588+0000", 2024-09-17T02:21:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092359931000000006 2024-09-17T02:21:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689622+0000", 2024-09-17T02:21:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4425999999999999e-05 2024-09-17T02:21:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689690+0000", 2024-09-17T02:21:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8126999999999993e-05 2024-09-17T02:21:54.330 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.330 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:54.330 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.330 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129462 5.4 5:2e0acc16:::benchmark_data_smithi001_23533_object1345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:54.330 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:21:54.330 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.765602682000001, 2024-09-17T02:21:54.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0112774899999999, 2024-09-17T02:21:54.330 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:54.330 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:54.330 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129462 2024-09-17T02:21:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:21:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:54.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:21:54.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:54.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534943+0000", 2024-09-17T02:21:54.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8759999999999999e-06 2024-09-17T02:21:54.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:54.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534951+0000", 2024-09-17T02:21:54.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3219999999999993e-06 2024-09-17T02:21:54.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534977+0000", 2024-09-17T02:21:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6245e-05 2024-09-17T02:21:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534992+0000", 2024-09-17T02:21:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4936000000000001e-05 2024-09-17T02:21:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535133+0000", 2024-09-17T02:21:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014051299999999999 2024-09-17T02:21:54.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:54.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:21:54.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1741000000000001e-05 2024-09-17T02:21:54.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.533906+0000", 2024-09-17T02:21:54.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99875209300000001 2024-09-17T02:21:54.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:54.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534348+0000", 2024-09-17T02:21:54.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044128899999999998 2024-09-17T02:21:54.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:54.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534762+0000", 2024-09-17T02:21:54.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000414707 2024-09-17T02:21:54.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:54.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545024+0000", 2024-09-17T02:21:54.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010261283 2024-09-17T02:21:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545953+0000", 2024-09-17T02:21:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000929618 2024-09-17T02:21:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546047+0000", 2024-09-17T02:21:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3697999999999996e-05 2024-09-17T02:21:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:54.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546218+0000", 2024-09-17T02:21:54.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017116899999999999 2024-09-17T02:21:54.337 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.337 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:54.337 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.337 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129480 5.4 5:2b1d398b:::benchmark_data_smithi001_23533_object1363:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:54.337 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:21:54.337 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.757848215999999, 2024-09-17T02:21:54.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0038926450000001, 2024-09-17T02:21:54.337 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:54.338 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:54.338 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:54.338 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:54.338 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:54.338 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.338 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129480 2024-09-17T02:21:54.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.338 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:54.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:54.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:21:54.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:21:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542696+0000", 2024-09-17T02:21:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9999999999999995e-07 2024-09-17T02:21:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542701+0000", 2024-09-17T02:21:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2240000000000003e-06 2024-09-17T02:21:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542716+0000", 2024-09-17T02:21:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4970000000000001e-05 2024-09-17T02:21:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542726+0000", 2024-09-17T02:21:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2879999999999998e-06 2024-09-17T02:21:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542832+0000", 2024-09-17T02:21:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010597199999999999 2024-09-17T02:21:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542843+0000", 2024-09-17T02:21:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.098e-05 2024-09-17T02:21:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538436+0000", 2024-09-17T02:21:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99559286800000002 2024-09-17T02:21:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538791+0000", 2024-09-17T02:21:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035585499999999997 2024-09-17T02:21:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.539144+0000", 2024-09-17T02:21:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035268499999999999 2024-09-17T02:21:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545880+0000", 2024-09-17T02:21:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00673552 2024-09-17T02:21:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546330+0000", 2024-09-17T02:21:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045039599999999999 2024-09-17T02:21:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546414+0000", 2024-09-17T02:21:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4468000000000005e-05 2024-09-17T02:21:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546588+0000", 2024-09-17T02:21:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017341899999999999 2024-09-17T02:21:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129505 5.4 5:294f2ec7:::benchmark_data_smithi001_23533_object1388:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:21:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.738835043000002, 2024-09-17T02:21:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98589826199999997, 2024-09-17T02:21:54.345 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:54.345 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:54.345 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:54.345 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:54.345 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:54.345 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.345 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129505 2024-09-17T02:21:54.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.345 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:54.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:54.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:21:54.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:54.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:21:54.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:54.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561710+0000", 2024-09-17T02:21:54.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7060000000000001e-06 2024-09-17T02:21:54.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561718+0000", 2024-09-17T02:21:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.542e-06 2024-09-17T02:21:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561741+0000", 2024-09-17T02:21:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3357e-05 2024-09-17T02:21:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561754+0000", 2024-09-17T02:21:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3200000000000001e-05 2024-09-17T02:21:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561867+0000", 2024-09-17T02:21:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113211 2024-09-17T02:21:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561888+0000", 2024-09-17T02:21:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0809999999999999e-05 2024-09-17T02:21:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542140+0000", 2024-09-17T02:21:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98025195799999998 2024-09-17T02:21:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542331+0000", 2024-09-17T02:21:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019127599999999999 2024-09-17T02:21:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542517+0000", 2024-09-17T02:21:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000185625 2024-09-17T02:21:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:54.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547114+0000", 2024-09-17T02:21:54.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045968620000000002 2024-09-17T02:21:54.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:54.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547187+0000", 2024-09-17T02:21:54.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3348000000000003e-05 2024-09-17T02:21:54.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:54.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547324+0000", 2024-09-17T02:21:54.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013681699999999999 2024-09-17T02:21:54.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:54.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547607+0000", 2024-09-17T02:21:54.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028255000000000001 2024-09-17T02:21:54.351 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.351 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:54.351 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.351 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129508 5.4 5:2892b582:::benchmark_data_smithi001_23533_object1391:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:21:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.737497950000002, 2024-09-17T02:21:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99697919099999999, 2024-09-17T02:21:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129508 2024-09-17T02:21:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:21:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:21:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563047+0000", 2024-09-17T02:21:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.274e-06 2024-09-17T02:21:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563054+0000", 2024-09-17T02:21:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2799999999999998e-06 2024-09-17T02:21:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563070+0000", 2024-09-17T02:21:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5991999999999999e-05 2024-09-17T02:21:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563078+0000", 2024-09-17T02:21:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2390000000000002e-06 2024-09-17T02:21:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563181+0000", 2024-09-17T02:21:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102249 2024-09-17T02:21:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563199+0000", 2024-09-17T02:21:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8215000000000001e-05 2024-09-17T02:21:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547713+0000", 2024-09-17T02:21:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98451446399999998 2024-09-17T02:21:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548063+0000", 2024-09-17T02:21:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034985499999999999 2024-09-17T02:21:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548490+0000", 2024-09-17T02:21:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042658600000000001 2024-09-17T02:21:54.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:54.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555655+0000", 2024-09-17T02:21:54.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071652579999999999 2024-09-17T02:21:54.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:54.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559612+0000", 2024-09-17T02:21:54.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003957103 2024-09-17T02:21:54.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:54.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559768+0000", 2024-09-17T02:21:54.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015556899999999999 2024-09-17T02:21:54.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:54.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560025+0000", 2024-09-17T02:21:54.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025710700000000002 2024-09-17T02:21:54.358 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.358 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:54.358 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.358 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129509 5.4 5:2c35515e:::benchmark_data_smithi001_23533_object1392:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:54.359 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:21:54.359 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.736870896999999, 2024-09-17T02:21:54.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99969384900000002, 2024-09-17T02:21:54.359 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:54.359 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:54.359 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:54.359 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:54.359 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:54.359 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.359 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129509 2024-09-17T02:21:54.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.359 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:54.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:54.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:21:54.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:54.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:21:54.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:54.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563674+0000", 2024-09-17T02:21:54.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0920000000000001e-06 2024-09-17T02:21:54.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:54.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563679+0000", 2024-09-17T02:21:54.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7660000000000004e-06 2024-09-17T02:21:54.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:54.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563693+0000", 2024-09-17T02:21:54.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3139000000000001e-05 2024-09-17T02:21:54.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563701+0000", 2024-09-17T02:21:54.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9859999999999994e-06 2024-09-17T02:21:54.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563775+0000", 2024-09-17T02:21:54.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4659000000000005e-05 2024-09-17T02:21:54.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:54.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563785+0000", 2024-09-17T02:21:54.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4839999999999993e-06 2024-09-17T02:21:54.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552085+0000", 2024-09-17T02:21:54.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98829986999999997 2024-09-17T02:21:54.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:54.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552554+0000", 2024-09-17T02:21:54.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046908900000000001 2024-09-17T02:21:54.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:54.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552931+0000", 2024-09-17T02:21:54.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377778 2024-09-17T02:21:54.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:54.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563106+0000", 2024-09-17T02:21:54.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010174186 2024-09-17T02:21:54.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:54.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563138+0000", 2024-09-17T02:21:54.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2495e-05 2024-09-17T02:21:54.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:54.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563225+0000", 2024-09-17T02:21:54.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6677999999999999e-05 2024-09-17T02:21:54.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:54.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563366+0000", 2024-09-17T02:21:54.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014162699999999999 2024-09-17T02:21:54.366 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.366 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:54.366 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.366 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129524 5.4 5:25dca7dd:::benchmark_data_smithi001_23533_object1407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:54.366 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:21:54.366 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.730179542999998, 2024-09-17T02:21:54.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99999501999999996, 2024-09-17T02:21:54.367 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:54.367 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:54.367 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:54.367 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:54.367 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:54.367 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.367 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129524 2024-09-17T02:21:54.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.367 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:54.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:54.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:21:54.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:54.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:21:54.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:54.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570365+0000", 2024-09-17T02:21:54.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.142e-06 2024-09-17T02:21:54.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:54.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570369+0000", 2024-09-17T02:21:54.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.856e-06 2024-09-17T02:21:54.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:54.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570385+0000", 2024-09-17T02:21:54.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5855e-05 2024-09-17T02:21:54.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570392+0000", 2024-09-17T02:21:54.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5340000000000002e-06 2024-09-17T02:21:54.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570484+0000", 2024-09-17T02:21:54.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1212999999999996e-05 2024-09-17T02:21:54.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:54.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570498+0000", 2024-09-17T02:21:54.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4331000000000001e-05 2024-09-17T02:21:54.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555835+0000", 2024-09-17T02:21:54.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98533757700000002 2024-09-17T02:21:54.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:54.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556329+0000", 2024-09-17T02:21:54.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000493458 2024-09-17T02:21:54.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:54.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556784+0000", 2024-09-17T02:21:54.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045476499999999999 2024-09-17T02:21:54.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:54.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569852+0000", 2024-09-17T02:21:54.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013068270999999999 2024-09-17T02:21:54.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:54.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569958+0000", 2024-09-17T02:21:54.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106214 2024-09-17T02:21:54.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:54.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570124+0000", 2024-09-17T02:21:54.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165546 2024-09-17T02:21:54.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:54.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570359+0000", 2024-09-17T02:21:54.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023525799999999999 2024-09-17T02:21:54.373 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.373 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:54.373 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.374 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129537 5.4 5:260327c6:::benchmark_data_smithi001_23533_object1420:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:54.374 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:21:54.374 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.722273013999999, 2024-09-17T02:21:54.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99624596499999996, 2024-09-17T02:21:54.374 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:54.374 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:54.374 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:54.374 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:54.374 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:54.374 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.374 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129537 2024-09-17T02:21:54.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.374 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:54.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:54.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:21:54.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:54.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:21:54.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:54.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578272+0000", 2024-09-17T02:21:54.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.164e-06 2024-09-17T02:21:54.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:54.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578278+0000", 2024-09-17T02:21:54.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5060000000000001e-06 2024-09-17T02:21:54.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:54.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578294+0000", 2024-09-17T02:21:54.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5687000000000001e-05 2024-09-17T02:21:54.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578329+0000", 2024-09-17T02:21:54.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5311999999999997e-05 2024-09-17T02:21:54.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578419+0000", 2024-09-17T02:21:54.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0054000000000002e-05 2024-09-17T02:21:54.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:54.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578435+0000", 2024-09-17T02:21:54.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5645999999999999e-05 2024-09-17T02:21:54.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560148+0000", 2024-09-17T02:21:54.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98171342299999997 2024-09-17T02:21:54.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:54.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560383+0000", 2024-09-17T02:21:54.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000234935 2024-09-17T02:21:54.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:54.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560586+0000", 2024-09-17T02:21:54.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000202909 2024-09-17T02:21:54.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:54.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570472+0000", 2024-09-17T02:21:54.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098856959999999994 2024-09-17T02:21:54.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:54.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574138+0000", 2024-09-17T02:21:54.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036660170000000001 2024-09-17T02:21:54.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:54.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574298+0000", 2024-09-17T02:21:54.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016025600000000001 2024-09-17T02:21:54.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:54.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574516+0000", 2024-09-17T02:21:54.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021835999999999999 2024-09-17T02:21:54.380 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.380 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:54.380 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.381 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129545 5.4 5:22366489:::benchmark_data_smithi001_23533_object1428:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:54.381 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:21:54.381 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.716410290999999, 2024-09-17T02:21:54.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99074544499999995, 2024-09-17T02:21:54.381 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:54.381 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:54.381 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:54.381 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:54.381 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:54.381 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.381 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129545 2024-09-17T02:21:54.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.382 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:54.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:54.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:21:54.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:54.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:21:54.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:54.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584135+0000", 2024-09-17T02:21:54.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4699999999999999e-06 2024-09-17T02:21:54.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:54.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584142+0000", 2024-09-17T02:21:54.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1620000000000002e-06 2024-09-17T02:21:54.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:54.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584170+0000", 2024-09-17T02:21:54.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7897000000000001e-05 2024-09-17T02:21:54.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584183+0000", 2024-09-17T02:21:54.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2814e-05 2024-09-17T02:21:54.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584299+0000", 2024-09-17T02:21:54.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116153 2024-09-17T02:21:54.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:54.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584316+0000", 2024-09-17T02:21:54.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7524999999999999e-05 2024-09-17T02:21:54.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563461+0000", 2024-09-17T02:21:54.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97914436699999996 2024-09-17T02:21:54.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:54.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563667+0000", 2024-09-17T02:21:54.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020689800000000001 2024-09-17T02:21:54.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:54.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563878+0000", 2024-09-17T02:21:54.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210275 2024-09-17T02:21:54.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:54.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570584+0000", 2024-09-17T02:21:54.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067066080000000002 2024-09-17T02:21:54.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:54.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574539+0000", 2024-09-17T02:21:54.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039550360000000003 2024-09-17T02:21:54.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:54.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574653+0000", 2024-09-17T02:21:54.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114003 2024-09-17T02:21:54.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:54.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574879+0000", 2024-09-17T02:21:54.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022523700000000001 2024-09-17T02:21:54.388 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.388 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:54.388 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.388 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129553 5.4 5:2e41ad40:::benchmark_data_smithi001_23533_object1436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:54.388 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:21:54.388 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.710987655, 2024-09-17T02:21:54.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99213429600000003, 2024-09-17T02:21:54.388 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:54.388 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:54.389 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:54.389 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:54.389 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:54.389 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.389 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129553 2024-09-17T02:21:54.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.389 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:54.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:54.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:21:54.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:54.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:21:54.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:54.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589557+0000", 2024-09-17T02:21:54.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2219999999999999e-06 2024-09-17T02:21:54.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:54.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589562+0000", 2024-09-17T02:21:54.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0649999999999998e-06 2024-09-17T02:21:54.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:54.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589575+0000", 2024-09-17T02:21:54.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3129000000000001e-05 2024-09-17T02:21:54.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589584+0000", 2024-09-17T02:21:54.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6200000000000005e-06 2024-09-17T02:21:54.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589693+0000", 2024-09-17T02:21:54.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109319 2024-09-17T02:21:54.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:54.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589714+0000", 2024-09-17T02:21:54.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0849999999999999e-05 2024-09-17T02:21:54.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566273+0000", 2024-09-17T02:21:54.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97655884999999998 2024-09-17T02:21:54.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:54.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566543+0000", 2024-09-17T02:21:54.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027059099999999998 2024-09-17T02:21:54.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:54.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566832+0000", 2024-09-17T02:21:54.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028898200000000002 2024-09-17T02:21:54.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:54.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581040+0000", 2024-09-17T02:21:54.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014208001 2024-09-17T02:21:54.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:54.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581200+0000", 2024-09-17T02:21:54.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159956 2024-09-17T02:21:54.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:54.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581427+0000", 2024-09-17T02:21:54.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000226309 2024-09-17T02:21:54.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:54.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581690+0000", 2024-09-17T02:21:54.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026340199999999998 2024-09-17T02:21:54.395 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.395 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:54.395 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.395 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129580 5.4 5:25ed887b:::benchmark_data_smithi001_23533_object1463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:54.395 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:21:54.395 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.689215611000002, 2024-09-17T02:21:54.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98001430499999997, 2024-09-17T02:21:54.395 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:54.396 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:54.396 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:54.396 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:54.396 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:54.396 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.396 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129580 2024-09-17T02:21:54.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.396 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:54.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:54.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:21:54.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:54.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:21:54.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:54.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611329+0000", 2024-09-17T02:21:54.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.22e-06 2024-09-17T02:21:54.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:54.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611335+0000", 2024-09-17T02:21:54.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1129999999999997e-06 2024-09-17T02:21:54.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:54.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611348+0000", 2024-09-17T02:21:54.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2342e-05 2024-09-17T02:21:54.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611356+0000", 2024-09-17T02:21:54.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.371e-06 2024-09-17T02:21:54.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611419+0000", 2024-09-17T02:21:54.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3393999999999996e-05 2024-09-17T02:21:54.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:54.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611427+0000", 2024-09-17T02:21:54.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999997e-06 2024-09-17T02:21:54.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570705+0000", 2024-09-17T02:21:54.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.95927859199999999 2024-09-17T02:21:54.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:54.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571009+0000", 2024-09-17T02:21:54.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030414599999999998 2024-09-17T02:21:54.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:54.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571241+0000", 2024-09-17T02:21:54.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023106799999999999 2024-09-17T02:21:54.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:54.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590789+0000", 2024-09-17T02:21:54.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019548763 2024-09-17T02:21:54.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:54.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590928+0000", 2024-09-17T02:21:54.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000139092 2024-09-17T02:21:54.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:54.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591086+0000", 2024-09-17T02:21:54.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015787400000000001 2024-09-17T02:21:54.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:54.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591342+0000", 2024-09-17T02:21:54.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025589900000000002 2024-09-17T02:21:54.402 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.402 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:54.402 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.402 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129603 5.4 5:25aaa5e8:::benchmark_data_smithi001_23533_object1486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:54.402 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:54.402 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.673155815000001, 2024-09-17T02:21:54.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96463198999999999, 2024-09-17T02:21:54.402 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:54.402 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:54.403 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:54.403 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:54.403 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:54.403 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.403 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129603 2024-09-17T02:21:54.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.403 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:54.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:54.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:54.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:54.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:54.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:54.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:54.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:21:54.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:54.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627392+0000", 2024-09-17T02:21:54.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0790000000000002e-06 2024-09-17T02:21:54.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:54.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627403+0000", 2024-09-17T02:21:54.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0866000000000001e-05 2024-09-17T02:21:54.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627409+0000", 2024-09-17T02:21:54.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.305e-06 2024-09-17T02:21:54.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627485+0000", 2024-09-17T02:21:54.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6582000000000006e-05 2024-09-17T02:21:54.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:54.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627499+0000", 2024-09-17T02:21:54.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:21:54.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574991+0000", 2024-09-17T02:21:54.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94749182300000001 2024-09-17T02:21:54.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:54.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575377+0000", 2024-09-17T02:21:54.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038629400000000003 2024-09-17T02:21:54.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:54.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575665+0000", 2024-09-17T02:21:54.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028759499999999997 2024-09-17T02:21:54.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:54.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590802+0000", 2024-09-17T02:21:54.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015136479 2024-09-17T02:21:54.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:54.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591614+0000", 2024-09-17T02:21:54.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081293100000000003 2024-09-17T02:21:54.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:54.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591764+0000", 2024-09-17T02:21:54.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014932199999999999 2024-09-17T02:21:54.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:54.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592020+0000", 2024-09-17T02:21:54.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025585099999999997 2024-09-17T02:21:54.409 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.409 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:54.409 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.409 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129607 5.4 5:2f638f1e:::benchmark_data_smithi001_23533_object1490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:54.409 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:21:54.409 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.671628908999999, 2024-09-17T02:21:54.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96352375899999998, 2024-09-17T02:21:54.410 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:54.410 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:54.410 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:54.410 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:54.410 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:54.410 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.410 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129607 2024-09-17T02:21:54.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.410 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:54.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:54.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:21:54.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:54.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:21:54.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:54.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628916+0000", 2024-09-17T02:21:54.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1710000000000001e-06 2024-09-17T02:21:54.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:54.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628920+0000", 2024-09-17T02:21:54.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-17T02:21:54.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:54.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628935+0000", 2024-09-17T02:21:54.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4474000000000001e-05 2024-09-17T02:21:54.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628944+0000", 2024-09-17T02:21:54.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9940000000000006e-06 2024-09-17T02:21:54.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628997+0000", 2024-09-17T02:21:54.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3579000000000003e-05 2024-09-17T02:21:54.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:54.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.629006+0000", 2024-09-17T02:21:54.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4009999999999997e-06 2024-09-17T02:21:54.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.577862+0000", 2024-09-17T02:21:54.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.948856335 2024-09-17T02:21:54.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:54.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578167+0000", 2024-09-17T02:21:54.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030532399999999999 2024-09-17T02:21:54.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:54.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578532+0000", 2024-09-17T02:21:54.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036428200000000001 2024-09-17T02:21:54.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:54.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591442+0000", 2024-09-17T02:21:54.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012910374000000001 2024-09-17T02:21:54.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:54.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592164+0000", 2024-09-17T02:21:54.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072242499999999996 2024-09-17T02:21:54.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:54.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592267+0000", 2024-09-17T02:21:54.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102205 2024-09-17T02:21:54.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:54.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592438+0000", 2024-09-17T02:21:54.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017165299999999999 2024-09-17T02:21:54.416 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.416 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:54.416 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.416 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129623 5.4 5:2cf5174b:::benchmark_data_smithi001_23533_object1506:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:54.416 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:21:54.416 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.647684623, 2024-09-17T02:21:54.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94334114499999999, 2024-09-17T02:21:54.416 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:54.416 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:54.417 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:54.417 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:54.417 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:54.417 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.417 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129623 2024-09-17T02:21:54.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.417 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:54.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:54.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:21:54.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:54.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:21:54.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:54.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652860+0000", 2024-09-17T02:21:54.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0330000000000001e-06 2024-09-17T02:21:54.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:54.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652864+0000", 2024-09-17T02:21:54.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.634e-06 2024-09-17T02:21:54.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:54.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652877+0000", 2024-09-17T02:21:54.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2591e-05 2024-09-17T02:21:54.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652883+0000", 2024-09-17T02:21:54.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1460000000000001e-06 2024-09-17T02:21:54.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652943+0000", 2024-09-17T02:21:54.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9833999999999997e-05 2024-09-17T02:21:54.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:54.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652950+0000", 2024-09-17T02:21:54.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.401e-06 2024-09-17T02:21:54.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581800+0000", 2024-09-17T02:21:54.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.92884935700000004 2024-09-17T02:21:54.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:54.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582122+0000", 2024-09-17T02:21:54.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032185200000000002 2024-09-17T02:21:54.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:54.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582689+0000", 2024-09-17T02:21:54.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056750400000000003 2024-09-17T02:21:54.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:54.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591458+0000", 2024-09-17T02:21:54.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008768685 2024-09-17T02:21:54.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:54.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595856+0000", 2024-09-17T02:21:54.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043977909999999999 2024-09-17T02:21:54.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:54.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595955+0000", 2024-09-17T02:21:54.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9166000000000006e-05 2024-09-17T02:21:54.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:54.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596200+0000", 2024-09-17T02:21:54.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024515099999999998 2024-09-17T02:21:54.423 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.423 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:54.423 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.423 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129642 5.4 5:255eb796:::benchmark_data_smithi001_23533_object1525:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:54.423 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:21:54.424 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.616448459000001, 2024-09-17T02:21:54.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.91257397299999998, 2024-09-17T02:21:54.424 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:54.424 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:54.424 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:54.424 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:54.424 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:54.424 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.424 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129642 2024-09-17T02:21:54.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.424 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:54.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:54.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:21:54.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:54.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:21:54.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:54.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684096+0000", 2024-09-17T02:21:54.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659999999999999e-06 2024-09-17T02:21:54.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:54.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684101+0000", 2024-09-17T02:21:54.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8110000000000002e-06 2024-09-17T02:21:54.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:54.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684114+0000", 2024-09-17T02:21:54.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2653000000000001e-05 2024-09-17T02:21:54.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684121+0000", 2024-09-17T02:21:54.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5100000000000001e-06 2024-09-17T02:21:54.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684181+0000", 2024-09-17T02:21:54.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0307999999999999e-05 2024-09-17T02:21:54.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:54.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684194+0000", 2024-09-17T02:21:54.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2916e-05 2024-09-17T02:21:54.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.587917+0000", 2024-09-17T02:21:54.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.90372220400000003 2024-09-17T02:21:54.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:54.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588215+0000", 2024-09-17T02:21:54.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029845400000000003 2024-09-17T02:21:54.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:54.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588470+0000", 2024-09-17T02:21:54.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025455399999999999 2024-09-17T02:21:54.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:54.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596318+0000", 2024-09-17T02:21:54.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078485589999999997 2024-09-17T02:21:54.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:54.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596354+0000", 2024-09-17T02:21:54.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5976999999999998e-05 2024-09-17T02:21:54.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:54.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596449+0000", 2024-09-17T02:21:54.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4728999999999994e-05 2024-09-17T02:21:54.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:54.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596669+0000", 2024-09-17T02:21:54.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220132 2024-09-17T02:21:54.431 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.431 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:54.431 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.431 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129649 5.4 5:2fe27050:::benchmark_data_smithi001_23533_object1532:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:54.431 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:21:54.431 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.584891716000001, 2024-09-17T02:21:54.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.88508119100000004, 2024-09-17T02:21:54.431 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:54.431 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:54.432 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:54.432 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:54.432 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:54.432 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.432 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129649 2024-09-17T02:21:54.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.432 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:54.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:54.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:21:54.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:54.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:21:54.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:54.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:54.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715653+0000", 2024-09-17T02:21:54.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3519999999999999e-06 2024-09-17T02:21:54.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:54.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715658+0000", 2024-09-17T02:21:54.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3120000000000001e-06 2024-09-17T02:21:54.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:54.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715677+0000", 2024-09-17T02:21:54.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-17T02:21:54.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715687+0000", 2024-09-17T02:21:54.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0146000000000001e-05 2024-09-17T02:21:54.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715821+0000", 2024-09-17T02:21:54.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013421 2024-09-17T02:21:54.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:54.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715840+0000", 2024-09-17T02:21:54.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8153999999999999e-05 2024-09-17T02:21:54.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:54.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592528+0000", 2024-09-17T02:21:54.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.87668860000000004 2024-09-17T02:21:54.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:54.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592702+0000", 2024-09-17T02:21:54.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017429300000000001 2024-09-17T02:21:54.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:54.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592945+0000", 2024-09-17T02:21:54.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000242048 2024-09-17T02:21:54.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:54.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600234+0000", 2024-09-17T02:21:54.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072897600000000002 2024-09-17T02:21:54.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:54.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600494+0000", 2024-09-17T02:21:54.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000259984 2024-09-17T02:21:54.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:54.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600555+0000", 2024-09-17T02:21:54.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1138999999999999e-05 2024-09-17T02:21:54.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:54.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:54.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:54.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600733+0000", 2024-09-17T02:21:54.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017753300000000001 2024-09-17T02:21:54.438 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.438 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:54.438 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.438 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:54.438 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:54.438 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:54.439 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:54.300+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:54.440 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:54.441 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:54.441+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:54.542 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:54.541+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:54.589 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:54.589 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:54.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.590 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:169924 5.5 5:a86b1cc2:::benchmark_data_smithi001_23533_object41807:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-17T02:21:54.590 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:54.589159+0000", 2024-09-17T02:21:54.590 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0039402619999999999, 2024-09-17T02:21:54.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039681930000000001, 2024-09-17T02:21:54.590 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:54.590 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:54.590 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:54.590 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:54.590 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:54.590 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.590 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 169924 2024-09-17T02:21:54.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.590 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:54.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:54.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589159+0000", 2024-09-17T02:21:54.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:54.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589159+0000", 2024-09-17T02:21:54.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:54.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589160+0000", 2024-09-17T02:21:54.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.54e-07 2024-09-17T02:21:54.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:54.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589166+0000", 2024-09-17T02:21:54.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.959e-06 2024-09-17T02:21:54.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:54.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589174+0000", 2024-09-17T02:21:54.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8220000000000007e-06 2024-09-17T02:21:54.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589181+0000", 2024-09-17T02:21:54.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1099999999999997e-06 2024-09-17T02:21:54.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:54.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589218+0000", 2024-09-17T02:21:54.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7675000000000001e-05 2024-09-17T02:21:54.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:54.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589285+0000", 2024-09-17T02:21:54.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6993e-05 2024-09-17T02:21:54.594 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.594 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:54.594 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.594 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:169925 5.2 5:48ddaae3:::benchmark_data_smithi001_23533_object41808:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-17T02:21:54.594 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:54.589197+0000", 2024-09-17T02:21:54.594 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.003902052, 2024-09-17T02:21:54.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040314180000000002, 2024-09-17T02:21:54.594 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:54.594 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:54.594 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:54.595 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:54.595 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:54.595 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.595 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 169925 2024-09-17T02:21:54.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.595 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:54.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:54.595 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589197+0000", 2024-09-17T02:21:54.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:54.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589197+0000", 2024-09-17T02:21:54.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:54.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589198+0000", 2024-09-17T02:21:54.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5000000000000003e-07 2024-09-17T02:21:54.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:54.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589201+0000", 2024-09-17T02:21:54.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8679999999999999e-06 2024-09-17T02:21:54.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:54.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589208+0000", 2024-09-17T02:21:54.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1049999999999997e-06 2024-09-17T02:21:54.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589213+0000", 2024-09-17T02:21:54.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4650000000000002e-06 2024-09-17T02:21:54.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:54.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589259+0000", 2024-09-17T02:21:54.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6097999999999998e-05 2024-09-17T02:21:54.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:54.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589379+0000", 2024-09-17T02:21:54.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120053 2024-09-17T02:21:54.599 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.599 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:54.599 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.599 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:169927 5.7 5:ea5292c1:::benchmark_data_smithi001_23533_object41810:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-17T02:21:54.599 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:54.589224+0000", 2024-09-17T02:21:54.599 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0038754250000000001, 2024-09-17T02:21:54.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040519279999999998, 2024-09-17T02:21:54.600 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:54.600 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:54.600 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:54.600 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:54.600 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:54.600 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.600 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 169927 2024-09-17T02:21:54.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.600 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:54.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:54.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589224+0000", 2024-09-17T02:21:54.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:54.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589224+0000", 2024-09-17T02:21:54.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:54.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589224+0000", 2024-09-17T02:21:54.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-17T02:21:54.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:54.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589227+0000", 2024-09-17T02:21:54.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5399999999999998e-06 2024-09-17T02:21:54.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:54.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589233+0000", 2024-09-17T02:21:54.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6270000000000002e-06 2024-09-17T02:21:54.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589239+0000", 2024-09-17T02:21:54.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6210000000000001e-06 2024-09-17T02:21:54.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:54.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589288+0000", 2024-09-17T02:21:54.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9375000000000001e-05 2024-09-17T02:21:54.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:54.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589393+0000", 2024-09-17T02:21:54.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010501399999999999 2024-09-17T02:21:54.603 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.603 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:54.603 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.603 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:169928 5.0 5:020bcbaa:::benchmark_data_smithi001_23533_object41811:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-17T02:21:54.604 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:54.589267+0000", 2024-09-17T02:21:54.604 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0038322489999999998, 2024-09-17T02:21:54.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040431800000000004, 2024-09-17T02:21:54.604 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:54.604 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:54.604 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:54.604 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:54.604 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:54.604 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.604 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 169928 2024-09-17T02:21:54.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.604 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:54.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:54.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589267+0000", 2024-09-17T02:21:54.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.605 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:54.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589267+0000", 2024-09-17T02:21:54.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.605 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:54.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589268+0000", 2024-09-17T02:21:54.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5400000000000001e-07 2024-09-17T02:21:54.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:54.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589270+0000", 2024-09-17T02:21:54.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7650000000000002e-06 2024-09-17T02:21:54.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:54.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589281+0000", 2024-09-17T02:21:54.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0182e-05 2024-09-17T02:21:54.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589287+0000", 2024-09-17T02:21:54.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9209999999999997e-06 2024-09-17T02:21:54.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:54.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589331+0000", 2024-09-17T02:21:54.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4295999999999997e-05 2024-09-17T02:21:54.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:54.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589443+0000", 2024-09-17T02:21:54.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000112184 2024-09-17T02:21:54.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:54.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589538+0000", 2024-09-17T02:21:54.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4665000000000003e-05 2024-09-17T02:21:54.608 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.608 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:54.608 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.608 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:169929 5.1 5:823ff4bc:::benchmark_data_smithi001_23533_object41812:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-17T02:21:54.608 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:54.589300+0000", 2024-09-17T02:21:54.608 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0037991090000000002, 2024-09-17T02:21:54.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040482030000000002, 2024-09-17T02:21:54.609 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:54.609 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:54.609 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:54.609 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:54.609 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:54.609 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.609 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 169929 2024-09-17T02:21:54.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.609 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:54.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:54.609 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589300+0000", 2024-09-17T02:21:54.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589300+0000", 2024-09-17T02:21:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589301+0000", 2024-09-17T02:21:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1699999999999998e-07 2024-09-17T02:21:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589304+0000", 2024-09-17T02:21:54.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8569999999999999e-06 2024-09-17T02:21:54.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:54.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589311+0000", 2024-09-17T02:21:54.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2740000000000002e-06 2024-09-17T02:21:54.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589318+0000", 2024-09-17T02:21:54.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4399999999999999e-06 2024-09-17T02:21:54.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:54.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589365+0000", 2024-09-17T02:21:54.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6476e-05 2024-09-17T02:21:54.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:54.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589497+0000", 2024-09-17T02:21:54.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013213299999999999 2024-09-17T02:21:54.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:54.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589623+0000", 2024-09-17T02:21:54.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012619500000000001 2024-09-17T02:21:54.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:54.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.593223+0000", 2024-09-17T02:21:54.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036000950000000002 2024-09-17T02:21:54.613 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.613 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:54.613 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.613 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:169930 5.5 5:acf4c48f:::benchmark_data_smithi001_23533_object41813:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-17T02:21:54.613 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:54.589328+0000", 2024-09-17T02:21:54.613 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0037713379999999999, 2024-09-17T02:21:54.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004059755, 2024-09-17T02:21:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 169930 2024-09-17T02:21:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589328+0000", 2024-09-17T02:21:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:54.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589328+0000", 2024-09-17T02:21:54.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:54.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589328+0000", 2024-09-17T02:21:54.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.65e-07 2024-09-17T02:21:54.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:54.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589330+0000", 2024-09-17T02:21:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1260000000000001e-06 2024-09-17T02:21:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589337+0000", 2024-09-17T02:21:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6640000000000001e-06 2024-09-17T02:21:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589342+0000", 2024-09-17T02:21:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9339999999999997e-06 2024-09-17T02:21:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.591543+0000", 2024-09-17T02:21:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002200811 2024-09-17T02:21:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.591667+0000", 2024-09-17T02:21:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012362699999999999 2024-09-17T02:21:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:169923 5.e e59/22 5:7b3e3597:::benchmark_data_smithi001_23533_object41806:head v 59'10684, mlcod=59'10681)", 2024-09-17T02:21:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:54.589599+0000", 2024-09-17T02:21:54.618 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0034998780000000001, 2024-09-17T02:21:54.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038216859999999999, 2024-09-17T02:21:54.618 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:54.618 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:54.618 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:54.618 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:54.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:54.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589599+0000", 2024-09-17T02:21:54.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589599+0000", 2024-09-17T02:21:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589600+0000", 2024-09-17T02:21:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999996e-07 2024-09-17T02:21:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589605+0000", 2024-09-17T02:21:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7049999999999998e-06 2024-09-17T02:21:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:54.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589621+0000", 2024-09-17T02:21:54.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6396999999999999e-05 2024-09-17T02:21:54.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589627+0000", 2024-09-17T02:21:54.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8170000000000004e-06 2024-09-17T02:21:54.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:54.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589865+0000", 2024-09-17T02:21:54.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023804499999999999 2024-09-17T02:21:54.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:54.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589884+0000", 2024-09-17T02:21:54.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9188e-05 2024-09-17T02:21:54.621 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.621 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:54.621 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.621 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:169926 5.4 e59/52 5:2bd633d5:::benchmark_data_smithi001_23533_object41809:head v 59'10447, mlcod=59'10445)", 2024-09-17T02:21:54.621 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:54.589653+0000", 2024-09-17T02:21:54.621 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0034460620000000002, 2024-09-17T02:21:54.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037993929999999999, 2024-09-17T02:21:54.622 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:54.622 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:54.622 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:54.622 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:54.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:54.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589653+0000", 2024-09-17T02:21:54.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:54.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589653+0000", 2024-09-17T02:21:54.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589654+0000", 2024-09-17T02:21:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4900000000000001e-07 2024-09-17T02:21:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589660+0000", 2024-09-17T02:21:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4810000000000003e-06 2024-09-17T02:21:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589667+0000", 2024-09-17T02:21:54.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7780000000000002e-06 2024-09-17T02:21:54.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589672+0000", 2024-09-17T02:21:54.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1229999999999999e-06 2024-09-17T02:21:54.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:54.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.592085+0000", 2024-09-17T02:21:54.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024131560000000001 2024-09-17T02:21:54.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:54.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.592108+0000", 2024-09-17T02:21:54.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2416e-05 2024-09-17T02:21:54.625 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.625 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:54.625 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.625 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:169932 5.8 5:19307952:::benchmark_data_smithi001_23533_object41815:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-17T02:21:54.625 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:54.589712+0000", 2024-09-17T02:21:54.625 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0033873950000000001, 2024-09-17T02:21:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037707119999999998, 2024-09-17T02:21:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 169932 2024-09-17T02:21:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589712+0000", 2024-09-17T02:21:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:54.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589712+0000", 2024-09-17T02:21:54.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:54.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589713+0000", 2024-09-17T02:21:54.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5600000000000005e-07 2024-09-17T02:21:54.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:54.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589716+0000", 2024-09-17T02:21:54.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3129999999999999e-06 2024-09-17T02:21:54.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:54.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589724+0000", 2024-09-17T02:21:54.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2919999999999996e-06 2024-09-17T02:21:54.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589731+0000", 2024-09-17T02:21:54.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2949999999999999e-06 2024-09-17T02:21:54.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:54.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.591645+0000", 2024-09-17T02:21:54.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001914579 2024-09-17T02:21:54.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:54.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.591808+0000", 2024-09-17T02:21:54.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000163158 2024-09-17T02:21:54.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:54.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.591926+0000", 2024-09-17T02:21:54.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117992 2024-09-17T02:21:54.630 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.630 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:54.630 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.630 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:169933 5.7 5:e80cf9ec:::benchmark_data_smithi001_23533_object41816:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-17T02:21:54.630 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:54.589744+0000", 2024-09-17T02:21:54.630 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0033552790000000001, 2024-09-17T02:21:54.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003774702, 2024-09-17T02:21:54.631 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:54.631 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:54.631 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:54.631 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:54.631 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:54.631 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.631 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 169933 2024-09-17T02:21:54.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.631 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:54.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:54.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589744+0000", 2024-09-17T02:21:54.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:54.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589744+0000", 2024-09-17T02:21:54.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:54.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589745+0000", 2024-09-17T02:21:54.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6899999999999997e-07 2024-09-17T02:21:54.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:54.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589747+0000", 2024-09-17T02:21:54.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6029999999999999e-06 2024-09-17T02:21:54.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:54.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589754+0000", 2024-09-17T02:21:54.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0079999999999996e-06 2024-09-17T02:21:54.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589760+0000", 2024-09-17T02:21:54.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2909999999999998e-06 2024-09-17T02:21:54.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:54.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.591516+0000", 2024-09-17T02:21:54.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001756552 2024-09-17T02:21:54.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:54.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.591646+0000", 2024-09-17T02:21:54.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012997900000000001 2024-09-17T02:21:54.634 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.634 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:54.634 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.635 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:169935 5.c 5:39eed84e:::benchmark_data_smithi001_23533_object41818:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-17T02:21:54.635 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:54.589771+0000", 2024-09-17T02:21:54.635 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.003328714, 2024-09-17T02:21:54.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003781979, 2024-09-17T02:21:54.635 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:54.635 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:54.635 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:54.635 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:54.635 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:54.635 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 169935 2024-09-17T02:21:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589771+0000", 2024-09-17T02:21:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589771+0000", 2024-09-17T02:21:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:54.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589771+0000", 2024-09-17T02:21:54.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.82e-07 2024-09-17T02:21:54.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:54.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589774+0000", 2024-09-17T02:21:54.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6309999999999999e-06 2024-09-17T02:21:54.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:54.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589781+0000", 2024-09-17T02:21:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0419999999999997e-06 2024-09-17T02:21:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589786+0000", 2024-09-17T02:21:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6099999999999997e-06 2024-09-17T02:21:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.591781+0000", 2024-09-17T02:21:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019947329999999998 2024-09-17T02:21:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:54.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.591919+0000", 2024-09-17T02:21:54.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013829200000000001 2024-09-17T02:21:54.639 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.639 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:54.639 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.639 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:169936 5.5 5.d144f5e5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-17T02:21:54.639 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:54.589794+0000", 2024-09-17T02:21:54.639 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0033048999999999999, 2024-09-17T02:21:54.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037907100000000001, 2024-09-17T02:21:54.639 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:54.640 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:54.640 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:54.640 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:54.640 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:54.640 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:54.640 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 169936 2024-09-17T02:21:54.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.640 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:54.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:54.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589794+0000", 2024-09-17T02:21:54.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589794+0000", 2024-09-17T02:21:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589795+0000", 2024-09-17T02:21:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0499999999999999e-07 2024-09-17T02:21:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589797+0000", 2024-09-17T02:21:54.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.644e-06 2024-09-17T02:21:54.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:54.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589814+0000", 2024-09-17T02:21:54.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6345e-05 2024-09-17T02:21:54.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589821+0000", 2024-09-17T02:21:54.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8700000000000003e-06 2024-09-17T02:21:54.642 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.642 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:54.643 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.643 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:169931 5.b e59/51 5:d0e25070:::benchmark_data_smithi001_23533_object41814:head v 59'10485, mlcod=59'10483)", 2024-09-17T02:21:54.643 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:54.589996+0000", 2024-09-17T02:21:54.643 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0031036549999999999, 2024-09-17T02:21:54.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036173030000000001, 2024-09-17T02:21:54.643 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:54.643 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:54.643 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:54.643 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:54.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:54.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589996+0000", 2024-09-17T02:21:54.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:54.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589996+0000", 2024-09-17T02:21:54.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:54.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.589996+0000", 2024-09-17T02:21:54.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9699999999999996e-07 2024-09-17T02:21:54.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:54.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.590020+0000", 2024-09-17T02:21:54.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3998999999999998e-05 2024-09-17T02:21:54.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:54.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.590032+0000", 2024-09-17T02:21:54.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1644000000000001e-05 2024-09-17T02:21:54.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.590037+0000", 2024-09-17T02:21:54.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5600000000000001e-06 2024-09-17T02:21:54.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:54.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.590141+0000", 2024-09-17T02:21:54.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103439 2024-09-17T02:21:54.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:54.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.590158+0000", 2024-09-17T02:21:54.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7169000000000001e-05 2024-09-17T02:21:54.646 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.646 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:54.647 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.647 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:169938 5.4 e59/52)", 2024-09-17T02:21:54.647 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:54.592931+0000", 2024-09-17T02:21:54.647 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00016834799999999999, 2024-09-17T02:21:54.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00070951800000000002, 2024-09-17T02:21:54.647 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:54.647 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:54.647 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:54.647 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:54.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:54.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.592931+0000", 2024-09-17T02:21:54.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:54.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.592931+0000", 2024-09-17T02:21:54.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:54.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.592932+0000", 2024-09-17T02:21:54.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7999999999999993e-07 2024-09-17T02:21:54.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:54.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.592940+0000", 2024-09-17T02:21:54.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6210000000000004e-06 2024-09-17T02:21:54.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:54.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.592953+0000", 2024-09-17T02:21:54.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.313e-05 2024-09-17T02:21:54.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.592961+0000", 2024-09-17T02:21:54.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7970000000000001e-06 2024-09-17T02:21:54.650 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.650 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:54.650 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.650 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4466.0:169928 5.0 e59/26)", 2024-09-17T02:21:54.650 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:54.592973+0000", 2024-09-17T02:21:54.650 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.000126081, 2024-09-17T02:21:54.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00069253399999999997, 2024-09-17T02:21:54.650 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:54.650 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:54.651 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:54.651 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:54.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:54.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.592973+0000", 2024-09-17T02:21:54.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:54.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.592973+0000", 2024-09-17T02:21:54.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:54.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:54.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.592974+0000", 2024-09-17T02:21:54.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0400000000000002e-07 2024-09-17T02:21:54.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:54.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.592976+0000", 2024-09-17T02:21:54.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.537e-06 2024-09-17T02:21:54.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:54.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.592982+0000", 2024-09-17T02:21:54.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.789e-06 2024-09-17T02:21:54.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:54.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:54.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:54.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:54.592986+0000", 2024-09-17T02:21:54.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9729999999999999e-06 2024-09-17T02:21:54.653 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.653 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:54.653 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.653 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:54.653 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:21:54.653 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 15 2024-09-17T02:21:54.653 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:54.655 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:54.655 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:54.653+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:54.676 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:21:54.756 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:54.753+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:54.835 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:21:54.836 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:21:54.854 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:54.854 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:54.854 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:21:54.854 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:21:54.855 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:21:54.856 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:54.856+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:54.858 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:21:54.859 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:21:54.873 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:54.964 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:54.965+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:55.057 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:55.060+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:55.073 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:55.074 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:55.094 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:55.158 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:55.157+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:55.242 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:55.242 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:55.259 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:55.257+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:55.260 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:55.361 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:55.361+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:55.406 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:55.406 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:55.425 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:55.468 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:55.472+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:55.562 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:55.561+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:55.572 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:55.572 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:55.593 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:55.663 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:55.664+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:55.750 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:55.750 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:55.763 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:55.761+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:55.771 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:55.866 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:55.865+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:55.965 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:55.968+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:55.973 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:55.973 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:55.994 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:56.018 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T02:21:56.065 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:56.068+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:56.168 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:56.165+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:56.186 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:56.186 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:56.209 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:56.268 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:56.265+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:56.362 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:56.362 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:56.370 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:56.372+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:56.383 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:56.473 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:56.476+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:56.569 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:56.572+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:56.575 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:56.576 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:56.596 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:56.671 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:56.669+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:56.741 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-17T02:21:56.772 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:56.773+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:56.783 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~18s 2024-09-17T02:21:56.795 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:56.795 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:56.817 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:56.860 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:21:56.871 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-09-17T02:21:56.871 INFO:teuthology.orchestra.console.smithi164:Power on completed 2024-09-17T02:21:56.873 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:56.876+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:56.972 DEBUG:teuthology.orchestra.console.smithi164:Waiting for login prompt 2024-09-17T02:21:56.972 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi164 2024-09-17T02:21:56.982 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:56.983 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:56.983 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:56.984+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:56.997 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:57.001 INFO:teuthology.orchestra.run.smithi001.stderr:nodeep-scrub is set 2024-09-17T02:21:57.025 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:21:57.025 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:21:57.046 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:21:57.047 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:21:57.047 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:21:57.049 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:21:57.050 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:21:57.084 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:57.084+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:57.147 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:57.147 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:21:57.148 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:21:57.148 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:21:57.148 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:57.167 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:57.212 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:57.213+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:57.285 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:57.288+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:57.325 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:57.326 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:21:57.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:21:57.326 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:57.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.326 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:57.326 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:57.326 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.758946158000001, 2024-09-17T02:21:57.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:21:57.326 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:57.326 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:57.326 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:57.326 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:57.326 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:57.327 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:57.327 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:21:57.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.327 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:57.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:57.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:57.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:57.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:57.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:57.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:21:57.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:21:57.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:57.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:21:57.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:21:57.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:57.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:21:57.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:21:57.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:57.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:21:57.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:21:57.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:57.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:21:57.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:21:57.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:57.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:21:57.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:21:57.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:57.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:21:57.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:21:57.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:57.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:21:57.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:21:57.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:57.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:21:57.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:21:57.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:57.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:21:57.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:21:57.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:57.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:21:57.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:21:57.332 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.332 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:57.332 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.332 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:57.332 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:57.332 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.755043908000005, 2024-09-17T02:21:57.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:21:57.332 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:57.333 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:57.333 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:57.333 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:57.333 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:57.333 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:57.333 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:21:57.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.333 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:57.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:57.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:57.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:57.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:57.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:57.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:21:57.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:21:57.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:57.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:21:57.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:21:57.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:57.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:21:57.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:21:57.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:57.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:21:57.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:21:57.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:57.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:21:57.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:21:57.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:57.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:21:57.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:21:57.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:57.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:21:57.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:21:57.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:57.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:21:57.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:21:57.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:57.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:21:57.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:21:57.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:57.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:21:57.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:21:57.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:57.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:21:57.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:21:57.338 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.339 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:57.339 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.339 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71206 5.3 e39/38 5:c6c9386d:::benchmark_data_smithi001_23533_object71205:head v 39'4517, mlcod=35'4513)", 2024-09-17T02:21:57.339 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:57.339 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 52.717716793000001, 2024-09-17T02:21:57.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026101868, 2024-09-17T02:21:57.339 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:57.339 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:57.339 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:57.339 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:57.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:57.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:57.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:57.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:57.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:57.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609694+0000", 2024-09-17T02:21:57.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9539999999999998e-06 2024-09-17T02:21:57.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:57.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609841+0000", 2024-09-17T02:21:57.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014690800000000001 2024-09-17T02:21:57.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:57.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609872+0000", 2024-09-17T02:21:57.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0326000000000001e-05 2024-09-17T02:21:57.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:57.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609892+0000", 2024-09-17T02:21:57.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9848999999999999e-05 2024-09-17T02:21:57.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:57.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613826+0000", 2024-09-17T02:21:57.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039345140000000001 2024-09-17T02:21:57.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:57.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613908+0000", 2024-09-17T02:21:57.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2412999999999999e-05 2024-09-17T02:21:57.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:57.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635696+0000", 2024-09-17T02:21:57.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021787597999999998 2024-09-17T02:21:57.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:57.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635794+0000", 2024-09-17T02:21:57.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8306000000000004e-05 2024-09-17T02:21:57.343 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.343 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:57.343 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.344 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97151 5.5 5:a0c2c072:::benchmark_data_smithi001_23533_object97150:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:57.344 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:57.344 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.059037185999998, 2024-09-17T02:21:57.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027297614000000001, 2024-09-17T02:21:57.344 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:57.344 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:57.344 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:57.344 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:57.344 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:57.344 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:57.344 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97151 2024-09-17T02:21:57.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.345 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:57.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:57.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:57.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:57.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:57.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:57.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268373+0000", 2024-09-17T02:21:57.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4000000000000002e-07 2024-09-17T02:21:57.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:57.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268423+0000", 2024-09-17T02:21:57.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0175e-05 2024-09-17T02:21:57.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:57.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268428+0000", 2024-09-17T02:21:57.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-17T02:21:57.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:57.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268431+0000", 2024-09-17T02:21:57.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.179e-06 2024-09-17T02:21:57.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:57.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283631+0000", 2024-09-17T02:21:57.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015199691 2024-09-17T02:21:57.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:57.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283740+0000", 2024-09-17T02:21:57.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109305 2024-09-17T02:21:57.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:57.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283863+0000", 2024-09-17T02:21:57.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012226699999999999 2024-09-17T02:21:57.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:57.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290857+0000", 2024-09-17T02:21:57.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069945449999999996 2024-09-17T02:21:57.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:57.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295595+0000", 2024-09-17T02:21:57.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047376750000000002 2024-09-17T02:21:57.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:57.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295638+0000", 2024-09-17T02:21:57.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3671999999999998e-05 2024-09-17T02:21:57.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:57.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295670+0000", 2024-09-17T02:21:57.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1266000000000002e-05 2024-09-17T02:21:57.349 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.349 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:57.349 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.350 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97759 5.a 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:57.350 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:57.350 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.729024084999999, 2024-09-17T02:21:57.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.089694871999999995, 2024-09-17T02:21:57.350 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:57.350 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:57.350 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:57.350 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:57.350 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:57.350 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:57.350 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97759 2024-09-17T02:21:57.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.351 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:57.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:57.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:57.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:57.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:57.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:57.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598386+0000", 2024-09-17T02:21:57.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999999e-07 2024-09-17T02:21:57.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:57.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598414+0000", 2024-09-17T02:21:57.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8013000000000001e-05 2024-09-17T02:21:57.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:57.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598420+0000", 2024-09-17T02:21:57.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1149999999999999e-06 2024-09-17T02:21:57.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:57.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598424+0000", 2024-09-17T02:21:57.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:21:57.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:57.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598479+0000", 2024-09-17T02:21:57.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4648999999999998e-05 2024-09-17T02:21:57.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:57.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598587+0000", 2024-09-17T02:21:57.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010853000000000001 2024-09-17T02:21:57.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:57.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598676+0000", 2024-09-17T02:21:57.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8381999999999995e-05 2024-09-17T02:21:57.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:57.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603766+0000", 2024-09-17T02:21:57.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050902559999999996 2024-09-17T02:21:57.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:57.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.687988+0000", 2024-09-17T02:21:57.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.084221753999999996 2024-09-17T02:21:57.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:57.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688037+0000", 2024-09-17T02:21:57.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-05 2024-09-17T02:21:57.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:57.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688080+0000", 2024-09-17T02:21:57.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3149999999999999e-05 2024-09-17T02:21:57.355 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.356 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:57.356 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.356 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97770 5.0 5:09c75033:::benchmark_data_smithi001_23533_object97769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:57.356 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:57.356 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.723881655, 2024-09-17T02:21:57.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.086380868, 2024-09-17T02:21:57.356 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:57.356 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:57.356 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:57.356 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:57.356 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:57.356 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:57.357 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97770 2024-09-17T02:21:57.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.357 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:57.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:57.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:57.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:57.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:57.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:57.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603529+0000", 2024-09-17T02:21:57.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:21:57.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:57.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603593+0000", 2024-09-17T02:21:57.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4216999999999999e-05 2024-09-17T02:21:57.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:57.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603603+0000", 2024-09-17T02:21:57.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5179999999999993e-06 2024-09-17T02:21:57.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:57.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603608+0000", 2024-09-17T02:21:57.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2039999999999996e-06 2024-09-17T02:21:57.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:57.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603653+0000", 2024-09-17T02:21:57.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5247000000000002e-05 2024-09-17T02:21:57.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:57.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603758+0000", 2024-09-17T02:21:57.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105352 2024-09-17T02:21:57.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:57.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603900+0000", 2024-09-17T02:21:57.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014198999999999999 2024-09-17T02:21:57.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:57.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.606097+0000", 2024-09-17T02:21:57.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021969839999999999 2024-09-17T02:21:57.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:57.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689756+0000", 2024-09-17T02:21:57.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.083659077999999998 2024-09-17T02:21:57.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:57.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689846+0000", 2024-09-17T02:21:57.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9320999999999994e-05 2024-09-17T02:21:57.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:57.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689908+0000", 2024-09-17T02:21:57.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720999999999998e-05 2024-09-17T02:21:57.362 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.362 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:57.362 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.362 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127513 5.c 5:3eca08e4:::benchmark_data_smithi001_23533_object127512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:57.362 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:21:57.362 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 24.883105231000002, 2024-09-17T02:21:57.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046626399999999998, 2024-09-17T02:21:57.363 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:57.363 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:57.363 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:57.363 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:57.363 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:57.363 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:57.363 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127513 2024-09-17T02:21:57.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.363 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:57.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:57.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:21:57.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:57.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:21:57.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:57.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444305+0000", 2024-09-17T02:21:57.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2529999999999999e-06 2024-09-17T02:21:57.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:57.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444466+0000", 2024-09-17T02:21:57.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016069700000000001 2024-09-17T02:21:57.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:57.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444479+0000", 2024-09-17T02:21:57.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2602999999999999e-05 2024-09-17T02:21:57.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:57.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444485+0000", 2024-09-17T02:21:57.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.669e-06 2024-09-17T02:21:57.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:57.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444560+0000", 2024-09-17T02:21:57.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4276999999999994e-05 2024-09-17T02:21:57.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:57.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444656+0000", 2024-09-17T02:21:57.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6490000000000006e-05 2024-09-17T02:21:57.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:57.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444739+0000", 2024-09-17T02:21:57.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3139999999999993e-05 2024-09-17T02:21:57.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:57.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.448438+0000", 2024-09-17T02:21:57.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036985490000000002 2024-09-17T02:21:57.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:57.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490732+0000", 2024-09-17T02:21:57.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042294353999999999 2024-09-17T02:21:57.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:57.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490859+0000", 2024-09-17T02:21:57.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012708899999999999 2024-09-17T02:21:57.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:57.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490930+0000", 2024-09-17T02:21:57.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:21:57.369 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.369 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:57.369 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.369 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127514 5.c 5:39cc1feb:::benchmark_data_smithi001_23533_object127513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:57.369 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:57.369 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 24.882908462, 2024-09-17T02:21:57.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049357228000000003, 2024-09-17T02:21:57.369 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:57.369 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:57.369 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:57.370 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:57.370 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:57.370 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:57.370 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127514 2024-09-17T02:21:57.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.370 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:57.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:57.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:57.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:57.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:57.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:57.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:57.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8599999999999998e-07 2024-09-17T02:21:57.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:57.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444554+0000", 2024-09-17T02:21:57.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3047999999999998e-05 2024-09-17T02:21:57.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:57.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444562+0000", 2024-09-17T02:21:57.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5830000000000001e-06 2024-09-17T02:21:57.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:57.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444567+0000", 2024-09-17T02:21:57.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4179999999999996e-06 2024-09-17T02:21:57.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:57.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446566+0000", 2024-09-17T02:21:57.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001998788 2024-09-17T02:21:57.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:57.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446696+0000", 2024-09-17T02:21:57.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129393 2024-09-17T02:21:57.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:57.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446794+0000", 2024-09-17T02:21:57.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8462999999999996e-05 2024-09-17T02:21:57.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:57.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.449036+0000", 2024-09-17T02:21:57.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022415880000000001 2024-09-17T02:21:57.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:57.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493737+0000", 2024-09-17T02:21:57.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044701682 2024-09-17T02:21:57.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:57.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493808+0000", 2024-09-17T02:21:57.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0846000000000006e-05 2024-09-17T02:21:57.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:57.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493858+0000", 2024-09-17T02:21:57.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9932999999999998e-05 2024-09-17T02:21:57.375 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.375 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:57.375 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.375 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129441 5.1 5:84c3199f:::benchmark_data_smithi001_23533_object1324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:57.375 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:21:57.375 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.823897974000001, 2024-09-17T02:21:57.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034387011000000002, 2024-09-17T02:21:57.375 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:57.375 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:57.375 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:57.375 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:57.376 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:57.376 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:57.376 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129441 2024-09-17T02:21:57.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.376 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:57.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:57.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:21:57.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:57.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:21:57.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:57.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503513+0000", 2024-09-17T02:21:57.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4759999999999999e-06 2024-09-17T02:21:57.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:57.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503518+0000", 2024-09-17T02:21:57.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-09-17T02:21:57.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:57.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503532+0000", 2024-09-17T02:21:57.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4049999999999999e-05 2024-09-17T02:21:57.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:57.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503541+0000", 2024-09-17T02:21:57.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5320000000000006e-06 2024-09-17T02:21:57.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:57.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506331+0000", 2024-09-17T02:21:57.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027899190000000001 2024-09-17T02:21:57.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:57.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506402+0000", 2024-09-17T02:21:57.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:21:57.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:57.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506477+0000", 2024-09-17T02:21:57.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4626e-05 2024-09-17T02:21:57.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:57.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509749+0000", 2024-09-17T02:21:57.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032726980000000001 2024-09-17T02:21:57.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:57.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537758+0000", 2024-09-17T02:21:57.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028008890000000002 2024-09-17T02:21:57.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:57.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537812+0000", 2024-09-17T02:21:57.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3300000000000001e-05 2024-09-17T02:21:57.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:57.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537898+0000", 2024-09-17T02:21:57.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6691000000000001e-05 2024-09-17T02:21:57.381 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.381 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:57.381 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.381 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129442 5.1 5:8f7f2a95:::benchmark_data_smithi001_23533_object1325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:57.381 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:21:57.381 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.820927364999999, 2024-09-17T02:21:57.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031546698999999997, 2024-09-17T02:21:57.382 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:57.382 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:57.382 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:57.382 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:57.382 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:57.382 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:57.382 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129442 2024-09-17T02:21:57.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.382 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:57.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:57.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:21:57.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:57.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:21:57.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:57.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506483+0000", 2024-09-17T02:21:57.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2869999999999999e-06 2024-09-17T02:21:57.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:57.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506489+0000", 2024-09-17T02:21:57.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2330000000000003e-06 2024-09-17T02:21:57.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:57.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506502+0000", 2024-09-17T02:21:57.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2286999999999999e-05 2024-09-17T02:21:57.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:57.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506511+0000", 2024-09-17T02:21:57.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7799999999999995e-06 2024-09-17T02:21:57.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:57.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.507966+0000", 2024-09-17T02:21:57.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014541549999999999 2024-09-17T02:21:57.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:57.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508130+0000", 2024-09-17T02:21:57.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016455199999999999 2024-09-17T02:21:57.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:57.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508287+0000", 2024-09-17T02:21:57.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015730400000000001 2024-09-17T02:21:57.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:57.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510577+0000", 2024-09-17T02:21:57.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022899449999999998 2024-09-17T02:21:57.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:57.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537932+0000", 2024-09-17T02:21:57.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027354471000000002 2024-09-17T02:21:57.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:57.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537964+0000", 2024-09-17T02:21:57.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1909999999999998e-05 2024-09-17T02:21:57.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:57.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.538029+0000", 2024-09-17T02:21:57.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4775000000000002e-05 2024-09-17T02:21:57.387 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.387 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:57.387 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.387 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129443 5.8 5:1edfeaf8:::benchmark_data_smithi001_23533_object1326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:57.388 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:21:57.388 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.817492864999998, 2024-09-17T02:21:57.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025315902000000001, 2024-09-17T02:21:57.388 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:57.388 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:57.388 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:57.388 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:57.388 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:57.388 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:57.388 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129443 2024-09-17T02:21:57.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.388 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:57.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:57.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:21:57.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:57.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:21:57.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:57.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509918+0000", 2024-09-17T02:21:57.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3689999999999999e-06 2024-09-17T02:21:57.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:57.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509923+0000", 2024-09-17T02:21:57.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0429999999999998e-06 2024-09-17T02:21:57.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:57.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509936+0000", 2024-09-17T02:21:57.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3234000000000001e-05 2024-09-17T02:21:57.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:57.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509950+0000", 2024-09-17T02:21:57.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3998999999999999e-05 2024-09-17T02:21:57.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:57.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509994+0000", 2024-09-17T02:21:57.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4323000000000002e-05 2024-09-17T02:21:57.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:57.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510095+0000", 2024-09-17T02:21:57.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010103300000000001 2024-09-17T02:21:57.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:57.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510160+0000", 2024-09-17T02:21:57.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4976999999999998e-05 2024-09-17T02:21:57.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:57.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.513304+0000", 2024-09-17T02:21:57.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031431330000000002 2024-09-17T02:21:57.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:57.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535046+0000", 2024-09-17T02:21:57.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021742276000000001 2024-09-17T02:21:57.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:57.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:21:57.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107759 2024-09-17T02:21:57.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:57.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535232+0000", 2024-09-17T02:21:57.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8756000000000003e-05 2024-09-17T02:21:57.393 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.394 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:57.394 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.394 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:138247 5.3 5:caf01f60:::benchmark_data_smithi001_23533_object10130:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:57.394 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.335014+0000", 2024-09-17T02:21:57.394 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.992395292000001, 2024-09-17T02:21:57.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026419469000000001, 2024-09-17T02:21:57.394 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:57.394 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:57.394 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:57.394 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:57.394 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:57.395 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:57.395 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 138247 2024-09-17T02:21:57.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.395 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:57.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:57.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335014+0000", 2024-09-17T02:21:57.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:57.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335014+0000", 2024-09-17T02:21:57.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:57.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335015+0000", 2024-09-17T02:21:57.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3600000000000004e-07 2024-09-17T02:21:57.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:57.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335017+0000", 2024-09-17T02:21:57.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5749999999999999e-06 2024-09-17T02:21:57.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:57.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335024+0000", 2024-09-17T02:21:57.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8379999999999996e-06 2024-09-17T02:21:57.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:57.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335029+0000", 2024-09-17T02:21:57.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.22e-06 2024-09-17T02:21:57.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:57.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335083+0000", 2024-09-17T02:21:57.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3600000000000002e-05 2024-09-17T02:21:57.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:57.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335229+0000", 2024-09-17T02:21:57.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000146098 2024-09-17T02:21:57.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:57.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335349+0000", 2024-09-17T02:21:57.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120631 2024-09-17T02:21:57.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:57.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.357942+0000", 2024-09-17T02:21:57.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022592457 2024-09-17T02:21:57.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:57.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.361286+0000", 2024-09-17T02:21:57.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003343623 2024-09-17T02:21:57.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:57.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.361338+0000", 2024-09-17T02:21:57.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2323e-05 2024-09-17T02:21:57.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:57.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.361433+0000", 2024-09-17T02:21:57.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5568000000000004e-05 2024-09-17T02:21:57.400 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.400 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:57.400 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.400 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:138244 5.b e54/51 5:d38c94c4:::benchmark_data_smithi001_23533_object10127:head v 54'8567, mlcod=54'8564)", 2024-09-17T02:21:57.400 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.336586+0000", 2024-09-17T02:21:57.400 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.990822902000001, 2024-09-17T02:21:57.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026602741999999999, 2024-09-17T02:21:57.401 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:57.401 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:57.401 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:57.401 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:57.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:57.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336586+0000", 2024-09-17T02:21:57.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:57.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336586+0000", 2024-09-17T02:21:57.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:57.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336587+0000", 2024-09-17T02:21:57.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0600000000000001e-07 2024-09-17T02:21:57.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:57.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336590+0000", 2024-09-17T02:21:57.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3110000000000001e-06 2024-09-17T02:21:57.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:57.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336597+0000", 2024-09-17T02:21:57.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0639999999999996e-06 2024-09-17T02:21:57.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:57.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336602+0000", 2024-09-17T02:21:57.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3599999999999998e-06 2024-09-17T02:21:57.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:57.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336645+0000", 2024-09-17T02:21:57.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3628999999999999e-05 2024-09-17T02:21:57.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:57.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336666+0000", 2024-09-17T02:21:57.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0604000000000001e-05 2024-09-17T02:21:57.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:57.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363143+0000", 2024-09-17T02:21:57.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026477055999999999 2024-09-17T02:21:57.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:57.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363189+0000", 2024-09-17T02:21:57.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6312e-05 2024-09-17T02:21:57.405 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.405 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:57.405 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.405 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:138259 5.3 5:c08b4023:::benchmark_data_smithi001_23533_object10142:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:57.405 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.337063+0000", 2024-09-17T02:21:57.405 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.990346083999999, 2024-09-17T02:21:57.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027773173000000002, 2024-09-17T02:21:57.405 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:57.405 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:57.406 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:57.406 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:57.406 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:57.406 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:57.406 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 138259 2024-09-17T02:21:57.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.406 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:57.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:57.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337063+0000", 2024-09-17T02:21:57.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:57.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337063+0000", 2024-09-17T02:21:57.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:57.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337064+0000", 2024-09-17T02:21:57.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-17T02:21:57.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:57.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337066+0000", 2024-09-17T02:21:57.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.03e-06 2024-09-17T02:21:57.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:57.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337072+0000", 2024-09-17T02:21:57.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5119999999999997e-06 2024-09-17T02:21:57.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:57.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337077+0000", 2024-09-17T02:21:57.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.454e-06 2024-09-17T02:21:57.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:57.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.352990+0000", 2024-09-17T02:21:57.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015913116000000001 2024-09-17T02:21:57.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:57.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.353136+0000", 2024-09-17T02:21:57.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000146117 2024-09-17T02:21:57.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:57.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.353253+0000", 2024-09-17T02:21:57.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117359 2024-09-17T02:21:57.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:57.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.358284+0000", 2024-09-17T02:21:57.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050306689999999998 2024-09-17T02:21:57.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:57.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.364738+0000", 2024-09-17T02:21:57.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064539410000000004 2024-09-17T02:21:57.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:57.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.364768+0000", 2024-09-17T02:21:57.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0086999999999998e-05 2024-09-17T02:21:57.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:57.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.364836+0000", 2024-09-17T02:21:57.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8549999999999999e-05 2024-09-17T02:21:57.411 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.411 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:57.411 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.411 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:138249 5.b e54/51 5:dcbad32d:::benchmark_data_smithi001_23533_object10132:head v 54'8568, mlcod=54'8564)", 2024-09-17T02:21:57.411 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.338016+0000", 2024-09-17T02:21:57.411 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.989393744000001, 2024-09-17T02:21:57.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025210803, 2024-09-17T02:21:57.411 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:57.412 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:57.412 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:57.412 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:57.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:57.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338016+0000", 2024-09-17T02:21:57.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:57.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338016+0000", 2024-09-17T02:21:57.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:57.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338017+0000", 2024-09-17T02:21:57.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.28e-06 2024-09-17T02:21:57.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:57.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338022+0000", 2024-09-17T02:21:57.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0950000000000003e-06 2024-09-17T02:21:57.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:57.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338032+0000", 2024-09-17T02:21:57.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7140000000000005e-06 2024-09-17T02:21:57.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:57.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338038+0000", 2024-09-17T02:21:57.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1029999999999998e-06 2024-09-17T02:21:57.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:57.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.349300+0000", 2024-09-17T02:21:57.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01126216 2024-09-17T02:21:57.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:57.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.349359+0000", 2024-09-17T02:21:57.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9206999999999997e-05 2024-09-17T02:21:57.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:57.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363192+0000", 2024-09-17T02:21:57.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013833253 2024-09-17T02:21:57.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:57.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363226+0000", 2024-09-17T02:21:57.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3991e-05 2024-09-17T02:21:57.416 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.416 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:57.416 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.416 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:139587 5.1 5:801d98ef:::benchmark_data_smithi001_23533_object11470:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:57.416 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.931670+0000", 2024-09-17T02:21:57.416 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.395739004999999, 2024-09-17T02:21:57.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025666268999999999, 2024-09-17T02:21:57.416 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:57.416 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:57.416 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:57.417 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:57.417 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:57.417 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:57.417 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 139587 2024-09-17T02:21:57.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.417 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:57.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:57.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931670+0000", 2024-09-17T02:21:57.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:57.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931670+0000", 2024-09-17T02:21:57.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:57.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931671+0000", 2024-09-17T02:21:57.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.034e-06 2024-09-17T02:21:57.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:57.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931677+0000", 2024-09-17T02:21:57.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4580000000000001e-06 2024-09-17T02:21:57.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:57.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931690+0000", 2024-09-17T02:21:57.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3152999999999999e-05 2024-09-17T02:21:57.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:57.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931699+0000", 2024-09-17T02:21:57.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3100000000000006e-06 2024-09-17T02:21:57.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:57.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931779+0000", 2024-09-17T02:21:57.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0284000000000006e-05 2024-09-17T02:21:57.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:57.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931968+0000", 2024-09-17T02:21:57.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018853399999999999 2024-09-17T02:21:57.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:57.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.932149+0000", 2024-09-17T02:21:57.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018114699999999999 2024-09-17T02:21:57.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:57.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.935163+0000", 2024-09-17T02:21:57.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030143169999999999 2024-09-17T02:21:57.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:57.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.957199+0000", 2024-09-17T02:21:57.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022035255 2024-09-17T02:21:57.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:57.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.957247+0000", 2024-09-17T02:21:57.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8319999999999998e-05 2024-09-17T02:21:57.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:57.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.957337+0000", 2024-09-17T02:21:57.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9456999999999994e-05 2024-09-17T02:21:57.422 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.422 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:57.422 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.422 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:140178 5.1 5:8f77d9ee:::benchmark_data_smithi001_23533_object12061:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:57.422 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:21:57.422 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.139953513999998, 2024-09-17T02:21:57.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025269478000000001, 2024-09-17T02:21:57.422 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:57.423 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:57.423 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:57.423 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:57.423 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:57.423 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:57.423 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 140178 2024-09-17T02:21:57.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.423 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:57.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:57.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:21:57.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:57.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:21:57.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:57.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:21:57.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0500000000000004e-07 2024-09-17T02:21:57.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:57.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187459+0000", 2024-09-17T02:21:57.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5299999999999999e-06 2024-09-17T02:21:57.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:57.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187468+0000", 2024-09-17T02:21:57.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3130000000000004e-06 2024-09-17T02:21:57.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:57.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187473+0000", 2024-09-17T02:21:57.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-09-17T02:21:57.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:57.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.192476+0000", 2024-09-17T02:21:57.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050035339999999996 2024-09-17T02:21:57.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:57.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.192603+0000", 2024-09-17T02:21:57.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012652299999999999 2024-09-17T02:21:57.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:57.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.192719+0000", 2024-09-17T02:21:57.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011568700000000001 2024-09-17T02:21:57.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:57.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.196336+0000", 2024-09-17T02:21:57.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003617178 2024-09-17T02:21:57.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:57.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.212470+0000", 2024-09-17T02:21:57.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016134402999999999 2024-09-17T02:21:57.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:57.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.212522+0000", 2024-09-17T02:21:57.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1480000000000002e-05 2024-09-17T02:21:57.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:57.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.212725+0000", 2024-09-17T02:21:57.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020359100000000001 2024-09-17T02:21:57.428 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.428 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:57.428 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.428 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:150456 5.2 5:4ee9ae1c:::benchmark_data_smithi001_23533_object22339:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:57.428 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.838305+0000", 2024-09-17T02:21:57.429 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 11.489104288, 2024-09-17T02:21:57.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026350045999999998, 2024-09-17T02:21:57.429 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:57.429 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:57.429 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:57.429 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:57.429 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:57.429 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:57.429 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 150456 2024-09-17T02:21:57.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.429 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:57.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:57.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838305+0000", 2024-09-17T02:21:57.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:57.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838305+0000", 2024-09-17T02:21:57.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:57.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838305+0000", 2024-09-17T02:21:57.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4999999999999998e-07 2024-09-17T02:21:57.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:57.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838308+0000", 2024-09-17T02:21:57.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.187e-06 2024-09-17T02:21:57.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:57.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838314+0000", 2024-09-17T02:21:57.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2400000000000004e-06 2024-09-17T02:21:57.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:57.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838318+0000", 2024-09-17T02:21:57.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5020000000000003e-06 2024-09-17T02:21:57.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:57.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.840927+0000", 2024-09-17T02:21:57.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026083690000000001 2024-09-17T02:21:57.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:57.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.841037+0000", 2024-09-17T02:21:57.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109888 2024-09-17T02:21:57.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:57.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.864539+0000", 2024-09-17T02:21:57.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023502788 2024-09-17T02:21:57.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:57.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.864586+0000", 2024-09-17T02:21:57.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6554999999999997e-05 2024-09-17T02:21:57.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:57.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.864655+0000", 2024-09-17T02:21:57.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9066999999999994e-05 2024-09-17T02:21:57.433 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.433 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:57.434 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.434 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:150458 5.a 5:59b62890:::benchmark_data_smithi001_23533_object22341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:57.434 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:21:57.434 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 11.489083558000001, 2024-09-17T02:21:57.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028150173000000001, 2024-09-17T02:21:57.434 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:57.434 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:57.434 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:57.434 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:57.434 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:57.434 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:57.435 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 150458 2024-09-17T02:21:57.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.435 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:57.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:57.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:21:57.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:57.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:21:57.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:57.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:21:57.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7800000000000002e-07 2024-09-17T02:21:57.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:57.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838328+0000", 2024-09-17T02:21:57.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.838e-06 2024-09-17T02:21:57.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:57.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838335+0000", 2024-09-17T02:21:57.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1999999999999997e-06 2024-09-17T02:21:57.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:57.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838340+0000", 2024-09-17T02:21:57.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7389999999999999e-06 2024-09-17T02:21:57.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:57.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849082+0000", 2024-09-17T02:21:57.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01074174 2024-09-17T02:21:57.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:57.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849192+0000", 2024-09-17T02:21:57.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011040300000000001 2024-09-17T02:21:57.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:57.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849297+0000", 2024-09-17T02:21:57.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104764 2024-09-17T02:21:57.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:57.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.857853+0000", 2024-09-17T02:21:57.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085558490000000008 2024-09-17T02:21:57.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:57.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866430+0000", 2024-09-17T02:21:57.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085768140000000003 2024-09-17T02:21:57.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:57.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866454+0000", 2024-09-17T02:21:57.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4428000000000001e-05 2024-09-17T02:21:57.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:57.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866476+0000", 2024-09-17T02:21:57.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.192e-05 2024-09-17T02:21:57.477 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.477 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:57.477 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.477 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:150461 5.a 5:58886edc:::benchmark_data_smithi001_23533_object22344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:57.478 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.838709+0000", 2024-09-17T02:21:57.478 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 11.488700244, 2024-09-17T02:21:57.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027819366000000002, 2024-09-17T02:21:57.478 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:57.478 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:57.478 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:57.478 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:57.478 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:57.478 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:57.478 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 150461 2024-09-17T02:21:57.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.478 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:57.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:57.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838709+0000", 2024-09-17T02:21:57.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:57.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838709+0000", 2024-09-17T02:21:57.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:57.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:57.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838710+0000", 2024-09-17T02:21:57.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9399999999999995e-07 2024-09-17T02:21:57.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:57.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838712+0000", 2024-09-17T02:21:57.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.57e-06 2024-09-17T02:21:57.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:57.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838843+0000", 2024-09-17T02:21:57.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130469 2024-09-17T02:21:57.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:57.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838925+0000", 2024-09-17T02:21:57.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2622999999999998e-05 2024-09-17T02:21:57.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:57.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.855341+0000", 2024-09-17T02:21:57.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016415965000000001 2024-09-17T02:21:57.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:57.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.855509+0000", 2024-09-17T02:21:57.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016805800000000001 2024-09-17T02:21:57.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:57.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.855638+0000", 2024-09-17T02:21:57.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012901199999999999 2024-09-17T02:21:57.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:57.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.860084+0000", 2024-09-17T02:21:57.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044458650000000002 2024-09-17T02:21:57.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:57.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866486+0000", 2024-09-17T02:21:57.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064016919999999996 2024-09-17T02:21:57.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:57.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866505+0000", 2024-09-17T02:21:57.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9667e-05 2024-09-17T02:21:57.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:57.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:57.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:57.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866528+0000", 2024-09-17T02:21:57.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2951000000000001e-05 2024-09-17T02:21:57.483 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.483 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:57.483 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.483 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:57.484 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:57.484 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:57.485 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:57.486 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:57.488+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:57.586 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:57.585+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:57.635 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:57.635 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:57.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.636 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:176660 5.b 5:ddf2cb86:::benchmark_data_smithi001_23533_object48543:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T02:21:57.636 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:57.627000+0000", 2024-09-17T02:21:57.636 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.012507443, 2024-09-17T02:21:57.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012525422, 2024-09-17T02:21:57.636 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:57.636 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:57.636 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:57.636 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:57.636 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:57.636 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:57.637 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 176660 2024-09-17T02:21:57.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.637 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:57.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:57.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.627000+0000", 2024-09-17T02:21:57.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:57.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:57.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.627000+0000", 2024-09-17T02:21:57.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:57.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:57.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.627001+0000", 2024-09-17T02:21:57.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7999999999999995e-07 2024-09-17T02:21:57.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:57.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.627004+0000", 2024-09-17T02:21:57.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3759999999999999e-06 2024-09-17T02:21:57.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:57.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.627014+0000", 2024-09-17T02:21:57.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6369999999999994e-06 2024-09-17T02:21:57.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:57.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.627020+0000", 2024-09-17T02:21:57.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1340000000000001e-06 2024-09-17T02:21:57.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:57.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.629756+0000", 2024-09-17T02:21:57.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027360850000000001 2024-09-17T02:21:57.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:57.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.629864+0000", 2024-09-17T02:21:57.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010819000000000001 2024-09-17T02:21:57.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:57.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.629975+0000", 2024-09-17T02:21:57.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110868 2024-09-17T02:21:57.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:57.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.632562+0000", 2024-09-17T02:21:57.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025866219999999998 2024-09-17T02:21:57.641 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:57.641 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:57.641 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:57.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.641 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:176678 5.b 5:d2b4c5fc:::benchmark_data_smithi001_23533_object48561:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T02:21:57.641 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:57.634494+0000", 2024-09-17T02:21:57.642 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0050133909999999999, 2024-09-17T02:21:57.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050996030000000003, 2024-09-17T02:21:57.642 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:57.642 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:57.642 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:57.642 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:57.642 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:57.642 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:57.642 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 176678 2024-09-17T02:21:57.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.642 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:57.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:57.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.634494+0000", 2024-09-17T02:21:57.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:57.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:57.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.634494+0000", 2024-09-17T02:21:57.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:57.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:57.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.634495+0000", 2024-09-17T02:21:57.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1399999999999996e-07 2024-09-17T02:21:57.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:57.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.634502+0000", 2024-09-17T02:21:57.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7909999999999999e-06 2024-09-17T02:21:57.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:57.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.634514+0000", 2024-09-17T02:21:57.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2121e-05 2024-09-17T02:21:57.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:57.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.634522+0000", 2024-09-17T02:21:57.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4619999999999999e-06 2024-09-17T02:21:57.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:57.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.634576+0000", 2024-09-17T02:21:57.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3983000000000001e-05 2024-09-17T02:21:57.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:57.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.634703+0000", 2024-09-17T02:21:57.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012726 2024-09-17T02:21:57.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:57.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.634819+0000", 2024-09-17T02:21:57.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116214 2024-09-17T02:21:57.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:57.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.636418+0000", 2024-09-17T02:21:57.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015987690000000001 2024-09-17T02:21:57.646 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:57.646 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:57.646 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:57.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.647 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:176680 5.e 5:76ee378d:::benchmark_data_smithi001_23533_object48563:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T02:21:57.647 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:57.636954+0000", 2024-09-17T02:21:57.647 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0025541869999999999, 2024-09-17T02:21:57.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026841579999999999, 2024-09-17T02:21:57.647 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:57.647 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:57.647 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:57.647 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:57.647 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:57.647 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:57.647 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 176680 2024-09-17T02:21:57.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.648 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:57.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:57.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.636954+0000", 2024-09-17T02:21:57.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:57.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:57.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.636954+0000", 2024-09-17T02:21:57.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:57.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:57.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.636955+0000", 2024-09-17T02:21:57.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7100000000000011e-07 2024-09-17T02:21:57.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:57.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.636962+0000", 2024-09-17T02:21:57.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4080000000000001e-06 2024-09-17T02:21:57.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:57.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.636976+0000", 2024-09-17T02:21:57.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3936e-05 2024-09-17T02:21:57.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:57.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.636985+0000", 2024-09-17T02:21:57.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9339999999999995e-06 2024-09-17T02:21:57.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:57.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.637037+0000", 2024-09-17T02:21:57.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2321000000000003e-05 2024-09-17T02:21:57.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:57.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.637158+0000", 2024-09-17T02:21:57.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000120723 2024-09-17T02:21:57.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:57.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.637280+0000", 2024-09-17T02:21:57.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012222200000000001 2024-09-17T02:21:57.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:57.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.639223+0000", 2024-09-17T02:21:57.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00194293 2024-09-17T02:21:57.652 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:57.652 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:57.652 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:57.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.652 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:176683 5.4 5:2ad1c1a2:::benchmark_data_smithi001_23533_object48566:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T02:21:57.652 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:57.637408+0000", 2024-09-17T02:21:57.652 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0020992839999999999, 2024-09-17T02:21:57.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022710080000000001, 2024-09-17T02:21:57.652 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:57.652 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:57.653 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:57.653 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:57.653 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:57.653 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:57.653 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 176683 2024-09-17T02:21:57.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.653 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:57.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:57.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.637408+0000", 2024-09-17T02:21:57.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:57.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:57.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.637408+0000", 2024-09-17T02:21:57.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:57.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:57.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.637409+0000", 2024-09-17T02:21:57.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9699999999999995e-07 2024-09-17T02:21:57.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:57.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.637413+0000", 2024-09-17T02:21:57.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1420000000000003e-06 2024-09-17T02:21:57.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:57.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.637427+0000", 2024-09-17T02:21:57.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3873000000000001e-05 2024-09-17T02:21:57.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:57.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.637435+0000", 2024-09-17T02:21:57.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9969999999999998e-06 2024-09-17T02:21:57.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:57.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.637490+0000", 2024-09-17T02:21:57.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5143999999999999e-05 2024-09-17T02:21:57.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:57.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.637643+0000", 2024-09-17T02:21:57.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152471 2024-09-17T02:21:57.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:57.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.637759+0000", 2024-09-17T02:21:57.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116304 2024-09-17T02:21:57.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:57.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.639574+0000", 2024-09-17T02:21:57.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018142869999999999 2024-09-17T02:21:57.657 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:57.657 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:57.657 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:57.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.658 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:176677 5.3 e60/51 5:cbacf574:::benchmark_data_smithi001_23533_object48560:head v 60'11122, mlcod=60'11119)", 2024-09-17T02:21:57.658 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:57.637717+0000", 2024-09-17T02:21:57.658 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0017910999999999999, 2024-09-17T02:21:57.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020354679999999999, 2024-09-17T02:21:57.658 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:57.658 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:57.658 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:57.658 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:57.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:57.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.637717+0000", 2024-09-17T02:21:57.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:57.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:57.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.637717+0000", 2024-09-17T02:21:57.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:57.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:57.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.637717+0000", 2024-09-17T02:21:57.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6000000000000003e-07 2024-09-17T02:21:57.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:57.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.637725+0000", 2024-09-17T02:21:57.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8329999999999994e-06 2024-09-17T02:21:57.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:57.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.637736+0000", 2024-09-17T02:21:57.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0861e-05 2024-09-17T02:21:57.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:57.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.637742+0000", 2024-09-17T02:21:57.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4559999999999997e-06 2024-09-17T02:21:57.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:57.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.637802+0000", 2024-09-17T02:21:57.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9036999999999997e-05 2024-09-17T02:21:57.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:57.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.637815+0000", 2024-09-17T02:21:57.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3203e-05 2024-09-17T02:21:57.662 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:57.662 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:57.662 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:57.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.662 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:176685 5.0 e60/26 5:0a27f476:::benchmark_data_smithi001_23533_object48568:head v 60'11007, mlcod=60'11005)", 2024-09-17T02:21:57.662 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:57.639421+0000", 2024-09-17T02:21:57.662 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.6819999999999999e-05, 2024-09-17T02:21:57.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00039379299999999998, 2024-09-17T02:21:57.662 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:57.662 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:57.662 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:57.663 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:57.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:57.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.639421+0000", 2024-09-17T02:21:57.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:57.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:57.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.639421+0000", 2024-09-17T02:21:57.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:57.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:57.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.639422+0000", 2024-09-17T02:21:57.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6400000000000002e-07 2024-09-17T02:21:57.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:57.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.639432+0000", 2024-09-17T02:21:57.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8849999999999994e-06 2024-09-17T02:21:57.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:57.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.639445+0000", 2024-09-17T02:21:57.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3087e-05 2024-09-17T02:21:57.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:57.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.639451+0000", 2024-09-17T02:21:57.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7939999999999997e-06 2024-09-17T02:21:57.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:57.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.639499+0000", 2024-09-17T02:21:57.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7123999999999998e-05 2024-09-17T02:21:57.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:57.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.639520+0000", 2024-09-17T02:21:57.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1149999999999999e-05 2024-09-17T02:21:57.666 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:57.666 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:57.666 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:57.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.666 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:176660 5.b e60/51 ondisk, result = 0)", 2024-09-17T02:21:57.666 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:57.639663+0000", 2024-09-17T02:21:57.666 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4294967295.9998446, 2024-09-17T02:21:57.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000213861, 2024-09-17T02:21:57.667 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:57.667 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:57.667 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:57.667 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:57.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:57.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.639663+0000", 2024-09-17T02:21:57.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:57.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:57.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.639663+0000", 2024-09-17T02:21:57.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:57.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:57.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.639664+0000", 2024-09-17T02:21:57.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2799999999999996e-07 2024-09-17T02:21:57.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:57.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.639668+0000", 2024-09-17T02:21:57.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9779999999999999e-06 2024-09-17T02:21:57.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:57.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.639681+0000", 2024-09-17T02:21:57.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3059e-05 2024-09-17T02:21:57.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:57.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.639688+0000", 2024-09-17T02:21:57.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8179999999999998e-06 2024-09-17T02:21:57.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:57.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.639726+0000", 2024-09-17T02:21:57.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.841e-05 2024-09-17T02:21:57.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:57.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:57.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:57.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:57.639734+0000", 2024-09-17T02:21:57.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.79e-06 2024-09-17T02:21:57.670 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:57.670 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:57.670 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:57.670 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:57.671 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:21:57.671 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 7 2024-09-17T02:21:57.671 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:57.672 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:57.718 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:57.720+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:57.787 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:57.788+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:57.825 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:57.825 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:21:57.825 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:21:57.825 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:21:57.825 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:57.845 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:57.889 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:57.892+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:57.989 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:57.992+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:58.034 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:58.034 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:21:58.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:21:58.034 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:58.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.034 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97749 5.b 5:d930ef52:::benchmark_data_smithi001_23533_object97748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:58.035 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:58.035 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.444206852999997, 2024-09-17T02:21:58.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092964343000000005, 2024-09-17T02:21:58.035 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:58.035 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:58.035 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.035 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:58.035 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:58.035 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.035 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97749 2024-09-17T02:21:58.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.035 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:58.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:58.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:58.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:58.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:21:58.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:58.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591947+0000", 2024-09-17T02:21:58.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:21:58.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:58.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592011+0000", 2024-09-17T02:21:58.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3608000000000005e-05 2024-09-17T02:21:58.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:58.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592021+0000", 2024-09-17T02:21:58.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9979999999999998e-06 2024-09-17T02:21:58.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592028+0000", 2024-09-17T02:21:58.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1439999999999997e-06 2024-09-17T02:21:58.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593633+0000", 2024-09-17T02:21:58.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001604636 2024-09-17T02:21:58.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:58.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593757+0000", 2024-09-17T02:21:58.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012432099999999999 2024-09-17T02:21:58.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:58.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593866+0000", 2024-09-17T02:21:58.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109094 2024-09-17T02:21:58.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:58.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601190+0000", 2024-09-17T02:21:58.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073237620000000002 2024-09-17T02:21:58.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601356+0000", 2024-09-17T02:21:58.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016651900000000001 2024-09-17T02:21:58.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684618+0000", 2024-09-17T02:21:58.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083261356999999994 2024-09-17T02:21:58.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:58.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684724+0000", 2024-09-17T02:21:58.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010681800000000001 2024-09-17T02:21:58.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:58.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684911+0000", 2024-09-17T02:21:58.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186243 2024-09-17T02:21:58.041 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.041 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:58.041 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.041 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97752 5.b 5:d146f486:::benchmark_data_smithi001_23533_object97751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:58.041 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:58.041 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.442854158999999, 2024-09-17T02:21:58.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091989557, 2024-09-17T02:21:58.042 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:58.042 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:58.042 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.042 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:58.042 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:58.042 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.042 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97752 2024-09-17T02:21:58.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.042 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:58.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:58.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:58.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:58.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:21:58.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:58.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593300+0000", 2024-09-17T02:21:58.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8199999999999998e-07 2024-09-17T02:21:58.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:58.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593364+0000", 2024-09-17T02:21:58.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3831999999999995e-05 2024-09-17T02:21:58.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:58.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593376+0000", 2024-09-17T02:21:58.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1800999999999999e-05 2024-09-17T02:21:58.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593382+0000", 2024-09-17T02:21:58.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6780000000000003e-06 2024-09-17T02:21:58.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595491+0000", 2024-09-17T02:21:58.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021090689999999999 2024-09-17T02:21:58.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:58.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595614+0000", 2024-09-17T02:21:58.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012321500000000001 2024-09-17T02:21:58.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:58.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595778+0000", 2024-09-17T02:21:58.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016321900000000001 2024-09-17T02:21:58.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:58.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601197+0000", 2024-09-17T02:21:58.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054195600000000003 2024-09-17T02:21:58.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601396+0000", 2024-09-17T02:21:58.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019825299999999999 2024-09-17T02:21:58.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684990+0000", 2024-09-17T02:21:58.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083594878999999997 2024-09-17T02:21:58.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:58.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685116+0000", 2024-09-17T02:21:58.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012522799999999999 2024-09-17T02:21:58.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:58.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685289+0000", 2024-09-17T02:21:58.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172941 2024-09-17T02:21:58.047 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.047 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:58.047 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.048 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97754 5.b 5:da0615e5:::benchmark_data_smithi001_23533_object97753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:58.048 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:58.048 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.441216236999999, 2024-09-17T02:21:58.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092097207, 2024-09-17T02:21:58.048 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:58.048 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:58.048 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.048 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:58.048 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:58.048 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.048 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97754 2024-09-17T02:21:58.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.049 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:58.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:58.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:58.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:58.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:21:58.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:58.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594938+0000", 2024-09-17T02:21:58.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5000000000000002e-07 2024-09-17T02:21:58.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:58.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595075+0000", 2024-09-17T02:21:58.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137742 2024-09-17T02:21:58.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:58.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595087+0000", 2024-09-17T02:21:58.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1243000000000001e-05 2024-09-17T02:21:58.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595095+0000", 2024-09-17T02:21:58.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1030000000000002e-06 2024-09-17T02:21:58.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598461+0000", 2024-09-17T02:21:58.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033661170000000001 2024-09-17T02:21:58.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:58.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598540+0000", 2024-09-17T02:21:58.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8937999999999995e-05 2024-09-17T02:21:58.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:58.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598626+0000", 2024-09-17T02:21:58.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6042000000000001e-05 2024-09-17T02:21:58.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:58.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684258+0000", 2024-09-17T02:21:58.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085632394000000001 2024-09-17T02:21:58.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685369+0000", 2024-09-17T02:21:58.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001111063 2024-09-17T02:21:58.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685511+0000", 2024-09-17T02:21:58.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141965 2024-09-17T02:21:58.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:58.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685604+0000", 2024-09-17T02:21:58.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2935000000000004e-05 2024-09-17T02:21:58.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:58.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687034+0000", 2024-09-17T02:21:58.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001430015 2024-09-17T02:21:58.054 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.054 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:58.054 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.054 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97755 5.b 5:d36a03a1:::benchmark_data_smithi001_23533_object97754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:58.054 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:58.054 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.441043086999997, 2024-09-17T02:21:58.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0924904, 2024-09-17T02:21:58.055 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:58.055 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:58.055 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.055 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:58.055 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:58.055 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.055 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97755 2024-09-17T02:21:58.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.055 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:58.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:58.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:58.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:58.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:21:58.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:58.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595111+0000", 2024-09-17T02:21:58.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:21:58.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:58.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595145+0000", 2024-09-17T02:21:58.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3927000000000002e-05 2024-09-17T02:21:58.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:58.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595155+0000", 2024-09-17T02:21:58.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0023e-05 2024-09-17T02:21:58.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595162+0000", 2024-09-17T02:21:58.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3950000000000003e-06 2024-09-17T02:21:58.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599821+0000", 2024-09-17T02:21:58.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046592880000000001 2024-09-17T02:21:58.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:58.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599912+0000", 2024-09-17T02:21:58.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1049000000000002e-05 2024-09-17T02:21:58.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:21:58.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600062+0000", 2024-09-17T02:21:58.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015001700000000001 2024-09-17T02:21:58.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:58.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685307+0000", 2024-09-17T02:21:58.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085244340000000002 2024-09-17T02:21:58.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685446+0000", 2024-09-17T02:21:58.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013955700000000001 2024-09-17T02:21:58.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687375+0000", 2024-09-17T02:21:58.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019291079999999999 2024-09-17T02:21:58.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:58.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687462+0000", 2024-09-17T02:21:58.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6148000000000003e-05 2024-09-17T02:21:58.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:58.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687600+0000", 2024-09-17T02:21:58.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013887900000000001 2024-09-17T02:21:58.061 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.061 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:58.061 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.061 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 44/44 lb 5:c4567a04:::benchmark_data_smithi001_23533_object4200:head)", 2024-09-17T02:21:58.061 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:58.061 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.438946461, 2024-09-17T02:21:58.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092483421999999996, 2024-09-17T02:21:58.061 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:58.061 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:58.061 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:58.061 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:58.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:58.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:58.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:58.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:58.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:58.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:21:58.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6399999999999998e-07 2024-09-17T02:21:58.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:58.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597213+0000", 2024-09-17T02:21:58.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3659999999999997e-06 2024-09-17T02:21:58.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:58.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597222+0000", 2024-09-17T02:21:58.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0510000000000002e-06 2024-09-17T02:21:58.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597228+0000", 2024-09-17T02:21:58.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1569999999999999e-06 2024-09-17T02:21:58.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689588+0000", 2024-09-17T02:21:58.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092359931000000006 2024-09-17T02:21:58.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:58.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689622+0000", 2024-09-17T02:21:58.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4425999999999999e-05 2024-09-17T02:21:58.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:58.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689690+0000", 2024-09-17T02:21:58.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8126999999999993e-05 2024-09-17T02:21:58.065 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.065 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:58.065 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.065 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129462 5.4 5:2e0acc16:::benchmark_data_smithi001_23533_object1345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:58.065 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:21:58.065 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.501212391999999, 2024-09-17T02:21:58.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0112774899999999, 2024-09-17T02:21:58.065 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:58.065 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:58.065 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.066 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:58.066 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:58.066 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.066 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129462 2024-09-17T02:21:58.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.066 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:58.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:58.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:21:58.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:58.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:21:58.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:58.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534943+0000", 2024-09-17T02:21:58.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8759999999999999e-06 2024-09-17T02:21:58.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:58.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534951+0000", 2024-09-17T02:21:58.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3219999999999993e-06 2024-09-17T02:21:58.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:58.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534977+0000", 2024-09-17T02:21:58.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6245e-05 2024-09-17T02:21:58.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534992+0000", 2024-09-17T02:21:58.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4936000000000001e-05 2024-09-17T02:21:58.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535133+0000", 2024-09-17T02:21:58.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014051299999999999 2024-09-17T02:21:58.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:58.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:21:58.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1741000000000001e-05 2024-09-17T02:21:58.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.533906+0000", 2024-09-17T02:21:58.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99875209300000001 2024-09-17T02:21:58.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:58.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534348+0000", 2024-09-17T02:21:58.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044128899999999998 2024-09-17T02:21:58.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:58.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534762+0000", 2024-09-17T02:21:58.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000414707 2024-09-17T02:21:58.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:58.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545024+0000", 2024-09-17T02:21:58.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010261283 2024-09-17T02:21:58.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545953+0000", 2024-09-17T02:21:58.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000929618 2024-09-17T02:21:58.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:58.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546047+0000", 2024-09-17T02:21:58.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3697999999999996e-05 2024-09-17T02:21:58.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:58.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546218+0000", 2024-09-17T02:21:58.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017116899999999999 2024-09-17T02:21:58.071 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.071 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:58.071 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.072 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129480 5.4 5:2b1d398b:::benchmark_data_smithi001_23533_object1363:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:58.072 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:21:58.072 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.493457926000001, 2024-09-17T02:21:58.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0038926450000001, 2024-09-17T02:21:58.072 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:58.072 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:58.072 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.072 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:58.072 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:58.072 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.072 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129480 2024-09-17T02:21:58.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.073 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:58.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:58.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:21:58.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:58.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:21:58.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:58.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542696+0000", 2024-09-17T02:21:58.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9999999999999995e-07 2024-09-17T02:21:58.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:58.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542701+0000", 2024-09-17T02:21:58.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2240000000000003e-06 2024-09-17T02:21:58.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:58.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542716+0000", 2024-09-17T02:21:58.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4970000000000001e-05 2024-09-17T02:21:58.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542726+0000", 2024-09-17T02:21:58.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2879999999999998e-06 2024-09-17T02:21:58.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542832+0000", 2024-09-17T02:21:58.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010597199999999999 2024-09-17T02:21:58.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:58.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542843+0000", 2024-09-17T02:21:58.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.098e-05 2024-09-17T02:21:58.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538436+0000", 2024-09-17T02:21:58.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99559286800000002 2024-09-17T02:21:58.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:58.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538791+0000", 2024-09-17T02:21:58.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035585499999999997 2024-09-17T02:21:58.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:58.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.539144+0000", 2024-09-17T02:21:58.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035268499999999999 2024-09-17T02:21:58.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:58.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545880+0000", 2024-09-17T02:21:58.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00673552 2024-09-17T02:21:58.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546330+0000", 2024-09-17T02:21:58.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045039599999999999 2024-09-17T02:21:58.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:58.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546414+0000", 2024-09-17T02:21:58.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4468000000000005e-05 2024-09-17T02:21:58.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:58.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546588+0000", 2024-09-17T02:21:58.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017341899999999999 2024-09-17T02:21:58.078 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.078 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:58.078 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.079 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129505 5.4 5:294f2ec7:::benchmark_data_smithi001_23533_object1388:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:58.079 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:21:58.079 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.474444753, 2024-09-17T02:21:58.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98589826199999997, 2024-09-17T02:21:58.079 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:58.079 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:58.079 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.079 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:58.079 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:58.079 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.079 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129505 2024-09-17T02:21:58.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.079 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:58.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:58.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:21:58.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:58.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:21:58.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:58.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561710+0000", 2024-09-17T02:21:58.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7060000000000001e-06 2024-09-17T02:21:58.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:58.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561718+0000", 2024-09-17T02:21:58.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.542e-06 2024-09-17T02:21:58.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:58.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561741+0000", 2024-09-17T02:21:58.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3357e-05 2024-09-17T02:21:58.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561754+0000", 2024-09-17T02:21:58.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3200000000000001e-05 2024-09-17T02:21:58.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561867+0000", 2024-09-17T02:21:58.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113211 2024-09-17T02:21:58.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:58.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561888+0000", 2024-09-17T02:21:58.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0809999999999999e-05 2024-09-17T02:21:58.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542140+0000", 2024-09-17T02:21:58.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98025195799999998 2024-09-17T02:21:58.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:58.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542331+0000", 2024-09-17T02:21:58.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019127599999999999 2024-09-17T02:21:58.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:58.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542517+0000", 2024-09-17T02:21:58.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000185625 2024-09-17T02:21:58.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547114+0000", 2024-09-17T02:21:58.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045968620000000002 2024-09-17T02:21:58.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:58.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547187+0000", 2024-09-17T02:21:58.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3348000000000003e-05 2024-09-17T02:21:58.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:58.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547324+0000", 2024-09-17T02:21:58.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013681699999999999 2024-09-17T02:21:58.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:58.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547607+0000", 2024-09-17T02:21:58.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028255000000000001 2024-09-17T02:21:58.085 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.085 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:58.085 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.086 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129508 5.4 5:2892b582:::benchmark_data_smithi001_23533_object1391:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:58.086 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:21:58.086 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.47310766, 2024-09-17T02:21:58.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99697919099999999, 2024-09-17T02:21:58.086 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:58.086 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:58.086 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.086 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:58.087 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:58.087 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.087 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129508 2024-09-17T02:21:58.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.087 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:58.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:58.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:21:58.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:58.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:21:58.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:58.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563047+0000", 2024-09-17T02:21:58.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.274e-06 2024-09-17T02:21:58.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:58.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563054+0000", 2024-09-17T02:21:58.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2799999999999998e-06 2024-09-17T02:21:58.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:58.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563070+0000", 2024-09-17T02:21:58.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5991999999999999e-05 2024-09-17T02:21:58.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563078+0000", 2024-09-17T02:21:58.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2390000000000002e-06 2024-09-17T02:21:58.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563181+0000", 2024-09-17T02:21:58.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102249 2024-09-17T02:21:58.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:58.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563199+0000", 2024-09-17T02:21:58.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8215000000000001e-05 2024-09-17T02:21:58.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547713+0000", 2024-09-17T02:21:58.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98451446399999998 2024-09-17T02:21:58.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:58.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548063+0000", 2024-09-17T02:21:58.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034985499999999999 2024-09-17T02:21:58.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:58.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548490+0000", 2024-09-17T02:21:58.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042658600000000001 2024-09-17T02:21:58.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555655+0000", 2024-09-17T02:21:58.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071652579999999999 2024-09-17T02:21:58.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:58.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559612+0000", 2024-09-17T02:21:58.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003957103 2024-09-17T02:21:58.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:58.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559768+0000", 2024-09-17T02:21:58.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015556899999999999 2024-09-17T02:21:58.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:58.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560025+0000", 2024-09-17T02:21:58.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025710700000000002 2024-09-17T02:21:58.092 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.093 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:58.093 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.093 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129509 5.4 5:2c35515e:::benchmark_data_smithi001_23533_object1392:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:58.093 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:21:58.093 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.472480607000001, 2024-09-17T02:21:58.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99969384900000002, 2024-09-17T02:21:58.093 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:58.093 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:58.093 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.093 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:58.093 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:58.093 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.094 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129509 2024-09-17T02:21:58.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.094 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:58.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:58.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:21:58.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:58.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:21:58.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:58.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563674+0000", 2024-09-17T02:21:58.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0920000000000001e-06 2024-09-17T02:21:58.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:58.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563679+0000", 2024-09-17T02:21:58.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7660000000000004e-06 2024-09-17T02:21:58.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:58.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563693+0000", 2024-09-17T02:21:58.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3139000000000001e-05 2024-09-17T02:21:58.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563701+0000", 2024-09-17T02:21:58.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9859999999999994e-06 2024-09-17T02:21:58.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563775+0000", 2024-09-17T02:21:58.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4659000000000005e-05 2024-09-17T02:21:58.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:58.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563785+0000", 2024-09-17T02:21:58.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4839999999999993e-06 2024-09-17T02:21:58.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552085+0000", 2024-09-17T02:21:58.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98829986999999997 2024-09-17T02:21:58.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:58.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552554+0000", 2024-09-17T02:21:58.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046908900000000001 2024-09-17T02:21:58.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:58.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552931+0000", 2024-09-17T02:21:58.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377778 2024-09-17T02:21:58.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563106+0000", 2024-09-17T02:21:58.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010174186 2024-09-17T02:21:58.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:58.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563138+0000", 2024-09-17T02:21:58.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2495e-05 2024-09-17T02:21:58.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:58.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563225+0000", 2024-09-17T02:21:58.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6677999999999999e-05 2024-09-17T02:21:58.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:58.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563366+0000", 2024-09-17T02:21:58.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014162699999999999 2024-09-17T02:21:58.099 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.099 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:58.099 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.099 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129524 5.4 5:25dca7dd:::benchmark_data_smithi001_23533_object1407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:58.100 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:21:58.100 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.465789253000001, 2024-09-17T02:21:58.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99999501999999996, 2024-09-17T02:21:58.100 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:58.100 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:58.100 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.100 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:58.100 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:58.100 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.100 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129524 2024-09-17T02:21:58.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.100 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:58.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:58.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:21:58.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:58.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:21:58.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:58.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570365+0000", 2024-09-17T02:21:58.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.142e-06 2024-09-17T02:21:58.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:58.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570369+0000", 2024-09-17T02:21:58.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.856e-06 2024-09-17T02:21:58.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:58.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570385+0000", 2024-09-17T02:21:58.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5855e-05 2024-09-17T02:21:58.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570392+0000", 2024-09-17T02:21:58.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5340000000000002e-06 2024-09-17T02:21:58.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570484+0000", 2024-09-17T02:21:58.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1212999999999996e-05 2024-09-17T02:21:58.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:58.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570498+0000", 2024-09-17T02:21:58.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4331000000000001e-05 2024-09-17T02:21:58.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555835+0000", 2024-09-17T02:21:58.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98533757700000002 2024-09-17T02:21:58.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:58.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556329+0000", 2024-09-17T02:21:58.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000493458 2024-09-17T02:21:58.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:58.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556784+0000", 2024-09-17T02:21:58.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045476499999999999 2024-09-17T02:21:58.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569852+0000", 2024-09-17T02:21:58.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013068270999999999 2024-09-17T02:21:58.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:58.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569958+0000", 2024-09-17T02:21:58.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106214 2024-09-17T02:21:58.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:58.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570124+0000", 2024-09-17T02:21:58.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165546 2024-09-17T02:21:58.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:58.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570359+0000", 2024-09-17T02:21:58.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023525799999999999 2024-09-17T02:21:58.106 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.106 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:58.106 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.106 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129537 5.4 5:260327c6:::benchmark_data_smithi001_23533_object1420:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:58.106 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:21:58.106 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.457882724000001, 2024-09-17T02:21:58.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99624596499999996, 2024-09-17T02:21:58.107 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:58.107 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:58.107 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.107 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:58.107 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:58.107 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.107 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129537 2024-09-17T02:21:58.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.107 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:58.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:58.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:21:58.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:58.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:21:58.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:58.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578272+0000", 2024-09-17T02:21:58.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.164e-06 2024-09-17T02:21:58.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:58.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578278+0000", 2024-09-17T02:21:58.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5060000000000001e-06 2024-09-17T02:21:58.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:58.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578294+0000", 2024-09-17T02:21:58.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5687000000000001e-05 2024-09-17T02:21:58.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578329+0000", 2024-09-17T02:21:58.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5311999999999997e-05 2024-09-17T02:21:58.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578419+0000", 2024-09-17T02:21:58.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0054000000000002e-05 2024-09-17T02:21:58.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:58.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578435+0000", 2024-09-17T02:21:58.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5645999999999999e-05 2024-09-17T02:21:58.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560148+0000", 2024-09-17T02:21:58.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98171342299999997 2024-09-17T02:21:58.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:58.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560383+0000", 2024-09-17T02:21:58.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000234935 2024-09-17T02:21:58.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:58.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560586+0000", 2024-09-17T02:21:58.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000202909 2024-09-17T02:21:58.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570472+0000", 2024-09-17T02:21:58.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098856959999999994 2024-09-17T02:21:58.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:58.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574138+0000", 2024-09-17T02:21:58.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036660170000000001 2024-09-17T02:21:58.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:58.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574298+0000", 2024-09-17T02:21:58.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016025600000000001 2024-09-17T02:21:58.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:58.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574516+0000", 2024-09-17T02:21:58.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021835999999999999 2024-09-17T02:21:58.113 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.113 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:58.113 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.113 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129545 5.4 5:22366489:::benchmark_data_smithi001_23533_object1428:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:58.113 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:21:58.113 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.452020001000001, 2024-09-17T02:21:58.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99074544499999995, 2024-09-17T02:21:58.113 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:58.114 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:58.114 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.114 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:58.114 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:58.114 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.114 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129545 2024-09-17T02:21:58.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.114 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:58.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:58.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:21:58.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:58.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:21:58.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:58.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584135+0000", 2024-09-17T02:21:58.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4699999999999999e-06 2024-09-17T02:21:58.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:58.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584142+0000", 2024-09-17T02:21:58.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1620000000000002e-06 2024-09-17T02:21:58.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:58.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584170+0000", 2024-09-17T02:21:58.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7897000000000001e-05 2024-09-17T02:21:58.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584183+0000", 2024-09-17T02:21:58.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2814e-05 2024-09-17T02:21:58.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584299+0000", 2024-09-17T02:21:58.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116153 2024-09-17T02:21:58.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:58.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584316+0000", 2024-09-17T02:21:58.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7524999999999999e-05 2024-09-17T02:21:58.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563461+0000", 2024-09-17T02:21:58.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97914436699999996 2024-09-17T02:21:58.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:58.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563667+0000", 2024-09-17T02:21:58.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020689800000000001 2024-09-17T02:21:58.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:58.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563878+0000", 2024-09-17T02:21:58.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210275 2024-09-17T02:21:58.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570584+0000", 2024-09-17T02:21:58.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067066080000000002 2024-09-17T02:21:58.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:58.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574539+0000", 2024-09-17T02:21:58.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039550360000000003 2024-09-17T02:21:58.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:58.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574653+0000", 2024-09-17T02:21:58.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114003 2024-09-17T02:21:58.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:58.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574879+0000", 2024-09-17T02:21:58.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022523700000000001 2024-09-17T02:21:58.120 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.120 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:58.120 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.120 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129553 5.4 5:2e41ad40:::benchmark_data_smithi001_23533_object1436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:58.120 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:21:58.120 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.446597364999999, 2024-09-17T02:21:58.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99213429600000003, 2024-09-17T02:21:58.121 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:58.121 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:58.121 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.121 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:58.121 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:58.121 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.121 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129553 2024-09-17T02:21:58.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.121 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:58.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:58.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:21:58.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:58.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:21:58.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:58.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589557+0000", 2024-09-17T02:21:58.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2219999999999999e-06 2024-09-17T02:21:58.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:58.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589562+0000", 2024-09-17T02:21:58.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0649999999999998e-06 2024-09-17T02:21:58.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:58.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589575+0000", 2024-09-17T02:21:58.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3129000000000001e-05 2024-09-17T02:21:58.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589584+0000", 2024-09-17T02:21:58.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6200000000000005e-06 2024-09-17T02:21:58.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589693+0000", 2024-09-17T02:21:58.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109319 2024-09-17T02:21:58.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:58.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589714+0000", 2024-09-17T02:21:58.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0849999999999999e-05 2024-09-17T02:21:58.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566273+0000", 2024-09-17T02:21:58.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97655884999999998 2024-09-17T02:21:58.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:58.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566543+0000", 2024-09-17T02:21:58.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027059099999999998 2024-09-17T02:21:58.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:58.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566832+0000", 2024-09-17T02:21:58.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028898200000000002 2024-09-17T02:21:58.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:58.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581040+0000", 2024-09-17T02:21:58.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014208001 2024-09-17T02:21:58.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581200+0000", 2024-09-17T02:21:58.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159956 2024-09-17T02:21:58.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:58.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581427+0000", 2024-09-17T02:21:58.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000226309 2024-09-17T02:21:58.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:58.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581690+0000", 2024-09-17T02:21:58.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026340199999999998 2024-09-17T02:21:58.127 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.127 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:58.127 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.127 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129580 5.4 5:25ed887b:::benchmark_data_smithi001_23533_object1463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:58.127 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:21:58.127 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.424825321, 2024-09-17T02:21:58.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98001430499999997, 2024-09-17T02:21:58.127 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:58.127 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:58.128 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.128 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:58.128 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:58.128 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.128 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129580 2024-09-17T02:21:58.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.128 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:58.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:58.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:21:58.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:58.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:21:58.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:58.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611329+0000", 2024-09-17T02:21:58.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.22e-06 2024-09-17T02:21:58.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:58.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611335+0000", 2024-09-17T02:21:58.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1129999999999997e-06 2024-09-17T02:21:58.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:58.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611348+0000", 2024-09-17T02:21:58.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2342e-05 2024-09-17T02:21:58.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611356+0000", 2024-09-17T02:21:58.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.371e-06 2024-09-17T02:21:58.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611419+0000", 2024-09-17T02:21:58.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3393999999999996e-05 2024-09-17T02:21:58.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:58.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611427+0000", 2024-09-17T02:21:58.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999997e-06 2024-09-17T02:21:58.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570705+0000", 2024-09-17T02:21:58.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.95927859199999999 2024-09-17T02:21:58.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:58.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571009+0000", 2024-09-17T02:21:58.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030414599999999998 2024-09-17T02:21:58.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:58.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571241+0000", 2024-09-17T02:21:58.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023106799999999999 2024-09-17T02:21:58.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:58.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590789+0000", 2024-09-17T02:21:58.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019548763 2024-09-17T02:21:58.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590928+0000", 2024-09-17T02:21:58.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000139092 2024-09-17T02:21:58.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:58.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591086+0000", 2024-09-17T02:21:58.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015787400000000001 2024-09-17T02:21:58.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:58.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591342+0000", 2024-09-17T02:21:58.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025589900000000002 2024-09-17T02:21:58.134 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.134 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:58.134 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.134 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129603 5.4 5:25aaa5e8:::benchmark_data_smithi001_23533_object1486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:58.134 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:58.134 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.408765525, 2024-09-17T02:21:58.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96463198999999999, 2024-09-17T02:21:58.134 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:58.134 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:58.134 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.134 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:58.135 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:58.135 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.135 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129603 2024-09-17T02:21:58.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.135 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:58.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:58.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:58.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:58.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:58.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:58.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:21:58.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:21:58.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:58.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627392+0000", 2024-09-17T02:21:58.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0790000000000002e-06 2024-09-17T02:21:58.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:58.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627403+0000", 2024-09-17T02:21:58.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0866000000000001e-05 2024-09-17T02:21:58.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627409+0000", 2024-09-17T02:21:58.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.305e-06 2024-09-17T02:21:58.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627485+0000", 2024-09-17T02:21:58.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6582000000000006e-05 2024-09-17T02:21:58.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:58.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627499+0000", 2024-09-17T02:21:58.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:21:58.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574991+0000", 2024-09-17T02:21:58.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94749182300000001 2024-09-17T02:21:58.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:58.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575377+0000", 2024-09-17T02:21:58.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038629400000000003 2024-09-17T02:21:58.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:58.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575665+0000", 2024-09-17T02:21:58.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028759499999999997 2024-09-17T02:21:58.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:58.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590802+0000", 2024-09-17T02:21:58.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015136479 2024-09-17T02:21:58.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591614+0000", 2024-09-17T02:21:58.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081293100000000003 2024-09-17T02:21:58.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:58.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591764+0000", 2024-09-17T02:21:58.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014932199999999999 2024-09-17T02:21:58.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:58.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592020+0000", 2024-09-17T02:21:58.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025585099999999997 2024-09-17T02:21:58.140 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.140 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:58.140 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.141 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129607 5.4 5:2f638f1e:::benchmark_data_smithi001_23533_object1490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:58.141 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:21:58.141 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.407238619000001, 2024-09-17T02:21:58.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96352375899999998, 2024-09-17T02:21:58.141 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:58.141 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:58.141 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.141 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:58.141 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:58.141 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.141 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129607 2024-09-17T02:21:58.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.142 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:58.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:58.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:21:58.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:58.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:21:58.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:58.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628916+0000", 2024-09-17T02:21:58.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1710000000000001e-06 2024-09-17T02:21:58.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:58.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628920+0000", 2024-09-17T02:21:58.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-17T02:21:58.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:58.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628935+0000", 2024-09-17T02:21:58.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4474000000000001e-05 2024-09-17T02:21:58.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628944+0000", 2024-09-17T02:21:58.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9940000000000006e-06 2024-09-17T02:21:58.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628997+0000", 2024-09-17T02:21:58.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3579000000000003e-05 2024-09-17T02:21:58.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:58.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.629006+0000", 2024-09-17T02:21:58.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4009999999999997e-06 2024-09-17T02:21:58.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.577862+0000", 2024-09-17T02:21:58.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.948856335 2024-09-17T02:21:58.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:58.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578167+0000", 2024-09-17T02:21:58.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030532399999999999 2024-09-17T02:21:58.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:58.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578532+0000", 2024-09-17T02:21:58.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036428200000000001 2024-09-17T02:21:58.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:58.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591442+0000", 2024-09-17T02:21:58.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012910374000000001 2024-09-17T02:21:58.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592164+0000", 2024-09-17T02:21:58.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072242499999999996 2024-09-17T02:21:58.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:58.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592267+0000", 2024-09-17T02:21:58.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102205 2024-09-17T02:21:58.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:58.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592438+0000", 2024-09-17T02:21:58.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017165299999999999 2024-09-17T02:21:58.147 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.147 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:58.147 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.147 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129623 5.4 5:2cf5174b:::benchmark_data_smithi001_23533_object1506:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:58.147 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:21:58.148 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.383294332999998, 2024-09-17T02:21:58.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94334114499999999, 2024-09-17T02:21:58.148 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:58.148 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:58.148 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.148 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:58.148 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:58.148 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.148 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129623 2024-09-17T02:21:58.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.148 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:58.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:58.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:21:58.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:58.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:21:58.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:58.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652860+0000", 2024-09-17T02:21:58.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0330000000000001e-06 2024-09-17T02:21:58.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:58.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652864+0000", 2024-09-17T02:21:58.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.634e-06 2024-09-17T02:21:58.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:58.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652877+0000", 2024-09-17T02:21:58.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2591e-05 2024-09-17T02:21:58.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652883+0000", 2024-09-17T02:21:58.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1460000000000001e-06 2024-09-17T02:21:58.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652943+0000", 2024-09-17T02:21:58.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9833999999999997e-05 2024-09-17T02:21:58.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:58.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652950+0000", 2024-09-17T02:21:58.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.401e-06 2024-09-17T02:21:58.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581800+0000", 2024-09-17T02:21:58.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.92884935700000004 2024-09-17T02:21:58.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:58.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582122+0000", 2024-09-17T02:21:58.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032185200000000002 2024-09-17T02:21:58.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:58.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582689+0000", 2024-09-17T02:21:58.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056750400000000003 2024-09-17T02:21:58.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:58.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591458+0000", 2024-09-17T02:21:58.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008768685 2024-09-17T02:21:58.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595856+0000", 2024-09-17T02:21:58.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043977909999999999 2024-09-17T02:21:58.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:58.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595955+0000", 2024-09-17T02:21:58.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9166000000000006e-05 2024-09-17T02:21:58.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:58.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596200+0000", 2024-09-17T02:21:58.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024515099999999998 2024-09-17T02:21:58.154 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.154 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:58.154 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.154 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129642 5.4 5:255eb796:::benchmark_data_smithi001_23533_object1525:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:58.154 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:21:58.154 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.352058168999999, 2024-09-17T02:21:58.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.91257397299999998, 2024-09-17T02:21:58.155 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:58.155 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:58.155 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.155 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:58.155 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:58.155 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.155 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129642 2024-09-17T02:21:58.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.155 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:58.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:58.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:21:58.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:58.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:21:58.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:58.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684096+0000", 2024-09-17T02:21:58.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659999999999999e-06 2024-09-17T02:21:58.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:58.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684101+0000", 2024-09-17T02:21:58.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8110000000000002e-06 2024-09-17T02:21:58.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:58.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684114+0000", 2024-09-17T02:21:58.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2653000000000001e-05 2024-09-17T02:21:58.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684121+0000", 2024-09-17T02:21:58.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5100000000000001e-06 2024-09-17T02:21:58.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684181+0000", 2024-09-17T02:21:58.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0307999999999999e-05 2024-09-17T02:21:58.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:58.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684194+0000", 2024-09-17T02:21:58.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2916e-05 2024-09-17T02:21:58.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.587917+0000", 2024-09-17T02:21:58.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.90372220400000003 2024-09-17T02:21:58.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:58.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588215+0000", 2024-09-17T02:21:58.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029845400000000003 2024-09-17T02:21:58.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:58.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588470+0000", 2024-09-17T02:21:58.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025455399999999999 2024-09-17T02:21:58.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596318+0000", 2024-09-17T02:21:58.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078485589999999997 2024-09-17T02:21:58.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:58.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596354+0000", 2024-09-17T02:21:58.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5976999999999998e-05 2024-09-17T02:21:58.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:58.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596449+0000", 2024-09-17T02:21:58.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4728999999999994e-05 2024-09-17T02:21:58.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:58.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596669+0000", 2024-09-17T02:21:58.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220132 2024-09-17T02:21:58.161 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.161 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:58.161 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.161 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129649 5.4 5:2fe27050:::benchmark_data_smithi001_23533_object1532:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:58.161 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:21:58.161 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.320501426, 2024-09-17T02:21:58.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.88508119100000004, 2024-09-17T02:21:58.161 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:58.161 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:58.162 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.162 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:58.162 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:58.162 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.162 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129649 2024-09-17T02:21:58.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.162 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:58.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:58.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:21:58.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:58.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:21:58.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:58.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:58.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715653+0000", 2024-09-17T02:21:58.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3519999999999999e-06 2024-09-17T02:21:58.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:58.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715658+0000", 2024-09-17T02:21:58.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3120000000000001e-06 2024-09-17T02:21:58.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:58.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715677+0000", 2024-09-17T02:21:58.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-17T02:21:58.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715687+0000", 2024-09-17T02:21:58.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0146000000000001e-05 2024-09-17T02:21:58.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715821+0000", 2024-09-17T02:21:58.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013421 2024-09-17T02:21:58.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:58.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715840+0000", 2024-09-17T02:21:58.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8153999999999999e-05 2024-09-17T02:21:58.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:58.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592528+0000", 2024-09-17T02:21:58.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.87668860000000004 2024-09-17T02:21:58.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:58.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592702+0000", 2024-09-17T02:21:58.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017429300000000001 2024-09-17T02:21:58.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:58.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592945+0000", 2024-09-17T02:21:58.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000242048 2024-09-17T02:21:58.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:21:58.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600234+0000", 2024-09-17T02:21:58.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072897600000000002 2024-09-17T02:21:58.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600494+0000", 2024-09-17T02:21:58.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000259984 2024-09-17T02:21:58.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:21:58.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600555+0000", 2024-09-17T02:21:58.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1138999999999999e-05 2024-09-17T02:21:58.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:58.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:58.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:21:58.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600733+0000", 2024-09-17T02:21:58.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017753300000000001 2024-09-17T02:21:58.167 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.167 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:58.167 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.167 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:58.168 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:58.168 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:58.169 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:58.169+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:58.169 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:58.270 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:58.269+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:58.333 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:58.334 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:58.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.334 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:178263 5.1 5:8c005423:::benchmark_data_smithi001_23533_object50146:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T02:21:58.334 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:58.331478+0000", 2024-09-17T02:21:58.334 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0058491849999999998, 2024-09-17T02:21:58.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058745510000000004, 2024-09-17T02:21:58.334 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.334 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.334 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:58.334 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:58.334 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:58.334 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.335 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 178263 2024-09-17T02:21:58.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.335 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.331478+0000", 2024-09-17T02:21:58.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.331478+0000", 2024-09-17T02:21:58.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.331479+0000", 2024-09-17T02:21:58.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6599999999999995e-07 2024-09-17T02:21:58.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.331482+0000", 2024-09-17T02:21:58.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9790000000000002e-06 2024-09-17T02:21:58.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.331501+0000", 2024-09-17T02:21:58.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8691000000000001e-05 2024-09-17T02:21:58.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.331508+0000", 2024-09-17T02:21:58.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.097e-06 2024-09-17T02:21:58.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.333530+0000", 2024-09-17T02:21:58.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020226380000000002 2024-09-17T02:21:58.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.333645+0000", 2024-09-17T02:21:58.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000114603 2024-09-17T02:21:58.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:58.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.333752+0000", 2024-09-17T02:21:58.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010696099999999999 2024-09-17T02:21:58.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:58.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.337335+0000", 2024-09-17T02:21:58.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035831750000000001 2024-09-17T02:21:58.338 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.339 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.339 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.339 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:178264 5.6 5:62d119a1:::benchmark_data_smithi001_23533_object50147:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T02:21:58.339 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:58.331606+0000", 2024-09-17T02:21:58.339 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.005720999, 2024-09-17T02:21:58.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058261789999999999, 2024-09-17T02:21:58.339 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.339 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.339 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:58.339 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:58.339 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:58.340 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.340 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 178264 2024-09-17T02:21:58.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.340 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.331606+0000", 2024-09-17T02:21:58.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.331606+0000", 2024-09-17T02:21:58.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.331607+0000", 2024-09-17T02:21:58.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8199999999999999e-07 2024-09-17T02:21:58.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.331613+0000", 2024-09-17T02:21:58.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5459999999999999e-06 2024-09-17T02:21:58.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.331622+0000", 2024-09-17T02:21:58.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5780000000000005e-06 2024-09-17T02:21:58.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.331629+0000", 2024-09-17T02:21:58.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6760000000000001e-06 2024-09-17T02:21:58.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.332037+0000", 2024-09-17T02:21:58.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00040779400000000001 2024-09-17T02:21:58.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.332164+0000", 2024-09-17T02:21:58.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000126883 2024-09-17T02:21:58.343 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.343 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.343 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.343 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:178265 5.a 5:511c8093:::benchmark_data_smithi001_23533_object50148:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T02:21:58.343 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:58.331868+0000", 2024-09-17T02:21:58.343 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.005459546, 2024-09-17T02:21:58.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056029879999999997, 2024-09-17T02:21:58.343 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.343 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.344 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:58.344 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:58.344 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:58.344 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.344 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 178265 2024-09-17T02:21:58.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.344 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.331868+0000", 2024-09-17T02:21:58.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.331868+0000", 2024-09-17T02:21:58.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.331869+0000", 2024-09-17T02:21:58.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1900000000000002e-07 2024-09-17T02:21:58.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.331872+0000", 2024-09-17T02:21:58.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4659999999999999e-06 2024-09-17T02:21:58.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.331882+0000", 2024-09-17T02:21:58.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0155e-05 2024-09-17T02:21:58.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.331888+0000", 2024-09-17T02:21:58.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7409999999999998e-06 2024-09-17T02:21:58.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.332042+0000", 2024-09-17T02:21:58.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015425200000000001 2024-09-17T02:21:58.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.332453+0000", 2024-09-17T02:21:58.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00041086399999999999 2024-09-17T02:21:58.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:58.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.332554+0000", 2024-09-17T02:21:58.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100566 2024-09-17T02:21:58.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.336946+0000", 2024-09-17T02:21:58.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004392366 2024-09-17T02:21:58.348 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.348 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.348 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.348 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:178266 5.5 5:aeb03ae6:::benchmark_data_smithi001_23533_object50149:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T02:21:58.348 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:58.332171+0000", 2024-09-17T02:21:58.348 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0051563709999999999, 2024-09-17T02:21:58.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053552399999999998, 2024-09-17T02:21:58.348 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.348 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.348 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:58.348 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:58.349 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:58.349 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.349 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 178266 2024-09-17T02:21:58.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.349 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.332171+0000", 2024-09-17T02:21:58.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.332171+0000", 2024-09-17T02:21:58.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.332172+0000", 2024-09-17T02:21:58.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9100000000000003e-07 2024-09-17T02:21:58.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.332178+0000", 2024-09-17T02:21:58.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2859999999999996e-06 2024-09-17T02:21:58.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.332189+0000", 2024-09-17T02:21:58.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0538e-05 2024-09-17T02:21:58.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.332195+0000", 2024-09-17T02:21:58.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2700000000000001e-06 2024-09-17T02:21:58.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.333033+0000", 2024-09-17T02:21:58.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00083839299999999999 2024-09-17T02:21:58.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.333163+0000", 2024-09-17T02:21:58.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013000800000000001 2024-09-17T02:21:58.352 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.352 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.352 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.352 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:178267 5.5 5:ace4c8e4:::benchmark_data_smithi001_23533_object50150:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T02:21:58.352 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:58.333685+0000", 2024-09-17T02:21:58.352 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0036428300000000001, 2024-09-17T02:21:58.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038843329999999998, 2024-09-17T02:21:58.352 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.352 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.353 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:58.353 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:58.353 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:58.353 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.353 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 178267 2024-09-17T02:21:58.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.353 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.333685+0000", 2024-09-17T02:21:58.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.333685+0000", 2024-09-17T02:21:58.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.333685+0000", 2024-09-17T02:21:58.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1999999999999998e-07 2024-09-17T02:21:58.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.333690+0000", 2024-09-17T02:21:58.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4379999999999997e-06 2024-09-17T02:21:58.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.333698+0000", 2024-09-17T02:21:58.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2749999999999995e-06 2024-09-17T02:21:58.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.333705+0000", 2024-09-17T02:21:58.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7460000000000003e-06 2024-09-17T02:21:58.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.335414+0000", 2024-09-17T02:21:58.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017087719999999999 2024-09-17T02:21:58.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.335521+0000", 2024-09-17T02:21:58.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107404 2024-09-17T02:21:58.356 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.356 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.356 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.356 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:178269 5.4 e60/52 5:285c3744:::benchmark_data_smithi001_23533_object50152:head v 60'10960, mlcod=60'10957)", 2024-09-17T02:21:58.356 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:58.334841+0000", 2024-09-17T02:21:58.356 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0024864409999999998, 2024-09-17T02:21:58.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027683349999999998, 2024-09-17T02:21:58.356 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.357 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.357 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:58.357 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.334841+0000", 2024-09-17T02:21:58.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.334841+0000", 2024-09-17T02:21:58.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.334841+0000", 2024-09-17T02:21:58.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-07 2024-09-17T02:21:58.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.334846+0000", 2024-09-17T02:21:58.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6650000000000002e-06 2024-09-17T02:21:58.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.334853+0000", 2024-09-17T02:21:58.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1149999999999996e-06 2024-09-17T02:21:58.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.334857+0000", 2024-09-17T02:21:58.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4490000000000001e-06 2024-09-17T02:21:58.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.335199+0000", 2024-09-17T02:21:58.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034174100000000001 2024-09-17T02:21:58.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.335212+0000", 2024-09-17T02:21:58.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2843000000000001e-05 2024-09-17T02:21:58.360 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.360 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.360 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.360 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:178268 5.2 5:4b1d2090:::benchmark_data_smithi001_23533_object50151:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T02:21:58.360 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:58.334917+0000", 2024-09-17T02:21:58.360 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.002410728, 2024-09-17T02:21:58.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027327409999999999, 2024-09-17T02:21:58.360 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.360 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.360 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:58.360 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:58.361 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:58.361 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.361 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 178268 2024-09-17T02:21:58.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.361 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.334917+0000", 2024-09-17T02:21:58.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.334917+0000", 2024-09-17T02:21:58.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.334917+0000", 2024-09-17T02:21:58.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.68e-07 2024-09-17T02:21:58.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.334920+0000", 2024-09-17T02:21:58.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.005e-06 2024-09-17T02:21:58.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.334929+0000", 2024-09-17T02:21:58.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5390000000000007e-06 2024-09-17T02:21:58.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.334935+0000", 2024-09-17T02:21:58.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8150000000000002e-06 2024-09-17T02:21:58.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.335063+0000", 2024-09-17T02:21:58.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012797700000000001 2024-09-17T02:21:58.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.335177+0000", 2024-09-17T02:21:58.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000114672 2024-09-17T02:21:58.364 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.364 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.364 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.364 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:178272 5.a 5:5291ebcd:::benchmark_data_smithi001_23533_object50155:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T02:21:58.364 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:58.335310+0000", 2024-09-17T02:21:58.364 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0020172620000000001, 2024-09-17T02:21:58.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023755970000000001, 2024-09-17T02:21:58.364 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.365 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.365 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:58.365 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:58.365 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:58.365 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.365 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 178272 2024-09-17T02:21:58.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.365 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.335310+0000", 2024-09-17T02:21:58.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.335310+0000", 2024-09-17T02:21:58.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.335311+0000", 2024-09-17T02:21:58.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5300000000000003e-07 2024-09-17T02:21:58.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.335315+0000", 2024-09-17T02:21:58.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9450000000000003e-06 2024-09-17T02:21:58.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.335325+0000", 2024-09-17T02:21:58.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0463e-05 2024-09-17T02:21:58.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.335332+0000", 2024-09-17T02:21:58.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.199e-06 2024-09-17T02:21:58.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.336973+0000", 2024-09-17T02:21:58.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001640772 2024-09-17T02:21:58.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.337089+0000", 2024-09-17T02:21:58.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000115456 2024-09-17T02:21:58.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:58.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.337196+0000", 2024-09-17T02:21:58.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107433 2024-09-17T02:21:58.368 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.368 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.368 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.369 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:178273 5.3 5:c82fc6ff:::benchmark_data_smithi001_23533_object50156:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T02:21:58.369 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:58.335343+0000", 2024-09-17T02:21:58.369 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0019839509999999999, 2024-09-17T02:21:58.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023974690000000002, 2024-09-17T02:21:58.369 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.369 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.369 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:58.369 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:58.369 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:58.369 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.369 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 178273 2024-09-17T02:21:58.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.370 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.335343+0000", 2024-09-17T02:21:58.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.335343+0000", 2024-09-17T02:21:58.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.335344+0000", 2024-09-17T02:21:58.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0999999999999999e-07 2024-09-17T02:21:58.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.335346+0000", 2024-09-17T02:21:58.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5670000000000002e-06 2024-09-17T02:21:58.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.335352+0000", 2024-09-17T02:21:58.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9880000000000001e-06 2024-09-17T02:21:58.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.335357+0000", 2024-09-17T02:21:58.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.865e-06 2024-09-17T02:21:58.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.337518+0000", 2024-09-17T02:21:58.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002161161 2024-09-17T02:21:58.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.337691+0000", 2024-09-17T02:21:58.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017247399999999999 2024-09-17T02:21:58.373 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.373 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.373 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.373 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:178275 5.b e60/51 5:d9a3e8ae:::benchmark_data_smithi001_23533_object50158:head v 60'11015, mlcod=60'11013)", 2024-09-17T02:21:58.373 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:58.336006+0000", 2024-09-17T02:21:58.373 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001321364, 2024-09-17T02:21:58.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018024130000000001, 2024-09-17T02:21:58.373 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.373 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.373 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:21:58.373 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.336006+0000", 2024-09-17T02:21:58.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.336006+0000", 2024-09-17T02:21:58.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.336007+0000", 2024-09-17T02:21:58.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3099999999999997e-07 2024-09-17T02:21:58.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.336011+0000", 2024-09-17T02:21:58.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5920000000000002e-06 2024-09-17T02:21:58.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.336019+0000", 2024-09-17T02:21:58.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5179999999999998e-06 2024-09-17T02:21:58.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.336024+0000", 2024-09-17T02:21:58.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4330000000000003e-06 2024-09-17T02:21:58.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.336225+0000", 2024-09-17T02:21:58.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020091900000000001 2024-09-17T02:21:58.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.336243+0000", 2024-09-17T02:21:58.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7476999999999999e-05 2024-09-17T02:21:58.376 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.376 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.376 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.377 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:178277 5.3 5.d6608143 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T02:21:58.377 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:58.337187+0000", 2024-09-17T02:21:58.377 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00014044599999999999, 2024-09-17T02:21:58.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00068062000000000005, 2024-09-17T02:21:58.377 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.377 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.377 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:58.377 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:58.377 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:58.377 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.377 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 178277 2024-09-17T02:21:58.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.378 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.337187+0000", 2024-09-17T02:21:58.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.337187+0000", 2024-09-17T02:21:58.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.337188+0000", 2024-09-17T02:21:58.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.02e-06 2024-09-17T02:21:58.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.337193+0000", 2024-09-17T02:21:58.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6129999999999997e-06 2024-09-17T02:21:58.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.337204+0000", 2024-09-17T02:21:58.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1272e-05 2024-09-17T02:21:58.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.337212+0000", 2024-09-17T02:21:58.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7710000000000006e-06 2024-09-17T02:21:58.380 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.380 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.380 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.380 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "MOSDPGPushReply(5.3 60/51 [PushReplyOp(5:cc37a7b0:::benchmark_data_smithi001_23533_object54307:head)])", 2024-09-17T02:21:58.380 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:58.337728+0000", 2024-09-17T02:21:58.380 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9995995, 2024-09-17T02:21:58.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000185649, 2024-09-17T02:21:58.380 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.381 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.381 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:21:58.381 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.337728+0000", 2024-09-17T02:21:58.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.337728+0000", 2024-09-17T02:21:58.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.337728+0000", 2024-09-17T02:21:58.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3900000000000001e-07 2024-09-17T02:21:58.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.337731+0000", 2024-09-17T02:21:58.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1329999999999999e-06 2024-09-17T02:21:58.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.337738+0000", 2024-09-17T02:21:58.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6660000000000002e-06 2024-09-17T02:21:58.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:58.337745+0000", 2024-09-17T02:21:58.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3610000000000003e-06 2024-09-17T02:21:58.383 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.383 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.383 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.383 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.383 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:21:58.383 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 12 2024-09-17T02:21:58.383 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:58.385 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:58.385 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:58.385+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:58.485 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:58.488+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:58.581 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:58.581 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:21:58.581 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:21:58.582 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:21:58.582 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:58.589 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:58.585+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:58.600 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:58.688 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:58.689+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:58.788 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:58.792+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:58.802 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:21:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:21:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:21:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:21:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 76.237027155000007, 2024-09-17T02:21:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:21:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:21:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:21:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:21:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:21:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:21:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:21:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:21:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:21:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:21:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:21:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:21:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:21:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:21:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:21:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:21:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:21:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:21:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:21:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:21:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:21:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:21:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:21:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:21:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:21:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 76.233124904999997, 2024-09-17T02:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:21:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:21:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:21:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:21:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:21:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:21:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:21:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:21:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:21:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:21:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:21:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:21:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:21:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:21:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:21:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:21:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:21:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:21:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71206 5.3 e39/38 5:c6c9386d:::benchmark_data_smithi001_23533_object71205:head v 39'4517, mlcod=35'4513)", 2024-09-17T02:21:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 54.19579779, 2024-09-17T02:21:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026101868, 2024-09-17T02:21:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:21:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609694+0000", 2024-09-17T02:21:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9539999999999998e-06 2024-09-17T02:21:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609841+0000", 2024-09-17T02:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014690800000000001 2024-09-17T02:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609872+0000", 2024-09-17T02:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0326000000000001e-05 2024-09-17T02:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609892+0000", 2024-09-17T02:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9848999999999999e-05 2024-09-17T02:21:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613826+0000", 2024-09-17T02:21:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039345140000000001 2024-09-17T02:21:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613908+0000", 2024-09-17T02:21:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2412999999999999e-05 2024-09-17T02:21:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635696+0000", 2024-09-17T02:21:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021787597999999998 2024-09-17T02:21:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635794+0000", 2024-09-17T02:21:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8306000000000004e-05 2024-09-17T02:21:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97151 5.5 5:a0c2c072:::benchmark_data_smithi001_23533_object97150:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 41.537118182999997, 2024-09-17T02:21:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027297614000000001, 2024-09-17T02:21:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97151 2024-09-17T02:21:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:21:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268373+0000", 2024-09-17T02:21:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4000000000000002e-07 2024-09-17T02:21:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268423+0000", 2024-09-17T02:21:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0175e-05 2024-09-17T02:21:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268428+0000", 2024-09-17T02:21:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-17T02:21:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268431+0000", 2024-09-17T02:21:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.179e-06 2024-09-17T02:21:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283631+0000", 2024-09-17T02:21:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015199691 2024-09-17T02:21:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283740+0000", 2024-09-17T02:21:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109305 2024-09-17T02:21:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283863+0000", 2024-09-17T02:21:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012226699999999999 2024-09-17T02:21:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290857+0000", 2024-09-17T02:21:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069945449999999996 2024-09-17T02:21:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295595+0000", 2024-09-17T02:21:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047376750000000002 2024-09-17T02:21:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295638+0000", 2024-09-17T02:21:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3671999999999998e-05 2024-09-17T02:21:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295670+0000", 2024-09-17T02:21:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1266000000000002e-05 2024-09-17T02:21:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97759 5.a 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 41.207105081999998, 2024-09-17T02:21:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.089694871999999995, 2024-09-17T02:21:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97759 2024-09-17T02:21:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:21:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598386+0000", 2024-09-17T02:21:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999999e-07 2024-09-17T02:21:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598414+0000", 2024-09-17T02:21:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8013000000000001e-05 2024-09-17T02:21:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598420+0000", 2024-09-17T02:21:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1149999999999999e-06 2024-09-17T02:21:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598424+0000", 2024-09-17T02:21:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:21:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598479+0000", 2024-09-17T02:21:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4648999999999998e-05 2024-09-17T02:21:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598587+0000", 2024-09-17T02:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010853000000000001 2024-09-17T02:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598676+0000", 2024-09-17T02:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8381999999999995e-05 2024-09-17T02:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603766+0000", 2024-09-17T02:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050902559999999996 2024-09-17T02:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.687988+0000", 2024-09-17T02:21:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.084221753999999996 2024-09-17T02:21:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688037+0000", 2024-09-17T02:21:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-05 2024-09-17T02:21:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688080+0000", 2024-09-17T02:21:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3149999999999999e-05 2024-09-17T02:21:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97770 5.0 5:09c75033:::benchmark_data_smithi001_23533_object97769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:21:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 41.201962651999999, 2024-09-17T02:21:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.086380868, 2024-09-17T02:21:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97770 2024-09-17T02:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603529+0000", 2024-09-17T02:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603593+0000", 2024-09-17T02:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4216999999999999e-05 2024-09-17T02:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603603+0000", 2024-09-17T02:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5179999999999993e-06 2024-09-17T02:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603608+0000", 2024-09-17T02:21:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2039999999999996e-06 2024-09-17T02:21:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603653+0000", 2024-09-17T02:21:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5247000000000002e-05 2024-09-17T02:21:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603758+0000", 2024-09-17T02:21:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105352 2024-09-17T02:21:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603900+0000", 2024-09-17T02:21:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014198999999999999 2024-09-17T02:21:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.606097+0000", 2024-09-17T02:21:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021969839999999999 2024-09-17T02:21:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689756+0000", 2024-09-17T02:21:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.083659077999999998 2024-09-17T02:21:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689846+0000", 2024-09-17T02:21:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9320999999999994e-05 2024-09-17T02:21:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689908+0000", 2024-09-17T02:21:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720999999999998e-05 2024-09-17T02:21:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127513 5.c 5:3eca08e4:::benchmark_data_smithi001_23533_object127512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:21:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.361186228000001, 2024-09-17T02:21:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046626399999999998, 2024-09-17T02:21:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127513 2024-09-17T02:21:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:21:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:21:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444305+0000", 2024-09-17T02:21:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2529999999999999e-06 2024-09-17T02:21:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444466+0000", 2024-09-17T02:21:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016069700000000001 2024-09-17T02:21:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444479+0000", 2024-09-17T02:21:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2602999999999999e-05 2024-09-17T02:21:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444485+0000", 2024-09-17T02:21:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.669e-06 2024-09-17T02:21:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444560+0000", 2024-09-17T02:21:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4276999999999994e-05 2024-09-17T02:21:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444656+0000", 2024-09-17T02:21:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6490000000000006e-05 2024-09-17T02:21:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444739+0000", 2024-09-17T02:21:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3139999999999993e-05 2024-09-17T02:21:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.448438+0000", 2024-09-17T02:21:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036985490000000002 2024-09-17T02:21:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490732+0000", 2024-09-17T02:21:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042294353999999999 2024-09-17T02:21:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490859+0000", 2024-09-17T02:21:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012708899999999999 2024-09-17T02:21:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490930+0000", 2024-09-17T02:21:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:21:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127514 5.c 5:39cc1feb:::benchmark_data_smithi001_23533_object127513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:21:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.360989458999999, 2024-09-17T02:21:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049357228000000003, 2024-09-17T02:21:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127514 2024-09-17T02:21:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:21:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8599999999999998e-07 2024-09-17T02:21:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444554+0000", 2024-09-17T02:21:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3047999999999998e-05 2024-09-17T02:21:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444562+0000", 2024-09-17T02:21:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5830000000000001e-06 2024-09-17T02:21:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444567+0000", 2024-09-17T02:21:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4179999999999996e-06 2024-09-17T02:21:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446566+0000", 2024-09-17T02:21:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001998788 2024-09-17T02:21:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446696+0000", 2024-09-17T02:21:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129393 2024-09-17T02:21:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:21:58.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446794+0000", 2024-09-17T02:21:58.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8462999999999996e-05 2024-09-17T02:21:58.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:58.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.449036+0000", 2024-09-17T02:21:58.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022415880000000001 2024-09-17T02:21:58.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493737+0000", 2024-09-17T02:21:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044701682 2024-09-17T02:21:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493808+0000", 2024-09-17T02:21:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0846000000000006e-05 2024-09-17T02:21:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493858+0000", 2024-09-17T02:21:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9932999999999998e-05 2024-09-17T02:21:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129441 5.1 5:84c3199f:::benchmark_data_smithi001_23533_object1324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:21:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.301978971, 2024-09-17T02:21:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034387011000000002, 2024-09-17T02:21:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129441 2024-09-17T02:21:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:21:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:21:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503513+0000", 2024-09-17T02:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4759999999999999e-06 2024-09-17T02:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503518+0000", 2024-09-17T02:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-09-17T02:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503532+0000", 2024-09-17T02:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4049999999999999e-05 2024-09-17T02:21:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503541+0000", 2024-09-17T02:21:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5320000000000006e-06 2024-09-17T02:21:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506331+0000", 2024-09-17T02:21:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027899190000000001 2024-09-17T02:21:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506402+0000", 2024-09-17T02:21:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:21:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506477+0000", 2024-09-17T02:21:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4626e-05 2024-09-17T02:21:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509749+0000", 2024-09-17T02:21:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032726980000000001 2024-09-17T02:21:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537758+0000", 2024-09-17T02:21:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028008890000000002 2024-09-17T02:21:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537812+0000", 2024-09-17T02:21:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3300000000000001e-05 2024-09-17T02:21:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537898+0000", 2024-09-17T02:21:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6691000000000001e-05 2024-09-17T02:21:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129442 5.1 5:8f7f2a95:::benchmark_data_smithi001_23533_object1325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:21:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.299008361999999, 2024-09-17T02:21:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031546698999999997, 2024-09-17T02:21:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129442 2024-09-17T02:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506483+0000", 2024-09-17T02:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2869999999999999e-06 2024-09-17T02:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506489+0000", 2024-09-17T02:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2330000000000003e-06 2024-09-17T02:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506502+0000", 2024-09-17T02:21:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2286999999999999e-05 2024-09-17T02:21:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506511+0000", 2024-09-17T02:21:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7799999999999995e-06 2024-09-17T02:21:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.507966+0000", 2024-09-17T02:21:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014541549999999999 2024-09-17T02:21:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508130+0000", 2024-09-17T02:21:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016455199999999999 2024-09-17T02:21:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508287+0000", 2024-09-17T02:21:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015730400000000001 2024-09-17T02:21:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510577+0000", 2024-09-17T02:21:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022899449999999998 2024-09-17T02:21:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537932+0000", 2024-09-17T02:21:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027354471000000002 2024-09-17T02:21:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537964+0000", 2024-09-17T02:21:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1909999999999998e-05 2024-09-17T02:21:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.538029+0000", 2024-09-17T02:21:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4775000000000002e-05 2024-09-17T02:21:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129443 5.8 5:1edfeaf8:::benchmark_data_smithi001_23533_object1326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:21:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:21:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.295573862000001, 2024-09-17T02:21:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025315902000000001, 2024-09-17T02:21:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129443 2024-09-17T02:21:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:21:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:21:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509918+0000", 2024-09-17T02:21:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3689999999999999e-06 2024-09-17T02:21:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509923+0000", 2024-09-17T02:21:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0429999999999998e-06 2024-09-17T02:21:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509936+0000", 2024-09-17T02:21:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3234000000000001e-05 2024-09-17T02:21:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509950+0000", 2024-09-17T02:21:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3998999999999999e-05 2024-09-17T02:21:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509994+0000", 2024-09-17T02:21:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4323000000000002e-05 2024-09-17T02:21:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510095+0000", 2024-09-17T02:21:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010103300000000001 2024-09-17T02:21:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510160+0000", 2024-09-17T02:21:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4976999999999998e-05 2024-09-17T02:21:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.513304+0000", 2024-09-17T02:21:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031431330000000002 2024-09-17T02:21:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535046+0000", 2024-09-17T02:21:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021742276000000001 2024-09-17T02:21:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:21:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107759 2024-09-17T02:21:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535232+0000", 2024-09-17T02:21:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8756000000000003e-05 2024-09-17T02:21:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:138247 5.3 5:caf01f60:::benchmark_data_smithi001_23533_object10130:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.335014+0000", 2024-09-17T02:21:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.470476289, 2024-09-17T02:21:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026419469000000001, 2024-09-17T02:21:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 138247 2024-09-17T02:21:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335014+0000", 2024-09-17T02:21:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335014+0000", 2024-09-17T02:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335015+0000", 2024-09-17T02:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3600000000000004e-07 2024-09-17T02:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335017+0000", 2024-09-17T02:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5749999999999999e-06 2024-09-17T02:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335024+0000", 2024-09-17T02:21:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8379999999999996e-06 2024-09-17T02:21:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335029+0000", 2024-09-17T02:21:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.22e-06 2024-09-17T02:21:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335083+0000", 2024-09-17T02:21:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3600000000000002e-05 2024-09-17T02:21:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335229+0000", 2024-09-17T02:21:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000146098 2024-09-17T02:21:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335349+0000", 2024-09-17T02:21:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120631 2024-09-17T02:21:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.357942+0000", 2024-09-17T02:21:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022592457 2024-09-17T02:21:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.361286+0000", 2024-09-17T02:21:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003343623 2024-09-17T02:21:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.361338+0000", 2024-09-17T02:21:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2323e-05 2024-09-17T02:21:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.361433+0000", 2024-09-17T02:21:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5568000000000004e-05 2024-09-17T02:21:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:138244 5.b e54/51 5:d38c94c4:::benchmark_data_smithi001_23533_object10127:head v 54'8567, mlcod=54'8564)", 2024-09-17T02:21:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.336586+0000", 2024-09-17T02:21:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.468903899000001, 2024-09-17T02:21:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026602741999999999, 2024-09-17T02:21:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336586+0000", 2024-09-17T02:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336586+0000", 2024-09-17T02:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336587+0000", 2024-09-17T02:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0600000000000001e-07 2024-09-17T02:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336590+0000", 2024-09-17T02:21:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3110000000000001e-06 2024-09-17T02:21:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336597+0000", 2024-09-17T02:21:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0639999999999996e-06 2024-09-17T02:21:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336602+0000", 2024-09-17T02:21:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3599999999999998e-06 2024-09-17T02:21:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336645+0000", 2024-09-17T02:21:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3628999999999999e-05 2024-09-17T02:21:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336666+0000", 2024-09-17T02:21:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0604000000000001e-05 2024-09-17T02:21:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363143+0000", 2024-09-17T02:21:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026477055999999999 2024-09-17T02:21:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363189+0000", 2024-09-17T02:21:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6312e-05 2024-09-17T02:21:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:138259 5.3 5:c08b4023:::benchmark_data_smithi001_23533_object10142:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.337063+0000", 2024-09-17T02:21:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.468427081000002, 2024-09-17T02:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027773173000000002, 2024-09-17T02:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 138259 2024-09-17T02:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337063+0000", 2024-09-17T02:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337063+0000", 2024-09-17T02:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337064+0000", 2024-09-17T02:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-17T02:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337066+0000", 2024-09-17T02:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.03e-06 2024-09-17T02:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337072+0000", 2024-09-17T02:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5119999999999997e-06 2024-09-17T02:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337077+0000", 2024-09-17T02:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.454e-06 2024-09-17T02:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.352990+0000", 2024-09-17T02:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015913116000000001 2024-09-17T02:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.353136+0000", 2024-09-17T02:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000146117 2024-09-17T02:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.353253+0000", 2024-09-17T02:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117359 2024-09-17T02:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.358284+0000", 2024-09-17T02:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050306689999999998 2024-09-17T02:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.364738+0000", 2024-09-17T02:21:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064539410000000004 2024-09-17T02:21:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.364768+0000", 2024-09-17T02:21:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0086999999999998e-05 2024-09-17T02:21:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.364836+0000", 2024-09-17T02:21:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8549999999999999e-05 2024-09-17T02:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:138249 5.b e54/51 5:dcbad32d:::benchmark_data_smithi001_23533_object10132:head v 54'8568, mlcod=54'8564)", 2024-09-17T02:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.338016+0000", 2024-09-17T02:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.467474741, 2024-09-17T02:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025210803, 2024-09-17T02:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338016+0000", 2024-09-17T02:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338016+0000", 2024-09-17T02:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338017+0000", 2024-09-17T02:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.28e-06 2024-09-17T02:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338022+0000", 2024-09-17T02:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0950000000000003e-06 2024-09-17T02:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338032+0000", 2024-09-17T02:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7140000000000005e-06 2024-09-17T02:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338038+0000", 2024-09-17T02:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1029999999999998e-06 2024-09-17T02:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.349300+0000", 2024-09-17T02:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01126216 2024-09-17T02:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.349359+0000", 2024-09-17T02:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9206999999999997e-05 2024-09-17T02:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363192+0000", 2024-09-17T02:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013833253 2024-09-17T02:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363226+0000", 2024-09-17T02:21:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3991e-05 2024-09-17T02:21:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:139587 5.1 5:801d98ef:::benchmark_data_smithi001_23533_object11470:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.931670+0000", 2024-09-17T02:21:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.873820001999999, 2024-09-17T02:21:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025666268999999999, 2024-09-17T02:21:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 139587 2024-09-17T02:21:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931670+0000", 2024-09-17T02:21:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931670+0000", 2024-09-17T02:21:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931671+0000", 2024-09-17T02:21:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.034e-06 2024-09-17T02:21:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931677+0000", 2024-09-17T02:21:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4580000000000001e-06 2024-09-17T02:21:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931690+0000", 2024-09-17T02:21:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3152999999999999e-05 2024-09-17T02:21:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931699+0000", 2024-09-17T02:21:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3100000000000006e-06 2024-09-17T02:21:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931779+0000", 2024-09-17T02:21:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0284000000000006e-05 2024-09-17T02:21:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931968+0000", 2024-09-17T02:21:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018853399999999999 2024-09-17T02:21:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.932149+0000", 2024-09-17T02:21:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018114699999999999 2024-09-17T02:21:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.935163+0000", 2024-09-17T02:21:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030143169999999999 2024-09-17T02:21:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.957199+0000", 2024-09-17T02:21:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022035255 2024-09-17T02:21:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.957247+0000", 2024-09-17T02:21:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8319999999999998e-05 2024-09-17T02:21:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.957337+0000", 2024-09-17T02:21:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9456999999999994e-05 2024-09-17T02:21:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:140178 5.1 5:8f77d9ee:::benchmark_data_smithi001_23533_object12061:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:21:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:21:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.618034511000001, 2024-09-17T02:21:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025269478000000001, 2024-09-17T02:21:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 140178 2024-09-17T02:21:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:21:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:21:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:21:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0500000000000004e-07 2024-09-17T02:21:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187459+0000", 2024-09-17T02:21:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5299999999999999e-06 2024-09-17T02:21:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187468+0000", 2024-09-17T02:21:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3130000000000004e-06 2024-09-17T02:21:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187473+0000", 2024-09-17T02:21:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-09-17T02:21:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.192476+0000", 2024-09-17T02:21:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050035339999999996 2024-09-17T02:21:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.192603+0000", 2024-09-17T02:21:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012652299999999999 2024-09-17T02:21:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.192719+0000", 2024-09-17T02:21:58.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011568700000000001 2024-09-17T02:21:58.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:58.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.196336+0000", 2024-09-17T02:21:58.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003617178 2024-09-17T02:21:58.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.212470+0000", 2024-09-17T02:21:58.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016134402999999999 2024-09-17T02:21:58.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:58.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.212522+0000", 2024-09-17T02:21:58.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1480000000000002e-05 2024-09-17T02:21:58.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:58.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.212725+0000", 2024-09-17T02:21:58.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020359100000000001 2024-09-17T02:21:58.904 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.904 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.904 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:150456 5.2 5:4ee9ae1c:::benchmark_data_smithi001_23533_object22339:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.838305+0000", 2024-09-17T02:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.967185284999999, 2024-09-17T02:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026350045999999998, 2024-09-17T02:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 150456 2024-09-17T02:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838305+0000", 2024-09-17T02:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838305+0000", 2024-09-17T02:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838305+0000", 2024-09-17T02:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4999999999999998e-07 2024-09-17T02:21:58.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838308+0000", 2024-09-17T02:21:58.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.187e-06 2024-09-17T02:21:58.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838314+0000", 2024-09-17T02:21:58.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2400000000000004e-06 2024-09-17T02:21:58.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838318+0000", 2024-09-17T02:21:58.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5020000000000003e-06 2024-09-17T02:21:58.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.840927+0000", 2024-09-17T02:21:58.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026083690000000001 2024-09-17T02:21:58.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.841037+0000", 2024-09-17T02:21:58.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109888 2024-09-17T02:21:58.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.864539+0000", 2024-09-17T02:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023502788 2024-09-17T02:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.864586+0000", 2024-09-17T02:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6554999999999997e-05 2024-09-17T02:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.864655+0000", 2024-09-17T02:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9066999999999994e-05 2024-09-17T02:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.910 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.910 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.910 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:150458 5.a 5:59b62890:::benchmark_data_smithi001_23533_object22341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:58.910 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:21:58.910 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.967164555, 2024-09-17T02:21:58.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028150173000000001, 2024-09-17T02:21:58.910 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.910 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.910 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.910 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:58.910 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:58.910 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 150458 2024-09-17T02:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:21:58.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7800000000000002e-07 2024-09-17T02:21:58.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838328+0000", 2024-09-17T02:21:58.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.838e-06 2024-09-17T02:21:58.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838335+0000", 2024-09-17T02:21:58.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1999999999999997e-06 2024-09-17T02:21:58.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838340+0000", 2024-09-17T02:21:58.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7389999999999999e-06 2024-09-17T02:21:58.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849082+0000", 2024-09-17T02:21:58.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01074174 2024-09-17T02:21:58.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849192+0000", 2024-09-17T02:21:58.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011040300000000001 2024-09-17T02:21:58.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:58.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849297+0000", 2024-09-17T02:21:58.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104764 2024-09-17T02:21:58.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.857853+0000", 2024-09-17T02:21:58.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085558490000000008 2024-09-17T02:21:58.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866430+0000", 2024-09-17T02:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085768140000000003 2024-09-17T02:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866454+0000", 2024-09-17T02:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4428000000000001e-05 2024-09-17T02:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866476+0000", 2024-09-17T02:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.192e-05 2024-09-17T02:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:150461 5.a 5:58886edc:::benchmark_data_smithi001_23533_object22344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.838709+0000", 2024-09-17T02:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.966781241, 2024-09-17T02:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027819366000000002, 2024-09-17T02:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 150461 2024-09-17T02:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.917 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:21:58.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:21:58.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838709+0000", 2024-09-17T02:21:58.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:21:58.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838709+0000", 2024-09-17T02:21:58.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:21:58.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:21:58.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838710+0000", 2024-09-17T02:21:58.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9399999999999995e-07 2024-09-17T02:21:58.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:21:58.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838712+0000", 2024-09-17T02:21:58.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.57e-06 2024-09-17T02:21:58.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:21:58.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838843+0000", 2024-09-17T02:21:58.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130469 2024-09-17T02:21:58.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:21:58.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838925+0000", 2024-09-17T02:21:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2622999999999998e-05 2024-09-17T02:21:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:21:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.855341+0000", 2024-09-17T02:21:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016415965000000001 2024-09-17T02:21:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:21:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.855509+0000", 2024-09-17T02:21:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016805800000000001 2024-09-17T02:21:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.855638+0000", 2024-09-17T02:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012901199999999999 2024-09-17T02:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.860084+0000", 2024-09-17T02:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044458650000000002 2024-09-17T02:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866486+0000", 2024-09-17T02:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064016919999999996 2024-09-17T02:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:21:58.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866505+0000", 2024-09-17T02:21:58.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9667e-05 2024-09-17T02:21:58.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:21:58.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:21:58.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:21:58.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866528+0000", 2024-09-17T02:21:58.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2951000000000001e-05 2024-09-17T02:21:58.921 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.921 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.921 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.921 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:21:58.921 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:21:58.921 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:21:58.923 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:58.924+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:58.923 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:59.022 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T02:21:59.023 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:59.021+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:59.051 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:21:59.079 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:21:59.079 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:21:59.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.079 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:179784 5.1 5.e46cf9d1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-17T02:21:59.079 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:59.034045+0000", 2024-09-17T02:21:59.079 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.048084732999999998, 2024-09-17T02:21:59.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.048107466000000002, 2024-09-17T02:21:59.079 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:59.079 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:59.079 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:59.080 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:59.080 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:59.080 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:59.080 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 179784 2024-09-17T02:21:59.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.080 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:59.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:59.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.034045+0000", 2024-09-17T02:21:59.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:59.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.034045+0000", 2024-09-17T02:21:59.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:59.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.034046+0000", 2024-09-17T02:21:59.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6599999999999996e-07 2024-09-17T02:21:59.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:59.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.034049+0000", 2024-09-17T02:21:59.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.755e-06 2024-09-17T02:21:59.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:59.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.034060+0000", 2024-09-17T02:21:59.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0205e-05 2024-09-17T02:21:59.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:59.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.034066+0000", 2024-09-17T02:21:59.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5250000000000002e-06 2024-09-17T02:21:59.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:59.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.034114+0000", 2024-09-17T02:21:59.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7698999999999999e-05 2024-09-17T02:21:59.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:59.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.034222+0000", 2024-09-17T02:21:59.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107672 2024-09-17T02:21:59.083 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.083 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:59.083 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.083 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:179732 5.1 5.c61e3d81 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e61)", 2024-09-17T02:21:59.084 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:59.024535+0000", 2024-09-17T02:21:59.084 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.057594467000000003, 2024-09-17T02:21:59.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.057688528000000003, 2024-09-17T02:21:59.084 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:59.084 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:59.084 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:59.084 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:59.084 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:59.084 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:59.084 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 179732 2024-09-17T02:21:59.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.084 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:59.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:59.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.024535+0000", 2024-09-17T02:21:59.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:59.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.024535+0000", 2024-09-17T02:21:59.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:59.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.024536+0000", 2024-09-17T02:21:59.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6600000000000005e-07 2024-09-17T02:21:59.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:59.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.024541+0000", 2024-09-17T02:21:59.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3089999999999997e-06 2024-09-17T02:21:59.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:59.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.024550+0000", 2024-09-17T02:21:59.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5689999999999994e-06 2024-09-17T02:21:59.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:59.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.024558+0000", 2024-09-17T02:21:59.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.413e-06 2024-09-17T02:21:59.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:59.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.028719+0000", 2024-09-17T02:21:59.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041618480000000001 2024-09-17T02:21:59.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:59.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.028727+0000", 2024-09-17T02:21:59.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5120000000000002e-06 2024-09-17T02:21:59.088 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.088 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:59.088 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.088 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:179733 5.1 5.f02ee421 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e61)", 2024-09-17T02:21:59.088 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:59.024570+0000", 2024-09-17T02:21:59.088 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.057559897999999998, 2024-09-17T02:21:59.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.057721004999999999, 2024-09-17T02:21:59.088 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:59.088 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:59.088 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:59.089 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:59.089 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:59.089 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:59.089 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 179733 2024-09-17T02:21:59.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.089 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:59.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:59.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.024570+0000", 2024-09-17T02:21:59.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:59.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.024570+0000", 2024-09-17T02:21:59.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:59.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.024570+0000", 2024-09-17T02:21:59.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5299999999999999e-07 2024-09-17T02:21:59.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:59.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.024573+0000", 2024-09-17T02:21:59.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5679999999999998e-06 2024-09-17T02:21:59.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:59.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.024580+0000", 2024-09-17T02:21:59.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5549999999999999e-06 2024-09-17T02:21:59.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:59.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.024585+0000", 2024-09-17T02:21:59.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4720000000000003e-06 2024-09-17T02:21:59.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:59.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.028749+0000", 2024-09-17T02:21:59.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00416389 2024-09-17T02:21:59.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:59.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.028755+0000", 2024-09-17T02:21:59.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.049e-06 2024-09-17T02:21:59.092 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.092 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:59.092 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.092 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:179739 5.1 5.8c4dabb1 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e61)", 2024-09-17T02:21:59.092 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:59.024593+0000", 2024-09-17T02:21:59.092 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.057537328999999998, 2024-09-17T02:21:59.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.057760959000000001, 2024-09-17T02:21:59.092 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:59.093 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:59.093 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:59.093 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:59.093 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:59.093 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:59.093 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 179739 2024-09-17T02:21:59.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.093 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:59.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:59.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.024593+0000", 2024-09-17T02:21:59.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:59.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.024593+0000", 2024-09-17T02:21:59.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:59.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.024593+0000", 2024-09-17T02:21:59.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1800000000000001e-07 2024-09-17T02:21:59.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:59.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.024595+0000", 2024-09-17T02:21:59.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4880000000000001e-06 2024-09-17T02:21:59.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:59.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.024602+0000", 2024-09-17T02:21:59.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.613e-06 2024-09-17T02:21:59.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:59.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.024607+0000", 2024-09-17T02:21:59.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3619999999999997e-06 2024-09-17T02:21:59.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:59.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.028777+0000", 2024-09-17T02:21:59.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041695990000000004 2024-09-17T02:21:59.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:59.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.028783+0000", 2024-09-17T02:21:59.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7950000000000004e-06 2024-09-17T02:21:59.096 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.096 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:59.096 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.096 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:179748 5.1 5.2e13c6b1 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e61)", 2024-09-17T02:21:59.096 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:59.024638+0000", 2024-09-17T02:21:59.097 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.057491750000000001, 2024-09-17T02:21:59.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.057778557000000001, 2024-09-17T02:21:59.097 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:59.097 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:59.097 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:59.097 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:59.097 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:59.097 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:59.097 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 179748 2024-09-17T02:21:59.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.097 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:59.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:59.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.024638+0000", 2024-09-17T02:21:59.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:59.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.024638+0000", 2024-09-17T02:21:59.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:59.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.024639+0000", 2024-09-17T02:21:59.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1399999999999997e-07 2024-09-17T02:21:59.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:59.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.024641+0000", 2024-09-17T02:21:59.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7920000000000001e-06 2024-09-17T02:21:59.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:59.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.024650+0000", 2024-09-17T02:21:59.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0589999999999992e-06 2024-09-17T02:21:59.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:59.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.024657+0000", 2024-09-17T02:21:59.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1539999999999999e-06 2024-09-17T02:21:59.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:59.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.028806+0000", 2024-09-17T02:21:59.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041490149999999998 2024-09-17T02:21:59.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:59.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.028811+0000", 2024-09-17T02:21:59.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7710000000000003e-06 2024-09-17T02:21:59.100 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.100 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:59.100 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.101 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:179793 5.1 5.ca6155e1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-17T02:21:59.101 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:59.039468+0000", 2024-09-17T02:21:59.101 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.042662142, 2024-09-17T02:21:59.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.043010713999999999, 2024-09-17T02:21:59.101 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:59.101 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:59.101 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:59.101 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:59.101 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:59.101 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:59.101 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 179793 2024-09-17T02:21:59.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.102 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:59.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:59.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.039468+0000", 2024-09-17T02:21:59.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:59.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.039468+0000", 2024-09-17T02:21:59.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:59.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.039468+0000", 2024-09-17T02:21:59.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:21:59.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:59.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.039472+0000", 2024-09-17T02:21:59.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8460000000000001e-06 2024-09-17T02:21:59.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:59.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.039482+0000", 2024-09-17T02:21:59.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6530000000000006e-06 2024-09-17T02:21:59.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:59.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.039488+0000", 2024-09-17T02:21:59.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3679999999999998e-06 2024-09-17T02:21:59.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:59.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.039552+0000", 2024-09-17T02:21:59.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3893000000000006e-05 2024-09-17T02:21:59.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:59.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.039558+0000", 2024-09-17T02:21:59.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8429999999999998e-06 2024-09-17T02:21:59.105 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.105 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:59.105 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.105 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:179856 5.1 5.8afff21 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-17T02:21:59.105 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:59.074033+0000", 2024-09-17T02:21:59.105 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0080972430000000005, 2024-09-17T02:21:59.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0085097309999999995, 2024-09-17T02:21:59.105 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:59.106 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:59.106 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:59.106 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:59.106 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:59.106 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:59.107 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 179856 2024-09-17T02:21:59.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.107 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:59.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:59.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.074033+0000", 2024-09-17T02:21:59.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:59.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.074033+0000", 2024-09-17T02:21:59.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:59.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.074033+0000", 2024-09-17T02:21:59.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8100000000000002e-07 2024-09-17T02:21:59.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:59.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.074037+0000", 2024-09-17T02:21:59.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.534e-06 2024-09-17T02:21:59.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:59.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.074050+0000", 2024-09-17T02:21:59.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2947e-05 2024-09-17T02:21:59.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:59.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.074057+0000", 2024-09-17T02:21:59.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5809999999999999e-06 2024-09-17T02:21:59.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:59.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.074113+0000", 2024-09-17T02:21:59.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5449999999999999e-05 2024-09-17T02:21:59.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:59.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.074121+0000", 2024-09-17T02:21:59.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5189999999999992e-06 2024-09-17T02:21:59.110 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.110 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:59.110 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.110 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:179775 5.1 5.2fbe3591 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-17T02:21:59.110 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:59.031201+0000", 2024-09-17T02:21:59.110 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.050928387999999998, 2024-09-17T02:21:59.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.051404594999999997, 2024-09-17T02:21:59.111 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:59.111 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:59.111 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:59.111 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:59.111 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:59.111 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:59.111 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 179775 2024-09-17T02:21:59.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.111 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:59.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:59.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.031201+0000", 2024-09-17T02:21:59.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:59.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.031201+0000", 2024-09-17T02:21:59.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:59.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.031202+0000", 2024-09-17T02:21:59.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4900000000000001e-07 2024-09-17T02:21:59.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:59.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.031205+0000", 2024-09-17T02:21:59.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7669999999999999e-06 2024-09-17T02:21:59.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:59.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.031210+0000", 2024-09-17T02:21:59.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5790000000000003e-06 2024-09-17T02:21:59.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:59.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.031214+0000", 2024-09-17T02:21:59.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6619999999999998e-06 2024-09-17T02:21:59.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:59.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.031247+0000", 2024-09-17T02:21:59.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3395999999999997e-05 2024-09-17T02:21:59.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:59.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.031252+0000", 2024-09-17T02:21:59.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8010000000000003e-06 2024-09-17T02:21:59.114 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.115 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:59.115 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.115 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:179862 5.1 5.3059f481 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-17T02:21:59.115 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:59.078603+0000", 2024-09-17T02:21:59.115 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0035265740000000002, 2024-09-17T02:21:59.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040643399999999996, 2024-09-17T02:21:59.115 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:59.115 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:59.115 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:59.115 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:59.115 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:59.115 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:59.116 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 179862 2024-09-17T02:21:59.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.116 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:59.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:59.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.078603+0000", 2024-09-17T02:21:59.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:59.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.078603+0000", 2024-09-17T02:21:59.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:59.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.078604+0000", 2024-09-17T02:21:59.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3600000000000003e-07 2024-09-17T02:21:59.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:59.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.078607+0000", 2024-09-17T02:21:59.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9399999999999998e-06 2024-09-17T02:21:59.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:59.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.078616+0000", 2024-09-17T02:21:59.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6190000000000006e-06 2024-09-17T02:21:59.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:59.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.078622+0000", 2024-09-17T02:21:59.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0320000000000003e-06 2024-09-17T02:21:59.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:59.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.078698+0000", 2024-09-17T02:21:59.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6460999999999999e-05 2024-09-17T02:21:59.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:59.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.078704+0000", 2024-09-17T02:21:59.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9050000000000002e-06 2024-09-17T02:21:59.119 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.119 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:59.119 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.119 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:179836 5.1 5.567b5251 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-17T02:21:59.119 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:59.064564+0000", 2024-09-17T02:21:59.119 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.017566075, 2024-09-17T02:21:59.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018168307000000002, 2024-09-17T02:21:59.119 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:59.120 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:59.120 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for peered", 2024-09-17T02:21:59.120 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:59.120 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:59.120 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:59.120 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 179836 2024-09-17T02:21:59.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.120 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:59.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:59.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.064564+0000", 2024-09-17T02:21:59.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:59.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.064564+0000", 2024-09-17T02:21:59.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:59.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.064564+0000", 2024-09-17T02:21:59.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3099999999999998e-07 2024-09-17T02:21:59.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:59.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.064567+0000", 2024-09-17T02:21:59.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.43e-06 2024-09-17T02:21:59.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:59.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.064574+0000", 2024-09-17T02:21:59.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0310000000000001e-06 2024-09-17T02:21:59.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:59.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.064578+0000", 2024-09-17T02:21:59.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7390000000000001e-06 2024-09-17T02:21:59.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:59.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.064623+0000", 2024-09-17T02:21:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5663e-05 2024-09-17T02:21:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:21:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.064630+0000", 2024-09-17T02:21:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.584e-06 2024-09-17T02:21:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:179867 5.8 e61/26 5:186c5496:::benchmark_data_smithi001_23533_object51750:head v 61'11409, mlcod=61'11407)", 2024-09-17T02:21:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:59.080164+0000", 2024-09-17T02:21:59.124 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0019661230000000002, 2024-09-17T02:21:59.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026318280000000001, 2024-09-17T02:21:59.124 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:59.124 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:59.124 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:21:59.124 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:59.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:59.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.080164+0000", 2024-09-17T02:21:59.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:59.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.080164+0000", 2024-09-17T02:21:59.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:59.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.080164+0000", 2024-09-17T02:21:59.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9699999999999996e-07 2024-09-17T02:21:59.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:59.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.080169+0000", 2024-09-17T02:21:59.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1189999999999996e-06 2024-09-17T02:21:59.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:59.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.080179+0000", 2024-09-17T02:21:59.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0003000000000001e-05 2024-09-17T02:21:59.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:59.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.080187+0000", 2024-09-17T02:21:59.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2880000000000004e-06 2024-09-17T02:21:59.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:59.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.080231+0000", 2024-09-17T02:21:59.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4579000000000001e-05 2024-09-17T02:21:59.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:59.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.080252+0000", 2024-09-17T02:21:59.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0322e-05 2024-09-17T02:21:59.127 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.127 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:59.127 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.128 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:179868 5.4 5:20a6173e:::benchmark_data_smithi001_23533_object51751:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-17T02:21:59.128 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:59.080511+0000", 2024-09-17T02:21:59.128 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0016193080000000001, 2024-09-17T02:21:59.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002345911, 2024-09-17T02:21:59.128 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:59.128 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:59.128 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:59.128 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:59.128 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:59.128 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:59.128 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 179868 2024-09-17T02:21:59.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.128 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:59.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:59.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.080511+0000", 2024-09-17T02:21:59.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:59.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.080511+0000", 2024-09-17T02:21:59.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:59.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.080511+0000", 2024-09-17T02:21:59.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:21:59.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:59.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.080515+0000", 2024-09-17T02:21:59.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.365e-06 2024-09-17T02:21:59.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:59.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.080523+0000", 2024-09-17T02:21:59.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9249999999999995e-06 2024-09-17T02:21:59.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:59.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.080527+0000", 2024-09-17T02:21:59.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9740000000000004e-06 2024-09-17T02:21:59.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:59.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.080574+0000", 2024-09-17T02:21:59.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7513999999999999e-05 2024-09-17T02:21:59.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:59.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.080691+0000", 2024-09-17T02:21:59.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011657199999999999 2024-09-17T02:21:59.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:59.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.080798+0000", 2024-09-17T02:21:59.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107595 2024-09-17T02:21:59.132 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.132 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:59.132 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.132 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:179869 5.4 5:28b9424c:::benchmark_data_smithi001_23533_object51752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-17T02:21:59.133 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:59.080542+0000", 2024-09-17T02:21:59.133 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0015873930000000001, 2024-09-17T02:21:59.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002383951, 2024-09-17T02:21:59.133 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:59.133 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:59.133 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:59.133 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:59.133 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:59.133 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:59.133 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 179869 2024-09-17T02:21:59.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.133 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:59.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:59.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.080542+0000", 2024-09-17T02:21:59.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:59.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.080542+0000", 2024-09-17T02:21:59.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:59.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.080543+0000", 2024-09-17T02:21:59.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2200000000000004e-07 2024-09-17T02:21:59.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:59.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.080546+0000", 2024-09-17T02:21:59.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.638e-06 2024-09-17T02:21:59.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:59.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.080550+0000", 2024-09-17T02:21:59.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5549999999999996e-06 2024-09-17T02:21:59.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:59.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.080554+0000", 2024-09-17T02:21:59.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3239999999999999e-06 2024-09-17T02:21:59.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:59.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.082602+0000", 2024-09-17T02:21:59.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020483519999999998 2024-09-17T02:21:59.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:59.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.082679+0000", 2024-09-17T02:21:59.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6889000000000002e-05 2024-09-17T02:21:59.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:59.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.082757+0000", 2024-09-17T02:21:59.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8178999999999998e-05 2024-09-17T02:21:59.137 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.137 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:59.137 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.137 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:179870 5.e 5:754ea0e9:::benchmark_data_smithi001_23533_object51753:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-17T02:21:59.137 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:59.081421+0000", 2024-09-17T02:21:59.137 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00070910000000000005, 2024-09-17T02:21:59.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015754600000000001, 2024-09-17T02:21:59.138 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:21:59.138 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:21:59.138 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:21:59.138 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:21:59.138 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:21:59.138 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:21:59.138 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 179870 2024-09-17T02:21:59.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.138 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:21:59.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:21:59.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.081421+0000", 2024-09-17T02:21:59.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:21:59.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.081421+0000", 2024-09-17T02:21:59.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:21:59.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:21:59.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.081421+0000", 2024-09-17T02:21:59.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.61e-07 2024-09-17T02:21:59.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:21:59.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.081425+0000", 2024-09-17T02:21:59.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3950000000000001e-06 2024-09-17T02:21:59.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:21:59.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.081434+0000", 2024-09-17T02:21:59.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2720000000000003e-06 2024-09-17T02:21:59.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:21:59.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.081440+0000", 2024-09-17T02:21:59.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4229999999999996e-06 2024-09-17T02:21:59.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:21:59.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.081481+0000", 2024-09-17T02:21:59.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1183000000000002e-05 2024-09-17T02:21:59.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:21:59.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.081563+0000", 2024-09-17T02:21:59.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2483000000000003e-05 2024-09-17T02:21:59.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:21:59.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:21:59.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:21:59.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:59.081634+0000", 2024-09-17T02:21:59.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0452999999999998e-05 2024-09-17T02:21:59.141 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.142 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:21:59.142 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.142 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:21:59.142 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:21:59.142 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 14 2024-09-17T02:21:59.142 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:21:59.143 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:21:59.144 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:59.141+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:59.219 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:21:59.220 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:21:59.240 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:21:59.240 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:21:59.240 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:21:59.244 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:21:59.244 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:21:59.245 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:59.244+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:59.274 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:59.275 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:59.289 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:21:59.345 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:59.345+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:59.446 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:59.448+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:59.462 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:59.463 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:59.480 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:21:59.548 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:59.548+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:59.619 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:59.620 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:59.634 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:21:59.680 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:59.680+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:59.750 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:59.752+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:21:59.750 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:59.750 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:59.763 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:21:59.852 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:21:59.852+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:21:59.924 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:21:59.924 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:21:59.937 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:21:59.989 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:21:59.991+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:00.030 INFO:teuthology.orchestra.run.smithi001.stderr:noscrub is unset 2024-09-17T02:22:00.052 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:00.052+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:00.105 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:00.106 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:00.127 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:00.153 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:00.152+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:00.253 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:00.255+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:00.327 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:00.327 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:00.348 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:00.389 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:00.391+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:00.455 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:00.452+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:00.551 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:00.551 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:00.558 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:00.555+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:00.573 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:00.657 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:00.659+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:00.737 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:00.738 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:00.758 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:00.759+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:00.760 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:00.859 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:00.859+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:00.925 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:00.926 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:00.948 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:00.992 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:00.992+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:01.061 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:01.060+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:01.110 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:01.111 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:01.132 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:01.176 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:01.176+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:01.245 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:22:01.263 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:01.263+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:01.297 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:01.297 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:01.321 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:01.365 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:01.367+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:01.408 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:22:01.408 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:22:01.426 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:22:01.426 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:22:01.426 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:22:01.429 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:22:01.430 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:22:01.464 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:01.468+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:01.525 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:01.525 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:22:01.525 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:22:01.525 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:22:01.525 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:01.546 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:01.565 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:01.568+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:01.665 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:01.668+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:01.713 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:01.713 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:22:01.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:22:01.713 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:22:01.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.713 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97749 5.b 5:d930ef52:::benchmark_data_smithi001_23533_object97748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:01.713 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:01.714 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.122319349999998, 2024-09-17T02:22:01.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092964343000000005, 2024-09-17T02:22:01.714 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:01.714 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:01.714 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:01.714 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:01.714 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:01.714 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:01.714 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97749 2024-09-17T02:22:01.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.714 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:01.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:01.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:01.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:01.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:01.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:01.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591947+0000", 2024-09-17T02:22:01.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:22:01.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:01.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592011+0000", 2024-09-17T02:22:01.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3608000000000005e-05 2024-09-17T02:22:01.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:01.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592021+0000", 2024-09-17T02:22:01.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9979999999999998e-06 2024-09-17T02:22:01.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:01.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592028+0000", 2024-09-17T02:22:01.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1439999999999997e-06 2024-09-17T02:22:01.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593633+0000", 2024-09-17T02:22:01.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001604636 2024-09-17T02:22:01.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:01.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593757+0000", 2024-09-17T02:22:01.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012432099999999999 2024-09-17T02:22:01.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593866+0000", 2024-09-17T02:22:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109094 2024-09-17T02:22:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601190+0000", 2024-09-17T02:22:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073237620000000002 2024-09-17T02:22:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601356+0000", 2024-09-17T02:22:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016651900000000001 2024-09-17T02:22:01.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:01.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684618+0000", 2024-09-17T02:22:01.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083261356999999994 2024-09-17T02:22:01.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:01.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684724+0000", 2024-09-17T02:22:01.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010681800000000001 2024-09-17T02:22:01.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:01.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684911+0000", 2024-09-17T02:22:01.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186243 2024-09-17T02:22:01.720 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.720 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:01.720 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.720 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97752 5.b 5:d146f486:::benchmark_data_smithi001_23533_object97751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:01.720 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:01.720 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.120966656, 2024-09-17T02:22:01.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091989557, 2024-09-17T02:22:01.720 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:01.720 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:01.721 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:01.721 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:01.721 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:01.721 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:01.721 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97752 2024-09-17T02:22:01.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.721 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:01.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:01.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:01.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:01.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:01.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:01.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593300+0000", 2024-09-17T02:22:01.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8199999999999998e-07 2024-09-17T02:22:01.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:01.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593364+0000", 2024-09-17T02:22:01.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3831999999999995e-05 2024-09-17T02:22:01.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:01.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593376+0000", 2024-09-17T02:22:01.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1800999999999999e-05 2024-09-17T02:22:01.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:01.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593382+0000", 2024-09-17T02:22:01.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6780000000000003e-06 2024-09-17T02:22:01.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595491+0000", 2024-09-17T02:22:01.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021090689999999999 2024-09-17T02:22:01.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:01.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595614+0000", 2024-09-17T02:22:01.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012321500000000001 2024-09-17T02:22:01.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:01.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595778+0000", 2024-09-17T02:22:01.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016321900000000001 2024-09-17T02:22:01.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:01.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601197+0000", 2024-09-17T02:22:01.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054195600000000003 2024-09-17T02:22:01.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:01.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601396+0000", 2024-09-17T02:22:01.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019825299999999999 2024-09-17T02:22:01.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:01.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684990+0000", 2024-09-17T02:22:01.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083594878999999997 2024-09-17T02:22:01.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:01.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685116+0000", 2024-09-17T02:22:01.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012522799999999999 2024-09-17T02:22:01.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:01.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685289+0000", 2024-09-17T02:22:01.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172941 2024-09-17T02:22:01.726 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.727 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:01.727 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.727 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97754 5.b 5:da0615e5:::benchmark_data_smithi001_23533_object97753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:01.727 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:01.727 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.119328734, 2024-09-17T02:22:01.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092097207, 2024-09-17T02:22:01.727 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:01.727 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:01.727 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:01.727 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:01.727 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:01.728 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:01.728 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97754 2024-09-17T02:22:01.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.728 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:01.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:01.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:01.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:01.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:01.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:01.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594938+0000", 2024-09-17T02:22:01.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5000000000000002e-07 2024-09-17T02:22:01.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:01.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595075+0000", 2024-09-17T02:22:01.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137742 2024-09-17T02:22:01.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:01.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595087+0000", 2024-09-17T02:22:01.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1243000000000001e-05 2024-09-17T02:22:01.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:01.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595095+0000", 2024-09-17T02:22:01.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1030000000000002e-06 2024-09-17T02:22:01.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598461+0000", 2024-09-17T02:22:01.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033661170000000001 2024-09-17T02:22:01.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:01.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598540+0000", 2024-09-17T02:22:01.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8937999999999995e-05 2024-09-17T02:22:01.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:01.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598626+0000", 2024-09-17T02:22:01.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6042000000000001e-05 2024-09-17T02:22:01.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:01.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684258+0000", 2024-09-17T02:22:01.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085632394000000001 2024-09-17T02:22:01.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:01.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685369+0000", 2024-09-17T02:22:01.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001111063 2024-09-17T02:22:01.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:01.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685511+0000", 2024-09-17T02:22:01.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141965 2024-09-17T02:22:01.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:01.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685604+0000", 2024-09-17T02:22:01.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2935000000000004e-05 2024-09-17T02:22:01.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:01.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687034+0000", 2024-09-17T02:22:01.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001430015 2024-09-17T02:22:01.733 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.733 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:01.733 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.734 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97755 5.b 5:d36a03a1:::benchmark_data_smithi001_23533_object97754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:01.734 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:01.734 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.119155583999998, 2024-09-17T02:22:01.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0924904, 2024-09-17T02:22:01.734 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:01.734 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:01.734 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:01.734 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:01.734 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:01.734 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:01.734 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97755 2024-09-17T02:22:01.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.735 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:01.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:01.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:01.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:01.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:01.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:01.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595111+0000", 2024-09-17T02:22:01.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:22:01.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:01.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595145+0000", 2024-09-17T02:22:01.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3927000000000002e-05 2024-09-17T02:22:01.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:01.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595155+0000", 2024-09-17T02:22:01.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0023e-05 2024-09-17T02:22:01.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:01.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595162+0000", 2024-09-17T02:22:01.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3950000000000003e-06 2024-09-17T02:22:01.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599821+0000", 2024-09-17T02:22:01.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046592880000000001 2024-09-17T02:22:01.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:01.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599912+0000", 2024-09-17T02:22:01.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1049000000000002e-05 2024-09-17T02:22:01.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:01.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600062+0000", 2024-09-17T02:22:01.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015001700000000001 2024-09-17T02:22:01.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:01.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685307+0000", 2024-09-17T02:22:01.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085244340000000002 2024-09-17T02:22:01.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:01.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685446+0000", 2024-09-17T02:22:01.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013955700000000001 2024-09-17T02:22:01.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:01.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687375+0000", 2024-09-17T02:22:01.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019291079999999999 2024-09-17T02:22:01.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:01.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687462+0000", 2024-09-17T02:22:01.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6148000000000003e-05 2024-09-17T02:22:01.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:01.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687600+0000", 2024-09-17T02:22:01.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013887900000000001 2024-09-17T02:22:01.740 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.740 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:01.740 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.740 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 44/44 lb 5:c4567a04:::benchmark_data_smithi001_23533_object4200:head)", 2024-09-17T02:22:01.740 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:01.740 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.117058958000001, 2024-09-17T02:22:01.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092483421999999996, 2024-09-17T02:22:01.741 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:01.741 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:01.741 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:01.741 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:01.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:01.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:01.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:01.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:01.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:01.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:01.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6399999999999998e-07 2024-09-17T02:22:01.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:01.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597213+0000", 2024-09-17T02:22:01.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3659999999999997e-06 2024-09-17T02:22:01.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:01.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597222+0000", 2024-09-17T02:22:01.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0510000000000002e-06 2024-09-17T02:22:01.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:01.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597228+0000", 2024-09-17T02:22:01.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1569999999999999e-06 2024-09-17T02:22:01.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689588+0000", 2024-09-17T02:22:01.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092359931000000006 2024-09-17T02:22:01.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:01.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689622+0000", 2024-09-17T02:22:01.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4425999999999999e-05 2024-09-17T02:22:01.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:01.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689690+0000", 2024-09-17T02:22:01.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8126999999999993e-05 2024-09-17T02:22:01.744 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.744 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:01.744 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.745 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129462 5.4 5:2e0acc16:::benchmark_data_smithi001_23533_object1345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:01.745 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:01.745 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.179324889, 2024-09-17T02:22:01.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0112774899999999, 2024-09-17T02:22:01.745 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:01.745 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:01.745 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:01.745 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:01.745 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:01.745 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:01.745 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129462 2024-09-17T02:22:01.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.746 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:01.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:01.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:01.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:01.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:01.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:01.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534943+0000", 2024-09-17T02:22:01.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8759999999999999e-06 2024-09-17T02:22:01.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:01.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534951+0000", 2024-09-17T02:22:01.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3219999999999993e-06 2024-09-17T02:22:01.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:01.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534977+0000", 2024-09-17T02:22:01.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6245e-05 2024-09-17T02:22:01.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:01.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534992+0000", 2024-09-17T02:22:01.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4936000000000001e-05 2024-09-17T02:22:01.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535133+0000", 2024-09-17T02:22:01.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014051299999999999 2024-09-17T02:22:01.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:01.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:22:01.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1741000000000001e-05 2024-09-17T02:22:01.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.533906+0000", 2024-09-17T02:22:01.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99875209300000001 2024-09-17T02:22:01.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:01.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534348+0000", 2024-09-17T02:22:01.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044128899999999998 2024-09-17T02:22:01.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:01.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534762+0000", 2024-09-17T02:22:01.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000414707 2024-09-17T02:22:01.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:01.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545024+0000", 2024-09-17T02:22:01.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010261283 2024-09-17T02:22:01.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:01.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545953+0000", 2024-09-17T02:22:01.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000929618 2024-09-17T02:22:01.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:01.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546047+0000", 2024-09-17T02:22:01.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3697999999999996e-05 2024-09-17T02:22:01.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:01.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546218+0000", 2024-09-17T02:22:01.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017116899999999999 2024-09-17T02:22:01.751 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.751 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:01.751 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.752 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129480 5.4 5:2b1d398b:::benchmark_data_smithi001_23533_object1363:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:01.752 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:01.752 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.171570422999999, 2024-09-17T02:22:01.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0038926450000001, 2024-09-17T02:22:01.752 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:01.752 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:01.752 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:01.752 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:01.752 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:01.752 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:01.752 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129480 2024-09-17T02:22:01.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.753 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:01.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:01.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:01.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:01.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:01.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:01.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542696+0000", 2024-09-17T02:22:01.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9999999999999995e-07 2024-09-17T02:22:01.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:01.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542701+0000", 2024-09-17T02:22:01.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2240000000000003e-06 2024-09-17T02:22:01.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:01.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542716+0000", 2024-09-17T02:22:01.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4970000000000001e-05 2024-09-17T02:22:01.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:01.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542726+0000", 2024-09-17T02:22:01.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2879999999999998e-06 2024-09-17T02:22:01.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542832+0000", 2024-09-17T02:22:01.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010597199999999999 2024-09-17T02:22:01.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:01.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542843+0000", 2024-09-17T02:22:01.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.098e-05 2024-09-17T02:22:01.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538436+0000", 2024-09-17T02:22:01.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99559286800000002 2024-09-17T02:22:01.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:01.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538791+0000", 2024-09-17T02:22:01.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035585499999999997 2024-09-17T02:22:01.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:01.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.539144+0000", 2024-09-17T02:22:01.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035268499999999999 2024-09-17T02:22:01.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:01.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545880+0000", 2024-09-17T02:22:01.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00673552 2024-09-17T02:22:01.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:01.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546330+0000", 2024-09-17T02:22:01.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045039599999999999 2024-09-17T02:22:01.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:01.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546414+0000", 2024-09-17T02:22:01.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4468000000000005e-05 2024-09-17T02:22:01.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:01.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546588+0000", 2024-09-17T02:22:01.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017341899999999999 2024-09-17T02:22:01.758 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.758 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:01.758 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.759 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129505 5.4 5:294f2ec7:::benchmark_data_smithi001_23533_object1388:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:01.759 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:01.759 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.152557250000001, 2024-09-17T02:22:01.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98589826199999997, 2024-09-17T02:22:01.759 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:01.759 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:01.759 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:01.759 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:01.759 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:01.759 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:01.759 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129505 2024-09-17T02:22:01.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.760 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:01.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:01.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:01.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:01.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:01.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:01.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561710+0000", 2024-09-17T02:22:01.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7060000000000001e-06 2024-09-17T02:22:01.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:01.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561718+0000", 2024-09-17T02:22:01.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.542e-06 2024-09-17T02:22:01.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:01.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561741+0000", 2024-09-17T02:22:01.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3357e-05 2024-09-17T02:22:01.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:01.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561754+0000", 2024-09-17T02:22:01.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3200000000000001e-05 2024-09-17T02:22:01.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561867+0000", 2024-09-17T02:22:01.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113211 2024-09-17T02:22:01.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:01.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561888+0000", 2024-09-17T02:22:01.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0809999999999999e-05 2024-09-17T02:22:01.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542140+0000", 2024-09-17T02:22:01.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98025195799999998 2024-09-17T02:22:01.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:01.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542331+0000", 2024-09-17T02:22:01.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019127599999999999 2024-09-17T02:22:01.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:01.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542517+0000", 2024-09-17T02:22:01.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000185625 2024-09-17T02:22:01.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:01.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547114+0000", 2024-09-17T02:22:01.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045968620000000002 2024-09-17T02:22:01.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:01.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547187+0000", 2024-09-17T02:22:01.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3348000000000003e-05 2024-09-17T02:22:01.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:01.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547324+0000", 2024-09-17T02:22:01.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013681699999999999 2024-09-17T02:22:01.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:01.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547607+0000", 2024-09-17T02:22:01.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028255000000000001 2024-09-17T02:22:01.766 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.766 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:01.766 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.766 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129508 5.4 5:2892b582:::benchmark_data_smithi001_23533_object1391:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:01.766 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:01.766 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.151220157000001, 2024-09-17T02:22:01.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99697919099999999, 2024-09-17T02:22:01.766 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:01.766 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:01.767 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:01.767 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:01.767 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:01.767 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:01.767 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129508 2024-09-17T02:22:01.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.767 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:01.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:01.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:01.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:01.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:01.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:01.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563047+0000", 2024-09-17T02:22:01.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.274e-06 2024-09-17T02:22:01.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:01.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563054+0000", 2024-09-17T02:22:01.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2799999999999998e-06 2024-09-17T02:22:01.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:01.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563070+0000", 2024-09-17T02:22:01.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5991999999999999e-05 2024-09-17T02:22:01.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:01.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563078+0000", 2024-09-17T02:22:01.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2390000000000002e-06 2024-09-17T02:22:01.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563181+0000", 2024-09-17T02:22:01.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102249 2024-09-17T02:22:01.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:01.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563199+0000", 2024-09-17T02:22:01.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8215000000000001e-05 2024-09-17T02:22:01.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547713+0000", 2024-09-17T02:22:01.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98451446399999998 2024-09-17T02:22:01.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:01.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548063+0000", 2024-09-17T02:22:01.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034985499999999999 2024-09-17T02:22:01.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:01.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548490+0000", 2024-09-17T02:22:01.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042658600000000001 2024-09-17T02:22:01.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:01.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555655+0000", 2024-09-17T02:22:01.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071652579999999999 2024-09-17T02:22:01.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:01.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559612+0000", 2024-09-17T02:22:01.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003957103 2024-09-17T02:22:01.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:01.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559768+0000", 2024-09-17T02:22:01.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015556899999999999 2024-09-17T02:22:01.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:01.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560025+0000", 2024-09-17T02:22:01.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025710700000000002 2024-09-17T02:22:01.773 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.773 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:01.773 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.773 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129509 5.4 5:2c35515e:::benchmark_data_smithi001_23533_object1392:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:01.773 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:01.773 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.150593103999999, 2024-09-17T02:22:01.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99969384900000002, 2024-09-17T02:22:01.774 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:01.774 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:01.774 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:01.774 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:01.774 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:01.774 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:01.774 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129509 2024-09-17T02:22:01.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.774 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:01.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:01.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:01.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:01.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:01.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:01.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563674+0000", 2024-09-17T02:22:01.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0920000000000001e-06 2024-09-17T02:22:01.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:01.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563679+0000", 2024-09-17T02:22:01.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7660000000000004e-06 2024-09-17T02:22:01.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:01.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563693+0000", 2024-09-17T02:22:01.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3139000000000001e-05 2024-09-17T02:22:01.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:01.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563701+0000", 2024-09-17T02:22:01.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9859999999999994e-06 2024-09-17T02:22:01.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563775+0000", 2024-09-17T02:22:01.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4659000000000005e-05 2024-09-17T02:22:01.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:01.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563785+0000", 2024-09-17T02:22:01.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4839999999999993e-06 2024-09-17T02:22:01.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552085+0000", 2024-09-17T02:22:01.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98829986999999997 2024-09-17T02:22:01.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:01.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552554+0000", 2024-09-17T02:22:01.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046908900000000001 2024-09-17T02:22:01.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:01.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552931+0000", 2024-09-17T02:22:01.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377778 2024-09-17T02:22:01.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:01.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563106+0000", 2024-09-17T02:22:01.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010174186 2024-09-17T02:22:01.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:01.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563138+0000", 2024-09-17T02:22:01.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2495e-05 2024-09-17T02:22:01.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:01.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563225+0000", 2024-09-17T02:22:01.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6677999999999999e-05 2024-09-17T02:22:01.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:01.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563366+0000", 2024-09-17T02:22:01.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014162699999999999 2024-09-17T02:22:01.780 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.780 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:01.780 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.781 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129524 5.4 5:25dca7dd:::benchmark_data_smithi001_23533_object1407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:01.781 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:01.781 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.143901750000001, 2024-09-17T02:22:01.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99999501999999996, 2024-09-17T02:22:01.781 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:01.781 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:01.781 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:01.781 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:01.781 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:01.781 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:01.781 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129524 2024-09-17T02:22:01.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.781 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:01.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:01.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:01.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:01.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:01.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:01.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570365+0000", 2024-09-17T02:22:01.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.142e-06 2024-09-17T02:22:01.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:01.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570369+0000", 2024-09-17T02:22:01.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.856e-06 2024-09-17T02:22:01.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:01.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570385+0000", 2024-09-17T02:22:01.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5855e-05 2024-09-17T02:22:01.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:01.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570392+0000", 2024-09-17T02:22:01.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5340000000000002e-06 2024-09-17T02:22:01.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570484+0000", 2024-09-17T02:22:01.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1212999999999996e-05 2024-09-17T02:22:01.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:01.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570498+0000", 2024-09-17T02:22:01.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4331000000000001e-05 2024-09-17T02:22:01.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555835+0000", 2024-09-17T02:22:01.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98533757700000002 2024-09-17T02:22:01.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:01.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556329+0000", 2024-09-17T02:22:01.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000493458 2024-09-17T02:22:01.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:01.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556784+0000", 2024-09-17T02:22:01.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045476499999999999 2024-09-17T02:22:01.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:01.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569852+0000", 2024-09-17T02:22:01.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013068270999999999 2024-09-17T02:22:01.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:01.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569958+0000", 2024-09-17T02:22:01.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106214 2024-09-17T02:22:01.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:01.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570124+0000", 2024-09-17T02:22:01.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165546 2024-09-17T02:22:01.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:01.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570359+0000", 2024-09-17T02:22:01.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023525799999999999 2024-09-17T02:22:01.787 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.787 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:01.787 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.788 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129537 5.4 5:260327c6:::benchmark_data_smithi001_23533_object1420:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:01.788 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:01.788 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.135995221000002, 2024-09-17T02:22:01.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99624596499999996, 2024-09-17T02:22:01.788 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:01.788 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:01.788 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:01.788 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:01.788 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:01.788 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:01.788 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129537 2024-09-17T02:22:01.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.788 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:01.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:01.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:01.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:01.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:01.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:01.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578272+0000", 2024-09-17T02:22:01.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.164e-06 2024-09-17T02:22:01.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:01.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578278+0000", 2024-09-17T02:22:01.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5060000000000001e-06 2024-09-17T02:22:01.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:01.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578294+0000", 2024-09-17T02:22:01.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5687000000000001e-05 2024-09-17T02:22:01.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:01.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578329+0000", 2024-09-17T02:22:01.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5311999999999997e-05 2024-09-17T02:22:01.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578419+0000", 2024-09-17T02:22:01.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0054000000000002e-05 2024-09-17T02:22:01.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:01.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578435+0000", 2024-09-17T02:22:01.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5645999999999999e-05 2024-09-17T02:22:01.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560148+0000", 2024-09-17T02:22:01.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98171342299999997 2024-09-17T02:22:01.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:01.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560383+0000", 2024-09-17T02:22:01.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000234935 2024-09-17T02:22:01.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:01.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560586+0000", 2024-09-17T02:22:01.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000202909 2024-09-17T02:22:01.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:01.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570472+0000", 2024-09-17T02:22:01.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098856959999999994 2024-09-17T02:22:01.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:01.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574138+0000", 2024-09-17T02:22:01.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036660170000000001 2024-09-17T02:22:01.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:01.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574298+0000", 2024-09-17T02:22:01.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016025600000000001 2024-09-17T02:22:01.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:01.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574516+0000", 2024-09-17T02:22:01.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021835999999999999 2024-09-17T02:22:01.794 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.794 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:01.794 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.794 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129545 5.4 5:22366489:::benchmark_data_smithi001_23533_object1428:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:01.795 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:01.795 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.130132497999998, 2024-09-17T02:22:01.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99074544499999995, 2024-09-17T02:22:01.795 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:01.795 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:01.795 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:01.795 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:01.795 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:01.795 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:01.795 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129545 2024-09-17T02:22:01.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.795 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:01.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:01.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:01.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:01.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:01.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:01.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584135+0000", 2024-09-17T02:22:01.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4699999999999999e-06 2024-09-17T02:22:01.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:01.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584142+0000", 2024-09-17T02:22:01.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1620000000000002e-06 2024-09-17T02:22:01.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:01.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584170+0000", 2024-09-17T02:22:01.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7897000000000001e-05 2024-09-17T02:22:01.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:01.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584183+0000", 2024-09-17T02:22:01.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2814e-05 2024-09-17T02:22:01.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584299+0000", 2024-09-17T02:22:01.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116153 2024-09-17T02:22:01.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:01.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584316+0000", 2024-09-17T02:22:01.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7524999999999999e-05 2024-09-17T02:22:01.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563461+0000", 2024-09-17T02:22:01.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97914436699999996 2024-09-17T02:22:01.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:01.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563667+0000", 2024-09-17T02:22:01.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020689800000000001 2024-09-17T02:22:01.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:01.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563878+0000", 2024-09-17T02:22:01.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210275 2024-09-17T02:22:01.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:01.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570584+0000", 2024-09-17T02:22:01.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067066080000000002 2024-09-17T02:22:01.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:01.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574539+0000", 2024-09-17T02:22:01.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039550360000000003 2024-09-17T02:22:01.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:01.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574653+0000", 2024-09-17T02:22:01.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114003 2024-09-17T02:22:01.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:01.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574879+0000", 2024-09-17T02:22:01.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022523700000000001 2024-09-17T02:22:01.801 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.801 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:01.801 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.802 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129553 5.4 5:2e41ad40:::benchmark_data_smithi001_23533_object1436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:01.802 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:01.802 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.124709862, 2024-09-17T02:22:01.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99213429600000003, 2024-09-17T02:22:01.802 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:01.802 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:01.802 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:01.802 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:01.802 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:01.802 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:01.802 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129553 2024-09-17T02:22:01.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.803 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:01.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:01.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:01.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:01.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:01.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:01.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589557+0000", 2024-09-17T02:22:01.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2219999999999999e-06 2024-09-17T02:22:01.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:01.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589562+0000", 2024-09-17T02:22:01.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0649999999999998e-06 2024-09-17T02:22:01.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:01.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589575+0000", 2024-09-17T02:22:01.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3129000000000001e-05 2024-09-17T02:22:01.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:01.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589584+0000", 2024-09-17T02:22:01.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6200000000000005e-06 2024-09-17T02:22:01.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589693+0000", 2024-09-17T02:22:01.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109319 2024-09-17T02:22:01.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:01.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589714+0000", 2024-09-17T02:22:01.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0849999999999999e-05 2024-09-17T02:22:01.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566273+0000", 2024-09-17T02:22:01.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97655884999999998 2024-09-17T02:22:01.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:01.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566543+0000", 2024-09-17T02:22:01.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027059099999999998 2024-09-17T02:22:01.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:01.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566832+0000", 2024-09-17T02:22:01.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028898200000000002 2024-09-17T02:22:01.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:01.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581040+0000", 2024-09-17T02:22:01.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014208001 2024-09-17T02:22:01.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:01.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581200+0000", 2024-09-17T02:22:01.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159956 2024-09-17T02:22:01.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:01.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581427+0000", 2024-09-17T02:22:01.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000226309 2024-09-17T02:22:01.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:01.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581690+0000", 2024-09-17T02:22:01.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026340199999999998 2024-09-17T02:22:01.808 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.808 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:01.808 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.809 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129580 5.4 5:25ed887b:::benchmark_data_smithi001_23533_object1463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:01.809 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:01.809 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.102937818000001, 2024-09-17T02:22:01.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98001430499999997, 2024-09-17T02:22:01.809 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:01.809 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:01.809 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:01.809 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:01.809 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:01.809 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:01.809 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129580 2024-09-17T02:22:01.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.810 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:01.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:01.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:01.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:01.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:01.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:01.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611329+0000", 2024-09-17T02:22:01.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.22e-06 2024-09-17T02:22:01.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:01.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611335+0000", 2024-09-17T02:22:01.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1129999999999997e-06 2024-09-17T02:22:01.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:01.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611348+0000", 2024-09-17T02:22:01.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2342e-05 2024-09-17T02:22:01.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:01.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611356+0000", 2024-09-17T02:22:01.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.371e-06 2024-09-17T02:22:01.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611419+0000", 2024-09-17T02:22:01.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3393999999999996e-05 2024-09-17T02:22:01.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:01.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611427+0000", 2024-09-17T02:22:01.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999997e-06 2024-09-17T02:22:01.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570705+0000", 2024-09-17T02:22:01.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.95927859199999999 2024-09-17T02:22:01.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:01.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571009+0000", 2024-09-17T02:22:01.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030414599999999998 2024-09-17T02:22:01.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:01.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571241+0000", 2024-09-17T02:22:01.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023106799999999999 2024-09-17T02:22:01.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:01.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590789+0000", 2024-09-17T02:22:01.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019548763 2024-09-17T02:22:01.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:01.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590928+0000", 2024-09-17T02:22:01.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000139092 2024-09-17T02:22:01.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:01.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591086+0000", 2024-09-17T02:22:01.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015787400000000001 2024-09-17T02:22:01.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:01.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591342+0000", 2024-09-17T02:22:01.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025589900000000002 2024-09-17T02:22:01.815 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.815 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:01.815 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.816 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129603 5.4 5:25aaa5e8:::benchmark_data_smithi001_23533_object1486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:01.816 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:01.816 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.086878022, 2024-09-17T02:22:01.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96463198999999999, 2024-09-17T02:22:01.816 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:01.816 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:01.816 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:01.816 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:01.816 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:01.816 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:01.816 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129603 2024-09-17T02:22:01.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.817 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:01.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:01.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:01.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:01.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:01.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:01.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:01.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:22:01.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:01.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627392+0000", 2024-09-17T02:22:01.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0790000000000002e-06 2024-09-17T02:22:01.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:01.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627403+0000", 2024-09-17T02:22:01.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0866000000000001e-05 2024-09-17T02:22:01.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:01.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627409+0000", 2024-09-17T02:22:01.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.305e-06 2024-09-17T02:22:01.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627485+0000", 2024-09-17T02:22:01.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6582000000000006e-05 2024-09-17T02:22:01.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:01.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627499+0000", 2024-09-17T02:22:01.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:22:01.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574991+0000", 2024-09-17T02:22:01.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94749182300000001 2024-09-17T02:22:01.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:01.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575377+0000", 2024-09-17T02:22:01.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038629400000000003 2024-09-17T02:22:01.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:01.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575665+0000", 2024-09-17T02:22:01.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028759499999999997 2024-09-17T02:22:01.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:01.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590802+0000", 2024-09-17T02:22:01.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015136479 2024-09-17T02:22:01.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:01.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591614+0000", 2024-09-17T02:22:01.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081293100000000003 2024-09-17T02:22:01.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:01.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591764+0000", 2024-09-17T02:22:01.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014932199999999999 2024-09-17T02:22:01.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:01.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592020+0000", 2024-09-17T02:22:01.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025585099999999997 2024-09-17T02:22:01.822 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.822 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:01.822 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.823 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129607 5.4 5:2f638f1e:::benchmark_data_smithi001_23533_object1490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:01.823 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:01.823 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.085351115999998, 2024-09-17T02:22:01.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96352375899999998, 2024-09-17T02:22:01.823 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:01.823 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:01.823 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:01.823 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:01.823 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:01.823 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:01.823 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129607 2024-09-17T02:22:01.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.824 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:01.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:01.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:01.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:01.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:01.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:01.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628916+0000", 2024-09-17T02:22:01.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1710000000000001e-06 2024-09-17T02:22:01.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:01.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628920+0000", 2024-09-17T02:22:01.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-17T02:22:01.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:01.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628935+0000", 2024-09-17T02:22:01.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4474000000000001e-05 2024-09-17T02:22:01.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:01.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628944+0000", 2024-09-17T02:22:01.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9940000000000006e-06 2024-09-17T02:22:01.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628997+0000", 2024-09-17T02:22:01.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3579000000000003e-05 2024-09-17T02:22:01.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:01.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.629006+0000", 2024-09-17T02:22:01.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4009999999999997e-06 2024-09-17T02:22:01.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.577862+0000", 2024-09-17T02:22:01.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.948856335 2024-09-17T02:22:01.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:01.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578167+0000", 2024-09-17T02:22:01.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030532399999999999 2024-09-17T02:22:01.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:01.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578532+0000", 2024-09-17T02:22:01.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036428200000000001 2024-09-17T02:22:01.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:01.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591442+0000", 2024-09-17T02:22:01.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012910374000000001 2024-09-17T02:22:01.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:01.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592164+0000", 2024-09-17T02:22:01.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072242499999999996 2024-09-17T02:22:01.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:01.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592267+0000", 2024-09-17T02:22:01.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102205 2024-09-17T02:22:01.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:01.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592438+0000", 2024-09-17T02:22:01.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017165299999999999 2024-09-17T02:22:01.830 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.830 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:01.830 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.830 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129623 5.4 5:2cf5174b:::benchmark_data_smithi001_23533_object1506:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:01.830 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:01.830 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.061406829999999, 2024-09-17T02:22:01.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94334114499999999, 2024-09-17T02:22:01.830 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:01.830 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:01.830 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:01.830 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:01.831 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:01.831 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:01.831 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129623 2024-09-17T02:22:01.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.831 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:01.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:01.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:01.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:01.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:01.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:01.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652860+0000", 2024-09-17T02:22:01.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0330000000000001e-06 2024-09-17T02:22:01.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:01.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652864+0000", 2024-09-17T02:22:01.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.634e-06 2024-09-17T02:22:01.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:01.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652877+0000", 2024-09-17T02:22:01.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2591e-05 2024-09-17T02:22:01.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:01.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652883+0000", 2024-09-17T02:22:01.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1460000000000001e-06 2024-09-17T02:22:01.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652943+0000", 2024-09-17T02:22:01.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9833999999999997e-05 2024-09-17T02:22:01.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:01.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652950+0000", 2024-09-17T02:22:01.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.401e-06 2024-09-17T02:22:01.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581800+0000", 2024-09-17T02:22:01.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.92884935700000004 2024-09-17T02:22:01.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:01.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582122+0000", 2024-09-17T02:22:01.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032185200000000002 2024-09-17T02:22:01.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:01.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582689+0000", 2024-09-17T02:22:01.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056750400000000003 2024-09-17T02:22:01.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:01.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591458+0000", 2024-09-17T02:22:01.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008768685 2024-09-17T02:22:01.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:01.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595856+0000", 2024-09-17T02:22:01.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043977909999999999 2024-09-17T02:22:01.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:01.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595955+0000", 2024-09-17T02:22:01.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9166000000000006e-05 2024-09-17T02:22:01.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:01.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596200+0000", 2024-09-17T02:22:01.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024515099999999998 2024-09-17T02:22:01.837 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.837 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:01.837 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.837 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129642 5.4 5:255eb796:::benchmark_data_smithi001_23533_object1525:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:01.837 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:01.837 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.030170666, 2024-09-17T02:22:01.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.91257397299999998, 2024-09-17T02:22:01.837 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:01.838 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:01.838 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:01.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:01.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:01.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:01.838 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129642 2024-09-17T02:22:01.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.838 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:01.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:01.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:01.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:01.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:01.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:01.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684096+0000", 2024-09-17T02:22:01.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659999999999999e-06 2024-09-17T02:22:01.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:01.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684101+0000", 2024-09-17T02:22:01.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8110000000000002e-06 2024-09-17T02:22:01.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:01.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684114+0000", 2024-09-17T02:22:01.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2653000000000001e-05 2024-09-17T02:22:01.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:01.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684121+0000", 2024-09-17T02:22:01.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5100000000000001e-06 2024-09-17T02:22:01.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684181+0000", 2024-09-17T02:22:01.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0307999999999999e-05 2024-09-17T02:22:01.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:01.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684194+0000", 2024-09-17T02:22:01.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2916e-05 2024-09-17T02:22:01.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.587917+0000", 2024-09-17T02:22:01.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.90372220400000003 2024-09-17T02:22:01.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:01.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588215+0000", 2024-09-17T02:22:01.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029845400000000003 2024-09-17T02:22:01.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:01.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588470+0000", 2024-09-17T02:22:01.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025455399999999999 2024-09-17T02:22:01.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:01.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596318+0000", 2024-09-17T02:22:01.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078485589999999997 2024-09-17T02:22:01.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:01.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596354+0000", 2024-09-17T02:22:01.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5976999999999998e-05 2024-09-17T02:22:01.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:01.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596449+0000", 2024-09-17T02:22:01.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4728999999999994e-05 2024-09-17T02:22:01.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:01.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596669+0000", 2024-09-17T02:22:01.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220132 2024-09-17T02:22:01.844 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.844 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:01.844 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.844 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129649 5.4 5:2fe27050:::benchmark_data_smithi001_23533_object1532:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:01.844 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:01.844 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.998613923000001, 2024-09-17T02:22:01.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.88508119100000004, 2024-09-17T02:22:01.844 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:01.844 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:01.845 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:01.845 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:01.845 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:01.845 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:01.845 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129649 2024-09-17T02:22:01.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.845 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:01.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:01.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:01.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:01.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:01.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:01.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:01.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715653+0000", 2024-09-17T02:22:01.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3519999999999999e-06 2024-09-17T02:22:01.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:01.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715658+0000", 2024-09-17T02:22:01.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3120000000000001e-06 2024-09-17T02:22:01.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:01.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715677+0000", 2024-09-17T02:22:01.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-17T02:22:01.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:01.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715687+0000", 2024-09-17T02:22:01.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0146000000000001e-05 2024-09-17T02:22:01.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715821+0000", 2024-09-17T02:22:01.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013421 2024-09-17T02:22:01.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:01.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715840+0000", 2024-09-17T02:22:01.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8153999999999999e-05 2024-09-17T02:22:01.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:01.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592528+0000", 2024-09-17T02:22:01.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.87668860000000004 2024-09-17T02:22:01.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:01.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592702+0000", 2024-09-17T02:22:01.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017429300000000001 2024-09-17T02:22:01.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:01.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592945+0000", 2024-09-17T02:22:01.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000242048 2024-09-17T02:22:01.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:01.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600234+0000", 2024-09-17T02:22:01.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072897600000000002 2024-09-17T02:22:01.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:01.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600494+0000", 2024-09-17T02:22:01.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000259984 2024-09-17T02:22:01.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:01.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600555+0000", 2024-09-17T02:22:01.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1138999999999999e-05 2024-09-17T02:22:01.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:01.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:01.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:01.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600733+0000", 2024-09-17T02:22:01.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017753300000000001 2024-09-17T02:22:01.851 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.851 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:01.851 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.851 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:01.851 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:01.851 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:01.852 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:01.856+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:01.853 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:01.953 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:01.955+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:02.010 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:02.010 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:22:02.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.010 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:183884 5.a 5:5b9419f1:::benchmark_data_smithi001_23533_object55767:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-17T02:22:02.010 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:02.004314+0000", 2024-09-17T02:22:02.010 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0087418819999999994, 2024-09-17T02:22:02.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0087716319999999997, 2024-09-17T02:22:02.010 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.010 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.010 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:02.011 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:02.011 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:02.011 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.011 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 183884 2024-09-17T02:22:02.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.011 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.004314+0000", 2024-09-17T02:22:02.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.004314+0000", 2024-09-17T02:22:02.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.004314+0000", 2024-09-17T02:22:02.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9299999999999999e-07 2024-09-17T02:22:02.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.004316+0000", 2024-09-17T02:22:02.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.17e-06 2024-09-17T02:22:02.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.004324+0000", 2024-09-17T02:22:02.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8210000000000002e-06 2024-09-17T02:22:02.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.004329+0000", 2024-09-17T02:22:02.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8289999999999998e-06 2024-09-17T02:22:02.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.004950+0000", 2024-09-17T02:22:02.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00062092799999999997 2024-09-17T02:22:02.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.005111+0000", 2024-09-17T02:22:02.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016137000000000001 2024-09-17T02:22:02.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:02.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.005276+0000", 2024-09-17T02:22:02.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000164196 2024-09-17T02:22:02.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:02.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.008779+0000", 2024-09-17T02:22:02.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035033709999999999 2024-09-17T02:22:02.015 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.015 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.015 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.015 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:183886 5.b e62/51 5:d23652e4:::benchmark_data_smithi001_23533_object55769:head v 62'11341, mlcod=62'11338)", 2024-09-17T02:22:02.015 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:02.007588+0000", 2024-09-17T02:22:02.015 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0054678590000000003, 2024-09-17T02:22:02.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055942159999999999, 2024-09-17T02:22:02.016 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.016 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.016 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:02.016 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.007588+0000", 2024-09-17T02:22:02.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.007588+0000", 2024-09-17T02:22:02.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.007588+0000", 2024-09-17T02:22:02.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3000000000000001e-07 2024-09-17T02:22:02.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.007593+0000", 2024-09-17T02:22:02.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5700000000000003e-06 2024-09-17T02:22:02.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.007603+0000", 2024-09-17T02:22:02.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8260000000000005e-06 2024-09-17T02:22:02.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.007610+0000", 2024-09-17T02:22:02.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2089999999999999e-06 2024-09-17T02:22:02.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.007647+0000", 2024-09-17T02:22:02.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6937000000000002e-05 2024-09-17T02:22:02.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.007660+0000", 2024-09-17T02:22:02.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3337e-05 2024-09-17T02:22:02.019 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.019 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.019 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.019 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:183889 5.0 5:0cfcebc0:::benchmark_data_smithi001_23533_object55772:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-17T02:22:02.019 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:02.008040+0000", 2024-09-17T02:22:02.019 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0050159489999999996, 2024-09-17T02:22:02.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051774910000000002, 2024-09-17T02:22:02.020 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.020 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.020 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:02.020 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:02.020 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:02.020 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.020 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 183889 2024-09-17T02:22:02.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.020 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.008040+0000", 2024-09-17T02:22:02.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.008040+0000", 2024-09-17T02:22:02.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.008040+0000", 2024-09-17T02:22:02.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9200000000000001e-07 2024-09-17T02:22:02.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.008043+0000", 2024-09-17T02:22:02.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3630000000000001e-06 2024-09-17T02:22:02.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.008049+0000", 2024-09-17T02:22:02.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7449999999999998e-06 2024-09-17T02:22:02.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.008054+0000", 2024-09-17T02:22:02.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9509999999999997e-06 2024-09-17T02:22:02.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.009460+0000", 2024-09-17T02:22:02.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001405342 2024-09-17T02:22:02.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.009576+0000", 2024-09-17T02:22:02.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000115911 2024-09-17T02:22:02.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:02.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.009682+0000", 2024-09-17T02:22:02.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010602099999999999 2024-09-17T02:22:02.024 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.024 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.024 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.024 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:183890 5.0 5:011d9a09:::benchmark_data_smithi001_23533_object55773:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-17T02:22:02.024 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:02.008115+0000", 2024-09-17T02:22:02.024 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0049403629999999997, 2024-09-17T02:22:02.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051412130000000004, 2024-09-17T02:22:02.024 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.024 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.024 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:02.025 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:02.025 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:02.025 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.025 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 183890 2024-09-17T02:22:02.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.025 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.008115+0000", 2024-09-17T02:22:02.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.008115+0000", 2024-09-17T02:22:02.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.008116+0000", 2024-09-17T02:22:02.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8599999999999998e-07 2024-09-17T02:22:02.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.008119+0000", 2024-09-17T02:22:02.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6620000000000001e-06 2024-09-17T02:22:02.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.008125+0000", 2024-09-17T02:22:02.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8140000000000003e-06 2024-09-17T02:22:02.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.008132+0000", 2024-09-17T02:22:02.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1689999999999997e-06 2024-09-17T02:22:02.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.012151+0000", 2024-09-17T02:22:02.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040192029999999998 2024-09-17T02:22:02.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.012263+0000", 2024-09-17T02:22:02.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000112123 2024-09-17T02:22:02.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:02.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.012371+0000", 2024-09-17T02:22:02.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000108464 2024-09-17T02:22:02.028 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.028 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.028 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.029 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:183891 5.2 5:4e535b93:::benchmark_data_smithi001_23533_object55774:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-17T02:22:02.029 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:02.010590+0000", 2024-09-17T02:22:02.029 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0024654239999999999, 2024-09-17T02:22:02.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002718083, 2024-09-17T02:22:02.029 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.029 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.029 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:02.029 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:02.029 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:02.029 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.029 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 183891 2024-09-17T02:22:02.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.029 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.010590+0000", 2024-09-17T02:22:02.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.010590+0000", 2024-09-17T02:22:02.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.010591+0000", 2024-09-17T02:22:02.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3500000000000005e-07 2024-09-17T02:22:02.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.010595+0000", 2024-09-17T02:22:02.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9639999999999997e-06 2024-09-17T02:22:02.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.010607+0000", 2024-09-17T02:22:02.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1610999999999999e-05 2024-09-17T02:22:02.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.010615+0000", 2024-09-17T02:22:02.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1750000000000005e-06 2024-09-17T02:22:02.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.010677+0000", 2024-09-17T02:22:02.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1657999999999998e-05 2024-09-17T02:22:02.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.010800+0000", 2024-09-17T02:22:02.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012357000000000001 2024-09-17T02:22:02.032 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.032 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.033 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.033 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:183892 5.c 5:31a4cc4a:::benchmark_data_smithi001_23533_object55775:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-17T02:22:02.033 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:02.010987+0000", 2024-09-17T02:22:02.033 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0020683279999999999, 2024-09-17T02:22:02.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024008390000000001, 2024-09-17T02:22:02.033 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.033 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.033 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:02.033 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:02.033 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:02.033 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.034 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 183892 2024-09-17T02:22:02.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.034 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.010987+0000", 2024-09-17T02:22:02.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.010987+0000", 2024-09-17T02:22:02.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.010988+0000", 2024-09-17T02:22:02.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3799999999999996e-07 2024-09-17T02:22:02.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.010993+0000", 2024-09-17T02:22:02.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6890000000000003e-06 2024-09-17T02:22:02.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011003+0000", 2024-09-17T02:22:02.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.645e-06 2024-09-17T02:22:02.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011010+0000", 2024-09-17T02:22:02.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5610000000000001e-06 2024-09-17T02:22:02.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011058+0000", 2024-09-17T02:22:02.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7926000000000002e-05 2024-09-17T02:22:02.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011168+0000", 2024-09-17T02:22:02.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109585 2024-09-17T02:22:02.037 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.037 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.037 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.037 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:183895 5.7 5:ef65d898:::benchmark_data_smithi001_23533_object55778:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-17T02:22:02.037 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:02.011247+0000", 2024-09-17T02:22:02.037 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0018090739999999999, 2024-09-17T02:22:02.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002213502, 2024-09-17T02:22:02.037 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.037 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.037 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:02.037 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:02.038 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:02.038 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.038 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 183895 2024-09-17T02:22:02.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.038 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011247+0000", 2024-09-17T02:22:02.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011247+0000", 2024-09-17T02:22:02.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011248+0000", 2024-09-17T02:22:02.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0380000000000001e-06 2024-09-17T02:22:02.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011252+0000", 2024-09-17T02:22:02.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0770000000000001e-06 2024-09-17T02:22:02.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011263+0000", 2024-09-17T02:22:02.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1069e-05 2024-09-17T02:22:02.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011270+0000", 2024-09-17T02:22:02.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9439999999999999e-06 2024-09-17T02:22:02.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011326+0000", 2024-09-17T02:22:02.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6227999999999998e-05 2024-09-17T02:22:02.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011435+0000", 2024-09-17T02:22:02.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010886 2024-09-17T02:22:02.041 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.041 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.041 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.041 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:183896 5.0 5.7b5be0f0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-17T02:22:02.041 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:02.011360+0000", 2024-09-17T02:22:02.041 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00169542, 2024-09-17T02:22:02.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021715940000000002, 2024-09-17T02:22:02.041 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.041 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.041 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:02.041 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:02.042 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:02.042 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.042 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 183896 2024-09-17T02:22:02.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.042 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011360+0000", 2024-09-17T02:22:02.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011360+0000", 2024-09-17T02:22:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011361+0000", 2024-09-17T02:22:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5199999999999996e-07 2024-09-17T02:22:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011365+0000", 2024-09-17T02:22:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.461e-06 2024-09-17T02:22:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011374+0000", 2024-09-17T02:22:02.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0669999999999998e-06 2024-09-17T02:22:02.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011384+0000", 2024-09-17T02:22:02.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0360000000000001e-05 2024-09-17T02:22:02.044 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.044 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.044 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.045 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:183894 5.b e62/51 5:dc5d9305:::benchmark_data_smithi001_23533_object55777:head v 62'11342, mlcod=62'11339)", 2024-09-17T02:22:02.045 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:02.011490+0000", 2024-09-17T02:22:02.045 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001566165, 2024-09-17T02:22:02.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021041580000000001, 2024-09-17T02:22:02.045 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.045 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.045 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:02.045 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011490+0000", 2024-09-17T02:22:02.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011490+0000", 2024-09-17T02:22:02.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011490+0000", 2024-09-17T02:22:02.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9100000000000004e-07 2024-09-17T02:22:02.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011497+0000", 2024-09-17T02:22:02.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1749999999999999e-06 2024-09-17T02:22:02.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011506+0000", 2024-09-17T02:22:02.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4840000000000004e-06 2024-09-17T02:22:02.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011512+0000", 2024-09-17T02:22:02.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8549999999999998e-06 2024-09-17T02:22:02.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011558+0000", 2024-09-17T02:22:02.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6446000000000002e-05 2024-09-17T02:22:02.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011580+0000", 2024-09-17T02:22:02.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2089000000000001e-05 2024-09-17T02:22:02.048 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.048 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.048 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:183897 5.0 5.20648bb0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-17T02:22:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:02.011713+0000", 2024-09-17T02:22:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0013423739999999999, 2024-09-17T02:22:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001940949, 2024-09-17T02:22:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 183897 2024-09-17T02:22:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011713+0000", 2024-09-17T02:22:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011713+0000", 2024-09-17T02:22:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011714+0000", 2024-09-17T02:22:02.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6899999999999996e-07 2024-09-17T02:22:02.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011719+0000", 2024-09-17T02:22:02.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4109999999999998e-06 2024-09-17T02:22:02.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011758+0000", 2024-09-17T02:22:02.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9209999999999999e-05 2024-09-17T02:22:02.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.011764+0000", 2024-09-17T02:22:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4749999999999998e-06 2024-09-17T02:22:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:183898 5.7 5.43cdc9f7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-17T02:22:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:02.012626+0000", 2024-09-17T02:22:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00043014399999999998, 2024-09-17T02:22:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010847739999999999, 2024-09-17T02:22:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-17T02:22:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 183898 2024-09-17T02:22:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.012626+0000", 2024-09-17T02:22:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.012626+0000", 2024-09-17T02:22:02.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.012626+0000", 2024-09-17T02:22:02.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1900000000000001e-07 2024-09-17T02:22:02.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.012630+0000", 2024-09-17T02:22:02.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0239999999999999e-06 2024-09-17T02:22:02.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.012642+0000", 2024-09-17T02:22:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1255e-05 2024-09-17T02:22:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.012650+0000", 2024-09-17T02:22:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0260000000000007e-06 2024-09-17T02:22:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.013698+0000", 2024-09-17T02:22:02.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010482219999999999 2024-09-17T02:22:02.056 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.056 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.056 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.056 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:183881 5.8 5:1f5deeb9:::benchmark_data_smithi001_23533_object55764:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-17T02:22:02.056 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:02.003821+0000", 2024-09-17T02:22:02.056 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0092352400000000005, 2024-09-17T02:22:02.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0099552449999999997, 2024-09-17T02:22:02.056 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.056 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.056 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 183881 2024-09-17T02:22:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.003821+0000", 2024-09-17T02:22:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.003821+0000", 2024-09-17T02:22:02.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.003821+0000", 2024-09-17T02:22:02.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0499999999999999e-07 2024-09-17T02:22:02.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.003823+0000", 2024-09-17T02:22:02.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-09-17T02:22:02.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.003829+0000", 2024-09-17T02:22:02.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1940000000000003e-06 2024-09-17T02:22:02.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.003835+0000", 2024-09-17T02:22:02.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1590000000000001e-06 2024-09-17T02:22:02.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.003884+0000", 2024-09-17T02:22:02.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9738999999999999e-05 2024-09-17T02:22:02.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.004041+0000", 2024-09-17T02:22:02.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015647999999999999 2024-09-17T02:22:02.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:02.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.004171+0000", 2024-09-17T02:22:02.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130445 2024-09-17T02:22:02.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:02.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:02.009480+0000", 2024-09-17T02:22:02.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053084179999999996 2024-09-17T02:22:02.061 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.061 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.061 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.061 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.061 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:22:02.061 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 12 2024-09-17T02:22:02.061 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:02.062 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T02:22:02.063 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:02.063+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:02.064 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:02.165 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:02.163+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:02.216 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:02.216 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:22:02.216 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:22:02.216 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:22:02.217 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:02.236 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:02.284 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:02.284+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:02.366 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:02.367+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:02.393 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:02.393 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:22:02.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:22:02.393 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:22:02.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.393 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:22:02.393 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:02.393 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 79.826196822, 2024-09-17T02:22:02.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:22:02.393 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.394 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.394 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:02.394 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:02.394 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:02.394 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.394 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:22:02.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.394 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:02.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:02.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:22:02.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:22:02.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:22:02.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:22:02.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:22:02.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:22:02.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:22:02.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:22:02.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:22:02.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:22:02.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:22:02.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:22:02.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:02.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:22:02.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:22:02.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:02.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:22:02.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:22:02.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:02.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:22:02.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:22:02.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:02.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:22:02.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:22:02.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:02.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:22:02.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:22:02.401 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.401 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.401 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.402 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:22:02.402 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:02.402 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 79.822294572000004, 2024-09-17T02:22:02.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:22:02.402 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.402 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.402 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:02.402 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:02.402 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:02.402 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.402 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:22:02.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.403 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:02.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:02.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:22:02.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:22:02.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:22:02.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:22:02.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:22:02.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:22:02.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:22:02.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:22:02.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:22:02.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:22:02.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:22:02.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:22:02.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:02.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:22:02.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:22:02.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:02.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:22:02.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:22:02.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:02.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:22:02.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:22:02.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:02.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:22:02.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:22:02.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:02.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:22:02.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:22:02.408 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.408 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.408 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.408 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71206 5.3 e39/38 5:c6c9386d:::benchmark_data_smithi001_23533_object71205:head v 39'4517, mlcod=35'4513)", 2024-09-17T02:22:02.408 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:22:02.409 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.784967457, 2024-09-17T02:22:02.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026101868, 2024-09-17T02:22:02.409 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.409 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.409 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:02.409 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:22:02.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:22:02.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609694+0000", 2024-09-17T02:22:02.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9539999999999998e-06 2024-09-17T02:22:02.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609841+0000", 2024-09-17T02:22:02.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014690800000000001 2024-09-17T02:22:02.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609872+0000", 2024-09-17T02:22:02.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0326000000000001e-05 2024-09-17T02:22:02.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609892+0000", 2024-09-17T02:22:02.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9848999999999999e-05 2024-09-17T02:22:02.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613826+0000", 2024-09-17T02:22:02.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039345140000000001 2024-09-17T02:22:02.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613908+0000", 2024-09-17T02:22:02.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2412999999999999e-05 2024-09-17T02:22:02.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:02.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635696+0000", 2024-09-17T02:22:02.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021787597999999998 2024-09-17T02:22:02.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:02.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635794+0000", 2024-09-17T02:22:02.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8306000000000004e-05 2024-09-17T02:22:02.413 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.413 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.413 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.413 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97151 5.5 5:a0c2c072:::benchmark_data_smithi001_23533_object97150:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:02.413 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:22:02.414 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 45.126287849999997, 2024-09-17T02:22:02.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027297614000000001, 2024-09-17T02:22:02.414 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.414 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.414 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:02.414 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:02.414 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:02.414 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.414 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97151 2024-09-17T02:22:02.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.414 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:22:02.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:22:02.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268373+0000", 2024-09-17T02:22:02.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4000000000000002e-07 2024-09-17T02:22:02.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268423+0000", 2024-09-17T02:22:02.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0175e-05 2024-09-17T02:22:02.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268428+0000", 2024-09-17T02:22:02.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-17T02:22:02.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268431+0000", 2024-09-17T02:22:02.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.179e-06 2024-09-17T02:22:02.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283631+0000", 2024-09-17T02:22:02.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015199691 2024-09-17T02:22:02.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283740+0000", 2024-09-17T02:22:02.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109305 2024-09-17T02:22:02.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:02.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283863+0000", 2024-09-17T02:22:02.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012226699999999999 2024-09-17T02:22:02.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:02.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290857+0000", 2024-09-17T02:22:02.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069945449999999996 2024-09-17T02:22:02.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:02.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295595+0000", 2024-09-17T02:22:02.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047376750000000002 2024-09-17T02:22:02.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:02.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295638+0000", 2024-09-17T02:22:02.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3671999999999998e-05 2024-09-17T02:22:02.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:02.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295670+0000", 2024-09-17T02:22:02.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1266000000000002e-05 2024-09-17T02:22:02.420 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.420 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.420 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.420 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97759 5.a 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:02.420 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:02.420 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.796274748999998, 2024-09-17T02:22:02.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.089694871999999995, 2024-09-17T02:22:02.420 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.420 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.420 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:02.420 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:02.421 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:02.421 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.421 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97759 2024-09-17T02:22:02.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.421 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:02.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:02.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598386+0000", 2024-09-17T02:22:02.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999999e-07 2024-09-17T02:22:02.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598414+0000", 2024-09-17T02:22:02.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8013000000000001e-05 2024-09-17T02:22:02.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598420+0000", 2024-09-17T02:22:02.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1149999999999999e-06 2024-09-17T02:22:02.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598424+0000", 2024-09-17T02:22:02.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:22:02.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598479+0000", 2024-09-17T02:22:02.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4648999999999998e-05 2024-09-17T02:22:02.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598587+0000", 2024-09-17T02:22:02.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010853000000000001 2024-09-17T02:22:02.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:02.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598676+0000", 2024-09-17T02:22:02.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8381999999999995e-05 2024-09-17T02:22:02.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:02.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603766+0000", 2024-09-17T02:22:02.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050902559999999996 2024-09-17T02:22:02.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:02.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.687988+0000", 2024-09-17T02:22:02.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.084221753999999996 2024-09-17T02:22:02.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:02.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688037+0000", 2024-09-17T02:22:02.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-05 2024-09-17T02:22:02.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:02.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688080+0000", 2024-09-17T02:22:02.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3149999999999999e-05 2024-09-17T02:22:02.426 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.426 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.426 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.427 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97770 5.0 5:09c75033:::benchmark_data_smithi001_23533_object97769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:02.427 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:02.427 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.791132318999999, 2024-09-17T02:22:02.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.086380868, 2024-09-17T02:22:02.427 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.427 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.427 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:02.427 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:02.427 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:02.427 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.427 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97770 2024-09-17T02:22:02.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.427 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:02.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:02.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603529+0000", 2024-09-17T02:22:02.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:22:02.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603593+0000", 2024-09-17T02:22:02.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4216999999999999e-05 2024-09-17T02:22:02.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603603+0000", 2024-09-17T02:22:02.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5179999999999993e-06 2024-09-17T02:22:02.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603608+0000", 2024-09-17T02:22:02.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2039999999999996e-06 2024-09-17T02:22:02.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603653+0000", 2024-09-17T02:22:02.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5247000000000002e-05 2024-09-17T02:22:02.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603758+0000", 2024-09-17T02:22:02.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105352 2024-09-17T02:22:02.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:02.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603900+0000", 2024-09-17T02:22:02.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014198999999999999 2024-09-17T02:22:02.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:02.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.606097+0000", 2024-09-17T02:22:02.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021969839999999999 2024-09-17T02:22:02.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:02.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689756+0000", 2024-09-17T02:22:02.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.083659077999999998 2024-09-17T02:22:02.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:02.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689846+0000", 2024-09-17T02:22:02.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9320999999999994e-05 2024-09-17T02:22:02.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:02.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689908+0000", 2024-09-17T02:22:02.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720999999999998e-05 2024-09-17T02:22:02.433 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.433 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.433 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.433 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127513 5.c 5:3eca08e4:::benchmark_data_smithi001_23533_object127512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:02.433 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:02.433 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 29.950355895000001, 2024-09-17T02:22:02.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046626399999999998, 2024-09-17T02:22:02.433 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.433 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.434 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:02.434 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:02.434 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:02.434 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.434 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127513 2024-09-17T02:22:02.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.434 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:02.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:02.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444305+0000", 2024-09-17T02:22:02.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2529999999999999e-06 2024-09-17T02:22:02.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444466+0000", 2024-09-17T02:22:02.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016069700000000001 2024-09-17T02:22:02.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444479+0000", 2024-09-17T02:22:02.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2602999999999999e-05 2024-09-17T02:22:02.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444485+0000", 2024-09-17T02:22:02.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.669e-06 2024-09-17T02:22:02.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444560+0000", 2024-09-17T02:22:02.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4276999999999994e-05 2024-09-17T02:22:02.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444656+0000", 2024-09-17T02:22:02.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6490000000000006e-05 2024-09-17T02:22:02.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:02.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444739+0000", 2024-09-17T02:22:02.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3139999999999993e-05 2024-09-17T02:22:02.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:02.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.448438+0000", 2024-09-17T02:22:02.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036985490000000002 2024-09-17T02:22:02.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:02.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490732+0000", 2024-09-17T02:22:02.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042294353999999999 2024-09-17T02:22:02.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:02.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490859+0000", 2024-09-17T02:22:02.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012708899999999999 2024-09-17T02:22:02.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:02.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490930+0000", 2024-09-17T02:22:02.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:02.439 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.439 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.439 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.439 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127514 5.c 5:39cc1feb:::benchmark_data_smithi001_23533_object127513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:02.439 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:02.440 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 29.950159125999999, 2024-09-17T02:22:02.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049357228000000003, 2024-09-17T02:22:02.440 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.440 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.440 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:02.440 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:02.440 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:02.440 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.440 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127514 2024-09-17T02:22:02.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.440 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:02.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:02.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:02.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8599999999999998e-07 2024-09-17T02:22:02.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444554+0000", 2024-09-17T02:22:02.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3047999999999998e-05 2024-09-17T02:22:02.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444562+0000", 2024-09-17T02:22:02.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5830000000000001e-06 2024-09-17T02:22:02.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444567+0000", 2024-09-17T02:22:02.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4179999999999996e-06 2024-09-17T02:22:02.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446566+0000", 2024-09-17T02:22:02.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001998788 2024-09-17T02:22:02.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446696+0000", 2024-09-17T02:22:02.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129393 2024-09-17T02:22:02.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:02.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446794+0000", 2024-09-17T02:22:02.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8462999999999996e-05 2024-09-17T02:22:02.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:02.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.449036+0000", 2024-09-17T02:22:02.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022415880000000001 2024-09-17T02:22:02.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:02.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493737+0000", 2024-09-17T02:22:02.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044701682 2024-09-17T02:22:02.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:02.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493808+0000", 2024-09-17T02:22:02.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0846000000000006e-05 2024-09-17T02:22:02.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:02.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493858+0000", 2024-09-17T02:22:02.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9932999999999998e-05 2024-09-17T02:22:02.446 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.446 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.446 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.446 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129441 5.1 5:84c3199f:::benchmark_data_smithi001_23533_object1324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:02.446 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:02.447 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.891148638000001, 2024-09-17T02:22:02.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034387011000000002, 2024-09-17T02:22:02.447 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.447 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.447 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:02.447 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:02.447 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:02.447 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.447 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129441 2024-09-17T02:22:02.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.447 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:02.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:02.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503513+0000", 2024-09-17T02:22:02.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4759999999999999e-06 2024-09-17T02:22:02.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503518+0000", 2024-09-17T02:22:02.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-09-17T02:22:02.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503532+0000", 2024-09-17T02:22:02.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4049999999999999e-05 2024-09-17T02:22:02.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503541+0000", 2024-09-17T02:22:02.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5320000000000006e-06 2024-09-17T02:22:02.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506331+0000", 2024-09-17T02:22:02.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027899190000000001 2024-09-17T02:22:02.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506402+0000", 2024-09-17T02:22:02.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:02.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:02.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506477+0000", 2024-09-17T02:22:02.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4626e-05 2024-09-17T02:22:02.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:02.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509749+0000", 2024-09-17T02:22:02.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032726980000000001 2024-09-17T02:22:02.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:02.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537758+0000", 2024-09-17T02:22:02.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028008890000000002 2024-09-17T02:22:02.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:02.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537812+0000", 2024-09-17T02:22:02.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3300000000000001e-05 2024-09-17T02:22:02.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:02.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537898+0000", 2024-09-17T02:22:02.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6691000000000001e-05 2024-09-17T02:22:02.453 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.453 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.453 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.453 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129442 5.1 5:8f7f2a95:::benchmark_data_smithi001_23533_object1325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:02.453 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:02.453 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.888178028999999, 2024-09-17T02:22:02.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031546698999999997, 2024-09-17T02:22:02.453 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.453 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.453 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:02.453 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:02.454 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:02.454 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.454 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129442 2024-09-17T02:22:02.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.454 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:02.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:02.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506483+0000", 2024-09-17T02:22:02.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2869999999999999e-06 2024-09-17T02:22:02.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506489+0000", 2024-09-17T02:22:02.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2330000000000003e-06 2024-09-17T02:22:02.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506502+0000", 2024-09-17T02:22:02.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2286999999999999e-05 2024-09-17T02:22:02.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506511+0000", 2024-09-17T02:22:02.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7799999999999995e-06 2024-09-17T02:22:02.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.507966+0000", 2024-09-17T02:22:02.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014541549999999999 2024-09-17T02:22:02.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508130+0000", 2024-09-17T02:22:02.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016455199999999999 2024-09-17T02:22:02.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:02.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508287+0000", 2024-09-17T02:22:02.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015730400000000001 2024-09-17T02:22:02.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:02.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510577+0000", 2024-09-17T02:22:02.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022899449999999998 2024-09-17T02:22:02.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:02.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537932+0000", 2024-09-17T02:22:02.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027354471000000002 2024-09-17T02:22:02.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:02.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537964+0000", 2024-09-17T02:22:02.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1909999999999998e-05 2024-09-17T02:22:02.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:02.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.538029+0000", 2024-09-17T02:22:02.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4775000000000002e-05 2024-09-17T02:22:02.459 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.459 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.459 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.459 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129443 5.8 5:1edfeaf8:::benchmark_data_smithi001_23533_object1326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:02.460 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:22:02.460 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.884743529000001, 2024-09-17T02:22:02.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025315902000000001, 2024-09-17T02:22:02.460 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.460 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.460 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:02.460 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:02.460 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:02.460 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.460 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129443 2024-09-17T02:22:02.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.460 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:22:02.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:22:02.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509918+0000", 2024-09-17T02:22:02.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3689999999999999e-06 2024-09-17T02:22:02.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509923+0000", 2024-09-17T02:22:02.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0429999999999998e-06 2024-09-17T02:22:02.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509936+0000", 2024-09-17T02:22:02.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3234000000000001e-05 2024-09-17T02:22:02.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509950+0000", 2024-09-17T02:22:02.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3998999999999999e-05 2024-09-17T02:22:02.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509994+0000", 2024-09-17T02:22:02.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4323000000000002e-05 2024-09-17T02:22:02.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510095+0000", 2024-09-17T02:22:02.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010103300000000001 2024-09-17T02:22:02.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:02.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510160+0000", 2024-09-17T02:22:02.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4976999999999998e-05 2024-09-17T02:22:02.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:02.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.513304+0000", 2024-09-17T02:22:02.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031431330000000002 2024-09-17T02:22:02.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:02.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535046+0000", 2024-09-17T02:22:02.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021742276000000001 2024-09-17T02:22:02.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:02.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:22:02.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107759 2024-09-17T02:22:02.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:02.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535232+0000", 2024-09-17T02:22:02.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8756000000000003e-05 2024-09-17T02:22:02.466 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.466 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.466 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.466 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:138247 5.3 5:caf01f60:::benchmark_data_smithi001_23533_object10130:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:22:02.466 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.335014+0000", 2024-09-17T02:22:02.466 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.059645956000001, 2024-09-17T02:22:02.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026419469000000001, 2024-09-17T02:22:02.466 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.466 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.466 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:02.467 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:02.467 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:02.467 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.467 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 138247 2024-09-17T02:22:02.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.467 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335014+0000", 2024-09-17T02:22:02.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335014+0000", 2024-09-17T02:22:02.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335015+0000", 2024-09-17T02:22:02.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3600000000000004e-07 2024-09-17T02:22:02.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335017+0000", 2024-09-17T02:22:02.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5749999999999999e-06 2024-09-17T02:22:02.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335024+0000", 2024-09-17T02:22:02.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8379999999999996e-06 2024-09-17T02:22:02.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335029+0000", 2024-09-17T02:22:02.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.22e-06 2024-09-17T02:22:02.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335083+0000", 2024-09-17T02:22:02.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3600000000000002e-05 2024-09-17T02:22:02.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335229+0000", 2024-09-17T02:22:02.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000146098 2024-09-17T02:22:02.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:02.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335349+0000", 2024-09-17T02:22:02.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120631 2024-09-17T02:22:02.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:02.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.357942+0000", 2024-09-17T02:22:02.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022592457 2024-09-17T02:22:02.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:02.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.361286+0000", 2024-09-17T02:22:02.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003343623 2024-09-17T02:22:02.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:02.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.361338+0000", 2024-09-17T02:22:02.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2323e-05 2024-09-17T02:22:02.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:02.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.361433+0000", 2024-09-17T02:22:02.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5568000000000004e-05 2024-09-17T02:22:02.472 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.472 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.472 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.473 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:138244 5.b e54/51 5:d38c94c4:::benchmark_data_smithi001_23533_object10127:head v 54'8567, mlcod=54'8564)", 2024-09-17T02:22:02.473 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.336586+0000", 2024-09-17T02:22:02.473 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.058073566000001, 2024-09-17T02:22:02.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026602741999999999, 2024-09-17T02:22:02.473 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.473 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.473 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:02.473 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336586+0000", 2024-09-17T02:22:02.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336586+0000", 2024-09-17T02:22:02.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336587+0000", 2024-09-17T02:22:02.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0600000000000001e-07 2024-09-17T02:22:02.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336590+0000", 2024-09-17T02:22:02.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3110000000000001e-06 2024-09-17T02:22:02.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336597+0000", 2024-09-17T02:22:02.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0639999999999996e-06 2024-09-17T02:22:02.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336602+0000", 2024-09-17T02:22:02.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3599999999999998e-06 2024-09-17T02:22:02.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336645+0000", 2024-09-17T02:22:02.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3628999999999999e-05 2024-09-17T02:22:02.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336666+0000", 2024-09-17T02:22:02.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0604000000000001e-05 2024-09-17T02:22:02.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:02.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363143+0000", 2024-09-17T02:22:02.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026477055999999999 2024-09-17T02:22:02.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:02.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363189+0000", 2024-09-17T02:22:02.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6312e-05 2024-09-17T02:22:02.478 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.478 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.478 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.478 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:138259 5.3 5:c08b4023:::benchmark_data_smithi001_23533_object10142:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:22:02.478 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.337063+0000", 2024-09-17T02:22:02.478 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.057596748000002, 2024-09-17T02:22:02.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027773173000000002, 2024-09-17T02:22:02.479 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.479 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.479 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:02.479 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:02.479 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:02.479 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.479 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 138259 2024-09-17T02:22:02.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.479 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337063+0000", 2024-09-17T02:22:02.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337063+0000", 2024-09-17T02:22:02.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337064+0000", 2024-09-17T02:22:02.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-17T02:22:02.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337066+0000", 2024-09-17T02:22:02.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.03e-06 2024-09-17T02:22:02.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337072+0000", 2024-09-17T02:22:02.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5119999999999997e-06 2024-09-17T02:22:02.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337077+0000", 2024-09-17T02:22:02.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.454e-06 2024-09-17T02:22:02.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.352990+0000", 2024-09-17T02:22:02.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015913116000000001 2024-09-17T02:22:02.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.353136+0000", 2024-09-17T02:22:02.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000146117 2024-09-17T02:22:02.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:02.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.353253+0000", 2024-09-17T02:22:02.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117359 2024-09-17T02:22:02.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:02.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.358284+0000", 2024-09-17T02:22:02.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050306689999999998 2024-09-17T02:22:02.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:02.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.364738+0000", 2024-09-17T02:22:02.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064539410000000004 2024-09-17T02:22:02.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:02.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.364768+0000", 2024-09-17T02:22:02.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0086999999999998e-05 2024-09-17T02:22:02.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:02.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.364836+0000", 2024-09-17T02:22:02.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8549999999999999e-05 2024-09-17T02:22:02.485 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.485 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.485 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.485 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:138249 5.b e54/51 5:dcbad32d:::benchmark_data_smithi001_23533_object10132:head v 54'8568, mlcod=54'8564)", 2024-09-17T02:22:02.485 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.338016+0000", 2024-09-17T02:22:02.485 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.056644408, 2024-09-17T02:22:02.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025210803, 2024-09-17T02:22:02.485 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.485 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.485 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:02.486 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338016+0000", 2024-09-17T02:22:02.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338016+0000", 2024-09-17T02:22:02.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338017+0000", 2024-09-17T02:22:02.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.28e-06 2024-09-17T02:22:02.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338022+0000", 2024-09-17T02:22:02.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0950000000000003e-06 2024-09-17T02:22:02.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338032+0000", 2024-09-17T02:22:02.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7140000000000005e-06 2024-09-17T02:22:02.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338038+0000", 2024-09-17T02:22:02.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1029999999999998e-06 2024-09-17T02:22:02.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.349300+0000", 2024-09-17T02:22:02.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01126216 2024-09-17T02:22:02.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.349359+0000", 2024-09-17T02:22:02.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9206999999999997e-05 2024-09-17T02:22:02.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:02.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363192+0000", 2024-09-17T02:22:02.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013833253 2024-09-17T02:22:02.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:02.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363226+0000", 2024-09-17T02:22:02.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3991e-05 2024-09-17T02:22:02.489 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.489 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.489 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.490 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:139587 5.1 5:801d98ef:::benchmark_data_smithi001_23533_object11470:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:22:02.490 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.931670+0000", 2024-09-17T02:22:02.490 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.462989668999999, 2024-09-17T02:22:02.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025666268999999999, 2024-09-17T02:22:02.490 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.490 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.490 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:02.490 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:02.490 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:02.490 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.490 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 139587 2024-09-17T02:22:02.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.491 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931670+0000", 2024-09-17T02:22:02.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931670+0000", 2024-09-17T02:22:02.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931671+0000", 2024-09-17T02:22:02.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.034e-06 2024-09-17T02:22:02.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931677+0000", 2024-09-17T02:22:02.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4580000000000001e-06 2024-09-17T02:22:02.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931690+0000", 2024-09-17T02:22:02.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3152999999999999e-05 2024-09-17T02:22:02.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931699+0000", 2024-09-17T02:22:02.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3100000000000006e-06 2024-09-17T02:22:02.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931779+0000", 2024-09-17T02:22:02.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0284000000000006e-05 2024-09-17T02:22:02.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931968+0000", 2024-09-17T02:22:02.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018853399999999999 2024-09-17T02:22:02.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:02.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.932149+0000", 2024-09-17T02:22:02.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018114699999999999 2024-09-17T02:22:02.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:02.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.935163+0000", 2024-09-17T02:22:02.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030143169999999999 2024-09-17T02:22:02.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:02.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.957199+0000", 2024-09-17T02:22:02.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022035255 2024-09-17T02:22:02.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:02.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.957247+0000", 2024-09-17T02:22:02.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8319999999999998e-05 2024-09-17T02:22:02.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:02.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.957337+0000", 2024-09-17T02:22:02.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9456999999999994e-05 2024-09-17T02:22:02.496 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.496 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.496 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.497 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:140178 5.1 5:8f77d9ee:::benchmark_data_smithi001_23533_object12061:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:22:02.497 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:22:02.497 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.207204178000001, 2024-09-17T02:22:02.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025269478000000001, 2024-09-17T02:22:02.497 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.497 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.497 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:02.497 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:02.497 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:02.497 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.497 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 140178 2024-09-17T02:22:02.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.498 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:22:02.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:22:02.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:22:02.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0500000000000004e-07 2024-09-17T02:22:02.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187459+0000", 2024-09-17T02:22:02.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5299999999999999e-06 2024-09-17T02:22:02.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187468+0000", 2024-09-17T02:22:02.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3130000000000004e-06 2024-09-17T02:22:02.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187473+0000", 2024-09-17T02:22:02.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-09-17T02:22:02.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.192476+0000", 2024-09-17T02:22:02.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050035339999999996 2024-09-17T02:22:02.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.192603+0000", 2024-09-17T02:22:02.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012652299999999999 2024-09-17T02:22:02.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:02.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.192719+0000", 2024-09-17T02:22:02.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011568700000000001 2024-09-17T02:22:02.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:02.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.196336+0000", 2024-09-17T02:22:02.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003617178 2024-09-17T02:22:02.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:02.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.212470+0000", 2024-09-17T02:22:02.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016134402999999999 2024-09-17T02:22:02.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:02.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.212522+0000", 2024-09-17T02:22:02.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1480000000000002e-05 2024-09-17T02:22:02.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:02.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.212725+0000", 2024-09-17T02:22:02.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020359100000000001 2024-09-17T02:22:02.503 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.503 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.503 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.503 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:150456 5.2 5:4ee9ae1c:::benchmark_data_smithi001_23533_object22339:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:22:02.503 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.838305+0000", 2024-09-17T02:22:02.503 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.556354952, 2024-09-17T02:22:02.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026350045999999998, 2024-09-17T02:22:02.503 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.503 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.504 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:02.504 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:02.504 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:02.504 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.504 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 150456 2024-09-17T02:22:02.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.504 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838305+0000", 2024-09-17T02:22:02.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838305+0000", 2024-09-17T02:22:02.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838305+0000", 2024-09-17T02:22:02.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4999999999999998e-07 2024-09-17T02:22:02.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838308+0000", 2024-09-17T02:22:02.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.187e-06 2024-09-17T02:22:02.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838314+0000", 2024-09-17T02:22:02.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2400000000000004e-06 2024-09-17T02:22:02.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838318+0000", 2024-09-17T02:22:02.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5020000000000003e-06 2024-09-17T02:22:02.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.840927+0000", 2024-09-17T02:22:02.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026083690000000001 2024-09-17T02:22:02.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.841037+0000", 2024-09-17T02:22:02.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109888 2024-09-17T02:22:02.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:02.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.864539+0000", 2024-09-17T02:22:02.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023502788 2024-09-17T02:22:02.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:02.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.864586+0000", 2024-09-17T02:22:02.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6554999999999997e-05 2024-09-17T02:22:02.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:02.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.864655+0000", 2024-09-17T02:22:02.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9066999999999994e-05 2024-09-17T02:22:02.509 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.509 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.509 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.509 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:150458 5.a 5:59b62890:::benchmark_data_smithi001_23533_object22341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:22:02.509 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:02.509 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.556334222, 2024-09-17T02:22:02.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028150173000000001, 2024-09-17T02:22:02.509 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.509 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.509 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:02.510 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:02.510 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:02.510 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.510 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 150458 2024-09-17T02:22:02.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.510 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:02.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:02.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:02.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7800000000000002e-07 2024-09-17T02:22:02.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838328+0000", 2024-09-17T02:22:02.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.838e-06 2024-09-17T02:22:02.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838335+0000", 2024-09-17T02:22:02.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1999999999999997e-06 2024-09-17T02:22:02.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838340+0000", 2024-09-17T02:22:02.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7389999999999999e-06 2024-09-17T02:22:02.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849082+0000", 2024-09-17T02:22:02.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01074174 2024-09-17T02:22:02.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849192+0000", 2024-09-17T02:22:02.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011040300000000001 2024-09-17T02:22:02.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:02.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849297+0000", 2024-09-17T02:22:02.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104764 2024-09-17T02:22:02.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:02.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.857853+0000", 2024-09-17T02:22:02.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085558490000000008 2024-09-17T02:22:02.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:02.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866430+0000", 2024-09-17T02:22:02.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085768140000000003 2024-09-17T02:22:02.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:02.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866454+0000", 2024-09-17T02:22:02.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4428000000000001e-05 2024-09-17T02:22:02.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:02.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866476+0000", 2024-09-17T02:22:02.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.192e-05 2024-09-17T02:22:02.515 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.515 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.515 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.515 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:150461 5.a 5:58886edc:::benchmark_data_smithi001_23533_object22344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:22:02.515 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.838709+0000", 2024-09-17T02:22:02.515 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.555950908, 2024-09-17T02:22:02.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027819366000000002, 2024-09-17T02:22:02.516 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:02.516 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:02.516 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:02.516 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:02.516 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:02.516 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.516 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 150461 2024-09-17T02:22:02.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.516 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:02.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:02.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838709+0000", 2024-09-17T02:22:02.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:02.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838709+0000", 2024-09-17T02:22:02.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:02.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:02.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838710+0000", 2024-09-17T02:22:02.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9399999999999995e-07 2024-09-17T02:22:02.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:02.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838712+0000", 2024-09-17T02:22:02.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.57e-06 2024-09-17T02:22:02.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:02.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838843+0000", 2024-09-17T02:22:02.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130469 2024-09-17T02:22:02.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838925+0000", 2024-09-17T02:22:02.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2622999999999998e-05 2024-09-17T02:22:02.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:02.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.855341+0000", 2024-09-17T02:22:02.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016415965000000001 2024-09-17T02:22:02.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:02.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.855509+0000", 2024-09-17T02:22:02.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016805800000000001 2024-09-17T02:22:02.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:02.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.855638+0000", 2024-09-17T02:22:02.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012901199999999999 2024-09-17T02:22:02.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:02.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.860084+0000", 2024-09-17T02:22:02.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044458650000000002 2024-09-17T02:22:02.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:02.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866486+0000", 2024-09-17T02:22:02.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064016919999999996 2024-09-17T02:22:02.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:02.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866505+0000", 2024-09-17T02:22:02.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9667e-05 2024-09-17T02:22:02.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:02.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:02.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:02.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866528+0000", 2024-09-17T02:22:02.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2951000000000001e-05 2024-09-17T02:22:02.521 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.521 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.521 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.521 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:02.521 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:02.521 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:02.523 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:02.524+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:02.523 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:02.623 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:02.624+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:02.690 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:02.690 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:22:02.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.690 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:185380 5.b 5:ddf37992:::benchmark_data_smithi001_23533_object57263:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-17T02:22:02.690 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:02.686255+0000", 2024-09-17T02:22:02.690 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0073010760000000001, 2024-09-17T02:22:02.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073296239999999999, 2024-09-17T02:22:02.691 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:02.691 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:02.691 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:02.691 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:02.691 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:02.691 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.691 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 185380 2024-09-17T02:22:02.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.691 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:02.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:02.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.686255+0000", 2024-09-17T02:22:02.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:02.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:02.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.686255+0000", 2024-09-17T02:22:02.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:02.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:02.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.686255+0000", 2024-09-17T02:22:02.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8100000000000003e-07 2024-09-17T02:22:02.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:02.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.686265+0000", 2024-09-17T02:22:02.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3659999999999998e-06 2024-09-17T02:22:02.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:02.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.686282+0000", 2024-09-17T02:22:02.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6926999999999999e-05 2024-09-17T02:22:02.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.686290+0000", 2024-09-17T02:22:02.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3119999999999994e-06 2024-09-17T02:22:02.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:02.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.686339+0000", 2024-09-17T02:22:02.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8810999999999997e-05 2024-09-17T02:22:02.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:02.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.686466+0000", 2024-09-17T02:22:02.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012778099999999999 2024-09-17T02:22:02.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:02.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.686584+0000", 2024-09-17T02:22:02.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117348 2024-09-17T02:22:02.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:02.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690778+0000", 2024-09-17T02:22:02.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041938089999999997 2024-09-17T02:22:02.696 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:02.696 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:02.696 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:02.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.696 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:185381 5.b 5:d49e7c9a:::benchmark_data_smithi001_23533_object57264:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-17T02:22:02.696 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:02.686320+0000", 2024-09-17T02:22:02.696 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0072360560000000003, 2024-09-17T02:22:02.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073533349999999999, 2024-09-17T02:22:02.696 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:02.696 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:02.696 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:02.696 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:02.697 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:02.697 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.697 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 185381 2024-09-17T02:22:02.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.697 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:02.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:02.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.686320+0000", 2024-09-17T02:22:02.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:02.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:02.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.686320+0000", 2024-09-17T02:22:02.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:02.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:02.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.686320+0000", 2024-09-17T02:22:02.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1099999999999995e-07 2024-09-17T02:22:02.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:02.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.686327+0000", 2024-09-17T02:22:02.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6259999999999997e-06 2024-09-17T02:22:02.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:02.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.686336+0000", 2024-09-17T02:22:02.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1849999999999993e-06 2024-09-17T02:22:02.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.686343+0000", 2024-09-17T02:22:02.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9709999999999998e-06 2024-09-17T02:22:02.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:02.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.688463+0000", 2024-09-17T02:22:02.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021194640000000002 2024-09-17T02:22:02.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:02.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.688537+0000", 2024-09-17T02:22:02.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4549999999999996e-05 2024-09-17T02:22:02.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:02.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.688628+0000", 2024-09-17T02:22:02.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1135000000000001e-05 2024-09-17T02:22:02.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:02.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.693275+0000", 2024-09-17T02:22:02.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046465819999999998 2024-09-17T02:22:02.701 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:02.701 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:02.701 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:02.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.701 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:185382 5.b 5:d08d9dbe:::benchmark_data_smithi001_23533_object57265:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-17T02:22:02.701 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:02.686354+0000", 2024-09-17T02:22:02.701 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0072017119999999999, 2024-09-17T02:22:02.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.007408258, 2024-09-17T02:22:02.702 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:02.702 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:02.702 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:02.702 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:02.702 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:02.702 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.702 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 185382 2024-09-17T02:22:02.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.702 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:02.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:02.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.686354+0000", 2024-09-17T02:22:02.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:02.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:02.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.686354+0000", 2024-09-17T02:22:02.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:02.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:02.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.686355+0000", 2024-09-17T02:22:02.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2500000000000005e-07 2024-09-17T02:22:02.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:02.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.686357+0000", 2024-09-17T02:22:02.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6570000000000001e-06 2024-09-17T02:22:02.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:02.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.686364+0000", 2024-09-17T02:22:02.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9149999999999999e-06 2024-09-17T02:22:02.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.686370+0000", 2024-09-17T02:22:02.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3720000000000004e-06 2024-09-17T02:22:02.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:02.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.693418+0000", 2024-09-17T02:22:02.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0070487170000000004 2024-09-17T02:22:02.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:02.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.693544+0000", 2024-09-17T02:22:02.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012591499999999999 2024-09-17T02:22:02.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:02.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.693694+0000", 2024-09-17T02:22:02.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014988299999999999 2024-09-17T02:22:02.706 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:02.706 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:02.706 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:02.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.706 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:185380 5.b e62/51 ondisk, result = 0)", 2024-09-17T02:22:02.706 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:02.690081+0000", 2024-09-17T02:22:02.706 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.003474942, 2024-09-17T02:22:02.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037605519999999999, 2024-09-17T02:22:02.706 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:02.706 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:02.707 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:02.707 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:02.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:02.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690081+0000", 2024-09-17T02:22:02.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:02.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:02.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690081+0000", 2024-09-17T02:22:02.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:02.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:02.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690082+0000", 2024-09-17T02:22:02.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5899999999999995e-07 2024-09-17T02:22:02.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:02.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690086+0000", 2024-09-17T02:22:02.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1250000000000003e-06 2024-09-17T02:22:02.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:02.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690099+0000", 2024-09-17T02:22:02.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2867999999999999e-05 2024-09-17T02:22:02.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690106+0000", 2024-09-17T02:22:02.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4159999999999998e-06 2024-09-17T02:22:02.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:02.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690763+0000", 2024-09-17T02:22:02.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065706399999999996 2024-09-17T02:22:02.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:02.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690770+0000", 2024-09-17T02:22:02.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3849999999999996e-06 2024-09-17T02:22:02.710 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:02.710 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:02.710 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:02.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.710 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:185392 5.1 5:8ddf553e:::benchmark_data_smithi001_23533_object57275:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-17T02:22:02.710 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:02.690260+0000", 2024-09-17T02:22:02.710 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0032961930000000002, 2024-09-17T02:22:02.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036308260000000002, 2024-09-17T02:22:02.710 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:02.710 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:02.710 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:02.710 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:02.711 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:02.711 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.711 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 185392 2024-09-17T02:22:02.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.711 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:02.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:02.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690260+0000", 2024-09-17T02:22:02.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:02.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:02.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690260+0000", 2024-09-17T02:22:02.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:02.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:02.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690261+0000", 2024-09-17T02:22:02.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.114e-06 2024-09-17T02:22:02.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:02.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690265+0000", 2024-09-17T02:22:02.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.527e-06 2024-09-17T02:22:02.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:02.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690279+0000", 2024-09-17T02:22:02.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.362e-05 2024-09-17T02:22:02.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690287+0000", 2024-09-17T02:22:02.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3459999999999994e-06 2024-09-17T02:22:02.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:02.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690339+0000", 2024-09-17T02:22:02.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2117000000000003e-05 2024-09-17T02:22:02.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:02.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690438+0000", 2024-09-17T02:22:02.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9117000000000007e-05 2024-09-17T02:22:02.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:02.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690546+0000", 2024-09-17T02:22:02.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010762100000000001 2024-09-17T02:22:02.714 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:02.715 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:02.715 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:02.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.715 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:185389 5.3 e62/51 5:ceff803d:::benchmark_data_smithi001_23533_object57272:head v 62'11673, mlcod=62'11671)", 2024-09-17T02:22:02.715 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:02.690515+0000", 2024-09-17T02:22:02.715 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0030411330000000001, 2024-09-17T02:22:02.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034327989999999998, 2024-09-17T02:22:02.715 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:02.716 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:02.716 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:02.716 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:02.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:02.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690515+0000", 2024-09-17T02:22:02.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:02.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:02.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690515+0000", 2024-09-17T02:22:02.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:02.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:02.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690515+0000", 2024-09-17T02:22:02.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3300000000000002e-07 2024-09-17T02:22:02.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:02.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690522+0000", 2024-09-17T02:22:02.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3679999999999998e-06 2024-09-17T02:22:02.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:02.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690531+0000", 2024-09-17T02:22:02.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2320000000000007e-06 2024-09-17T02:22:02.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690548+0000", 2024-09-17T02:22:02.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6744000000000001e-05 2024-09-17T02:22:02.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:02.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690749+0000", 2024-09-17T02:22:02.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000201261 2024-09-17T02:22:02.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:02.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690771+0000", 2024-09-17T02:22:02.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2413e-05 2024-09-17T02:22:02.719 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:02.719 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:02.719 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:02.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.719 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:185391 5.8 e62/26 5:159b0f51:::benchmark_data_smithi001_23533_object57274:head v 62'11771, mlcod=62'11769)", 2024-09-17T02:22:02.719 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:02.690898+0000", 2024-09-17T02:22:02.719 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0026582110000000002, 2024-09-17T02:22:02.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030823560000000001, 2024-09-17T02:22:02.720 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:02.720 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:02.720 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:02.720 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:02.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:02.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690898+0000", 2024-09-17T02:22:02.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:02.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:02.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690898+0000", 2024-09-17T02:22:02.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:02.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:02.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690898+0000", 2024-09-17T02:22:02.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4000000000000002e-07 2024-09-17T02:22:02.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:02.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690902+0000", 2024-09-17T02:22:02.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3880000000000002e-06 2024-09-17T02:22:02.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:02.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690910+0000", 2024-09-17T02:22:02.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6429999999999995e-06 2024-09-17T02:22:02.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690915+0000", 2024-09-17T02:22:02.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2650000000000004e-06 2024-09-17T02:22:02.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:02.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690959+0000", 2024-09-17T02:22:02.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3643000000000002e-05 2024-09-17T02:22:02.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:02.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.690979+0000", 2024-09-17T02:22:02.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0237999999999998e-05 2024-09-17T02:22:02.723 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:02.723 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:02.723 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:02.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.724 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:185396 5.1 5:88a62981:::benchmark_data_smithi001_23533_object57279:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-17T02:22:02.724 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:02.691194+0000", 2024-09-17T02:22:02.724 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.002362229, 2024-09-17T02:22:02.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028542229999999999, 2024-09-17T02:22:02.724 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:02.724 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:02.724 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:02.724 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:02.724 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:02.724 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.724 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 185396 2024-09-17T02:22:02.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.725 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:02.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:02.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.691194+0000", 2024-09-17T02:22:02.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:02.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:02.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.691194+0000", 2024-09-17T02:22:02.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:02.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:02.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.691194+0000", 2024-09-17T02:22:02.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1699999999999997e-07 2024-09-17T02:22:02.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:02.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.691199+0000", 2024-09-17T02:22:02.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.092e-06 2024-09-17T02:22:02.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:02.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.691210+0000", 2024-09-17T02:22:02.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1718e-05 2024-09-17T02:22:02.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.691218+0000", 2024-09-17T02:22:02.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3529999999999997e-06 2024-09-17T02:22:02.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:02.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.692290+0000", 2024-09-17T02:22:02.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001072712 2024-09-17T02:22:02.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:02.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.692378+0000", 2024-09-17T02:22:02.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7596000000000006e-05 2024-09-17T02:22:02.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:02.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.692444+0000", 2024-09-17T02:22:02.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5708000000000002e-05 2024-09-17T02:22:02.728 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:02.728 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:02.728 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:02.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.729 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:185394 5.8 e62/26 5:161d1031:::benchmark_data_smithi001_23533_object57277:head v 62'11772, mlcod=62'11769)", 2024-09-17T02:22:02.729 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:02.692529+0000", 2024-09-17T02:22:02.729 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0010270769999999999, 2024-09-17T02:22:02.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00159421, 2024-09-17T02:22:02.729 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:02.729 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:02.729 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:02.729 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:02.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:02.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.692529+0000", 2024-09-17T02:22:02.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:02.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:02.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.692529+0000", 2024-09-17T02:22:02.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:02.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:02.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.692529+0000", 2024-09-17T02:22:02.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.61e-07 2024-09-17T02:22:02.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:02.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.692535+0000", 2024-09-17T02:22:02.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5369999999999997e-06 2024-09-17T02:22:02.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:02.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.692545+0000", 2024-09-17T02:22:02.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8079999999999999e-06 2024-09-17T02:22:02.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.692552+0000", 2024-09-17T02:22:02.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8889999999999996e-06 2024-09-17T02:22:02.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:02.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.693173+0000", 2024-09-17T02:22:02.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000621129 2024-09-17T02:22:02.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:02.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.693198+0000", 2024-09-17T02:22:02.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5746999999999999e-05 2024-09-17T02:22:02.732 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:02.733 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:02.733 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:02.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.733 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:185398 5.e 5:78970fd6:::benchmark_data_smithi001_23533_object57281:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-17T02:22:02.733 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:02.693652+0000", 2024-09-17T02:22:02.733 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4294967295.9999032, 2024-09-17T02:22:02.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053844699999999995, 2024-09-17T02:22:02.733 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:02.733 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:02.733 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:02.733 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:02.734 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:02.734 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.734 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 185398 2024-09-17T02:22:02.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.734 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:02.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:02.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.693652+0000", 2024-09-17T02:22:02.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:02.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:02.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.693652+0000", 2024-09-17T02:22:02.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:02.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:02.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.693653+0000", 2024-09-17T02:22:02.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8000000000000004e-07 2024-09-17T02:22:02.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:02.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.693658+0000", 2024-09-17T02:22:02.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2480000000000004e-06 2024-09-17T02:22:02.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:02.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.693669+0000", 2024-09-17T02:22:02.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0278000000000001e-05 2024-09-17T02:22:02.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.693676+0000", 2024-09-17T02:22:02.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0419999999999997e-06 2024-09-17T02:22:02.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:02.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.693746+0000", 2024-09-17T02:22:02.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0159000000000004e-05 2024-09-17T02:22:02.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:02.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.693863+0000", 2024-09-17T02:22:02.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011743600000000001 2024-09-17T02:22:02.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:02.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.693965+0000", 2024-09-17T02:22:02.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101767 2024-09-17T02:22:02.737 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:02.737 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:02.737 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:02.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.738 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:185399 5.e 5.f016019e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-17T02:22:02.738 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:02.693809+0000", 2024-09-17T02:22:02.738 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4294967295.9997473, 2024-09-17T02:22:02.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046157099999999998, 2024-09-17T02:22:02.738 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:02.738 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:02.738 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:02.738 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:02.738 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:02.738 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.738 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 185399 2024-09-17T02:22:02.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.739 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:02.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:02.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.693809+0000", 2024-09-17T02:22:02.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:02.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:02.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.693809+0000", 2024-09-17T02:22:02.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:02.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:02.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.693809+0000", 2024-09-17T02:22:02.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1999999999999998e-07 2024-09-17T02:22:02.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:02.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.693814+0000", 2024-09-17T02:22:02.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5340000000000001e-06 2024-09-17T02:22:02.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:02.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.693827+0000", 2024-09-17T02:22:02.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2751999999999999e-05 2024-09-17T02:22:02.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.693834+0000", 2024-09-17T02:22:02.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.469e-06 2024-09-17T02:22:02.741 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:02.741 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:02.741 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:02.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.741 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:185402 5.d 5:b3c4f18e:::benchmark_data_smithi001_23533_object57285:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-17T02:22:02.741 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:02.693944+0000", 2024-09-17T02:22:02.741 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4294967295.9996114, 2024-09-17T02:22:02.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038828099999999998, 2024-09-17T02:22:02.742 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:02.742 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:02.742 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:02.742 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:02.742 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:02.742 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:02.742 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 185402 2024-09-17T02:22:02.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.742 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:02.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:02.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.693944+0000", 2024-09-17T02:22:02.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:02.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:02.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.693944+0000", 2024-09-17T02:22:02.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:02.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:02.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.693945+0000", 2024-09-17T02:22:02.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1100000000000005e-07 2024-09-17T02:22:02.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:02.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.693952+0000", 2024-09-17T02:22:02.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7139999999999996e-06 2024-09-17T02:22:02.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:02.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.693962+0000", 2024-09-17T02:22:02.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0051000000000001e-05 2024-09-17T02:22:02.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.693969+0000", 2024-09-17T02:22:02.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.657e-06 2024-09-17T02:22:02.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:02.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.694022+0000", 2024-09-17T02:22:02.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3538999999999997e-05 2024-09-17T02:22:02.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:02.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.694169+0000", 2024-09-17T02:22:02.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014680499999999999 2024-09-17T02:22:02.745 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:02.746 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:02.746 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:02.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.746 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:185397 5.8 e62/26)", 2024-09-17T02:22:02.746 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:02.694198+0000", 2024-09-17T02:22:02.746 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4294967295.9993582, 2024-09-17T02:22:02.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020242099999999999, 2024-09-17T02:22:02.746 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:02.746 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:02.746 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:02.746 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:02.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:02.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.694198+0000", 2024-09-17T02:22:02.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:02.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:02.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.694198+0000", 2024-09-17T02:22:02.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:02.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:02.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.694198+0000", 2024-09-17T02:22:02.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5700000000000002e-07 2024-09-17T02:22:02.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:02.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.694202+0000", 2024-09-17T02:22:02.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8820000000000003e-06 2024-09-17T02:22:02.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:02.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.694212+0000", 2024-09-17T02:22:02.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0175e-05 2024-09-17T02:22:02.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:02.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:02.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:02.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:02.694217+0000", 2024-09-17T02:22:02.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7539999999999997e-06 2024-09-17T02:22:02.748 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:02.749 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:02.749 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:02.749 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:02.749 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:22:02.749 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 13 2024-09-17T02:22:02.749 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:02.750 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~23s 2024-09-17T02:22:02.751 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:02.751 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:02.751+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:02.852 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:02.851+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:02.953 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:02.956+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:02.959 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:02.959 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:22:02.959 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:22:02.960 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:22:02.960 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:02.978 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:03.043 INFO:teuthology.orchestra.run.smithi001.stderr:nodeep-scrub is unset 2024-09-17T02:22:03.054 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:03.056+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:03.156 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:03.155+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:03.173 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:03.173 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:22:03.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:22:03.173 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:22:03.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.173 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97749 5.b 5:d930ef52:::benchmark_data_smithi001_23533_object97748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:03.173 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:03.173 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.581470281000001, 2024-09-17T02:22:03.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092964343000000005, 2024-09-17T02:22:03.174 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:03.174 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:03.174 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:03.174 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:03.174 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:03.174 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.174 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97749 2024-09-17T02:22:03.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.174 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:03.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:03.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:03.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:03.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:03.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:03.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591947+0000", 2024-09-17T02:22:03.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:22:03.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:03.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592011+0000", 2024-09-17T02:22:03.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3608000000000005e-05 2024-09-17T02:22:03.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:03.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592021+0000", 2024-09-17T02:22:03.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9979999999999998e-06 2024-09-17T02:22:03.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592028+0000", 2024-09-17T02:22:03.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1439999999999997e-06 2024-09-17T02:22:03.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593633+0000", 2024-09-17T02:22:03.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001604636 2024-09-17T02:22:03.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:03.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593757+0000", 2024-09-17T02:22:03.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012432099999999999 2024-09-17T02:22:03.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:03.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593866+0000", 2024-09-17T02:22:03.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109094 2024-09-17T02:22:03.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:03.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601190+0000", 2024-09-17T02:22:03.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073237620000000002 2024-09-17T02:22:03.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:03.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601356+0000", 2024-09-17T02:22:03.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016651900000000001 2024-09-17T02:22:03.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:03.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684618+0000", 2024-09-17T02:22:03.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083261356999999994 2024-09-17T02:22:03.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:03.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684724+0000", 2024-09-17T02:22:03.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010681800000000001 2024-09-17T02:22:03.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:03.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684911+0000", 2024-09-17T02:22:03.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186243 2024-09-17T02:22:03.180 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.180 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:03.180 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.180 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97752 5.b 5:d146f486:::benchmark_data_smithi001_23533_object97751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:03.181 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:03.181 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.580117586999997, 2024-09-17T02:22:03.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091989557, 2024-09-17T02:22:03.181 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:03.181 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:03.181 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:03.181 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:03.181 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:03.181 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.181 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97752 2024-09-17T02:22:03.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.181 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:03.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:03.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:03.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:03.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:03.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:03.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593300+0000", 2024-09-17T02:22:03.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8199999999999998e-07 2024-09-17T02:22:03.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:03.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593364+0000", 2024-09-17T02:22:03.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3831999999999995e-05 2024-09-17T02:22:03.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:03.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593376+0000", 2024-09-17T02:22:03.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1800999999999999e-05 2024-09-17T02:22:03.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593382+0000", 2024-09-17T02:22:03.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6780000000000003e-06 2024-09-17T02:22:03.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595491+0000", 2024-09-17T02:22:03.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021090689999999999 2024-09-17T02:22:03.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:03.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595614+0000", 2024-09-17T02:22:03.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012321500000000001 2024-09-17T02:22:03.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:03.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595778+0000", 2024-09-17T02:22:03.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016321900000000001 2024-09-17T02:22:03.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:03.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601197+0000", 2024-09-17T02:22:03.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054195600000000003 2024-09-17T02:22:03.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:03.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601396+0000", 2024-09-17T02:22:03.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019825299999999999 2024-09-17T02:22:03.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:03.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684990+0000", 2024-09-17T02:22:03.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083594878999999997 2024-09-17T02:22:03.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:03.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685116+0000", 2024-09-17T02:22:03.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012522799999999999 2024-09-17T02:22:03.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:03.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685289+0000", 2024-09-17T02:22:03.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172941 2024-09-17T02:22:03.188 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.188 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:03.188 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.188 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97754 5.b 5:da0615e5:::benchmark_data_smithi001_23533_object97753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:03.188 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:03.188 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.578479665000003, 2024-09-17T02:22:03.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092097207, 2024-09-17T02:22:03.188 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:03.188 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:03.188 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:03.188 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:03.189 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:03.189 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.189 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97754 2024-09-17T02:22:03.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.189 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:03.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:03.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:03.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:03.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:03.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:03.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594938+0000", 2024-09-17T02:22:03.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5000000000000002e-07 2024-09-17T02:22:03.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:03.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595075+0000", 2024-09-17T02:22:03.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137742 2024-09-17T02:22:03.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:03.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595087+0000", 2024-09-17T02:22:03.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1243000000000001e-05 2024-09-17T02:22:03.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595095+0000", 2024-09-17T02:22:03.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1030000000000002e-06 2024-09-17T02:22:03.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598461+0000", 2024-09-17T02:22:03.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033661170000000001 2024-09-17T02:22:03.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:03.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598540+0000", 2024-09-17T02:22:03.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8937999999999995e-05 2024-09-17T02:22:03.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:03.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598626+0000", 2024-09-17T02:22:03.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6042000000000001e-05 2024-09-17T02:22:03.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:03.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684258+0000", 2024-09-17T02:22:03.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085632394000000001 2024-09-17T02:22:03.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:03.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685369+0000", 2024-09-17T02:22:03.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001111063 2024-09-17T02:22:03.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:03.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685511+0000", 2024-09-17T02:22:03.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141965 2024-09-17T02:22:03.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:03.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685604+0000", 2024-09-17T02:22:03.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2935000000000004e-05 2024-09-17T02:22:03.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:03.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687034+0000", 2024-09-17T02:22:03.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001430015 2024-09-17T02:22:03.194 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.195 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:03.195 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.195 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97755 5.b 5:d36a03a1:::benchmark_data_smithi001_23533_object97754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:03.195 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:03.195 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.578306515000001, 2024-09-17T02:22:03.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0924904, 2024-09-17T02:22:03.195 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:03.195 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:03.195 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:03.195 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:03.195 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:03.196 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.196 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97755 2024-09-17T02:22:03.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.196 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:03.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:03.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:03.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:03.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:03.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:03.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595111+0000", 2024-09-17T02:22:03.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:22:03.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:03.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595145+0000", 2024-09-17T02:22:03.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3927000000000002e-05 2024-09-17T02:22:03.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:03.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595155+0000", 2024-09-17T02:22:03.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0023e-05 2024-09-17T02:22:03.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595162+0000", 2024-09-17T02:22:03.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3950000000000003e-06 2024-09-17T02:22:03.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599821+0000", 2024-09-17T02:22:03.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046592880000000001 2024-09-17T02:22:03.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:03.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599912+0000", 2024-09-17T02:22:03.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1049000000000002e-05 2024-09-17T02:22:03.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:03.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600062+0000", 2024-09-17T02:22:03.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015001700000000001 2024-09-17T02:22:03.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:03.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685307+0000", 2024-09-17T02:22:03.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085244340000000002 2024-09-17T02:22:03.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:03.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685446+0000", 2024-09-17T02:22:03.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013955700000000001 2024-09-17T02:22:03.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:03.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687375+0000", 2024-09-17T02:22:03.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019291079999999999 2024-09-17T02:22:03.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:03.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687462+0000", 2024-09-17T02:22:03.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6148000000000003e-05 2024-09-17T02:22:03.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:03.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687600+0000", 2024-09-17T02:22:03.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013887900000000001 2024-09-17T02:22:03.201 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.201 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:03.202 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.202 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 44/44 lb 5:c4567a04:::benchmark_data_smithi001_23533_object4200:head)", 2024-09-17T02:22:03.202 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:03.202 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.576209888999998, 2024-09-17T02:22:03.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092483421999999996, 2024-09-17T02:22:03.202 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:03.202 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:03.202 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:03.202 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:03.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:03.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:03.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:03.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:03.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:03.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:03.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6399999999999998e-07 2024-09-17T02:22:03.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:03.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597213+0000", 2024-09-17T02:22:03.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3659999999999997e-06 2024-09-17T02:22:03.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:03.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597222+0000", 2024-09-17T02:22:03.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0510000000000002e-06 2024-09-17T02:22:03.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597228+0000", 2024-09-17T02:22:03.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1569999999999999e-06 2024-09-17T02:22:03.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689588+0000", 2024-09-17T02:22:03.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092359931000000006 2024-09-17T02:22:03.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:03.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689622+0000", 2024-09-17T02:22:03.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4425999999999999e-05 2024-09-17T02:22:03.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:03.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689690+0000", 2024-09-17T02:22:03.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8126999999999993e-05 2024-09-17T02:22:03.206 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.206 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:03.206 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.206 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129462 5.4 5:2e0acc16:::benchmark_data_smithi001_23533_object1345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:03.206 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:03.207 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 27.63847582, 2024-09-17T02:22:03.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0112774899999999, 2024-09-17T02:22:03.207 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:03.207 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:03.207 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:03.207 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:03.207 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:03.207 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.207 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129462 2024-09-17T02:22:03.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.208 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:03.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:03.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:03.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:03.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:03.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:03.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534943+0000", 2024-09-17T02:22:03.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8759999999999999e-06 2024-09-17T02:22:03.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:03.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534951+0000", 2024-09-17T02:22:03.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3219999999999993e-06 2024-09-17T02:22:03.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:03.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534977+0000", 2024-09-17T02:22:03.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6245e-05 2024-09-17T02:22:03.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534992+0000", 2024-09-17T02:22:03.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4936000000000001e-05 2024-09-17T02:22:03.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535133+0000", 2024-09-17T02:22:03.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014051299999999999 2024-09-17T02:22:03.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:03.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:22:03.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1741000000000001e-05 2024-09-17T02:22:03.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.533906+0000", 2024-09-17T02:22:03.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99875209300000001 2024-09-17T02:22:03.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:03.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534348+0000", 2024-09-17T02:22:03.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044128899999999998 2024-09-17T02:22:03.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:03.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534762+0000", 2024-09-17T02:22:03.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000414707 2024-09-17T02:22:03.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:03.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545024+0000", 2024-09-17T02:22:03.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010261283 2024-09-17T02:22:03.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:03.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545953+0000", 2024-09-17T02:22:03.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000929618 2024-09-17T02:22:03.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:03.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546047+0000", 2024-09-17T02:22:03.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3697999999999996e-05 2024-09-17T02:22:03.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:03.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546218+0000", 2024-09-17T02:22:03.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017116899999999999 2024-09-17T02:22:03.213 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.213 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:03.213 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.214 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129480 5.4 5:2b1d398b:::benchmark_data_smithi001_23533_object1363:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:03.214 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:03.214 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 27.630721353999999, 2024-09-17T02:22:03.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0038926450000001, 2024-09-17T02:22:03.214 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:03.214 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:03.214 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:03.214 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:03.214 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:03.214 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.214 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129480 2024-09-17T02:22:03.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.214 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:03.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:03.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:03.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:03.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:03.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:03.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542696+0000", 2024-09-17T02:22:03.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9999999999999995e-07 2024-09-17T02:22:03.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:03.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542701+0000", 2024-09-17T02:22:03.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2240000000000003e-06 2024-09-17T02:22:03.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:03.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542716+0000", 2024-09-17T02:22:03.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4970000000000001e-05 2024-09-17T02:22:03.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542726+0000", 2024-09-17T02:22:03.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2879999999999998e-06 2024-09-17T02:22:03.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542832+0000", 2024-09-17T02:22:03.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010597199999999999 2024-09-17T02:22:03.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:03.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542843+0000", 2024-09-17T02:22:03.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.098e-05 2024-09-17T02:22:03.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538436+0000", 2024-09-17T02:22:03.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99559286800000002 2024-09-17T02:22:03.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:03.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538791+0000", 2024-09-17T02:22:03.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035585499999999997 2024-09-17T02:22:03.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:03.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.539144+0000", 2024-09-17T02:22:03.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035268499999999999 2024-09-17T02:22:03.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:03.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545880+0000", 2024-09-17T02:22:03.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00673552 2024-09-17T02:22:03.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:03.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546330+0000", 2024-09-17T02:22:03.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045039599999999999 2024-09-17T02:22:03.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:03.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546414+0000", 2024-09-17T02:22:03.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4468000000000005e-05 2024-09-17T02:22:03.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:03.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546588+0000", 2024-09-17T02:22:03.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017341899999999999 2024-09-17T02:22:03.220 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.220 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:03.220 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.220 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129505 5.4 5:294f2ec7:::benchmark_data_smithi001_23533_object1388:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:03.220 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:03.220 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 27.611708181000001, 2024-09-17T02:22:03.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98589826199999997, 2024-09-17T02:22:03.221 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:03.221 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:03.221 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:03.221 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:03.221 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:03.221 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.221 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129505 2024-09-17T02:22:03.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.221 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:03.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:03.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:03.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:03.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:03.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:03.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561710+0000", 2024-09-17T02:22:03.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7060000000000001e-06 2024-09-17T02:22:03.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:03.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561718+0000", 2024-09-17T02:22:03.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.542e-06 2024-09-17T02:22:03.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:03.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561741+0000", 2024-09-17T02:22:03.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3357e-05 2024-09-17T02:22:03.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561754+0000", 2024-09-17T02:22:03.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3200000000000001e-05 2024-09-17T02:22:03.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561867+0000", 2024-09-17T02:22:03.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113211 2024-09-17T02:22:03.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:03.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561888+0000", 2024-09-17T02:22:03.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0809999999999999e-05 2024-09-17T02:22:03.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542140+0000", 2024-09-17T02:22:03.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98025195799999998 2024-09-17T02:22:03.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:03.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542331+0000", 2024-09-17T02:22:03.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019127599999999999 2024-09-17T02:22:03.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:03.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542517+0000", 2024-09-17T02:22:03.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000185625 2024-09-17T02:22:03.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:03.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547114+0000", 2024-09-17T02:22:03.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045968620000000002 2024-09-17T02:22:03.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:03.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547187+0000", 2024-09-17T02:22:03.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3348000000000003e-05 2024-09-17T02:22:03.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:03.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547324+0000", 2024-09-17T02:22:03.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013681699999999999 2024-09-17T02:22:03.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:03.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547607+0000", 2024-09-17T02:22:03.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028255000000000001 2024-09-17T02:22:03.228 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.228 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:03.228 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.229 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129508 5.4 5:2892b582:::benchmark_data_smithi001_23533_object1391:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:03.229 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:03.229 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 27.610371088000001, 2024-09-17T02:22:03.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99697919099999999, 2024-09-17T02:22:03.230 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:03.230 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:03.230 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:03.230 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:03.230 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:03.230 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.230 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129508 2024-09-17T02:22:03.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.230 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:03.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:03.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:03.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:03.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:03.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:03.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563047+0000", 2024-09-17T02:22:03.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.274e-06 2024-09-17T02:22:03.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:03.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563054+0000", 2024-09-17T02:22:03.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2799999999999998e-06 2024-09-17T02:22:03.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:03.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563070+0000", 2024-09-17T02:22:03.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5991999999999999e-05 2024-09-17T02:22:03.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563078+0000", 2024-09-17T02:22:03.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2390000000000002e-06 2024-09-17T02:22:03.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563181+0000", 2024-09-17T02:22:03.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102249 2024-09-17T02:22:03.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:03.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563199+0000", 2024-09-17T02:22:03.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8215000000000001e-05 2024-09-17T02:22:03.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547713+0000", 2024-09-17T02:22:03.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98451446399999998 2024-09-17T02:22:03.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:03.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548063+0000", 2024-09-17T02:22:03.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034985499999999999 2024-09-17T02:22:03.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:03.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548490+0000", 2024-09-17T02:22:03.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042658600000000001 2024-09-17T02:22:03.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:03.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555655+0000", 2024-09-17T02:22:03.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071652579999999999 2024-09-17T02:22:03.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:03.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559612+0000", 2024-09-17T02:22:03.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003957103 2024-09-17T02:22:03.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:03.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559768+0000", 2024-09-17T02:22:03.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015556899999999999 2024-09-17T02:22:03.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:03.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560025+0000", 2024-09-17T02:22:03.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025710700000000002 2024-09-17T02:22:03.236 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.236 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:03.236 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.237 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129509 5.4 5:2c35515e:::benchmark_data_smithi001_23533_object1392:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:03.237 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:03.237 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 27.609744034999999, 2024-09-17T02:22:03.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99969384900000002, 2024-09-17T02:22:03.237 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:03.237 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:03.237 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:03.237 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:03.237 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:03.237 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.237 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129509 2024-09-17T02:22:03.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.237 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:03.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:03.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:03.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:03.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:03.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:03.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563674+0000", 2024-09-17T02:22:03.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0920000000000001e-06 2024-09-17T02:22:03.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:03.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563679+0000", 2024-09-17T02:22:03.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7660000000000004e-06 2024-09-17T02:22:03.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:03.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563693+0000", 2024-09-17T02:22:03.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3139000000000001e-05 2024-09-17T02:22:03.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563701+0000", 2024-09-17T02:22:03.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9859999999999994e-06 2024-09-17T02:22:03.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563775+0000", 2024-09-17T02:22:03.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4659000000000005e-05 2024-09-17T02:22:03.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:03.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563785+0000", 2024-09-17T02:22:03.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4839999999999993e-06 2024-09-17T02:22:03.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552085+0000", 2024-09-17T02:22:03.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98829986999999997 2024-09-17T02:22:03.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:03.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552554+0000", 2024-09-17T02:22:03.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046908900000000001 2024-09-17T02:22:03.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:03.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552931+0000", 2024-09-17T02:22:03.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377778 2024-09-17T02:22:03.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:03.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563106+0000", 2024-09-17T02:22:03.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010174186 2024-09-17T02:22:03.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:03.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563138+0000", 2024-09-17T02:22:03.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2495e-05 2024-09-17T02:22:03.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:03.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563225+0000", 2024-09-17T02:22:03.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6677999999999999e-05 2024-09-17T02:22:03.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:03.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563366+0000", 2024-09-17T02:22:03.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014162699999999999 2024-09-17T02:22:03.243 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.243 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:03.243 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.243 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129524 5.4 5:25dca7dd:::benchmark_data_smithi001_23533_object1407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:03.244 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:03.244 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 27.603052681000001, 2024-09-17T02:22:03.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99999501999999996, 2024-09-17T02:22:03.244 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:03.244 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:03.244 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:03.244 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:03.244 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:03.244 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.244 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129524 2024-09-17T02:22:03.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.245 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:03.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:03.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:03.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:03.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:03.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:03.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570365+0000", 2024-09-17T02:22:03.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.142e-06 2024-09-17T02:22:03.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:03.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570369+0000", 2024-09-17T02:22:03.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.856e-06 2024-09-17T02:22:03.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:03.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570385+0000", 2024-09-17T02:22:03.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5855e-05 2024-09-17T02:22:03.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570392+0000", 2024-09-17T02:22:03.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5340000000000002e-06 2024-09-17T02:22:03.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570484+0000", 2024-09-17T02:22:03.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1212999999999996e-05 2024-09-17T02:22:03.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:03.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570498+0000", 2024-09-17T02:22:03.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4331000000000001e-05 2024-09-17T02:22:03.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555835+0000", 2024-09-17T02:22:03.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98533757700000002 2024-09-17T02:22:03.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:03.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556329+0000", 2024-09-17T02:22:03.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000493458 2024-09-17T02:22:03.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:03.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556784+0000", 2024-09-17T02:22:03.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045476499999999999 2024-09-17T02:22:03.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:03.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569852+0000", 2024-09-17T02:22:03.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013068270999999999 2024-09-17T02:22:03.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:03.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569958+0000", 2024-09-17T02:22:03.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106214 2024-09-17T02:22:03.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.250 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:03.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570124+0000", 2024-09-17T02:22:03.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165546 2024-09-17T02:22:03.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.250 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:03.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570359+0000", 2024-09-17T02:22:03.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023525799999999999 2024-09-17T02:22:03.250 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.250 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:03.250 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.251 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129537 5.4 5:260327c6:::benchmark_data_smithi001_23533_object1420:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:03.251 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:03.251 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 27.595146152000002, 2024-09-17T02:22:03.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99624596499999996, 2024-09-17T02:22:03.251 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:03.251 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:03.251 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:03.251 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:03.251 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:03.251 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.252 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129537 2024-09-17T02:22:03.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.252 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:03.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:03.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:03.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:03.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:03.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:03.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578272+0000", 2024-09-17T02:22:03.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.164e-06 2024-09-17T02:22:03.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:03.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578278+0000", 2024-09-17T02:22:03.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5060000000000001e-06 2024-09-17T02:22:03.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:03.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578294+0000", 2024-09-17T02:22:03.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5687000000000001e-05 2024-09-17T02:22:03.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578329+0000", 2024-09-17T02:22:03.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5311999999999997e-05 2024-09-17T02:22:03.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578419+0000", 2024-09-17T02:22:03.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0054000000000002e-05 2024-09-17T02:22:03.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:03.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578435+0000", 2024-09-17T02:22:03.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5645999999999999e-05 2024-09-17T02:22:03.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560148+0000", 2024-09-17T02:22:03.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98171342299999997 2024-09-17T02:22:03.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:03.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560383+0000", 2024-09-17T02:22:03.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000234935 2024-09-17T02:22:03.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:03.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560586+0000", 2024-09-17T02:22:03.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000202909 2024-09-17T02:22:03.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:03.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570472+0000", 2024-09-17T02:22:03.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098856959999999994 2024-09-17T02:22:03.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:03.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574138+0000", 2024-09-17T02:22:03.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036660170000000001 2024-09-17T02:22:03.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:03.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574298+0000", 2024-09-17T02:22:03.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016025600000000001 2024-09-17T02:22:03.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:03.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574516+0000", 2024-09-17T02:22:03.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021835999999999999 2024-09-17T02:22:03.258 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.258 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:03.258 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.258 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129545 5.4 5:22366489:::benchmark_data_smithi001_23533_object1428:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:03.258 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:03.258 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 27.589283428999998, 2024-09-17T02:22:03.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99074544499999995, 2024-09-17T02:22:03.258 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:03.258 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:03.258 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:03.258 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:03.259 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:03.259 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.259 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129545 2024-09-17T02:22:03.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.259 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:03.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:03.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:03.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:03.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:03.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:03.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584135+0000", 2024-09-17T02:22:03.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4699999999999999e-06 2024-09-17T02:22:03.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:03.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584142+0000", 2024-09-17T02:22:03.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1620000000000002e-06 2024-09-17T02:22:03.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:03.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584170+0000", 2024-09-17T02:22:03.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7897000000000001e-05 2024-09-17T02:22:03.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584183+0000", 2024-09-17T02:22:03.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2814e-05 2024-09-17T02:22:03.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584299+0000", 2024-09-17T02:22:03.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116153 2024-09-17T02:22:03.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:03.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584316+0000", 2024-09-17T02:22:03.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7524999999999999e-05 2024-09-17T02:22:03.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563461+0000", 2024-09-17T02:22:03.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97914436699999996 2024-09-17T02:22:03.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:03.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563667+0000", 2024-09-17T02:22:03.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020689800000000001 2024-09-17T02:22:03.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:03.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563878+0000", 2024-09-17T02:22:03.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210275 2024-09-17T02:22:03.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:03.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570584+0000", 2024-09-17T02:22:03.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067066080000000002 2024-09-17T02:22:03.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:03.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574539+0000", 2024-09-17T02:22:03.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039550360000000003 2024-09-17T02:22:03.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:03.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574653+0000", 2024-09-17T02:22:03.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114003 2024-09-17T02:22:03.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:03.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574879+0000", 2024-09-17T02:22:03.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022523700000000001 2024-09-17T02:22:03.264 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.264 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:03.264 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.265 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129553 5.4 5:2e41ad40:::benchmark_data_smithi001_23533_object1436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:03.265 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:03.265 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 27.583860792999999, 2024-09-17T02:22:03.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99213429600000003, 2024-09-17T02:22:03.265 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:03.265 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:03.265 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:03.265 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:03.265 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:03.265 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.265 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129553 2024-09-17T02:22:03.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.266 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:03.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:03.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:03.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:03.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:03.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:03.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589557+0000", 2024-09-17T02:22:03.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2219999999999999e-06 2024-09-17T02:22:03.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:03.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589562+0000", 2024-09-17T02:22:03.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0649999999999998e-06 2024-09-17T02:22:03.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:03.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589575+0000", 2024-09-17T02:22:03.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3129000000000001e-05 2024-09-17T02:22:03.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589584+0000", 2024-09-17T02:22:03.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6200000000000005e-06 2024-09-17T02:22:03.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589693+0000", 2024-09-17T02:22:03.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109319 2024-09-17T02:22:03.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:03.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589714+0000", 2024-09-17T02:22:03.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0849999999999999e-05 2024-09-17T02:22:03.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566273+0000", 2024-09-17T02:22:03.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97655884999999998 2024-09-17T02:22:03.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:03.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566543+0000", 2024-09-17T02:22:03.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027059099999999998 2024-09-17T02:22:03.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:03.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566832+0000", 2024-09-17T02:22:03.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028898200000000002 2024-09-17T02:22:03.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:03.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581040+0000", 2024-09-17T02:22:03.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014208001 2024-09-17T02:22:03.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:03.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581200+0000", 2024-09-17T02:22:03.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159956 2024-09-17T02:22:03.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:03.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581427+0000", 2024-09-17T02:22:03.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000226309 2024-09-17T02:22:03.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.272 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:03.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581690+0000", 2024-09-17T02:22:03.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026340199999999998 2024-09-17T02:22:03.272 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.272 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:03.272 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.272 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129580 5.4 5:25ed887b:::benchmark_data_smithi001_23533_object1463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:03.272 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:03.272 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 27.562088749000001, 2024-09-17T02:22:03.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98001430499999997, 2024-09-17T02:22:03.273 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:03.273 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:03.273 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:03.273 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:03.273 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:03.273 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.273 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129580 2024-09-17T02:22:03.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.273 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:03.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:03.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:03.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:03.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:03.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:03.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611329+0000", 2024-09-17T02:22:03.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.22e-06 2024-09-17T02:22:03.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:03.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611335+0000", 2024-09-17T02:22:03.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1129999999999997e-06 2024-09-17T02:22:03.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:03.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611348+0000", 2024-09-17T02:22:03.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2342e-05 2024-09-17T02:22:03.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611356+0000", 2024-09-17T02:22:03.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.371e-06 2024-09-17T02:22:03.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611419+0000", 2024-09-17T02:22:03.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3393999999999996e-05 2024-09-17T02:22:03.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:03.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611427+0000", 2024-09-17T02:22:03.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999997e-06 2024-09-17T02:22:03.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570705+0000", 2024-09-17T02:22:03.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.95927859199999999 2024-09-17T02:22:03.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:03.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571009+0000", 2024-09-17T02:22:03.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030414599999999998 2024-09-17T02:22:03.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:03.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571241+0000", 2024-09-17T02:22:03.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023106799999999999 2024-09-17T02:22:03.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:03.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590789+0000", 2024-09-17T02:22:03.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019548763 2024-09-17T02:22:03.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:03.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590928+0000", 2024-09-17T02:22:03.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000139092 2024-09-17T02:22:03.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:03.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591086+0000", 2024-09-17T02:22:03.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015787400000000001 2024-09-17T02:22:03.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:03.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591342+0000", 2024-09-17T02:22:03.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025589900000000002 2024-09-17T02:22:03.279 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.279 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:03.279 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.280 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129603 5.4 5:25aaa5e8:::benchmark_data_smithi001_23533_object1486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:03.280 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:03.280 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 27.546028953, 2024-09-17T02:22:03.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96463198999999999, 2024-09-17T02:22:03.280 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:03.280 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:03.280 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:03.280 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:03.280 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:03.280 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.280 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129603 2024-09-17T02:22:03.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.281 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:03.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.281 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:03.281 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:03.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.281 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:03.281 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:03.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:03.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:03.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:22:03.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:03.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627392+0000", 2024-09-17T02:22:03.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0790000000000002e-06 2024-09-17T02:22:03.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:03.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627403+0000", 2024-09-17T02:22:03.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0866000000000001e-05 2024-09-17T02:22:03.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627409+0000", 2024-09-17T02:22:03.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.305e-06 2024-09-17T02:22:03.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627485+0000", 2024-09-17T02:22:03.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6582000000000006e-05 2024-09-17T02:22:03.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:03.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627499+0000", 2024-09-17T02:22:03.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:22:03.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574991+0000", 2024-09-17T02:22:03.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94749182300000001 2024-09-17T02:22:03.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:03.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575377+0000", 2024-09-17T02:22:03.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038629400000000003 2024-09-17T02:22:03.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:03.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575665+0000", 2024-09-17T02:22:03.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028759499999999997 2024-09-17T02:22:03.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:03.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590802+0000", 2024-09-17T02:22:03.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015136479 2024-09-17T02:22:03.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:03.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591614+0000", 2024-09-17T02:22:03.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081293100000000003 2024-09-17T02:22:03.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:03.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591764+0000", 2024-09-17T02:22:03.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014932199999999999 2024-09-17T02:22:03.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:03.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592020+0000", 2024-09-17T02:22:03.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025585099999999997 2024-09-17T02:22:03.286 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.286 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:03.286 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.287 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129607 5.4 5:2f638f1e:::benchmark_data_smithi001_23533_object1490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:03.287 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:03.287 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 27.544502047000002, 2024-09-17T02:22:03.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96352375899999998, 2024-09-17T02:22:03.287 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:03.287 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:03.287 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:03.287 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:03.287 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:03.287 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.287 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129607 2024-09-17T02:22:03.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.288 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:03.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:03.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:03.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:03.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:03.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:03.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628916+0000", 2024-09-17T02:22:03.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1710000000000001e-06 2024-09-17T02:22:03.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:03.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628920+0000", 2024-09-17T02:22:03.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-17T02:22:03.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:03.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628935+0000", 2024-09-17T02:22:03.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4474000000000001e-05 2024-09-17T02:22:03.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628944+0000", 2024-09-17T02:22:03.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9940000000000006e-06 2024-09-17T02:22:03.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628997+0000", 2024-09-17T02:22:03.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3579000000000003e-05 2024-09-17T02:22:03.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:03.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.629006+0000", 2024-09-17T02:22:03.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4009999999999997e-06 2024-09-17T02:22:03.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.577862+0000", 2024-09-17T02:22:03.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.948856335 2024-09-17T02:22:03.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:03.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578167+0000", 2024-09-17T02:22:03.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030532399999999999 2024-09-17T02:22:03.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:03.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578532+0000", 2024-09-17T02:22:03.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036428200000000001 2024-09-17T02:22:03.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:03.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591442+0000", 2024-09-17T02:22:03.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012910374000000001 2024-09-17T02:22:03.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:03.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592164+0000", 2024-09-17T02:22:03.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072242499999999996 2024-09-17T02:22:03.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:03.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592267+0000", 2024-09-17T02:22:03.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102205 2024-09-17T02:22:03.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:03.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592438+0000", 2024-09-17T02:22:03.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017165299999999999 2024-09-17T02:22:03.293 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.293 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:03.293 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.293 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129623 5.4 5:2cf5174b:::benchmark_data_smithi001_23533_object1506:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:03.294 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:03.294 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 27.520557760999999, 2024-09-17T02:22:03.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94334114499999999, 2024-09-17T02:22:03.294 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:03.294 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:03.294 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:03.294 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:03.294 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:03.294 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.294 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129623 2024-09-17T02:22:03.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.294 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:03.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:03.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:03.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:03.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:03.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:03.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652860+0000", 2024-09-17T02:22:03.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0330000000000001e-06 2024-09-17T02:22:03.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:03.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652864+0000", 2024-09-17T02:22:03.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.634e-06 2024-09-17T02:22:03.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:03.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652877+0000", 2024-09-17T02:22:03.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2591e-05 2024-09-17T02:22:03.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652883+0000", 2024-09-17T02:22:03.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1460000000000001e-06 2024-09-17T02:22:03.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652943+0000", 2024-09-17T02:22:03.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9833999999999997e-05 2024-09-17T02:22:03.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:03.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652950+0000", 2024-09-17T02:22:03.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.401e-06 2024-09-17T02:22:03.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581800+0000", 2024-09-17T02:22:03.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.92884935700000004 2024-09-17T02:22:03.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:03.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582122+0000", 2024-09-17T02:22:03.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032185200000000002 2024-09-17T02:22:03.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:03.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582689+0000", 2024-09-17T02:22:03.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056750400000000003 2024-09-17T02:22:03.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:03.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591458+0000", 2024-09-17T02:22:03.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008768685 2024-09-17T02:22:03.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:03.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595856+0000", 2024-09-17T02:22:03.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043977909999999999 2024-09-17T02:22:03.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:03.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595955+0000", 2024-09-17T02:22:03.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9166000000000006e-05 2024-09-17T02:22:03.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:03.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596200+0000", 2024-09-17T02:22:03.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024515099999999998 2024-09-17T02:22:03.300 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.300 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:03.300 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.300 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129642 5.4 5:255eb796:::benchmark_data_smithi001_23533_object1525:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:03.301 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:03.301 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 27.489321597, 2024-09-17T02:22:03.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.91257397299999998, 2024-09-17T02:22:03.301 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:03.301 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:03.301 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:03.301 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:03.301 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:03.301 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.301 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129642 2024-09-17T02:22:03.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.301 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:03.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:03.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:03.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:03.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:03.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:03.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684096+0000", 2024-09-17T02:22:03.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659999999999999e-06 2024-09-17T02:22:03.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:03.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684101+0000", 2024-09-17T02:22:03.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8110000000000002e-06 2024-09-17T02:22:03.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:03.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684114+0000", 2024-09-17T02:22:03.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2653000000000001e-05 2024-09-17T02:22:03.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684121+0000", 2024-09-17T02:22:03.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5100000000000001e-06 2024-09-17T02:22:03.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684181+0000", 2024-09-17T02:22:03.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0307999999999999e-05 2024-09-17T02:22:03.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:03.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684194+0000", 2024-09-17T02:22:03.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2916e-05 2024-09-17T02:22:03.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.587917+0000", 2024-09-17T02:22:03.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.90372220400000003 2024-09-17T02:22:03.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:03.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588215+0000", 2024-09-17T02:22:03.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029845400000000003 2024-09-17T02:22:03.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:03.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588470+0000", 2024-09-17T02:22:03.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025455399999999999 2024-09-17T02:22:03.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:03.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596318+0000", 2024-09-17T02:22:03.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078485589999999997 2024-09-17T02:22:03.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:03.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596354+0000", 2024-09-17T02:22:03.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5976999999999998e-05 2024-09-17T02:22:03.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:03.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596449+0000", 2024-09-17T02:22:03.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4728999999999994e-05 2024-09-17T02:22:03.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:03.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596669+0000", 2024-09-17T02:22:03.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220132 2024-09-17T02:22:03.307 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.307 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:03.307 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.307 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129649 5.4 5:2fe27050:::benchmark_data_smithi001_23533_object1532:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:03.307 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:03.308 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 27.457764854000001, 2024-09-17T02:22:03.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.88508119100000004, 2024-09-17T02:22:03.308 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:03.308 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:03.308 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:03.308 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:03.308 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:03.308 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.308 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129649 2024-09-17T02:22:03.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.308 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:03.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:03.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:03.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:03.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:03.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:03.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:03.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715653+0000", 2024-09-17T02:22:03.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3519999999999999e-06 2024-09-17T02:22:03.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:03.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715658+0000", 2024-09-17T02:22:03.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3120000000000001e-06 2024-09-17T02:22:03.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:03.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715677+0000", 2024-09-17T02:22:03.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-17T02:22:03.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715687+0000", 2024-09-17T02:22:03.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0146000000000001e-05 2024-09-17T02:22:03.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715821+0000", 2024-09-17T02:22:03.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013421 2024-09-17T02:22:03.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:03.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715840+0000", 2024-09-17T02:22:03.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8153999999999999e-05 2024-09-17T02:22:03.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:03.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592528+0000", 2024-09-17T02:22:03.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.87668860000000004 2024-09-17T02:22:03.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:03.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592702+0000", 2024-09-17T02:22:03.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017429300000000001 2024-09-17T02:22:03.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:03.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592945+0000", 2024-09-17T02:22:03.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000242048 2024-09-17T02:22:03.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:03.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600234+0000", 2024-09-17T02:22:03.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072897600000000002 2024-09-17T02:22:03.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:03.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600494+0000", 2024-09-17T02:22:03.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000259984 2024-09-17T02:22:03.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:03.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600555+0000", 2024-09-17T02:22:03.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1138999999999999e-05 2024-09-17T02:22:03.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:03.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:03.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:03.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600733+0000", 2024-09-17T02:22:03.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017753300000000001 2024-09-17T02:22:03.314 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.314 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:03.314 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.314 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:03.314 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:03.314 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:03.316 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:03.316 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:03.315+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:03.416 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:03.415+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:03.431 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:22:03.474 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:22:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:187137 5.b e63/51 5:dba907e6:::benchmark_data_smithi001_23533_object59020:head v 63'11556, mlcod=63'11552)", 2024-09-17T02:22:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:03.469795+0000", 2024-09-17T02:22:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0069636519999999999, 2024-09-17T02:22:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069896580000000002, 2024-09-17T02:22:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.469795+0000", 2024-09-17T02:22:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.469795+0000", 2024-09-17T02:22:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.469795+0000", 2024-09-17T02:22:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.91e-07 2024-09-17T02:22:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.469799+0000", 2024-09-17T02:22:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.194e-06 2024-09-17T02:22:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.469805+0000", 2024-09-17T02:22:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7899999999999996e-06 2024-09-17T02:22:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.469810+0000", 2024-09-17T02:22:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8489999999999997e-06 2024-09-17T02:22:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.469847+0000", 2024-09-17T02:22:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7212999999999998e-05 2024-09-17T02:22:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.469885+0000", 2024-09-17T02:22:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7623999999999998e-05 2024-09-17T02:22:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:187136 5.7 5:e625ee1c:::benchmark_data_smithi001_23533_object59019:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-17T02:22:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:03.469912+0000", 2024-09-17T02:22:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0068464670000000002, 2024-09-17T02:22:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069215489999999999, 2024-09-17T02:22:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 187136 2024-09-17T02:22:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.469912+0000", 2024-09-17T02:22:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.469912+0000", 2024-09-17T02:22:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.469913+0000", 2024-09-17T02:22:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7700000000000004e-07 2024-09-17T02:22:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.469916+0000", 2024-09-17T02:22:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0489999999999999e-06 2024-09-17T02:22:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.469926+0000", 2024-09-17T02:22:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0017000000000001e-05 2024-09-17T02:22:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.469932+0000", 2024-09-17T02:22:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7950000000000004e-06 2024-09-17T02:22:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.469991+0000", 2024-09-17T02:22:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9562999999999999e-05 2024-09-17T02:22:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.470138+0000", 2024-09-17T02:22:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000146804 2024-09-17T02:22:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:187140 5.8 5:1da0b6b5:::benchmark_data_smithi001_23533_object59023:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-17T02:22:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:03.470347+0000", 2024-09-17T02:22:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0064116729999999997, 2024-09-17T02:22:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0065249339999999996, 2024-09-17T02:22:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 187140 2024-09-17T02:22:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.470347+0000", 2024-09-17T02:22:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.470347+0000", 2024-09-17T02:22:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.470348+0000", 2024-09-17T02:22:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.06e-07 2024-09-17T02:22:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.470351+0000", 2024-09-17T02:22:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1999999999999999e-06 2024-09-17T02:22:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.470360+0000", 2024-09-17T02:22:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0210000000000005e-06 2024-09-17T02:22:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.470366+0000", 2024-09-17T02:22:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1720000000000004e-06 2024-09-17T02:22:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.473755+0000", 2024-09-17T02:22:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003388964 2024-09-17T02:22:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.473855+0000", 2024-09-17T02:22:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9891999999999998e-05 2024-09-17T02:22:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.473955+0000", 2024-09-17T02:22:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100108 2024-09-17T02:22:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.476322+0000", 2024-09-17T02:22:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023666540000000002 2024-09-17T02:22:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:187139 5.1 e63/61 5:87405c2e:::benchmark_data_smithi001_23533_object59022:head v 63'11606, mlcod=63'11603)", 2024-09-17T02:22:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:03.470612+0000", 2024-09-17T02:22:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0061469189999999998, 2024-09-17T02:22:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063224919999999999, 2024-09-17T02:22:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.470612+0000", 2024-09-17T02:22:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.470612+0000", 2024-09-17T02:22:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.470612+0000", 2024-09-17T02:22:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3300000000000002e-07 2024-09-17T02:22:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.470618+0000", 2024-09-17T02:22:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4450000000000004e-06 2024-09-17T02:22:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.470627+0000", 2024-09-17T02:22:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5559999999999996e-06 2024-09-17T02:22:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.470633+0000", 2024-09-17T02:22:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6060000000000002e-06 2024-09-17T02:22:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.470674+0000", 2024-09-17T02:22:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1031000000000001e-05 2024-09-17T02:22:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.470688+0000", 2024-09-17T02:22:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3749e-05 2024-09-17T02:22:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:187142 5.e e63/22 5:7039cadd:::benchmark_data_smithi001_23533_object59025:head v 63'11754, mlcod=63'11752)", 2024-09-17T02:22:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:03.471114+0000", 2024-09-17T02:22:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0056443800000000001, 2024-09-17T02:22:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058708950000000001, 2024-09-17T02:22:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.471114+0000", 2024-09-17T02:22:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.471114+0000", 2024-09-17T02:22:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.471115+0000", 2024-09-17T02:22:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1900000000000002e-07 2024-09-17T02:22:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.471120+0000", 2024-09-17T02:22:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6690000000000003e-06 2024-09-17T02:22:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.471130+0000", 2024-09-17T02:22:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1900000000000001e-06 2024-09-17T02:22:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.471135+0000", 2024-09-17T02:22:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8670000000000002e-06 2024-09-17T02:22:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.471775+0000", 2024-09-17T02:22:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00064095899999999997 2024-09-17T02:22:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.471794+0000", 2024-09-17T02:22:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8113000000000001e-05 2024-09-17T02:22:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:187141 5.1 e63/61 5:89502498:::benchmark_data_smithi001_23533_object59024:head v 63'11607, mlcod=63'11603)", 2024-09-17T02:22:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:03.471976+0000", 2024-09-17T02:22:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0047828480000000001, 2024-09-17T02:22:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050670239999999998, 2024-09-17T02:22:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.471976+0000", 2024-09-17T02:22:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.471976+0000", 2024-09-17T02:22:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.471976+0000", 2024-09-17T02:22:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2799999999999996e-07 2024-09-17T02:22:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.471981+0000", 2024-09-17T02:22:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3919999999999996e-06 2024-09-17T02:22:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.471988+0000", 2024-09-17T02:22:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6960000000000005e-06 2024-09-17T02:22:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.471993+0000", 2024-09-17T02:22:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4039999999999997e-06 2024-09-17T02:22:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472042+0000", 2024-09-17T02:22:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9737000000000002e-05 2024-09-17T02:22:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472056+0000", 2024-09-17T02:22:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3359e-05 2024-09-17T02:22:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:187144 5.6 5:63b18e92:::benchmark_data_smithi001_23533_object59027:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-17T02:22:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:03.472104+0000", 2024-09-17T02:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0046540790000000002, 2024-09-17T02:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049874020000000002, 2024-09-17T02:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 187144 2024-09-17T02:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472104+0000", 2024-09-17T02:22:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472104+0000", 2024-09-17T02:22:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472105+0000", 2024-09-17T02:22:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2200000000000003e-07 2024-09-17T02:22:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472109+0000", 2024-09-17T02:22:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9040000000000002e-06 2024-09-17T02:22:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472118+0000", 2024-09-17T02:22:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0280000000000006e-06 2024-09-17T02:22:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472125+0000", 2024-09-17T02:22:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6250000000000001e-06 2024-09-17T02:22:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.473707+0000", 2024-09-17T02:22:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015821819999999999 2024-09-17T02:22:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.473820+0000", 2024-09-17T02:22:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000113182 2024-09-17T02:22:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:187145 5.6 5:639d5533:::benchmark_data_smithi001_23533_object59028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-17T02:22:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:03.472142+0000", 2024-09-17T02:22:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0046170550000000001, 2024-09-17T02:22:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049896819999999996, 2024-09-17T02:22:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 187145 2024-09-17T02:22:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472142+0000", 2024-09-17T02:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472142+0000", 2024-09-17T02:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472142+0000", 2024-09-17T02:22:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9800000000000004e-07 2024-09-17T02:22:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472144+0000", 2024-09-17T02:22:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4049999999999998e-06 2024-09-17T02:22:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472151+0000", 2024-09-17T02:22:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6730000000000003e-06 2024-09-17T02:22:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472156+0000", 2024-09-17T02:22:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.831e-06 2024-09-17T02:22:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.476305+0000", 2024-09-17T02:22:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041495710000000003 2024-09-17T02:22:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.476385+0000", 2024-09-17T02:22:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9975000000000006e-05 2024-09-17T02:22:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:187143 5.4 e63/52 5:2c726c54:::benchmark_data_smithi001_23533_object59026:head v 63'11509, mlcod=63'11507)", 2024-09-17T02:22:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:03.472434+0000", 2024-09-17T02:22:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0043248200000000001, 2024-09-17T02:22:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004737537, 2024-09-17T02:22:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472434+0000", 2024-09-17T02:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472434+0000", 2024-09-17T02:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472434+0000", 2024-09-17T02:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7899999999999999e-07 2024-09-17T02:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472438+0000", 2024-09-17T02:22:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0509999999999998e-06 2024-09-17T02:22:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472447+0000", 2024-09-17T02:22:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1379999999999996e-06 2024-09-17T02:22:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472454+0000", 2024-09-17T02:22:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.596e-06 2024-09-17T02:22:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472499+0000", 2024-09-17T02:22:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4863000000000001e-05 2024-09-17T02:22:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472518+0000", 2024-09-17T02:22:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8992999999999999e-05 2024-09-17T02:22:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:187147 5.a 5:56cec9a3:::benchmark_data_smithi001_23533_object59030:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-17T02:22:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:03.472567+0000", 2024-09-17T02:22:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0041910979999999999, 2024-09-17T02:22:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046662939999999997, 2024-09-17T02:22:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 187147 2024-09-17T02:22:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472567+0000", 2024-09-17T02:22:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472567+0000", 2024-09-17T02:22:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472568+0000", 2024-09-17T02:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9699999999999995e-07 2024-09-17T02:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472572+0000", 2024-09-17T02:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7790000000000002e-06 2024-09-17T02:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472587+0000", 2024-09-17T02:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4732000000000001e-05 2024-09-17T02:22:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472593+0000", 2024-09-17T02:22:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8079999999999999e-06 2024-09-17T02:22:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472649+0000", 2024-09-17T02:22:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5584999999999997e-05 2024-09-17T02:22:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472780+0000", 2024-09-17T02:22:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013045600000000001 2024-09-17T02:22:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.472893+0000", 2024-09-17T02:22:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000113257 2024-09-17T02:22:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.475993+0000", 2024-09-17T02:22:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031005300000000002 2024-09-17T02:22:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:187148 5.3 5:c1784810:::benchmark_data_smithi001_23533_object59031:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-17T02:22:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:03.473914+0000", 2024-09-17T02:22:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0028440990000000001, 2024-09-17T02:22:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033983220000000001, 2024-09-17T02:22:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 187148 2024-09-17T02:22:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.473914+0000", 2024-09-17T02:22:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.473914+0000", 2024-09-17T02:22:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.473915+0000", 2024-09-17T02:22:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4900000000000005e-07 2024-09-17T02:22:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.473919+0000", 2024-09-17T02:22:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7610000000000001e-06 2024-09-17T02:22:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.473929+0000", 2024-09-17T02:22:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.859e-06 2024-09-17T02:22:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.473935+0000", 2024-09-17T02:22:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4450000000000001e-06 2024-09-17T02:22:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.474773+0000", 2024-09-17T02:22:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00083712999999999995 2024-09-17T02:22:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.474854+0000", 2024-09-17T02:22:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1392999999999998e-05 2024-09-17T02:22:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.474921+0000", 2024-09-17T02:22:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7070999999999995e-05 2024-09-17T02:22:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:187149 5.5 5:abf4a35c:::benchmark_data_smithi001_23533_object59032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-17T02:22:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:03.475214+0000", 2024-09-17T02:22:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0015447620000000001, 2024-09-17T02:22:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021665479999999999, 2024-09-17T02:22:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 187149 2024-09-17T02:22:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.475214+0000", 2024-09-17T02:22:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.475214+0000", 2024-09-17T02:22:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.475215+0000", 2024-09-17T02:22:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0400000000000005e-07 2024-09-17T02:22:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.475218+0000", 2024-09-17T02:22:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.416e-06 2024-09-17T02:22:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.475229+0000", 2024-09-17T02:22:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1291000000000001e-05 2024-09-17T02:22:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.475236+0000", 2024-09-17T02:22:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8090000000000004e-06 2024-09-17T02:22:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.475292+0000", 2024-09-17T02:22:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5724999999999999e-05 2024-09-17T02:22:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.475423+0000", 2024-09-17T02:22:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013154400000000001 2024-09-17T02:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:187150 5.e e63/22 5:71fb282b:::benchmark_data_smithi001_23533_object59033:head v 63'11755, mlcod=63'11752)", 2024-09-17T02:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:03.476976+0000", 2024-09-17T02:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9997826, 2024-09-17T02:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00046963499999999999, 2024-09-17T02:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.476976+0000", 2024-09-17T02:22:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.476976+0000", 2024-09-17T02:22:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.476977+0000", 2024-09-17T02:22:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5799999999999999e-07 2024-09-17T02:22:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.476982+0000", 2024-09-17T02:22:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9640000000000002e-06 2024-09-17T02:22:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.476991+0000", 2024-09-17T02:22:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0510000000000002e-06 2024-09-17T02:22:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.476996+0000", 2024-09-17T02:22:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-09-17T02:22:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.477036+0000", 2024-09-17T02:22:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9876000000000002e-05 2024-09-17T02:22:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.477055+0000", 2024-09-17T02:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9318999999999999e-05 2024-09-17T02:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:187151 5.b e63/51 5:df41dcc2:::benchmark_data_smithi001_23533_object59034:head v 63'11557, mlcod=63'11554)", 2024-09-17T02:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:03.477128+0000", 2024-09-17T02:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.99963, 2024-09-17T02:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00036992699999999998, 2024-09-17T02:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.477128+0000", 2024-09-17T02:22:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.477128+0000", 2024-09-17T02:22:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.477129+0000", 2024-09-17T02:22:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9800000000000003e-07 2024-09-17T02:22:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.477133+0000", 2024-09-17T02:22:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1160000000000001e-06 2024-09-17T02:22:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.477142+0000", 2024-09-17T02:22:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8689999999999993e-06 2024-09-17T02:22:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.477147+0000", 2024-09-17T02:22:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2020000000000003e-06 2024-09-17T02:22:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.477187+0000", 2024-09-17T02:22:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9886999999999999e-05 2024-09-17T02:22:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.477209+0000", 2024-09-17T02:22:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1829000000000001e-05 2024-09-17T02:22:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:187129 5.0 5:0673c26f:::benchmark_data_smithi001_23533_object59012:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-17T02:22:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:03.464453+0000", 2024-09-17T02:22:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.012305712999999999, 2024-09-17T02:22:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013104401, 2024-09-17T02:22:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 187129 2024-09-17T02:22:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.464453+0000", 2024-09-17T02:22:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.464453+0000", 2024-09-17T02:22:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.464453+0000", 2024-09-17T02:22:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9200000000000001e-07 2024-09-17T02:22:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.464456+0000", 2024-09-17T02:22:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0620000000000001e-06 2024-09-17T02:22:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.464472+0000", 2024-09-17T02:22:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5923e-05 2024-09-17T02:22:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.464478+0000", 2024-09-17T02:22:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1090000000000003e-06 2024-09-17T02:22:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.471247+0000", 2024-09-17T02:22:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0067687169999999996 2024-09-17T02:22:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.471358+0000", 2024-09-17T02:22:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000110905 2024-09-17T02:22:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.471461+0000", 2024-09-17T02:22:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103349 2024-09-17T02:22:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.476937+0000", 2024-09-17T02:22:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0054752569999999999 2024-09-17T02:22:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4466.0:187148 5.3 e63/51)", 2024-09-17T02:22:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:03.477257+0000", 2024-09-17T02:22:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9995012, 2024-09-17T02:22:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00036745400000000002, 2024-09-17T02:22:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.477257+0000", 2024-09-17T02:22:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.477257+0000", 2024-09-17T02:22:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.477258+0000", 2024-09-17T02:22:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6899999999999998e-07 2024-09-17T02:22:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.477260+0000", 2024-09-17T02:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5339999999999998e-06 2024-09-17T02:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.477267+0000", 2024-09-17T02:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3159999999999999e-06 2024-09-17T02:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.477272+0000", 2024-09-17T02:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6990000000000002e-06 2024-09-17T02:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:187131 5.8 5:18a329c3:::benchmark_data_smithi001_23533_object59014:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-17T02:22:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:03.464987+0000", 2024-09-17T02:22:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.011771752999999999, 2024-09-17T02:22:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012682201000000001, 2024-09-17T02:22:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 187131 2024-09-17T02:22:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.464987+0000", 2024-09-17T02:22:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.464987+0000", 2024-09-17T02:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.464988+0000", 2024-09-17T02:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4099999999999997e-07 2024-09-17T02:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.464992+0000", 2024-09-17T02:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1320000000000004e-06 2024-09-17T02:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.465002+0000", 2024-09-17T02:22:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8789999999999998e-06 2024-09-17T02:22:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.465008+0000", 2024-09-17T02:22:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2160000000000003e-06 2024-09-17T02:22:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.471441+0000", 2024-09-17T02:22:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064331709999999997 2024-09-17T02:22:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.471564+0000", 2024-09-17T02:22:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012324699999999999 2024-09-17T02:22:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.471655+0000", 2024-09-17T02:22:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0882000000000002e-05 2024-09-17T02:22:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:03.476216+0000", 2024-09-17T02:22:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045613140000000003 2024-09-17T02:22:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:22:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 17 2024-09-17T02:22:03.549 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:03.551 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:03.551 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:03.551+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:03.596 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:22:03.596 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:22:03.616 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:22:03.617 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:22:03.617 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:22:03.620 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:22:03.621 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:22:03.651 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:03.651+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:03.700 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:03.701 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:03.719 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:03.752 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:03.751+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:03.854 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:03.855+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:03.875 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:03.876 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:03.894 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:03.955 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:03.956+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:04.052 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:04.052 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:04.056 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:04.060+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:04.070 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:04.157 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:04.159+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:04.218 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:04.219 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:04.237 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:04.281 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:04.283+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:04.359 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:04.359+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:04.430 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:04.430 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:04.448 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:04.497 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:04.500+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:04.561 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:04.564+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:04.596 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:04.596 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:04.615 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:04.700 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:04.704+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:04.763 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:04.763+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:04.810 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:04.810 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:04.830 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:04.864 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:04.863+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:04.966 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:04.968+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:05.021 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:05.021 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:05.041 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:05.068 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T02:22:05.085 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:05.087+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:05.167 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:05.167+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:05.185 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:05.185 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:05.201 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:05.293 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:05.295+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:05.370 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:05.372+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:05.370 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:05.371 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:05.385 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:05.471 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:05.472+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:05.556 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:05.556 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:05.570 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:05.572 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:05.571+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:05.624 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:22:05.672 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:05.671+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:05.695 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:05.696 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:05.709 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:05.774 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:05.775+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:05.783 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:22:05.784 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:22:05.804 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:22:05.804 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:22:05.804 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:22:05.807 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:22:05.808 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:22:05.824 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:05.824 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:22:05.824 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:22:05.824 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:22:05.824 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:05.837 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:05.875 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:05.875+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:05.954 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:05.954 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:22:05.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:22:05.954 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:22:05.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:22:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 83.385742488000005, 2024-09-17T02:22:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:22:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:22:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:05.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:05.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:05.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:05.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:05.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:05.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:05.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:22:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:22:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:22:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:22:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:22:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:22:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:05.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:22:05.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:22:05.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:05.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:22:05.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:22:05.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:05.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:22:05.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:22:05.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:05.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:22:05.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:22:05.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:05.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:22:05.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:22:05.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:05.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:22:05.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:22:05.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:05.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:22:05.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:22:05.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:22:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:22:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:22:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 83.381840237999995, 2024-09-17T02:22:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:22:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:05.962 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:05.962 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:05.962 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:05.962 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:05.962 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:22:05.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.962 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:05.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:05.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:05.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:05.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:22:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:22:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:22:05.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:22:05.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:05.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:22:05.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:22:05.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:05.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:22:05.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:22:05.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:05.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:22:05.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:22:05.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:05.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:22:05.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:22:05.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:05.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:22:05.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:22:05.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:05.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:22:05.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:22:05.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:05.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:22:05.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:22:05.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:05.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:22:05.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:22:05.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:05.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:22:05.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:22:05.968 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:05.968 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:05.968 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:05.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:71206 5.3 e39/38 5:c6c9386d:::benchmark_data_smithi001_23533_object71205:head v 39'4517, mlcod=35'4513)", 2024-09-17T02:22:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:22:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 61.344513122999999, 2024-09-17T02:22:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026101868, 2024-09-17T02:22:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:22:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609692+0000", 2024-09-17T02:22:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609694+0000", 2024-09-17T02:22:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9539999999999998e-06 2024-09-17T02:22:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609841+0000", 2024-09-17T02:22:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014690800000000001 2024-09-17T02:22:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609872+0000", 2024-09-17T02:22:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0326000000000001e-05 2024-09-17T02:22:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.609892+0000", 2024-09-17T02:22:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9848999999999999e-05 2024-09-17T02:22:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613826+0000", 2024-09-17T02:22:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039345140000000001 2024-09-17T02:22:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.613908+0000", 2024-09-17T02:22:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2412999999999999e-05 2024-09-17T02:22:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635696+0000", 2024-09-17T02:22:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021787597999999998 2024-09-17T02:22:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:04.635794+0000", 2024-09-17T02:22:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8306000000000004e-05 2024-09-17T02:22:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97151 5.5 5:a0c2c072:::benchmark_data_smithi001_23533_object97150:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:22:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.685833516000002, 2024-09-17T02:22:05.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027297614000000001, 2024-09-17T02:22:05.974 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:05.974 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:05.974 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:05.974 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:05.974 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:05.974 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:05.974 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97151 2024-09-17T02:22:05.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.974 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:05.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:05.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:22:05.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:05.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:05.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268372+0000", 2024-09-17T02:22:05.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:05.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:05.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268373+0000", 2024-09-17T02:22:05.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4000000000000002e-07 2024-09-17T02:22:05.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:05.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268423+0000", 2024-09-17T02:22:05.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0175e-05 2024-09-17T02:22:05.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:05.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268428+0000", 2024-09-17T02:22:05.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-17T02:22:05.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:05.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.268431+0000", 2024-09-17T02:22:05.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.179e-06 2024-09-17T02:22:05.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:05.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283631+0000", 2024-09-17T02:22:05.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015199691 2024-09-17T02:22:05.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:05.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283740+0000", 2024-09-17T02:22:05.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109305 2024-09-17T02:22:05.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:05.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.283863+0000", 2024-09-17T02:22:05.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012226699999999999 2024-09-17T02:22:05.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:05.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.290857+0000", 2024-09-17T02:22:05.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069945449999999996 2024-09-17T02:22:05.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295595+0000", 2024-09-17T02:22:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047376750000000002 2024-09-17T02:22:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295638+0000", 2024-09-17T02:22:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3671999999999998e-05 2024-09-17T02:22:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.295670+0000", 2024-09-17T02:22:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1266000000000002e-05 2024-09-17T02:22:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:05.980 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:05.980 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:05.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.980 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97759 5.a 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:05.980 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:05.980 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.355820414999997, 2024-09-17T02:22:05.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.089694871999999995, 2024-09-17T02:22:05.980 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:05.980 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:05.980 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:05.980 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97759 2024-09-17T02:22:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598386+0000", 2024-09-17T02:22:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999999e-07 2024-09-17T02:22:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598414+0000", 2024-09-17T02:22:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8013000000000001e-05 2024-09-17T02:22:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598420+0000", 2024-09-17T02:22:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1149999999999999e-06 2024-09-17T02:22:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598424+0000", 2024-09-17T02:22:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:22:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598479+0000", 2024-09-17T02:22:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4648999999999998e-05 2024-09-17T02:22:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598587+0000", 2024-09-17T02:22:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010853000000000001 2024-09-17T02:22:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598676+0000", 2024-09-17T02:22:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8381999999999995e-05 2024-09-17T02:22:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603766+0000", 2024-09-17T02:22:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050902559999999996 2024-09-17T02:22:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.687988+0000", 2024-09-17T02:22:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.084221753999999996 2024-09-17T02:22:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688037+0000", 2024-09-17T02:22:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-05 2024-09-17T02:22:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688080+0000", 2024-09-17T02:22:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3149999999999999e-05 2024-09-17T02:22:05.986 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:05.986 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:05.986 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:05.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.986 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97770 5.0 5:09c75033:::benchmark_data_smithi001_23533_object97769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:05.986 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:05.986 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.350677984999997, 2024-09-17T02:22:05.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.086380868, 2024-09-17T02:22:05.986 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:05.986 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:05.986 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97770 2024-09-17T02:22:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:05.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:05.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:05.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:05.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603529+0000", 2024-09-17T02:22:05.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:22:05.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:05.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603593+0000", 2024-09-17T02:22:05.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4216999999999999e-05 2024-09-17T02:22:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603603+0000", 2024-09-17T02:22:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5179999999999993e-06 2024-09-17T02:22:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603608+0000", 2024-09-17T02:22:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2039999999999996e-06 2024-09-17T02:22:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603653+0000", 2024-09-17T02:22:05.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5247000000000002e-05 2024-09-17T02:22:05.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:05.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603758+0000", 2024-09-17T02:22:05.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105352 2024-09-17T02:22:05.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:05.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603900+0000", 2024-09-17T02:22:05.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014198999999999999 2024-09-17T02:22:05.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.606097+0000", 2024-09-17T02:22:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021969839999999999 2024-09-17T02:22:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689756+0000", 2024-09-17T02:22:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.083659077999999998 2024-09-17T02:22:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689846+0000", 2024-09-17T02:22:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9320999999999994e-05 2024-09-17T02:22:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689908+0000", 2024-09-17T02:22:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720999999999998e-05 2024-09-17T02:22:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127513 5.c 5:3eca08e4:::benchmark_data_smithi001_23533_object127512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 33.509901561, 2024-09-17T02:22:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046626399999999998, 2024-09-17T02:22:05.993 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:05.993 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:05.993 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:05.993 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:05.993 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:05.993 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:05.993 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127513 2024-09-17T02:22:05.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.993 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:05.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:05.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:05.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:05.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:05.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:05.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:05.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:05.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444305+0000", 2024-09-17T02:22:05.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2529999999999999e-06 2024-09-17T02:22:05.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444466+0000", 2024-09-17T02:22:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016069700000000001 2024-09-17T02:22:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444479+0000", 2024-09-17T02:22:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2602999999999999e-05 2024-09-17T02:22:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444485+0000", 2024-09-17T02:22:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.669e-06 2024-09-17T02:22:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444560+0000", 2024-09-17T02:22:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4276999999999994e-05 2024-09-17T02:22:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444656+0000", 2024-09-17T02:22:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6490000000000006e-05 2024-09-17T02:22:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444739+0000", 2024-09-17T02:22:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3139999999999993e-05 2024-09-17T02:22:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.448438+0000", 2024-09-17T02:22:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036985490000000002 2024-09-17T02:22:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490732+0000", 2024-09-17T02:22:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042294353999999999 2024-09-17T02:22:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490859+0000", 2024-09-17T02:22:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012708899999999999 2024-09-17T02:22:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490930+0000", 2024-09-17T02:22:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127514 5.c 5:39cc1feb:::benchmark_data_smithi001_23533_object127513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 33.509704792000001, 2024-09-17T02:22:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049357228000000003, 2024-09-17T02:22:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127514 2024-09-17T02:22:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8599999999999998e-07 2024-09-17T02:22:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444554+0000", 2024-09-17T02:22:06.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3047999999999998e-05 2024-09-17T02:22:06.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:06.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444562+0000", 2024-09-17T02:22:06.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5830000000000001e-06 2024-09-17T02:22:06.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444567+0000", 2024-09-17T02:22:06.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4179999999999996e-06 2024-09-17T02:22:06.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:06.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446566+0000", 2024-09-17T02:22:06.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001998788 2024-09-17T02:22:06.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:06.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446696+0000", 2024-09-17T02:22:06.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129393 2024-09-17T02:22:06.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:06.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446794+0000", 2024-09-17T02:22:06.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8462999999999996e-05 2024-09-17T02:22:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.449036+0000", 2024-09-17T02:22:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022415880000000001 2024-09-17T02:22:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493737+0000", 2024-09-17T02:22:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044701682 2024-09-17T02:22:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:06.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493808+0000", 2024-09-17T02:22:06.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0846000000000006e-05 2024-09-17T02:22:06.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:06.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493858+0000", 2024-09-17T02:22:06.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9932999999999998e-05 2024-09-17T02:22:06.004 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.004 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:06.004 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.004 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129441 5.1 5:84c3199f:::benchmark_data_smithi001_23533_object1324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:06.005 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:06.005 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.450694303999999, 2024-09-17T02:22:06.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034387011000000002, 2024-09-17T02:22:06.005 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:06.005 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:06.005 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.005 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:06.005 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:06.005 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.005 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129441 2024-09-17T02:22:06.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.005 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:06.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:06.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:06.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:06.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:06.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:06.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503513+0000", 2024-09-17T02:22:06.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4759999999999999e-06 2024-09-17T02:22:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503518+0000", 2024-09-17T02:22:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-09-17T02:22:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503532+0000", 2024-09-17T02:22:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4049999999999999e-05 2024-09-17T02:22:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503541+0000", 2024-09-17T02:22:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5320000000000006e-06 2024-09-17T02:22:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506331+0000", 2024-09-17T02:22:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027899190000000001 2024-09-17T02:22:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506402+0000", 2024-09-17T02:22:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:06.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506477+0000", 2024-09-17T02:22:06.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4626e-05 2024-09-17T02:22:06.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:06.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509749+0000", 2024-09-17T02:22:06.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032726980000000001 2024-09-17T02:22:06.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537758+0000", 2024-09-17T02:22:06.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028008890000000002 2024-09-17T02:22:06.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:06.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537812+0000", 2024-09-17T02:22:06.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3300000000000001e-05 2024-09-17T02:22:06.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:06.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537898+0000", 2024-09-17T02:22:06.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6691000000000001e-05 2024-09-17T02:22:06.010 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.010 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:06.010 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129442 5.1 5:8f7f2a95:::benchmark_data_smithi001_23533_object1325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.447723695000001, 2024-09-17T02:22:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031546698999999997, 2024-09-17T02:22:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129442 2024-09-17T02:22:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:06.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:06.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:06.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:06.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:06.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506483+0000", 2024-09-17T02:22:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2869999999999999e-06 2024-09-17T02:22:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506489+0000", 2024-09-17T02:22:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2330000000000003e-06 2024-09-17T02:22:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506502+0000", 2024-09-17T02:22:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2286999999999999e-05 2024-09-17T02:22:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506511+0000", 2024-09-17T02:22:06.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7799999999999995e-06 2024-09-17T02:22:06.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:06.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.507966+0000", 2024-09-17T02:22:06.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014541549999999999 2024-09-17T02:22:06.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:06.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508130+0000", 2024-09-17T02:22:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016455199999999999 2024-09-17T02:22:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508287+0000", 2024-09-17T02:22:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015730400000000001 2024-09-17T02:22:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510577+0000", 2024-09-17T02:22:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022899449999999998 2024-09-17T02:22:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537932+0000", 2024-09-17T02:22:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027354471000000002 2024-09-17T02:22:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537964+0000", 2024-09-17T02:22:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1909999999999998e-05 2024-09-17T02:22:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.538029+0000", 2024-09-17T02:22:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4775000000000002e-05 2024-09-17T02:22:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129443 5.8 5:1edfeaf8:::benchmark_data_smithi001_23533_object1326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:22:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.444289195, 2024-09-17T02:22:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025315902000000001, 2024-09-17T02:22:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:06.018 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.018 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129443 2024-09-17T02:22:06.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.018 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:06.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:06.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:22:06.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:06.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509916+0000", 2024-09-17T02:22:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509918+0000", 2024-09-17T02:22:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3689999999999999e-06 2024-09-17T02:22:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509923+0000", 2024-09-17T02:22:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0429999999999998e-06 2024-09-17T02:22:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509936+0000", 2024-09-17T02:22:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3234000000000001e-05 2024-09-17T02:22:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509950+0000", 2024-09-17T02:22:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3998999999999999e-05 2024-09-17T02:22:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509994+0000", 2024-09-17T02:22:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4323000000000002e-05 2024-09-17T02:22:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510095+0000", 2024-09-17T02:22:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010103300000000001 2024-09-17T02:22:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510160+0000", 2024-09-17T02:22:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4976999999999998e-05 2024-09-17T02:22:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.513304+0000", 2024-09-17T02:22:06.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031431330000000002 2024-09-17T02:22:06.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535046+0000", 2024-09-17T02:22:06.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021742276000000001 2024-09-17T02:22:06.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:06.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:22:06.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107759 2024-09-17T02:22:06.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:06.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.535232+0000", 2024-09-17T02:22:06.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8756000000000003e-05 2024-09-17T02:22:06.023 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.023 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:06.023 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.023 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:138247 5.3 5:caf01f60:::benchmark_data_smithi001_23533_object10130:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:22:06.023 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.335014+0000", 2024-09-17T02:22:06.023 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.619191621999999, 2024-09-17T02:22:06.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026419469000000001, 2024-09-17T02:22:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 138247 2024-09-17T02:22:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335014+0000", 2024-09-17T02:22:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:06.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335014+0000", 2024-09-17T02:22:06.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:06.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335015+0000", 2024-09-17T02:22:06.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3600000000000004e-07 2024-09-17T02:22:06.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335017+0000", 2024-09-17T02:22:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5749999999999999e-06 2024-09-17T02:22:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335024+0000", 2024-09-17T02:22:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8379999999999996e-06 2024-09-17T02:22:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335029+0000", 2024-09-17T02:22:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.22e-06 2024-09-17T02:22:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335083+0000", 2024-09-17T02:22:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3600000000000002e-05 2024-09-17T02:22:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335229+0000", 2024-09-17T02:22:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000146098 2024-09-17T02:22:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.335349+0000", 2024-09-17T02:22:06.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120631 2024-09-17T02:22:06.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.357942+0000", 2024-09-17T02:22:06.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022592457 2024-09-17T02:22:06.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:06.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.361286+0000", 2024-09-17T02:22:06.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003343623 2024-09-17T02:22:06.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:06.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.361338+0000", 2024-09-17T02:22:06.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2323e-05 2024-09-17T02:22:06.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:06.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.361433+0000", 2024-09-17T02:22:06.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5568000000000004e-05 2024-09-17T02:22:06.029 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.029 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:06.029 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.030 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:138244 5.b e54/51 5:d38c94c4:::benchmark_data_smithi001_23533_object10127:head v 54'8567, mlcod=54'8564)", 2024-09-17T02:22:06.030 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.336586+0000", 2024-09-17T02:22:06.030 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.617619231999999, 2024-09-17T02:22:06.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026602741999999999, 2024-09-17T02:22:06.030 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:06.030 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:06.030 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.030 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:06.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:06.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336586+0000", 2024-09-17T02:22:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336586+0000", 2024-09-17T02:22:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336587+0000", 2024-09-17T02:22:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0600000000000001e-07 2024-09-17T02:22:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336590+0000", 2024-09-17T02:22:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3110000000000001e-06 2024-09-17T02:22:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336597+0000", 2024-09-17T02:22:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0639999999999996e-06 2024-09-17T02:22:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336602+0000", 2024-09-17T02:22:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3599999999999998e-06 2024-09-17T02:22:06.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:06.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336645+0000", 2024-09-17T02:22:06.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3628999999999999e-05 2024-09-17T02:22:06.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:06.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.336666+0000", 2024-09-17T02:22:06.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0604000000000001e-05 2024-09-17T02:22:06.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363143+0000", 2024-09-17T02:22:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026477055999999999 2024-09-17T02:22:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363189+0000", 2024-09-17T02:22:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6312e-05 2024-09-17T02:22:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:138259 5.3 5:c08b4023:::benchmark_data_smithi001_23533_object10142:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:22:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.337063+0000", 2024-09-17T02:22:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.617142414, 2024-09-17T02:22:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027773173000000002, 2024-09-17T02:22:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 138259 2024-09-17T02:22:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:06.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337063+0000", 2024-09-17T02:22:06.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:06.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337063+0000", 2024-09-17T02:22:06.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:06.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337064+0000", 2024-09-17T02:22:06.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-17T02:22:06.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:06.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337066+0000", 2024-09-17T02:22:06.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.03e-06 2024-09-17T02:22:06.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:06.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337072+0000", 2024-09-17T02:22:06.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5119999999999997e-06 2024-09-17T02:22:06.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.337077+0000", 2024-09-17T02:22:06.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.454e-06 2024-09-17T02:22:06.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:06.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.352990+0000", 2024-09-17T02:22:06.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015913116000000001 2024-09-17T02:22:06.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:06.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.353136+0000", 2024-09-17T02:22:06.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000146117 2024-09-17T02:22:06.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:06.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.353253+0000", 2024-09-17T02:22:06.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117359 2024-09-17T02:22:06.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.358284+0000", 2024-09-17T02:22:06.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050306689999999998 2024-09-17T02:22:06.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:06.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.364738+0000", 2024-09-17T02:22:06.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064539410000000004 2024-09-17T02:22:06.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:06.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.364768+0000", 2024-09-17T02:22:06.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0086999999999998e-05 2024-09-17T02:22:06.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:06.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.364836+0000", 2024-09-17T02:22:06.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8549999999999999e-05 2024-09-17T02:22:06.040 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.040 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:06.041 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.041 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:138249 5.b e54/51 5:dcbad32d:::benchmark_data_smithi001_23533_object10132:head v 54'8568, mlcod=54'8564)", 2024-09-17T02:22:06.041 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.338016+0000", 2024-09-17T02:22:06.041 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.616190073999999, 2024-09-17T02:22:06.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025210803, 2024-09-17T02:22:06.041 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:06.041 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:06.041 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.041 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:06.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:06.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338016+0000", 2024-09-17T02:22:06.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:06.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338016+0000", 2024-09-17T02:22:06.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:06.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338017+0000", 2024-09-17T02:22:06.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.28e-06 2024-09-17T02:22:06.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:06.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338022+0000", 2024-09-17T02:22:06.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0950000000000003e-06 2024-09-17T02:22:06.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:06.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338032+0000", 2024-09-17T02:22:06.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7140000000000005e-06 2024-09-17T02:22:06.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.338038+0000", 2024-09-17T02:22:06.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1029999999999998e-06 2024-09-17T02:22:06.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:06.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.349300+0000", 2024-09-17T02:22:06.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01126216 2024-09-17T02:22:06.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:06.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.349359+0000", 2024-09-17T02:22:06.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9206999999999997e-05 2024-09-17T02:22:06.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:06.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363192+0000", 2024-09-17T02:22:06.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013833253 2024-09-17T02:22:06.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:06.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.363226+0000", 2024-09-17T02:22:06.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3991e-05 2024-09-17T02:22:06.045 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.045 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:06.046 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.046 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:139587 5.1 5:801d98ef:::benchmark_data_smithi001_23533_object11470:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:22:06.046 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:40.931670+0000", 2024-09-17T02:22:06.046 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.022535335000001, 2024-09-17T02:22:06.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025666268999999999, 2024-09-17T02:22:06.046 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:06.046 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:06.046 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.047 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:06.047 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:06.047 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.047 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 139587 2024-09-17T02:22:06.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.047 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:06.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:06.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931670+0000", 2024-09-17T02:22:06.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:06.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931670+0000", 2024-09-17T02:22:06.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:06.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931671+0000", 2024-09-17T02:22:06.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.034e-06 2024-09-17T02:22:06.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:06.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931677+0000", 2024-09-17T02:22:06.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4580000000000001e-06 2024-09-17T02:22:06.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:06.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931690+0000", 2024-09-17T02:22:06.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3152999999999999e-05 2024-09-17T02:22:06.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931699+0000", 2024-09-17T02:22:06.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3100000000000006e-06 2024-09-17T02:22:06.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:06.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931779+0000", 2024-09-17T02:22:06.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0284000000000006e-05 2024-09-17T02:22:06.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:06.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.931968+0000", 2024-09-17T02:22:06.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018853399999999999 2024-09-17T02:22:06.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:06.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.932149+0000", 2024-09-17T02:22:06.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018114699999999999 2024-09-17T02:22:06.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:06.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.935163+0000", 2024-09-17T02:22:06.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030143169999999999 2024-09-17T02:22:06.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.957199+0000", 2024-09-17T02:22:06.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022035255 2024-09-17T02:22:06.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:06.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.957247+0000", 2024-09-17T02:22:06.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8319999999999998e-05 2024-09-17T02:22:06.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:06.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:40.957337+0000", 2024-09-17T02:22:06.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9456999999999994e-05 2024-09-17T02:22:06.052 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.052 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:06.052 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.053 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:140178 5.1 5:8f77d9ee:::benchmark_data_smithi001_23533_object12061:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T02:22:06.053 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:22:06.053 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 24.766749844, 2024-09-17T02:22:06.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025269478000000001, 2024-09-17T02:22:06.053 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:06.053 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:06.053 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.053 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:06.053 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:06.053 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.053 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 140178 2024-09-17T02:22:06.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.053 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:06.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:06.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:22:06.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:06.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:22:06.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:06.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187456+0000", 2024-09-17T02:22:06.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0500000000000004e-07 2024-09-17T02:22:06.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:06.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187459+0000", 2024-09-17T02:22:06.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5299999999999999e-06 2024-09-17T02:22:06.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:06.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187468+0000", 2024-09-17T02:22:06.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3130000000000004e-06 2024-09-17T02:22:06.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.187473+0000", 2024-09-17T02:22:06.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-09-17T02:22:06.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:06.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.192476+0000", 2024-09-17T02:22:06.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050035339999999996 2024-09-17T02:22:06.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:06.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.192603+0000", 2024-09-17T02:22:06.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012652299999999999 2024-09-17T02:22:06.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:06.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.192719+0000", 2024-09-17T02:22:06.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011568700000000001 2024-09-17T02:22:06.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:06.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.196336+0000", 2024-09-17T02:22:06.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003617178 2024-09-17T02:22:06.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.212470+0000", 2024-09-17T02:22:06.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016134402999999999 2024-09-17T02:22:06.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:06.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.212522+0000", 2024-09-17T02:22:06.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1480000000000002e-05 2024-09-17T02:22:06.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:06.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:41.212725+0000", 2024-09-17T02:22:06.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020359100000000001 2024-09-17T02:22:06.058 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.059 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:06.059 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.059 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:150456 5.2 5:4ee9ae1c:::benchmark_data_smithi001_23533_object22339:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:22:06.059 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.838305+0000", 2024-09-17T02:22:06.059 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 20.115900618000001, 2024-09-17T02:22:06.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026350045999999998, 2024-09-17T02:22:06.059 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:06.059 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:06.059 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.059 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:06.059 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:06.060 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.060 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 150456 2024-09-17T02:22:06.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.060 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:06.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:06.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838305+0000", 2024-09-17T02:22:06.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:06.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838305+0000", 2024-09-17T02:22:06.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:06.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838305+0000", 2024-09-17T02:22:06.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4999999999999998e-07 2024-09-17T02:22:06.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:06.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838308+0000", 2024-09-17T02:22:06.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.187e-06 2024-09-17T02:22:06.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:06.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838314+0000", 2024-09-17T02:22:06.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2400000000000004e-06 2024-09-17T02:22:06.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838318+0000", 2024-09-17T02:22:06.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5020000000000003e-06 2024-09-17T02:22:06.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:06.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.840927+0000", 2024-09-17T02:22:06.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026083690000000001 2024-09-17T02:22:06.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:06.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.841037+0000", 2024-09-17T02:22:06.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109888 2024-09-17T02:22:06.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:06.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.864539+0000", 2024-09-17T02:22:06.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023502788 2024-09-17T02:22:06.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:06.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.864586+0000", 2024-09-17T02:22:06.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6554999999999997e-05 2024-09-17T02:22:06.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:06.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.864655+0000", 2024-09-17T02:22:06.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9066999999999994e-05 2024-09-17T02:22:06.064 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.064 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:06.064 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.064 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:150458 5.a 5:59b62890:::benchmark_data_smithi001_23533_object22341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:22:06.064 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:06.064 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 20.115879887999998, 2024-09-17T02:22:06.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028150173000000001, 2024-09-17T02:22:06.064 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:06.065 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:06.065 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.065 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:06.065 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:06.065 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.065 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 150458 2024-09-17T02:22:06.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.065 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:06.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:06.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:06.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:06.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:06.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:06.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:06.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7800000000000002e-07 2024-09-17T02:22:06.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:06.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838328+0000", 2024-09-17T02:22:06.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.838e-06 2024-09-17T02:22:06.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:06.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838335+0000", 2024-09-17T02:22:06.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1999999999999997e-06 2024-09-17T02:22:06.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838340+0000", 2024-09-17T02:22:06.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7389999999999999e-06 2024-09-17T02:22:06.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:06.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849082+0000", 2024-09-17T02:22:06.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01074174 2024-09-17T02:22:06.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:06.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849192+0000", 2024-09-17T02:22:06.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011040300000000001 2024-09-17T02:22:06.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:06.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849297+0000", 2024-09-17T02:22:06.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104764 2024-09-17T02:22:06.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.857853+0000", 2024-09-17T02:22:06.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085558490000000008 2024-09-17T02:22:06.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:06.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866430+0000", 2024-09-17T02:22:06.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085768140000000003 2024-09-17T02:22:06.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:06.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866454+0000", 2024-09-17T02:22:06.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4428000000000001e-05 2024-09-17T02:22:06.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:06.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866476+0000", 2024-09-17T02:22:06.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.192e-05 2024-09-17T02:22:06.069 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.070 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:06.070 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.070 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:150461 5.a 5:58886edc:::benchmark_data_smithi001_23533_object22344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:22:06.070 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.838709+0000", 2024-09-17T02:22:06.070 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 20.115496574000002, 2024-09-17T02:22:06.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027819366000000002, 2024-09-17T02:22:06.070 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:06.070 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:06.070 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.070 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:06.070 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:06.070 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.071 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 150461 2024-09-17T02:22:06.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.071 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:06.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:06.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838709+0000", 2024-09-17T02:22:06.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:06.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838709+0000", 2024-09-17T02:22:06.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:06.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838710+0000", 2024-09-17T02:22:06.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9399999999999995e-07 2024-09-17T02:22:06.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:06.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838712+0000", 2024-09-17T02:22:06.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.57e-06 2024-09-17T02:22:06.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:06.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838843+0000", 2024-09-17T02:22:06.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130469 2024-09-17T02:22:06.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838925+0000", 2024-09-17T02:22:06.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2622999999999998e-05 2024-09-17T02:22:06.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:06.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.855341+0000", 2024-09-17T02:22:06.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016415965000000001 2024-09-17T02:22:06.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:06.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.855509+0000", 2024-09-17T02:22:06.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016805800000000001 2024-09-17T02:22:06.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:06.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.855638+0000", 2024-09-17T02:22:06.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012901199999999999 2024-09-17T02:22:06.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.860084+0000", 2024-09-17T02:22:06.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044458650000000002 2024-09-17T02:22:06.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:06.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866486+0000", 2024-09-17T02:22:06.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064016919999999996 2024-09-17T02:22:06.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:06.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866505+0000", 2024-09-17T02:22:06.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9667e-05 2024-09-17T02:22:06.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:06.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866528+0000", 2024-09-17T02:22:06.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2951000000000001e-05 2024-09-17T02:22:06.076 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.076 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:06.076 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.076 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.076 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:06.076 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:06.077 INFO:teuthology.orchestra.run.smithi001.stderr:noscrub is set 2024-09-17T02:22:06.078 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:06.080+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:06.078 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:06.178 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:06.180+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:06.224 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:06.225 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:22:06.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.225 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:191117 5.f 5:fa6d6c8f:::benchmark_data_smithi001_23533_object63000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T02:22:06.225 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:06.224650+0000", 2024-09-17T02:22:06.225 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0038278909999999999, 2024-09-17T02:22:06.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038969230000000001, 2024-09-17T02:22:06.225 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:06.225 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:06.225 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:06.225 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:06.225 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:06.225 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.226 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 191117 2024-09-17T02:22:06.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.226 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:06.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:06.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:06.224650+0000", 2024-09-17T02:22:06.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:06.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:06.224650+0000", 2024-09-17T02:22:06.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:06.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:06.224652+0000", 2024-09-17T02:22:06.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.823e-06 2024-09-17T02:22:06.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:06.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:06.224661+0000", 2024-09-17T02:22:06.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1530000000000003e-06 2024-09-17T02:22:06.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:06.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:06.224687+0000", 2024-09-17T02:22:06.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5232000000000002e-05 2024-09-17T02:22:06.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:06.224706+0000", 2024-09-17T02:22:06.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9559e-05 2024-09-17T02:22:06.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:06.224845+0000", 2024-09-17T02:22:06.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000138961 2024-09-17T02:22:06.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:06.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:06.225054+0000", 2024-09-17T02:22:06.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020846999999999999 2024-09-17T02:22:06.229 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.229 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:06.229 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.229 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:191119 5.f 5:f20f1af1:::benchmark_data_smithi001_23533_object63002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T02:22:06.229 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:06.227737+0000", 2024-09-17T02:22:06.229 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00074131100000000003, 2024-09-17T02:22:06.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001060278, 2024-09-17T02:22:06.229 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:06.230 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:06.230 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:06.230 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:06.230 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:06.230 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.230 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 191119 2024-09-17T02:22:06.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.230 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:06.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:06.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:06.227737+0000", 2024-09-17T02:22:06.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:06.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:06.227737+0000", 2024-09-17T02:22:06.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:06.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:06.227739+0000", 2024-09-17T02:22:06.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6270000000000001e-06 2024-09-17T02:22:06.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:06.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:06.227746+0000", 2024-09-17T02:22:06.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8650000000000003e-06 2024-09-17T02:22:06.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:06.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:06.227770+0000", 2024-09-17T02:22:06.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4706e-05 2024-09-17T02:22:06.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:06.227790+0000", 2024-09-17T02:22:06.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9272000000000001e-05 2024-09-17T02:22:06.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:06.228299+0000", 2024-09-17T02:22:06.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050900499999999998 2024-09-17T02:22:06.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:06.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:06.228505+0000", 2024-09-17T02:22:06.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000206114 2024-09-17T02:22:06.233 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.233 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:06.233 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.233 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.233 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:22:06.233 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 2 2024-09-17T02:22:06.234 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:06.245 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:06.281 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:06.280+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:06.380 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:06.379+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:06.407 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:06.408 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:22:06.408 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:22:06.408 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:22:06.408 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:06.429 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:06.481 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:06.484+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:06.583 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:06.584+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:06.637 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:06.638 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:22:06.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:22:06.638 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:22:06.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.638 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97749 5.b 5:d930ef52:::benchmark_data_smithi001_23533_object97748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:06.638 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:06.638 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.046970311999999, 2024-09-17T02:22:06.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092964343000000005, 2024-09-17T02:22:06.638 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:06.638 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:06.638 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.638 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:06.639 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:06.639 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.639 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97749 2024-09-17T02:22:06.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.639 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:06.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:06.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:06.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:06.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:06.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:06.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591947+0000", 2024-09-17T02:22:06.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:22:06.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:06.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592011+0000", 2024-09-17T02:22:06.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3608000000000005e-05 2024-09-17T02:22:06.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:06.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592021+0000", 2024-09-17T02:22:06.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9979999999999998e-06 2024-09-17T02:22:06.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592028+0000", 2024-09-17T02:22:06.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1439999999999997e-06 2024-09-17T02:22:06.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593633+0000", 2024-09-17T02:22:06.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001604636 2024-09-17T02:22:06.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:06.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593757+0000", 2024-09-17T02:22:06.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012432099999999999 2024-09-17T02:22:06.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:06.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593866+0000", 2024-09-17T02:22:06.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109094 2024-09-17T02:22:06.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:06.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601190+0000", 2024-09-17T02:22:06.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073237620000000002 2024-09-17T02:22:06.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601356+0000", 2024-09-17T02:22:06.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016651900000000001 2024-09-17T02:22:06.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684618+0000", 2024-09-17T02:22:06.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083261356999999994 2024-09-17T02:22:06.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:06.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684724+0000", 2024-09-17T02:22:06.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010681800000000001 2024-09-17T02:22:06.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:06.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684911+0000", 2024-09-17T02:22:06.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186243 2024-09-17T02:22:06.644 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.645 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:06.645 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.645 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97752 5.b 5:d146f486:::benchmark_data_smithi001_23533_object97751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:06.645 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:06.645 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.045617618000001, 2024-09-17T02:22:06.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091989557, 2024-09-17T02:22:06.645 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:06.645 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:06.645 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.645 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:06.646 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:06.646 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.646 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97752 2024-09-17T02:22:06.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.646 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:06.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:06.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:06.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:06.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:06.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:06.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593300+0000", 2024-09-17T02:22:06.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8199999999999998e-07 2024-09-17T02:22:06.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:06.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593364+0000", 2024-09-17T02:22:06.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3831999999999995e-05 2024-09-17T02:22:06.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:06.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593376+0000", 2024-09-17T02:22:06.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1800999999999999e-05 2024-09-17T02:22:06.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593382+0000", 2024-09-17T02:22:06.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6780000000000003e-06 2024-09-17T02:22:06.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595491+0000", 2024-09-17T02:22:06.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021090689999999999 2024-09-17T02:22:06.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:06.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595614+0000", 2024-09-17T02:22:06.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012321500000000001 2024-09-17T02:22:06.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:06.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595778+0000", 2024-09-17T02:22:06.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016321900000000001 2024-09-17T02:22:06.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:06.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601197+0000", 2024-09-17T02:22:06.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054195600000000003 2024-09-17T02:22:06.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601396+0000", 2024-09-17T02:22:06.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019825299999999999 2024-09-17T02:22:06.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684990+0000", 2024-09-17T02:22:06.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083594878999999997 2024-09-17T02:22:06.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:06.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685116+0000", 2024-09-17T02:22:06.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012522799999999999 2024-09-17T02:22:06.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:06.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685289+0000", 2024-09-17T02:22:06.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172941 2024-09-17T02:22:06.653 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.653 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:06.653 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.654 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97754 5.b 5:da0615e5:::benchmark_data_smithi001_23533_object97753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:06.654 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:06.654 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.043979696000001, 2024-09-17T02:22:06.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092097207, 2024-09-17T02:22:06.654 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:06.654 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:06.654 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.654 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:06.654 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:06.654 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.655 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97754 2024-09-17T02:22:06.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.655 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:06.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:06.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:06.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:06.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:06.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:06.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594938+0000", 2024-09-17T02:22:06.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5000000000000002e-07 2024-09-17T02:22:06.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:06.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595075+0000", 2024-09-17T02:22:06.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137742 2024-09-17T02:22:06.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:06.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595087+0000", 2024-09-17T02:22:06.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1243000000000001e-05 2024-09-17T02:22:06.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595095+0000", 2024-09-17T02:22:06.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1030000000000002e-06 2024-09-17T02:22:06.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598461+0000", 2024-09-17T02:22:06.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033661170000000001 2024-09-17T02:22:06.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:06.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598540+0000", 2024-09-17T02:22:06.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8937999999999995e-05 2024-09-17T02:22:06.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:06.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598626+0000", 2024-09-17T02:22:06.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6042000000000001e-05 2024-09-17T02:22:06.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:06.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684258+0000", 2024-09-17T02:22:06.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085632394000000001 2024-09-17T02:22:06.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685369+0000", 2024-09-17T02:22:06.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001111063 2024-09-17T02:22:06.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685511+0000", 2024-09-17T02:22:06.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141965 2024-09-17T02:22:06.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:06.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685604+0000", 2024-09-17T02:22:06.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2935000000000004e-05 2024-09-17T02:22:06.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:06.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687034+0000", 2024-09-17T02:22:06.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001430015 2024-09-17T02:22:06.660 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.660 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:06.660 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.660 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97755 5.b 5:d36a03a1:::benchmark_data_smithi001_23533_object97754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:06.660 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:06.661 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.043806545999999, 2024-09-17T02:22:06.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0924904, 2024-09-17T02:22:06.661 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:06.661 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:06.661 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.661 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:06.661 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:06.661 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.661 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97755 2024-09-17T02:22:06.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.661 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:06.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:06.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:06.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:06.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:06.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:06.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595111+0000", 2024-09-17T02:22:06.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:22:06.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:06.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595145+0000", 2024-09-17T02:22:06.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3927000000000002e-05 2024-09-17T02:22:06.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:06.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595155+0000", 2024-09-17T02:22:06.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0023e-05 2024-09-17T02:22:06.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595162+0000", 2024-09-17T02:22:06.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3950000000000003e-06 2024-09-17T02:22:06.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599821+0000", 2024-09-17T02:22:06.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046592880000000001 2024-09-17T02:22:06.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:06.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599912+0000", 2024-09-17T02:22:06.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1049000000000002e-05 2024-09-17T02:22:06.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:06.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600062+0000", 2024-09-17T02:22:06.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015001700000000001 2024-09-17T02:22:06.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:06.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685307+0000", 2024-09-17T02:22:06.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085244340000000002 2024-09-17T02:22:06.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685446+0000", 2024-09-17T02:22:06.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013955700000000001 2024-09-17T02:22:06.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687375+0000", 2024-09-17T02:22:06.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019291079999999999 2024-09-17T02:22:06.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:06.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687462+0000", 2024-09-17T02:22:06.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6148000000000003e-05 2024-09-17T02:22:06.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:06.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687600+0000", 2024-09-17T02:22:06.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013887900000000001 2024-09-17T02:22:06.666 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.667 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:06.667 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.667 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 44/44 lb 5:c4567a04:::benchmark_data_smithi001_23533_object4200:head)", 2024-09-17T02:22:06.667 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:06.667 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.041709920000002, 2024-09-17T02:22:06.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092483421999999996, 2024-09-17T02:22:06.667 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:06.667 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:06.667 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:06.667 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:06.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:06.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:06.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:06.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:06.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:06.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:06.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6399999999999998e-07 2024-09-17T02:22:06.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:06.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597213+0000", 2024-09-17T02:22:06.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3659999999999997e-06 2024-09-17T02:22:06.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:06.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597222+0000", 2024-09-17T02:22:06.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0510000000000002e-06 2024-09-17T02:22:06.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597228+0000", 2024-09-17T02:22:06.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1569999999999999e-06 2024-09-17T02:22:06.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689588+0000", 2024-09-17T02:22:06.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092359931000000006 2024-09-17T02:22:06.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:06.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689622+0000", 2024-09-17T02:22:06.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4425999999999999e-05 2024-09-17T02:22:06.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:06.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689690+0000", 2024-09-17T02:22:06.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8126999999999993e-05 2024-09-17T02:22:06.671 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.671 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:06.671 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.672 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129462 5.4 5:2e0acc16:::benchmark_data_smithi001_23533_object1345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:06.672 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:06.672 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.103975851000001, 2024-09-17T02:22:06.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0112774899999999, 2024-09-17T02:22:06.672 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:06.672 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:06.672 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.672 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:06.672 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:06.672 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.672 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129462 2024-09-17T02:22:06.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.672 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:06.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:06.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:06.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:06.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:06.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:06.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534943+0000", 2024-09-17T02:22:06.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8759999999999999e-06 2024-09-17T02:22:06.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:06.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534951+0000", 2024-09-17T02:22:06.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3219999999999993e-06 2024-09-17T02:22:06.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:06.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534977+0000", 2024-09-17T02:22:06.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6245e-05 2024-09-17T02:22:06.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534992+0000", 2024-09-17T02:22:06.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4936000000000001e-05 2024-09-17T02:22:06.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535133+0000", 2024-09-17T02:22:06.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014051299999999999 2024-09-17T02:22:06.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:06.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:22:06.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1741000000000001e-05 2024-09-17T02:22:06.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.533906+0000", 2024-09-17T02:22:06.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99875209300000001 2024-09-17T02:22:06.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:06.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534348+0000", 2024-09-17T02:22:06.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044128899999999998 2024-09-17T02:22:06.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:06.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534762+0000", 2024-09-17T02:22:06.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000414707 2024-09-17T02:22:06.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:06.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545024+0000", 2024-09-17T02:22:06.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010261283 2024-09-17T02:22:06.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545953+0000", 2024-09-17T02:22:06.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000929618 2024-09-17T02:22:06.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:06.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546047+0000", 2024-09-17T02:22:06.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3697999999999996e-05 2024-09-17T02:22:06.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:06.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546218+0000", 2024-09-17T02:22:06.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017116899999999999 2024-09-17T02:22:06.678 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.678 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:06.679 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.679 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129480 5.4 5:2b1d398b:::benchmark_data_smithi001_23533_object1363:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:06.679 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:06.679 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.096221385, 2024-09-17T02:22:06.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0038926450000001, 2024-09-17T02:22:06.679 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:06.679 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:06.679 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.679 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:06.679 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:06.679 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.679 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129480 2024-09-17T02:22:06.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.680 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:06.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:06.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:06.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:06.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:06.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:06.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542696+0000", 2024-09-17T02:22:06.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9999999999999995e-07 2024-09-17T02:22:06.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:06.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542701+0000", 2024-09-17T02:22:06.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2240000000000003e-06 2024-09-17T02:22:06.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:06.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542716+0000", 2024-09-17T02:22:06.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4970000000000001e-05 2024-09-17T02:22:06.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542726+0000", 2024-09-17T02:22:06.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2879999999999998e-06 2024-09-17T02:22:06.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542832+0000", 2024-09-17T02:22:06.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010597199999999999 2024-09-17T02:22:06.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:06.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542843+0000", 2024-09-17T02:22:06.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.098e-05 2024-09-17T02:22:06.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538436+0000", 2024-09-17T02:22:06.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99559286800000002 2024-09-17T02:22:06.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:06.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538791+0000", 2024-09-17T02:22:06.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035585499999999997 2024-09-17T02:22:06.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:06.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.539144+0000", 2024-09-17T02:22:06.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035268499999999999 2024-09-17T02:22:06.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:06.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545880+0000", 2024-09-17T02:22:06.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00673552 2024-09-17T02:22:06.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546330+0000", 2024-09-17T02:22:06.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045039599999999999 2024-09-17T02:22:06.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:06.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546414+0000", 2024-09-17T02:22:06.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4468000000000005e-05 2024-09-17T02:22:06.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:06.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546588+0000", 2024-09-17T02:22:06.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017341899999999999 2024-09-17T02:22:06.685 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.685 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:06.685 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.686 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129505 5.4 5:294f2ec7:::benchmark_data_smithi001_23533_object1388:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:06.686 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:06.686 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.077208211999999, 2024-09-17T02:22:06.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98589826199999997, 2024-09-17T02:22:06.686 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:06.686 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:06.686 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.686 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:06.686 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:06.686 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.686 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129505 2024-09-17T02:22:06.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.687 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:06.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:06.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:06.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:06.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:06.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:06.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561710+0000", 2024-09-17T02:22:06.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7060000000000001e-06 2024-09-17T02:22:06.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:06.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561718+0000", 2024-09-17T02:22:06.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.542e-06 2024-09-17T02:22:06.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:06.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561741+0000", 2024-09-17T02:22:06.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3357e-05 2024-09-17T02:22:06.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561754+0000", 2024-09-17T02:22:06.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3200000000000001e-05 2024-09-17T02:22:06.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561867+0000", 2024-09-17T02:22:06.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113211 2024-09-17T02:22:06.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:06.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561888+0000", 2024-09-17T02:22:06.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0809999999999999e-05 2024-09-17T02:22:06.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542140+0000", 2024-09-17T02:22:06.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98025195799999998 2024-09-17T02:22:06.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:06.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542331+0000", 2024-09-17T02:22:06.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019127599999999999 2024-09-17T02:22:06.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:06.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542517+0000", 2024-09-17T02:22:06.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000185625 2024-09-17T02:22:06.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547114+0000", 2024-09-17T02:22:06.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045968620000000002 2024-09-17T02:22:06.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:06.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547187+0000", 2024-09-17T02:22:06.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3348000000000003e-05 2024-09-17T02:22:06.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:06.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547324+0000", 2024-09-17T02:22:06.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013681699999999999 2024-09-17T02:22:06.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:06.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547607+0000", 2024-09-17T02:22:06.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028255000000000001 2024-09-17T02:22:06.693 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.693 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:06.693 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.693 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129508 5.4 5:2892b582:::benchmark_data_smithi001_23533_object1391:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:06.693 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:06.693 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.075871118999999, 2024-09-17T02:22:06.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99697919099999999, 2024-09-17T02:22:06.693 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:06.693 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:06.694 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.694 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:06.694 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:06.694 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.694 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129508 2024-09-17T02:22:06.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.694 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:06.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:06.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:06.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:06.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:06.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:06.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563047+0000", 2024-09-17T02:22:06.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.274e-06 2024-09-17T02:22:06.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:06.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563054+0000", 2024-09-17T02:22:06.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2799999999999998e-06 2024-09-17T02:22:06.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:06.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563070+0000", 2024-09-17T02:22:06.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5991999999999999e-05 2024-09-17T02:22:06.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563078+0000", 2024-09-17T02:22:06.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2390000000000002e-06 2024-09-17T02:22:06.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563181+0000", 2024-09-17T02:22:06.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102249 2024-09-17T02:22:06.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:06.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563199+0000", 2024-09-17T02:22:06.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8215000000000001e-05 2024-09-17T02:22:06.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547713+0000", 2024-09-17T02:22:06.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98451446399999998 2024-09-17T02:22:06.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:06.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548063+0000", 2024-09-17T02:22:06.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034985499999999999 2024-09-17T02:22:06.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:06.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548490+0000", 2024-09-17T02:22:06.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042658600000000001 2024-09-17T02:22:06.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555655+0000", 2024-09-17T02:22:06.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071652579999999999 2024-09-17T02:22:06.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:06.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559612+0000", 2024-09-17T02:22:06.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003957103 2024-09-17T02:22:06.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:06.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559768+0000", 2024-09-17T02:22:06.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015556899999999999 2024-09-17T02:22:06.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:06.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560025+0000", 2024-09-17T02:22:06.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025710700000000002 2024-09-17T02:22:06.700 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.700 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:06.700 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.700 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129509 5.4 5:2c35515e:::benchmark_data_smithi001_23533_object1392:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:06.700 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:06.700 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.075244066, 2024-09-17T02:22:06.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99969384900000002, 2024-09-17T02:22:06.701 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:06.701 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:06.701 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:06.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:06.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.701 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129509 2024-09-17T02:22:06.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.701 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:06.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:06.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:06.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:06.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:06.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:06.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563674+0000", 2024-09-17T02:22:06.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0920000000000001e-06 2024-09-17T02:22:06.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:06.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563679+0000", 2024-09-17T02:22:06.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7660000000000004e-06 2024-09-17T02:22:06.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:06.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563693+0000", 2024-09-17T02:22:06.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3139000000000001e-05 2024-09-17T02:22:06.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563701+0000", 2024-09-17T02:22:06.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9859999999999994e-06 2024-09-17T02:22:06.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563775+0000", 2024-09-17T02:22:06.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4659000000000005e-05 2024-09-17T02:22:06.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:06.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563785+0000", 2024-09-17T02:22:06.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4839999999999993e-06 2024-09-17T02:22:06.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552085+0000", 2024-09-17T02:22:06.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98829986999999997 2024-09-17T02:22:06.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:06.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552554+0000", 2024-09-17T02:22:06.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046908900000000001 2024-09-17T02:22:06.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:06.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552931+0000", 2024-09-17T02:22:06.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377778 2024-09-17T02:22:06.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563106+0000", 2024-09-17T02:22:06.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010174186 2024-09-17T02:22:06.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:06.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563138+0000", 2024-09-17T02:22:06.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2495e-05 2024-09-17T02:22:06.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:06.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563225+0000", 2024-09-17T02:22:06.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6677999999999999e-05 2024-09-17T02:22:06.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:06.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563366+0000", 2024-09-17T02:22:06.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014162699999999999 2024-09-17T02:22:06.707 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.707 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:06.707 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.708 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129524 5.4 5:25dca7dd:::benchmark_data_smithi001_23533_object1407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:06.708 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:06.708 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.068552711999999, 2024-09-17T02:22:06.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99999501999999996, 2024-09-17T02:22:06.708 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:06.708 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:06.708 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.708 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:06.708 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:06.708 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.708 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129524 2024-09-17T02:22:06.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.709 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:06.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:06.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:06.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:06.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:06.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:06.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570365+0000", 2024-09-17T02:22:06.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.142e-06 2024-09-17T02:22:06.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:06.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570369+0000", 2024-09-17T02:22:06.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.856e-06 2024-09-17T02:22:06.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:06.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570385+0000", 2024-09-17T02:22:06.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5855e-05 2024-09-17T02:22:06.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570392+0000", 2024-09-17T02:22:06.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5340000000000002e-06 2024-09-17T02:22:06.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570484+0000", 2024-09-17T02:22:06.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1212999999999996e-05 2024-09-17T02:22:06.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:06.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570498+0000", 2024-09-17T02:22:06.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4331000000000001e-05 2024-09-17T02:22:06.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555835+0000", 2024-09-17T02:22:06.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98533757700000002 2024-09-17T02:22:06.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:06.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556329+0000", 2024-09-17T02:22:06.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000493458 2024-09-17T02:22:06.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:06.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556784+0000", 2024-09-17T02:22:06.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045476499999999999 2024-09-17T02:22:06.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569852+0000", 2024-09-17T02:22:06.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013068270999999999 2024-09-17T02:22:06.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:06.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569958+0000", 2024-09-17T02:22:06.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106214 2024-09-17T02:22:06.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:06.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570124+0000", 2024-09-17T02:22:06.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165546 2024-09-17T02:22:06.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:06.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570359+0000", 2024-09-17T02:22:06.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023525799999999999 2024-09-17T02:22:06.714 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.714 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:06.714 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.715 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129537 5.4 5:260327c6:::benchmark_data_smithi001_23533_object1420:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:06.715 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:06.715 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.060646182999999, 2024-09-17T02:22:06.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99624596499999996, 2024-09-17T02:22:06.715 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:06.715 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:06.715 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.715 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:06.715 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:06.715 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.715 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129537 2024-09-17T02:22:06.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.715 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:06.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:06.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:06.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:06.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:06.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:06.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578272+0000", 2024-09-17T02:22:06.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.164e-06 2024-09-17T02:22:06.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:06.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578278+0000", 2024-09-17T02:22:06.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5060000000000001e-06 2024-09-17T02:22:06.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:06.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578294+0000", 2024-09-17T02:22:06.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5687000000000001e-05 2024-09-17T02:22:06.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578329+0000", 2024-09-17T02:22:06.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5311999999999997e-05 2024-09-17T02:22:06.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578419+0000", 2024-09-17T02:22:06.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0054000000000002e-05 2024-09-17T02:22:06.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:06.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578435+0000", 2024-09-17T02:22:06.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5645999999999999e-05 2024-09-17T02:22:06.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560148+0000", 2024-09-17T02:22:06.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98171342299999997 2024-09-17T02:22:06.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:06.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560383+0000", 2024-09-17T02:22:06.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000234935 2024-09-17T02:22:06.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:06.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560586+0000", 2024-09-17T02:22:06.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000202909 2024-09-17T02:22:06.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570472+0000", 2024-09-17T02:22:06.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098856959999999994 2024-09-17T02:22:06.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:06.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574138+0000", 2024-09-17T02:22:06.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036660170000000001 2024-09-17T02:22:06.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:06.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574298+0000", 2024-09-17T02:22:06.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016025600000000001 2024-09-17T02:22:06.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:06.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574516+0000", 2024-09-17T02:22:06.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021835999999999999 2024-09-17T02:22:06.721 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.721 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:06.721 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.721 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129545 5.4 5:22366489:::benchmark_data_smithi001_23533_object1428:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:06.721 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:06.721 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.054783459999999, 2024-09-17T02:22:06.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99074544499999995, 2024-09-17T02:22:06.722 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:06.722 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:06.722 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.722 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:06.722 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:06.722 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.722 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129545 2024-09-17T02:22:06.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.722 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:06.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:06.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:06.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:06.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:06.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:06.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584135+0000", 2024-09-17T02:22:06.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4699999999999999e-06 2024-09-17T02:22:06.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:06.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584142+0000", 2024-09-17T02:22:06.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1620000000000002e-06 2024-09-17T02:22:06.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:06.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584170+0000", 2024-09-17T02:22:06.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7897000000000001e-05 2024-09-17T02:22:06.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584183+0000", 2024-09-17T02:22:06.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2814e-05 2024-09-17T02:22:06.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584299+0000", 2024-09-17T02:22:06.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116153 2024-09-17T02:22:06.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:06.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584316+0000", 2024-09-17T02:22:06.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7524999999999999e-05 2024-09-17T02:22:06.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563461+0000", 2024-09-17T02:22:06.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97914436699999996 2024-09-17T02:22:06.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:06.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563667+0000", 2024-09-17T02:22:06.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020689800000000001 2024-09-17T02:22:06.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:06.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563878+0000", 2024-09-17T02:22:06.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210275 2024-09-17T02:22:06.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570584+0000", 2024-09-17T02:22:06.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067066080000000002 2024-09-17T02:22:06.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:06.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574539+0000", 2024-09-17T02:22:06.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039550360000000003 2024-09-17T02:22:06.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:06.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574653+0000", 2024-09-17T02:22:06.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114003 2024-09-17T02:22:06.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:06.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574879+0000", 2024-09-17T02:22:06.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022523700000000001 2024-09-17T02:22:06.728 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.728 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:06.728 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.728 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129553 5.4 5:2e41ad40:::benchmark_data_smithi001_23533_object1436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:06.728 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:06.728 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.049360824000001, 2024-09-17T02:22:06.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99213429600000003, 2024-09-17T02:22:06.728 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:06.728 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:06.728 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.729 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:06.729 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:06.729 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.729 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129553 2024-09-17T02:22:06.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.729 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:06.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:06.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:06.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:06.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:06.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:06.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589557+0000", 2024-09-17T02:22:06.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2219999999999999e-06 2024-09-17T02:22:06.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:06.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589562+0000", 2024-09-17T02:22:06.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0649999999999998e-06 2024-09-17T02:22:06.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:06.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589575+0000", 2024-09-17T02:22:06.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3129000000000001e-05 2024-09-17T02:22:06.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589584+0000", 2024-09-17T02:22:06.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6200000000000005e-06 2024-09-17T02:22:06.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589693+0000", 2024-09-17T02:22:06.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109319 2024-09-17T02:22:06.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:06.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589714+0000", 2024-09-17T02:22:06.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0849999999999999e-05 2024-09-17T02:22:06.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566273+0000", 2024-09-17T02:22:06.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97655884999999998 2024-09-17T02:22:06.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:06.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566543+0000", 2024-09-17T02:22:06.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027059099999999998 2024-09-17T02:22:06.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:06.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566832+0000", 2024-09-17T02:22:06.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028898200000000002 2024-09-17T02:22:06.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:06.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581040+0000", 2024-09-17T02:22:06.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014208001 2024-09-17T02:22:06.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581200+0000", 2024-09-17T02:22:06.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159956 2024-09-17T02:22:06.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:06.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581427+0000", 2024-09-17T02:22:06.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000226309 2024-09-17T02:22:06.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:06.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581690+0000", 2024-09-17T02:22:06.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026340199999999998 2024-09-17T02:22:06.735 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.735 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:06.735 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.735 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129580 5.4 5:25ed887b:::benchmark_data_smithi001_23533_object1463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:06.735 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:06.735 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.027588779999999, 2024-09-17T02:22:06.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98001430499999997, 2024-09-17T02:22:06.735 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:06.735 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:06.735 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.736 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:06.736 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:06.736 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.736 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129580 2024-09-17T02:22:06.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.736 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:06.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:06.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:06.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:06.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:06.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:06.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611329+0000", 2024-09-17T02:22:06.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.22e-06 2024-09-17T02:22:06.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:06.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611335+0000", 2024-09-17T02:22:06.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1129999999999997e-06 2024-09-17T02:22:06.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:06.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611348+0000", 2024-09-17T02:22:06.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2342e-05 2024-09-17T02:22:06.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611356+0000", 2024-09-17T02:22:06.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.371e-06 2024-09-17T02:22:06.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611419+0000", 2024-09-17T02:22:06.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3393999999999996e-05 2024-09-17T02:22:06.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:06.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611427+0000", 2024-09-17T02:22:06.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999997e-06 2024-09-17T02:22:06.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570705+0000", 2024-09-17T02:22:06.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.95927859199999999 2024-09-17T02:22:06.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:06.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571009+0000", 2024-09-17T02:22:06.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030414599999999998 2024-09-17T02:22:06.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:06.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571241+0000", 2024-09-17T02:22:06.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023106799999999999 2024-09-17T02:22:06.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:06.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590789+0000", 2024-09-17T02:22:06.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019548763 2024-09-17T02:22:06.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590928+0000", 2024-09-17T02:22:06.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000139092 2024-09-17T02:22:06.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:06.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591086+0000", 2024-09-17T02:22:06.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015787400000000001 2024-09-17T02:22:06.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:06.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591342+0000", 2024-09-17T02:22:06.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025589900000000002 2024-09-17T02:22:06.742 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.742 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:06.742 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.742 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129603 5.4 5:25aaa5e8:::benchmark_data_smithi001_23533_object1486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:06.742 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:06.742 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.011528984000002, 2024-09-17T02:22:06.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96463198999999999, 2024-09-17T02:22:06.742 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:06.742 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:06.743 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.743 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:06.743 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:06.743 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.743 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129603 2024-09-17T02:22:06.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.743 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:06.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:06.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:06.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:06.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:06.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:06.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:06.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:22:06.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:06.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627392+0000", 2024-09-17T02:22:06.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0790000000000002e-06 2024-09-17T02:22:06.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:06.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627403+0000", 2024-09-17T02:22:06.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0866000000000001e-05 2024-09-17T02:22:06.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627409+0000", 2024-09-17T02:22:06.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.305e-06 2024-09-17T02:22:06.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627485+0000", 2024-09-17T02:22:06.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6582000000000006e-05 2024-09-17T02:22:06.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:06.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627499+0000", 2024-09-17T02:22:06.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:22:06.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574991+0000", 2024-09-17T02:22:06.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94749182300000001 2024-09-17T02:22:06.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:06.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575377+0000", 2024-09-17T02:22:06.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038629400000000003 2024-09-17T02:22:06.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:06.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575665+0000", 2024-09-17T02:22:06.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028759499999999997 2024-09-17T02:22:06.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:06.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590802+0000", 2024-09-17T02:22:06.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015136479 2024-09-17T02:22:06.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591614+0000", 2024-09-17T02:22:06.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081293100000000003 2024-09-17T02:22:06.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:06.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591764+0000", 2024-09-17T02:22:06.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014932199999999999 2024-09-17T02:22:06.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:06.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592020+0000", 2024-09-17T02:22:06.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025585099999999997 2024-09-17T02:22:06.749 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.749 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:06.749 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.749 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129607 5.4 5:2f638f1e:::benchmark_data_smithi001_23533_object1490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:06.749 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:06.749 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.010002077999999, 2024-09-17T02:22:06.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96352375899999998, 2024-09-17T02:22:06.749 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:06.749 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:06.749 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.750 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:06.750 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:06.750 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.750 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129607 2024-09-17T02:22:06.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.750 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:06.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:06.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:06.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:06.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:06.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:06.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628916+0000", 2024-09-17T02:22:06.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1710000000000001e-06 2024-09-17T02:22:06.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:06.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628920+0000", 2024-09-17T02:22:06.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-17T02:22:06.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:06.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628935+0000", 2024-09-17T02:22:06.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4474000000000001e-05 2024-09-17T02:22:06.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628944+0000", 2024-09-17T02:22:06.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9940000000000006e-06 2024-09-17T02:22:06.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628997+0000", 2024-09-17T02:22:06.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3579000000000003e-05 2024-09-17T02:22:06.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:06.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.629006+0000", 2024-09-17T02:22:06.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4009999999999997e-06 2024-09-17T02:22:06.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.577862+0000", 2024-09-17T02:22:06.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.948856335 2024-09-17T02:22:06.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:06.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578167+0000", 2024-09-17T02:22:06.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030532399999999999 2024-09-17T02:22:06.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:06.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578532+0000", 2024-09-17T02:22:06.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036428200000000001 2024-09-17T02:22:06.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:06.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591442+0000", 2024-09-17T02:22:06.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012910374000000001 2024-09-17T02:22:06.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592164+0000", 2024-09-17T02:22:06.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072242499999999996 2024-09-17T02:22:06.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:06.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592267+0000", 2024-09-17T02:22:06.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102205 2024-09-17T02:22:06.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:06.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592438+0000", 2024-09-17T02:22:06.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017165299999999999 2024-09-17T02:22:06.756 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.757 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:06.757 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.757 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129623 5.4 5:2cf5174b:::benchmark_data_smithi001_23533_object1506:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:06.757 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:06.757 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.986057792, 2024-09-17T02:22:06.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94334114499999999, 2024-09-17T02:22:06.757 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:06.757 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:06.757 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.757 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:06.757 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:06.758 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.758 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129623 2024-09-17T02:22:06.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.758 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:06.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:06.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:06.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:06.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:06.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:06.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652860+0000", 2024-09-17T02:22:06.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0330000000000001e-06 2024-09-17T02:22:06.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:06.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652864+0000", 2024-09-17T02:22:06.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.634e-06 2024-09-17T02:22:06.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:06.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652877+0000", 2024-09-17T02:22:06.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2591e-05 2024-09-17T02:22:06.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652883+0000", 2024-09-17T02:22:06.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1460000000000001e-06 2024-09-17T02:22:06.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652943+0000", 2024-09-17T02:22:06.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9833999999999997e-05 2024-09-17T02:22:06.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:06.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652950+0000", 2024-09-17T02:22:06.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.401e-06 2024-09-17T02:22:06.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581800+0000", 2024-09-17T02:22:06.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.92884935700000004 2024-09-17T02:22:06.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:06.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582122+0000", 2024-09-17T02:22:06.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032185200000000002 2024-09-17T02:22:06.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:06.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582689+0000", 2024-09-17T02:22:06.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056750400000000003 2024-09-17T02:22:06.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:06.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591458+0000", 2024-09-17T02:22:06.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008768685 2024-09-17T02:22:06.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595856+0000", 2024-09-17T02:22:06.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043977909999999999 2024-09-17T02:22:06.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:06.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595955+0000", 2024-09-17T02:22:06.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9166000000000006e-05 2024-09-17T02:22:06.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:06.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596200+0000", 2024-09-17T02:22:06.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024515099999999998 2024-09-17T02:22:06.763 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.763 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:06.764 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.764 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129642 5.4 5:255eb796:::benchmark_data_smithi001_23533_object1525:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:06.764 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:06.764 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.954821628000001, 2024-09-17T02:22:06.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.91257397299999998, 2024-09-17T02:22:06.764 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:06.764 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:06.764 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.764 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:06.764 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:06.764 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.765 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129642 2024-09-17T02:22:06.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.765 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:06.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:06.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:06.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:06.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:06.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:06.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684096+0000", 2024-09-17T02:22:06.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659999999999999e-06 2024-09-17T02:22:06.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:06.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684101+0000", 2024-09-17T02:22:06.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8110000000000002e-06 2024-09-17T02:22:06.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:06.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684114+0000", 2024-09-17T02:22:06.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2653000000000001e-05 2024-09-17T02:22:06.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684121+0000", 2024-09-17T02:22:06.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5100000000000001e-06 2024-09-17T02:22:06.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684181+0000", 2024-09-17T02:22:06.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0307999999999999e-05 2024-09-17T02:22:06.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:06.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684194+0000", 2024-09-17T02:22:06.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2916e-05 2024-09-17T02:22:06.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.587917+0000", 2024-09-17T02:22:06.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.90372220400000003 2024-09-17T02:22:06.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:06.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588215+0000", 2024-09-17T02:22:06.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029845400000000003 2024-09-17T02:22:06.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:06.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588470+0000", 2024-09-17T02:22:06.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025455399999999999 2024-09-17T02:22:06.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596318+0000", 2024-09-17T02:22:06.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078485589999999997 2024-09-17T02:22:06.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:06.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596354+0000", 2024-09-17T02:22:06.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5976999999999998e-05 2024-09-17T02:22:06.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:06.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596449+0000", 2024-09-17T02:22:06.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4728999999999994e-05 2024-09-17T02:22:06.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:06.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596669+0000", 2024-09-17T02:22:06.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220132 2024-09-17T02:22:06.771 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.771 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:06.771 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.771 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129649 5.4 5:2fe27050:::benchmark_data_smithi001_23533_object1532:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:06.771 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:06.771 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.923264885000002, 2024-09-17T02:22:06.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.88508119100000004, 2024-09-17T02:22:06.771 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:06.772 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:06.772 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:06.772 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:06.772 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:06.772 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.772 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129649 2024-09-17T02:22:06.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.772 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:06.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:06.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:06.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:06.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:06.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:06.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:06.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715653+0000", 2024-09-17T02:22:06.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3519999999999999e-06 2024-09-17T02:22:06.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:06.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715658+0000", 2024-09-17T02:22:06.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3120000000000001e-06 2024-09-17T02:22:06.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:06.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715677+0000", 2024-09-17T02:22:06.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-17T02:22:06.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715687+0000", 2024-09-17T02:22:06.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0146000000000001e-05 2024-09-17T02:22:06.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715821+0000", 2024-09-17T02:22:06.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013421 2024-09-17T02:22:06.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:06.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715840+0000", 2024-09-17T02:22:06.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8153999999999999e-05 2024-09-17T02:22:06.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:06.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592528+0000", 2024-09-17T02:22:06.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.87668860000000004 2024-09-17T02:22:06.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:06.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592702+0000", 2024-09-17T02:22:06.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017429300000000001 2024-09-17T02:22:06.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:06.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592945+0000", 2024-09-17T02:22:06.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000242048 2024-09-17T02:22:06.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:06.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600234+0000", 2024-09-17T02:22:06.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072897600000000002 2024-09-17T02:22:06.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:06.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600494+0000", 2024-09-17T02:22:06.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000259984 2024-09-17T02:22:06.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:06.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600555+0000", 2024-09-17T02:22:06.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1138999999999999e-05 2024-09-17T02:22:06.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:06.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:06.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:06.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600733+0000", 2024-09-17T02:22:06.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017753300000000001 2024-09-17T02:22:06.778 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.778 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:06.778 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.778 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:06.778 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:06.778 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:06.780 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:06.780 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:06.780+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:06.880 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:06.879+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:06.942 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:06.943 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:22:06.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.943 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:192649 5.6 5:62e0d385:::benchmark_data_smithi001_23533_object64532:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T02:22:06.943 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.942956+0000", 2024-09-17T02:22:06.943 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0031399000000000002, 2024-09-17T02:22:06.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031609379999999999, 2024-09-17T02:22:06.943 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:06.943 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:06.943 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:06.943 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:06.943 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:06.943 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.944 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 192649 2024-09-17T02:22:06.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.944 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:06.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:06.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.942956+0000", 2024-09-17T02:22:06.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:06.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.942956+0000", 2024-09-17T02:22:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.942957+0000", 2024-09-17T02:22:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.127e-06 2024-09-17T02:22:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.942961+0000", 2024-09-17T02:22:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6030000000000001e-06 2024-09-17T02:22:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:06.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.942974+0000", 2024-09-17T02:22:06.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2636000000000001e-05 2024-09-17T02:22:06.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.942981+0000", 2024-09-17T02:22:06.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2389999999999996e-06 2024-09-17T02:22:06.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:06.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943053+0000", 2024-09-17T02:22:06.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2156999999999994e-05 2024-09-17T02:22:06.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:06.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943204+0000", 2024-09-17T02:22:06.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015057499999999999 2024-09-17T02:22:06.947 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.947 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:06.947 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:192650 5.6 5:64e741da:::benchmark_data_smithi001_23533_object64533:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T02:22:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.943011+0000", 2024-09-17T02:22:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0030856519999999999, 2024-09-17T02:22:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031504269999999999, 2024-09-17T02:22:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 192650 2024-09-17T02:22:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.949 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:06.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:06.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943011+0000", 2024-09-17T02:22:06.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:06.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943011+0000", 2024-09-17T02:22:06.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:06.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943011+0000", 2024-09-17T02:22:06.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9100000000000004e-07 2024-09-17T02:22:06.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:06.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943014+0000", 2024-09-17T02:22:06.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6410000000000002e-06 2024-09-17T02:22:06.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:06.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943021+0000", 2024-09-17T02:22:06.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2189999999999998e-06 2024-09-17T02:22:06.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943033+0000", 2024-09-17T02:22:06.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1698999999999999e-05 2024-09-17T02:22:06.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:06.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.945794+0000", 2024-09-17T02:22:06.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027617399999999999 2024-09-17T02:22:06.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:06.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.945933+0000", 2024-09-17T02:22:06.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138653 2024-09-17T02:22:06.952 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.952 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:06.952 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.952 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:192651 5.c 5:3ea33d54:::benchmark_data_smithi001_23533_object64534:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T02:22:06.952 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.943071+0000", 2024-09-17T02:22:06.952 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0030249280000000001, 2024-09-17T02:22:06.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031276160000000002, 2024-09-17T02:22:06.952 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:06.952 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:06.953 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:06.953 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:06.953 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:06.953 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.953 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 192651 2024-09-17T02:22:06.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.953 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:06.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:06.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943071+0000", 2024-09-17T02:22:06.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:06.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943071+0000", 2024-09-17T02:22:06.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:06.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943072+0000", 2024-09-17T02:22:06.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6000000000000004e-07 2024-09-17T02:22:06.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:06.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943074+0000", 2024-09-17T02:22:06.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5390000000000002e-06 2024-09-17T02:22:06.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:06.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943081+0000", 2024-09-17T02:22:06.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6259999999999997e-06 2024-09-17T02:22:06.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943097+0000", 2024-09-17T02:22:06.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6254000000000001e-05 2024-09-17T02:22:06.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:06.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943215+0000", 2024-09-17T02:22:06.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011759 2024-09-17T02:22:06.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:06.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943330+0000", 2024-09-17T02:22:06.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000114988 2024-09-17T02:22:06.956 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.956 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:06.957 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.957 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:192652 5.6 5.bc810186 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T02:22:06.957 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.943118+0000", 2024-09-17T02:22:06.957 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0029783840000000002, 2024-09-17T02:22:06.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031153830000000002, 2024-09-17T02:22:06.957 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:06.957 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:06.957 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:06.957 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:06.957 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:06.957 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.957 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 192652 2024-09-17T02:22:06.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.958 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:06.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:06.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943118+0000", 2024-09-17T02:22:06.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:06.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943118+0000", 2024-09-17T02:22:06.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:06.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943118+0000", 2024-09-17T02:22:06.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8299999999999997e-07 2024-09-17T02:22:06.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:06.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943121+0000", 2024-09-17T02:22:06.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4789999999999999e-06 2024-09-17T02:22:06.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:06.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943128+0000", 2024-09-17T02:22:06.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6109999999999996e-06 2024-09-17T02:22:06.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943135+0000", 2024-09-17T02:22:06.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8220000000000001e-06 2024-09-17T02:22:06.960 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.960 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:06.960 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.960 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:192654 5.8 5:12dc66dd:::benchmark_data_smithi001_23533_object64537:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T02:22:06.960 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.943152+0000", 2024-09-17T02:22:06.960 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.002944613, 2024-09-17T02:22:06.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003119995, 2024-09-17T02:22:06.960 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:06.961 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:06.961 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:06.961 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:06.961 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:06.961 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.961 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 192654 2024-09-17T02:22:06.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.961 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:06.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:06.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943152+0000", 2024-09-17T02:22:06.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:06.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943152+0000", 2024-09-17T02:22:06.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:06.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943152+0000", 2024-09-17T02:22:06.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4999999999999998e-07 2024-09-17T02:22:06.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:06.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943155+0000", 2024-09-17T02:22:06.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4770000000000002e-06 2024-09-17T02:22:06.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:06.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943163+0000", 2024-09-17T02:22:06.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6470000000000004e-06 2024-09-17T02:22:06.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.943168+0000", 2024-09-17T02:22:06.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0719999999999999e-06 2024-09-17T02:22:06.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:06.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.944073+0000", 2024-09-17T02:22:06.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000904333 2024-09-17T02:22:06.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:06.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.944193+0000", 2024-09-17T02:22:06.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120009 2024-09-17T02:22:06.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:06.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.944305+0000", 2024-09-17T02:22:06.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000112475 2024-09-17T02:22:06.964 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.964 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:06.965 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.965 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:192655 5.1 e65/61 5:856f9453:::benchmark_data_smithi001_23533_object64538:head v 65'11950, mlcod=65'11948)", 2024-09-17T02:22:06.965 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.945840+0000", 2024-09-17T02:22:06.965 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00025598999999999999, 2024-09-17T02:22:06.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00050453599999999998, 2024-09-17T02:22:06.965 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:06.965 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:06.965 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:06.965 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:06.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:06.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.945840+0000", 2024-09-17T02:22:06.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:06.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.945840+0000", 2024-09-17T02:22:06.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:06.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.945842+0000", 2024-09-17T02:22:06.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3370000000000001e-06 2024-09-17T02:22:06.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:06.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.945848+0000", 2024-09-17T02:22:06.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9349999999999999e-06 2024-09-17T02:22:06.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:06.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.945859+0000", 2024-09-17T02:22:06.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1235e-05 2024-09-17T02:22:06.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.945870+0000", 2024-09-17T02:22:06.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1147e-05 2024-09-17T02:22:06.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:06.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.945923+0000", 2024-09-17T02:22:06.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3288000000000002e-05 2024-09-17T02:22:06.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:06.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.945943+0000", 2024-09-17T02:22:06.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0081e-05 2024-09-17T02:22:06.969 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.969 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:06.969 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.969 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:192653 5.3 e65/64 5:c3f34e9e:::benchmark_data_smithi001_23533_object64536:head v 65'12131, mlcod=65'12127)", 2024-09-17T02:22:06.969 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.945886+0000", 2024-09-17T02:22:06.969 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00020973000000000001, 2024-09-17T02:22:06.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00052074499999999998, 2024-09-17T02:22:06.969 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:06.969 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:06.969 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:06.969 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:06.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:06.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.945886+0000", 2024-09-17T02:22:06.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:06.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.945886+0000", 2024-09-17T02:22:06.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:06.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.945887+0000", 2024-09-17T02:22:06.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0199999999999998e-07 2024-09-17T02:22:06.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:06.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.945891+0000", 2024-09-17T02:22:06.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7510000000000002e-06 2024-09-17T02:22:06.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:06.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.945897+0000", 2024-09-17T02:22:06.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2099999999999998e-06 2024-09-17T02:22:06.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.945901+0000", 2024-09-17T02:22:06.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4190000000000004e-06 2024-09-17T02:22:06.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:06.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.945948+0000", 2024-09-17T02:22:06.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7274999999999997e-05 2024-09-17T02:22:06.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:06.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.945969+0000", 2024-09-17T02:22:06.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0720000000000002e-05 2024-09-17T02:22:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4466.0:192646 5.a e65/22)", 2024-09-17T02:22:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.945915+0000", 2024-09-17T02:22:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00018147700000000001, 2024-09-17T02:22:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00054515499999999997, 2024-09-17T02:22:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:06.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.945915+0000", 2024-09-17T02:22:06.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:06.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.945915+0000", 2024-09-17T02:22:06.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:06.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.945915+0000", 2024-09-17T02:22:06.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.91e-07 2024-09-17T02:22:06.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:06.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.945917+0000", 2024-09-17T02:22:06.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2460000000000002e-06 2024-09-17T02:22:06.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:06.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.945924+0000", 2024-09-17T02:22:06.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6000000000000003e-06 2024-09-17T02:22:06.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.945928+0000", 2024-09-17T02:22:06.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5369999999999999e-06 2024-09-17T02:22:06.976 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.976 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:06.976 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.976 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:192657 5.8 5.37af5778 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T02:22:06.976 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.946403+0000", 2024-09-17T02:22:06.976 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9996929, 2024-09-17T02:22:06.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000116079, 2024-09-17T02:22:06.976 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:06.976 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:06.977 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:06.977 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:06.977 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:06.977 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.977 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 192657 2024-09-17T02:22:06.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.977 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:06.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:06.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.946403+0000", 2024-09-17T02:22:06.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:06.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.946403+0000", 2024-09-17T02:22:06.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:06.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.946404+0000", 2024-09-17T02:22:06.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1659999999999999e-06 2024-09-17T02:22:06.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:06.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.946414+0000", 2024-09-17T02:22:06.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2990000000000002e-06 2024-09-17T02:22:06.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:06.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.946431+0000", 2024-09-17T02:22:06.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7487999999999999e-05 2024-09-17T02:22:06.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.946445+0000", 2024-09-17T02:22:06.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3888e-05 2024-09-17T02:22:06.980 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.980 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:06.980 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.980 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:192659 5.c 5:3f9ca0f4:::benchmark_data_smithi001_23533_object64542:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T02:22:06.980 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.946475+0000", 2024-09-17T02:22:06.980 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9996219, 2024-09-17T02:22:06.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012537200000000001, 2024-09-17T02:22:06.980 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:06.980 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:06.980 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-17T02:22:06.981 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:06.981 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:06.981 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.981 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 192659 2024-09-17T02:22:06.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.981 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:06.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:06.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.946475+0000", 2024-09-17T02:22:06.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:06.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.946475+0000", 2024-09-17T02:22:06.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:06.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.946475+0000", 2024-09-17T02:22:06.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2800000000000005e-07 2024-09-17T02:22:06.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:06.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.946479+0000", 2024-09-17T02:22:06.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.529e-06 2024-09-17T02:22:06.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:06.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.946504+0000", 2024-09-17T02:22:06.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4516999999999999e-05 2024-09-17T02:22:06.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.946510+0000", 2024-09-17T02:22:06.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7619999999999998e-06 2024-09-17T02:22:06.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:06.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.946566+0000", 2024-09-17T02:22:06.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5847000000000002e-05 2024-09-17T02:22:06.984 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.984 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:06.984 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.985 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:192646 5.a 5:5f1fe791:::benchmark_data_smithi001_23533_object64529:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T02:22:06.985 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.938495+0000", 2024-09-17T02:22:06.985 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0076010920000000003, 2024-09-17T02:22:06.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081404700000000003, 2024-09-17T02:22:06.985 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:06.985 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:06.985 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:06.985 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:06.985 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:06.985 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:06.985 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 192646 2024-09-17T02:22:06.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.986 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:06.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:06.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.938495+0000", 2024-09-17T02:22:06.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:06.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.938495+0000", 2024-09-17T02:22:06.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:06.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:06.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.938496+0000", 2024-09-17T02:22:06.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3300000000000002e-07 2024-09-17T02:22:06.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:06.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.938499+0000", 2024-09-17T02:22:06.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.886e-06 2024-09-17T02:22:06.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:06.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.938507+0000", 2024-09-17T02:22:06.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9149999999999996e-06 2024-09-17T02:22:06.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:06.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.938514+0000", 2024-09-17T02:22:06.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1729999999999998e-06 2024-09-17T02:22:06.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:06.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.942548+0000", 2024-09-17T02:22:06.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040343499999999999 2024-09-17T02:22:06.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:06.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.942646+0000", 2024-09-17T02:22:06.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7669000000000003e-05 2024-09-17T02:22:06.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:06.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.942759+0000", 2024-09-17T02:22:06.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011357 2024-09-17T02:22:06.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:06.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:06.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:06.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.945825+0000", 2024-09-17T02:22:06.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003065492 2024-09-17T02:22:06.990 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.990 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:06.990 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.990 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:06.990 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:22:06.990 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 11 2024-09-17T02:22:06.990 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:06.992 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:06.992 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:06.992+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:07.092 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:07.091+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:07.187 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:07.188 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:22:07.188 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:22:07.188 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:22:07.188 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:07.194 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:07.196+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:07.209 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:07.303 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:07.304+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:07.396 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:07.395+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:07.423 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:07.423 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:22:07.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:22:07.424 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:22:07.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.424 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:22:07.424 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:07.424 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 84.857069800000005, 2024-09-17T02:22:07.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:22:07.424 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:07.424 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:07.424 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:07.424 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:07.424 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:07.424 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:07.425 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:22:07.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.425 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:07.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:07.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:07.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:07.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:07.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:07.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:22:07.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:22:07.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:07.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:22:07.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:22:07.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:07.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:22:07.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:22:07.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:07.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:22:07.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:22:07.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:07.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:22:07.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:22:07.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:07.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:22:07.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:22:07.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:07.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:22:07.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:22:07.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:07.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:22:07.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:22:07.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:07.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:22:07.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:22:07.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:07.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:22:07.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:22:07.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:07.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:22:07.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:22:07.430 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.430 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:07.430 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.430 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:22:07.430 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:07.430 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 84.853167549999995, 2024-09-17T02:22:07.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:22:07.430 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:07.430 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:07.431 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:07.431 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:07.431 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:07.431 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:07.431 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:22:07.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.431 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:07.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:07.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:07.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:07.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:07.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:07.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:22:07.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:22:07.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:07.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:22:07.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:22:07.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:07.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:22:07.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:22:07.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:07.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:22:07.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:22:07.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:07.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:22:07.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:22:07.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:07.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:22:07.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:22:07.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:07.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:22:07.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:22:07.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:07.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:22:07.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:22:07.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:07.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:22:07.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:22:07.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:07.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:22:07.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:22:07.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:07.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:22:07.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:22:07.436 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.436 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:07.436 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.436 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97759 5.a 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:07.436 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:07.436 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.827147727000003, 2024-09-17T02:22:07.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.089694871999999995, 2024-09-17T02:22:07.436 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:07.437 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:07.437 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:07.437 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:07.437 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:07.437 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:07.437 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97759 2024-09-17T02:22:07.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.437 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:07.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:07.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:07.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:07.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:07.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:07.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598386+0000", 2024-09-17T02:22:07.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999999e-07 2024-09-17T02:22:07.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:07.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598414+0000", 2024-09-17T02:22:07.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8013000000000001e-05 2024-09-17T02:22:07.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:07.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598420+0000", 2024-09-17T02:22:07.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1149999999999999e-06 2024-09-17T02:22:07.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:07.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598424+0000", 2024-09-17T02:22:07.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:22:07.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:07.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598479+0000", 2024-09-17T02:22:07.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4648999999999998e-05 2024-09-17T02:22:07.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:07.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598587+0000", 2024-09-17T02:22:07.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010853000000000001 2024-09-17T02:22:07.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:07.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598676+0000", 2024-09-17T02:22:07.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8381999999999995e-05 2024-09-17T02:22:07.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:07.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603766+0000", 2024-09-17T02:22:07.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050902559999999996 2024-09-17T02:22:07.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:07.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.687988+0000", 2024-09-17T02:22:07.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.084221753999999996 2024-09-17T02:22:07.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:07.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688037+0000", 2024-09-17T02:22:07.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-05 2024-09-17T02:22:07.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:07.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688080+0000", 2024-09-17T02:22:07.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3149999999999999e-05 2024-09-17T02:22:07.442 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.442 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:07.442 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.442 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97770 5.0 5:09c75033:::benchmark_data_smithi001_23533_object97769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:07.442 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:07.442 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.822005296999997, 2024-09-17T02:22:07.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.086380868, 2024-09-17T02:22:07.443 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:07.443 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:07.443 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:07.443 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:07.443 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:07.443 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:07.443 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97770 2024-09-17T02:22:07.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.443 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:07.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:07.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:07.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603529+0000", 2024-09-17T02:22:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:22:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603593+0000", 2024-09-17T02:22:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4216999999999999e-05 2024-09-17T02:22:07.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:07.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603603+0000", 2024-09-17T02:22:07.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5179999999999993e-06 2024-09-17T02:22:07.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:07.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603608+0000", 2024-09-17T02:22:07.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2039999999999996e-06 2024-09-17T02:22:07.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:07.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603653+0000", 2024-09-17T02:22:07.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5247000000000002e-05 2024-09-17T02:22:07.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:07.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603758+0000", 2024-09-17T02:22:07.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105352 2024-09-17T02:22:07.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:07.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603900+0000", 2024-09-17T02:22:07.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014198999999999999 2024-09-17T02:22:07.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:07.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.606097+0000", 2024-09-17T02:22:07.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021969839999999999 2024-09-17T02:22:07.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:07.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689756+0000", 2024-09-17T02:22:07.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.083659077999999998 2024-09-17T02:22:07.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:07.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689846+0000", 2024-09-17T02:22:07.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9320999999999994e-05 2024-09-17T02:22:07.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:07.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689908+0000", 2024-09-17T02:22:07.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720999999999998e-05 2024-09-17T02:22:07.448 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.448 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:07.448 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.448 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127513 5.c 5:3eca08e4:::benchmark_data_smithi001_23533_object127512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:07.448 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:07.448 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.981228872999999, 2024-09-17T02:22:07.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046626399999999998, 2024-09-17T02:22:07.448 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:07.448 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:07.448 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:07.449 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:07.449 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:07.449 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:07.449 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127513 2024-09-17T02:22:07.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.449 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:07.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:07.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:07.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:07.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:07.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:07.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444305+0000", 2024-09-17T02:22:07.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2529999999999999e-06 2024-09-17T02:22:07.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:07.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444466+0000", 2024-09-17T02:22:07.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016069700000000001 2024-09-17T02:22:07.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:07.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444479+0000", 2024-09-17T02:22:07.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2602999999999999e-05 2024-09-17T02:22:07.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:07.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444485+0000", 2024-09-17T02:22:07.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.669e-06 2024-09-17T02:22:07.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:07.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444560+0000", 2024-09-17T02:22:07.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4276999999999994e-05 2024-09-17T02:22:07.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:07.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444656+0000", 2024-09-17T02:22:07.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6490000000000006e-05 2024-09-17T02:22:07.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:07.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444739+0000", 2024-09-17T02:22:07.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3139999999999993e-05 2024-09-17T02:22:07.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:07.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.448438+0000", 2024-09-17T02:22:07.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036985490000000002 2024-09-17T02:22:07.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:07.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490732+0000", 2024-09-17T02:22:07.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042294353999999999 2024-09-17T02:22:07.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:07.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490859+0000", 2024-09-17T02:22:07.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012708899999999999 2024-09-17T02:22:07.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:07.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490930+0000", 2024-09-17T02:22:07.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:07.454 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.454 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:07.454 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.454 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127514 5.c 5:39cc1feb:::benchmark_data_smithi001_23533_object127513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:07.455 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:07.455 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.981032104000001, 2024-09-17T02:22:07.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049357228000000003, 2024-09-17T02:22:07.455 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:07.455 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:07.455 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:07.455 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:07.455 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:07.455 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:07.455 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127514 2024-09-17T02:22:07.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.455 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:07.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:07.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:07.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:07.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:07.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:07.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:07.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8599999999999998e-07 2024-09-17T02:22:07.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:07.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444554+0000", 2024-09-17T02:22:07.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3047999999999998e-05 2024-09-17T02:22:07.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:07.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444562+0000", 2024-09-17T02:22:07.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5830000000000001e-06 2024-09-17T02:22:07.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:07.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444567+0000", 2024-09-17T02:22:07.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4179999999999996e-06 2024-09-17T02:22:07.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:07.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446566+0000", 2024-09-17T02:22:07.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001998788 2024-09-17T02:22:07.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:07.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446696+0000", 2024-09-17T02:22:07.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129393 2024-09-17T02:22:07.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:07.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446794+0000", 2024-09-17T02:22:07.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8462999999999996e-05 2024-09-17T02:22:07.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:07.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.449036+0000", 2024-09-17T02:22:07.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022415880000000001 2024-09-17T02:22:07.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:07.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493737+0000", 2024-09-17T02:22:07.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044701682 2024-09-17T02:22:07.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:07.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493808+0000", 2024-09-17T02:22:07.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0846000000000006e-05 2024-09-17T02:22:07.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:07.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493858+0000", 2024-09-17T02:22:07.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9932999999999998e-05 2024-09-17T02:22:07.460 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.460 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:07.460 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.460 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129441 5.1 5:84c3199f:::benchmark_data_smithi001_23533_object1324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:07.460 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:07.460 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.922021615999999, 2024-09-17T02:22:07.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034387011000000002, 2024-09-17T02:22:07.461 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:07.461 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:07.461 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:07.461 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:07.461 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:07.461 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:07.461 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129441 2024-09-17T02:22:07.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.461 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:07.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:07.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:07.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:07.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:07.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:07.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503513+0000", 2024-09-17T02:22:07.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4759999999999999e-06 2024-09-17T02:22:07.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:07.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503518+0000", 2024-09-17T02:22:07.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-09-17T02:22:07.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:07.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503532+0000", 2024-09-17T02:22:07.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4049999999999999e-05 2024-09-17T02:22:07.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:07.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503541+0000", 2024-09-17T02:22:07.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5320000000000006e-06 2024-09-17T02:22:07.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:07.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506331+0000", 2024-09-17T02:22:07.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027899190000000001 2024-09-17T02:22:07.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:07.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506402+0000", 2024-09-17T02:22:07.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:07.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:07.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506477+0000", 2024-09-17T02:22:07.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4626e-05 2024-09-17T02:22:07.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:07.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509749+0000", 2024-09-17T02:22:07.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032726980000000001 2024-09-17T02:22:07.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:07.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537758+0000", 2024-09-17T02:22:07.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028008890000000002 2024-09-17T02:22:07.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:07.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537812+0000", 2024-09-17T02:22:07.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3300000000000001e-05 2024-09-17T02:22:07.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:07.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537898+0000", 2024-09-17T02:22:07.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6691000000000001e-05 2024-09-17T02:22:07.466 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.466 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:07.466 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.466 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129442 5.1 5:8f7f2a95:::benchmark_data_smithi001_23533_object1325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:07.466 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:07.466 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.919051007, 2024-09-17T02:22:07.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031546698999999997, 2024-09-17T02:22:07.467 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:07.467 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:07.467 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:07.467 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:07.467 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:07.467 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:07.467 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129442 2024-09-17T02:22:07.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.467 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:07.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:07.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:07.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:07.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:07.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:07.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506483+0000", 2024-09-17T02:22:07.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2869999999999999e-06 2024-09-17T02:22:07.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:07.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506489+0000", 2024-09-17T02:22:07.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2330000000000003e-06 2024-09-17T02:22:07.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:07.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506502+0000", 2024-09-17T02:22:07.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2286999999999999e-05 2024-09-17T02:22:07.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:07.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506511+0000", 2024-09-17T02:22:07.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7799999999999995e-06 2024-09-17T02:22:07.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:07.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.507966+0000", 2024-09-17T02:22:07.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014541549999999999 2024-09-17T02:22:07.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:07.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508130+0000", 2024-09-17T02:22:07.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016455199999999999 2024-09-17T02:22:07.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:07.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508287+0000", 2024-09-17T02:22:07.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015730400000000001 2024-09-17T02:22:07.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:07.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510577+0000", 2024-09-17T02:22:07.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022899449999999998 2024-09-17T02:22:07.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:07.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537932+0000", 2024-09-17T02:22:07.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027354471000000002 2024-09-17T02:22:07.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:07.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537964+0000", 2024-09-17T02:22:07.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1909999999999998e-05 2024-09-17T02:22:07.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:07.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.538029+0000", 2024-09-17T02:22:07.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4775000000000002e-05 2024-09-17T02:22:07.475 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.475 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:07.475 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.476 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:150458 5.a 5:59b62890:::benchmark_data_smithi001_23533_object22341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:22:07.476 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:07.476 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.587207200000002, 2024-09-17T02:22:07.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028150173000000001, 2024-09-17T02:22:07.476 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:07.476 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:07.476 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:07.476 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:07.476 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:07.476 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:07.476 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 150458 2024-09-17T02:22:07.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.477 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:07.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:07.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:07.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:07.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:07.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:07.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:07.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7800000000000002e-07 2024-09-17T02:22:07.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:07.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838328+0000", 2024-09-17T02:22:07.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.838e-06 2024-09-17T02:22:07.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:07.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838335+0000", 2024-09-17T02:22:07.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1999999999999997e-06 2024-09-17T02:22:07.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:07.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838340+0000", 2024-09-17T02:22:07.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7389999999999999e-06 2024-09-17T02:22:07.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:07.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849082+0000", 2024-09-17T02:22:07.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01074174 2024-09-17T02:22:07.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:07.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849192+0000", 2024-09-17T02:22:07.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011040300000000001 2024-09-17T02:22:07.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:07.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849297+0000", 2024-09-17T02:22:07.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104764 2024-09-17T02:22:07.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:07.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.857853+0000", 2024-09-17T02:22:07.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085558490000000008 2024-09-17T02:22:07.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:07.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866430+0000", 2024-09-17T02:22:07.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085768140000000003 2024-09-17T02:22:07.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:07.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866454+0000", 2024-09-17T02:22:07.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4428000000000001e-05 2024-09-17T02:22:07.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:07.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866476+0000", 2024-09-17T02:22:07.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.192e-05 2024-09-17T02:22:07.481 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.482 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:07.482 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.482 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190780 5.3 e65/64 5:c634f18a:::benchmark_data_smithi001_23533_object62663:head v 65'12039, mlcod=0'0)", 2024-09-17T02:22:07.482 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.182278+0000", 2024-09-17T02:22:07.482 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.2432551110000001, 2024-09-17T02:22:07.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028943393000000001, 2024-09-17T02:22:07.482 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:07.482 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:07.482 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:07.482 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:07.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:07.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182278+0000", 2024-09-17T02:22:07.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:07.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182278+0000", 2024-09-17T02:22:07.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:07.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182280+0000", 2024-09-17T02:22:07.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.736e-06 2024-09-17T02:22:07.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:07.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182291+0000", 2024-09-17T02:22:07.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1933000000000001e-05 2024-09-17T02:22:07.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:07.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182317+0000", 2024-09-17T02:22:07.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6024999999999999e-05 2024-09-17T02:22:07.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:07.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182332+0000", 2024-09-17T02:22:07.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4856e-05 2024-09-17T02:22:07.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:07.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182463+0000", 2024-09-17T02:22:07.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130674 2024-09-17T02:22:07.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:07.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182533+0000", 2024-09-17T02:22:07.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0296999999999995e-05 2024-09-17T02:22:07.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:07.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211153+0000", 2024-09-17T02:22:07.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028619265000000001 2024-09-17T02:22:07.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:07.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211221+0000", 2024-09-17T02:22:07.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8607000000000002e-05 2024-09-17T02:22:07.486 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.486 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:07.487 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.487 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190799 5.3 e65/64 5:c0e8780b:::benchmark_data_smithi001_23533_object62682:head v 65'12040, mlcod=0'0)", 2024-09-17T02:22:07.487 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.193849+0000", 2024-09-17T02:22:07.487 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.231683759, 2024-09-17T02:22:07.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02989934, 2024-09-17T02:22:07.487 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:07.487 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:07.487 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:07.487 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:07.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:07.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193849+0000", 2024-09-17T02:22:07.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:07.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193849+0000", 2024-09-17T02:22:07.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:07.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193851+0000", 2024-09-17T02:22:07.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.137e-06 2024-09-17T02:22:07.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:07.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193865+0000", 2024-09-17T02:22:07.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3845999999999999e-05 2024-09-17T02:22:07.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:07.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193888+0000", 2024-09-17T02:22:07.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3312e-05 2024-09-17T02:22:07.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:07.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193901+0000", 2024-09-17T02:22:07.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2896e-05 2024-09-17T02:22:07.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:07.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.204084+0000", 2024-09-17T02:22:07.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010182538 2024-09-17T02:22:07.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:07.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.204126+0000", 2024-09-17T02:22:07.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1828e-05 2024-09-17T02:22:07.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:07.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223688+0000", 2024-09-17T02:22:07.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019562408999999999 2024-09-17T02:22:07.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:07.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223748+0000", 2024-09-17T02:22:07.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0374000000000002e-05 2024-09-17T02:22:07.491 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.491 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:07.491 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.491 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190836 5.3 e65/64 5:c72f74ff:::benchmark_data_smithi001_23533_object62719:head v 65'12042, mlcod=0'0)", 2024-09-17T02:22:07.491 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.198478+0000", 2024-09-17T02:22:07.491 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.2270548670000001, 2024-09-17T02:22:07.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031214246000000001, 2024-09-17T02:22:07.492 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:07.492 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:07.492 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:07.492 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:07.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:07.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198478+0000", 2024-09-17T02:22:07.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:07.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198478+0000", 2024-09-17T02:22:07.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:07.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198480+0000", 2024-09-17T02:22:07.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0899999999999999e-06 2024-09-17T02:22:07.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:07.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198494+0000", 2024-09-17T02:22:07.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3572e-05 2024-09-17T02:22:07.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:07.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198521+0000", 2024-09-17T02:22:07.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7178999999999998e-05 2024-09-17T02:22:07.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:07.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198533+0000", 2024-09-17T02:22:07.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2588999999999999e-05 2024-09-17T02:22:07.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:07.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208944+0000", 2024-09-17T02:22:07.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010410236 2024-09-17T02:22:07.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:07.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208979+0000", 2024-09-17T02:22:07.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5555000000000001e-05 2024-09-17T02:22:07.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:07.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229627+0000", 2024-09-17T02:22:07.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020647993999999999 2024-09-17T02:22:07.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:07.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229692+0000", 2024-09-17T02:22:07.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5030999999999995e-05 2024-09-17T02:22:07.495 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.496 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:07.496 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.496 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190852 5.3 e65/64 5:c63de204:::benchmark_data_smithi001_23533_object62735:head v 65'12043, mlcod=0'0)", 2024-09-17T02:22:07.496 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.200082+0000", 2024-09-17T02:22:07.496 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.2254508689999999, 2024-09-17T02:22:07.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029657795000000001, 2024-09-17T02:22:07.496 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:07.496 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:07.496 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:07.496 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:07.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:07.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200082+0000", 2024-09-17T02:22:07.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:07.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200082+0000", 2024-09-17T02:22:07.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:07.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200084+0000", 2024-09-17T02:22:07.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1900000000000002e-06 2024-09-17T02:22:07.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:07.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200099+0000", 2024-09-17T02:22:07.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4392999999999999e-05 2024-09-17T02:22:07.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:07.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200122+0000", 2024-09-17T02:22:07.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3292e-05 2024-09-17T02:22:07.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:07.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200134+0000", 2024-09-17T02:22:07.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2489e-05 2024-09-17T02:22:07.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:07.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211322+0000", 2024-09-17T02:22:07.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011187689000000001 2024-09-17T02:22:07.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:07.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211383+0000", 2024-09-17T02:22:07.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0707e-05 2024-09-17T02:22:07.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:07.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229698+0000", 2024-09-17T02:22:07.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018315306999999999 2024-09-17T02:22:07.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:07.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229740+0000", 2024-09-17T02:22:07.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1727999999999998e-05 2024-09-17T02:22:07.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.500 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:07.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.500 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190887 5.3 e65/64 5:cc339b34:::benchmark_data_smithi001_23533_object62770:head v 65'12044, mlcod=0'0)", 2024-09-17T02:22:07.501 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.201631+0000", 2024-09-17T02:22:07.501 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.2239015209999999, 2024-09-17T02:22:07.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028149121999999999, 2024-09-17T02:22:07.501 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:07.501 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:07.501 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:07.501 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:07.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:07.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201631+0000", 2024-09-17T02:22:07.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:07.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201631+0000", 2024-09-17T02:22:07.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:07.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201634+0000", 2024-09-17T02:22:07.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1629999999999999e-06 2024-09-17T02:22:07.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:07.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201647+0000", 2024-09-17T02:22:07.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3943e-05 2024-09-17T02:22:07.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:07.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201690+0000", 2024-09-17T02:22:07.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2660999999999997e-05 2024-09-17T02:22:07.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:07.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201707+0000", 2024-09-17T02:22:07.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.647e-05 2024-09-17T02:22:07.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:07.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.213560+0000", 2024-09-17T02:22:07.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011852945 2024-09-17T02:22:07.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:07.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.213617+0000", 2024-09-17T02:22:07.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7170999999999999e-05 2024-09-17T02:22:07.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:07.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229744+0000", 2024-09-17T02:22:07.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016127617 2024-09-17T02:22:07.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:07.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229781+0000", 2024-09-17T02:22:07.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6152000000000002e-05 2024-09-17T02:22:07.505 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.505 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:07.505 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.505 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190920 5.3 e65/64 5:c7bc6082:::benchmark_data_smithi001_23533_object62803:head v 65'12047, mlcod=0'0)", 2024-09-17T02:22:07.505 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.206674+0000", 2024-09-17T02:22:07.505 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.2188588929999999, 2024-09-17T02:22:07.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.033826457999999997, 2024-09-17T02:22:07.505 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:07.505 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:07.505 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:07.505 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:07.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:07.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206674+0000", 2024-09-17T02:22:07.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:07.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206674+0000", 2024-09-17T02:22:07.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:07.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206676+0000", 2024-09-17T02:22:07.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.646e-06 2024-09-17T02:22:07.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:07.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206689+0000", 2024-09-17T02:22:07.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3196999999999999e-05 2024-09-17T02:22:07.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:07.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206718+0000", 2024-09-17T02:22:07.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8988000000000001e-05 2024-09-17T02:22:07.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:07.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206736+0000", 2024-09-17T02:22:07.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8221999999999999e-05 2024-09-17T02:22:07.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:07.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.221517+0000", 2024-09-17T02:22:07.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014781247000000001 2024-09-17T02:22:07.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:07.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.221563+0000", 2024-09-17T02:22:07.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5343999999999998e-05 2024-09-17T02:22:07.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:07.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240391+0000", 2024-09-17T02:22:07.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018828693000000001 2024-09-17T02:22:07.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:07.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240500+0000", 2024-09-17T02:22:07.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109121 2024-09-17T02:22:07.509 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.509 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:07.509 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.509 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190947 5.3 e65/64 5:ca95b398:::benchmark_data_smithi001_23533_object62830:head v 65'12048, mlcod=0'0)", 2024-09-17T02:22:07.509 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.208183+0000", 2024-09-17T02:22:07.510 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.2173495400000001, 2024-09-17T02:22:07.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032404800999999997, 2024-09-17T02:22:07.510 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:07.510 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:07.510 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:07.510 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:07.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:07.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208183+0000", 2024-09-17T02:22:07.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:07.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208183+0000", 2024-09-17T02:22:07.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:07.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208185+0000", 2024-09-17T02:22:07.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.64e-06 2024-09-17T02:22:07.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:07.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208197+0000", 2024-09-17T02:22:07.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1589e-05 2024-09-17T02:22:07.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:07.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208217+0000", 2024-09-17T02:22:07.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0242e-05 2024-09-17T02:22:07.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:07.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208227+0000", 2024-09-17T02:22:07.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0256e-05 2024-09-17T02:22:07.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:07.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223908+0000", 2024-09-17T02:22:07.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015680726999999998 2024-09-17T02:22:07.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:07.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223969+0000", 2024-09-17T02:22:07.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1277000000000003e-05 2024-09-17T02:22:07.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:07.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240509+0000", 2024-09-17T02:22:07.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016539484 2024-09-17T02:22:07.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:07.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240588+0000", 2024-09-17T02:22:07.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9585999999999993e-05 2024-09-17T02:22:07.514 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.514 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:07.514 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.514 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190958 5.3 e65/64 5:c9337cc4:::benchmark_data_smithi001_23533_object62841:head v 65'12049, mlcod=0'0)", 2024-09-17T02:22:07.514 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.209746+0000", 2024-09-17T02:22:07.514 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.2157871929999999, 2024-09-17T02:22:07.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030921212999999999, 2024-09-17T02:22:07.514 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:07.514 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:07.514 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:07.514 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:07.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:07.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209746+0000", 2024-09-17T02:22:07.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:07.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209746+0000", 2024-09-17T02:22:07.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:07.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209748+0000", 2024-09-17T02:22:07.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9989999999999998e-06 2024-09-17T02:22:07.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:07.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209761+0000", 2024-09-17T02:22:07.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3317e-05 2024-09-17T02:22:07.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:07.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209786+0000", 2024-09-17T02:22:07.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4941999999999999e-05 2024-09-17T02:22:07.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:07.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209799+0000", 2024-09-17T02:22:07.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2556e-05 2024-09-17T02:22:07.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:07.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.226753+0000", 2024-09-17T02:22:07.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016954100999999999 2024-09-17T02:22:07.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:07.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.226810+0000", 2024-09-17T02:22:07.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7207000000000003e-05 2024-09-17T02:22:07.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:07.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240599+0000", 2024-09-17T02:22:07.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013789228000000001 2024-09-17T02:22:07.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:07.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240667+0000", 2024-09-17T02:22:07.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7862999999999997e-05 2024-09-17T02:22:07.518 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.518 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:07.518 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.519 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:191023 5.3 e65/64 5:cfca4af2:::benchmark_data_smithi001_23533_object62906:head v 65'12050, mlcod=0'0)", 2024-09-17T02:22:07.519 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.210919+0000", 2024-09-17T02:22:07.519 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.2146138369999999, 2024-09-17T02:22:07.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029830820000000001, 2024-09-17T02:22:07.519 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:07.519 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:07.519 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:07.519 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:07.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:07.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210919+0000", 2024-09-17T02:22:07.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:07.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210919+0000", 2024-09-17T02:22:07.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:07.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210921+0000", 2024-09-17T02:22:07.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-09-17T02:22:07.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:07.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210935+0000", 2024-09-17T02:22:07.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3436e-05 2024-09-17T02:22:07.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:07.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210961+0000", 2024-09-17T02:22:07.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6767999999999999e-05 2024-09-17T02:22:07.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:07.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210974+0000", 2024-09-17T02:22:07.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2904e-05 2024-09-17T02:22:07.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:07.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229967+0000", 2024-09-17T02:22:07.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018992774 2024-09-17T02:22:07.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:07.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.230023+0000", 2024-09-17T02:22:07.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6334e-05 2024-09-17T02:22:07.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:07.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240673+0000", 2024-09-17T02:22:07.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010649908 2024-09-17T02:22:07.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:07.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240750+0000", 2024-09-17T02:22:07.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6556000000000004e-05 2024-09-17T02:22:07.523 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.523 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:07.523 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.523 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:191048 5.3 e65/64 5:c4115f14:::benchmark_data_smithi001_23533_object62931:head v 65'12051, mlcod=0'0)", 2024-09-17T02:22:07.523 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.211763+0000", 2024-09-17T02:22:07.523 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.2137699150000001, 2024-09-17T02:22:07.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029064577000000001, 2024-09-17T02:22:07.523 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:07.523 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:07.523 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:07.523 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:07.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:07.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211763+0000", 2024-09-17T02:22:07.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:07.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211763+0000", 2024-09-17T02:22:07.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:07.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211765+0000", 2024-09-17T02:22:07.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.717e-06 2024-09-17T02:22:07.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:07.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211776+0000", 2024-09-17T02:22:07.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1358999999999999e-05 2024-09-17T02:22:07.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:07.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211806+0000", 2024-09-17T02:22:07.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9924999999999999e-05 2024-09-17T02:22:07.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:07.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211824+0000", 2024-09-17T02:22:07.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7782999999999999e-05 2024-09-17T02:22:07.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:07.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.232521+0000", 2024-09-17T02:22:07.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020696902 2024-09-17T02:22:07.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:07.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.232574+0000", 2024-09-17T02:22:07.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3044000000000002e-05 2024-09-17T02:22:07.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:07.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240757+0000", 2024-09-17T02:22:07.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081828579999999995 2024-09-17T02:22:07.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:07.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240828+0000", 2024-09-17T02:22:07.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0988999999999994e-05 2024-09-17T02:22:07.527 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.527 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:07.527 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.527 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:191114 5.3 e65/64 5:c2a7e5a9:::benchmark_data_smithi001_23533_object62997:head v 65'12054, mlcod=63'12038)", 2024-09-17T02:22:07.528 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.217495+0000", 2024-09-17T02:22:07.528 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.2080382839999999, 2024-09-17T02:22:07.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029944788, 2024-09-17T02:22:07.528 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:07.528 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:07.528 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:07.528 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:07.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:07.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217495+0000", 2024-09-17T02:22:07.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:07.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217495+0000", 2024-09-17T02:22:07.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:07.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:07.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217496+0000", 2024-09-17T02:22:07.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.46e-06 2024-09-17T02:22:07.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:07.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217508+0000", 2024-09-17T02:22:07.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2157000000000001e-05 2024-09-17T02:22:07.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:07.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217535+0000", 2024-09-17T02:22:07.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7058000000000001e-05 2024-09-17T02:22:07.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:07.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217551+0000", 2024-09-17T02:22:07.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5709000000000002e-05 2024-09-17T02:22:07.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:07.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.241029+0000", 2024-09-17T02:22:07.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023478452 2024-09-17T02:22:07.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:07.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.241078+0000", 2024-09-17T02:22:07.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8068000000000001e-05 2024-09-17T02:22:07.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:07.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.247369+0000", 2024-09-17T02:22:07.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0062912740000000003 2024-09-17T02:22:07.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:07.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:07.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:07.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.247439+0000", 2024-09-17T02:22:07.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0610000000000003e-05 2024-09-17T02:22:07.532 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.532 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:07.532 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.532 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:07.532 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:07.532 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:07.533 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:07.535+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:07.534 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:07.634 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:07.635+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:07.700 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:07.700 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:22:07.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.700 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:194398 5.3 5:c5eab850:::benchmark_data_smithi001_23533_object66281:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T02:22:07.700 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:07.695554+0000", 2024-09-17T02:22:07.700 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0083175829999999999, 2024-09-17T02:22:07.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083355649999999996, 2024-09-17T02:22:07.700 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:07.700 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:07.701 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:07.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:07.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:07.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:07.701 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 194398 2024-09-17T02:22:07.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.701 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:07.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:07.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.695554+0000", 2024-09-17T02:22:07.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:07.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:07.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.695554+0000", 2024-09-17T02:22:07.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:07.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:07.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.695554+0000", 2024-09-17T02:22:07.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2899999999999999e-07 2024-09-17T02:22:07.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:07.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.695557+0000", 2024-09-17T02:22:07.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.531e-06 2024-09-17T02:22:07.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:07.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.695564+0000", 2024-09-17T02:22:07.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9480000000000002e-06 2024-09-17T02:22:07.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:07.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.695569+0000", 2024-09-17T02:22:07.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.614e-06 2024-09-17T02:22:07.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:07.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.697695+0000", 2024-09-17T02:22:07.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021258150000000001 2024-09-17T02:22:07.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:07.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.697769+0000", 2024-09-17T02:22:07.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4062999999999999e-05 2024-09-17T02:22:07.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:07.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.697832+0000", 2024-09-17T02:22:07.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2774000000000006e-05 2024-09-17T02:22:07.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:07.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.701030+0000", 2024-09-17T02:22:07.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031979970000000002 2024-09-17T02:22:07.705 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:07.705 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:07.705 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:07.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.705 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:194401 5.3 5:cf2e27b0:::benchmark_data_smithi001_23533_object66284:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T02:22:07.705 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:07.695993+0000", 2024-09-17T02:22:07.705 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0078784679999999996, 2024-09-17T02:22:07.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0079484710000000004, 2024-09-17T02:22:07.705 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:07.706 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:07.706 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:07.706 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:07.706 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:07.706 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:07.706 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 194401 2024-09-17T02:22:07.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.706 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:07.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:07.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.695993+0000", 2024-09-17T02:22:07.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:07.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:07.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.695993+0000", 2024-09-17T02:22:07.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:07.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:07.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.695994+0000", 2024-09-17T02:22:07.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8800000000000002e-07 2024-09-17T02:22:07.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:07.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.695997+0000", 2024-09-17T02:22:07.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.507e-06 2024-09-17T02:22:07.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:07.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.696006+0000", 2024-09-17T02:22:07.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8910000000000001e-06 2024-09-17T02:22:07.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:07.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.696013+0000", 2024-09-17T02:22:07.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6460000000000004e-06 2024-09-17T02:22:07.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:07.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.699610+0000", 2024-09-17T02:22:07.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003597491 2024-09-17T02:22:07.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:07.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.699691+0000", 2024-09-17T02:22:07.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0966999999999999e-05 2024-09-17T02:22:07.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:07.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.699766+0000", 2024-09-17T02:22:07.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4422e-05 2024-09-17T02:22:07.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:07.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.701706+0000", 2024-09-17T02:22:07.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019408310000000001 2024-09-17T02:22:07.710 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:07.710 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:07.710 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:07.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.711 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:194404 5.1 5:842ac96b:::benchmark_data_smithi001_23533_object66287:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T02:22:07.711 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:07.699022+0000", 2024-09-17T02:22:07.711 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0048496110000000002, 2024-09-17T02:22:07.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049647240000000002, 2024-09-17T02:22:07.711 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:07.711 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:07.711 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:07.711 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:07.711 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:07.711 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:07.711 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 194404 2024-09-17T02:22:07.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.711 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:07.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:07.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.699022+0000", 2024-09-17T02:22:07.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:07.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:07.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.699022+0000", 2024-09-17T02:22:07.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:07.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:07.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.699023+0000", 2024-09-17T02:22:07.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7100000000000001e-07 2024-09-17T02:22:07.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:07.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.699026+0000", 2024-09-17T02:22:07.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3900000000000002e-06 2024-09-17T02:22:07.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:07.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.699035+0000", 2024-09-17T02:22:07.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5969999999999992e-06 2024-09-17T02:22:07.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:07.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.699041+0000", 2024-09-17T02:22:07.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0909999999999998e-06 2024-09-17T02:22:07.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:07.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.701869+0000", 2024-09-17T02:22:07.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028279310000000001 2024-09-17T02:22:07.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:07.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.702005+0000", 2024-09-17T02:22:07.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000136942 2024-09-17T02:22:07.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:07.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.702133+0000", 2024-09-17T02:22:07.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012753499999999999 2024-09-17T02:22:07.715 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:07.715 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:07.715 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:07.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.715 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:194405 5.9 5:9e74f008:::benchmark_data_smithi001_23533_object66288:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T02:22:07.715 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:07.699366+0000", 2024-09-17T02:22:07.715 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.004505167, 2024-09-17T02:22:07.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046661009999999998, 2024-09-17T02:22:07.715 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:07.715 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:07.716 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:07.716 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:07.716 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:07.716 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:07.716 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 194405 2024-09-17T02:22:07.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.716 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:07.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:07.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.699366+0000", 2024-09-17T02:22:07.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:07.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:07.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.699366+0000", 2024-09-17T02:22:07.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:07.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:07.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.699367+0000", 2024-09-17T02:22:07.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2999999999999999e-07 2024-09-17T02:22:07.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:07.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.699371+0000", 2024-09-17T02:22:07.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3019999999999996e-06 2024-09-17T02:22:07.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:07.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.699384+0000", 2024-09-17T02:22:07.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2082000000000001e-05 2024-09-17T02:22:07.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:07.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.699392+0000", 2024-09-17T02:22:07.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2519999999999999e-06 2024-09-17T02:22:07.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:07.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.701963+0000", 2024-09-17T02:22:07.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025714969999999998 2024-09-17T02:22:07.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:07.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.702039+0000", 2024-09-17T02:22:07.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6150999999999996e-05 2024-09-17T02:22:07.719 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:07.719 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:07.719 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:07.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.720 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:194413 5.9 5:9354fd11:::benchmark_data_smithi001_23533_object66296:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T02:22:07.720 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:07.699752+0000", 2024-09-17T02:22:07.720 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0041197910000000003, 2024-09-17T02:22:07.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043206449999999997, 2024-09-17T02:22:07.720 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:07.720 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:07.720 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:07.720 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:07.720 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:07.720 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:07.720 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 194413 2024-09-17T02:22:07.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.721 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:07.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:07.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.699752+0000", 2024-09-17T02:22:07.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:07.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:07.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.699752+0000", 2024-09-17T02:22:07.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:07.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:07.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.699752+0000", 2024-09-17T02:22:07.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5799999999999998e-07 2024-09-17T02:22:07.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:07.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.699757+0000", 2024-09-17T02:22:07.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6770000000000003e-06 2024-09-17T02:22:07.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:07.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.699769+0000", 2024-09-17T02:22:07.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2323e-05 2024-09-17T02:22:07.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:07.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.699777+0000", 2024-09-17T02:22:07.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5739999999999998e-06 2024-09-17T02:22:07.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:07.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.703120+0000", 2024-09-17T02:22:07.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033429079999999999 2024-09-17T02:22:07.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:07.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:07.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:07.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:07.703188+0000", 2024-09-17T02:22:07.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7791000000000002e-05 2024-09-17T02:22:07.723 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:07.723 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:07.724 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:07.724 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:07.724 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:22:07.724 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 5 2024-09-17T02:22:07.724 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:07.725 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:07.769 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:07.771+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:07.809 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:22:07.837 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:07.836+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:07.934 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:07.934 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:22:07.934 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:22:07.934 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:22:07.934 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:07.936 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:07.940+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:07.962 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:07.975 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:22:07.975 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:22:07.994 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:22:07.995 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:22:07.995 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:22:07.998 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:22:07.999 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:22:08.037 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:08.040+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:08.083 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T02:22:08.116 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:08.117 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:08.138 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:08.139 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:08.140+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:08.240 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:08.240+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:08.290 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:08.290 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:08.312 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:08.342 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:08.343+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:08.450 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:08.452+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:08.504 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:08.504 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:08.525 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:08.554 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~29s 2024-09-17T02:22:08.568 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:08.572+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:08.645 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:08.644+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:08.723 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:08.723 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:08.743 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:08.745 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:08.747+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:08.845 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:08.848+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:08.894 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:08.895 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:08.914 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:08.957 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:08.959+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:09.047 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:09.047+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:09.059 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:09.060 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:09.074 INFO:teuthology.orchestra.run.smithi001.stderr:nodeep-scrub is set 2024-09-17T02:22:09.079 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:09.165 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:09.167+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:09.249 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:09.247+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:09.273 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:09.273 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:09.292 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:09.350 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:09.352+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:09.448 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:09.448 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:09.450 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:09.452+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:09.468 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:09.556 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:09.560+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:09.651 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:09.652+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:09.660 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:09.660 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:09.678 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:09.752 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:09.751+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:09.853 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:09.855+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:09.867 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:09.867 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:09.887 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:09.954 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:09.955+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:10.000 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:22:10.035 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:10.035 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:10.053 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:10.102 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:10.103+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:10.156 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:10.156+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:10.161 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:22:10.161 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:22:10.179 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:22:10.180 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:22:10.180 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:22:10.183 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:22:10.183 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:22:10.250 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:10.250 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:22:10.250 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:22:10.250 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:22:10.250 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:10.257 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:10.260+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:10.268 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:10.358 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:10.360+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:10.422 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:10.422 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:22:10.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:22:10.422 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:22:10.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.423 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97749 5.b 5:d930ef52:::benchmark_data_smithi001_23533_object97748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:10.423 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:10.423 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.831380019000001, 2024-09-17T02:22:10.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092964343000000005, 2024-09-17T02:22:10.423 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:10.423 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:10.423 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:10.423 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:10.423 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:10.423 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.423 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97749 2024-09-17T02:22:10.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:10.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591947+0000", 2024-09-17T02:22:10.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:22:10.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:10.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592011+0000", 2024-09-17T02:22:10.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3608000000000005e-05 2024-09-17T02:22:10.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:10.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592021+0000", 2024-09-17T02:22:10.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9979999999999998e-06 2024-09-17T02:22:10.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592028+0000", 2024-09-17T02:22:10.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1439999999999997e-06 2024-09-17T02:22:10.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593633+0000", 2024-09-17T02:22:10.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001604636 2024-09-17T02:22:10.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:10.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593757+0000", 2024-09-17T02:22:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012432099999999999 2024-09-17T02:22:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593866+0000", 2024-09-17T02:22:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109094 2024-09-17T02:22:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601190+0000", 2024-09-17T02:22:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073237620000000002 2024-09-17T02:22:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:10.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601356+0000", 2024-09-17T02:22:10.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016651900000000001 2024-09-17T02:22:10.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:10.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684618+0000", 2024-09-17T02:22:10.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083261356999999994 2024-09-17T02:22:10.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:10.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684724+0000", 2024-09-17T02:22:10.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010681800000000001 2024-09-17T02:22:10.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:10.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684911+0000", 2024-09-17T02:22:10.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186243 2024-09-17T02:22:10.429 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.429 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:10.429 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.430 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97752 5.b 5:d146f486:::benchmark_data_smithi001_23533_object97751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:10.430 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:10.430 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.830027325000003, 2024-09-17T02:22:10.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091989557, 2024-09-17T02:22:10.430 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:10.430 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:10.430 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:10.430 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:10.430 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:10.430 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.430 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97752 2024-09-17T02:22:10.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.430 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:10.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:10.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:10.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:10.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:10.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:10.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593300+0000", 2024-09-17T02:22:10.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8199999999999998e-07 2024-09-17T02:22:10.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:10.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593364+0000", 2024-09-17T02:22:10.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3831999999999995e-05 2024-09-17T02:22:10.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:10.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593376+0000", 2024-09-17T02:22:10.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1800999999999999e-05 2024-09-17T02:22:10.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593382+0000", 2024-09-17T02:22:10.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6780000000000003e-06 2024-09-17T02:22:10.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595491+0000", 2024-09-17T02:22:10.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021090689999999999 2024-09-17T02:22:10.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:10.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595614+0000", 2024-09-17T02:22:10.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012321500000000001 2024-09-17T02:22:10.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:10.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595778+0000", 2024-09-17T02:22:10.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016321900000000001 2024-09-17T02:22:10.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:10.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601197+0000", 2024-09-17T02:22:10.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054195600000000003 2024-09-17T02:22:10.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:10.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601396+0000", 2024-09-17T02:22:10.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019825299999999999 2024-09-17T02:22:10.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:10.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684990+0000", 2024-09-17T02:22:10.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083594878999999997 2024-09-17T02:22:10.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:10.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685116+0000", 2024-09-17T02:22:10.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012522799999999999 2024-09-17T02:22:10.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685289+0000", 2024-09-17T02:22:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172941 2024-09-17T02:22:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97754 5.b 5:da0615e5:::benchmark_data_smithi001_23533_object97753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.828389403000003, 2024-09-17T02:22:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092097207, 2024-09-17T02:22:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97754 2024-09-17T02:22:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:10.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:10.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:10.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594938+0000", 2024-09-17T02:22:10.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5000000000000002e-07 2024-09-17T02:22:10.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:10.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595075+0000", 2024-09-17T02:22:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137742 2024-09-17T02:22:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595087+0000", 2024-09-17T02:22:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1243000000000001e-05 2024-09-17T02:22:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595095+0000", 2024-09-17T02:22:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1030000000000002e-06 2024-09-17T02:22:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598461+0000", 2024-09-17T02:22:10.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033661170000000001 2024-09-17T02:22:10.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:10.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598540+0000", 2024-09-17T02:22:10.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8937999999999995e-05 2024-09-17T02:22:10.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:10.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598626+0000", 2024-09-17T02:22:10.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6042000000000001e-05 2024-09-17T02:22:10.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:10.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684258+0000", 2024-09-17T02:22:10.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085632394000000001 2024-09-17T02:22:10.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:10.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685369+0000", 2024-09-17T02:22:10.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001111063 2024-09-17T02:22:10.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:10.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685511+0000", 2024-09-17T02:22:10.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141965 2024-09-17T02:22:10.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:10.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685604+0000", 2024-09-17T02:22:10.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2935000000000004e-05 2024-09-17T02:22:10.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:10.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687034+0000", 2024-09-17T02:22:10.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001430015 2024-09-17T02:22:10.442 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.442 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:10.442 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97755 5.b 5:d36a03a1:::benchmark_data_smithi001_23533_object97754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.828216253000001, 2024-09-17T02:22:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0924904, 2024-09-17T02:22:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97755 2024-09-17T02:22:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595111+0000", 2024-09-17T02:22:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:22:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595145+0000", 2024-09-17T02:22:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3927000000000002e-05 2024-09-17T02:22:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595155+0000", 2024-09-17T02:22:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0023e-05 2024-09-17T02:22:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595162+0000", 2024-09-17T02:22:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3950000000000003e-06 2024-09-17T02:22:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599821+0000", 2024-09-17T02:22:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046592880000000001 2024-09-17T02:22:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599912+0000", 2024-09-17T02:22:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1049000000000002e-05 2024-09-17T02:22:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600062+0000", 2024-09-17T02:22:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015001700000000001 2024-09-17T02:22:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685307+0000", 2024-09-17T02:22:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085244340000000002 2024-09-17T02:22:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685446+0000", 2024-09-17T02:22:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013955700000000001 2024-09-17T02:22:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687375+0000", 2024-09-17T02:22:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019291079999999999 2024-09-17T02:22:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687462+0000", 2024-09-17T02:22:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6148000000000003e-05 2024-09-17T02:22:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687600+0000", 2024-09-17T02:22:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013887900000000001 2024-09-17T02:22:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 44/44 lb 5:c4567a04:::benchmark_data_smithi001_23533_object4200:head)", 2024-09-17T02:22:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.826119626999997, 2024-09-17T02:22:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092483421999999996, 2024-09-17T02:22:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6399999999999998e-07 2024-09-17T02:22:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597213+0000", 2024-09-17T02:22:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3659999999999997e-06 2024-09-17T02:22:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597222+0000", 2024-09-17T02:22:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0510000000000002e-06 2024-09-17T02:22:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597228+0000", 2024-09-17T02:22:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1569999999999999e-06 2024-09-17T02:22:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689588+0000", 2024-09-17T02:22:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092359931000000006 2024-09-17T02:22:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689622+0000", 2024-09-17T02:22:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4425999999999999e-05 2024-09-17T02:22:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689690+0000", 2024-09-17T02:22:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8126999999999993e-05 2024-09-17T02:22:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129462 5.4 5:2e0acc16:::benchmark_data_smithi001_23533_object1345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:10.454 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.888385558000003, 2024-09-17T02:22:10.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0112774899999999, 2024-09-17T02:22:10.454 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:10.454 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:10.454 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:10.454 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:10.454 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:10.454 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.454 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129462 2024-09-17T02:22:10.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.454 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:10.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:10.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534943+0000", 2024-09-17T02:22:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8759999999999999e-06 2024-09-17T02:22:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534951+0000", 2024-09-17T02:22:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3219999999999993e-06 2024-09-17T02:22:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534977+0000", 2024-09-17T02:22:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6245e-05 2024-09-17T02:22:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534992+0000", 2024-09-17T02:22:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4936000000000001e-05 2024-09-17T02:22:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535133+0000", 2024-09-17T02:22:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014051299999999999 2024-09-17T02:22:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:22:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1741000000000001e-05 2024-09-17T02:22:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.533906+0000", 2024-09-17T02:22:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99875209300000001 2024-09-17T02:22:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534348+0000", 2024-09-17T02:22:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044128899999999998 2024-09-17T02:22:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534762+0000", 2024-09-17T02:22:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000414707 2024-09-17T02:22:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545024+0000", 2024-09-17T02:22:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010261283 2024-09-17T02:22:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545953+0000", 2024-09-17T02:22:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000929618 2024-09-17T02:22:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546047+0000", 2024-09-17T02:22:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3697999999999996e-05 2024-09-17T02:22:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546218+0000", 2024-09-17T02:22:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017116899999999999 2024-09-17T02:22:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129480 5.4 5:2b1d398b:::benchmark_data_smithi001_23533_object1363:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.880631092000002, 2024-09-17T02:22:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0038926450000001, 2024-09-17T02:22:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129480 2024-09-17T02:22:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:10.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:10.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542696+0000", 2024-09-17T02:22:10.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9999999999999995e-07 2024-09-17T02:22:10.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:10.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542701+0000", 2024-09-17T02:22:10.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2240000000000003e-06 2024-09-17T02:22:10.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542716+0000", 2024-09-17T02:22:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4970000000000001e-05 2024-09-17T02:22:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542726+0000", 2024-09-17T02:22:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2879999999999998e-06 2024-09-17T02:22:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542832+0000", 2024-09-17T02:22:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010597199999999999 2024-09-17T02:22:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:10.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542843+0000", 2024-09-17T02:22:10.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.098e-05 2024-09-17T02:22:10.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538436+0000", 2024-09-17T02:22:10.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99559286800000002 2024-09-17T02:22:10.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:10.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538791+0000", 2024-09-17T02:22:10.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035585499999999997 2024-09-17T02:22:10.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.539144+0000", 2024-09-17T02:22:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035268499999999999 2024-09-17T02:22:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545880+0000", 2024-09-17T02:22:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00673552 2024-09-17T02:22:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546330+0000", 2024-09-17T02:22:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045039599999999999 2024-09-17T02:22:10.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:10.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546414+0000", 2024-09-17T02:22:10.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4468000000000005e-05 2024-09-17T02:22:10.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:10.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546588+0000", 2024-09-17T02:22:10.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017341899999999999 2024-09-17T02:22:10.466 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.466 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:10.466 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129505 5.4 5:294f2ec7:::benchmark_data_smithi001_23533_object1388:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.861617918999997, 2024-09-17T02:22:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98589826199999997, 2024-09-17T02:22:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129505 2024-09-17T02:22:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561710+0000", 2024-09-17T02:22:10.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7060000000000001e-06 2024-09-17T02:22:10.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:10.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561718+0000", 2024-09-17T02:22:10.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.542e-06 2024-09-17T02:22:10.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:10.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561741+0000", 2024-09-17T02:22:10.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3357e-05 2024-09-17T02:22:10.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561754+0000", 2024-09-17T02:22:10.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3200000000000001e-05 2024-09-17T02:22:10.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561867+0000", 2024-09-17T02:22:10.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113211 2024-09-17T02:22:10.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:10.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561888+0000", 2024-09-17T02:22:10.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0809999999999999e-05 2024-09-17T02:22:10.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542140+0000", 2024-09-17T02:22:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98025195799999998 2024-09-17T02:22:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542331+0000", 2024-09-17T02:22:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019127599999999999 2024-09-17T02:22:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542517+0000", 2024-09-17T02:22:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000185625 2024-09-17T02:22:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:10.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547114+0000", 2024-09-17T02:22:10.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045968620000000002 2024-09-17T02:22:10.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:10.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547187+0000", 2024-09-17T02:22:10.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3348000000000003e-05 2024-09-17T02:22:10.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:10.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547324+0000", 2024-09-17T02:22:10.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013681699999999999 2024-09-17T02:22:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547607+0000", 2024-09-17T02:22:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028255000000000001 2024-09-17T02:22:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129508 5.4 5:2892b582:::benchmark_data_smithi001_23533_object1391:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.860280826, 2024-09-17T02:22:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99697919099999999, 2024-09-17T02:22:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129508 2024-09-17T02:22:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:10.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:10.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:10.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563047+0000", 2024-09-17T02:22:10.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.274e-06 2024-09-17T02:22:10.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:10.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563054+0000", 2024-09-17T02:22:10.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2799999999999998e-06 2024-09-17T02:22:10.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:10.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563070+0000", 2024-09-17T02:22:10.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5991999999999999e-05 2024-09-17T02:22:10.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563078+0000", 2024-09-17T02:22:10.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2390000000000002e-06 2024-09-17T02:22:10.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563181+0000", 2024-09-17T02:22:10.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102249 2024-09-17T02:22:10.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:10.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563199+0000", 2024-09-17T02:22:10.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8215000000000001e-05 2024-09-17T02:22:10.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547713+0000", 2024-09-17T02:22:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98451446399999998 2024-09-17T02:22:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548063+0000", 2024-09-17T02:22:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034985499999999999 2024-09-17T02:22:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548490+0000", 2024-09-17T02:22:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042658600000000001 2024-09-17T02:22:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:10.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555655+0000", 2024-09-17T02:22:10.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071652579999999999 2024-09-17T02:22:10.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:10.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559612+0000", 2024-09-17T02:22:10.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003957103 2024-09-17T02:22:10.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:10.480 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559768+0000", 2024-09-17T02:22:10.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015556899999999999 2024-09-17T02:22:10.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.480 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:10.480 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560025+0000", 2024-09-17T02:22:10.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025710700000000002 2024-09-17T02:22:10.480 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.480 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:10.480 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.480 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129509 5.4 5:2c35515e:::benchmark_data_smithi001_23533_object1392:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:10.481 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:10.481 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.859653772999998, 2024-09-17T02:22:10.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99969384900000002, 2024-09-17T02:22:10.481 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:10.481 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:10.481 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:10.481 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:10.481 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:10.481 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.481 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129509 2024-09-17T02:22:10.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.481 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:10.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:10.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:10.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:10.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:10.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:10.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563674+0000", 2024-09-17T02:22:10.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0920000000000001e-06 2024-09-17T02:22:10.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:10.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563679+0000", 2024-09-17T02:22:10.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7660000000000004e-06 2024-09-17T02:22:10.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:10.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563693+0000", 2024-09-17T02:22:10.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3139000000000001e-05 2024-09-17T02:22:10.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563701+0000", 2024-09-17T02:22:10.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9859999999999994e-06 2024-09-17T02:22:10.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563775+0000", 2024-09-17T02:22:10.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4659000000000005e-05 2024-09-17T02:22:10.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:10.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563785+0000", 2024-09-17T02:22:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4839999999999993e-06 2024-09-17T02:22:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552085+0000", 2024-09-17T02:22:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98829986999999997 2024-09-17T02:22:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552554+0000", 2024-09-17T02:22:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046908900000000001 2024-09-17T02:22:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:10.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552931+0000", 2024-09-17T02:22:10.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377778 2024-09-17T02:22:10.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:10.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563106+0000", 2024-09-17T02:22:10.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010174186 2024-09-17T02:22:10.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:10.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563138+0000", 2024-09-17T02:22:10.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2495e-05 2024-09-17T02:22:10.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:10.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563225+0000", 2024-09-17T02:22:10.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6677999999999999e-05 2024-09-17T02:22:10.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563366+0000", 2024-09-17T02:22:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014162699999999999 2024-09-17T02:22:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129524 5.4 5:25dca7dd:::benchmark_data_smithi001_23533_object1407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.852962419000001, 2024-09-17T02:22:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99999501999999996, 2024-09-17T02:22:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:10.489 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:10.489 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:10.489 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:10.489 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.489 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129524 2024-09-17T02:22:10.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.489 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:10.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:10.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:10.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:10.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:10.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:10.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570365+0000", 2024-09-17T02:22:10.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.142e-06 2024-09-17T02:22:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570369+0000", 2024-09-17T02:22:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.856e-06 2024-09-17T02:22:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570385+0000", 2024-09-17T02:22:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5855e-05 2024-09-17T02:22:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570392+0000", 2024-09-17T02:22:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5340000000000002e-06 2024-09-17T02:22:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570484+0000", 2024-09-17T02:22:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1212999999999996e-05 2024-09-17T02:22:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570498+0000", 2024-09-17T02:22:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4331000000000001e-05 2024-09-17T02:22:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555835+0000", 2024-09-17T02:22:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98533757700000002 2024-09-17T02:22:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556329+0000", 2024-09-17T02:22:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000493458 2024-09-17T02:22:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556784+0000", 2024-09-17T02:22:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045476499999999999 2024-09-17T02:22:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569852+0000", 2024-09-17T02:22:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013068270999999999 2024-09-17T02:22:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569958+0000", 2024-09-17T02:22:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106214 2024-09-17T02:22:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570124+0000", 2024-09-17T02:22:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165546 2024-09-17T02:22:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570359+0000", 2024-09-17T02:22:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023525799999999999 2024-09-17T02:22:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129537 5.4 5:260327c6:::benchmark_data_smithi001_23533_object1420:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.845055889999998, 2024-09-17T02:22:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99624596499999996, 2024-09-17T02:22:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129537 2024-09-17T02:22:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578272+0000", 2024-09-17T02:22:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.164e-06 2024-09-17T02:22:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578278+0000", 2024-09-17T02:22:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5060000000000001e-06 2024-09-17T02:22:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578294+0000", 2024-09-17T02:22:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5687000000000001e-05 2024-09-17T02:22:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578329+0000", 2024-09-17T02:22:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5311999999999997e-05 2024-09-17T02:22:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578419+0000", 2024-09-17T02:22:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0054000000000002e-05 2024-09-17T02:22:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578435+0000", 2024-09-17T02:22:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5645999999999999e-05 2024-09-17T02:22:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560148+0000", 2024-09-17T02:22:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98171342299999997 2024-09-17T02:22:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560383+0000", 2024-09-17T02:22:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000234935 2024-09-17T02:22:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560586+0000", 2024-09-17T02:22:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000202909 2024-09-17T02:22:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570472+0000", 2024-09-17T02:22:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098856959999999994 2024-09-17T02:22:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574138+0000", 2024-09-17T02:22:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036660170000000001 2024-09-17T02:22:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574298+0000", 2024-09-17T02:22:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016025600000000001 2024-09-17T02:22:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574516+0000", 2024-09-17T02:22:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021835999999999999 2024-09-17T02:22:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129545 5.4 5:22366489:::benchmark_data_smithi001_23533_object1428:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.839193166999998, 2024-09-17T02:22:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99074544499999995, 2024-09-17T02:22:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129545 2024-09-17T02:22:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584135+0000", 2024-09-17T02:22:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4699999999999999e-06 2024-09-17T02:22:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584142+0000", 2024-09-17T02:22:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1620000000000002e-06 2024-09-17T02:22:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584170+0000", 2024-09-17T02:22:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7897000000000001e-05 2024-09-17T02:22:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584183+0000", 2024-09-17T02:22:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2814e-05 2024-09-17T02:22:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584299+0000", 2024-09-17T02:22:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116153 2024-09-17T02:22:10.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:10.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584316+0000", 2024-09-17T02:22:10.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7524999999999999e-05 2024-09-17T02:22:10.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563461+0000", 2024-09-17T02:22:10.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97914436699999996 2024-09-17T02:22:10.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:10.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563667+0000", 2024-09-17T02:22:10.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020689800000000001 2024-09-17T02:22:10.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:10.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563878+0000", 2024-09-17T02:22:10.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210275 2024-09-17T02:22:10.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:10.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570584+0000", 2024-09-17T02:22:10.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067066080000000002 2024-09-17T02:22:10.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:10.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574539+0000", 2024-09-17T02:22:10.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039550360000000003 2024-09-17T02:22:10.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:10.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574653+0000", 2024-09-17T02:22:10.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114003 2024-09-17T02:22:10.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:10.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574879+0000", 2024-09-17T02:22:10.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022523700000000001 2024-09-17T02:22:10.509 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.509 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:10.509 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.509 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129553 5.4 5:2e41ad40:::benchmark_data_smithi001_23533_object1436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:10.509 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:10.509 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.833770530999999, 2024-09-17T02:22:10.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99213429600000003, 2024-09-17T02:22:10.509 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:10.509 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:10.509 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:10.509 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:10.510 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:10.510 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.510 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129553 2024-09-17T02:22:10.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.510 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:10.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:10.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:10.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:10.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:10.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:10.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589557+0000", 2024-09-17T02:22:10.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2219999999999999e-06 2024-09-17T02:22:10.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:10.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589562+0000", 2024-09-17T02:22:10.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0649999999999998e-06 2024-09-17T02:22:10.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:10.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589575+0000", 2024-09-17T02:22:10.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3129000000000001e-05 2024-09-17T02:22:10.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589584+0000", 2024-09-17T02:22:10.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6200000000000005e-06 2024-09-17T02:22:10.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589693+0000", 2024-09-17T02:22:10.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109319 2024-09-17T02:22:10.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:10.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589714+0000", 2024-09-17T02:22:10.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0849999999999999e-05 2024-09-17T02:22:10.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566273+0000", 2024-09-17T02:22:10.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97655884999999998 2024-09-17T02:22:10.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:10.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566543+0000", 2024-09-17T02:22:10.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027059099999999998 2024-09-17T02:22:10.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:10.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566832+0000", 2024-09-17T02:22:10.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028898200000000002 2024-09-17T02:22:10.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:10.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581040+0000", 2024-09-17T02:22:10.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014208001 2024-09-17T02:22:10.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:10.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581200+0000", 2024-09-17T02:22:10.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159956 2024-09-17T02:22:10.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:10.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581427+0000", 2024-09-17T02:22:10.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000226309 2024-09-17T02:22:10.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:10.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581690+0000", 2024-09-17T02:22:10.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026340199999999998 2024-09-17T02:22:10.515 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.515 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:10.515 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.516 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129580 5.4 5:25ed887b:::benchmark_data_smithi001_23533_object1463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:10.516 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:10.516 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.811998486999997, 2024-09-17T02:22:10.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98001430499999997, 2024-09-17T02:22:10.516 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:10.516 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:10.516 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:10.516 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:10.516 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:10.516 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.516 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129580 2024-09-17T02:22:10.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.516 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:10.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:10.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:10.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:10.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:10.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:10.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611329+0000", 2024-09-17T02:22:10.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.22e-06 2024-09-17T02:22:10.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:10.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611335+0000", 2024-09-17T02:22:10.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1129999999999997e-06 2024-09-17T02:22:10.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:10.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611348+0000", 2024-09-17T02:22:10.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2342e-05 2024-09-17T02:22:10.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611356+0000", 2024-09-17T02:22:10.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.371e-06 2024-09-17T02:22:10.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611419+0000", 2024-09-17T02:22:10.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3393999999999996e-05 2024-09-17T02:22:10.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:10.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611427+0000", 2024-09-17T02:22:10.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999997e-06 2024-09-17T02:22:10.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570705+0000", 2024-09-17T02:22:10.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.95927859199999999 2024-09-17T02:22:10.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:10.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571009+0000", 2024-09-17T02:22:10.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030414599999999998 2024-09-17T02:22:10.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:10.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571241+0000", 2024-09-17T02:22:10.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023106799999999999 2024-09-17T02:22:10.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:10.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590789+0000", 2024-09-17T02:22:10.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019548763 2024-09-17T02:22:10.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:10.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590928+0000", 2024-09-17T02:22:10.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000139092 2024-09-17T02:22:10.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:10.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591086+0000", 2024-09-17T02:22:10.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015787400000000001 2024-09-17T02:22:10.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:10.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591342+0000", 2024-09-17T02:22:10.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025589900000000002 2024-09-17T02:22:10.522 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.522 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:10.522 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.522 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129603 5.4 5:25aaa5e8:::benchmark_data_smithi001_23533_object1486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:10.522 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:10.522 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.795938691000003, 2024-09-17T02:22:10.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96463198999999999, 2024-09-17T02:22:10.523 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:10.523 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:10.523 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:10.523 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:10.523 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:10.523 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.523 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129603 2024-09-17T02:22:10.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.523 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:10.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:10.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:10.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:10.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:10.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:10.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:10.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:22:10.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:10.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627392+0000", 2024-09-17T02:22:10.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0790000000000002e-06 2024-09-17T02:22:10.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:10.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627403+0000", 2024-09-17T02:22:10.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0866000000000001e-05 2024-09-17T02:22:10.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627409+0000", 2024-09-17T02:22:10.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.305e-06 2024-09-17T02:22:10.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.526 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627485+0000", 2024-09-17T02:22:10.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6582000000000006e-05 2024-09-17T02:22:10.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.526 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.526 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:10.526 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627499+0000", 2024-09-17T02:22:10.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:22:10.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.526 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.526 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.526 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574991+0000", 2024-09-17T02:22:10.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94749182300000001 2024-09-17T02:22:10.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.526 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:10.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575377+0000", 2024-09-17T02:22:10.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038629400000000003 2024-09-17T02:22:10.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:10.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575665+0000", 2024-09-17T02:22:10.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028759499999999997 2024-09-17T02:22:10.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:10.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590802+0000", 2024-09-17T02:22:10.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015136479 2024-09-17T02:22:10.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:10.528 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591614+0000", 2024-09-17T02:22:10.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081293100000000003 2024-09-17T02:22:10.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:10.528 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591764+0000", 2024-09-17T02:22:10.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014932199999999999 2024-09-17T02:22:10.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:10.529 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592020+0000", 2024-09-17T02:22:10.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025585099999999997 2024-09-17T02:22:10.529 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.529 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:10.529 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.529 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.529 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129607 5.4 5:2f638f1e:::benchmark_data_smithi001_23533_object1490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:10.529 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:10.529 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.794411785000001, 2024-09-17T02:22:10.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96352375899999998, 2024-09-17T02:22:10.529 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:10.529 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:10.530 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:10.530 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:10.530 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:10.530 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.530 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129607 2024-09-17T02:22:10.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.530 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:10.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:10.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:10.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:10.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:10.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:10.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628916+0000", 2024-09-17T02:22:10.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1710000000000001e-06 2024-09-17T02:22:10.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:10.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628920+0000", 2024-09-17T02:22:10.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-17T02:22:10.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:10.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628935+0000", 2024-09-17T02:22:10.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4474000000000001e-05 2024-09-17T02:22:10.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628944+0000", 2024-09-17T02:22:10.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9940000000000006e-06 2024-09-17T02:22:10.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628997+0000", 2024-09-17T02:22:10.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3579000000000003e-05 2024-09-17T02:22:10.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.533 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:10.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.629006+0000", 2024-09-17T02:22:10.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4009999999999997e-06 2024-09-17T02:22:10.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.533 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.577862+0000", 2024-09-17T02:22:10.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.948856335 2024-09-17T02:22:10.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.533 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:10.534 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578167+0000", 2024-09-17T02:22:10.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030532399999999999 2024-09-17T02:22:10.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:10.534 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578532+0000", 2024-09-17T02:22:10.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036428200000000001 2024-09-17T02:22:10.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:10.534 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591442+0000", 2024-09-17T02:22:10.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012910374000000001 2024-09-17T02:22:10.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:10.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592164+0000", 2024-09-17T02:22:10.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072242499999999996 2024-09-17T02:22:10.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:10.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592267+0000", 2024-09-17T02:22:10.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102205 2024-09-17T02:22:10.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:10.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592438+0000", 2024-09-17T02:22:10.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017165299999999999 2024-09-17T02:22:10.535 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.535 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:10.536 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.536 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129623 5.4 5:2cf5174b:::benchmark_data_smithi001_23533_object1506:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:10.536 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:10.536 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.770467498999999, 2024-09-17T02:22:10.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94334114499999999, 2024-09-17T02:22:10.536 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:10.536 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:10.536 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:10.536 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:10.536 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:10.536 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.537 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129623 2024-09-17T02:22:10.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.537 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:10.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:10.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:10.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:10.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:10.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:10.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652860+0000", 2024-09-17T02:22:10.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0330000000000001e-06 2024-09-17T02:22:10.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:10.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652864+0000", 2024-09-17T02:22:10.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.634e-06 2024-09-17T02:22:10.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:10.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652877+0000", 2024-09-17T02:22:10.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2591e-05 2024-09-17T02:22:10.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652883+0000", 2024-09-17T02:22:10.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1460000000000001e-06 2024-09-17T02:22:10.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652943+0000", 2024-09-17T02:22:10.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9833999999999997e-05 2024-09-17T02:22:10.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:10.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652950+0000", 2024-09-17T02:22:10.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.401e-06 2024-09-17T02:22:10.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581800+0000", 2024-09-17T02:22:10.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.92884935700000004 2024-09-17T02:22:10.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:10.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582122+0000", 2024-09-17T02:22:10.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032185200000000002 2024-09-17T02:22:10.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:10.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582689+0000", 2024-09-17T02:22:10.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056750400000000003 2024-09-17T02:22:10.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:10.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591458+0000", 2024-09-17T02:22:10.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008768685 2024-09-17T02:22:10.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:10.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595856+0000", 2024-09-17T02:22:10.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043977909999999999 2024-09-17T02:22:10.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:10.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595955+0000", 2024-09-17T02:22:10.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9166000000000006e-05 2024-09-17T02:22:10.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:10.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596200+0000", 2024-09-17T02:22:10.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024515099999999998 2024-09-17T02:22:10.544 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.544 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:10.544 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.544 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129642 5.4 5:255eb796:::benchmark_data_smithi001_23533_object1525:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:10.544 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:10.544 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.739231334999999, 2024-09-17T02:22:10.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.91257397299999998, 2024-09-17T02:22:10.544 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:10.545 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:10.545 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:10.545 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:10.545 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:10.545 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.545 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129642 2024-09-17T02:22:10.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.545 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:10.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:10.545 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:10.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:10.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:10.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:10.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684096+0000", 2024-09-17T02:22:10.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659999999999999e-06 2024-09-17T02:22:10.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:10.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684101+0000", 2024-09-17T02:22:10.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8110000000000002e-06 2024-09-17T02:22:10.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:10.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684114+0000", 2024-09-17T02:22:10.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2653000000000001e-05 2024-09-17T02:22:10.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684121+0000", 2024-09-17T02:22:10.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5100000000000001e-06 2024-09-17T02:22:10.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684181+0000", 2024-09-17T02:22:10.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0307999999999999e-05 2024-09-17T02:22:10.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.548 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:10.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684194+0000", 2024-09-17T02:22:10.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2916e-05 2024-09-17T02:22:10.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.548 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.587917+0000", 2024-09-17T02:22:10.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.90372220400000003 2024-09-17T02:22:10.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:10.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588215+0000", 2024-09-17T02:22:10.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029845400000000003 2024-09-17T02:22:10.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:10.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588470+0000", 2024-09-17T02:22:10.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025455399999999999 2024-09-17T02:22:10.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:10.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596318+0000", 2024-09-17T02:22:10.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078485589999999997 2024-09-17T02:22:10.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:10.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596354+0000", 2024-09-17T02:22:10.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5976999999999998e-05 2024-09-17T02:22:10.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:10.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596449+0000", 2024-09-17T02:22:10.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4728999999999994e-05 2024-09-17T02:22:10.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:10.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596669+0000", 2024-09-17T02:22:10.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220132 2024-09-17T02:22:10.551 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.551 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:10.551 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.551 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129649 5.4 5:2fe27050:::benchmark_data_smithi001_23533_object1532:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:10.551 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:10.551 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.707674592000004, 2024-09-17T02:22:10.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.88508119100000004, 2024-09-17T02:22:10.551 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:10.551 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:10.551 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:10.552 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:10.552 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:10.552 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.552 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129649 2024-09-17T02:22:10.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.552 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:10.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:10.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:10.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:10.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:10.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:10.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:10.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715653+0000", 2024-09-17T02:22:10.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3519999999999999e-06 2024-09-17T02:22:10.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:10.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715658+0000", 2024-09-17T02:22:10.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3120000000000001e-06 2024-09-17T02:22:10.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:10.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715677+0000", 2024-09-17T02:22:10.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-17T02:22:10.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715687+0000", 2024-09-17T02:22:10.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0146000000000001e-05 2024-09-17T02:22:10.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715821+0000", 2024-09-17T02:22:10.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013421 2024-09-17T02:22:10.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:10.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715840+0000", 2024-09-17T02:22:10.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8153999999999999e-05 2024-09-17T02:22:10.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:10.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592528+0000", 2024-09-17T02:22:10.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.87668860000000004 2024-09-17T02:22:10.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:10.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592702+0000", 2024-09-17T02:22:10.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017429300000000001 2024-09-17T02:22:10.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:10.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592945+0000", 2024-09-17T02:22:10.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000242048 2024-09-17T02:22:10.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:10.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600234+0000", 2024-09-17T02:22:10.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072897600000000002 2024-09-17T02:22:10.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:10.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600494+0000", 2024-09-17T02:22:10.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000259984 2024-09-17T02:22:10.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:10.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600555+0000", 2024-09-17T02:22:10.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1138999999999999e-05 2024-09-17T02:22:10.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:10.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:10.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:10.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600733+0000", 2024-09-17T02:22:10.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017753300000000001 2024-09-17T02:22:10.557 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.557 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:10.558 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.558 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:10.558 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:10.558 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:10.559 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:10.560 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:10.559+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:10.661 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:10.660+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:10.707 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:10.707 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:22:10.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.707 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:201578 5.8 5:152a969a:::benchmark_data_smithi001_23533_object73461:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:10.707 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:10.703280+0000", 2024-09-17T02:22:10.707 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0060030559999999997, 2024-09-17T02:22:10.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060357079999999999, 2024-09-17T02:22:10.707 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:10.708 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:10.708 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:10.708 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:10.708 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:10.708 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.708 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 201578 2024-09-17T02:22:10.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.708 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:10.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:10.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.703280+0000", 2024-09-17T02:22:10.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:10.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.703280+0000", 2024-09-17T02:22:10.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:10.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.703281+0000", 2024-09-17T02:22:10.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0900000000000001e-07 2024-09-17T02:22:10.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:10.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.703284+0000", 2024-09-17T02:22:10.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3110000000000001e-06 2024-09-17T02:22:10.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:10.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.703291+0000", 2024-09-17T02:22:10.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7909999999999999e-06 2024-09-17T02:22:10.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.703297+0000", 2024-09-17T02:22:10.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6699999999999999e-06 2024-09-17T02:22:10.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:10.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.703333+0000", 2024-09-17T02:22:10.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5982999999999998e-05 2024-09-17T02:22:10.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:10.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.703445+0000", 2024-09-17T02:22:10.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000112867 2024-09-17T02:22:10.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:10.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.703550+0000", 2024-09-17T02:22:10.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010488300000000001 2024-09-17T02:22:10.711 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.712 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:10.712 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.712 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:201582 5.4 e66/52 5:2646a297:::benchmark_data_smithi001_23533_object73465:head v 66'12416, mlcod=66'12414)", 2024-09-17T02:22:10.712 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:10.704971+0000", 2024-09-17T02:22:10.712 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0043127130000000001, 2024-09-17T02:22:10.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044227399999999997, 2024-09-17T02:22:10.712 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:10.712 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:10.712 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:10.712 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:10.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:10.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.704971+0000", 2024-09-17T02:22:10.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:10.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.704971+0000", 2024-09-17T02:22:10.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:10.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.704971+0000", 2024-09-17T02:22:10.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.89e-07 2024-09-17T02:22:10.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:10.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.704975+0000", 2024-09-17T02:22:10.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.692e-06 2024-09-17T02:22:10.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:10.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.704982+0000", 2024-09-17T02:22:10.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8430000000000004e-06 2024-09-17T02:22:10.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.704988+0000", 2024-09-17T02:22:10.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9989999999999997e-06 2024-09-17T02:22:10.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:10.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705767+0000", 2024-09-17T02:22:10.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00077920500000000005 2024-09-17T02:22:10.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:10.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705787+0000", 2024-09-17T02:22:10.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9868e-05 2024-09-17T02:22:10.715 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.715 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:10.716 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.716 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:201583 5.8 5:19b24694:::benchmark_data_smithi001_23533_object73466:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:10.716 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:10.705358+0000", 2024-09-17T02:22:10.716 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0039251449999999997, 2024-09-17T02:22:10.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040986149999999999, 2024-09-17T02:22:10.716 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:10.716 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:10.716 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:10.716 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:10.716 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:10.716 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.717 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 201583 2024-09-17T02:22:10.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.717 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:10.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:10.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705358+0000", 2024-09-17T02:22:10.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:10.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705358+0000", 2024-09-17T02:22:10.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:10.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705359+0000", 2024-09-17T02:22:10.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1999999999999998e-07 2024-09-17T02:22:10.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:10.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705363+0000", 2024-09-17T02:22:10.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.777e-06 2024-09-17T02:22:10.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:10.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705375+0000", 2024-09-17T02:22:10.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1897e-05 2024-09-17T02:22:10.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705381+0000", 2024-09-17T02:22:10.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4819999999999999e-06 2024-09-17T02:22:10.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:10.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705822+0000", 2024-09-17T02:22:10.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044032899999999999 2024-09-17T02:22:10.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:10.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705890+0000", 2024-09-17T02:22:10.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8029999999999997e-05 2024-09-17T02:22:10.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:10.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705950+0000", 2024-09-17T02:22:10.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0087999999999998e-05 2024-09-17T02:22:10.720 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.720 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:10.720 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.721 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:201584 5.7 5:eb657030:::benchmark_data_smithi001_23533_object73467:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:10.721 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:10.705406+0000", 2024-09-17T02:22:10.721 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0038768700000000001, 2024-09-17T02:22:10.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041259729999999998, 2024-09-17T02:22:10.721 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:10.721 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:10.721 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:10.721 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:10.721 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:10.721 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.721 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 201584 2024-09-17T02:22:10.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.721 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:10.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:10.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705406+0000", 2024-09-17T02:22:10.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:10.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705406+0000", 2024-09-17T02:22:10.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:10.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705407+0000", 2024-09-17T02:22:10.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6700000000000003e-07 2024-09-17T02:22:10.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:10.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705410+0000", 2024-09-17T02:22:10.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6819999999999999e-06 2024-09-17T02:22:10.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:10.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705421+0000", 2024-09-17T02:22:10.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0903e-05 2024-09-17T02:22:10.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705426+0000", 2024-09-17T02:22:10.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3800000000000002e-06 2024-09-17T02:22:10.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:10.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705518+0000", 2024-09-17T02:22:10.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2056000000000001e-05 2024-09-17T02:22:10.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:10.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705633+0000", 2024-09-17T02:22:10.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000114941 2024-09-17T02:22:10.725 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.725 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:10.725 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.725 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:201585 5.7 5:eba74bf1:::benchmark_data_smithi001_23533_object73468:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:10.725 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:10.705441+0000", 2024-09-17T02:22:10.725 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0038418229999999999, 2024-09-17T02:22:10.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041573290000000004, 2024-09-17T02:22:10.725 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:10.725 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:10.725 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:10.726 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:10.726 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:10.726 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.726 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 201585 2024-09-17T02:22:10.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.726 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:10.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:10.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705441+0000", 2024-09-17T02:22:10.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:10.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705441+0000", 2024-09-17T02:22:10.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:10.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705442+0000", 2024-09-17T02:22:10.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7800000000000002e-07 2024-09-17T02:22:10.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:10.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705444+0000", 2024-09-17T02:22:10.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2749999999999998e-06 2024-09-17T02:22:10.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:10.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705451+0000", 2024-09-17T02:22:10.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.238e-06 2024-09-17T02:22:10.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705456+0000", 2024-09-17T02:22:10.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.831e-06 2024-09-17T02:22:10.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:10.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.707634+0000", 2024-09-17T02:22:10.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021776819999999998 2024-09-17T02:22:10.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:10.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.707746+0000", 2024-09-17T02:22:10.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000112339 2024-09-17T02:22:10.729 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.729 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:10.729 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.729 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:201586 5.6 5:6b6ed53d:::benchmark_data_smithi001_23533_object73469:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:10.729 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:10.705462+0000", 2024-09-17T02:22:10.729 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.003820946, 2024-09-17T02:22:10.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042009710000000004, 2024-09-17T02:22:10.730 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:10.730 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:10.730 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:10.730 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:10.730 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:10.730 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.730 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 201586 2024-09-17T02:22:10.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.730 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:10.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:10.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705462+0000", 2024-09-17T02:22:10.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:10.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705462+0000", 2024-09-17T02:22:10.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:10.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705463+0000", 2024-09-17T02:22:10.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3299999999999998e-07 2024-09-17T02:22:10.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:10.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705465+0000", 2024-09-17T02:22:10.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0899999999999999e-06 2024-09-17T02:22:10.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:10.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705470+0000", 2024-09-17T02:22:10.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.507e-06 2024-09-17T02:22:10.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705474+0000", 2024-09-17T02:22:10.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1420000000000003e-06 2024-09-17T02:22:10.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705766+0000", 2024-09-17T02:22:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00029153700000000002 2024-09-17T02:22:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.705873+0000", 2024-09-17T02:22:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010732 2024-09-17T02:22:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:201587 5.4 e66/52 5:21c12943:::benchmark_data_smithi001_23533_object73470:head v 66'12417, mlcod=66'12414)", 2024-09-17T02:22:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:10.707534+0000", 2024-09-17T02:22:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0017493999999999999, 2024-09-17T02:22:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021950889999999999, 2024-09-17T02:22:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.707534+0000", 2024-09-17T02:22:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:10.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.707534+0000", 2024-09-17T02:22:10.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:10.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.707534+0000", 2024-09-17T02:22:10.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5400000000000001e-07 2024-09-17T02:22:10.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:10.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.707542+0000", 2024-09-17T02:22:10.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7729999999999999e-06 2024-09-17T02:22:10.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:10.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.707551+0000", 2024-09-17T02:22:10.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9830000000000002e-06 2024-09-17T02:22:10.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.707556+0000", 2024-09-17T02:22:10.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0549999999999999e-06 2024-09-17T02:22:10.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:10.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.707699+0000", 2024-09-17T02:22:10.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014237700000000001 2024-09-17T02:22:10.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:10.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.707715+0000", 2024-09-17T02:22:10.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6560000000000001e-05 2024-09-17T02:22:10.737 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.737 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:10.737 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.737 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:201590 5.b e66/51 5:d518319a:::benchmark_data_smithi001_23533_object73473:head v 66'12468, mlcod=66'12466)", 2024-09-17T02:22:10.737 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:10.707573+0000", 2024-09-17T02:22:10.737 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0017098440000000001, 2024-09-17T02:22:10.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022180250000000002, 2024-09-17T02:22:10.738 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:10.738 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:10.738 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:10.738 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:10.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:10.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.707573+0000", 2024-09-17T02:22:10.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:10.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.707573+0000", 2024-09-17T02:22:10.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:10.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.707574+0000", 2024-09-17T02:22:10.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8099999999999999e-07 2024-09-17T02:22:10.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:10.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.707578+0000", 2024-09-17T02:22:10.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0289999999999999e-06 2024-09-17T02:22:10.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:10.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.707584+0000", 2024-09-17T02:22:10.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6409999999999996e-06 2024-09-17T02:22:10.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.707589+0000", 2024-09-17T02:22:10.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5879999999999999e-06 2024-09-17T02:22:10.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:10.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.707634+0000", 2024-09-17T02:22:10.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5436999999999999e-05 2024-09-17T02:22:10.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:10.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.707653+0000", 2024-09-17T02:22:10.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8757999999999999e-05 2024-09-17T02:22:10.741 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.741 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:10.741 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.741 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:201591 5.a 5:53c1eb95:::benchmark_data_smithi001_23533_object73474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:10.741 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:10.707645+0000", 2024-09-17T02:22:10.741 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0016384399999999999, 2024-09-17T02:22:10.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022068489999999999, 2024-09-17T02:22:10.742 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:10.742 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:10.742 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:10.742 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:10.742 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:10.742 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.742 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 201591 2024-09-17T02:22:10.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.742 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:10.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:10.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.707645+0000", 2024-09-17T02:22:10.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:10.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.707645+0000", 2024-09-17T02:22:10.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:10.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.707646+0000", 2024-09-17T02:22:10.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.001e-06 2024-09-17T02:22:10.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:10.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.707652+0000", 2024-09-17T02:22:10.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2829999999999998e-06 2024-09-17T02:22:10.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:10.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.707661+0000", 2024-09-17T02:22:10.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5650000000000002e-06 2024-09-17T02:22:10.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.707668+0000", 2024-09-17T02:22:10.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0190000000000001e-06 2024-09-17T02:22:10.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:10.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.707730+0000", 2024-09-17T02:22:10.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2401000000000001e-05 2024-09-17T02:22:10.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:10.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.707817+0000", 2024-09-17T02:22:10.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6922999999999994e-05 2024-09-17T02:22:10.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:10.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.707889+0000", 2024-09-17T02:22:10.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1826e-05 2024-09-17T02:22:10.747 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.747 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:10.747 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.747 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:201592 5.a 5:56a05b6a:::benchmark_data_smithi001_23533_object73475:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:10.748 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:10.708027+0000", 2024-09-17T02:22:10.748 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0012557950000000001, 2024-09-17T02:22:10.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001899031, 2024-09-17T02:22:10.748 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:10.748 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:10.748 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:10.748 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:10.748 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:10.748 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.748 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 201592 2024-09-17T02:22:10.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.748 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:10.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:10.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.708027+0000", 2024-09-17T02:22:10.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:10.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.708027+0000", 2024-09-17T02:22:10.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:10.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.708028+0000", 2024-09-17T02:22:10.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0070000000000001e-06 2024-09-17T02:22:10.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:10.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.708034+0000", 2024-09-17T02:22:10.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1420000000000001e-06 2024-09-17T02:22:10.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:10.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.708045+0000", 2024-09-17T02:22:10.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1372000000000001e-05 2024-09-17T02:22:10.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.708053+0000", 2024-09-17T02:22:10.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.588e-06 2024-09-17T02:22:10.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:10.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.709780+0000", 2024-09-17T02:22:10.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001727646 2024-09-17T02:22:10.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:10.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.709885+0000", 2024-09-17T02:22:10.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105132 2024-09-17T02:22:10.751 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.751 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:10.751 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.752 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:201593 5.6 5:631cd469:::benchmark_data_smithi001_23533_object73476:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:10.752 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:10.708066+0000", 2024-09-17T02:22:10.752 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0012167790000000001, 2024-09-17T02:22:10.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001929612, 2024-09-17T02:22:10.752 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:10.752 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:10.752 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:10.752 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:10.752 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:10.752 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.752 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 201593 2024-09-17T02:22:10.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.753 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:10.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:10.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.708066+0000", 2024-09-17T02:22:10.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:10.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.708066+0000", 2024-09-17T02:22:10.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:10.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.708067+0000", 2024-09-17T02:22:10.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1099999999999996e-07 2024-09-17T02:22:10.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:10.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.708070+0000", 2024-09-17T02:22:10.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7190000000000001e-06 2024-09-17T02:22:10.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:10.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.708077+0000", 2024-09-17T02:22:10.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5639999999999999e-06 2024-09-17T02:22:10.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.708083+0000", 2024-09-17T02:22:10.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8560000000000003e-06 2024-09-17T02:22:10.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:10.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.708129+0000", 2024-09-17T02:22:10.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5697e-05 2024-09-17T02:22:10.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:10.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.708229+0000", 2024-09-17T02:22:10.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100331 2024-09-17T02:22:10.756 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.756 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:10.756 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.756 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:201589 5.4 e66/52 5:23201818:::benchmark_data_smithi001_23533_object73472:head v 66'12418, mlcod=66'12414)", 2024-09-17T02:22:10.756 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:10.708134+0000", 2024-09-17T02:22:10.756 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001149207, 2024-09-17T02:22:10.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019287970000000001, 2024-09-17T02:22:10.756 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:10.756 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:10.756 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:10.757 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:10.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:10.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.708134+0000", 2024-09-17T02:22:10.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:10.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.708134+0000", 2024-09-17T02:22:10.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:10.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.708135+0000", 2024-09-17T02:22:10.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7899999999999999e-07 2024-09-17T02:22:10.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:10.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.708139+0000", 2024-09-17T02:22:10.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2019999999999997e-06 2024-09-17T02:22:10.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:10.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.708147+0000", 2024-09-17T02:22:10.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6549999999999993e-06 2024-09-17T02:22:10.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.708154+0000", 2024-09-17T02:22:10.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1820000000000003e-06 2024-09-17T02:22:10.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:10.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.709238+0000", 2024-09-17T02:22:10.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001084114 2024-09-17T02:22:10.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:10.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.709258+0000", 2024-09-17T02:22:10.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0458e-05 2024-09-17T02:22:10.760 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.760 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:10.760 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.760 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:201595 5.7 5:e1a1ec02:::benchmark_data_smithi001_23533_object73478:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:10.760 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:10.708364+0000", 2024-09-17T02:22:10.760 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.000919427, 2024-09-17T02:22:10.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017625780000000001, 2024-09-17T02:22:10.760 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:10.760 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:10.760 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:10.760 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:10.761 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:10.761 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.761 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 201595 2024-09-17T02:22:10.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.761 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:10.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:10.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.708364+0000", 2024-09-17T02:22:10.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:10.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.708364+0000", 2024-09-17T02:22:10.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:10.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.708365+0000", 2024-09-17T02:22:10.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0800000000000004e-07 2024-09-17T02:22:10.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:10.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.708369+0000", 2024-09-17T02:22:10.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1609999999999996e-06 2024-09-17T02:22:10.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:10.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.708377+0000", 2024-09-17T02:22:10.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4659999999999999e-06 2024-09-17T02:22:10.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.708384+0000", 2024-09-17T02:22:10.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4350000000000002e-06 2024-09-17T02:22:10.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:10.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.709696+0000", 2024-09-17T02:22:10.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013120510000000001 2024-09-17T02:22:10.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:10.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.709763+0000", 2024-09-17T02:22:10.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7317999999999995e-05 2024-09-17T02:22:10.764 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.764 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:10.764 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.764 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:201594 5.4 e66/52)", 2024-09-17T02:22:10.764 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:10.709493+0000", 2024-09-17T02:22:10.764 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9997902, 2024-09-17T02:22:10.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00069707799999999996, 2024-09-17T02:22:10.765 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:10.765 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:10.765 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:10.765 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:10.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:10.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.709493+0000", 2024-09-17T02:22:10.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:10.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.709493+0000", 2024-09-17T02:22:10.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:10.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.709494+0000", 2024-09-17T02:22:10.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0900000000000001e-07 2024-09-17T02:22:10.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:10.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.709498+0000", 2024-09-17T02:22:10.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.797e-06 2024-09-17T02:22:10.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:10.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.709507+0000", 2024-09-17T02:22:10.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9060000000000008e-06 2024-09-17T02:22:10.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.709513+0000", 2024-09-17T02:22:10.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8069999999999996e-06 2024-09-17T02:22:10.767 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.767 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:10.767 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.767 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:201596 5.0 5:0bf21edf:::benchmark_data_smithi001_23533_object73479:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:10.767 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:10.710030+0000", 2024-09-17T02:22:10.768 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9992533, 2024-09-17T02:22:10.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021319500000000001, 2024-09-17T02:22:10.768 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:10.768 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:10.768 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-17T02:22:10.768 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:10.768 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:10.768 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:10.768 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 201596 2024-09-17T02:22:10.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.768 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:10.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:10.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.710030+0000", 2024-09-17T02:22:10.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:10.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.710030+0000", 2024-09-17T02:22:10.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:10.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.710031+0000", 2024-09-17T02:22:10.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0669999999999999e-06 2024-09-17T02:22:10.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:10.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.710036+0000", 2024-09-17T02:22:10.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6970000000000001e-06 2024-09-17T02:22:10.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:10.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.710045+0000", 2024-09-17T02:22:10.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2830000000000007e-06 2024-09-17T02:22:10.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.710053+0000", 2024-09-17T02:22:10.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2330000000000006e-06 2024-09-17T02:22:10.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:10.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.710164+0000", 2024-09-17T02:22:10.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000110321 2024-09-17T02:22:10.771 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.771 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:10.771 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.771 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4466.0:201583 5.8 e66/26)", 2024-09-17T02:22:10.771 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:10.710187+0000", 2024-09-17T02:22:10.771 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9990959, 2024-09-17T02:22:10.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000116097, 2024-09-17T02:22:10.772 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:10.772 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:10.772 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:10.772 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:10.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:10.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.710187+0000", 2024-09-17T02:22:10.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:10.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.710187+0000", 2024-09-17T02:22:10.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:10.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.710188+0000", 2024-09-17T02:22:10.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4200000000000001e-07 2024-09-17T02:22:10.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:10.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.710191+0000", 2024-09-17T02:22:10.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-06 2024-09-17T02:22:10.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:10.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.710200+0000", 2024-09-17T02:22:10.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5969999999999992e-06 2024-09-17T02:22:10.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.710205+0000", 2024-09-17T02:22:10.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7350000000000001e-06 2024-09-17T02:22:10.774 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.774 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:10.774 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.774 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4466.0:201591 5.a e66/22)", 2024-09-17T02:22:10.775 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:10.710305+0000", 2024-09-17T02:22:10.775 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9989781, 2024-09-17T02:22:10.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4116000000000002e-05, 2024-09-17T02:22:10.775 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:10.775 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:10.775 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:10.775 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:10.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:10.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.710305+0000", 2024-09-17T02:22:10.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:10.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.710305+0000", 2024-09-17T02:22:10.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:10.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:10.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.710306+0000", 2024-09-17T02:22:10.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3000000000000001e-07 2024-09-17T02:22:10.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:10.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.710309+0000", 2024-09-17T02:22:10.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3139999999999999e-06 2024-09-17T02:22:10.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:10.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.710318+0000", 2024-09-17T02:22:10.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6319999999999997e-06 2024-09-17T02:22:10.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:10.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:10.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:10.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:10.710323+0000", 2024-09-17T02:22:10.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6629999999999998e-06 2024-09-17T02:22:10.777 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.777 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:10.777 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.777 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:10.777 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:22:10.777 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 17 2024-09-17T02:22:10.778 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:10.779 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:10.779 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:10.780+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:10.880 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:10.879+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:10.969 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:10.969 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:22:10.969 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:22:10.969 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:22:10.969 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:10.980 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:10.979+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:10.987 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:11.081 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:11.084+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:11.101 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T02:22:11.136 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:22:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:22:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:22:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:22:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 88.569359778000006, 2024-09-17T02:22:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:22:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:22:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:22:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:22:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:22:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:22:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:22:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:22:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:22:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:22:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:22:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:22:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:22:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:22:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:22:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:22:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:22:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:22:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:22:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:22:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:22:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:22:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:22:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:22:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:22:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 88.565457527999996, 2024-09-17T02:22:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:22:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:22:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:22:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:22:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:22:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:22:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:22:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:22:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:22:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:22:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:22:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:22:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:22:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:22:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:22:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:22:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:22:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:22:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:22:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:22:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:22:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:22:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:22:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:22:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97759 5.a 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.539437704999997, 2024-09-17T02:22:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.089694871999999995, 2024-09-17T02:22:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97759 2024-09-17T02:22:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598386+0000", 2024-09-17T02:22:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999999e-07 2024-09-17T02:22:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598414+0000", 2024-09-17T02:22:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8013000000000001e-05 2024-09-17T02:22:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598420+0000", 2024-09-17T02:22:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1149999999999999e-06 2024-09-17T02:22:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598424+0000", 2024-09-17T02:22:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:22:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598479+0000", 2024-09-17T02:22:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4648999999999998e-05 2024-09-17T02:22:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598587+0000", 2024-09-17T02:22:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010853000000000001 2024-09-17T02:22:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598676+0000", 2024-09-17T02:22:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8381999999999995e-05 2024-09-17T02:22:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603766+0000", 2024-09-17T02:22:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050902559999999996 2024-09-17T02:22:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.687988+0000", 2024-09-17T02:22:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.084221753999999996 2024-09-17T02:22:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688037+0000", 2024-09-17T02:22:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-05 2024-09-17T02:22:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688080+0000", 2024-09-17T02:22:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3149999999999999e-05 2024-09-17T02:22:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97770 5.0 5:09c75033:::benchmark_data_smithi001_23533_object97769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.534295274999998, 2024-09-17T02:22:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.086380868, 2024-09-17T02:22:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97770 2024-09-17T02:22:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603529+0000", 2024-09-17T02:22:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:22:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603593+0000", 2024-09-17T02:22:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4216999999999999e-05 2024-09-17T02:22:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603603+0000", 2024-09-17T02:22:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5179999999999993e-06 2024-09-17T02:22:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603608+0000", 2024-09-17T02:22:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2039999999999996e-06 2024-09-17T02:22:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603653+0000", 2024-09-17T02:22:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5247000000000002e-05 2024-09-17T02:22:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603758+0000", 2024-09-17T02:22:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105352 2024-09-17T02:22:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603900+0000", 2024-09-17T02:22:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014198999999999999 2024-09-17T02:22:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.606097+0000", 2024-09-17T02:22:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021969839999999999 2024-09-17T02:22:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689756+0000", 2024-09-17T02:22:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.083659077999999998 2024-09-17T02:22:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689846+0000", 2024-09-17T02:22:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9320999999999994e-05 2024-09-17T02:22:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689908+0000", 2024-09-17T02:22:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720999999999998e-05 2024-09-17T02:22:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127513 5.c 5:3eca08e4:::benchmark_data_smithi001_23533_object127512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 38.693518851, 2024-09-17T02:22:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046626399999999998, 2024-09-17T02:22:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127513 2024-09-17T02:22:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444305+0000", 2024-09-17T02:22:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2529999999999999e-06 2024-09-17T02:22:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444466+0000", 2024-09-17T02:22:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016069700000000001 2024-09-17T02:22:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444479+0000", 2024-09-17T02:22:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2602999999999999e-05 2024-09-17T02:22:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444485+0000", 2024-09-17T02:22:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.669e-06 2024-09-17T02:22:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444560+0000", 2024-09-17T02:22:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4276999999999994e-05 2024-09-17T02:22:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444656+0000", 2024-09-17T02:22:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6490000000000006e-05 2024-09-17T02:22:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444739+0000", 2024-09-17T02:22:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3139999999999993e-05 2024-09-17T02:22:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.448438+0000", 2024-09-17T02:22:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036985490000000002 2024-09-17T02:22:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490732+0000", 2024-09-17T02:22:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042294353999999999 2024-09-17T02:22:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490859+0000", 2024-09-17T02:22:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012708899999999999 2024-09-17T02:22:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490930+0000", 2024-09-17T02:22:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127514 5.c 5:39cc1feb:::benchmark_data_smithi001_23533_object127513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 38.693322082000002, 2024-09-17T02:22:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049357228000000003, 2024-09-17T02:22:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127514 2024-09-17T02:22:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8599999999999998e-07 2024-09-17T02:22:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444554+0000", 2024-09-17T02:22:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3047999999999998e-05 2024-09-17T02:22:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444562+0000", 2024-09-17T02:22:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5830000000000001e-06 2024-09-17T02:22:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444567+0000", 2024-09-17T02:22:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4179999999999996e-06 2024-09-17T02:22:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446566+0000", 2024-09-17T02:22:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001998788 2024-09-17T02:22:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446696+0000", 2024-09-17T02:22:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129393 2024-09-17T02:22:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446794+0000", 2024-09-17T02:22:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8462999999999996e-05 2024-09-17T02:22:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.449036+0000", 2024-09-17T02:22:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022415880000000001 2024-09-17T02:22:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493737+0000", 2024-09-17T02:22:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044701682 2024-09-17T02:22:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493808+0000", 2024-09-17T02:22:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0846000000000006e-05 2024-09-17T02:22:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493858+0000", 2024-09-17T02:22:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9932999999999998e-05 2024-09-17T02:22:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129441 5.1 5:84c3199f:::benchmark_data_smithi001_23533_object1324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 35.634311594000003, 2024-09-17T02:22:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034387011000000002, 2024-09-17T02:22:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129441 2024-09-17T02:22:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503513+0000", 2024-09-17T02:22:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4759999999999999e-06 2024-09-17T02:22:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503518+0000", 2024-09-17T02:22:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-09-17T02:22:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503532+0000", 2024-09-17T02:22:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4049999999999999e-05 2024-09-17T02:22:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503541+0000", 2024-09-17T02:22:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5320000000000006e-06 2024-09-17T02:22:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506331+0000", 2024-09-17T02:22:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027899190000000001 2024-09-17T02:22:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506402+0000", 2024-09-17T02:22:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506477+0000", 2024-09-17T02:22:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4626e-05 2024-09-17T02:22:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509749+0000", 2024-09-17T02:22:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032726980000000001 2024-09-17T02:22:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537758+0000", 2024-09-17T02:22:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028008890000000002 2024-09-17T02:22:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537812+0000", 2024-09-17T02:22:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3300000000000001e-05 2024-09-17T02:22:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537898+0000", 2024-09-17T02:22:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6691000000000001e-05 2024-09-17T02:22:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129442 5.1 5:8f7f2a95:::benchmark_data_smithi001_23533_object1325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 35.631340985000001, 2024-09-17T02:22:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031546698999999997, 2024-09-17T02:22:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129442 2024-09-17T02:22:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:11.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:11.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:11.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:11.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:11.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:11.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506483+0000", 2024-09-17T02:22:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2869999999999999e-06 2024-09-17T02:22:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506489+0000", 2024-09-17T02:22:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2330000000000003e-06 2024-09-17T02:22:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506502+0000", 2024-09-17T02:22:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2286999999999999e-05 2024-09-17T02:22:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506511+0000", 2024-09-17T02:22:11.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7799999999999995e-06 2024-09-17T02:22:11.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:11.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.507966+0000", 2024-09-17T02:22:11.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014541549999999999 2024-09-17T02:22:11.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:11.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508130+0000", 2024-09-17T02:22:11.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016455199999999999 2024-09-17T02:22:11.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508287+0000", 2024-09-17T02:22:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015730400000000001 2024-09-17T02:22:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510577+0000", 2024-09-17T02:22:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022899449999999998 2024-09-17T02:22:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537932+0000", 2024-09-17T02:22:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027354471000000002 2024-09-17T02:22:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537964+0000", 2024-09-17T02:22:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1909999999999998e-05 2024-09-17T02:22:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.538029+0000", 2024-09-17T02:22:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4775000000000002e-05 2024-09-17T02:22:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:150458 5.a 5:59b62890:::benchmark_data_smithi001_23533_object22341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:22:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.299497177999999, 2024-09-17T02:22:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028150173000000001, 2024-09-17T02:22:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 150458 2024-09-17T02:22:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7800000000000002e-07 2024-09-17T02:22:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838328+0000", 2024-09-17T02:22:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.838e-06 2024-09-17T02:22:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838335+0000", 2024-09-17T02:22:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1999999999999997e-06 2024-09-17T02:22:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838340+0000", 2024-09-17T02:22:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7389999999999999e-06 2024-09-17T02:22:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849082+0000", 2024-09-17T02:22:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01074174 2024-09-17T02:22:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849192+0000", 2024-09-17T02:22:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011040300000000001 2024-09-17T02:22:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849297+0000", 2024-09-17T02:22:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104764 2024-09-17T02:22:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.857853+0000", 2024-09-17T02:22:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085558490000000008 2024-09-17T02:22:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866430+0000", 2024-09-17T02:22:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085768140000000003 2024-09-17T02:22:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866454+0000", 2024-09-17T02:22:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4428000000000001e-05 2024-09-17T02:22:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866476+0000", 2024-09-17T02:22:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.192e-05 2024-09-17T02:22:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190780 5.3 e65/64 5:c634f18a:::benchmark_data_smithi001_23533_object62663:head v 65'12039, mlcod=0'0)", 2024-09-17T02:22:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.182278+0000", 2024-09-17T02:22:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.9555450890000001, 2024-09-17T02:22:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028943393000000001, 2024-09-17T02:22:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182278+0000", 2024-09-17T02:22:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182278+0000", 2024-09-17T02:22:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182280+0000", 2024-09-17T02:22:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.736e-06 2024-09-17T02:22:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182291+0000", 2024-09-17T02:22:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1933000000000001e-05 2024-09-17T02:22:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182317+0000", 2024-09-17T02:22:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6024999999999999e-05 2024-09-17T02:22:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182332+0000", 2024-09-17T02:22:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4856e-05 2024-09-17T02:22:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182463+0000", 2024-09-17T02:22:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130674 2024-09-17T02:22:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182533+0000", 2024-09-17T02:22:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0296999999999995e-05 2024-09-17T02:22:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211153+0000", 2024-09-17T02:22:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028619265000000001 2024-09-17T02:22:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211221+0000", 2024-09-17T02:22:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8607000000000002e-05 2024-09-17T02:22:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190799 5.3 e65/64 5:c0e8780b:::benchmark_data_smithi001_23533_object62682:head v 65'12040, mlcod=0'0)", 2024-09-17T02:22:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.193849+0000", 2024-09-17T02:22:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.9439737370000003, 2024-09-17T02:22:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02989934, 2024-09-17T02:22:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193849+0000", 2024-09-17T02:22:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193849+0000", 2024-09-17T02:22:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193851+0000", 2024-09-17T02:22:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.137e-06 2024-09-17T02:22:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193865+0000", 2024-09-17T02:22:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3845999999999999e-05 2024-09-17T02:22:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193888+0000", 2024-09-17T02:22:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3312e-05 2024-09-17T02:22:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193901+0000", 2024-09-17T02:22:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2896e-05 2024-09-17T02:22:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.204084+0000", 2024-09-17T02:22:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010182538 2024-09-17T02:22:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.204126+0000", 2024-09-17T02:22:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1828e-05 2024-09-17T02:22:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223688+0000", 2024-09-17T02:22:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019562408999999999 2024-09-17T02:22:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223748+0000", 2024-09-17T02:22:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0374000000000002e-05 2024-09-17T02:22:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190836 5.3 e65/64 5:c72f74ff:::benchmark_data_smithi001_23533_object62719:head v 65'12042, mlcod=0'0)", 2024-09-17T02:22:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.198478+0000", 2024-09-17T02:22:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.9393448449999999, 2024-09-17T02:22:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031214246000000001, 2024-09-17T02:22:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198478+0000", 2024-09-17T02:22:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198478+0000", 2024-09-17T02:22:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198480+0000", 2024-09-17T02:22:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0899999999999999e-06 2024-09-17T02:22:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198494+0000", 2024-09-17T02:22:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3572e-05 2024-09-17T02:22:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198521+0000", 2024-09-17T02:22:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7178999999999998e-05 2024-09-17T02:22:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198533+0000", 2024-09-17T02:22:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2588999999999999e-05 2024-09-17T02:22:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208944+0000", 2024-09-17T02:22:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010410236 2024-09-17T02:22:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208979+0000", 2024-09-17T02:22:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5555000000000001e-05 2024-09-17T02:22:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229627+0000", 2024-09-17T02:22:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020647993999999999 2024-09-17T02:22:11.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:11.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229692+0000", 2024-09-17T02:22:11.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5030999999999995e-05 2024-09-17T02:22:11.208 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.208 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:11.208 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.208 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190852 5.3 e65/64 5:c63de204:::benchmark_data_smithi001_23533_object62735:head v 65'12043, mlcod=0'0)", 2024-09-17T02:22:11.208 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.200082+0000", 2024-09-17T02:22:11.208 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.9377408469999997, 2024-09-17T02:22:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029657795000000001, 2024-09-17T02:22:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200082+0000", 2024-09-17T02:22:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200082+0000", 2024-09-17T02:22:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200084+0000", 2024-09-17T02:22:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1900000000000002e-06 2024-09-17T02:22:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200099+0000", 2024-09-17T02:22:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4392999999999999e-05 2024-09-17T02:22:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200122+0000", 2024-09-17T02:22:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3292e-05 2024-09-17T02:22:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200134+0000", 2024-09-17T02:22:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2489e-05 2024-09-17T02:22:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211322+0000", 2024-09-17T02:22:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011187689000000001 2024-09-17T02:22:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:11.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211383+0000", 2024-09-17T02:22:11.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0707e-05 2024-09-17T02:22:11.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:11.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229698+0000", 2024-09-17T02:22:11.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018315306999999999 2024-09-17T02:22:11.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:11.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229740+0000", 2024-09-17T02:22:11.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1727999999999998e-05 2024-09-17T02:22:11.212 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190887 5.3 e65/64 5:cc339b34:::benchmark_data_smithi001_23533_object62770:head v 65'12044, mlcod=0'0)", 2024-09-17T02:22:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.201631+0000", 2024-09-17T02:22:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.9361914989999995, 2024-09-17T02:22:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028149121999999999, 2024-09-17T02:22:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:11.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:11.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201631+0000", 2024-09-17T02:22:11.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:11.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201631+0000", 2024-09-17T02:22:11.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:11.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201634+0000", 2024-09-17T02:22:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1629999999999999e-06 2024-09-17T02:22:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201647+0000", 2024-09-17T02:22:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3943e-05 2024-09-17T02:22:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201690+0000", 2024-09-17T02:22:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2660999999999997e-05 2024-09-17T02:22:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201707+0000", 2024-09-17T02:22:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.647e-05 2024-09-17T02:22:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.213560+0000", 2024-09-17T02:22:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011852945 2024-09-17T02:22:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.213617+0000", 2024-09-17T02:22:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7170999999999999e-05 2024-09-17T02:22:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229744+0000", 2024-09-17T02:22:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016127617 2024-09-17T02:22:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229781+0000", 2024-09-17T02:22:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6152000000000002e-05 2024-09-17T02:22:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.218 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190920 5.3 e65/64 5:c7bc6082:::benchmark_data_smithi001_23533_object62803:head v 65'12047, mlcod=0'0)", 2024-09-17T02:22:11.218 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.206674+0000", 2024-09-17T02:22:11.218 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.9311488709999995, 2024-09-17T02:22:11.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.033826457999999997, 2024-09-17T02:22:11.218 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:11.218 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:11.218 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.218 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:11.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:11.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206674+0000", 2024-09-17T02:22:11.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206674+0000", 2024-09-17T02:22:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206676+0000", 2024-09-17T02:22:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.646e-06 2024-09-17T02:22:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206689+0000", 2024-09-17T02:22:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3196999999999999e-05 2024-09-17T02:22:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206718+0000", 2024-09-17T02:22:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8988000000000001e-05 2024-09-17T02:22:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206736+0000", 2024-09-17T02:22:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8221999999999999e-05 2024-09-17T02:22:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.221517+0000", 2024-09-17T02:22:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014781247000000001 2024-09-17T02:22:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.221563+0000", 2024-09-17T02:22:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5343999999999998e-05 2024-09-17T02:22:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240391+0000", 2024-09-17T02:22:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018828693000000001 2024-09-17T02:22:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240500+0000", 2024-09-17T02:22:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109121 2024-09-17T02:22:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190947 5.3 e65/64 5:ca95b398:::benchmark_data_smithi001_23533_object62830:head v 65'12048, mlcod=0'0)", 2024-09-17T02:22:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.208183+0000", 2024-09-17T02:22:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.9296395180000001, 2024-09-17T02:22:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032404800999999997, 2024-09-17T02:22:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:11.223 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.223 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:11.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:11.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208183+0000", 2024-09-17T02:22:11.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:11.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208183+0000", 2024-09-17T02:22:11.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208185+0000", 2024-09-17T02:22:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.64e-06 2024-09-17T02:22:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208197+0000", 2024-09-17T02:22:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1589e-05 2024-09-17T02:22:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208217+0000", 2024-09-17T02:22:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0242e-05 2024-09-17T02:22:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208227+0000", 2024-09-17T02:22:11.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0256e-05 2024-09-17T02:22:11.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:11.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223908+0000", 2024-09-17T02:22:11.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015680726999999998 2024-09-17T02:22:11.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:11.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223969+0000", 2024-09-17T02:22:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1277000000000003e-05 2024-09-17T02:22:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240509+0000", 2024-09-17T02:22:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016539484 2024-09-17T02:22:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240588+0000", 2024-09-17T02:22:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9585999999999993e-05 2024-09-17T02:22:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190958 5.3 e65/64 5:c9337cc4:::benchmark_data_smithi001_23533_object62841:head v 65'12049, mlcod=0'0)", 2024-09-17T02:22:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.209746+0000", 2024-09-17T02:22:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.928077171, 2024-09-17T02:22:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030921212999999999, 2024-09-17T02:22:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209746+0000", 2024-09-17T02:22:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:11.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209746+0000", 2024-09-17T02:22:11.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:11.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209748+0000", 2024-09-17T02:22:11.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9989999999999998e-06 2024-09-17T02:22:11.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:11.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209761+0000", 2024-09-17T02:22:11.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3317e-05 2024-09-17T02:22:11.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:11.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209786+0000", 2024-09-17T02:22:11.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4941999999999999e-05 2024-09-17T02:22:11.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209799+0000", 2024-09-17T02:22:11.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2556e-05 2024-09-17T02:22:11.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:11.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.226753+0000", 2024-09-17T02:22:11.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016954100999999999 2024-09-17T02:22:11.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:11.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.226810+0000", 2024-09-17T02:22:11.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7207000000000003e-05 2024-09-17T02:22:11.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:11.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240599+0000", 2024-09-17T02:22:11.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013789228000000001 2024-09-17T02:22:11.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:11.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240667+0000", 2024-09-17T02:22:11.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7862999999999997e-05 2024-09-17T02:22:11.231 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.231 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:11.231 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.231 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:191023 5.3 e65/64 5:cfca4af2:::benchmark_data_smithi001_23533_object62906:head v 65'12050, mlcod=0'0)", 2024-09-17T02:22:11.231 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.210919+0000", 2024-09-17T02:22:11.231 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.9269038150000002, 2024-09-17T02:22:11.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029830820000000001, 2024-09-17T02:22:11.232 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:11.232 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:11.232 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.232 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:11.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:11.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210919+0000", 2024-09-17T02:22:11.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:11.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210919+0000", 2024-09-17T02:22:11.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:11.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210921+0000", 2024-09-17T02:22:11.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-09-17T02:22:11.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:11.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210935+0000", 2024-09-17T02:22:11.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3436e-05 2024-09-17T02:22:11.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:11.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210961+0000", 2024-09-17T02:22:11.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6767999999999999e-05 2024-09-17T02:22:11.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210974+0000", 2024-09-17T02:22:11.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2904e-05 2024-09-17T02:22:11.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:11.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229967+0000", 2024-09-17T02:22:11.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018992774 2024-09-17T02:22:11.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.230023+0000", 2024-09-17T02:22:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6334e-05 2024-09-17T02:22:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240673+0000", 2024-09-17T02:22:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010649908 2024-09-17T02:22:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240750+0000", 2024-09-17T02:22:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6556000000000004e-05 2024-09-17T02:22:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:11.236 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.236 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:191048 5.3 e65/64 5:c4115f14:::benchmark_data_smithi001_23533_object62931:head v 65'12051, mlcod=0'0)", 2024-09-17T02:22:11.236 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.211763+0000", 2024-09-17T02:22:11.236 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.9260598929999997, 2024-09-17T02:22:11.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029064577000000001, 2024-09-17T02:22:11.236 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:11.236 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:11.236 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.236 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:11.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:11.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211763+0000", 2024-09-17T02:22:11.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:11.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211763+0000", 2024-09-17T02:22:11.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:11.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211765+0000", 2024-09-17T02:22:11.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.717e-06 2024-09-17T02:22:11.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:11.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211776+0000", 2024-09-17T02:22:11.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1358999999999999e-05 2024-09-17T02:22:11.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:11.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211806+0000", 2024-09-17T02:22:11.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9924999999999999e-05 2024-09-17T02:22:11.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211824+0000", 2024-09-17T02:22:11.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7782999999999999e-05 2024-09-17T02:22:11.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:11.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.232521+0000", 2024-09-17T02:22:11.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020696902 2024-09-17T02:22:11.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:11.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.232574+0000", 2024-09-17T02:22:11.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3044000000000002e-05 2024-09-17T02:22:11.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:11.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240757+0000", 2024-09-17T02:22:11.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081828579999999995 2024-09-17T02:22:11.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:11.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240828+0000", 2024-09-17T02:22:11.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0988999999999994e-05 2024-09-17T02:22:11.240 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.240 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:11.240 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.240 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:191114 5.3 e65/64 5:c2a7e5a9:::benchmark_data_smithi001_23533_object62997:head v 65'12054, mlcod=63'12038)", 2024-09-17T02:22:11.240 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.217495+0000", 2024-09-17T02:22:11.240 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.920328262, 2024-09-17T02:22:11.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029944788, 2024-09-17T02:22:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217495+0000", 2024-09-17T02:22:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217495+0000", 2024-09-17T02:22:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:11.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217496+0000", 2024-09-17T02:22:11.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.46e-06 2024-09-17T02:22:11.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:11.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217508+0000", 2024-09-17T02:22:11.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2157000000000001e-05 2024-09-17T02:22:11.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:11.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217535+0000", 2024-09-17T02:22:11.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7058000000000001e-05 2024-09-17T02:22:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217551+0000", 2024-09-17T02:22:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5709000000000002e-05 2024-09-17T02:22:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.241029+0000", 2024-09-17T02:22:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023478452 2024-09-17T02:22:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.241078+0000", 2024-09-17T02:22:11.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8068000000000001e-05 2024-09-17T02:22:11.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:11.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.247369+0000", 2024-09-17T02:22:11.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0062912740000000003 2024-09-17T02:22:11.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:11.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:11.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:11.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.247439+0000", 2024-09-17T02:22:11.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0610000000000003e-05 2024-09-17T02:22:11.244 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.244 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:11.244 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.245 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:11.245 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:11.245 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:11.246 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:11.247 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:11.247+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:11.346 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:11.347+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:11.398 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:11.398 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:22:11.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.398 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:203217 5.a e66/22 5:5f4259c0:::benchmark_data_smithi001_23533_object75100:head v 66'12839, mlcod=66'12837)", 2024-09-17T02:22:11.398 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:11.395932+0000", 2024-09-17T02:22:11.399 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0046889030000000003, 2024-09-17T02:22:11.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004709464, 2024-09-17T02:22:11.399 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.399 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.399 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:11.399 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.395932+0000", 2024-09-17T02:22:11.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.395932+0000", 2024-09-17T02:22:11.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.395932+0000", 2024-09-17T02:22:11.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.17e-07 2024-09-17T02:22:11.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.395936+0000", 2024-09-17T02:22:11.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.454e-06 2024-09-17T02:22:11.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.395942+0000", 2024-09-17T02:22:11.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.947e-06 2024-09-17T02:22:11.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.395947+0000", 2024-09-17T02:22:11.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9840000000000001e-06 2024-09-17T02:22:11.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.395996+0000", 2024-09-17T02:22:11.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8464999999999998e-05 2024-09-17T02:22:11.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396016+0000", 2024-09-17T02:22:11.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0000000000000002e-05 2024-09-17T02:22:11.402 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.402 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.402 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.402 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:203218 5.0 e66/26 5:02a86ff1:::benchmark_data_smithi001_23533_object75101:head v 66'12693, mlcod=66'12691)", 2024-09-17T02:22:11.402 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:11.396020+0000", 2024-09-17T02:22:11.402 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0046003060000000002, 2024-09-17T02:22:11.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046746920000000003, 2024-09-17T02:22:11.403 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.403 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.403 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:11.403 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396020+0000", 2024-09-17T02:22:11.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396020+0000", 2024-09-17T02:22:11.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396021+0000", 2024-09-17T02:22:11.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5499999999999999e-07 2024-09-17T02:22:11.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396024+0000", 2024-09-17T02:22:11.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7349999999999998e-06 2024-09-17T02:22:11.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396031+0000", 2024-09-17T02:22:11.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2570000000000004e-06 2024-09-17T02:22:11.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396035+0000", 2024-09-17T02:22:11.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9559999999999996e-06 2024-09-17T02:22:11.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396118+0000", 2024-09-17T02:22:11.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2985999999999995e-05 2024-09-17T02:22:11.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396136+0000", 2024-09-17T02:22:11.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7561e-05 2024-09-17T02:22:11.406 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.406 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.406 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.406 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:203219 5.4 5:20183f2a:::benchmark_data_smithi001_23533_object75102:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:11.406 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:11.396103+0000", 2024-09-17T02:22:11.406 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0045178459999999998, 2024-09-17T02:22:11.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046505649999999997, 2024-09-17T02:22:11.407 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.407 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.407 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:11.407 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.407 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.407 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.407 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 203219 2024-09-17T02:22:11.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.407 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396103+0000", 2024-09-17T02:22:11.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396103+0000", 2024-09-17T02:22:11.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396104+0000", 2024-09-17T02:22:11.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8100000000000001e-07 2024-09-17T02:22:11.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396108+0000", 2024-09-17T02:22:11.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.775e-06 2024-09-17T02:22:11.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396119+0000", 2024-09-17T02:22:11.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0360000000000001e-05 2024-09-17T02:22:11.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396125+0000", 2024-09-17T02:22:11.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5710000000000003e-06 2024-09-17T02:22:11.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396245+0000", 2024-09-17T02:22:11.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000119354 2024-09-17T02:22:11.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396367+0000", 2024-09-17T02:22:11.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012226500000000001 2024-09-17T02:22:11.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:11.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398586+0000", 2024-09-17T02:22:11.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022192850000000001 2024-09-17T02:22:11.410 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.411 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.411 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.411 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:203221 5.9 5:98d8ee34:::benchmark_data_smithi001_23533_object75104:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:11.411 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:11.396323+0000", 2024-09-17T02:22:11.411 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0042978579999999999, 2024-09-17T02:22:11.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045131540000000001, 2024-09-17T02:22:11.411 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.411 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.411 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:11.411 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.411 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.411 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.411 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 203221 2024-09-17T02:22:11.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.412 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396323+0000", 2024-09-17T02:22:11.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396323+0000", 2024-09-17T02:22:11.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396323+0000", 2024-09-17T02:22:11.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6599999999999996e-07 2024-09-17T02:22:11.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396327+0000", 2024-09-17T02:22:11.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4429999999999999e-06 2024-09-17T02:22:11.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396335+0000", 2024-09-17T02:22:11.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7179999999999996e-06 2024-09-17T02:22:11.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396339+0000", 2024-09-17T02:22:11.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.527e-06 2024-09-17T02:22:11.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396386+0000", 2024-09-17T02:22:11.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7222999999999998e-05 2024-09-17T02:22:11.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396482+0000", 2024-09-17T02:22:11.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5284000000000005e-05 2024-09-17T02:22:11.415 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.415 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.415 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.415 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:203222 5.f 5:f4125364:::benchmark_data_smithi001_23533_object75105:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:11.415 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:11.396351+0000", 2024-09-17T02:22:11.415 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0042692750000000003, 2024-09-17T02:22:11.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045604210000000003, 2024-09-17T02:22:11.415 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.416 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.416 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:11.416 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.416 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.416 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.416 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 203222 2024-09-17T02:22:11.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.416 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396351+0000", 2024-09-17T02:22:11.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396351+0000", 2024-09-17T02:22:11.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396352+0000", 2024-09-17T02:22:11.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4299999999999998e-07 2024-09-17T02:22:11.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396354+0000", 2024-09-17T02:22:11.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.418e-06 2024-09-17T02:22:11.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396361+0000", 2024-09-17T02:22:11.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1489999999999997e-06 2024-09-17T02:22:11.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396367+0000", 2024-09-17T02:22:11.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4199999999999998e-06 2024-09-17T02:22:11.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396416+0000", 2024-09-17T02:22:11.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9543999999999999e-05 2024-09-17T02:22:11.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396522+0000", 2024-09-17T02:22:11.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106005 2024-09-17T02:22:11.419 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.419 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.419 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.419 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:203224 5.d 5:bfe22697:::benchmark_data_smithi001_23533_object75107:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:11.419 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:11.396386+0000", 2024-09-17T02:22:11.419 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0042345550000000001, 2024-09-17T02:22:11.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045983179999999997, 2024-09-17T02:22:11.420 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.420 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.420 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:11.420 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.420 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.420 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.420 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 203224 2024-09-17T02:22:11.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.420 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396386+0000", 2024-09-17T02:22:11.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396386+0000", 2024-09-17T02:22:11.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396386+0000", 2024-09-17T02:22:11.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5200000000000002e-07 2024-09-17T02:22:11.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396389+0000", 2024-09-17T02:22:11.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.711e-06 2024-09-17T02:22:11.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396396+0000", 2024-09-17T02:22:11.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8669999999999996e-06 2024-09-17T02:22:11.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396402+0000", 2024-09-17T02:22:11.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7599999999999999e-06 2024-09-17T02:22:11.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396457+0000", 2024-09-17T02:22:11.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5146999999999999e-05 2024-09-17T02:22:11.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396577+0000", 2024-09-17T02:22:11.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000119726 2024-09-17T02:22:11.423 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.423 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.423 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.423 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:203225 5.d 5:bd41fb8f:::benchmark_data_smithi001_23533_object75108:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:11.424 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:11.396418+0000", 2024-09-17T02:22:11.424 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0042023859999999998, 2024-09-17T02:22:11.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046545889999999998, 2024-09-17T02:22:11.424 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.424 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.424 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:11.424 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.424 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.424 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.424 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 203225 2024-09-17T02:22:11.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.424 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396418+0000", 2024-09-17T02:22:11.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396418+0000", 2024-09-17T02:22:11.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396419+0000", 2024-09-17T02:22:11.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9999999999999998e-07 2024-09-17T02:22:11.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396421+0000", 2024-09-17T02:22:11.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.362e-06 2024-09-17T02:22:11.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396428+0000", 2024-09-17T02:22:11.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1389999999999998e-06 2024-09-17T02:22:11.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.396433+0000", 2024-09-17T02:22:11.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0499999999999999e-06 2024-09-17T02:22:11.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398536+0000", 2024-09-17T02:22:11.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021029299999999998 2024-09-17T02:22:11.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398662+0000", 2024-09-17T02:22:11.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000126277 2024-09-17T02:22:11.427 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.427 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.427 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.428 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:203228 5.b 5:d23c1fd9:::benchmark_data_smithi001_23533_object75111:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:11.428 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:11.398811+0000", 2024-09-17T02:22:11.428 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0018096119999999999, 2024-09-17T02:22:11.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023369139999999998, 2024-09-17T02:22:11.428 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.428 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.428 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:11.428 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.428 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.428 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.428 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 203228 2024-09-17T02:22:11.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.428 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398811+0000", 2024-09-17T02:22:11.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398811+0000", 2024-09-17T02:22:11.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398812+0000", 2024-09-17T02:22:11.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1800000000000005e-07 2024-09-17T02:22:11.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398814+0000", 2024-09-17T02:22:11.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6079999999999998e-06 2024-09-17T02:22:11.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398822+0000", 2024-09-17T02:22:11.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0770000000000008e-06 2024-09-17T02:22:11.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398827+0000", 2024-09-17T02:22:11.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9579999999999998e-06 2024-09-17T02:22:11.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398892+0000", 2024-09-17T02:22:11.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4320999999999996e-05 2024-09-17T02:22:11.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.399003+0000", 2024-09-17T02:22:11.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111229 2024-09-17T02:22:11.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:11.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.399116+0000", 2024-09-17T02:22:11.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113633 2024-09-17T02:22:11.432 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.432 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.432 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.432 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:203229 5.3 5:cd8b309a:::benchmark_data_smithi001_23533_object75112:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:11.433 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:11.398840+0000", 2024-09-17T02:22:11.433 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.001780217, 2024-09-17T02:22:11.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024064609999999999, 2024-09-17T02:22:11.433 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.433 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.433 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:11.433 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.433 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.433 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.433 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 203229 2024-09-17T02:22:11.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.433 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398840+0000", 2024-09-17T02:22:11.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398840+0000", 2024-09-17T02:22:11.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398841+0000", 2024-09-17T02:22:11.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0600000000000001e-07 2024-09-17T02:22:11.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398843+0000", 2024-09-17T02:22:11.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8700000000000001e-06 2024-09-17T02:22:11.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398847+0000", 2024-09-17T02:22:11.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2740000000000001e-06 2024-09-17T02:22:11.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398850+0000", 2024-09-17T02:22:11.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0319999999999999e-06 2024-09-17T02:22:11.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398884+0000", 2024-09-17T02:22:11.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3898e-05 2024-09-17T02:22:11.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.399006+0000", 2024-09-17T02:22:11.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012219299999999999 2024-09-17T02:22:11.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:11.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.399116+0000", 2024-09-17T02:22:11.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110575 2024-09-17T02:22:11.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:11.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401078+0000", 2024-09-17T02:22:11.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019614609999999998 2024-09-17T02:22:11.437 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.437 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.437 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.437 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:203230 5.b 5:d4fc4da0:::benchmark_data_smithi001_23533_object75113:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:11.437 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:11.398856+0000", 2024-09-17T02:22:11.438 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.001764299, 2024-09-17T02:22:11.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002471951, 2024-09-17T02:22:11.438 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.438 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.438 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:11.438 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.438 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.438 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.438 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 203230 2024-09-17T02:22:11.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.438 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398856+0000", 2024-09-17T02:22:11.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398856+0000", 2024-09-17T02:22:11.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398856+0000", 2024-09-17T02:22:11.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2000000000000001e-07 2024-09-17T02:22:11.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398858+0000", 2024-09-17T02:22:11.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.331e-06 2024-09-17T02:22:11.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398861+0000", 2024-09-17T02:22:11.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.641e-06 2024-09-17T02:22:11.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398864+0000", 2024-09-17T02:22:11.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0249999999999998e-06 2024-09-17T02:22:11.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.400921+0000", 2024-09-17T02:22:11.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020560750000000001 2024-09-17T02:22:11.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.400988+0000", 2024-09-17T02:22:11.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.745e-05 2024-09-17T02:22:11.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:11.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401056+0000", 2024-09-17T02:22:11.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8442000000000006e-05 2024-09-17T02:22:11.442 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.442 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.442 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.442 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:203231 5.d 5:b917f4f7:::benchmark_data_smithi001_23533_object75114:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:11.442 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:11.398886+0000", 2024-09-17T02:22:11.442 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.001735044, 2024-09-17T02:22:11.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025213829999999999, 2024-09-17T02:22:11.442 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.442 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.442 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:11.442 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.443 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.443 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.443 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 203231 2024-09-17T02:22:11.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.443 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398886+0000", 2024-09-17T02:22:11.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398886+0000", 2024-09-17T02:22:11.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398886+0000", 2024-09-17T02:22:11.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5100000000000001e-07 2024-09-17T02:22:11.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398887+0000", 2024-09-17T02:22:11.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5430000000000001e-06 2024-09-17T02:22:11.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398891+0000", 2024-09-17T02:22:11.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8870000000000002e-06 2024-09-17T02:22:11.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.398894+0000", 2024-09-17T02:22:11.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8700000000000001e-06 2024-09-17T02:22:11.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.400038+0000", 2024-09-17T02:22:11.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011439359999999999 2024-09-17T02:22:11.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.400117+0000", 2024-09-17T02:22:11.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8753999999999998e-05 2024-09-17T02:22:11.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:11.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401413+0000", 2024-09-17T02:22:11.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001296251 2024-09-17T02:22:11.446 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.446 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.446 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.447 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:203232 5.9 5:965697ad:::benchmark_data_smithi001_23533_object75115:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:11.447 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:11.400813+0000", 2024-09-17T02:22:11.447 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4294967295.9998074, 2024-09-17T02:22:11.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066951800000000002, 2024-09-17T02:22:11.447 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.447 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.447 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:11.447 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.447 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.447 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.447 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 203232 2024-09-17T02:22:11.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.447 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.400813+0000", 2024-09-17T02:22:11.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.400813+0000", 2024-09-17T02:22:11.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.400814+0000", 2024-09-17T02:22:11.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9800000000000002e-07 2024-09-17T02:22:11.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.400818+0000", 2024-09-17T02:22:11.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4139999999999996e-06 2024-09-17T02:22:11.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.400828+0000", 2024-09-17T02:22:11.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7259999999999997e-06 2024-09-17T02:22:11.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.400836+0000", 2024-09-17T02:22:11.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9799999999999998e-06 2024-09-17T02:22:11.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.400963+0000", 2024-09-17T02:22:11.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012684299999999999 2024-09-17T02:22:11.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401085+0000", 2024-09-17T02:22:11.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000122101 2024-09-17T02:22:11.451 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.451 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.451 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.451 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:203219 5.4 e66/52 ondisk, result = 0)", 2024-09-17T02:22:11.451 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:11.401420+0000", 2024-09-17T02:22:11.451 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4294967295.9992008, 2024-09-17T02:22:11.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000125408, 2024-09-17T02:22:11.451 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.451 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.451 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:11.451 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401420+0000", 2024-09-17T02:22:11.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401420+0000", 2024-09-17T02:22:11.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401421+0000", 2024-09-17T02:22:11.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2200000000000004e-07 2024-09-17T02:22:11.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401424+0000", 2024-09-17T02:22:11.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.495e-06 2024-09-17T02:22:11.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401433+0000", 2024-09-17T02:22:11.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2720000000000003e-06 2024-09-17T02:22:11.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401440+0000", 2024-09-17T02:22:11.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7830000000000001e-06 2024-09-17T02:22:11.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401481+0000", 2024-09-17T02:22:11.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1242999999999998e-05 2024-09-17T02:22:11.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401486+0000", 2024-09-17T02:22:11.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3460000000000004e-06 2024-09-17T02:22:11.454 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.454 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.455 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.455 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:203233 5.3 5.11ae7743 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:11.455 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:11.401488+0000", 2024-09-17T02:22:11.455 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4294967295.9991326, 2024-09-17T02:22:11.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115238, 2024-09-17T02:22:11.455 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.455 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.455 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:11.455 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.455 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.455 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.455 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 203233 2024-09-17T02:22:11.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.456 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401488+0000", 2024-09-17T02:22:11.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401488+0000", 2024-09-17T02:22:11.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401489+0000", 2024-09-17T02:22:11.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3900000000000004e-07 2024-09-17T02:22:11.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401492+0000", 2024-09-17T02:22:11.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7409999999999998e-06 2024-09-17T02:22:11.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401503+0000", 2024-09-17T02:22:11.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.096e-05 2024-09-17T02:22:11.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401510+0000", 2024-09-17T02:22:11.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7889999999999997e-06 2024-09-17T02:22:11.458 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.458 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.458 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.458 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:203237 5.4 5:2e87918d:::benchmark_data_smithi001_23533_object75120:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:11.458 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:11.401522+0000", 2024-09-17T02:22:11.458 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4294967295.9990983, 2024-09-17T02:22:11.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172984, 2024-09-17T02:22:11.458 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.459 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.459 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:11.459 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.459 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.459 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.459 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 203237 2024-09-17T02:22:11.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.459 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401522+0000", 2024-09-17T02:22:11.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401522+0000", 2024-09-17T02:22:11.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401523+0000", 2024-09-17T02:22:11.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9800000000000004e-07 2024-09-17T02:22:11.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401525+0000", 2024-09-17T02:22:11.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0940000000000002e-06 2024-09-17T02:22:11.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401532+0000", 2024-09-17T02:22:11.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9380000000000003e-06 2024-09-17T02:22:11.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401537+0000", 2024-09-17T02:22:11.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0529999999999997e-06 2024-09-17T02:22:11.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401588+0000", 2024-09-17T02:22:11.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1146999999999997e-05 2024-09-17T02:22:11.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401673+0000", 2024-09-17T02:22:11.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5164e-05 2024-09-17T02:22:11.462 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.462 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.462 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.462 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:203240 5.e 5:72ebf4e0:::benchmark_data_smithi001_23533_object75123:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:11.463 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:11.401639+0000", 2024-09-17T02:22:11.463 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4294967295.998982, 2024-09-17T02:22:11.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012573, 2024-09-17T02:22:11.463 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.463 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.463 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-17T02:22:11.463 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.463 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.463 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.463 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 203240 2024-09-17T02:22:11.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.463 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401639+0000", 2024-09-17T02:22:11.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401639+0000", 2024-09-17T02:22:11.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401639+0000", 2024-09-17T02:22:11.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2099999999999996e-07 2024-09-17T02:22:11.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401643+0000", 2024-09-17T02:22:11.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.631e-06 2024-09-17T02:22:11.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401652+0000", 2024-09-17T02:22:11.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8240000000000006e-06 2024-09-17T02:22:11.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401659+0000", 2024-09-17T02:22:11.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7549999999999997e-06 2024-09-17T02:22:11.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:11.401713+0000", 2024-09-17T02:22:11.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4119999999999997e-05 2024-09-17T02:22:11.466 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.466 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.466 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.466 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.466 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:22:11.466 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 16 2024-09-17T02:22:11.466 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:11.468 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:11.468 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:11.468+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:11.568 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:11.572+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:11.650 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:11.650 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:22:11.650 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:22:11.650 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:22:11.650 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:11.667 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:11.669 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:11.671+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:11.769 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:11.772+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:11.818 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:11.818 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:22:11.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:22:11.818 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:22:11.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.818 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97749 5.b 5:d930ef52:::benchmark_data_smithi001_23533_object97748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:11.818 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:11.818 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.227289403, 2024-09-17T02:22:11.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092964343000000005, 2024-09-17T02:22:11.818 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.818 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.819 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.819 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.819 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.819 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.819 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97749 2024-09-17T02:22:11.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.819 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:11.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:11.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591947+0000", 2024-09-17T02:22:11.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:22:11.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592011+0000", 2024-09-17T02:22:11.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3608000000000005e-05 2024-09-17T02:22:11.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592021+0000", 2024-09-17T02:22:11.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9979999999999998e-06 2024-09-17T02:22:11.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592028+0000", 2024-09-17T02:22:11.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1439999999999997e-06 2024-09-17T02:22:11.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593633+0000", 2024-09-17T02:22:11.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001604636 2024-09-17T02:22:11.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593757+0000", 2024-09-17T02:22:11.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012432099999999999 2024-09-17T02:22:11.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:11.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593866+0000", 2024-09-17T02:22:11.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109094 2024-09-17T02:22:11.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:11.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601190+0000", 2024-09-17T02:22:11.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073237620000000002 2024-09-17T02:22:11.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601356+0000", 2024-09-17T02:22:11.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016651900000000001 2024-09-17T02:22:11.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684618+0000", 2024-09-17T02:22:11.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083261356999999994 2024-09-17T02:22:11.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:11.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684724+0000", 2024-09-17T02:22:11.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010681800000000001 2024-09-17T02:22:11.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:11.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684911+0000", 2024-09-17T02:22:11.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186243 2024-09-17T02:22:11.824 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.824 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.824 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.825 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97752 5.b 5:d146f486:::benchmark_data_smithi001_23533_object97751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:11.825 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:11.825 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.225936709000003, 2024-09-17T02:22:11.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091989557, 2024-09-17T02:22:11.825 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.825 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.825 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.825 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.825 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.825 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.825 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97752 2024-09-17T02:22:11.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.826 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:11.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:11.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593300+0000", 2024-09-17T02:22:11.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8199999999999998e-07 2024-09-17T02:22:11.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593364+0000", 2024-09-17T02:22:11.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3831999999999995e-05 2024-09-17T02:22:11.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593376+0000", 2024-09-17T02:22:11.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1800999999999999e-05 2024-09-17T02:22:11.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593382+0000", 2024-09-17T02:22:11.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6780000000000003e-06 2024-09-17T02:22:11.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595491+0000", 2024-09-17T02:22:11.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021090689999999999 2024-09-17T02:22:11.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595614+0000", 2024-09-17T02:22:11.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012321500000000001 2024-09-17T02:22:11.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:11.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595778+0000", 2024-09-17T02:22:11.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016321900000000001 2024-09-17T02:22:11.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:11.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601197+0000", 2024-09-17T02:22:11.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054195600000000003 2024-09-17T02:22:11.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601396+0000", 2024-09-17T02:22:11.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019825299999999999 2024-09-17T02:22:11.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684990+0000", 2024-09-17T02:22:11.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083594878999999997 2024-09-17T02:22:11.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:11.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685116+0000", 2024-09-17T02:22:11.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012522799999999999 2024-09-17T02:22:11.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:11.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685289+0000", 2024-09-17T02:22:11.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172941 2024-09-17T02:22:11.831 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.831 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.831 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.831 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97754 5.b 5:da0615e5:::benchmark_data_smithi001_23533_object97753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:11.831 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:11.831 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.224298787000002, 2024-09-17T02:22:11.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092097207, 2024-09-17T02:22:11.831 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.831 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.831 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.831 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.832 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.832 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.832 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97754 2024-09-17T02:22:11.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.832 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:11.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:11.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594938+0000", 2024-09-17T02:22:11.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5000000000000002e-07 2024-09-17T02:22:11.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595075+0000", 2024-09-17T02:22:11.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137742 2024-09-17T02:22:11.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595087+0000", 2024-09-17T02:22:11.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1243000000000001e-05 2024-09-17T02:22:11.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595095+0000", 2024-09-17T02:22:11.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1030000000000002e-06 2024-09-17T02:22:11.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598461+0000", 2024-09-17T02:22:11.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033661170000000001 2024-09-17T02:22:11.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598540+0000", 2024-09-17T02:22:11.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8937999999999995e-05 2024-09-17T02:22:11.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:11.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598626+0000", 2024-09-17T02:22:11.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6042000000000001e-05 2024-09-17T02:22:11.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:11.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684258+0000", 2024-09-17T02:22:11.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085632394000000001 2024-09-17T02:22:11.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685369+0000", 2024-09-17T02:22:11.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001111063 2024-09-17T02:22:11.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685511+0000", 2024-09-17T02:22:11.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141965 2024-09-17T02:22:11.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:11.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685604+0000", 2024-09-17T02:22:11.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2935000000000004e-05 2024-09-17T02:22:11.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:11.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687034+0000", 2024-09-17T02:22:11.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001430015 2024-09-17T02:22:11.837 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.837 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.837 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.837 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97755 5.b 5:d36a03a1:::benchmark_data_smithi001_23533_object97754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:11.837 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:11.837 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.224125637, 2024-09-17T02:22:11.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0924904, 2024-09-17T02:22:11.838 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.838 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.838 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.838 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97755 2024-09-17T02:22:11.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.838 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:11.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:11.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595111+0000", 2024-09-17T02:22:11.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:22:11.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595145+0000", 2024-09-17T02:22:11.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3927000000000002e-05 2024-09-17T02:22:11.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595155+0000", 2024-09-17T02:22:11.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0023e-05 2024-09-17T02:22:11.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595162+0000", 2024-09-17T02:22:11.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3950000000000003e-06 2024-09-17T02:22:11.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599821+0000", 2024-09-17T02:22:11.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046592880000000001 2024-09-17T02:22:11.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599912+0000", 2024-09-17T02:22:11.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1049000000000002e-05 2024-09-17T02:22:11.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:11.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600062+0000", 2024-09-17T02:22:11.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015001700000000001 2024-09-17T02:22:11.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:11.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685307+0000", 2024-09-17T02:22:11.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085244340000000002 2024-09-17T02:22:11.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685446+0000", 2024-09-17T02:22:11.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013955700000000001 2024-09-17T02:22:11.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687375+0000", 2024-09-17T02:22:11.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019291079999999999 2024-09-17T02:22:11.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:11.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687462+0000", 2024-09-17T02:22:11.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6148000000000003e-05 2024-09-17T02:22:11.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:11.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687600+0000", 2024-09-17T02:22:11.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013887900000000001 2024-09-17T02:22:11.843 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.843 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.843 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.843 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 44/44 lb 5:c4567a04:::benchmark_data_smithi001_23533_object4200:head)", 2024-09-17T02:22:11.844 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:11.844 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.222029010999997, 2024-09-17T02:22:11.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092483421999999996, 2024-09-17T02:22:11.844 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.844 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.844 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:11.844 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:11.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:11.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:11.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6399999999999998e-07 2024-09-17T02:22:11.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597213+0000", 2024-09-17T02:22:11.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3659999999999997e-06 2024-09-17T02:22:11.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597222+0000", 2024-09-17T02:22:11.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0510000000000002e-06 2024-09-17T02:22:11.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597228+0000", 2024-09-17T02:22:11.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1569999999999999e-06 2024-09-17T02:22:11.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689588+0000", 2024-09-17T02:22:11.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092359931000000006 2024-09-17T02:22:11.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689622+0000", 2024-09-17T02:22:11.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4425999999999999e-05 2024-09-17T02:22:11.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:11.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689690+0000", 2024-09-17T02:22:11.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8126999999999993e-05 2024-09-17T02:22:11.847 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.847 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.847 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.848 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129462 5.4 5:2e0acc16:::benchmark_data_smithi001_23533_object1345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:11.848 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:11.848 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.284294942000002, 2024-09-17T02:22:11.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0112774899999999, 2024-09-17T02:22:11.848 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.848 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.848 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.848 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.848 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.848 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.848 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129462 2024-09-17T02:22:11.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.849 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:11.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:11.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534943+0000", 2024-09-17T02:22:11.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8759999999999999e-06 2024-09-17T02:22:11.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534951+0000", 2024-09-17T02:22:11.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3219999999999993e-06 2024-09-17T02:22:11.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534977+0000", 2024-09-17T02:22:11.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6245e-05 2024-09-17T02:22:11.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534992+0000", 2024-09-17T02:22:11.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4936000000000001e-05 2024-09-17T02:22:11.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535133+0000", 2024-09-17T02:22:11.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014051299999999999 2024-09-17T02:22:11.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:11.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:22:11.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1741000000000001e-05 2024-09-17T02:22:11.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.533906+0000", 2024-09-17T02:22:11.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99875209300000001 2024-09-17T02:22:11.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534348+0000", 2024-09-17T02:22:11.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044128899999999998 2024-09-17T02:22:11.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:11.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534762+0000", 2024-09-17T02:22:11.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000414707 2024-09-17T02:22:11.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:11.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545024+0000", 2024-09-17T02:22:11.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010261283 2024-09-17T02:22:11.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545953+0000", 2024-09-17T02:22:11.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000929618 2024-09-17T02:22:11.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:11.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546047+0000", 2024-09-17T02:22:11.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3697999999999996e-05 2024-09-17T02:22:11.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:11.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546218+0000", 2024-09-17T02:22:11.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017116899999999999 2024-09-17T02:22:11.854 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.854 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.854 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.854 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129480 5.4 5:2b1d398b:::benchmark_data_smithi001_23533_object1363:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:11.854 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:11.855 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.276540476000001, 2024-09-17T02:22:11.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0038926450000001, 2024-09-17T02:22:11.855 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.855 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.855 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.855 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.855 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.855 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.855 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129480 2024-09-17T02:22:11.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.855 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:11.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:11.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542696+0000", 2024-09-17T02:22:11.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9999999999999995e-07 2024-09-17T02:22:11.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542701+0000", 2024-09-17T02:22:11.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2240000000000003e-06 2024-09-17T02:22:11.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542716+0000", 2024-09-17T02:22:11.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4970000000000001e-05 2024-09-17T02:22:11.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542726+0000", 2024-09-17T02:22:11.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2879999999999998e-06 2024-09-17T02:22:11.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542832+0000", 2024-09-17T02:22:11.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010597199999999999 2024-09-17T02:22:11.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:11.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542843+0000", 2024-09-17T02:22:11.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.098e-05 2024-09-17T02:22:11.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538436+0000", 2024-09-17T02:22:11.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99559286800000002 2024-09-17T02:22:11.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538791+0000", 2024-09-17T02:22:11.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035585499999999997 2024-09-17T02:22:11.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:11.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.539144+0000", 2024-09-17T02:22:11.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035268499999999999 2024-09-17T02:22:11.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:11.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545880+0000", 2024-09-17T02:22:11.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00673552 2024-09-17T02:22:11.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546330+0000", 2024-09-17T02:22:11.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045039599999999999 2024-09-17T02:22:11.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:11.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546414+0000", 2024-09-17T02:22:11.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4468000000000005e-05 2024-09-17T02:22:11.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:11.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546588+0000", 2024-09-17T02:22:11.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017341899999999999 2024-09-17T02:22:11.861 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.861 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.861 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.861 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129505 5.4 5:294f2ec7:::benchmark_data_smithi001_23533_object1388:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:11.861 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:11.861 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.257527303000003, 2024-09-17T02:22:11.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98589826199999997, 2024-09-17T02:22:11.861 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.861 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.862 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.862 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.862 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.862 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.862 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129505 2024-09-17T02:22:11.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.862 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:11.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:11.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561710+0000", 2024-09-17T02:22:11.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7060000000000001e-06 2024-09-17T02:22:11.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561718+0000", 2024-09-17T02:22:11.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.542e-06 2024-09-17T02:22:11.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561741+0000", 2024-09-17T02:22:11.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3357e-05 2024-09-17T02:22:11.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561754+0000", 2024-09-17T02:22:11.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3200000000000001e-05 2024-09-17T02:22:11.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561867+0000", 2024-09-17T02:22:11.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113211 2024-09-17T02:22:11.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:11.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561888+0000", 2024-09-17T02:22:11.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0809999999999999e-05 2024-09-17T02:22:11.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542140+0000", 2024-09-17T02:22:11.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98025195799999998 2024-09-17T02:22:11.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542331+0000", 2024-09-17T02:22:11.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019127599999999999 2024-09-17T02:22:11.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:11.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542517+0000", 2024-09-17T02:22:11.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000185625 2024-09-17T02:22:11.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547114+0000", 2024-09-17T02:22:11.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045968620000000002 2024-09-17T02:22:11.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:11.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547187+0000", 2024-09-17T02:22:11.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3348000000000003e-05 2024-09-17T02:22:11.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:11.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547324+0000", 2024-09-17T02:22:11.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013681699999999999 2024-09-17T02:22:11.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:11.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547607+0000", 2024-09-17T02:22:11.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028255000000000001 2024-09-17T02:22:11.867 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.868 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.868 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.868 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129508 5.4 5:2892b582:::benchmark_data_smithi001_23533_object1391:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:11.868 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:11.868 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.25619021, 2024-09-17T02:22:11.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99697919099999999, 2024-09-17T02:22:11.868 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.868 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.868 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.868 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.868 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.868 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.869 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129508 2024-09-17T02:22:11.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.869 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:11.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:11.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563047+0000", 2024-09-17T02:22:11.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.274e-06 2024-09-17T02:22:11.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563054+0000", 2024-09-17T02:22:11.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2799999999999998e-06 2024-09-17T02:22:11.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563070+0000", 2024-09-17T02:22:11.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5991999999999999e-05 2024-09-17T02:22:11.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563078+0000", 2024-09-17T02:22:11.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2390000000000002e-06 2024-09-17T02:22:11.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563181+0000", 2024-09-17T02:22:11.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102249 2024-09-17T02:22:11.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:11.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563199+0000", 2024-09-17T02:22:11.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8215000000000001e-05 2024-09-17T02:22:11.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547713+0000", 2024-09-17T02:22:11.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98451446399999998 2024-09-17T02:22:11.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548063+0000", 2024-09-17T02:22:11.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034985499999999999 2024-09-17T02:22:11.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:11.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548490+0000", 2024-09-17T02:22:11.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042658600000000001 2024-09-17T02:22:11.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555655+0000", 2024-09-17T02:22:11.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071652579999999999 2024-09-17T02:22:11.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:11.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559612+0000", 2024-09-17T02:22:11.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003957103 2024-09-17T02:22:11.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:11.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559768+0000", 2024-09-17T02:22:11.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015556899999999999 2024-09-17T02:22:11.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:11.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560025+0000", 2024-09-17T02:22:11.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025710700000000002 2024-09-17T02:22:11.874 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.874 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.874 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.874 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129509 5.4 5:2c35515e:::benchmark_data_smithi001_23533_object1392:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:11.874 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:11.874 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.255563156999997, 2024-09-17T02:22:11.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99969384900000002, 2024-09-17T02:22:11.875 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.875 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.875 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.875 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.875 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.875 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.875 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129509 2024-09-17T02:22:11.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.875 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:11.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:11.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563674+0000", 2024-09-17T02:22:11.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0920000000000001e-06 2024-09-17T02:22:11.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563679+0000", 2024-09-17T02:22:11.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7660000000000004e-06 2024-09-17T02:22:11.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563693+0000", 2024-09-17T02:22:11.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3139000000000001e-05 2024-09-17T02:22:11.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563701+0000", 2024-09-17T02:22:11.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9859999999999994e-06 2024-09-17T02:22:11.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563775+0000", 2024-09-17T02:22:11.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4659000000000005e-05 2024-09-17T02:22:11.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:11.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563785+0000", 2024-09-17T02:22:11.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4839999999999993e-06 2024-09-17T02:22:11.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552085+0000", 2024-09-17T02:22:11.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98829986999999997 2024-09-17T02:22:11.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552554+0000", 2024-09-17T02:22:11.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046908900000000001 2024-09-17T02:22:11.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:11.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552931+0000", 2024-09-17T02:22:11.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377778 2024-09-17T02:22:11.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563106+0000", 2024-09-17T02:22:11.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010174186 2024-09-17T02:22:11.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:11.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563138+0000", 2024-09-17T02:22:11.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2495e-05 2024-09-17T02:22:11.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:11.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563225+0000", 2024-09-17T02:22:11.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6677999999999999e-05 2024-09-17T02:22:11.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:11.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563366+0000", 2024-09-17T02:22:11.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014162699999999999 2024-09-17T02:22:11.881 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.881 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.881 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.881 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129524 5.4 5:25dca7dd:::benchmark_data_smithi001_23533_object1407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:11.881 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:11.881 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.248871803, 2024-09-17T02:22:11.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99999501999999996, 2024-09-17T02:22:11.881 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.881 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.881 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.881 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.882 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.882 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.882 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129524 2024-09-17T02:22:11.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.882 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:11.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:11.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570365+0000", 2024-09-17T02:22:11.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.142e-06 2024-09-17T02:22:11.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570369+0000", 2024-09-17T02:22:11.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.856e-06 2024-09-17T02:22:11.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570385+0000", 2024-09-17T02:22:11.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5855e-05 2024-09-17T02:22:11.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570392+0000", 2024-09-17T02:22:11.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5340000000000002e-06 2024-09-17T02:22:11.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570484+0000", 2024-09-17T02:22:11.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1212999999999996e-05 2024-09-17T02:22:11.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:11.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570498+0000", 2024-09-17T02:22:11.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4331000000000001e-05 2024-09-17T02:22:11.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555835+0000", 2024-09-17T02:22:11.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98533757700000002 2024-09-17T02:22:11.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556329+0000", 2024-09-17T02:22:11.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000493458 2024-09-17T02:22:11.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:11.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556784+0000", 2024-09-17T02:22:11.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045476499999999999 2024-09-17T02:22:11.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569852+0000", 2024-09-17T02:22:11.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013068270999999999 2024-09-17T02:22:11.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:11.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569958+0000", 2024-09-17T02:22:11.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106214 2024-09-17T02:22:11.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:11.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570124+0000", 2024-09-17T02:22:11.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165546 2024-09-17T02:22:11.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:11.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570359+0000", 2024-09-17T02:22:11.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023525799999999999 2024-09-17T02:22:11.888 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.888 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.888 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.888 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129537 5.4 5:260327c6:::benchmark_data_smithi001_23533_object1420:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:11.888 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:11.888 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.240965273999997, 2024-09-17T02:22:11.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99624596499999996, 2024-09-17T02:22:11.888 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.889 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.889 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.889 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.889 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.889 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.889 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129537 2024-09-17T02:22:11.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.889 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:11.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:11.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578272+0000", 2024-09-17T02:22:11.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.164e-06 2024-09-17T02:22:11.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578278+0000", 2024-09-17T02:22:11.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5060000000000001e-06 2024-09-17T02:22:11.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578294+0000", 2024-09-17T02:22:11.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5687000000000001e-05 2024-09-17T02:22:11.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578329+0000", 2024-09-17T02:22:11.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5311999999999997e-05 2024-09-17T02:22:11.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578419+0000", 2024-09-17T02:22:11.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0054000000000002e-05 2024-09-17T02:22:11.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:11.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578435+0000", 2024-09-17T02:22:11.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5645999999999999e-05 2024-09-17T02:22:11.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560148+0000", 2024-09-17T02:22:11.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98171342299999997 2024-09-17T02:22:11.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560383+0000", 2024-09-17T02:22:11.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000234935 2024-09-17T02:22:11.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:11.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560586+0000", 2024-09-17T02:22:11.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000202909 2024-09-17T02:22:11.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570472+0000", 2024-09-17T02:22:11.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098856959999999994 2024-09-17T02:22:11.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:11.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574138+0000", 2024-09-17T02:22:11.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036660170000000001 2024-09-17T02:22:11.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:11.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574298+0000", 2024-09-17T02:22:11.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016025600000000001 2024-09-17T02:22:11.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:11.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574516+0000", 2024-09-17T02:22:11.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021835999999999999 2024-09-17T02:22:11.895 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.895 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.895 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.895 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129545 5.4 5:22366489:::benchmark_data_smithi001_23533_object1428:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:11.895 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:11.895 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.235102550999997, 2024-09-17T02:22:11.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99074544499999995, 2024-09-17T02:22:11.895 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.895 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.896 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.896 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.896 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.896 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.896 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129545 2024-09-17T02:22:11.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.896 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:11.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:11.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584135+0000", 2024-09-17T02:22:11.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4699999999999999e-06 2024-09-17T02:22:11.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584142+0000", 2024-09-17T02:22:11.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1620000000000002e-06 2024-09-17T02:22:11.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584170+0000", 2024-09-17T02:22:11.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7897000000000001e-05 2024-09-17T02:22:11.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584183+0000", 2024-09-17T02:22:11.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2814e-05 2024-09-17T02:22:11.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584299+0000", 2024-09-17T02:22:11.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116153 2024-09-17T02:22:11.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:11.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584316+0000", 2024-09-17T02:22:11.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7524999999999999e-05 2024-09-17T02:22:11.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563461+0000", 2024-09-17T02:22:11.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97914436699999996 2024-09-17T02:22:11.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563667+0000", 2024-09-17T02:22:11.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020689800000000001 2024-09-17T02:22:11.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:11.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563878+0000", 2024-09-17T02:22:11.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210275 2024-09-17T02:22:11.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570584+0000", 2024-09-17T02:22:11.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067066080000000002 2024-09-17T02:22:11.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:11.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574539+0000", 2024-09-17T02:22:11.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039550360000000003 2024-09-17T02:22:11.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:11.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574653+0000", 2024-09-17T02:22:11.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114003 2024-09-17T02:22:11.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:11.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574879+0000", 2024-09-17T02:22:11.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022523700000000001 2024-09-17T02:22:11.902 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.902 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.902 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.902 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129553 5.4 5:2e41ad40:::benchmark_data_smithi001_23533_object1436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:11.902 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:11.902 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.229679914999998, 2024-09-17T02:22:11.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99213429600000003, 2024-09-17T02:22:11.902 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.903 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.903 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.903 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.903 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.903 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.903 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129553 2024-09-17T02:22:11.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.903 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:11.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:11.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589557+0000", 2024-09-17T02:22:11.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2219999999999999e-06 2024-09-17T02:22:11.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589562+0000", 2024-09-17T02:22:11.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0649999999999998e-06 2024-09-17T02:22:11.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589575+0000", 2024-09-17T02:22:11.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3129000000000001e-05 2024-09-17T02:22:11.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589584+0000", 2024-09-17T02:22:11.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6200000000000005e-06 2024-09-17T02:22:11.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589693+0000", 2024-09-17T02:22:11.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109319 2024-09-17T02:22:11.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:11.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589714+0000", 2024-09-17T02:22:11.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0849999999999999e-05 2024-09-17T02:22:11.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566273+0000", 2024-09-17T02:22:11.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97655884999999998 2024-09-17T02:22:11.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566543+0000", 2024-09-17T02:22:11.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027059099999999998 2024-09-17T02:22:11.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:11.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566832+0000", 2024-09-17T02:22:11.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028898200000000002 2024-09-17T02:22:11.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:11.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581040+0000", 2024-09-17T02:22:11.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014208001 2024-09-17T02:22:11.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581200+0000", 2024-09-17T02:22:11.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159956 2024-09-17T02:22:11.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:11.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581427+0000", 2024-09-17T02:22:11.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000226309 2024-09-17T02:22:11.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:11.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581690+0000", 2024-09-17T02:22:11.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026340199999999998 2024-09-17T02:22:11.909 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.909 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.909 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.909 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129580 5.4 5:25ed887b:::benchmark_data_smithi001_23533_object1463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:11.909 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:11.909 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.207907871000003, 2024-09-17T02:22:11.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98001430499999997, 2024-09-17T02:22:11.909 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.909 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.910 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.910 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.910 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.910 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.910 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129580 2024-09-17T02:22:11.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.910 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:11.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:11.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611329+0000", 2024-09-17T02:22:11.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.22e-06 2024-09-17T02:22:11.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611335+0000", 2024-09-17T02:22:11.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1129999999999997e-06 2024-09-17T02:22:11.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611348+0000", 2024-09-17T02:22:11.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2342e-05 2024-09-17T02:22:11.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611356+0000", 2024-09-17T02:22:11.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.371e-06 2024-09-17T02:22:11.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611419+0000", 2024-09-17T02:22:11.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3393999999999996e-05 2024-09-17T02:22:11.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:11.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611427+0000", 2024-09-17T02:22:11.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999997e-06 2024-09-17T02:22:11.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570705+0000", 2024-09-17T02:22:11.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.95927859199999999 2024-09-17T02:22:11.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571009+0000", 2024-09-17T02:22:11.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030414599999999998 2024-09-17T02:22:11.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:11.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571241+0000", 2024-09-17T02:22:11.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023106799999999999 2024-09-17T02:22:11.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:11.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590789+0000", 2024-09-17T02:22:11.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019548763 2024-09-17T02:22:11.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590928+0000", 2024-09-17T02:22:11.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000139092 2024-09-17T02:22:11.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:11.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591086+0000", 2024-09-17T02:22:11.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015787400000000001 2024-09-17T02:22:11.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:11.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591342+0000", 2024-09-17T02:22:11.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025589900000000002 2024-09-17T02:22:11.916 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.916 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.916 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.916 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129603 5.4 5:25aaa5e8:::benchmark_data_smithi001_23533_object1486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:11.916 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:11.916 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.191848075000003, 2024-09-17T02:22:11.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96463198999999999, 2024-09-17T02:22:11.916 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.916 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.916 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.916 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.917 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.917 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.917 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129603 2024-09-17T02:22:11.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.917 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:11.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:11.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:11.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:22:11.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627392+0000", 2024-09-17T02:22:11.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0790000000000002e-06 2024-09-17T02:22:11.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627403+0000", 2024-09-17T02:22:11.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0866000000000001e-05 2024-09-17T02:22:11.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627409+0000", 2024-09-17T02:22:11.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.305e-06 2024-09-17T02:22:11.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627485+0000", 2024-09-17T02:22:11.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6582000000000006e-05 2024-09-17T02:22:11.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:11.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627499+0000", 2024-09-17T02:22:11.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:22:11.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574991+0000", 2024-09-17T02:22:11.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94749182300000001 2024-09-17T02:22:11.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575377+0000", 2024-09-17T02:22:11.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038629400000000003 2024-09-17T02:22:11.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:11.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575665+0000", 2024-09-17T02:22:11.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028759499999999997 2024-09-17T02:22:11.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:11.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590802+0000", 2024-09-17T02:22:11.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015136479 2024-09-17T02:22:11.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591614+0000", 2024-09-17T02:22:11.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081293100000000003 2024-09-17T02:22:11.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:11.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591764+0000", 2024-09-17T02:22:11.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014932199999999999 2024-09-17T02:22:11.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:11.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592020+0000", 2024-09-17T02:22:11.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025585099999999997 2024-09-17T02:22:11.923 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.923 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.923 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.923 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129607 5.4 5:2f638f1e:::benchmark_data_smithi001_23533_object1490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:11.923 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:11.923 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.190321169000001, 2024-09-17T02:22:11.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96352375899999998, 2024-09-17T02:22:11.923 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.923 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.923 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.923 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.924 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.924 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.924 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129607 2024-09-17T02:22:11.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.924 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:11.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:11.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628916+0000", 2024-09-17T02:22:11.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1710000000000001e-06 2024-09-17T02:22:11.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628920+0000", 2024-09-17T02:22:11.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-17T02:22:11.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628935+0000", 2024-09-17T02:22:11.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4474000000000001e-05 2024-09-17T02:22:11.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628944+0000", 2024-09-17T02:22:11.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9940000000000006e-06 2024-09-17T02:22:11.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628997+0000", 2024-09-17T02:22:11.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3579000000000003e-05 2024-09-17T02:22:11.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:11.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.629006+0000", 2024-09-17T02:22:11.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4009999999999997e-06 2024-09-17T02:22:11.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.577862+0000", 2024-09-17T02:22:11.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.948856335 2024-09-17T02:22:11.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578167+0000", 2024-09-17T02:22:11.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030532399999999999 2024-09-17T02:22:11.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:11.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578532+0000", 2024-09-17T02:22:11.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036428200000000001 2024-09-17T02:22:11.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:11.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591442+0000", 2024-09-17T02:22:11.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012910374000000001 2024-09-17T02:22:11.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592164+0000", 2024-09-17T02:22:11.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072242499999999996 2024-09-17T02:22:11.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:11.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592267+0000", 2024-09-17T02:22:11.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102205 2024-09-17T02:22:11.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:11.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592438+0000", 2024-09-17T02:22:11.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017165299999999999 2024-09-17T02:22:11.930 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.930 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.930 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.930 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129623 5.4 5:2cf5174b:::benchmark_data_smithi001_23533_object1506:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:11.930 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:11.930 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.166376882999998, 2024-09-17T02:22:11.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94334114499999999, 2024-09-17T02:22:11.930 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.930 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.930 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.930 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.930 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.930 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.931 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129623 2024-09-17T02:22:11.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.931 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:11.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:11.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652860+0000", 2024-09-17T02:22:11.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0330000000000001e-06 2024-09-17T02:22:11.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652864+0000", 2024-09-17T02:22:11.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.634e-06 2024-09-17T02:22:11.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652877+0000", 2024-09-17T02:22:11.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2591e-05 2024-09-17T02:22:11.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652883+0000", 2024-09-17T02:22:11.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1460000000000001e-06 2024-09-17T02:22:11.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652943+0000", 2024-09-17T02:22:11.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9833999999999997e-05 2024-09-17T02:22:11.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:11.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652950+0000", 2024-09-17T02:22:11.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.401e-06 2024-09-17T02:22:11.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581800+0000", 2024-09-17T02:22:11.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.92884935700000004 2024-09-17T02:22:11.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582122+0000", 2024-09-17T02:22:11.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032185200000000002 2024-09-17T02:22:11.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:11.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582689+0000", 2024-09-17T02:22:11.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056750400000000003 2024-09-17T02:22:11.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:11.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591458+0000", 2024-09-17T02:22:11.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008768685 2024-09-17T02:22:11.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595856+0000", 2024-09-17T02:22:11.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043977909999999999 2024-09-17T02:22:11.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:11.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595955+0000", 2024-09-17T02:22:11.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9166000000000006e-05 2024-09-17T02:22:11.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:11.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596200+0000", 2024-09-17T02:22:11.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024515099999999998 2024-09-17T02:22:11.938 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.938 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.938 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.938 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129642 5.4 5:255eb796:::benchmark_data_smithi001_23533_object1525:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:11.939 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:11.939 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.135140718999999, 2024-09-17T02:22:11.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.91257397299999998, 2024-09-17T02:22:11.939 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.939 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.939 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.939 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.939 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.939 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.939 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129642 2024-09-17T02:22:11.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.939 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:11.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:11.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684096+0000", 2024-09-17T02:22:11.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659999999999999e-06 2024-09-17T02:22:11.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684101+0000", 2024-09-17T02:22:11.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8110000000000002e-06 2024-09-17T02:22:11.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684114+0000", 2024-09-17T02:22:11.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2653000000000001e-05 2024-09-17T02:22:11.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684121+0000", 2024-09-17T02:22:11.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5100000000000001e-06 2024-09-17T02:22:11.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684181+0000", 2024-09-17T02:22:11.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0307999999999999e-05 2024-09-17T02:22:11.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:11.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684194+0000", 2024-09-17T02:22:11.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2916e-05 2024-09-17T02:22:11.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.587917+0000", 2024-09-17T02:22:11.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.90372220400000003 2024-09-17T02:22:11.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588215+0000", 2024-09-17T02:22:11.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029845400000000003 2024-09-17T02:22:11.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:11.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588470+0000", 2024-09-17T02:22:11.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025455399999999999 2024-09-17T02:22:11.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596318+0000", 2024-09-17T02:22:11.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078485589999999997 2024-09-17T02:22:11.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:11.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596354+0000", 2024-09-17T02:22:11.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5976999999999998e-05 2024-09-17T02:22:11.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:11.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596449+0000", 2024-09-17T02:22:11.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4728999999999994e-05 2024-09-17T02:22:11.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:11.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596669+0000", 2024-09-17T02:22:11.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220132 2024-09-17T02:22:11.945 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.945 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.945 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.945 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129649 5.4 5:2fe27050:::benchmark_data_smithi001_23533_object1532:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:11.945 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:11.945 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.103583976000003, 2024-09-17T02:22:11.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.88508119100000004, 2024-09-17T02:22:11.945 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:11.946 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:11.946 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:11.946 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:11.946 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:11.946 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:11.946 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129649 2024-09-17T02:22:11.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.946 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:11.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:11.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:11.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:11.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:11.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:11.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:11.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715653+0000", 2024-09-17T02:22:11.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3519999999999999e-06 2024-09-17T02:22:11.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:11.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715658+0000", 2024-09-17T02:22:11.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3120000000000001e-06 2024-09-17T02:22:11.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:11.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715677+0000", 2024-09-17T02:22:11.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-17T02:22:11.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:11.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715687+0000", 2024-09-17T02:22:11.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0146000000000001e-05 2024-09-17T02:22:11.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715821+0000", 2024-09-17T02:22:11.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013421 2024-09-17T02:22:11.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:11.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715840+0000", 2024-09-17T02:22:11.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8153999999999999e-05 2024-09-17T02:22:11.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:11.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592528+0000", 2024-09-17T02:22:11.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.87668860000000004 2024-09-17T02:22:11.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:11.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592702+0000", 2024-09-17T02:22:11.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017429300000000001 2024-09-17T02:22:11.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:11.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592945+0000", 2024-09-17T02:22:11.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000242048 2024-09-17T02:22:11.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:11.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600234+0000", 2024-09-17T02:22:11.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072897600000000002 2024-09-17T02:22:11.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:11.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600494+0000", 2024-09-17T02:22:11.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000259984 2024-09-17T02:22:11.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:11.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600555+0000", 2024-09-17T02:22:11.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1138999999999999e-05 2024-09-17T02:22:11.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:11.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:11.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:11.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600733+0000", 2024-09-17T02:22:11.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017753300000000001 2024-09-17T02:22:11.952 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.952 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.952 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.952 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:11.952 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:11.952 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:11.953 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:11.954 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:11.955+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:12.054 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:12.055+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:12.098 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:12.098 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:22:12.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.098 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4466.0:204909 5.a e66/22)", 2024-09-17T02:22:12.098 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:12.100078+0000", 2024-09-17T02:22:12.098 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00080836700000000005, 2024-09-17T02:22:12.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00082994099999999995, 2024-09-17T02:22:12.098 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:12.098 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:12.098 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:12.098 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:12.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:12.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100078+0000", 2024-09-17T02:22:12.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:12.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:12.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100078+0000", 2024-09-17T02:22:12.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:12.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:12.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100078+0000", 2024-09-17T02:22:12.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2700000000000001e-07 2024-09-17T02:22:12.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:12.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100080+0000", 2024-09-17T02:22:12.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.903e-06 2024-09-17T02:22:12.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:12.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100086+0000", 2024-09-17T02:22:12.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7570000000000001e-06 2024-09-17T02:22:12.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:12.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100090+0000", 2024-09-17T02:22:12.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4299999999999999e-06 2024-09-17T02:22:12.101 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:12.101 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:12.101 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:12.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.101 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:204923 5.6 5:6cb83ccb:::benchmark_data_smithi001_23533_object76806:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:12.101 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:12.100465+0000", 2024-09-17T02:22:12.101 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.000421579, 2024-09-17T02:22:12.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00047673300000000002, 2024-09-17T02:22:12.101 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:12.101 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:12.102 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-17T02:22:12.102 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:12.102 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:12.102 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:12.102 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 204923 2024-09-17T02:22:12.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.102 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:12.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:12.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100465+0000", 2024-09-17T02:22:12.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:12.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:12.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100465+0000", 2024-09-17T02:22:12.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:12.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:12.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100465+0000", 2024-09-17T02:22:12.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8400000000000003e-07 2024-09-17T02:22:12.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:12.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100470+0000", 2024-09-17T02:22:12.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2069999999999997e-06 2024-09-17T02:22:12.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:12.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100480+0000", 2024-09-17T02:22:12.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0712e-05 2024-09-17T02:22:12.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:12.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100487+0000", 2024-09-17T02:22:12.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5010000000000001e-06 2024-09-17T02:22:12.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:12.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100875+0000", 2024-09-17T02:22:12.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038819100000000002 2024-09-17T02:22:12.105 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:12.105 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:12.105 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:12.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.105 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:204924 5.5 5.70f12f15 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:12.105 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:12.100499+0000", 2024-09-17T02:22:12.105 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00038735799999999997, 2024-09-17T02:22:12.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00050177900000000005, 2024-09-17T02:22:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 204924 2024-09-17T02:22:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100499+0000", 2024-09-17T02:22:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100499+0000", 2024-09-17T02:22:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100499+0000", 2024-09-17T02:22:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3799999999999998e-07 2024-09-17T02:22:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100501+0000", 2024-09-17T02:22:12.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.091e-06 2024-09-17T02:22:12.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:12.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100508+0000", 2024-09-17T02:22:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9519999999999997e-06 2024-09-17T02:22:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100513+0000", 2024-09-17T02:22:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.617e-06 2024-09-17T02:22:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:204904 5.0 5:0dde2413:::benchmark_data_smithi001_23533_object76787:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:12.092023+0000", 2024-09-17T02:22:12.110 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0088628500000000002, 2024-09-17T02:22:12.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0090357730000000004, 2024-09-17T02:22:12.110 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:12.110 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:12.110 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:12.110 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:12.110 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:12.110 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:12.110 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 204904 2024-09-17T02:22:12.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.110 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:12.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.092023+0000", 2024-09-17T02:22:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.092023+0000", 2024-09-17T02:22:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.092024+0000", 2024-09-17T02:22:12.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6000000000000004e-07 2024-09-17T02:22:12.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:12.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.092027+0000", 2024-09-17T02:22:12.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7970000000000001e-06 2024-09-17T02:22:12.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.092034+0000", 2024-09-17T02:22:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8010000000000004e-06 2024-09-17T02:22:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.092040+0000", 2024-09-17T02:22:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9819999999999996e-06 2024-09-17T02:22:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.095405+0000", 2024-09-17T02:22:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033648129999999999 2024-09-17T02:22:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.095469+0000", 2024-09-17T02:22:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3937999999999997e-05 2024-09-17T02:22:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.095527+0000", 2024-09-17T02:22:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8202999999999998e-05 2024-09-17T02:22:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100002+0000", 2024-09-17T02:22:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044746819999999998 2024-09-17T02:22:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:204907 5.0 5:0f7bc79d:::benchmark_data_smithi001_23533_object76790:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:12.092154+0000", 2024-09-17T02:22:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0087321759999999995, 2024-09-17T02:22:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089927229999999993, 2024-09-17T02:22:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 204907 2024-09-17T02:22:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.092154+0000", 2024-09-17T02:22:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:12.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.092154+0000", 2024-09-17T02:22:12.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:12.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:12.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.092155+0000", 2024-09-17T02:22:12.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8699999999999995e-07 2024-09-17T02:22:12.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:12.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.092158+0000", 2024-09-17T02:22:12.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3519999999999998e-06 2024-09-17T02:22:12.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:12.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.092166+0000", 2024-09-17T02:22:12.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5010000000000004e-06 2024-09-17T02:22:12.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:12.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.092172+0000", 2024-09-17T02:22:12.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0159999999999997e-06 2024-09-17T02:22:12.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.097631+0000", 2024-09-17T02:22:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0054589920000000002 2024-09-17T02:22:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.097747+0000", 2024-09-17T02:22:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000115714 2024-09-17T02:22:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.097854+0000", 2024-09-17T02:22:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106465 2024-09-17T02:22:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:204909 5.a 5:5053a44c:::benchmark_data_smithi001_23533_object76792:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:12.093492+0000", 2024-09-17T02:22:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0073938449999999996, 2024-09-17T02:22:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0077296810000000004, 2024-09-17T02:22:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 204909 2024-09-17T02:22:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.093492+0000", 2024-09-17T02:22:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:12.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.093492+0000", 2024-09-17T02:22:12.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:12.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:12.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.093493+0000", 2024-09-17T02:22:12.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0100000000000004e-07 2024-09-17T02:22:12.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:12.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.093497+0000", 2024-09-17T02:22:12.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8089999999999999e-06 2024-09-17T02:22:12.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:12.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.093509+0000", 2024-09-17T02:22:12.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1897e-05 2024-09-17T02:22:12.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:12.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.093518+0000", 2024-09-17T02:22:12.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7830000000000004e-06 2024-09-17T02:22:12.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:12.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.094389+0000", 2024-09-17T02:22:12.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00087152400000000004 2024-09-17T02:22:12.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:12.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.094491+0000", 2024-09-17T02:22:12.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102205 2024-09-17T02:22:12.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:12.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.094592+0000", 2024-09-17T02:22:12.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010053800000000001 2024-09-17T02:22:12.125 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:12.125 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:12.125 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:12.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.125 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:204911 5.8 5:1458da3c:::benchmark_data_smithi001_23533_object76794:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:12.125 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:12.094753+0000", 2024-09-17T02:22:12.125 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.006132714, 2024-09-17T02:22:12.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0065425639999999998, 2024-09-17T02:22:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 204911 2024-09-17T02:22:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.094753+0000", 2024-09-17T02:22:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.094753+0000", 2024-09-17T02:22:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.094754+0000", 2024-09-17T02:22:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4000000000000001e-07 2024-09-17T02:22:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.094758+0000", 2024-09-17T02:22:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9090000000000002e-06 2024-09-17T02:22:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.094769+0000", 2024-09-17T02:22:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1336e-05 2024-09-17T02:22:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.094776+0000", 2024-09-17T02:22:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0929999999999997e-06 2024-09-17T02:22:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.097572+0000", 2024-09-17T02:22:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002795081 2024-09-17T02:22:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.097681+0000", 2024-09-17T02:22:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010970499999999999 2024-09-17T02:22:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.097792+0000", 2024-09-17T02:22:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011099000000000001 2024-09-17T02:22:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:204917 5.5 5:add85438:::benchmark_data_smithi001_23533_object76800:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:12.096667+0000", 2024-09-17T02:22:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0042194670000000002, 2024-09-17T02:22:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047026660000000003, 2024-09-17T02:22:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 204917 2024-09-17T02:22:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.096667+0000", 2024-09-17T02:22:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.096667+0000", 2024-09-17T02:22:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.096668+0000", 2024-09-17T02:22:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5300000000000003e-07 2024-09-17T02:22:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.096672+0000", 2024-09-17T02:22:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.301e-06 2024-09-17T02:22:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.096683+0000", 2024-09-17T02:22:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1072e-05 2024-09-17T02:22:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.096690+0000", 2024-09-17T02:22:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4050000000000003e-06 2024-09-17T02:22:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.096748+0000", 2024-09-17T02:22:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7394e-05 2024-09-17T02:22:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:12.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.096848+0000", 2024-09-17T02:22:12.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010019899999999999 2024-09-17T02:22:12.134 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:12.134 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:12.134 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:12.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.134 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:204919 5.a 5:56a98805:::benchmark_data_smithi001_23533_object76802:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:12.134 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:12.098653+0000", 2024-09-17T02:22:12.134 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.002232899, 2024-09-17T02:22:12.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027816759999999999, 2024-09-17T02:22:12.135 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:12.135 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:12.135 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:12.135 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:12.135 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:12.135 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:12.135 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 204919 2024-09-17T02:22:12.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.135 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:12.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:12.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.098653+0000", 2024-09-17T02:22:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.098653+0000", 2024-09-17T02:22:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.098654+0000", 2024-09-17T02:22:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1800000000000004e-07 2024-09-17T02:22:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.098659+0000", 2024-09-17T02:22:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5229999999999997e-06 2024-09-17T02:22:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.098668+0000", 2024-09-17T02:22:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1390000000000001e-06 2024-09-17T02:22:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.098676+0000", 2024-09-17T02:22:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1669999999999999e-06 2024-09-17T02:22:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.099971+0000", 2024-09-17T02:22:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012945389999999999 2024-09-17T02:22:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100102+0000", 2024-09-17T02:22:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013148500000000001 2024-09-17T02:22:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100185+0000", 2024-09-17T02:22:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2787000000000005e-05 2024-09-17T02:22:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:204920 5.5 5:adee3e5a:::benchmark_data_smithi001_23533_object76803:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T02:22:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:12.099940+0000", 2024-09-17T02:22:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00094596199999999995, 2024-09-17T02:22:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001565835, 2024-09-17T02:22:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:12.140 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:12.140 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:12.140 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:12.140 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:12.140 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:12.140 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 204920 2024-09-17T02:22:12.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.140 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:12.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:12.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.099940+0000", 2024-09-17T02:22:12.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.099940+0000", 2024-09-17T02:22:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.099941+0000", 2024-09-17T02:22:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2200000000000004e-07 2024-09-17T02:22:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.099944+0000", 2024-09-17T02:22:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6950000000000002e-06 2024-09-17T02:22:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.099952+0000", 2024-09-17T02:22:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.622e-06 2024-09-17T02:22:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.099959+0000", 2024-09-17T02:22:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7399999999999998e-06 2024-09-17T02:22:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:12.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100005+0000", 2024-09-17T02:22:12.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6542999999999998e-05 2024-09-17T02:22:12.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:12.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100087+0000", 2024-09-17T02:22:12.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1594000000000005e-05 2024-09-17T02:22:12.143 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:12.143 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:12.143 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:12.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:204916 5.e e66/22 5:7314c7d5:::benchmark_data_smithi001_23533_object76799:head v 66'12786, mlcod=66'12784)", 2024-09-17T02:22:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:12.100050+0000", 2024-09-17T02:22:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00083638500000000004, 2024-09-17T02:22:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015232659999999999, 2024-09-17T02:22:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100050+0000", 2024-09-17T02:22:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100050+0000", 2024-09-17T02:22:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100050+0000", 2024-09-17T02:22:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6300000000000001e-07 2024-09-17T02:22:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100054+0000", 2024-09-17T02:22:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9269999999999998e-06 2024-09-17T02:22:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100062+0000", 2024-09-17T02:22:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9480000000000008e-06 2024-09-17T02:22:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100067+0000", 2024-09-17T02:22:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8169999999999998e-06 2024-09-17T02:22:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100109+0000", 2024-09-17T02:22:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2172999999999998e-05 2024-09-17T02:22:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:12.100139+0000", 2024-09-17T02:22:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9995e-05 2024-09-17T02:22:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:22:12.148 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 11 2024-09-17T02:22:12.148 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:12.149 INFO:teuthology.orchestra.run.smithi001.stderr:noscrub is unset 2024-09-17T02:22:12.149 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:12.184 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:22:12.192 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:12.196+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:12.256 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:12.256+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:12.297 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:12.297 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:22:12.297 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:22:12.297 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:22:12.297 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:12.317 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:12.344 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:22:12.344 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:22:12.356 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:12.355+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:12.362 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:22:12.362 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:22:12.363 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:22:12.368 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:22:12.368 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:22:12.458 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:12.459+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:12.516 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:12.516 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:12.535 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:12.584 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:12.583+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:12.659 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:12.660+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:12.684 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:12.684 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:12.703 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:12.760 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:12.764+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:12.861 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:12.863+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:12.897 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:12.897 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:12.916 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:13.002 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:13.003+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:13.063 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:13.064+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:13.103 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:13.104 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:13.120 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:13.165 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:13.167+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:13.265 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:13.268+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:13.274 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:13.275 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:13.294 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:13.384 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:13.388+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:13.467 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:13.467+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:13.494 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:13.494 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:13.514 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:13.568 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:13.567+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:13.669 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:13.672+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:13.703 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:13.704 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:13.722 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:13.770 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:13.771+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:13.871 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:13.872+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:13.874 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:13.875 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:13.893 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:13.972 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:13.972+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:14.073 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:14.076+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:14.086 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:14.086 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:14.106 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:14.150 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T02:22:14.176 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:14.175+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:14.257 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:14.257 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:14.274 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:14.276+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:14.276 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:14.362 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~35s 2024-09-17T02:22:14.369 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:22:14.375 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:14.375+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:14.428 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:14.429 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:14.445 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:14.477 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:14.475+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:14.515 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:22:14.515 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:22:14.533 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:22:14.533 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:22:14.533 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:22:14.536 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:22:14.537 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:22:14.579 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:14.580+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:14.597 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:14.597 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:22:14.597 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:22:14.598 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:22:14.598 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:14.617 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:14.678 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:14.679+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:14.779 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:14.779+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:14.810 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:14.811 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:22:14.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:22:14.811 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:22:14.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.811 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:22:14.811 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:14.811 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 92.243824205999999, 2024-09-17T02:22:14.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:22:14.811 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:14.811 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:14.811 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:14.811 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:14.811 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:14.812 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:14.812 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:22:14.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.812 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:14.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:14.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:14.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:14.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:14.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:22:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:22:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:22:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:22:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:22:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:22:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:22:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:22:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:22:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:22:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:22:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:22:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:22:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:22:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:22:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:22:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:22:14.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:22:14.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:14.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:22:14.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:22:14.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:14.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:22:14.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:22:14.816 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.816 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:14.817 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.817 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:22:14.817 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:14.817 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 92.239921956000003, 2024-09-17T02:22:14.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:22:14.817 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:14.817 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:14.817 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:14.817 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:14.817 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:14.817 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:14.818 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:22:14.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.818 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:14.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:14.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:14.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:14.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:14.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:14.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:22:14.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:22:14.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:14.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:22:14.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:22:14.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:14.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:22:14.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:22:14.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:14.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:22:14.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:22:14.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:14.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:22:14.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:22:14.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:14.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:22:14.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:22:14.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:14.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:22:14.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:22:14.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:14.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:22:14.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:22:14.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:14.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:22:14.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:22:14.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:14.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:22:14.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:22:14.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:14.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:22:14.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:22:14.823 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.823 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:14.823 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.823 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97759 5.a 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:14.823 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:14.823 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.213902132999998, 2024-09-17T02:22:14.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.089694871999999995, 2024-09-17T02:22:14.824 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:14.824 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:14.824 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:14.824 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:14.824 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:14.824 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:14.824 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97759 2024-09-17T02:22:14.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.824 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:14.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:14.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:14.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:14.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:14.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:14.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598386+0000", 2024-09-17T02:22:14.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999999e-07 2024-09-17T02:22:14.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:14.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598414+0000", 2024-09-17T02:22:14.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8013000000000001e-05 2024-09-17T02:22:14.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:14.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598420+0000", 2024-09-17T02:22:14.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1149999999999999e-06 2024-09-17T02:22:14.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:14.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598424+0000", 2024-09-17T02:22:14.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:22:14.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:14.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598479+0000", 2024-09-17T02:22:14.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4648999999999998e-05 2024-09-17T02:22:14.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:14.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598587+0000", 2024-09-17T02:22:14.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010853000000000001 2024-09-17T02:22:14.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:14.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598676+0000", 2024-09-17T02:22:14.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8381999999999995e-05 2024-09-17T02:22:14.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:14.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603766+0000", 2024-09-17T02:22:14.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050902559999999996 2024-09-17T02:22:14.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:14.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.687988+0000", 2024-09-17T02:22:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.084221753999999996 2024-09-17T02:22:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688037+0000", 2024-09-17T02:22:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-05 2024-09-17T02:22:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688080+0000", 2024-09-17T02:22:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3149999999999999e-05 2024-09-17T02:22:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97770 5.0 5:09c75033:::benchmark_data_smithi001_23533_object97769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.208759702999998, 2024-09-17T02:22:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.086380868, 2024-09-17T02:22:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97770 2024-09-17T02:22:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603529+0000", 2024-09-17T02:22:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:22:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603593+0000", 2024-09-17T02:22:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4216999999999999e-05 2024-09-17T02:22:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603603+0000", 2024-09-17T02:22:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5179999999999993e-06 2024-09-17T02:22:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603608+0000", 2024-09-17T02:22:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2039999999999996e-06 2024-09-17T02:22:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603653+0000", 2024-09-17T02:22:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5247000000000002e-05 2024-09-17T02:22:14.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:14.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603758+0000", 2024-09-17T02:22:14.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105352 2024-09-17T02:22:14.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:14.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603900+0000", 2024-09-17T02:22:14.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014198999999999999 2024-09-17T02:22:14.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.606097+0000", 2024-09-17T02:22:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021969839999999999 2024-09-17T02:22:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689756+0000", 2024-09-17T02:22:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.083659077999999998 2024-09-17T02:22:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689846+0000", 2024-09-17T02:22:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9320999999999994e-05 2024-09-17T02:22:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:14.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689908+0000", 2024-09-17T02:22:14.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720999999999998e-05 2024-09-17T02:22:14.836 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.836 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:14.836 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.836 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127513 5.c 5:3eca08e4:::benchmark_data_smithi001_23533_object127512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:14.836 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:14.836 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 42.367983279000001, 2024-09-17T02:22:14.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046626399999999998, 2024-09-17T02:22:14.836 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:14.837 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:14.837 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:14.837 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:14.837 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:14.837 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:14.837 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127513 2024-09-17T02:22:14.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.837 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:14.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:14.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:14.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444305+0000", 2024-09-17T02:22:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2529999999999999e-06 2024-09-17T02:22:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444466+0000", 2024-09-17T02:22:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016069700000000001 2024-09-17T02:22:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:14.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444479+0000", 2024-09-17T02:22:14.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2602999999999999e-05 2024-09-17T02:22:14.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:14.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444485+0000", 2024-09-17T02:22:14.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.669e-06 2024-09-17T02:22:14.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:14.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444560+0000", 2024-09-17T02:22:14.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4276999999999994e-05 2024-09-17T02:22:14.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:14.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444656+0000", 2024-09-17T02:22:14.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6490000000000006e-05 2024-09-17T02:22:14.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:14.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444739+0000", 2024-09-17T02:22:14.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3139999999999993e-05 2024-09-17T02:22:14.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:14.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.448438+0000", 2024-09-17T02:22:14.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036985490000000002 2024-09-17T02:22:14.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:14.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490732+0000", 2024-09-17T02:22:14.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042294353999999999 2024-09-17T02:22:14.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:14.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490859+0000", 2024-09-17T02:22:14.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012708899999999999 2024-09-17T02:22:14.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:14.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490930+0000", 2024-09-17T02:22:14.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:14.842 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.842 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:14.842 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.842 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127514 5.c 5:39cc1feb:::benchmark_data_smithi001_23533_object127513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:14.842 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:14.842 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 42.367786510000002, 2024-09-17T02:22:14.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049357228000000003, 2024-09-17T02:22:14.842 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:14.842 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127514 2024-09-17T02:22:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:14.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:14.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:14.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:14.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8599999999999998e-07 2024-09-17T02:22:14.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:14.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444554+0000", 2024-09-17T02:22:14.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3047999999999998e-05 2024-09-17T02:22:14.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444562+0000", 2024-09-17T02:22:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5830000000000001e-06 2024-09-17T02:22:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444567+0000", 2024-09-17T02:22:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4179999999999996e-06 2024-09-17T02:22:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446566+0000", 2024-09-17T02:22:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001998788 2024-09-17T02:22:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:14.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446696+0000", 2024-09-17T02:22:14.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129393 2024-09-17T02:22:14.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:14.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446794+0000", 2024-09-17T02:22:14.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8462999999999996e-05 2024-09-17T02:22:14.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:14.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.449036+0000", 2024-09-17T02:22:14.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022415880000000001 2024-09-17T02:22:14.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:14.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493737+0000", 2024-09-17T02:22:14.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044701682 2024-09-17T02:22:14.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:14.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493808+0000", 2024-09-17T02:22:14.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0846000000000006e-05 2024-09-17T02:22:14.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:14.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493858+0000", 2024-09-17T02:22:14.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9932999999999998e-05 2024-09-17T02:22:14.848 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.848 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:14.848 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.848 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129441 5.1 5:84c3199f:::benchmark_data_smithi001_23533_object1324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:14.848 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:14.848 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.308776022000004, 2024-09-17T02:22:14.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034387011000000002, 2024-09-17T02:22:14.848 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:14.848 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:14.849 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:14.849 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:14.849 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:14.849 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:14.849 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129441 2024-09-17T02:22:14.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.849 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:14.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:14.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:14.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503513+0000", 2024-09-17T02:22:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4759999999999999e-06 2024-09-17T02:22:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503518+0000", 2024-09-17T02:22:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-09-17T02:22:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503532+0000", 2024-09-17T02:22:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4049999999999999e-05 2024-09-17T02:22:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503541+0000", 2024-09-17T02:22:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5320000000000006e-06 2024-09-17T02:22:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506331+0000", 2024-09-17T02:22:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027899190000000001 2024-09-17T02:22:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506402+0000", 2024-09-17T02:22:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506477+0000", 2024-09-17T02:22:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4626e-05 2024-09-17T02:22:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509749+0000", 2024-09-17T02:22:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032726980000000001 2024-09-17T02:22:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537758+0000", 2024-09-17T02:22:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028008890000000002 2024-09-17T02:22:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537812+0000", 2024-09-17T02:22:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3300000000000001e-05 2024-09-17T02:22:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:14.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537898+0000", 2024-09-17T02:22:14.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6691000000000001e-05 2024-09-17T02:22:14.854 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.854 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:14.854 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.854 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129442 5.1 5:8f7f2a95:::benchmark_data_smithi001_23533_object1325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:14.854 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:14.854 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.305805413000002, 2024-09-17T02:22:14.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031546698999999997, 2024-09-17T02:22:14.854 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:14.854 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:14.854 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:14.855 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:14.855 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:14.855 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:14.855 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129442 2024-09-17T02:22:14.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.855 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:14.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:14.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:14.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:14.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:14.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:14.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506483+0000", 2024-09-17T02:22:14.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2869999999999999e-06 2024-09-17T02:22:14.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:14.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506489+0000", 2024-09-17T02:22:14.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2330000000000003e-06 2024-09-17T02:22:14.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:14.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506502+0000", 2024-09-17T02:22:14.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2286999999999999e-05 2024-09-17T02:22:14.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:14.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506511+0000", 2024-09-17T02:22:14.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7799999999999995e-06 2024-09-17T02:22:14.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:14.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.507966+0000", 2024-09-17T02:22:14.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014541549999999999 2024-09-17T02:22:14.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:14.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508130+0000", 2024-09-17T02:22:14.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016455199999999999 2024-09-17T02:22:14.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:14.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508287+0000", 2024-09-17T02:22:14.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015730400000000001 2024-09-17T02:22:14.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:14.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510577+0000", 2024-09-17T02:22:14.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022899449999999998 2024-09-17T02:22:14.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:14.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537932+0000", 2024-09-17T02:22:14.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027354471000000002 2024-09-17T02:22:14.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:14.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537964+0000", 2024-09-17T02:22:14.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1909999999999998e-05 2024-09-17T02:22:14.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:14.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.538029+0000", 2024-09-17T02:22:14.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4775000000000002e-05 2024-09-17T02:22:14.860 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.860 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:14.860 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.860 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:150458 5.a 5:59b62890:::benchmark_data_smithi001_23533_object22341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:22:14.860 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:14.860 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.973961606, 2024-09-17T02:22:14.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028150173000000001, 2024-09-17T02:22:14.860 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:14.861 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:14.861 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:14.861 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:14.861 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:14.861 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:14.861 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 150458 2024-09-17T02:22:14.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.861 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:14.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:14.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:14.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7800000000000002e-07 2024-09-17T02:22:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838328+0000", 2024-09-17T02:22:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.838e-06 2024-09-17T02:22:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838335+0000", 2024-09-17T02:22:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1999999999999997e-06 2024-09-17T02:22:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838340+0000", 2024-09-17T02:22:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7389999999999999e-06 2024-09-17T02:22:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849082+0000", 2024-09-17T02:22:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01074174 2024-09-17T02:22:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849192+0000", 2024-09-17T02:22:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011040300000000001 2024-09-17T02:22:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849297+0000", 2024-09-17T02:22:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104764 2024-09-17T02:22:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:14.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.857853+0000", 2024-09-17T02:22:14.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085558490000000008 2024-09-17T02:22:14.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:14.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866430+0000", 2024-09-17T02:22:14.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085768140000000003 2024-09-17T02:22:14.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:14.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866454+0000", 2024-09-17T02:22:14.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4428000000000001e-05 2024-09-17T02:22:14.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866476+0000", 2024-09-17T02:22:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.192e-05 2024-09-17T02:22:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190780 5.3 e65/64 5:c634f18a:::benchmark_data_smithi001_23533_object62663:head v 65'12039, mlcod=0'0)", 2024-09-17T02:22:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.182278+0000", 2024-09-17T02:22:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6300095169999995, 2024-09-17T02:22:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028943393000000001, 2024-09-17T02:22:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182278+0000", 2024-09-17T02:22:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182278+0000", 2024-09-17T02:22:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:14.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182280+0000", 2024-09-17T02:22:14.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.736e-06 2024-09-17T02:22:14.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:14.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182291+0000", 2024-09-17T02:22:14.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1933000000000001e-05 2024-09-17T02:22:14.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:14.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182317+0000", 2024-09-17T02:22:14.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6024999999999999e-05 2024-09-17T02:22:14.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:14.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182332+0000", 2024-09-17T02:22:14.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4856e-05 2024-09-17T02:22:14.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:14.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182463+0000", 2024-09-17T02:22:14.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130674 2024-09-17T02:22:14.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:14.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182533+0000", 2024-09-17T02:22:14.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0296999999999995e-05 2024-09-17T02:22:14.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:14.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211153+0000", 2024-09-17T02:22:14.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028619265000000001 2024-09-17T02:22:14.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:14.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211221+0000", 2024-09-17T02:22:14.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8607000000000002e-05 2024-09-17T02:22:14.871 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.871 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:14.871 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.871 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190799 5.3 e65/64 5:c0e8780b:::benchmark_data_smithi001_23533_object62682:head v 65'12040, mlcod=0'0)", 2024-09-17T02:22:14.871 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.193849+0000", 2024-09-17T02:22:14.871 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6184381650000006, 2024-09-17T02:22:14.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02989934, 2024-09-17T02:22:14.871 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:14.871 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:14.871 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:14.872 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:14.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:14.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193849+0000", 2024-09-17T02:22:14.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:14.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193849+0000", 2024-09-17T02:22:14.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:14.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193851+0000", 2024-09-17T02:22:14.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.137e-06 2024-09-17T02:22:14.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:14.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193865+0000", 2024-09-17T02:22:14.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3845999999999999e-05 2024-09-17T02:22:14.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:14.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193888+0000", 2024-09-17T02:22:14.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3312e-05 2024-09-17T02:22:14.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:14.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193901+0000", 2024-09-17T02:22:14.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2896e-05 2024-09-17T02:22:14.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:14.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.204084+0000", 2024-09-17T02:22:14.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010182538 2024-09-17T02:22:14.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:14.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.204126+0000", 2024-09-17T02:22:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1828e-05 2024-09-17T02:22:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223688+0000", 2024-09-17T02:22:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019562408999999999 2024-09-17T02:22:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223748+0000", 2024-09-17T02:22:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0374000000000002e-05 2024-09-17T02:22:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190836 5.3 e65/64 5:c72f74ff:::benchmark_data_smithi001_23533_object62719:head v 65'12042, mlcod=0'0)", 2024-09-17T02:22:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.198478+0000", 2024-09-17T02:22:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6138092729999993, 2024-09-17T02:22:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031214246000000001, 2024-09-17T02:22:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198478+0000", 2024-09-17T02:22:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:14.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198478+0000", 2024-09-17T02:22:14.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:14.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198480+0000", 2024-09-17T02:22:14.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0899999999999999e-06 2024-09-17T02:22:14.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:14.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198494+0000", 2024-09-17T02:22:14.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3572e-05 2024-09-17T02:22:14.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:14.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198521+0000", 2024-09-17T02:22:14.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7178999999999998e-05 2024-09-17T02:22:14.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:14.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198533+0000", 2024-09-17T02:22:14.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2588999999999999e-05 2024-09-17T02:22:14.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208944+0000", 2024-09-17T02:22:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010410236 2024-09-17T02:22:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208979+0000", 2024-09-17T02:22:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5555000000000001e-05 2024-09-17T02:22:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229627+0000", 2024-09-17T02:22:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020647993999999999 2024-09-17T02:22:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229692+0000", 2024-09-17T02:22:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5030999999999995e-05 2024-09-17T02:22:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190852 5.3 e65/64 5:c63de204:::benchmark_data_smithi001_23533_object62735:head v 65'12043, mlcod=0'0)", 2024-09-17T02:22:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.200082+0000", 2024-09-17T02:22:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6122052750000009, 2024-09-17T02:22:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029657795000000001, 2024-09-17T02:22:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:14.881 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:14.881 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:14.881 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:14.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:14.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200082+0000", 2024-09-17T02:22:14.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:14.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200082+0000", 2024-09-17T02:22:14.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:14.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200084+0000", 2024-09-17T02:22:14.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1900000000000002e-06 2024-09-17T02:22:14.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:14.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200099+0000", 2024-09-17T02:22:14.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4392999999999999e-05 2024-09-17T02:22:14.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:14.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200122+0000", 2024-09-17T02:22:14.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3292e-05 2024-09-17T02:22:14.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:14.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200134+0000", 2024-09-17T02:22:14.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2489e-05 2024-09-17T02:22:14.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:14.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211322+0000", 2024-09-17T02:22:14.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011187689000000001 2024-09-17T02:22:14.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:14.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211383+0000", 2024-09-17T02:22:14.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0707e-05 2024-09-17T02:22:14.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:14.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229698+0000", 2024-09-17T02:22:14.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018315306999999999 2024-09-17T02:22:14.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:14.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229740+0000", 2024-09-17T02:22:14.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1727999999999998e-05 2024-09-17T02:22:14.884 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.885 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:14.885 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.885 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190887 5.3 e65/64 5:cc339b34:::benchmark_data_smithi001_23533_object62770:head v 65'12044, mlcod=0'0)", 2024-09-17T02:22:14.885 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.201631+0000", 2024-09-17T02:22:14.885 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6106559269999998, 2024-09-17T02:22:14.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028149121999999999, 2024-09-17T02:22:14.885 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:14.885 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:14.885 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:14.885 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:14.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:14.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201631+0000", 2024-09-17T02:22:14.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:14.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201631+0000", 2024-09-17T02:22:14.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:14.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201634+0000", 2024-09-17T02:22:14.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1629999999999999e-06 2024-09-17T02:22:14.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:14.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201647+0000", 2024-09-17T02:22:14.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3943e-05 2024-09-17T02:22:14.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:14.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201690+0000", 2024-09-17T02:22:14.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2660999999999997e-05 2024-09-17T02:22:14.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:14.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201707+0000", 2024-09-17T02:22:14.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.647e-05 2024-09-17T02:22:14.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:14.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.213560+0000", 2024-09-17T02:22:14.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011852945 2024-09-17T02:22:14.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:14.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.213617+0000", 2024-09-17T02:22:14.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7170999999999999e-05 2024-09-17T02:22:14.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:14.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229744+0000", 2024-09-17T02:22:14.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016127617 2024-09-17T02:22:14.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:14.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229781+0000", 2024-09-17T02:22:14.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6152000000000002e-05 2024-09-17T02:22:14.889 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.889 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:14.889 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.889 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190920 5.3 e65/64 5:c7bc6082:::benchmark_data_smithi001_23533_object62803:head v 65'12047, mlcod=0'0)", 2024-09-17T02:22:14.889 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.206674+0000", 2024-09-17T02:22:14.890 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6056132989999998, 2024-09-17T02:22:14.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.033826457999999997, 2024-09-17T02:22:14.890 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:14.890 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:14.890 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:14.890 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:14.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:14.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206674+0000", 2024-09-17T02:22:14.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:14.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206674+0000", 2024-09-17T02:22:14.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:14.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206676+0000", 2024-09-17T02:22:14.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.646e-06 2024-09-17T02:22:14.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:14.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206689+0000", 2024-09-17T02:22:14.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3196999999999999e-05 2024-09-17T02:22:14.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:14.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206718+0000", 2024-09-17T02:22:14.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8988000000000001e-05 2024-09-17T02:22:14.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:14.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206736+0000", 2024-09-17T02:22:14.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8221999999999999e-05 2024-09-17T02:22:14.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:14.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.221517+0000", 2024-09-17T02:22:14.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014781247000000001 2024-09-17T02:22:14.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:14.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.221563+0000", 2024-09-17T02:22:14.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5343999999999998e-05 2024-09-17T02:22:14.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:14.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240391+0000", 2024-09-17T02:22:14.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018828693000000001 2024-09-17T02:22:14.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:14.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240500+0000", 2024-09-17T02:22:14.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109121 2024-09-17T02:22:14.894 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.894 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:14.894 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.894 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190947 5.3 e65/64 5:ca95b398:::benchmark_data_smithi001_23533_object62830:head v 65'12048, mlcod=0'0)", 2024-09-17T02:22:14.894 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.208183+0000", 2024-09-17T02:22:14.894 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6041039460000004, 2024-09-17T02:22:14.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032404800999999997, 2024-09-17T02:22:14.894 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:14.894 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:14.894 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:14.894 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:14.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:14.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208183+0000", 2024-09-17T02:22:14.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:14.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208183+0000", 2024-09-17T02:22:14.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:14.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208185+0000", 2024-09-17T02:22:14.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.64e-06 2024-09-17T02:22:14.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:14.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208197+0000", 2024-09-17T02:22:14.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1589e-05 2024-09-17T02:22:14.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:14.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208217+0000", 2024-09-17T02:22:14.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0242e-05 2024-09-17T02:22:14.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:14.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208227+0000", 2024-09-17T02:22:14.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0256e-05 2024-09-17T02:22:14.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:14.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223908+0000", 2024-09-17T02:22:14.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015680726999999998 2024-09-17T02:22:14.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:14.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223969+0000", 2024-09-17T02:22:14.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1277000000000003e-05 2024-09-17T02:22:14.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:14.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240509+0000", 2024-09-17T02:22:14.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016539484 2024-09-17T02:22:14.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:14.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240588+0000", 2024-09-17T02:22:14.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9585999999999993e-05 2024-09-17T02:22:14.898 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.898 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:14.898 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.899 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190958 5.3 e65/64 5:c9337cc4:::benchmark_data_smithi001_23533_object62841:head v 65'12049, mlcod=0'0)", 2024-09-17T02:22:14.899 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.209746+0000", 2024-09-17T02:22:14.899 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6025415990000003, 2024-09-17T02:22:14.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030921212999999999, 2024-09-17T02:22:14.899 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:14.899 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:14.899 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:14.899 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:14.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:14.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209746+0000", 2024-09-17T02:22:14.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:14.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209746+0000", 2024-09-17T02:22:14.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:14.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209748+0000", 2024-09-17T02:22:14.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9989999999999998e-06 2024-09-17T02:22:14.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:14.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209761+0000", 2024-09-17T02:22:14.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3317e-05 2024-09-17T02:22:14.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:14.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209786+0000", 2024-09-17T02:22:14.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4941999999999999e-05 2024-09-17T02:22:14.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:14.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209799+0000", 2024-09-17T02:22:14.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2556e-05 2024-09-17T02:22:14.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:14.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.226753+0000", 2024-09-17T02:22:14.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016954100999999999 2024-09-17T02:22:14.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:14.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.226810+0000", 2024-09-17T02:22:14.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7207000000000003e-05 2024-09-17T02:22:14.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:14.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240599+0000", 2024-09-17T02:22:14.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013789228000000001 2024-09-17T02:22:14.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:14.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240667+0000", 2024-09-17T02:22:14.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7862999999999997e-05 2024-09-17T02:22:14.903 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.903 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:14.903 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.903 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:191023 5.3 e65/64 5:cfca4af2:::benchmark_data_smithi001_23533_object62906:head v 65'12050, mlcod=0'0)", 2024-09-17T02:22:14.904 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.210919+0000", 2024-09-17T02:22:14.904 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6013682429999996, 2024-09-17T02:22:14.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029830820000000001, 2024-09-17T02:22:14.904 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:14.904 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:14.904 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:14.904 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:14.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:14.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210919+0000", 2024-09-17T02:22:14.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:14.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210919+0000", 2024-09-17T02:22:14.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:14.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210921+0000", 2024-09-17T02:22:14.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-09-17T02:22:14.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:14.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210935+0000", 2024-09-17T02:22:14.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3436e-05 2024-09-17T02:22:14.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:14.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210961+0000", 2024-09-17T02:22:14.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6767999999999999e-05 2024-09-17T02:22:14.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:14.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210974+0000", 2024-09-17T02:22:14.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2904e-05 2024-09-17T02:22:14.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:14.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229967+0000", 2024-09-17T02:22:14.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018992774 2024-09-17T02:22:14.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:14.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.230023+0000", 2024-09-17T02:22:14.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6334e-05 2024-09-17T02:22:14.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:14.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240673+0000", 2024-09-17T02:22:14.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010649908 2024-09-17T02:22:14.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:14.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240750+0000", 2024-09-17T02:22:14.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6556000000000004e-05 2024-09-17T02:22:14.908 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.908 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:14.908 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.908 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:191048 5.3 e65/64 5:c4115f14:::benchmark_data_smithi001_23533_object62931:head v 65'12051, mlcod=0'0)", 2024-09-17T02:22:14.908 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.211763+0000", 2024-09-17T02:22:14.908 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.600524321, 2024-09-17T02:22:14.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029064577000000001, 2024-09-17T02:22:14.909 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:14.909 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:14.909 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:14.909 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:14.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:14.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211763+0000", 2024-09-17T02:22:14.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:14.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211763+0000", 2024-09-17T02:22:14.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:14.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211765+0000", 2024-09-17T02:22:14.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.717e-06 2024-09-17T02:22:14.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:14.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211776+0000", 2024-09-17T02:22:14.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1358999999999999e-05 2024-09-17T02:22:14.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:14.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211806+0000", 2024-09-17T02:22:14.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9924999999999999e-05 2024-09-17T02:22:14.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:14.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211824+0000", 2024-09-17T02:22:14.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7782999999999999e-05 2024-09-17T02:22:14.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:14.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.232521+0000", 2024-09-17T02:22:14.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020696902 2024-09-17T02:22:14.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:14.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.232574+0000", 2024-09-17T02:22:14.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3044000000000002e-05 2024-09-17T02:22:14.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:14.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240757+0000", 2024-09-17T02:22:14.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081828579999999995 2024-09-17T02:22:14.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:14.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240828+0000", 2024-09-17T02:22:14.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0988999999999994e-05 2024-09-17T02:22:14.913 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.913 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:14.913 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.913 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:191114 5.3 e65/64 5:c2a7e5a9:::benchmark_data_smithi001_23533_object62997:head v 65'12054, mlcod=63'12038)", 2024-09-17T02:22:14.913 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.217495+0000", 2024-09-17T02:22:14.913 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.5947926900000002, 2024-09-17T02:22:14.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029944788, 2024-09-17T02:22:14.913 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:14.913 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:14.913 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:14.913 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:14.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:14.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217495+0000", 2024-09-17T02:22:14.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:14.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217495+0000", 2024-09-17T02:22:14.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:14.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:14.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217496+0000", 2024-09-17T02:22:14.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.46e-06 2024-09-17T02:22:14.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:14.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217508+0000", 2024-09-17T02:22:14.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2157000000000001e-05 2024-09-17T02:22:14.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:14.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217535+0000", 2024-09-17T02:22:14.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7058000000000001e-05 2024-09-17T02:22:14.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:14.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217551+0000", 2024-09-17T02:22:14.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5709000000000002e-05 2024-09-17T02:22:14.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:14.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.241029+0000", 2024-09-17T02:22:14.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023478452 2024-09-17T02:22:14.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:14.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.241078+0000", 2024-09-17T02:22:14.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8068000000000001e-05 2024-09-17T02:22:14.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:14.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.247369+0000", 2024-09-17T02:22:14.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0062912740000000003 2024-09-17T02:22:14.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:14.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:14.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:14.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.247439+0000", 2024-09-17T02:22:14.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0610000000000003e-05 2024-09-17T02:22:14.917 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.917 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:14.917 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.917 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:14.917 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:14.917 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:14.919 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:14.920 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:14.919+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:15.019 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:15.019+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:15.078 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:15.079 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:22:15.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.079 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:211976 5.3 e67/64 ondisk, result = 0)", 2024-09-17T02:22:15.079 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:15.081653+0000", 2024-09-17T02:22:15.079 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00020458499999999999, 2024-09-17T02:22:15.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020588200000000001, 2024-09-17T02:22:15.079 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.079 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.079 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:15.079 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.081653+0000", 2024-09-17T02:22:15.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.081653+0000", 2024-09-17T02:22:15.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.081653+0000", 2024-09-17T02:22:15.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8599999999999999e-07 2024-09-17T02:22:15.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.081655+0000", 2024-09-17T02:22:15.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9300000000000002e-06 2024-09-17T02:22:15.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.081662+0000", 2024-09-17T02:22:15.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9949999999999999e-06 2024-09-17T02:22:15.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.081668+0000", 2024-09-17T02:22:15.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6810000000000003e-06 2024-09-17T02:22:15.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.081708+0000", 2024-09-17T02:22:15.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0485999999999998e-05 2024-09-17T02:22:15.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.081717+0000", 2024-09-17T02:22:15.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7390000000000005e-06 2024-09-17T02:22:15.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:15.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.081859+0000", 2024-09-17T02:22:15.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141765 2024-09-17T02:22:15.083 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.083 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.083 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.083 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:211980 5.b e67/51 ondisk, result = 0)", 2024-09-17T02:22:15.083 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:15.081683+0000", 2024-09-17T02:22:15.083 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.000174573, 2024-09-17T02:22:15.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029164300000000001, 2024-09-17T02:22:15.083 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.083 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.083 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:15.084 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.081683+0000", 2024-09-17T02:22:15.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.081683+0000", 2024-09-17T02:22:15.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.081683+0000", 2024-09-17T02:22:15.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3200000000000001e-07 2024-09-17T02:22:15.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.081685+0000", 2024-09-17T02:22:15.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.029e-06 2024-09-17T02:22:15.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.081691+0000", 2024-09-17T02:22:15.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3620000000000002e-06 2024-09-17T02:22:15.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.081697+0000", 2024-09-17T02:22:15.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.181e-06 2024-09-17T02:22:15.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.081849+0000", 2024-09-17T02:22:15.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015211000000000001 2024-09-17T02:22:15.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.081856+0000", 2024-09-17T02:22:15.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.861e-06 2024-09-17T02:22:15.087 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.087 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.087 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.087 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:211975 5.f 5:f5ef60b9:::benchmark_data_smithi001_23533_object83858:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-17T02:22:15.087 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:15.073682+0000", 2024-09-17T02:22:15.087 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0081756840000000008, 2024-09-17T02:22:15.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083758050000000001, 2024-09-17T02:22:15.087 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.087 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.087 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:15.087 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:15.088 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:15.088 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.088 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 211975 2024-09-17T02:22:15.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.088 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.073682+0000", 2024-09-17T02:22:15.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.073682+0000", 2024-09-17T02:22:15.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.073682+0000", 2024-09-17T02:22:15.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9499999999999998e-07 2024-09-17T02:22:15.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.073684+0000", 2024-09-17T02:22:15.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3250000000000002e-06 2024-09-17T02:22:15.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.073691+0000", 2024-09-17T02:22:15.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5830000000000003e-06 2024-09-17T02:22:15.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.073696+0000", 2024-09-17T02:22:15.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1989999999999997e-06 2024-09-17T02:22:15.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.075795+0000", 2024-09-17T02:22:15.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020989300000000002 2024-09-17T02:22:15.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.075910+0000", 2024-09-17T02:22:15.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011477299999999999 2024-09-17T02:22:15.091 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.091 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.091 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.091 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:211979 5.f 5:f6b2a266:::benchmark_data_smithi001_23533_object83862:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-17T02:22:15.091 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:15.074392+0000", 2024-09-17T02:22:15.091 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0074655149999999998, 2024-09-17T02:22:15.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0077190949999999996, 2024-09-17T02:22:15.091 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.091 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.091 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:15.091 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:15.092 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:15.092 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.092 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 211979 2024-09-17T02:22:15.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.092 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.074392+0000", 2024-09-17T02:22:15.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.074392+0000", 2024-09-17T02:22:15.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.074392+0000", 2024-09-17T02:22:15.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3000000000000001e-07 2024-09-17T02:22:15.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.074395+0000", 2024-09-17T02:22:15.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8540000000000001e-06 2024-09-17T02:22:15.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.074403+0000", 2024-09-17T02:22:15.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1640000000000001e-06 2024-09-17T02:22:15.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.074409+0000", 2024-09-17T02:22:15.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4380000000000003e-06 2024-09-17T02:22:15.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.077862+0000", 2024-09-17T02:22:15.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034532510000000001 2024-09-17T02:22:15.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.077992+0000", 2024-09-17T02:22:15.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000129462 2024-09-17T02:22:15.095 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.095 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.095 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.095 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:211981 5.f 5:f4b95e5e:::benchmark_data_smithi001_23533_object83864:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-17T02:22:15.095 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:15.075828+0000", 2024-09-17T02:22:15.095 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0060297650000000003, 2024-09-17T02:22:15.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0063414739999999997, 2024-09-17T02:22:15.095 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.095 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.096 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:15.096 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:15.096 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:15.096 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.096 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 211981 2024-09-17T02:22:15.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.096 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.075828+0000", 2024-09-17T02:22:15.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.075828+0000", 2024-09-17T02:22:15.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.075828+0000", 2024-09-17T02:22:15.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4700000000000002e-07 2024-09-17T02:22:15.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.075830+0000", 2024-09-17T02:22:15.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2520000000000002e-06 2024-09-17T02:22:15.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.075836+0000", 2024-09-17T02:22:15.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1210000000000003e-06 2024-09-17T02:22:15.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.075841+0000", 2024-09-17T02:22:15.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7559999999999999e-06 2024-09-17T02:22:15.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.079565+0000", 2024-09-17T02:22:15.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037237239999999999 2024-09-17T02:22:15.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.079641+0000", 2024-09-17T02:22:15.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6446999999999995e-05 2024-09-17T02:22:15.099 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.099 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.099 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.099 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:211982 5.f 5:f443836a:::benchmark_data_smithi001_23533_object83865:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-17T02:22:15.099 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:15.075852+0000", 2024-09-17T02:22:15.099 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0060058869999999997, 2024-09-17T02:22:15.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0063681989999999997, 2024-09-17T02:22:15.099 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.100 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.100 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:15.100 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:15.100 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:15.100 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.100 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 211982 2024-09-17T02:22:15.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.100 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.075852+0000", 2024-09-17T02:22:15.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.075852+0000", 2024-09-17T02:22:15.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.075852+0000", 2024-09-17T02:22:15.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0600000000000001e-07 2024-09-17T02:22:15.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.075854+0000", 2024-09-17T02:22:15.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.933e-06 2024-09-17T02:22:15.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.075860+0000", 2024-09-17T02:22:15.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6899999999999997e-06 2024-09-17T02:22:15.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.075864+0000", 2024-09-17T02:22:15.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5519999999999998e-06 2024-09-17T02:22:15.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.080560+0000", 2024-09-17T02:22:15.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046957190000000001 2024-09-17T02:22:15.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.080632+0000", 2024-09-17T02:22:15.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1675999999999996e-05 2024-09-17T02:22:15.103 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.103 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.103 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.103 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:211985 5.3 5:c2c09227:::benchmark_data_smithi001_23533_object83868:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-17T02:22:15.103 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:15.076334+0000", 2024-09-17T02:22:15.103 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.005523048, 2024-09-17T02:22:15.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059286729999999998, 2024-09-17T02:22:15.104 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.104 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.104 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:15.104 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:15.104 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:15.104 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.104 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 211985 2024-09-17T02:22:15.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.104 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076334+0000", 2024-09-17T02:22:15.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076334+0000", 2024-09-17T02:22:15.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076335+0000", 2024-09-17T02:22:15.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7000000000000004e-07 2024-09-17T02:22:15.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076339+0000", 2024-09-17T02:22:15.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5130000000000001e-06 2024-09-17T02:22:15.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076347+0000", 2024-09-17T02:22:15.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7509999999999997e-06 2024-09-17T02:22:15.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076352+0000", 2024-09-17T02:22:15.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8110000000000002e-06 2024-09-17T02:22:15.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076589+0000", 2024-09-17T02:22:15.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023672999999999999 2024-09-17T02:22:15.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076721+0000", 2024-09-17T02:22:15.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000132409 2024-09-17T02:22:15.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:15.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076858+0000", 2024-09-17T02:22:15.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013698399999999999 2024-09-17T02:22:15.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:15.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.079134+0000", 2024-09-17T02:22:15.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022756529999999999 2024-09-17T02:22:15.108 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.108 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.108 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.108 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:211988 5.f 5:f8802f8f:::benchmark_data_smithi001_23533_object83871:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-17T02:22:15.108 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:15.076397+0000", 2024-09-17T02:22:15.108 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0054602449999999999, 2024-09-17T02:22:15.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005920514, 2024-09-17T02:22:15.109 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.109 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.109 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:15.109 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:15.109 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:15.109 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.109 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 211988 2024-09-17T02:22:15.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.109 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076397+0000", 2024-09-17T02:22:15.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076397+0000", 2024-09-17T02:22:15.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076398+0000", 2024-09-17T02:22:15.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5299999999999999e-07 2024-09-17T02:22:15.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076400+0000", 2024-09-17T02:22:15.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4660000000000002e-06 2024-09-17T02:22:15.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076407+0000", 2024-09-17T02:22:15.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.652e-06 2024-09-17T02:22:15.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076413+0000", 2024-09-17T02:22:15.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5370000000000003e-06 2024-09-17T02:22:15.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.081455+0000", 2024-09-17T02:22:15.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050420029999999998 2024-09-17T02:22:15.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.081525+0000", 2024-09-17T02:22:15.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9330000000000002e-05 2024-09-17T02:22:15.112 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.112 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.112 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.113 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:211989 5.1 5:806649d0:::benchmark_data_smithi001_23533_object83872:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-17T02:22:15.113 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:15.076680+0000", 2024-09-17T02:22:15.113 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0051778570000000001, 2024-09-17T02:22:15.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056815069999999997, 2024-09-17T02:22:15.113 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.113 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.113 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:15.113 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:15.113 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:15.113 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.113 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 211989 2024-09-17T02:22:15.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.113 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076680+0000", 2024-09-17T02:22:15.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076680+0000", 2024-09-17T02:22:15.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076680+0000", 2024-09-17T02:22:15.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6700000000000002e-07 2024-09-17T02:22:15.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076685+0000", 2024-09-17T02:22:15.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4900000000000002e-06 2024-09-17T02:22:15.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076718+0000", 2024-09-17T02:22:15.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2796999999999998e-05 2024-09-17T02:22:15.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076725+0000", 2024-09-17T02:22:15.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5630000000000003e-06 2024-09-17T02:22:15.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.078250+0000", 2024-09-17T02:22:15.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015246649999999999 2024-09-17T02:22:15.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.078372+0000", 2024-09-17T02:22:15.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012215199999999999 2024-09-17T02:22:15.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:15.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.078483+0000", 2024-09-17T02:22:15.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011048900000000001 2024-09-17T02:22:15.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:15.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.079979+0000", 2024-09-17T02:22:15.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014968169999999999 2024-09-17T02:22:15.117 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.117 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.117 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.118 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:211990 5.4 5:27e6c39d:::benchmark_data_smithi001_23533_object83873:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-17T02:22:15.118 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:15.076737+0000", 2024-09-17T02:22:15.118 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0051206649999999999, 2024-09-17T02:22:15.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056763639999999997, 2024-09-17T02:22:15.118 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.118 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.118 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:15.118 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:15.118 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:15.118 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.118 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 211990 2024-09-17T02:22:15.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.119 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076737+0000", 2024-09-17T02:22:15.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076737+0000", 2024-09-17T02:22:15.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076737+0000", 2024-09-17T02:22:15.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4199999999999996e-07 2024-09-17T02:22:15.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076740+0000", 2024-09-17T02:22:15.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9179999999999998e-06 2024-09-17T02:22:15.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076747+0000", 2024-09-17T02:22:15.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1550000000000001e-06 2024-09-17T02:22:15.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076752+0000", 2024-09-17T02:22:15.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8899999999999998e-06 2024-09-17T02:22:15.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076805+0000", 2024-09-17T02:22:15.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2827000000000001e-05 2024-09-17T02:22:15.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.076919+0000", 2024-09-17T02:22:15.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114052 2024-09-17T02:22:15.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:15.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.077024+0000", 2024-09-17T02:22:15.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000104912 2024-09-17T02:22:15.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:15.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:15.079155+0000", 2024-09-17T02:22:15.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021307420000000001 2024-09-17T02:22:15.122 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.122 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.122 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.122 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.122 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:22:15.123 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 10 2024-09-17T02:22:15.123 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:15.124 INFO:teuthology.orchestra.run.smithi001.stderr:nodeep-scrub is unset 2024-09-17T02:22:15.124 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:15.124+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:15.125 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:15.225 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:15.223+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:15.326 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:15.326 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:22:15.326 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:22:15.326 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:22:15.326 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:15.326 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:15.327+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:15.344 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:15.427 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:15.428+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:15.529 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:15.531+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:15.541 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:15.541 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:22:15.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:22:15.542 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:22:15.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.542 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97749 5.b 5:d930ef52:::benchmark_data_smithi001_23533_object97748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:15.542 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:15.542 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.948416977999997, 2024-09-17T02:22:15.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092964343000000005, 2024-09-17T02:22:15.542 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.542 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.542 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:15.542 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:15.542 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:15.542 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.543 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97749 2024-09-17T02:22:15.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.543 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:15.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:15.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591947+0000", 2024-09-17T02:22:15.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:22:15.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592011+0000", 2024-09-17T02:22:15.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3608000000000005e-05 2024-09-17T02:22:15.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592021+0000", 2024-09-17T02:22:15.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9979999999999998e-06 2024-09-17T02:22:15.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.545 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592028+0000", 2024-09-17T02:22:15.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1439999999999997e-06 2024-09-17T02:22:15.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.545 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593633+0000", 2024-09-17T02:22:15.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001604636 2024-09-17T02:22:15.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593757+0000", 2024-09-17T02:22:15.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012432099999999999 2024-09-17T02:22:15.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:15.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593866+0000", 2024-09-17T02:22:15.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109094 2024-09-17T02:22:15.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:15.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601190+0000", 2024-09-17T02:22:15.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073237620000000002 2024-09-17T02:22:15.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:15.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601356+0000", 2024-09-17T02:22:15.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016651900000000001 2024-09-17T02:22:15.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:15.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684618+0000", 2024-09-17T02:22:15.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083261356999999994 2024-09-17T02:22:15.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:15.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684724+0000", 2024-09-17T02:22:15.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010681800000000001 2024-09-17T02:22:15.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.548 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:15.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684911+0000", 2024-09-17T02:22:15.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186243 2024-09-17T02:22:15.548 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.548 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.548 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.548 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.549 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97752 5.b 5:d146f486:::benchmark_data_smithi001_23533_object97751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:15.549 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:15.549 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.947064284, 2024-09-17T02:22:15.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091989557, 2024-09-17T02:22:15.549 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.549 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.549 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:15.549 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:15.549 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:15.549 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.549 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97752 2024-09-17T02:22:15.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.549 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:15.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:15.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593300+0000", 2024-09-17T02:22:15.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8199999999999998e-07 2024-09-17T02:22:15.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.551 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593364+0000", 2024-09-17T02:22:15.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3831999999999995e-05 2024-09-17T02:22:15.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.551 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593376+0000", 2024-09-17T02:22:15.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1800999999999999e-05 2024-09-17T02:22:15.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593382+0000", 2024-09-17T02:22:15.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6780000000000003e-06 2024-09-17T02:22:15.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595491+0000", 2024-09-17T02:22:15.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021090689999999999 2024-09-17T02:22:15.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595614+0000", 2024-09-17T02:22:15.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012321500000000001 2024-09-17T02:22:15.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:15.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595778+0000", 2024-09-17T02:22:15.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016321900000000001 2024-09-17T02:22:15.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:15.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601197+0000", 2024-09-17T02:22:15.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054195600000000003 2024-09-17T02:22:15.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:15.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601396+0000", 2024-09-17T02:22:15.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019825299999999999 2024-09-17T02:22:15.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:15.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684990+0000", 2024-09-17T02:22:15.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083594878999999997 2024-09-17T02:22:15.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:15.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685116+0000", 2024-09-17T02:22:15.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012522799999999999 2024-09-17T02:22:15.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:15.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685289+0000", 2024-09-17T02:22:15.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172941 2024-09-17T02:22:15.555 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.555 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.555 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.555 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97754 5.b 5:da0615e5:::benchmark_data_smithi001_23533_object97753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:15.555 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:15.555 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.945426361999999, 2024-09-17T02:22:15.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092097207, 2024-09-17T02:22:15.555 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.555 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.556 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:15.556 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:15.556 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:15.556 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.556 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97754 2024-09-17T02:22:15.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.556 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:15.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:15.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594938+0000", 2024-09-17T02:22:15.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5000000000000002e-07 2024-09-17T02:22:15.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595075+0000", 2024-09-17T02:22:15.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137742 2024-09-17T02:22:15.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595087+0000", 2024-09-17T02:22:15.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1243000000000001e-05 2024-09-17T02:22:15.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595095+0000", 2024-09-17T02:22:15.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1030000000000002e-06 2024-09-17T02:22:15.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598461+0000", 2024-09-17T02:22:15.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033661170000000001 2024-09-17T02:22:15.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598540+0000", 2024-09-17T02:22:15.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8937999999999995e-05 2024-09-17T02:22:15.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:15.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598626+0000", 2024-09-17T02:22:15.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6042000000000001e-05 2024-09-17T02:22:15.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:15.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684258+0000", 2024-09-17T02:22:15.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085632394000000001 2024-09-17T02:22:15.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:15.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685369+0000", 2024-09-17T02:22:15.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001111063 2024-09-17T02:22:15.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:15.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685511+0000", 2024-09-17T02:22:15.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141965 2024-09-17T02:22:15.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:15.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685604+0000", 2024-09-17T02:22:15.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2935000000000004e-05 2024-09-17T02:22:15.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:15.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687034+0000", 2024-09-17T02:22:15.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001430015 2024-09-17T02:22:15.561 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.561 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.561 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.561 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97755 5.b 5:d36a03a1:::benchmark_data_smithi001_23533_object97754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:15.562 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:15.562 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.945253211999997, 2024-09-17T02:22:15.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0924904, 2024-09-17T02:22:15.562 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.562 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.562 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:15.562 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:15.562 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:15.562 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.562 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97755 2024-09-17T02:22:15.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.562 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:15.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:15.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595111+0000", 2024-09-17T02:22:15.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:22:15.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595145+0000", 2024-09-17T02:22:15.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3927000000000002e-05 2024-09-17T02:22:15.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595155+0000", 2024-09-17T02:22:15.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0023e-05 2024-09-17T02:22:15.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595162+0000", 2024-09-17T02:22:15.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3950000000000003e-06 2024-09-17T02:22:15.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599821+0000", 2024-09-17T02:22:15.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046592880000000001 2024-09-17T02:22:15.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599912+0000", 2024-09-17T02:22:15.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1049000000000002e-05 2024-09-17T02:22:15.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:15.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600062+0000", 2024-09-17T02:22:15.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015001700000000001 2024-09-17T02:22:15.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:15.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685307+0000", 2024-09-17T02:22:15.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085244340000000002 2024-09-17T02:22:15.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:15.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685446+0000", 2024-09-17T02:22:15.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013955700000000001 2024-09-17T02:22:15.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:15.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687375+0000", 2024-09-17T02:22:15.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019291079999999999 2024-09-17T02:22:15.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:15.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687462+0000", 2024-09-17T02:22:15.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6148000000000003e-05 2024-09-17T02:22:15.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:15.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687600+0000", 2024-09-17T02:22:15.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013887900000000001 2024-09-17T02:22:15.567 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.567 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.568 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.568 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 44/44 lb 5:c4567a04:::benchmark_data_smithi001_23533_object4200:head)", 2024-09-17T02:22:15.568 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:15.568 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.943156586000001, 2024-09-17T02:22:15.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092483421999999996, 2024-09-17T02:22:15.568 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.568 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.568 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:15.568 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:15.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:15.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:15.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6399999999999998e-07 2024-09-17T02:22:15.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597213+0000", 2024-09-17T02:22:15.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3659999999999997e-06 2024-09-17T02:22:15.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597222+0000", 2024-09-17T02:22:15.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0510000000000002e-06 2024-09-17T02:22:15.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597228+0000", 2024-09-17T02:22:15.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1569999999999999e-06 2024-09-17T02:22:15.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689588+0000", 2024-09-17T02:22:15.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092359931000000006 2024-09-17T02:22:15.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689622+0000", 2024-09-17T02:22:15.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4425999999999999e-05 2024-09-17T02:22:15.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:15.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689690+0000", 2024-09-17T02:22:15.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8126999999999993e-05 2024-09-17T02:22:15.572 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.572 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.572 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.572 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129462 5.4 5:2e0acc16:::benchmark_data_smithi001_23533_object1345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:15.572 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:15.572 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.005422517, 2024-09-17T02:22:15.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0112774899999999, 2024-09-17T02:22:15.572 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.572 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.572 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:15.572 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:15.572 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:15.573 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.573 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129462 2024-09-17T02:22:15.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.573 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:15.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:15.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534943+0000", 2024-09-17T02:22:15.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8759999999999999e-06 2024-09-17T02:22:15.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534951+0000", 2024-09-17T02:22:15.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3219999999999993e-06 2024-09-17T02:22:15.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534977+0000", 2024-09-17T02:22:15.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6245e-05 2024-09-17T02:22:15.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534992+0000", 2024-09-17T02:22:15.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4936000000000001e-05 2024-09-17T02:22:15.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535133+0000", 2024-09-17T02:22:15.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014051299999999999 2024-09-17T02:22:15.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:15.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:22:15.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1741000000000001e-05 2024-09-17T02:22:15.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.533906+0000", 2024-09-17T02:22:15.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99875209300000001 2024-09-17T02:22:15.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534348+0000", 2024-09-17T02:22:15.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044128899999999998 2024-09-17T02:22:15.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:15.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534762+0000", 2024-09-17T02:22:15.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000414707 2024-09-17T02:22:15.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:15.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545024+0000", 2024-09-17T02:22:15.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010261283 2024-09-17T02:22:15.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:15.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545953+0000", 2024-09-17T02:22:15.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000929618 2024-09-17T02:22:15.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:15.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546047+0000", 2024-09-17T02:22:15.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3697999999999996e-05 2024-09-17T02:22:15.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:15.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546218+0000", 2024-09-17T02:22:15.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017116899999999999 2024-09-17T02:22:15.578 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.578 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.578 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.579 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129480 5.4 5:2b1d398b:::benchmark_data_smithi001_23533_object1363:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:15.579 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:15.579 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.997668050999998, 2024-09-17T02:22:15.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0038926450000001, 2024-09-17T02:22:15.579 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.579 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.579 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:15.579 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:15.579 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:15.579 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.579 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129480 2024-09-17T02:22:15.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.580 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:15.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:15.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542696+0000", 2024-09-17T02:22:15.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9999999999999995e-07 2024-09-17T02:22:15.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542701+0000", 2024-09-17T02:22:15.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2240000000000003e-06 2024-09-17T02:22:15.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542716+0000", 2024-09-17T02:22:15.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4970000000000001e-05 2024-09-17T02:22:15.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542726+0000", 2024-09-17T02:22:15.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2879999999999998e-06 2024-09-17T02:22:15.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542832+0000", 2024-09-17T02:22:15.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010597199999999999 2024-09-17T02:22:15.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:15.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542843+0000", 2024-09-17T02:22:15.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.098e-05 2024-09-17T02:22:15.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538436+0000", 2024-09-17T02:22:15.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99559286800000002 2024-09-17T02:22:15.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538791+0000", 2024-09-17T02:22:15.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035585499999999997 2024-09-17T02:22:15.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:15.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.539144+0000", 2024-09-17T02:22:15.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035268499999999999 2024-09-17T02:22:15.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:15.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545880+0000", 2024-09-17T02:22:15.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00673552 2024-09-17T02:22:15.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:15.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546330+0000", 2024-09-17T02:22:15.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045039599999999999 2024-09-17T02:22:15.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:15.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546414+0000", 2024-09-17T02:22:15.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4468000000000005e-05 2024-09-17T02:22:15.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:15.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546588+0000", 2024-09-17T02:22:15.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017341899999999999 2024-09-17T02:22:15.585 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.585 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.585 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.586 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129505 5.4 5:294f2ec7:::benchmark_data_smithi001_23533_object1388:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:15.586 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:15.586 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.978654878, 2024-09-17T02:22:15.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98589826199999997, 2024-09-17T02:22:15.586 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.586 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.586 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:15.586 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:15.586 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:15.586 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.586 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129505 2024-09-17T02:22:15.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.586 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:15.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:15.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561710+0000", 2024-09-17T02:22:15.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7060000000000001e-06 2024-09-17T02:22:15.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561718+0000", 2024-09-17T02:22:15.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.542e-06 2024-09-17T02:22:15.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561741+0000", 2024-09-17T02:22:15.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3357e-05 2024-09-17T02:22:15.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561754+0000", 2024-09-17T02:22:15.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3200000000000001e-05 2024-09-17T02:22:15.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561867+0000", 2024-09-17T02:22:15.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113211 2024-09-17T02:22:15.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:15.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561888+0000", 2024-09-17T02:22:15.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0809999999999999e-05 2024-09-17T02:22:15.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542140+0000", 2024-09-17T02:22:15.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98025195799999998 2024-09-17T02:22:15.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542331+0000", 2024-09-17T02:22:15.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019127599999999999 2024-09-17T02:22:15.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:15.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542517+0000", 2024-09-17T02:22:15.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000185625 2024-09-17T02:22:15.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:15.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547114+0000", 2024-09-17T02:22:15.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045968620000000002 2024-09-17T02:22:15.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:15.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547187+0000", 2024-09-17T02:22:15.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3348000000000003e-05 2024-09-17T02:22:15.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:15.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547324+0000", 2024-09-17T02:22:15.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013681699999999999 2024-09-17T02:22:15.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:15.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547607+0000", 2024-09-17T02:22:15.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028255000000000001 2024-09-17T02:22:15.592 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.592 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.592 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.593 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129508 5.4 5:2892b582:::benchmark_data_smithi001_23533_object1391:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:15.593 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:15.593 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.977317784999997, 2024-09-17T02:22:15.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99697919099999999, 2024-09-17T02:22:15.593 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.593 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.593 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:15.593 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:15.593 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:15.593 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.593 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129508 2024-09-17T02:22:15.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.593 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:15.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:15.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563047+0000", 2024-09-17T02:22:15.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.274e-06 2024-09-17T02:22:15.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563054+0000", 2024-09-17T02:22:15.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2799999999999998e-06 2024-09-17T02:22:15.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563070+0000", 2024-09-17T02:22:15.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5991999999999999e-05 2024-09-17T02:22:15.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563078+0000", 2024-09-17T02:22:15.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2390000000000002e-06 2024-09-17T02:22:15.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563181+0000", 2024-09-17T02:22:15.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102249 2024-09-17T02:22:15.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:15.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563199+0000", 2024-09-17T02:22:15.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8215000000000001e-05 2024-09-17T02:22:15.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547713+0000", 2024-09-17T02:22:15.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98451446399999998 2024-09-17T02:22:15.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548063+0000", 2024-09-17T02:22:15.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034985499999999999 2024-09-17T02:22:15.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:15.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548490+0000", 2024-09-17T02:22:15.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042658600000000001 2024-09-17T02:22:15.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:15.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555655+0000", 2024-09-17T02:22:15.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071652579999999999 2024-09-17T02:22:15.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:15.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559612+0000", 2024-09-17T02:22:15.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003957103 2024-09-17T02:22:15.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:15.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559768+0000", 2024-09-17T02:22:15.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015556899999999999 2024-09-17T02:22:15.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:15.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560025+0000", 2024-09-17T02:22:15.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025710700000000002 2024-09-17T02:22:15.599 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.599 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.599 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.599 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129509 5.4 5:2c35515e:::benchmark_data_smithi001_23533_object1392:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:15.599 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:15.599 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.976690732000002, 2024-09-17T02:22:15.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99969384900000002, 2024-09-17T02:22:15.600 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.600 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.600 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:15.600 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:15.600 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:15.600 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.600 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129509 2024-09-17T02:22:15.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.600 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:15.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:15.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563674+0000", 2024-09-17T02:22:15.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0920000000000001e-06 2024-09-17T02:22:15.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563679+0000", 2024-09-17T02:22:15.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7660000000000004e-06 2024-09-17T02:22:15.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563693+0000", 2024-09-17T02:22:15.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3139000000000001e-05 2024-09-17T02:22:15.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563701+0000", 2024-09-17T02:22:15.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9859999999999994e-06 2024-09-17T02:22:15.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563775+0000", 2024-09-17T02:22:15.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4659000000000005e-05 2024-09-17T02:22:15.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:15.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563785+0000", 2024-09-17T02:22:15.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4839999999999993e-06 2024-09-17T02:22:15.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552085+0000", 2024-09-17T02:22:15.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98829986999999997 2024-09-17T02:22:15.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552554+0000", 2024-09-17T02:22:15.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046908900000000001 2024-09-17T02:22:15.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:15.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552931+0000", 2024-09-17T02:22:15.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377778 2024-09-17T02:22:15.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:15.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563106+0000", 2024-09-17T02:22:15.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010174186 2024-09-17T02:22:15.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:15.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563138+0000", 2024-09-17T02:22:15.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2495e-05 2024-09-17T02:22:15.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:15.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563225+0000", 2024-09-17T02:22:15.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6677999999999999e-05 2024-09-17T02:22:15.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:15.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563366+0000", 2024-09-17T02:22:15.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014162699999999999 2024-09-17T02:22:15.606 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.606 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.606 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.606 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129524 5.4 5:25dca7dd:::benchmark_data_smithi001_23533_object1407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:15.606 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:15.607 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.969999377999997, 2024-09-17T02:22:15.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99999501999999996, 2024-09-17T02:22:15.607 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.607 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.607 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:15.607 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:15.607 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:15.607 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.607 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129524 2024-09-17T02:22:15.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.607 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:15.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:15.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570365+0000", 2024-09-17T02:22:15.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.142e-06 2024-09-17T02:22:15.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570369+0000", 2024-09-17T02:22:15.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.856e-06 2024-09-17T02:22:15.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570385+0000", 2024-09-17T02:22:15.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5855e-05 2024-09-17T02:22:15.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570392+0000", 2024-09-17T02:22:15.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5340000000000002e-06 2024-09-17T02:22:15.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570484+0000", 2024-09-17T02:22:15.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1212999999999996e-05 2024-09-17T02:22:15.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:15.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570498+0000", 2024-09-17T02:22:15.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4331000000000001e-05 2024-09-17T02:22:15.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555835+0000", 2024-09-17T02:22:15.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98533757700000002 2024-09-17T02:22:15.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556329+0000", 2024-09-17T02:22:15.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000493458 2024-09-17T02:22:15.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:15.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556784+0000", 2024-09-17T02:22:15.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045476499999999999 2024-09-17T02:22:15.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:15.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569852+0000", 2024-09-17T02:22:15.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013068270999999999 2024-09-17T02:22:15.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:15.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569958+0000", 2024-09-17T02:22:15.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106214 2024-09-17T02:22:15.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:15.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570124+0000", 2024-09-17T02:22:15.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165546 2024-09-17T02:22:15.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:15.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570359+0000", 2024-09-17T02:22:15.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023525799999999999 2024-09-17T02:22:15.613 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.613 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.613 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.613 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129537 5.4 5:260327c6:::benchmark_data_smithi001_23533_object1420:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:15.613 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:15.613 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.962092849000001, 2024-09-17T02:22:15.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99624596499999996, 2024-09-17T02:22:15.614 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.614 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.614 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:15.614 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:15.614 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:15.614 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.614 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129537 2024-09-17T02:22:15.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.614 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:15.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:15.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578272+0000", 2024-09-17T02:22:15.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.164e-06 2024-09-17T02:22:15.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578278+0000", 2024-09-17T02:22:15.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5060000000000001e-06 2024-09-17T02:22:15.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578294+0000", 2024-09-17T02:22:15.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5687000000000001e-05 2024-09-17T02:22:15.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578329+0000", 2024-09-17T02:22:15.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5311999999999997e-05 2024-09-17T02:22:15.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578419+0000", 2024-09-17T02:22:15.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0054000000000002e-05 2024-09-17T02:22:15.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:15.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578435+0000", 2024-09-17T02:22:15.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5645999999999999e-05 2024-09-17T02:22:15.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560148+0000", 2024-09-17T02:22:15.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98171342299999997 2024-09-17T02:22:15.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560383+0000", 2024-09-17T02:22:15.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000234935 2024-09-17T02:22:15.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:15.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560586+0000", 2024-09-17T02:22:15.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000202909 2024-09-17T02:22:15.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:15.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570472+0000", 2024-09-17T02:22:15.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098856959999999994 2024-09-17T02:22:15.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:15.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574138+0000", 2024-09-17T02:22:15.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036660170000000001 2024-09-17T02:22:15.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:15.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574298+0000", 2024-09-17T02:22:15.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016025600000000001 2024-09-17T02:22:15.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:15.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574516+0000", 2024-09-17T02:22:15.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021835999999999999 2024-09-17T02:22:15.620 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.620 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.620 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.620 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129545 5.4 5:22366489:::benchmark_data_smithi001_23533_object1428:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:15.620 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:15.620 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.956230126000001, 2024-09-17T02:22:15.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99074544499999995, 2024-09-17T02:22:15.620 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.620 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.621 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:15.621 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:15.621 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:15.621 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.621 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129545 2024-09-17T02:22:15.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.621 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:15.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:15.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584135+0000", 2024-09-17T02:22:15.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4699999999999999e-06 2024-09-17T02:22:15.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584142+0000", 2024-09-17T02:22:15.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1620000000000002e-06 2024-09-17T02:22:15.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584170+0000", 2024-09-17T02:22:15.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7897000000000001e-05 2024-09-17T02:22:15.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584183+0000", 2024-09-17T02:22:15.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2814e-05 2024-09-17T02:22:15.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584299+0000", 2024-09-17T02:22:15.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116153 2024-09-17T02:22:15.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:15.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584316+0000", 2024-09-17T02:22:15.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7524999999999999e-05 2024-09-17T02:22:15.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563461+0000", 2024-09-17T02:22:15.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97914436699999996 2024-09-17T02:22:15.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563667+0000", 2024-09-17T02:22:15.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020689800000000001 2024-09-17T02:22:15.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:15.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563878+0000", 2024-09-17T02:22:15.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210275 2024-09-17T02:22:15.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:15.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570584+0000", 2024-09-17T02:22:15.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067066080000000002 2024-09-17T02:22:15.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:15.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574539+0000", 2024-09-17T02:22:15.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039550360000000003 2024-09-17T02:22:15.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:15.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574653+0000", 2024-09-17T02:22:15.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114003 2024-09-17T02:22:15.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:15.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574879+0000", 2024-09-17T02:22:15.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022523700000000001 2024-09-17T02:22:15.626 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.626 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.626 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.627 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129553 5.4 5:2e41ad40:::benchmark_data_smithi001_23533_object1436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:15.627 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:15.627 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.950807490000003, 2024-09-17T02:22:15.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99213429600000003, 2024-09-17T02:22:15.627 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.627 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.627 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:15.627 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:15.627 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:15.627 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.627 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129553 2024-09-17T02:22:15.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.628 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:15.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:15.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589557+0000", 2024-09-17T02:22:15.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2219999999999999e-06 2024-09-17T02:22:15.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589562+0000", 2024-09-17T02:22:15.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0649999999999998e-06 2024-09-17T02:22:15.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589575+0000", 2024-09-17T02:22:15.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3129000000000001e-05 2024-09-17T02:22:15.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589584+0000", 2024-09-17T02:22:15.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6200000000000005e-06 2024-09-17T02:22:15.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589693+0000", 2024-09-17T02:22:15.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109319 2024-09-17T02:22:15.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:15.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589714+0000", 2024-09-17T02:22:15.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0849999999999999e-05 2024-09-17T02:22:15.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566273+0000", 2024-09-17T02:22:15.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97655884999999998 2024-09-17T02:22:15.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566543+0000", 2024-09-17T02:22:15.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027059099999999998 2024-09-17T02:22:15.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:15.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566832+0000", 2024-09-17T02:22:15.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028898200000000002 2024-09-17T02:22:15.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:15.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581040+0000", 2024-09-17T02:22:15.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014208001 2024-09-17T02:22:15.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:15.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581200+0000", 2024-09-17T02:22:15.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159956 2024-09-17T02:22:15.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:15.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581427+0000", 2024-09-17T02:22:15.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000226309 2024-09-17T02:22:15.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:15.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581690+0000", 2024-09-17T02:22:15.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026340199999999998 2024-09-17T02:22:15.633 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.633 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.634 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.634 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129580 5.4 5:25ed887b:::benchmark_data_smithi001_23533_object1463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:15.634 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:15.634 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.929035446, 2024-09-17T02:22:15.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98001430499999997, 2024-09-17T02:22:15.634 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.634 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.634 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:15.634 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:15.634 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:15.634 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.634 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129580 2024-09-17T02:22:15.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.635 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:15.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:15.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611329+0000", 2024-09-17T02:22:15.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.22e-06 2024-09-17T02:22:15.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611335+0000", 2024-09-17T02:22:15.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1129999999999997e-06 2024-09-17T02:22:15.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611348+0000", 2024-09-17T02:22:15.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2342e-05 2024-09-17T02:22:15.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611356+0000", 2024-09-17T02:22:15.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.371e-06 2024-09-17T02:22:15.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611419+0000", 2024-09-17T02:22:15.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3393999999999996e-05 2024-09-17T02:22:15.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:15.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611427+0000", 2024-09-17T02:22:15.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999997e-06 2024-09-17T02:22:15.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570705+0000", 2024-09-17T02:22:15.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.95927859199999999 2024-09-17T02:22:15.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571009+0000", 2024-09-17T02:22:15.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030414599999999998 2024-09-17T02:22:15.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:15.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571241+0000", 2024-09-17T02:22:15.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023106799999999999 2024-09-17T02:22:15.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:15.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590789+0000", 2024-09-17T02:22:15.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019548763 2024-09-17T02:22:15.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:15.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590928+0000", 2024-09-17T02:22:15.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000139092 2024-09-17T02:22:15.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:15.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591086+0000", 2024-09-17T02:22:15.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015787400000000001 2024-09-17T02:22:15.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:15.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591342+0000", 2024-09-17T02:22:15.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025589900000000002 2024-09-17T02:22:15.641 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.641 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.641 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.641 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129603 5.4 5:25aaa5e8:::benchmark_data_smithi001_23533_object1486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:15.641 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:15.641 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.91297565, 2024-09-17T02:22:15.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96463198999999999, 2024-09-17T02:22:15.641 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.641 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.642 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:15.642 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:15.642 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:15.642 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.642 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129603 2024-09-17T02:22:15.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.642 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:15.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:15.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:15.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:22:15.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627392+0000", 2024-09-17T02:22:15.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0790000000000002e-06 2024-09-17T02:22:15.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627403+0000", 2024-09-17T02:22:15.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0866000000000001e-05 2024-09-17T02:22:15.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627409+0000", 2024-09-17T02:22:15.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.305e-06 2024-09-17T02:22:15.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627485+0000", 2024-09-17T02:22:15.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6582000000000006e-05 2024-09-17T02:22:15.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:15.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627499+0000", 2024-09-17T02:22:15.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:22:15.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574991+0000", 2024-09-17T02:22:15.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94749182300000001 2024-09-17T02:22:15.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575377+0000", 2024-09-17T02:22:15.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038629400000000003 2024-09-17T02:22:15.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:15.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575665+0000", 2024-09-17T02:22:15.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028759499999999997 2024-09-17T02:22:15.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:15.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590802+0000", 2024-09-17T02:22:15.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015136479 2024-09-17T02:22:15.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:15.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591614+0000", 2024-09-17T02:22:15.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081293100000000003 2024-09-17T02:22:15.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:15.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591764+0000", 2024-09-17T02:22:15.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014932199999999999 2024-09-17T02:22:15.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:15.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592020+0000", 2024-09-17T02:22:15.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025585099999999997 2024-09-17T02:22:15.648 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.648 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.648 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.648 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129607 5.4 5:2f638f1e:::benchmark_data_smithi001_23533_object1490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:15.648 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:15.648 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.911448743999998, 2024-09-17T02:22:15.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96352375899999998, 2024-09-17T02:22:15.648 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.648 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.649 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:15.649 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:15.649 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:15.649 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.649 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129607 2024-09-17T02:22:15.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.649 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:15.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:15.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628916+0000", 2024-09-17T02:22:15.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1710000000000001e-06 2024-09-17T02:22:15.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628920+0000", 2024-09-17T02:22:15.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-17T02:22:15.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628935+0000", 2024-09-17T02:22:15.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4474000000000001e-05 2024-09-17T02:22:15.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628944+0000", 2024-09-17T02:22:15.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9940000000000006e-06 2024-09-17T02:22:15.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628997+0000", 2024-09-17T02:22:15.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3579000000000003e-05 2024-09-17T02:22:15.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:15.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.629006+0000", 2024-09-17T02:22:15.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4009999999999997e-06 2024-09-17T02:22:15.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.577862+0000", 2024-09-17T02:22:15.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.948856335 2024-09-17T02:22:15.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578167+0000", 2024-09-17T02:22:15.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030532399999999999 2024-09-17T02:22:15.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:15.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578532+0000", 2024-09-17T02:22:15.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036428200000000001 2024-09-17T02:22:15.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:15.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591442+0000", 2024-09-17T02:22:15.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012910374000000001 2024-09-17T02:22:15.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:15.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592164+0000", 2024-09-17T02:22:15.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072242499999999996 2024-09-17T02:22:15.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:15.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592267+0000", 2024-09-17T02:22:15.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102205 2024-09-17T02:22:15.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:15.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592438+0000", 2024-09-17T02:22:15.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017165299999999999 2024-09-17T02:22:15.657 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.657 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.657 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.657 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129623 5.4 5:2cf5174b:::benchmark_data_smithi001_23533_object1506:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:15.657 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:15.657 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.887504458000002, 2024-09-17T02:22:15.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94334114499999999, 2024-09-17T02:22:15.657 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.657 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.657 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:15.658 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:15.658 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:15.658 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.658 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129623 2024-09-17T02:22:15.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.658 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:15.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:15.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652860+0000", 2024-09-17T02:22:15.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0330000000000001e-06 2024-09-17T02:22:15.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652864+0000", 2024-09-17T02:22:15.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.634e-06 2024-09-17T02:22:15.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652877+0000", 2024-09-17T02:22:15.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2591e-05 2024-09-17T02:22:15.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652883+0000", 2024-09-17T02:22:15.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1460000000000001e-06 2024-09-17T02:22:15.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652943+0000", 2024-09-17T02:22:15.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9833999999999997e-05 2024-09-17T02:22:15.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:15.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652950+0000", 2024-09-17T02:22:15.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.401e-06 2024-09-17T02:22:15.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581800+0000", 2024-09-17T02:22:15.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.92884935700000004 2024-09-17T02:22:15.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582122+0000", 2024-09-17T02:22:15.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032185200000000002 2024-09-17T02:22:15.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:15.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582689+0000", 2024-09-17T02:22:15.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056750400000000003 2024-09-17T02:22:15.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:15.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591458+0000", 2024-09-17T02:22:15.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008768685 2024-09-17T02:22:15.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:15.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595856+0000", 2024-09-17T02:22:15.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043977909999999999 2024-09-17T02:22:15.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:15.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595955+0000", 2024-09-17T02:22:15.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9166000000000006e-05 2024-09-17T02:22:15.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:15.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596200+0000", 2024-09-17T02:22:15.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024515099999999998 2024-09-17T02:22:15.663 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.663 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.663 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.664 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129642 5.4 5:255eb796:::benchmark_data_smithi001_23533_object1525:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:15.664 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:15.664 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.856268294000003, 2024-09-17T02:22:15.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.91257397299999998, 2024-09-17T02:22:15.664 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.664 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.664 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:15.664 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:15.664 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:15.664 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.664 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129642 2024-09-17T02:22:15.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.665 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:15.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:15.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684096+0000", 2024-09-17T02:22:15.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659999999999999e-06 2024-09-17T02:22:15.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684101+0000", 2024-09-17T02:22:15.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8110000000000002e-06 2024-09-17T02:22:15.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684114+0000", 2024-09-17T02:22:15.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2653000000000001e-05 2024-09-17T02:22:15.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684121+0000", 2024-09-17T02:22:15.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5100000000000001e-06 2024-09-17T02:22:15.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684181+0000", 2024-09-17T02:22:15.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0307999999999999e-05 2024-09-17T02:22:15.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:15.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684194+0000", 2024-09-17T02:22:15.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2916e-05 2024-09-17T02:22:15.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.587917+0000", 2024-09-17T02:22:15.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.90372220400000003 2024-09-17T02:22:15.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588215+0000", 2024-09-17T02:22:15.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029845400000000003 2024-09-17T02:22:15.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:15.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588470+0000", 2024-09-17T02:22:15.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025455399999999999 2024-09-17T02:22:15.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:15.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596318+0000", 2024-09-17T02:22:15.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078485589999999997 2024-09-17T02:22:15.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:15.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596354+0000", 2024-09-17T02:22:15.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5976999999999998e-05 2024-09-17T02:22:15.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:15.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596449+0000", 2024-09-17T02:22:15.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4728999999999994e-05 2024-09-17T02:22:15.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:15.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596669+0000", 2024-09-17T02:22:15.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220132 2024-09-17T02:22:15.670 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.670 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.670 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.671 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129649 5.4 5:2fe27050:::benchmark_data_smithi001_23533_object1532:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:15.671 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:15.671 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.824711551, 2024-09-17T02:22:15.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.88508119100000004, 2024-09-17T02:22:15.671 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:15.671 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:15.671 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:15.671 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:15.671 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:15.671 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.671 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129649 2024-09-17T02:22:15.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.671 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:15.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:15.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:15.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:15.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:15.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:15.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:15.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715653+0000", 2024-09-17T02:22:15.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3519999999999999e-06 2024-09-17T02:22:15.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:15.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715658+0000", 2024-09-17T02:22:15.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3120000000000001e-06 2024-09-17T02:22:15.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:15.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715677+0000", 2024-09-17T02:22:15.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-17T02:22:15.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715687+0000", 2024-09-17T02:22:15.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0146000000000001e-05 2024-09-17T02:22:15.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715821+0000", 2024-09-17T02:22:15.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013421 2024-09-17T02:22:15.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:15.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715840+0000", 2024-09-17T02:22:15.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8153999999999999e-05 2024-09-17T02:22:15.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:15.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592528+0000", 2024-09-17T02:22:15.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.87668860000000004 2024-09-17T02:22:15.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:15.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592702+0000", 2024-09-17T02:22:15.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017429300000000001 2024-09-17T02:22:15.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:15.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592945+0000", 2024-09-17T02:22:15.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000242048 2024-09-17T02:22:15.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:15.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600234+0000", 2024-09-17T02:22:15.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072897600000000002 2024-09-17T02:22:15.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:15.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600494+0000", 2024-09-17T02:22:15.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000259984 2024-09-17T02:22:15.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:15.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600555+0000", 2024-09-17T02:22:15.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1138999999999999e-05 2024-09-17T02:22:15.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:15.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:15.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:15.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600733+0000", 2024-09-17T02:22:15.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017753300000000001 2024-09-17T02:22:15.677 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.677 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.677 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.677 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:15.677 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:15.677 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:15.679 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:15.679 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:15.680+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:15.779 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:15.780+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:15.834 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:15.834 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:22:15.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.834 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:213803 5.8 5:13ae3336:::benchmark_data_smithi001_23533_object85686:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T02:22:15.834 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:15.831380+0000", 2024-09-17T02:22:15.834 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0048210830000000003, 2024-09-17T02:22:15.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004843539, 2024-09-17T02:22:15.834 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:15.834 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:15.834 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:15.834 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:15.835 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:15.835 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.835 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 213803 2024-09-17T02:22:15.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.835 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:15.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:15.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.831380+0000", 2024-09-17T02:22:15.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:15.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.831380+0000", 2024-09-17T02:22:15.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:15.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.831380+0000", 2024-09-17T02:22:15.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1100000000000001e-07 2024-09-17T02:22:15.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:15.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.831382+0000", 2024-09-17T02:22:15.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1509999999999998e-06 2024-09-17T02:22:15.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:15.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.831389+0000", 2024-09-17T02:22:15.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9330000000000004e-06 2024-09-17T02:22:15.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.831395+0000", 2024-09-17T02:22:15.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9349999999999999e-06 2024-09-17T02:22:15.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:15.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.832025+0000", 2024-09-17T02:22:15.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00062932699999999995 2024-09-17T02:22:15.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:15.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.832121+0000", 2024-09-17T02:22:15.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6086000000000001e-05 2024-09-17T02:22:15.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:15.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.832213+0000", 2024-09-17T02:22:15.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2641999999999998e-05 2024-09-17T02:22:15.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:15.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834495+0000", 2024-09-17T02:22:15.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022813949999999999 2024-09-17T02:22:15.839 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.839 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:15.839 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.839 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:213807 5.c 5:3d602f52:::benchmark_data_smithi001_23533_object85690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T02:22:15.839 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:15.831680+0000", 2024-09-17T02:22:15.840 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0045208480000000001, 2024-09-17T02:22:15.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046219859999999998, 2024-09-17T02:22:15.840 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:15.840 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:15.840 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:15.840 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:15.840 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:15.840 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.840 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 213807 2024-09-17T02:22:15.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.840 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:15.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:15.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.831680+0000", 2024-09-17T02:22:15.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:15.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.831680+0000", 2024-09-17T02:22:15.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:15.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.831681+0000", 2024-09-17T02:22:15.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3900000000000004e-07 2024-09-17T02:22:15.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:15.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.831687+0000", 2024-09-17T02:22:15.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5549999999999999e-06 2024-09-17T02:22:15.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:15.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.831696+0000", 2024-09-17T02:22:15.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5930000000000006e-06 2024-09-17T02:22:15.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.831702+0000", 2024-09-17T02:22:15.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3369999999999996e-06 2024-09-17T02:22:15.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:15.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.831757+0000", 2024-09-17T02:22:15.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4681e-05 2024-09-17T02:22:15.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:15.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.831827+0000", 2024-09-17T02:22:15.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0528e-05 2024-09-17T02:22:15.843 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.843 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:15.843 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.844 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:213806 5.4 e68/52 5:2dc19037:::benchmark_data_smithi001_23533_object85689:head v 68'13135, mlcod=68'13133)", 2024-09-17T02:22:15.844 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:15.832002+0000", 2024-09-17T02:22:15.844 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.004198701, 2024-09-17T02:22:15.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043601580000000003, 2024-09-17T02:22:15.844 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:15.844 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:15.844 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:15.844 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:15.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:15.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.832002+0000", 2024-09-17T02:22:15.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:15.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.832002+0000", 2024-09-17T02:22:15.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:15.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.832003+0000", 2024-09-17T02:22:15.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2900000000000004e-07 2024-09-17T02:22:15.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:15.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.832009+0000", 2024-09-17T02:22:15.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3810000000000004e-06 2024-09-17T02:22:15.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:15.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.832017+0000", 2024-09-17T02:22:15.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0360000000000006e-06 2024-09-17T02:22:15.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.832023+0000", 2024-09-17T02:22:15.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3879999999999999e-06 2024-09-17T02:22:15.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:15.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.833786+0000", 2024-09-17T02:22:15.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017636329999999999 2024-09-17T02:22:15.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:15.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.833806+0000", 2024-09-17T02:22:15.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9758999999999998e-05 2024-09-17T02:22:15.847 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.847 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:15.847 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.848 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:213808 5.c 5:36aa6856:::benchmark_data_smithi001_23533_object85691:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T02:22:15.848 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:15.834043+0000", 2024-09-17T02:22:15.848 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.002157426, 2024-09-17T02:22:15.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023729900000000002, 2024-09-17T02:22:15.848 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:15.848 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:15.848 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:15.848 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:15.848 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:15.848 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.848 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 213808 2024-09-17T02:22:15.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.848 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:15.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:15.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834043+0000", 2024-09-17T02:22:15.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:15.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834043+0000", 2024-09-17T02:22:15.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:15.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834045+0000", 2024-09-17T02:22:15.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6199999999999999e-06 2024-09-17T02:22:15.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:15.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834049+0000", 2024-09-17T02:22:15.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8260000000000003e-06 2024-09-17T02:22:15.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:15.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834059+0000", 2024-09-17T02:22:15.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0035e-05 2024-09-17T02:22:15.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834067+0000", 2024-09-17T02:22:15.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8040000000000002e-06 2024-09-17T02:22:15.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:15.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835589+0000", 2024-09-17T02:22:15.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001521978 2024-09-17T02:22:15.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:15.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835718+0000", 2024-09-17T02:22:15.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129078 2024-09-17T02:22:15.851 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.851 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:15.851 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.852 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:213809 5.c 5.4a93f10c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T02:22:15.852 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:15.834089+0000", 2024-09-17T02:22:15.852 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.002111707, 2024-09-17T02:22:15.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023856799999999998, 2024-09-17T02:22:15.852 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:15.852 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:15.852 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:15.852 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:15.852 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:15.852 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.852 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 213809 2024-09-17T02:22:15.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.853 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:15.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:15.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834089+0000", 2024-09-17T02:22:15.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:15.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834089+0000", 2024-09-17T02:22:15.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:15.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834090+0000", 2024-09-17T02:22:15.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.06e-07 2024-09-17T02:22:15.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:15.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834096+0000", 2024-09-17T02:22:15.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0179999999999998e-06 2024-09-17T02:22:15.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:15.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834104+0000", 2024-09-17T02:22:15.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6170000000000007e-06 2024-09-17T02:22:15.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834110+0000", 2024-09-17T02:22:15.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6110000000000001e-06 2024-09-17T02:22:15.855 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.855 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:15.855 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.855 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:213810 5.7 5:e9995ef7:::benchmark_data_smithi001_23533_object85693:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T02:22:15.855 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:15.834285+0000", 2024-09-17T02:22:15.855 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001915768, 2024-09-17T02:22:15.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022392480000000001, 2024-09-17T02:22:15.855 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:15.855 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:15.856 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:15.856 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:15.856 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:15.856 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.856 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 213810 2024-09-17T02:22:15.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.856 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:15.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:15.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834285+0000", 2024-09-17T02:22:15.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:15.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834285+0000", 2024-09-17T02:22:15.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:15.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834286+0000", 2024-09-17T02:22:15.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8599999999999998e-07 2024-09-17T02:22:15.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:15.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834289+0000", 2024-09-17T02:22:15.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.824e-06 2024-09-17T02:22:15.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:15.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834302+0000", 2024-09-17T02:22:15.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3667e-05 2024-09-17T02:22:15.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834308+0000", 2024-09-17T02:22:15.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6359999999999999e-06 2024-09-17T02:22:15.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:15.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834342+0000", 2024-09-17T02:22:15.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4212999999999999e-05 2024-09-17T02:22:15.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:15.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834436+0000", 2024-09-17T02:22:15.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3653999999999995e-05 2024-09-17T02:22:15.859 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.859 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:15.859 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.860 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:213787 5.0 5:0cc11c01:::benchmark_data_smithi001_23533_object85670:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T02:22:15.860 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:15.822850+0000", 2024-09-17T02:22:15.860 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.013350752, 2024-09-17T02:22:15.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013735867000000001, 2024-09-17T02:22:15.860 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:15.860 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:15.860 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:15.860 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:15.860 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:15.860 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.860 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 213787 2024-09-17T02:22:15.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.860 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:15.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:15.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.822850+0000", 2024-09-17T02:22:15.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:15.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.822850+0000", 2024-09-17T02:22:15.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:15.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.822851+0000", 2024-09-17T02:22:15.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8299999999999996e-07 2024-09-17T02:22:15.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:15.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.822855+0000", 2024-09-17T02:22:15.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.313e-06 2024-09-17T02:22:15.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:15.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.822871+0000", 2024-09-17T02:22:15.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5996999999999999e-05 2024-09-17T02:22:15.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.822879+0000", 2024-09-17T02:22:15.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4209999999999998e-06 2024-09-17T02:22:15.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:15.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.826003+0000", 2024-09-17T02:22:15.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031246329999999999 2024-09-17T02:22:15.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:15.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.826122+0000", 2024-09-17T02:22:15.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000118577 2024-09-17T02:22:15.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:15.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.826235+0000", 2024-09-17T02:22:15.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011348799999999999 2024-09-17T02:22:15.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:15.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.831965+0000", 2024-09-17T02:22:15.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0057297390000000002 2024-09-17T02:22:15.864 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.864 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:15.864 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.864 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:213811 5.0 5:030dcd14:::benchmark_data_smithi001_23533_object85694:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T02:22:15.864 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:15.834759+0000", 2024-09-17T02:22:15.864 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0014416069999999999, 2024-09-17T02:22:15.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001898795, 2024-09-17T02:22:15.864 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:15.865 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:15.865 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:15.865 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:15.865 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:15.865 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.865 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 213811 2024-09-17T02:22:15.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.865 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:15.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:15.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834759+0000", 2024-09-17T02:22:15.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:15.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834759+0000", 2024-09-17T02:22:15.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:15.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834760+0000", 2024-09-17T02:22:15.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5899999999999995e-07 2024-09-17T02:22:15.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:15.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834764+0000", 2024-09-17T02:22:15.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7589999999999999e-06 2024-09-17T02:22:15.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:15.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834773+0000", 2024-09-17T02:22:15.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3370000000000006e-06 2024-09-17T02:22:15.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834779+0000", 2024-09-17T02:22:15.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2020000000000001e-06 2024-09-17T02:22:15.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:15.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835183+0000", 2024-09-17T02:22:15.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000403886 2024-09-17T02:22:15.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:15.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835310+0000", 2024-09-17T02:22:15.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012639300000000001 2024-09-17T02:22:15.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:15.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835381+0000", 2024-09-17T02:22:15.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1439999999999994e-05 2024-09-17T02:22:15.868 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.868 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:15.868 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.869 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:213814 5.c 5.3dcfcd2c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T02:22:15.869 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:15.835366+0000", 2024-09-17T02:22:15.869 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00083521300000000001, 2024-09-17T02:22:15.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001355158, 2024-09-17T02:22:15.869 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:15.869 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:15.869 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:15.869 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:15.869 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:15.869 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.869 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 213814 2024-09-17T02:22:15.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.869 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:15.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:15.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835366+0000", 2024-09-17T02:22:15.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:15.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835366+0000", 2024-09-17T02:22:15.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:15.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835366+0000", 2024-09-17T02:22:15.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7800000000000001e-07 2024-09-17T02:22:15.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:15.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835370+0000", 2024-09-17T02:22:15.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-06 2024-09-17T02:22:15.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:15.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835379+0000", 2024-09-17T02:22:15.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9970000000000004e-06 2024-09-17T02:22:15.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835385+0000", 2024-09-17T02:22:15.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7969999999999997e-06 2024-09-17T02:22:15.872 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.872 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:15.872 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.872 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:213812 5.3 e68/64 5:c40e1d48:::benchmark_data_smithi001_23533_object85695:head v 68'13499, mlcod=68'13497)", 2024-09-17T02:22:15.872 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:15.835554+0000", 2024-09-17T02:22:15.872 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00064729999999999996, 2024-09-17T02:22:15.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001215528, 2024-09-17T02:22:15.872 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:15.872 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:15.872 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:15.872 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:15.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:15.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835554+0000", 2024-09-17T02:22:15.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:15.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835554+0000", 2024-09-17T02:22:15.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:15.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835554+0000", 2024-09-17T02:22:15.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5900000000000002e-07 2024-09-17T02:22:15.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:15.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835558+0000", 2024-09-17T02:22:15.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8510000000000001e-06 2024-09-17T02:22:15.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:15.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835565+0000", 2024-09-17T02:22:15.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5870000000000004e-06 2024-09-17T02:22:15.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835570+0000", 2024-09-17T02:22:15.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9450000000000001e-06 2024-09-17T02:22:15.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:15.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835612+0000", 2024-09-17T02:22:15.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1356999999999997e-05 2024-09-17T02:22:15.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:15.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835631+0000", 2024-09-17T02:22:15.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9179999999999999e-05 2024-09-17T02:22:15.875 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.875 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:15.875 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.876 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:213813 5.e e68/22 5:77d40404:::benchmark_data_smithi001_23533_object85696:head v 68'13342, mlcod=68'13340)", 2024-09-17T02:22:15.876 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:15.835722+0000", 2024-09-17T02:22:15.876 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00047925000000000002, 2024-09-17T02:22:15.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010996300000000001, 2024-09-17T02:22:15.876 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:15.876 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:15.876 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:15.876 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:15.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:15.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835722+0000", 2024-09-17T02:22:15.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:15.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835722+0000", 2024-09-17T02:22:15.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:15.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835722+0000", 2024-09-17T02:22:15.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.96e-07 2024-09-17T02:22:15.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:15.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835725+0000", 2024-09-17T02:22:15.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4470000000000002e-06 2024-09-17T02:22:15.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:15.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835733+0000", 2024-09-17T02:22:15.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3760000000000002e-06 2024-09-17T02:22:15.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835737+0000", 2024-09-17T02:22:15.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5419999999999999e-06 2024-09-17T02:22:15.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:15.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835859+0000", 2024-09-17T02:22:15.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000121737 2024-09-17T02:22:15.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:15.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835877+0000", 2024-09-17T02:22:15.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7572e-05 2024-09-17T02:22:15.879 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.879 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:15.879 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.879 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:213815 5.b e68/51 5:d9d9a218:::benchmark_data_smithi001_23533_object85698:head v 68'13223, mlcod=68'13221)", 2024-09-17T02:22:15.879 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:15.835813+0000", 2024-09-17T02:22:15.880 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00038767400000000002, 2024-09-17T02:22:15.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010600189999999999, 2024-09-17T02:22:15.880 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:15.880 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:15.880 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:15.880 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:15.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:15.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835813+0000", 2024-09-17T02:22:15.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:15.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835813+0000", 2024-09-17T02:22:15.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:15.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835814+0000", 2024-09-17T02:22:15.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3300000000000003e-07 2024-09-17T02:22:15.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:15.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835817+0000", 2024-09-17T02:22:15.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7160000000000001e-06 2024-09-17T02:22:15.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:15.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835824+0000", 2024-09-17T02:22:15.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7050000000000002e-06 2024-09-17T02:22:15.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835829+0000", 2024-09-17T02:22:15.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.51e-06 2024-09-17T02:22:15.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:15.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835873+0000", 2024-09-17T02:22:15.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4286999999999998e-05 2024-09-17T02:22:15.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:15.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.835894+0000", 2024-09-17T02:22:15.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0752000000000001e-05 2024-09-17T02:22:15.883 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.883 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:15.883 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.883 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:213792 5.0 5:0d7cb0b4:::benchmark_data_smithi001_23533_object85675:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T02:22:15.883 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:15.825537+0000", 2024-09-17T02:22:15.883 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.010664253, 2024-09-17T02:22:15.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011401682, 2024-09-17T02:22:15.884 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:15.884 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:15.884 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:15.884 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:15.884 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:15.884 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.884 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 213792 2024-09-17T02:22:15.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.884 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:15.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:15.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.825537+0000", 2024-09-17T02:22:15.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:15.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.825537+0000", 2024-09-17T02:22:15.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:15.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.825537+0000", 2024-09-17T02:22:15.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1100000000000005e-07 2024-09-17T02:22:15.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:15.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.825541+0000", 2024-09-17T02:22:15.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4450000000000001e-06 2024-09-17T02:22:15.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:15.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.825550+0000", 2024-09-17T02:22:15.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5249999999999994e-06 2024-09-17T02:22:15.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.825556+0000", 2024-09-17T02:22:15.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1560000000000003e-06 2024-09-17T02:22:15.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:15.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.828360+0000", 2024-09-17T02:22:15.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028041229999999999 2024-09-17T02:22:15.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:15.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.828469+0000", 2024-09-17T02:22:15.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010970400000000001 2024-09-17T02:22:15.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:15.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.828543+0000", 2024-09-17T02:22:15.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3769999999999993e-05 2024-09-17T02:22:15.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:15.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.832001+0000", 2024-09-17T02:22:15.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034579580000000001 2024-09-17T02:22:15.888 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.888 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:15.888 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.888 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:213794 5.8 5:1ddce647:::benchmark_data_smithi001_23533_object85677:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T02:22:15.888 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:15.825574+0000", 2024-09-17T02:22:15.888 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.010627062, 2024-09-17T02:22:15.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011435307, 2024-09-17T02:22:15.888 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:15.889 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:15.889 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:15.889 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:15.889 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:15.889 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.889 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 213794 2024-09-17T02:22:15.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.889 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:15.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:15.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.825574+0000", 2024-09-17T02:22:15.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:15.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.825574+0000", 2024-09-17T02:22:15.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:15.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.825574+0000", 2024-09-17T02:22:15.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.96e-07 2024-09-17T02:22:15.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:15.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.825576+0000", 2024-09-17T02:22:15.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8199999999999999e-06 2024-09-17T02:22:15.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:15.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.825582+0000", 2024-09-17T02:22:15.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5890000000000002e-06 2024-09-17T02:22:15.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.825586+0000", 2024-09-17T02:22:15.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8189999999999999e-06 2024-09-17T02:22:15.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:15.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.830025+0000", 2024-09-17T02:22:15.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044387080000000004 2024-09-17T02:22:15.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:15.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.830090+0000", 2024-09-17T02:22:15.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5170000000000001e-05 2024-09-17T02:22:15.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:15.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.830148+0000", 2024-09-17T02:22:15.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7238999999999999e-05 2024-09-17T02:22:15.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:15.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.834271+0000", 2024-09-17T02:22:15.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041235159999999998 2024-09-17T02:22:15.893 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.893 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:15.893 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.893 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:213798 5.0 5:0e6dfd64:::benchmark_data_smithi001_23533_object85681:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T02:22:15.893 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:15.828725+0000", 2024-09-17T02:22:15.893 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0074763260000000002, 2024-09-17T02:22:15.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0083590360000000002, 2024-09-17T02:22:15.893 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:15.893 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:15.893 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:15.893 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:15.893 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:15.894 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.894 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 213798 2024-09-17T02:22:15.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.894 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:15.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:15.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.828725+0000", 2024-09-17T02:22:15.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:15.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.828725+0000", 2024-09-17T02:22:15.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:15.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.828725+0000", 2024-09-17T02:22:15.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5300000000000004e-07 2024-09-17T02:22:15.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:15.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.828728+0000", 2024-09-17T02:22:15.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.785e-06 2024-09-17T02:22:15.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:15.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.828739+0000", 2024-09-17T02:22:15.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0560999999999999e-05 2024-09-17T02:22:15.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.828744+0000", 2024-09-17T02:22:15.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4079999999999997e-06 2024-09-17T02:22:15.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:15.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.832938+0000", 2024-09-17T02:22:15.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041939009999999999 2024-09-17T02:22:15.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:15.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.833045+0000", 2024-09-17T02:22:15.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107324 2024-09-17T02:22:15.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:15.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.833142+0000", 2024-09-17T02:22:15.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6586e-05 2024-09-17T02:22:15.897 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.897 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:15.897 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.898 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:213800 5.c 5:34ee92c4:::benchmark_data_smithi001_23533_object85683:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T02:22:15.898 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:15.828876+0000", 2024-09-17T02:22:15.898 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0073244039999999996, 2024-09-17T02:22:15.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0082726439999999991, 2024-09-17T02:22:15.898 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:15.898 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:15.898 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:15.898 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:15.898 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:15.898 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:15.898 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 213800 2024-09-17T02:22:15.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.898 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:15.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:15.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.828876+0000", 2024-09-17T02:22:15.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:15.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.828876+0000", 2024-09-17T02:22:15.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:15.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:15.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.828877+0000", 2024-09-17T02:22:15.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2900000000000003e-07 2024-09-17T02:22:15.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:15.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.828880+0000", 2024-09-17T02:22:15.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.706e-06 2024-09-17T02:22:15.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:15.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.828887+0000", 2024-09-17T02:22:15.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1389999999999998e-06 2024-09-17T02:22:15.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:15.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.828893+0000", 2024-09-17T02:22:15.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7690000000000002e-06 2024-09-17T02:22:15.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:15.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.828948+0000", 2024-09-17T02:22:15.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5606000000000003e-05 2024-09-17T02:22:15.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:15.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:15.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:15.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:15.829052+0000", 2024-09-17T02:22:15.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104028 2024-09-17T02:22:15.901 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.901 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:15.901 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.901 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:15.901 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:22:15.901 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 16 2024-09-17T02:22:15.901 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:15.903 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:15.903 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:15.902+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:16.003 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:16.004+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:16.100 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:16.100 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:22:16.100 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:22:16.100 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:22:16.100 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:16.104 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:16.108+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:16.118 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:16.205 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:16.202+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:16.309 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:16.308+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:16.319 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:16.319 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:22:16.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:22:16.319 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:22:16.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.320 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:22:16.320 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:16.320 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 93.753025991000001, 2024-09-17T02:22:16.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:22:16.320 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:16.320 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:16.320 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:16.320 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:16.320 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:16.320 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:16.320 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:22:16.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.321 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:16.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:16.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:16.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:16.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:16.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:16.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:22:16.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:22:16.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:16.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:22:16.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:22:16.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:16.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:22:16.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:22:16.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:22:16.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:22:16.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:16.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:22:16.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:22:16.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:16.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:22:16.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:22:16.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:16.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:22:16.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:22:16.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:16.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:22:16.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:22:16.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:16.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:22:16.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:22:16.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:16.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:22:16.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:22:16.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:16.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:22:16.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:22:16.325 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.325 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:16.326 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.326 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:22:16.326 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:16.326 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 93.749123741000005, 2024-09-17T02:22:16.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:22:16.326 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:16.326 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:16.326 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:16.326 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:16.326 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:16.326 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:16.327 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:22:16.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.327 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:16.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:16.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:16.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:16.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:16.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:16.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:22:16.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:22:16.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:16.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:22:16.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:22:16.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:16.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:22:16.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:22:16.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:22:16.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:22:16.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:16.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:22:16.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:22:16.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:16.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:22:16.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:22:16.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:16.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:22:16.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:22:16.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:16.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:22:16.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:22:16.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:16.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:22:16.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:22:16.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:16.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:22:16.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:22:16.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:16.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:22:16.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:22:16.331 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.332 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:16.332 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.332 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97759 5.a 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:16.332 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:16.332 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 58.723103918, 2024-09-17T02:22:16.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.089694871999999995, 2024-09-17T02:22:16.332 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:16.332 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:16.332 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:16.332 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:16.332 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:16.333 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:16.333 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97759 2024-09-17T02:22:16.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.333 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:16.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:16.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:16.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:16.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:16.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:16.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598386+0000", 2024-09-17T02:22:16.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999999e-07 2024-09-17T02:22:16.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:16.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598414+0000", 2024-09-17T02:22:16.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8013000000000001e-05 2024-09-17T02:22:16.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:16.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598420+0000", 2024-09-17T02:22:16.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1149999999999999e-06 2024-09-17T02:22:16.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598424+0000", 2024-09-17T02:22:16.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:22:16.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:16.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598479+0000", 2024-09-17T02:22:16.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4648999999999998e-05 2024-09-17T02:22:16.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:16.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598587+0000", 2024-09-17T02:22:16.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010853000000000001 2024-09-17T02:22:16.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:16.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598676+0000", 2024-09-17T02:22:16.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8381999999999995e-05 2024-09-17T02:22:16.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:16.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603766+0000", 2024-09-17T02:22:16.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050902559999999996 2024-09-17T02:22:16.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:16.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.687988+0000", 2024-09-17T02:22:16.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.084221753999999996 2024-09-17T02:22:16.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:16.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688037+0000", 2024-09-17T02:22:16.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-05 2024-09-17T02:22:16.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:16.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688080+0000", 2024-09-17T02:22:16.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3149999999999999e-05 2024-09-17T02:22:16.338 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.338 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:16.338 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.338 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97770 5.0 5:09c75033:::benchmark_data_smithi001_23533_object97769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:16.338 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:16.338 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 58.717961488, 2024-09-17T02:22:16.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.086380868, 2024-09-17T02:22:16.338 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:16.339 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:16.339 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:16.339 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:16.339 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:16.339 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:16.339 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97770 2024-09-17T02:22:16.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.339 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:16.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:16.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:16.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:16.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:16.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:16.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603529+0000", 2024-09-17T02:22:16.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:22:16.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:16.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603593+0000", 2024-09-17T02:22:16.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4216999999999999e-05 2024-09-17T02:22:16.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:16.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603603+0000", 2024-09-17T02:22:16.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5179999999999993e-06 2024-09-17T02:22:16.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603608+0000", 2024-09-17T02:22:16.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2039999999999996e-06 2024-09-17T02:22:16.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:16.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603653+0000", 2024-09-17T02:22:16.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5247000000000002e-05 2024-09-17T02:22:16.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:16.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603758+0000", 2024-09-17T02:22:16.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105352 2024-09-17T02:22:16.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:16.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603900+0000", 2024-09-17T02:22:16.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014198999999999999 2024-09-17T02:22:16.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:16.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.606097+0000", 2024-09-17T02:22:16.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021969839999999999 2024-09-17T02:22:16.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:16.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689756+0000", 2024-09-17T02:22:16.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.083659077999999998 2024-09-17T02:22:16.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:16.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689846+0000", 2024-09-17T02:22:16.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9320999999999994e-05 2024-09-17T02:22:16.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:16.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689908+0000", 2024-09-17T02:22:16.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720999999999998e-05 2024-09-17T02:22:16.344 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.344 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:16.344 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.344 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127513 5.c 5:3eca08e4:::benchmark_data_smithi001_23533_object127512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:16.344 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:16.344 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.877185064000003, 2024-09-17T02:22:16.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046626399999999998, 2024-09-17T02:22:16.345 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:16.345 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:16.345 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:16.345 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:16.345 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:16.345 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:16.345 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127513 2024-09-17T02:22:16.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.345 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:16.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:16.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:16.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:16.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:16.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:16.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444305+0000", 2024-09-17T02:22:16.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2529999999999999e-06 2024-09-17T02:22:16.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:16.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444466+0000", 2024-09-17T02:22:16.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016069700000000001 2024-09-17T02:22:16.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:16.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444479+0000", 2024-09-17T02:22:16.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2602999999999999e-05 2024-09-17T02:22:16.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444485+0000", 2024-09-17T02:22:16.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.669e-06 2024-09-17T02:22:16.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:16.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444560+0000", 2024-09-17T02:22:16.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4276999999999994e-05 2024-09-17T02:22:16.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:16.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444656+0000", 2024-09-17T02:22:16.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6490000000000006e-05 2024-09-17T02:22:16.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:16.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444739+0000", 2024-09-17T02:22:16.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3139999999999993e-05 2024-09-17T02:22:16.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:16.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.448438+0000", 2024-09-17T02:22:16.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036985490000000002 2024-09-17T02:22:16.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:16.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490732+0000", 2024-09-17T02:22:16.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042294353999999999 2024-09-17T02:22:16.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:16.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490859+0000", 2024-09-17T02:22:16.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012708899999999999 2024-09-17T02:22:16.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:16.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490930+0000", 2024-09-17T02:22:16.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:16.350 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.350 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:16.351 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.351 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127514 5.c 5:39cc1feb:::benchmark_data_smithi001_23533_object127513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:16.351 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:16.351 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.876988294999997, 2024-09-17T02:22:16.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049357228000000003, 2024-09-17T02:22:16.351 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:16.351 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:16.351 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:16.351 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:16.352 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:16.352 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:16.352 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127514 2024-09-17T02:22:16.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.352 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:16.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:16.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:16.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:16.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:16.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:16.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:16.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8599999999999998e-07 2024-09-17T02:22:16.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:16.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444554+0000", 2024-09-17T02:22:16.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3047999999999998e-05 2024-09-17T02:22:16.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:16.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444562+0000", 2024-09-17T02:22:16.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5830000000000001e-06 2024-09-17T02:22:16.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444567+0000", 2024-09-17T02:22:16.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4179999999999996e-06 2024-09-17T02:22:16.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:16.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446566+0000", 2024-09-17T02:22:16.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001998788 2024-09-17T02:22:16.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:16.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446696+0000", 2024-09-17T02:22:16.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129393 2024-09-17T02:22:16.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:16.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446794+0000", 2024-09-17T02:22:16.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8462999999999996e-05 2024-09-17T02:22:16.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:16.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.449036+0000", 2024-09-17T02:22:16.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022415880000000001 2024-09-17T02:22:16.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:16.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493737+0000", 2024-09-17T02:22:16.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044701682 2024-09-17T02:22:16.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:16.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493808+0000", 2024-09-17T02:22:16.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0846000000000006e-05 2024-09-17T02:22:16.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:16.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493858+0000", 2024-09-17T02:22:16.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9932999999999998e-05 2024-09-17T02:22:16.357 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.357 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:16.357 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.357 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129441 5.1 5:84c3199f:::benchmark_data_smithi001_23533_object1324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:16.358 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:16.358 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.817977806999998, 2024-09-17T02:22:16.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034387011000000002, 2024-09-17T02:22:16.358 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:16.358 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:16.358 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:16.358 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:16.358 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:16.358 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:16.358 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129441 2024-09-17T02:22:16.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.358 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:16.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:16.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:16.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:16.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:16.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:16.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503513+0000", 2024-09-17T02:22:16.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4759999999999999e-06 2024-09-17T02:22:16.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:16.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503518+0000", 2024-09-17T02:22:16.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-09-17T02:22:16.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:16.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503532+0000", 2024-09-17T02:22:16.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4049999999999999e-05 2024-09-17T02:22:16.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503541+0000", 2024-09-17T02:22:16.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5320000000000006e-06 2024-09-17T02:22:16.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:16.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506331+0000", 2024-09-17T02:22:16.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027899190000000001 2024-09-17T02:22:16.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:16.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506402+0000", 2024-09-17T02:22:16.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:16.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:16.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506477+0000", 2024-09-17T02:22:16.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4626e-05 2024-09-17T02:22:16.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:16.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509749+0000", 2024-09-17T02:22:16.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032726980000000001 2024-09-17T02:22:16.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:16.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537758+0000", 2024-09-17T02:22:16.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028008890000000002 2024-09-17T02:22:16.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:16.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537812+0000", 2024-09-17T02:22:16.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3300000000000001e-05 2024-09-17T02:22:16.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:16.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537898+0000", 2024-09-17T02:22:16.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6691000000000001e-05 2024-09-17T02:22:16.364 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.364 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:16.364 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.364 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129442 5.1 5:8f7f2a95:::benchmark_data_smithi001_23533_object1325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:16.364 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:16.364 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.815007198000004, 2024-09-17T02:22:16.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031546698999999997, 2024-09-17T02:22:16.365 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:16.365 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:16.365 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:16.365 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:16.365 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:16.365 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:16.365 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129442 2024-09-17T02:22:16.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.365 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:16.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:16.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:16.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:16.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:16.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:16.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506483+0000", 2024-09-17T02:22:16.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2869999999999999e-06 2024-09-17T02:22:16.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:16.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506489+0000", 2024-09-17T02:22:16.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2330000000000003e-06 2024-09-17T02:22:16.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:16.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506502+0000", 2024-09-17T02:22:16.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2286999999999999e-05 2024-09-17T02:22:16.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506511+0000", 2024-09-17T02:22:16.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7799999999999995e-06 2024-09-17T02:22:16.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:16.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.507966+0000", 2024-09-17T02:22:16.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014541549999999999 2024-09-17T02:22:16.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:16.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508130+0000", 2024-09-17T02:22:16.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016455199999999999 2024-09-17T02:22:16.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:16.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508287+0000", 2024-09-17T02:22:16.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015730400000000001 2024-09-17T02:22:16.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:16.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510577+0000", 2024-09-17T02:22:16.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022899449999999998 2024-09-17T02:22:16.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:16.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537932+0000", 2024-09-17T02:22:16.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027354471000000002 2024-09-17T02:22:16.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:16.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537964+0000", 2024-09-17T02:22:16.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1909999999999998e-05 2024-09-17T02:22:16.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:16.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.538029+0000", 2024-09-17T02:22:16.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4775000000000002e-05 2024-09-17T02:22:16.371 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.371 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:16.371 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.371 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:150458 5.a 5:59b62890:::benchmark_data_smithi001_23533_object22341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:22:16.371 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:16.371 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.483163391000001, 2024-09-17T02:22:16.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028150173000000001, 2024-09-17T02:22:16.371 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:16.372 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:16.372 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:16.372 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:16.372 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:16.372 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:16.372 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 150458 2024-09-17T02:22:16.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.372 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:16.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:16.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:16.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:16.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:16.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:16.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:16.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7800000000000002e-07 2024-09-17T02:22:16.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:16.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838328+0000", 2024-09-17T02:22:16.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.838e-06 2024-09-17T02:22:16.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:16.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838335+0000", 2024-09-17T02:22:16.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1999999999999997e-06 2024-09-17T02:22:16.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838340+0000", 2024-09-17T02:22:16.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7389999999999999e-06 2024-09-17T02:22:16.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:16.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849082+0000", 2024-09-17T02:22:16.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01074174 2024-09-17T02:22:16.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:16.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849192+0000", 2024-09-17T02:22:16.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011040300000000001 2024-09-17T02:22:16.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:16.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849297+0000", 2024-09-17T02:22:16.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104764 2024-09-17T02:22:16.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:16.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.857853+0000", 2024-09-17T02:22:16.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085558490000000008 2024-09-17T02:22:16.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:16.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866430+0000", 2024-09-17T02:22:16.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085768140000000003 2024-09-17T02:22:16.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:16.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866454+0000", 2024-09-17T02:22:16.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4428000000000001e-05 2024-09-17T02:22:16.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:16.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866476+0000", 2024-09-17T02:22:16.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.192e-05 2024-09-17T02:22:16.377 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.377 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:16.377 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.377 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190780 5.3 e65/64 5:c634f18a:::benchmark_data_smithi001_23533_object62663:head v 65'12039, mlcod=0'0)", 2024-09-17T02:22:16.377 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.182278+0000", 2024-09-17T02:22:16.377 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.139211302, 2024-09-17T02:22:16.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028943393000000001, 2024-09-17T02:22:16.377 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:16.377 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:16.378 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:16.378 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:16.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:16.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182278+0000", 2024-09-17T02:22:16.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:16.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182278+0000", 2024-09-17T02:22:16.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:16.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182280+0000", 2024-09-17T02:22:16.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.736e-06 2024-09-17T02:22:16.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:16.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182291+0000", 2024-09-17T02:22:16.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1933000000000001e-05 2024-09-17T02:22:16.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:16.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182317+0000", 2024-09-17T02:22:16.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6024999999999999e-05 2024-09-17T02:22:16.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182332+0000", 2024-09-17T02:22:16.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4856e-05 2024-09-17T02:22:16.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:16.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182463+0000", 2024-09-17T02:22:16.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130674 2024-09-17T02:22:16.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:16.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182533+0000", 2024-09-17T02:22:16.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0296999999999995e-05 2024-09-17T02:22:16.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:16.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211153+0000", 2024-09-17T02:22:16.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028619265000000001 2024-09-17T02:22:16.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:16.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211221+0000", 2024-09-17T02:22:16.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8607000000000002e-05 2024-09-17T02:22:16.382 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.382 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:16.382 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.382 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190799 5.3 e65/64 5:c0e8780b:::benchmark_data_smithi001_23533_object62682:head v 65'12040, mlcod=0'0)", 2024-09-17T02:22:16.382 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.193849+0000", 2024-09-17T02:22:16.382 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.127639950000001, 2024-09-17T02:22:16.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02989934, 2024-09-17T02:22:16.382 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:16.382 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:16.382 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:16.383 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:16.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:16.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193849+0000", 2024-09-17T02:22:16.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:16.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193849+0000", 2024-09-17T02:22:16.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:16.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193851+0000", 2024-09-17T02:22:16.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.137e-06 2024-09-17T02:22:16.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:16.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193865+0000", 2024-09-17T02:22:16.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3845999999999999e-05 2024-09-17T02:22:16.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:16.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193888+0000", 2024-09-17T02:22:16.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3312e-05 2024-09-17T02:22:16.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193901+0000", 2024-09-17T02:22:16.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2896e-05 2024-09-17T02:22:16.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:16.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.204084+0000", 2024-09-17T02:22:16.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010182538 2024-09-17T02:22:16.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:16.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.204126+0000", 2024-09-17T02:22:16.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1828e-05 2024-09-17T02:22:16.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:16.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223688+0000", 2024-09-17T02:22:16.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019562408999999999 2024-09-17T02:22:16.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:16.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223748+0000", 2024-09-17T02:22:16.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0374000000000002e-05 2024-09-17T02:22:16.386 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.386 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:16.386 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.387 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190836 5.3 e65/64 5:c72f74ff:::benchmark_data_smithi001_23533_object62719:head v 65'12042, mlcod=0'0)", 2024-09-17T02:22:16.387 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.198478+0000", 2024-09-17T02:22:16.387 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.123011057999999, 2024-09-17T02:22:16.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031214246000000001, 2024-09-17T02:22:16.387 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:16.387 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:16.387 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:16.387 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:16.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:16.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198478+0000", 2024-09-17T02:22:16.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:16.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198478+0000", 2024-09-17T02:22:16.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:16.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198480+0000", 2024-09-17T02:22:16.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0899999999999999e-06 2024-09-17T02:22:16.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:16.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198494+0000", 2024-09-17T02:22:16.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3572e-05 2024-09-17T02:22:16.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:16.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198521+0000", 2024-09-17T02:22:16.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7178999999999998e-05 2024-09-17T02:22:16.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198533+0000", 2024-09-17T02:22:16.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2588999999999999e-05 2024-09-17T02:22:16.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:16.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208944+0000", 2024-09-17T02:22:16.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010410236 2024-09-17T02:22:16.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:16.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208979+0000", 2024-09-17T02:22:16.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5555000000000001e-05 2024-09-17T02:22:16.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:16.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229627+0000", 2024-09-17T02:22:16.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020647993999999999 2024-09-17T02:22:16.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:16.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229692+0000", 2024-09-17T02:22:16.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5030999999999995e-05 2024-09-17T02:22:16.391 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.391 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:16.391 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.391 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190852 5.3 e65/64 5:c63de204:::benchmark_data_smithi001_23533_object62735:head v 65'12043, mlcod=0'0)", 2024-09-17T02:22:16.391 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.200082+0000", 2024-09-17T02:22:16.391 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.121407059999999, 2024-09-17T02:22:16.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029657795000000001, 2024-09-17T02:22:16.391 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:16.391 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:16.391 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:16.392 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:16.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:16.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200082+0000", 2024-09-17T02:22:16.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:16.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200082+0000", 2024-09-17T02:22:16.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:16.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200084+0000", 2024-09-17T02:22:16.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1900000000000002e-06 2024-09-17T02:22:16.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:16.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200099+0000", 2024-09-17T02:22:16.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4392999999999999e-05 2024-09-17T02:22:16.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:16.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200122+0000", 2024-09-17T02:22:16.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3292e-05 2024-09-17T02:22:16.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200134+0000", 2024-09-17T02:22:16.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2489e-05 2024-09-17T02:22:16.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:16.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211322+0000", 2024-09-17T02:22:16.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011187689000000001 2024-09-17T02:22:16.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:16.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211383+0000", 2024-09-17T02:22:16.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0707e-05 2024-09-17T02:22:16.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:16.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229698+0000", 2024-09-17T02:22:16.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018315306999999999 2024-09-17T02:22:16.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:16.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229740+0000", 2024-09-17T02:22:16.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1727999999999998e-05 2024-09-17T02:22:16.395 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.395 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:16.395 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.395 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190887 5.3 e65/64 5:cc339b34:::benchmark_data_smithi001_23533_object62770:head v 65'12044, mlcod=0'0)", 2024-09-17T02:22:16.396 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.201631+0000", 2024-09-17T02:22:16.396 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.119857712, 2024-09-17T02:22:16.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028149121999999999, 2024-09-17T02:22:16.396 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:16.396 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:16.396 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:16.396 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:16.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:16.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201631+0000", 2024-09-17T02:22:16.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:16.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201631+0000", 2024-09-17T02:22:16.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:16.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201634+0000", 2024-09-17T02:22:16.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1629999999999999e-06 2024-09-17T02:22:16.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:16.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201647+0000", 2024-09-17T02:22:16.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3943e-05 2024-09-17T02:22:16.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:16.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201690+0000", 2024-09-17T02:22:16.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2660999999999997e-05 2024-09-17T02:22:16.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201707+0000", 2024-09-17T02:22:16.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.647e-05 2024-09-17T02:22:16.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:16.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.213560+0000", 2024-09-17T02:22:16.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011852945 2024-09-17T02:22:16.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:16.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.213617+0000", 2024-09-17T02:22:16.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7170999999999999e-05 2024-09-17T02:22:16.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:16.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229744+0000", 2024-09-17T02:22:16.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016127617 2024-09-17T02:22:16.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:16.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229781+0000", 2024-09-17T02:22:16.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6152000000000002e-05 2024-09-17T02:22:16.400 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.400 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:16.400 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.400 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190920 5.3 e65/64 5:c7bc6082:::benchmark_data_smithi001_23533_object62803:head v 65'12047, mlcod=0'0)", 2024-09-17T02:22:16.400 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.206674+0000", 2024-09-17T02:22:16.400 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.114815084, 2024-09-17T02:22:16.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.033826457999999997, 2024-09-17T02:22:16.400 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:16.400 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:16.400 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:16.401 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:16.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:16.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206674+0000", 2024-09-17T02:22:16.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:16.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206674+0000", 2024-09-17T02:22:16.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:16.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206676+0000", 2024-09-17T02:22:16.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.646e-06 2024-09-17T02:22:16.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:16.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206689+0000", 2024-09-17T02:22:16.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3196999999999999e-05 2024-09-17T02:22:16.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:16.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206718+0000", 2024-09-17T02:22:16.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8988000000000001e-05 2024-09-17T02:22:16.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206736+0000", 2024-09-17T02:22:16.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8221999999999999e-05 2024-09-17T02:22:16.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:16.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.221517+0000", 2024-09-17T02:22:16.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014781247000000001 2024-09-17T02:22:16.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:16.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.221563+0000", 2024-09-17T02:22:16.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5343999999999998e-05 2024-09-17T02:22:16.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:16.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240391+0000", 2024-09-17T02:22:16.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018828693000000001 2024-09-17T02:22:16.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:16.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240500+0000", 2024-09-17T02:22:16.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109121 2024-09-17T02:22:16.404 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.404 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:16.404 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.404 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190947 5.3 e65/64 5:ca95b398:::benchmark_data_smithi001_23533_object62830:head v 65'12048, mlcod=0'0)", 2024-09-17T02:22:16.404 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.208183+0000", 2024-09-17T02:22:16.405 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.113305731000001, 2024-09-17T02:22:16.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032404800999999997, 2024-09-17T02:22:16.405 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:16.405 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:16.405 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:16.405 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:16.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:16.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208183+0000", 2024-09-17T02:22:16.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:16.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208183+0000", 2024-09-17T02:22:16.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:16.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208185+0000", 2024-09-17T02:22:16.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.64e-06 2024-09-17T02:22:16.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:16.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208197+0000", 2024-09-17T02:22:16.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1589e-05 2024-09-17T02:22:16.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:16.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208217+0000", 2024-09-17T02:22:16.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0242e-05 2024-09-17T02:22:16.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208227+0000", 2024-09-17T02:22:16.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0256e-05 2024-09-17T02:22:16.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:16.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223908+0000", 2024-09-17T02:22:16.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015680726999999998 2024-09-17T02:22:16.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:16.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223969+0000", 2024-09-17T02:22:16.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1277000000000003e-05 2024-09-17T02:22:16.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:16.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240509+0000", 2024-09-17T02:22:16.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016539484 2024-09-17T02:22:16.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:16.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240588+0000", 2024-09-17T02:22:16.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9585999999999993e-05 2024-09-17T02:22:16.409 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.409 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:16.409 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.409 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190958 5.3 e65/64 5:c9337cc4:::benchmark_data_smithi001_23533_object62841:head v 65'12049, mlcod=0'0)", 2024-09-17T02:22:16.409 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.209746+0000", 2024-09-17T02:22:16.409 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.111743384, 2024-09-17T02:22:16.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030921212999999999, 2024-09-17T02:22:16.409 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:16.409 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:16.409 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:16.409 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:16.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:16.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209746+0000", 2024-09-17T02:22:16.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:16.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209746+0000", 2024-09-17T02:22:16.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:16.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209748+0000", 2024-09-17T02:22:16.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9989999999999998e-06 2024-09-17T02:22:16.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:16.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209761+0000", 2024-09-17T02:22:16.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3317e-05 2024-09-17T02:22:16.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:16.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209786+0000", 2024-09-17T02:22:16.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4941999999999999e-05 2024-09-17T02:22:16.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209799+0000", 2024-09-17T02:22:16.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2556e-05 2024-09-17T02:22:16.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:16.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.226753+0000", 2024-09-17T02:22:16.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016954100999999999 2024-09-17T02:22:16.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:16.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.226810+0000", 2024-09-17T02:22:16.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7207000000000003e-05 2024-09-17T02:22:16.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:16.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240599+0000", 2024-09-17T02:22:16.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013789228000000001 2024-09-17T02:22:16.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:16.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240667+0000", 2024-09-17T02:22:16.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7862999999999997e-05 2024-09-17T02:22:16.413 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.413 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:16.414 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.414 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:191023 5.3 e65/64 5:cfca4af2:::benchmark_data_smithi001_23533_object62906:head v 65'12050, mlcod=0'0)", 2024-09-17T02:22:16.414 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.210919+0000", 2024-09-17T02:22:16.414 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.110570028, 2024-09-17T02:22:16.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029830820000000001, 2024-09-17T02:22:16.414 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:16.414 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:16.414 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:16.414 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:16.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:16.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210919+0000", 2024-09-17T02:22:16.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:16.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210919+0000", 2024-09-17T02:22:16.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:16.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210921+0000", 2024-09-17T02:22:16.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-09-17T02:22:16.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:16.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210935+0000", 2024-09-17T02:22:16.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3436e-05 2024-09-17T02:22:16.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:16.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210961+0000", 2024-09-17T02:22:16.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6767999999999999e-05 2024-09-17T02:22:16.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210974+0000", 2024-09-17T02:22:16.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2904e-05 2024-09-17T02:22:16.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:16.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229967+0000", 2024-09-17T02:22:16.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018992774 2024-09-17T02:22:16.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:16.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.230023+0000", 2024-09-17T02:22:16.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6334e-05 2024-09-17T02:22:16.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:16.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240673+0000", 2024-09-17T02:22:16.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010649908 2024-09-17T02:22:16.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:16.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240750+0000", 2024-09-17T02:22:16.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6556000000000004e-05 2024-09-17T02:22:16.418 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.418 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:16.418 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.418 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:191048 5.3 e65/64 5:c4115f14:::benchmark_data_smithi001_23533_object62931:head v 65'12051, mlcod=0'0)", 2024-09-17T02:22:16.418 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.211763+0000", 2024-09-17T02:22:16.418 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.109726106, 2024-09-17T02:22:16.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029064577000000001, 2024-09-17T02:22:16.418 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:16.418 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:16.419 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:16.419 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:16.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:16.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211763+0000", 2024-09-17T02:22:16.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:16.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211763+0000", 2024-09-17T02:22:16.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:16.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211765+0000", 2024-09-17T02:22:16.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.717e-06 2024-09-17T02:22:16.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:16.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211776+0000", 2024-09-17T02:22:16.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1358999999999999e-05 2024-09-17T02:22:16.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:16.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211806+0000", 2024-09-17T02:22:16.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9924999999999999e-05 2024-09-17T02:22:16.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211824+0000", 2024-09-17T02:22:16.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7782999999999999e-05 2024-09-17T02:22:16.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:16.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.232521+0000", 2024-09-17T02:22:16.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020696902 2024-09-17T02:22:16.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:16.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.232574+0000", 2024-09-17T02:22:16.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3044000000000002e-05 2024-09-17T02:22:16.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:16.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240757+0000", 2024-09-17T02:22:16.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081828579999999995 2024-09-17T02:22:16.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:16.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240828+0000", 2024-09-17T02:22:16.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0988999999999994e-05 2024-09-17T02:22:16.422 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.422 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:16.422 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.422 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:191114 5.3 e65/64 5:c2a7e5a9:::benchmark_data_smithi001_23533_object62997:head v 65'12054, mlcod=63'12038)", 2024-09-17T02:22:16.422 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.217495+0000", 2024-09-17T02:22:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.103994475, 2024-09-17T02:22:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029944788, 2024-09-17T02:22:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217495+0000", 2024-09-17T02:22:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217495+0000", 2024-09-17T02:22:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:16.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217496+0000", 2024-09-17T02:22:16.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.46e-06 2024-09-17T02:22:16.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:16.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217508+0000", 2024-09-17T02:22:16.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2157000000000001e-05 2024-09-17T02:22:16.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:16.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217535+0000", 2024-09-17T02:22:16.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7058000000000001e-05 2024-09-17T02:22:16.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217551+0000", 2024-09-17T02:22:16.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5709000000000002e-05 2024-09-17T02:22:16.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:16.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.241029+0000", 2024-09-17T02:22:16.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023478452 2024-09-17T02:22:16.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:16.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.241078+0000", 2024-09-17T02:22:16.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8068000000000001e-05 2024-09-17T02:22:16.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:16.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.247369+0000", 2024-09-17T02:22:16.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0062912740000000003 2024-09-17T02:22:16.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:16.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:16.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:16.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.247439+0000", 2024-09-17T02:22:16.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0610000000000003e-05 2024-09-17T02:22:16.426 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.426 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:16.426 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.426 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:16.427 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:16.427 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:16.428 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:16.429 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:16.426+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:16.528 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:16.526+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:16.538 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:22:16.580 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:16.581 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:22:16.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.581 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:215607 5.8 e68/26)", 2024-09-17T02:22:16.581 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:16.583326+0000", 2024-09-17T02:22:16.581 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00060906800000000004, 2024-09-17T02:22:16.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062198400000000001, 2024-09-17T02:22:16.581 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:16.581 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:16.581 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:16.581 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:16.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:16.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583326+0000", 2024-09-17T02:22:16.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:16.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:16.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583326+0000", 2024-09-17T02:22:16.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:16.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:16.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583327+0000", 2024-09-17T02:22:16.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9699999999999996e-07 2024-09-17T02:22:16.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:16.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583334+0000", 2024-09-17T02:22:16.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0570000000000004e-06 2024-09-17T02:22:16.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:16.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583342+0000", 2024-09-17T02:22:16.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4619999999999996e-06 2024-09-17T02:22:16.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583348+0000", 2024-09-17T02:22:16.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7570000000000001e-06 2024-09-17T02:22:16.584 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:16.584 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:16.584 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:16.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.584 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:215612 5.1 5:84af21ad:::benchmark_data_smithi001_23533_object87495:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T02:22:16.584 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:16.583560+0000", 2024-09-17T02:22:16.584 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00037549600000000001, 2024-09-17T02:22:16.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042282099999999998, 2024-09-17T02:22:16.584 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:16.584 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:16.584 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:16.584 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:16.585 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:16.585 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:16.585 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 215612 2024-09-17T02:22:16.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.585 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:16.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:16.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583560+0000", 2024-09-17T02:22:16.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:16.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:16.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583560+0000", 2024-09-17T02:22:16.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:16.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:16.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583560+0000", 2024-09-17T02:22:16.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8500000000000001e-07 2024-09-17T02:22:16.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:16.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583563+0000", 2024-09-17T02:22:16.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5840000000000002e-06 2024-09-17T02:22:16.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:16.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583572+0000", 2024-09-17T02:22:16.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0340000000000002e-06 2024-09-17T02:22:16.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583576+0000", 2024-09-17T02:22:16.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4410000000000003e-06 2024-09-17T02:22:16.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:16.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583619+0000", 2024-09-17T02:22:16.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2948999999999998e-05 2024-09-17T02:22:16.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:16.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583744+0000", 2024-09-17T02:22:16.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000124614 2024-09-17T02:22:16.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:16.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583846+0000", 2024-09-17T02:22:16.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102466 2024-09-17T02:22:16.588 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:16.588 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:16.588 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:16.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.588 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:215613 5.4 5:2b4755ff:::benchmark_data_smithi001_23533_object87496:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T02:22:16.589 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:16.583588+0000", 2024-09-17T02:22:16.589 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00034701799999999999, 2024-09-17T02:22:16.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045063900000000002, 2024-09-17T02:22:16.589 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:16.589 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:16.589 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:16.589 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:16.589 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:16.589 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:16.589 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 215613 2024-09-17T02:22:16.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.589 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:16.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:16.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583588+0000", 2024-09-17T02:22:16.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:16.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:16.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583588+0000", 2024-09-17T02:22:16.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:16.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:16.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583588+0000", 2024-09-17T02:22:16.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0699999999999998e-07 2024-09-17T02:22:16.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:16.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583590+0000", 2024-09-17T02:22:16.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.64e-06 2024-09-17T02:22:16.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:16.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583594+0000", 2024-09-17T02:22:16.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2980000000000002e-06 2024-09-17T02:22:16.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583598+0000", 2024-09-17T02:22:16.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2540000000000001e-06 2024-09-17T02:22:16.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:16.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583648+0000", 2024-09-17T02:22:16.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0760000000000002e-05 2024-09-17T02:22:16.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:16.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583766+0000", 2024-09-17T02:22:16.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011756699999999999 2024-09-17T02:22:16.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:16.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583880+0000", 2024-09-17T02:22:16.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011386499999999999 2024-09-17T02:22:16.593 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:16.593 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:16.593 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:16.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.593 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:215614 5.3 5:c5384cd4:::benchmark_data_smithi001_23533_object87497:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T02:22:16.593 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:16.583850+0000", 2024-09-17T02:22:16.593 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.5016000000000001e-05, 2024-09-17T02:22:16.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000231766, 2024-09-17T02:22:16.593 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:16.593 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:16.593 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:16.593 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:16.593 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:16.594 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:16.594 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 215614 2024-09-17T02:22:16.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.594 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:16.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:16.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583850+0000", 2024-09-17T02:22:16.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:16.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:16.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583850+0000", 2024-09-17T02:22:16.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:16.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:16.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583851+0000", 2024-09-17T02:22:16.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0100000000000001e-06 2024-09-17T02:22:16.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:16.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583856+0000", 2024-09-17T02:22:16.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.729e-06 2024-09-17T02:22:16.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:16.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583866+0000", 2024-09-17T02:22:16.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7620000000000007e-06 2024-09-17T02:22:16.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583874+0000", 2024-09-17T02:22:16.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6370000000000005e-06 2024-09-17T02:22:16.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:16.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583926+0000", 2024-09-17T02:22:16.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1440000000000002e-05 2024-09-17T02:22:16.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:16.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.584041+0000", 2024-09-17T02:22:16.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115536 2024-09-17T02:22:16.597 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:16.597 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:16.597 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:16.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.597 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:215585 5.b 5:ddc370cc:::benchmark_data_smithi001_23533_object87468:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T02:22:16.597 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:16.571737+0000", 2024-09-17T02:22:16.597 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.01219837, 2024-09-17T02:22:16.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012393539, 2024-09-17T02:22:16.597 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:16.597 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:16.597 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:16.597 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:16.597 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:16.598 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:16.598 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 215585 2024-09-17T02:22:16.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.598 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:16.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:16.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.571737+0000", 2024-09-17T02:22:16.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:16.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:16.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.571737+0000", 2024-09-17T02:22:16.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:16.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:16.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.571737+0000", 2024-09-17T02:22:16.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7299999999999996e-07 2024-09-17T02:22:16.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:16.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.571740+0000", 2024-09-17T02:22:16.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.881e-06 2024-09-17T02:22:16.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:16.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.571749+0000", 2024-09-17T02:22:16.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4889999999999995e-06 2024-09-17T02:22:16.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.571755+0000", 2024-09-17T02:22:16.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1739999999999997e-06 2024-09-17T02:22:16.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:16.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.576761+0000", 2024-09-17T02:22:16.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050063219999999997 2024-09-17T02:22:16.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:16.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.576891+0000", 2024-09-17T02:22:16.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000129579 2024-09-17T02:22:16.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:16.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.577021+0000", 2024-09-17T02:22:16.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013002000000000001 2024-09-17T02:22:16.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:16.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.579111+0000", 2024-09-17T02:22:16.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002090639 2024-09-17T02:22:16.601 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:16.601 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:16.602 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:16.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.602 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:215615 5.3 5.87060d3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T02:22:16.602 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:16.584043+0000", 2024-09-17T02:22:16.602 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4294967295.9998922, 2024-09-17T02:22:16.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012950700000000001, 2024-09-17T02:22:16.602 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:16.602 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:16.602 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:16.602 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:16.602 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:16.602 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:16.602 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 215615 2024-09-17T02:22:16.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.603 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:16.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:16.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.584043+0000", 2024-09-17T02:22:16.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:16.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:16.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.584043+0000", 2024-09-17T02:22:16.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:16.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:16.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.584044+0000", 2024-09-17T02:22:16.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7800000000000001e-07 2024-09-17T02:22:16.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:16.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.584047+0000", 2024-09-17T02:22:16.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.783e-06 2024-09-17T02:22:16.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:16.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.584058+0000", 2024-09-17T02:22:16.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0575e-05 2024-09-17T02:22:16.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.584065+0000", 2024-09-17T02:22:16.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0899999999999999e-06 2024-09-17T02:22:16.605 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:16.605 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:16.605 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:16.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.605 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:215602 5.4 5:2ea4b27d:::benchmark_data_smithi001_23533_object87485:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T02:22:16.605 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:16.578840+0000", 2024-09-17T02:22:16.605 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0050950099999999996, 2024-09-17T02:22:16.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0053675529999999997, 2024-09-17T02:22:16.605 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:16.605 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:16.605 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:16.605 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:16.606 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:16.606 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:16.606 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 215602 2024-09-17T02:22:16.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.606 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:16.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:16.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.578840+0000", 2024-09-17T02:22:16.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:16.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:16.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.578840+0000", 2024-09-17T02:22:16.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:16.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:16.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.578841+0000", 2024-09-17T02:22:16.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3900000000000005e-07 2024-09-17T02:22:16.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:16.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.578844+0000", 2024-09-17T02:22:16.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0879999999999999e-06 2024-09-17T02:22:16.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:16.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.578851+0000", 2024-09-17T02:22:16.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6510000000000001e-06 2024-09-17T02:22:16.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.578857+0000", 2024-09-17T02:22:16.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4929999999999998e-06 2024-09-17T02:22:16.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:16.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.578909+0000", 2024-09-17T02:22:16.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2061999999999997e-05 2024-09-17T02:22:16.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:16.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.579029+0000", 2024-09-17T02:22:16.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000120277 2024-09-17T02:22:16.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:16.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.579144+0000", 2024-09-17T02:22:16.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114768 2024-09-17T02:22:16.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:16.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.582812+0000", 2024-09-17T02:22:16.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003668354 2024-09-17T02:22:16.609 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:16.609 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:16.610 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:16.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.610 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:215604 5.e 5:7809c2e6:::benchmark_data_smithi001_23533_object87487:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T02:22:16.610 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:16.579684+0000", 2024-09-17T02:22:16.610 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0042512180000000002, 2024-09-17T02:22:16.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045682429999999996, 2024-09-17T02:22:16.610 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:16.610 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:16.610 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:16.610 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:16.610 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:16.610 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:16.610 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 215604 2024-09-17T02:22:16.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.611 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:16.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:16.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.579684+0000", 2024-09-17T02:22:16.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:16.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:16.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.579684+0000", 2024-09-17T02:22:16.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:16.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:16.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.579685+0000", 2024-09-17T02:22:16.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5099999999999998e-07 2024-09-17T02:22:16.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:16.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.579689+0000", 2024-09-17T02:22:16.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9990000000000002e-06 2024-09-17T02:22:16.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:16.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.579702+0000", 2024-09-17T02:22:16.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.346e-05 2024-09-17T02:22:16.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.579710+0000", 2024-09-17T02:22:16.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9000000000000006e-06 2024-09-17T02:22:16.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:16.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.579756+0000", 2024-09-17T02:22:16.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6026999999999998e-05 2024-09-17T02:22:16.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:16.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.579828+0000", 2024-09-17T02:22:16.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1598000000000001e-05 2024-09-17T02:22:16.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:16.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.579889+0000", 2024-09-17T02:22:16.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1376000000000003e-05 2024-09-17T02:22:16.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:16.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583753+0000", 2024-09-17T02:22:16.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038643079999999999 2024-09-17T02:22:16.614 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:16.615 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:16.615 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:16.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.615 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:215605 5.4 5:26804a7c:::benchmark_data_smithi001_23533_object87488:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T02:22:16.615 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:16.580765+0000", 2024-09-17T02:22:16.615 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0031696509999999999, 2024-09-17T02:22:16.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035281280000000002, 2024-09-17T02:22:16.615 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:16.615 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:16.615 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:16.615 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:16.615 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:16.615 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:16.615 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 215605 2024-09-17T02:22:16.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.616 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:16.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:16.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.580765+0000", 2024-09-17T02:22:16.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:16.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:16.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.580765+0000", 2024-09-17T02:22:16.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:16.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:16.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.580766+0000", 2024-09-17T02:22:16.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8000000000000004e-07 2024-09-17T02:22:16.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:16.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.580771+0000", 2024-09-17T02:22:16.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2980000000000002e-06 2024-09-17T02:22:16.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:16.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.580784+0000", 2024-09-17T02:22:16.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3206e-05 2024-09-17T02:22:16.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.580791+0000", 2024-09-17T02:22:16.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6699999999999994e-06 2024-09-17T02:22:16.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:16.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.580851+0000", 2024-09-17T02:22:16.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9163000000000003e-05 2024-09-17T02:22:16.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:16.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.580999+0000", 2024-09-17T02:22:16.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000148307 2024-09-17T02:22:16.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:16.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.581117+0000", 2024-09-17T02:22:16.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117942 2024-09-17T02:22:16.619 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:16.619 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:16.619 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:16.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.619 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:215608 5.b 5:dc0c9ba3:::benchmark_data_smithi001_23533_object87491:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T02:22:16.619 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:16.580968+0000", 2024-09-17T02:22:16.619 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0029667410000000002, 2024-09-17T02:22:16.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033632699999999998, 2024-09-17T02:22:16.620 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:16.620 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:16.620 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:16.620 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:16.620 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:16.620 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:16.620 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 215608 2024-09-17T02:22:16.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.620 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:16.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:16.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.580968+0000", 2024-09-17T02:22:16.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:16.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:16.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.580968+0000", 2024-09-17T02:22:16.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:16.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:16.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.580969+0000", 2024-09-17T02:22:16.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5199999999999996e-07 2024-09-17T02:22:16.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:16.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.580973+0000", 2024-09-17T02:22:16.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8489999999999999e-06 2024-09-17T02:22:16.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:16.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.580984+0000", 2024-09-17T02:22:16.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0627e-05 2024-09-17T02:22:16.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.580991+0000", 2024-09-17T02:22:16.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0639999999999996e-06 2024-09-17T02:22:16.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:16.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.581044+0000", 2024-09-17T02:22:16.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3188e-05 2024-09-17T02:22:16.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:16.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.581157+0000", 2024-09-17T02:22:16.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011298099999999999 2024-09-17T02:22:16.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:16.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.581274+0000", 2024-09-17T02:22:16.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117398 2024-09-17T02:22:16.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:16.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.583805+0000", 2024-09-17T02:22:16.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025306019999999999 2024-09-17T02:22:16.624 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:16.624 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:16.624 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:16.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.624 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:215606 5.8 e68/26 5:126a3f8c:::benchmark_data_smithi001_23533_object87489:head v 68'13676, mlcod=68'13674)", 2024-09-17T02:22:16.624 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:16.581168+0000", 2024-09-17T02:22:16.624 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.002767392, 2024-09-17T02:22:16.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032052109999999999, 2024-09-17T02:22:16.624 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:16.625 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:16.625 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:16.625 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:16.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:16.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.581168+0000", 2024-09-17T02:22:16.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:16.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:16.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.581168+0000", 2024-09-17T02:22:16.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:16.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:16.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.581168+0000", 2024-09-17T02:22:16.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9299999999999997e-07 2024-09-17T02:22:16.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:16.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.581173+0000", 2024-09-17T02:22:16.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9620000000000001e-06 2024-09-17T02:22:16.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:16.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.581183+0000", 2024-09-17T02:22:16.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7710000000000001e-06 2024-09-17T02:22:16.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.581189+0000", 2024-09-17T02:22:16.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2450000000000003e-06 2024-09-17T02:22:16.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:16.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.581247+0000", 2024-09-17T02:22:16.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7890000000000003e-05 2024-09-17T02:22:16.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:16.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.581265+0000", 2024-09-17T02:22:16.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7533999999999998e-05 2024-09-17T02:22:16.628 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:16.628 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:16.628 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:16.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.628 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:215610 5.9 5:94f7ae55:::benchmark_data_smithi001_23533_object87493:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T02:22:16.628 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:16.581336+0000", 2024-09-17T02:22:16.628 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.002598777, 2024-09-17T02:22:16.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003068402, 2024-09-17T02:22:16.628 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:16.628 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:16.629 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:16.629 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:16.629 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:16.629 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:16.629 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 215610 2024-09-17T02:22:16.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.629 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:16.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:16.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.581336+0000", 2024-09-17T02:22:16.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:16.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:16.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.581336+0000", 2024-09-17T02:22:16.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:16.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:16.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.581337+0000", 2024-09-17T02:22:16.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4000000000000001e-07 2024-09-17T02:22:16.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:16.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.581341+0000", 2024-09-17T02:22:16.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7840000000000001e-06 2024-09-17T02:22:16.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:16.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.581352+0000", 2024-09-17T02:22:16.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0729e-05 2024-09-17T02:22:16.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.581359+0000", 2024-09-17T02:22:16.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3490000000000003e-06 2024-09-17T02:22:16.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:16.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.581427+0000", 2024-09-17T02:22:16.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7797000000000002e-05 2024-09-17T02:22:16.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:16.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.581561+0000", 2024-09-17T02:22:16.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000134349 2024-09-17T02:22:16.632 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:16.632 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:16.632 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:16.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.632 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:215611 5.e 5:7ee0e8d1:::benchmark_data_smithi001_23533_object87494:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T02:22:16.632 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:16.582029+0000", 2024-09-17T02:22:16.632 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0019061359999999999, 2024-09-17T02:22:16.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024109819999999999, 2024-09-17T02:22:16.633 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:16.633 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:16.633 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:16.633 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:16.633 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:16.633 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:16.633 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 215611 2024-09-17T02:22:16.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.633 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:16.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:16.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.582029+0000", 2024-09-17T02:22:16.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:16.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:16.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.582029+0000", 2024-09-17T02:22:16.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:16.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:16.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.582030+0000", 2024-09-17T02:22:16.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8299999999999995e-07 2024-09-17T02:22:16.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:16.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.582034+0000", 2024-09-17T02:22:16.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5460000000000002e-06 2024-09-17T02:22:16.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:16.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.582046+0000", 2024-09-17T02:22:16.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1892000000000001e-05 2024-09-17T02:22:16.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:16.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.582053+0000", 2024-09-17T02:22:16.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9369999999999998e-06 2024-09-17T02:22:16.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:16.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.582113+0000", 2024-09-17T02:22:16.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9639999999999998e-05 2024-09-17T02:22:16.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:16.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.582222+0000", 2024-09-17T02:22:16.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010943299999999999 2024-09-17T02:22:16.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:16.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:16.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:16.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:16.582284+0000", 2024-09-17T02:22:16.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1694999999999998e-05 2024-09-17T02:22:16.636 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:16.636 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:16.636 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:16.636 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:16.637 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:22:16.637 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 13 2024-09-17T02:22:16.637 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:16.638 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:16.639 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:16.640+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:16.701 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:22:16.701 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:22:16.720 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:22:16.720 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:22:16.720 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:22:16.723 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:22:16.724 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:22:16.739 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:16.738+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:16.833 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:16.833 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:16.839 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:16.840+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:16.851 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:16.940 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:16.940+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:17.039 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:17.039 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:17.041 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:17.042+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:17.057 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:17.141 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T02:22:17.142 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:17.144+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:17.206 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:17.207 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:17.227 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:17.270 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:17.272+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:17.343 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:17.344+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:17.417 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:17.418 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:17.437 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:17.481 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:17.484+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:17.545 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:17.542+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:17.631 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:17.632 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:17.646 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:17.648+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:17.652 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:17.747 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:17.746+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:17.789 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:17.789 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:17.809 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:17.848 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:17.848+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:17.949 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:17.952+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:18.005 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:18.005 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:18.024 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:18.069 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:18.070+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:18.118 INFO:teuthology.orchestra.run.smithi001.stderr:noscrub is set 2024-09-17T02:22:18.150 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:18.150+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:18.173 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:18.174 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:18.191 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:18.251 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:18.252+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:18.344 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:18.344 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:18.352 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:18.356+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:18.364 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:18.456 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:18.460+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:18.554 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:18.554+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:18.559 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:18.559 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:18.579 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:18.665 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:18.668+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:18.725 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:22:18.756 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:18.756+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:18.771 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:18.771 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:18.791 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:18.857 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:18.854+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:18.886 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:22:18.886 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:22:18.904 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:22:18.905 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:22:18.905 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:22:18.908 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:22:18.908 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:22:18.940 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:18.940 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:22:18.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.940 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:221185 5.d 5:b680dd14:::benchmark_data_smithi001_23533_object93068:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T02:22:18.940 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:18.941632+0000", 2024-09-17T02:22:18.940 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0019263419999999999, 2024-09-17T02:22:18.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001943272, 2024-09-17T02:22:18.941 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:18.941 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:18.941 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-17T02:22:18.941 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:18.941 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:18.941 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:18.941 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 221185 2024-09-17T02:22:18.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.941 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:18.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:18.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.941632+0000", 2024-09-17T02:22:18.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:18.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:18.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.941632+0000", 2024-09-17T02:22:18.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:18.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:18.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.941633+0000", 2024-09-17T02:22:18.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6899999999999996e-07 2024-09-17T02:22:18.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:18.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.941636+0000", 2024-09-17T02:22:18.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1089999999999998e-06 2024-09-17T02:22:18.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:18.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.941649+0000", 2024-09-17T02:22:18.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2802e-05 2024-09-17T02:22:18.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:18.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.941658+0000", 2024-09-17T02:22:18.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1300000000000007e-06 2024-09-17T02:22:18.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:18.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.943486+0000", 2024-09-17T02:22:18.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001828728 2024-09-17T02:22:18.944 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:18.944 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:18.944 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:18.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.944 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:221186 5.a e69/22 5:5698c1bb:::benchmark_data_smithi001_23533_object93069:head v 69'13951, mlcod=69'13949)", 2024-09-17T02:22:18.944 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:18.943417+0000", 2024-09-17T02:22:18.944 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.000141459, 2024-09-17T02:22:18.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020036699999999999, 2024-09-17T02:22:18.945 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:18.945 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:18.945 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:18.945 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:18.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:18.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.943417+0000", 2024-09-17T02:22:18.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:18.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:18.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.943417+0000", 2024-09-17T02:22:18.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:18.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:18.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.943417+0000", 2024-09-17T02:22:18.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1399999999999996e-07 2024-09-17T02:22:18.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:18.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.943423+0000", 2024-09-17T02:22:18.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1399999999999999e-06 2024-09-17T02:22:18.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:18.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.943435+0000", 2024-09-17T02:22:18.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2046e-05 2024-09-17T02:22:18.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:18.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.943446+0000", 2024-09-17T02:22:18.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1296e-05 2024-09-17T02:22:18.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:18.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.943492+0000", 2024-09-17T02:22:18.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5901e-05 2024-09-17T02:22:18.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:18.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.943511+0000", 2024-09-17T02:22:18.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9162000000000001e-05 2024-09-17T02:22:18.951 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:18.951 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:18.951 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:18.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.952 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:221171 5.1 5:8da0d5f3:::benchmark_data_smithi001_23533_object93054:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T02:22:18.952 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:18.935732+0000", 2024-09-17T02:22:18.952 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0078263929999999992, 2024-09-17T02:22:18.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0079201199999999992, 2024-09-17T02:22:18.953 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:18.953 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:18.953 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:18.953 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:18.953 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:18.953 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:18.953 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 221171 2024-09-17T02:22:18.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.954 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:18.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:18.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.935732+0000", 2024-09-17T02:22:18.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:18.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:18.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.935732+0000", 2024-09-17T02:22:18.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:18.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:18.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.935732+0000", 2024-09-17T02:22:18.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4899999999999995e-07 2024-09-17T02:22:18.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:18.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.935735+0000", 2024-09-17T02:22:18.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7659999999999999e-06 2024-09-17T02:22:18.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:18.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.935743+0000", 2024-09-17T02:22:18.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2330000000000006e-06 2024-09-17T02:22:18.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:18.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.935749+0000", 2024-09-17T02:22:18.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8449999999999999e-06 2024-09-17T02:22:18.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:18.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.936876+0000", 2024-09-17T02:22:18.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011265349999999999 2024-09-17T02:22:18.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:18.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.936954+0000", 2024-09-17T02:22:18.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8677999999999994e-05 2024-09-17T02:22:18.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:18.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.937028+0000", 2024-09-17T02:22:18.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4067999999999996e-05 2024-09-17T02:22:18.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:18.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.938204+0000", 2024-09-17T02:22:18.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011758599999999999 2024-09-17T02:22:18.958 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:18.958 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:18.958 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:18.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.959 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:221178 5.3 5:c7f9f1a9:::benchmark_data_smithi001_23533_object93061:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T02:22:18.959 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:18.939461+0000", 2024-09-17T02:22:18.959 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0040973269999999996, 2024-09-17T02:22:18.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042330859999999996, 2024-09-17T02:22:18.959 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:18.959 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:18.959 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:18.959 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:18.959 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:18.959 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:18.959 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 221178 2024-09-17T02:22:18.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.960 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:18.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:18.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.939461+0000", 2024-09-17T02:22:18.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:18.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:18.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.939461+0000", 2024-09-17T02:22:18.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:18.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:18.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.939462+0000", 2024-09-17T02:22:18.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5600000000000005e-07 2024-09-17T02:22:18.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:18.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.939465+0000", 2024-09-17T02:22:18.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3550000000000001e-06 2024-09-17T02:22:18.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:18.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.939477+0000", 2024-09-17T02:22:18.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1778e-05 2024-09-17T02:22:18.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:18.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.939483+0000", 2024-09-17T02:22:18.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.268e-06 2024-09-17T02:22:18.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:18.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.939526+0000", 2024-09-17T02:22:18.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2948000000000003e-05 2024-09-17T02:22:18.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.939596+0000", 2024-09-17T02:22:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9951999999999997e-05 2024-09-17T02:22:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.939659+0000", 2024-09-17T02:22:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3433000000000001e-05 2024-09-17T02:22:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:221179 5.3 5:c96922b5:::benchmark_data_smithi001_23533_object93062:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T02:22:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:18.940421+0000", 2024-09-17T02:22:18.964 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.003137267, 2024-09-17T02:22:18.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003334648, 2024-09-17T02:22:18.964 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:18.964 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:18.964 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:18.964 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:18.964 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:18.964 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:18.964 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 221179 2024-09-17T02:22:18.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.964 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:18.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:18.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.940421+0000", 2024-09-17T02:22:18.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:18.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:18.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.940421+0000", 2024-09-17T02:22:18.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:18.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:18.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.940422+0000", 2024-09-17T02:22:18.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.16e-07 2024-09-17T02:22:18.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:18.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.940426+0000", 2024-09-17T02:22:18.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.51e-06 2024-09-17T02:22:18.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:18.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.940439+0000", 2024-09-17T02:22:18.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2991e-05 2024-09-17T02:22:18.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:18.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.940449+0000", 2024-09-17T02:22:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3270000000000007e-06 2024-09-17T02:22:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.941258+0000", 2024-09-17T02:22:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080894799999999998 2024-09-17T02:22:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.941358+0000", 2024-09-17T02:22:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9912000000000002e-05 2024-09-17T02:22:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:18.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.941449+0000", 2024-09-17T02:22:18.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1162999999999994e-05 2024-09-17T02:22:18.968 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:18.968 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:18.968 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:18.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.968 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:221180 5.3 5:cec6e1dc:::benchmark_data_smithi001_23533_object93063:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T02:22:18.968 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:18.941399+0000", 2024-09-17T02:22:18.968 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.002159341, 2024-09-17T02:22:18.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023963399999999998, 2024-09-17T02:22:18.968 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 221180 2024-09-17T02:22:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.941399+0000", 2024-09-17T02:22:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.941399+0000", 2024-09-17T02:22:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.941400+0000", 2024-09-17T02:22:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.37e-07 2024-09-17T02:22:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.941411+0000", 2024-09-17T02:22:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659e-05 2024-09-17T02:22:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.941422+0000", 2024-09-17T02:22:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1003e-05 2024-09-17T02:22:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.941430+0000", 2024-09-17T02:22:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3599999999999998e-06 2024-09-17T02:22:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:18.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.943089+0000", 2024-09-17T02:22:18.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016594750000000001 2024-09-17T02:22:18.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:18.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.943167+0000", 2024-09-17T02:22:18.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8083000000000004e-05 2024-09-17T02:22:18.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:18.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.943231+0000", 2024-09-17T02:22:18.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3378000000000002e-05 2024-09-17T02:22:18.973 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:18.973 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:18.973 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:18.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.973 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:221182 5.d 5:b04608fc:::benchmark_data_smithi001_23533_object93065:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T02:22:18.973 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:18.941450+0000", 2024-09-17T02:22:18.973 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0021077019999999999, 2024-09-17T02:22:18.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002382693, 2024-09-17T02:22:18.973 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:18.973 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:18.973 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:18.973 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:18.973 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:18.974 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:18.974 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 221182 2024-09-17T02:22:18.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.974 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:18.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:18.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.941450+0000", 2024-09-17T02:22:18.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:18.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:18.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.941450+0000", 2024-09-17T02:22:18.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.941451+0000", 2024-09-17T02:22:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1900000000000002e-07 2024-09-17T02:22:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.941454+0000", 2024-09-17T02:22:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0149999999999999e-06 2024-09-17T02:22:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.941463+0000", 2024-09-17T02:22:18.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5949999999999999e-06 2024-09-17T02:22:18.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:18.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.941469+0000", 2024-09-17T02:22:18.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0560000000000001e-06 2024-09-17T02:22:18.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:18.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.941521+0000", 2024-09-17T02:22:18.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2475000000000002e-05 2024-09-17T02:22:18.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:18.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:18.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:18.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:18.941671+0000", 2024-09-17T02:22:18.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149309 2024-09-17T02:22:18.977 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:18.977 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:18.977 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:18.977 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:18.977 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:22:18.977 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 7 2024-09-17T02:22:18.977 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:18.979 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:18.979 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:18.980+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:19.080 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:19.078+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:19.168 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:19.169 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:22:19.169 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:22:19.169 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:22:19.169 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:19.180 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:19.178+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:19.189 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:19.281 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:19.278+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:19.382 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:19.384+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:19.391 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:19.392 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:22:19.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:22:19.392 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:22:19.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.392 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97749 5.b 5:d930ef52:::benchmark_data_smithi001_23533_object97748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:19.392 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:19.392 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 61.801580090999998, 2024-09-17T02:22:19.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092964343000000005, 2024-09-17T02:22:19.392 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:19.392 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:19.393 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:19.393 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:19.393 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:19.393 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:19.393 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97749 2024-09-17T02:22:19.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.393 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:19.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:19.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:19.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:19.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:19.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:19.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591947+0000", 2024-09-17T02:22:19.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:22:19.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:19.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592011+0000", 2024-09-17T02:22:19.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3608000000000005e-05 2024-09-17T02:22:19.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:19.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592021+0000", 2024-09-17T02:22:19.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9979999999999998e-06 2024-09-17T02:22:19.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592028+0000", 2024-09-17T02:22:19.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1439999999999997e-06 2024-09-17T02:22:19.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593633+0000", 2024-09-17T02:22:19.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001604636 2024-09-17T02:22:19.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:19.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593757+0000", 2024-09-17T02:22:19.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012432099999999999 2024-09-17T02:22:19.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:19.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593866+0000", 2024-09-17T02:22:19.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109094 2024-09-17T02:22:19.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:19.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601190+0000", 2024-09-17T02:22:19.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073237620000000002 2024-09-17T02:22:19.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:19.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601356+0000", 2024-09-17T02:22:19.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016651900000000001 2024-09-17T02:22:19.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:19.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684618+0000", 2024-09-17T02:22:19.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083261356999999994 2024-09-17T02:22:19.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:19.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684724+0000", 2024-09-17T02:22:19.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010681800000000001 2024-09-17T02:22:19.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:19.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684911+0000", 2024-09-17T02:22:19.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186243 2024-09-17T02:22:19.400 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.400 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:19.400 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.401 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97752 5.b 5:d146f486:::benchmark_data_smithi001_23533_object97751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:19.401 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:19.401 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 61.800227397, 2024-09-17T02:22:19.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091989557, 2024-09-17T02:22:19.401 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:19.401 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:19.401 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:19.401 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:19.402 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:19.402 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:19.402 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97752 2024-09-17T02:22:19.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.402 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:19.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:19.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:19.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:19.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:19.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:19.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593300+0000", 2024-09-17T02:22:19.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8199999999999998e-07 2024-09-17T02:22:19.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:19.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593364+0000", 2024-09-17T02:22:19.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3831999999999995e-05 2024-09-17T02:22:19.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:19.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593376+0000", 2024-09-17T02:22:19.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1800999999999999e-05 2024-09-17T02:22:19.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593382+0000", 2024-09-17T02:22:19.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6780000000000003e-06 2024-09-17T02:22:19.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595491+0000", 2024-09-17T02:22:19.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021090689999999999 2024-09-17T02:22:19.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:19.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595614+0000", 2024-09-17T02:22:19.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012321500000000001 2024-09-17T02:22:19.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:19.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595778+0000", 2024-09-17T02:22:19.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016321900000000001 2024-09-17T02:22:19.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:19.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601197+0000", 2024-09-17T02:22:19.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054195600000000003 2024-09-17T02:22:19.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:19.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601396+0000", 2024-09-17T02:22:19.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019825299999999999 2024-09-17T02:22:19.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:19.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684990+0000", 2024-09-17T02:22:19.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083594878999999997 2024-09-17T02:22:19.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:19.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685116+0000", 2024-09-17T02:22:19.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012522799999999999 2024-09-17T02:22:19.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:19.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685289+0000", 2024-09-17T02:22:19.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172941 2024-09-17T02:22:19.411 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.411 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:19.411 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.412 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97754 5.b 5:da0615e5:::benchmark_data_smithi001_23533_object97753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:19.412 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:19.412 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 61.798589475, 2024-09-17T02:22:19.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092097207, 2024-09-17T02:22:19.412 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:19.412 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:19.412 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:19.412 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:19.412 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:19.412 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:19.413 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97754 2024-09-17T02:22:19.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.413 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:19.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:19.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:19.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:19.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:19.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:19.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594938+0000", 2024-09-17T02:22:19.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5000000000000002e-07 2024-09-17T02:22:19.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:19.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595075+0000", 2024-09-17T02:22:19.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137742 2024-09-17T02:22:19.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:19.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595087+0000", 2024-09-17T02:22:19.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1243000000000001e-05 2024-09-17T02:22:19.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595095+0000", 2024-09-17T02:22:19.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1030000000000002e-06 2024-09-17T02:22:19.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598461+0000", 2024-09-17T02:22:19.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033661170000000001 2024-09-17T02:22:19.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:19.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598540+0000", 2024-09-17T02:22:19.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8937999999999995e-05 2024-09-17T02:22:19.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:19.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598626+0000", 2024-09-17T02:22:19.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6042000000000001e-05 2024-09-17T02:22:19.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:19.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684258+0000", 2024-09-17T02:22:19.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085632394000000001 2024-09-17T02:22:19.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:19.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685369+0000", 2024-09-17T02:22:19.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001111063 2024-09-17T02:22:19.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:19.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685511+0000", 2024-09-17T02:22:19.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141965 2024-09-17T02:22:19.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:19.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685604+0000", 2024-09-17T02:22:19.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2935000000000004e-05 2024-09-17T02:22:19.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:19.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687034+0000", 2024-09-17T02:22:19.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001430015 2024-09-17T02:22:19.418 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.418 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:19.418 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.418 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97755 5.b 5:d36a03a1:::benchmark_data_smithi001_23533_object97754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:19.419 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:19.419 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 61.798416324999998, 2024-09-17T02:22:19.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0924904, 2024-09-17T02:22:19.419 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:19.419 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:19.419 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:19.419 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:19.419 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:19.419 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:19.419 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97755 2024-09-17T02:22:19.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.419 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:19.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:19.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:19.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:19.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:19.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:19.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595111+0000", 2024-09-17T02:22:19.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:22:19.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:19.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595145+0000", 2024-09-17T02:22:19.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3927000000000002e-05 2024-09-17T02:22:19.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:19.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595155+0000", 2024-09-17T02:22:19.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0023e-05 2024-09-17T02:22:19.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595162+0000", 2024-09-17T02:22:19.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3950000000000003e-06 2024-09-17T02:22:19.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599821+0000", 2024-09-17T02:22:19.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046592880000000001 2024-09-17T02:22:19.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:19.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599912+0000", 2024-09-17T02:22:19.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1049000000000002e-05 2024-09-17T02:22:19.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:19.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600062+0000", 2024-09-17T02:22:19.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015001700000000001 2024-09-17T02:22:19.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:19.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685307+0000", 2024-09-17T02:22:19.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085244340000000002 2024-09-17T02:22:19.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:19.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685446+0000", 2024-09-17T02:22:19.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013955700000000001 2024-09-17T02:22:19.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:19.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687375+0000", 2024-09-17T02:22:19.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019291079999999999 2024-09-17T02:22:19.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:19.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687462+0000", 2024-09-17T02:22:19.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6148000000000003e-05 2024-09-17T02:22:19.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:19.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687600+0000", 2024-09-17T02:22:19.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013887900000000001 2024-09-17T02:22:19.425 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.426 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:19.426 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.426 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 44/44 lb 5:c4567a04:::benchmark_data_smithi001_23533_object4200:head)", 2024-09-17T02:22:19.426 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:19.426 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 61.796319699000001, 2024-09-17T02:22:19.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092483421999999996, 2024-09-17T02:22:19.426 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:19.426 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:19.426 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:19.426 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:19.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:19.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:19.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:19.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:19.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:19.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:19.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6399999999999998e-07 2024-09-17T02:22:19.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:19.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597213+0000", 2024-09-17T02:22:19.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3659999999999997e-06 2024-09-17T02:22:19.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:19.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597222+0000", 2024-09-17T02:22:19.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0510000000000002e-06 2024-09-17T02:22:19.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597228+0000", 2024-09-17T02:22:19.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1569999999999999e-06 2024-09-17T02:22:19.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689588+0000", 2024-09-17T02:22:19.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092359931000000006 2024-09-17T02:22:19.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:19.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689622+0000", 2024-09-17T02:22:19.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4425999999999999e-05 2024-09-17T02:22:19.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:19.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689690+0000", 2024-09-17T02:22:19.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8126999999999993e-05 2024-09-17T02:22:19.430 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.430 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:19.430 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.430 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129462 5.4 5:2e0acc16:::benchmark_data_smithi001_23533_object1345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:19.431 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:19.431 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.85858563, 2024-09-17T02:22:19.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0112774899999999, 2024-09-17T02:22:19.431 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:19.431 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:19.431 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:19.431 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:19.431 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:19.431 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:19.431 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129462 2024-09-17T02:22:19.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.432 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:19.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:19.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:19.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:19.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:19.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:19.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534943+0000", 2024-09-17T02:22:19.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8759999999999999e-06 2024-09-17T02:22:19.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:19.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534951+0000", 2024-09-17T02:22:19.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3219999999999993e-06 2024-09-17T02:22:19.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:19.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534977+0000", 2024-09-17T02:22:19.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6245e-05 2024-09-17T02:22:19.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534992+0000", 2024-09-17T02:22:19.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4936000000000001e-05 2024-09-17T02:22:19.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535133+0000", 2024-09-17T02:22:19.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014051299999999999 2024-09-17T02:22:19.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:19.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:22:19.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1741000000000001e-05 2024-09-17T02:22:19.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.533906+0000", 2024-09-17T02:22:19.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99875209300000001 2024-09-17T02:22:19.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:19.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534348+0000", 2024-09-17T02:22:19.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044128899999999998 2024-09-17T02:22:19.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:19.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534762+0000", 2024-09-17T02:22:19.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000414707 2024-09-17T02:22:19.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:19.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545024+0000", 2024-09-17T02:22:19.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010261283 2024-09-17T02:22:19.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:19.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545953+0000", 2024-09-17T02:22:19.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000929618 2024-09-17T02:22:19.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:19.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546047+0000", 2024-09-17T02:22:19.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3697999999999996e-05 2024-09-17T02:22:19.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:19.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546218+0000", 2024-09-17T02:22:19.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017116899999999999 2024-09-17T02:22:19.438 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.438 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:19.438 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.438 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129480 5.4 5:2b1d398b:::benchmark_data_smithi001_23533_object1363:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:19.438 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:19.439 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.850831163999999, 2024-09-17T02:22:19.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0038926450000001, 2024-09-17T02:22:19.439 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:19.439 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:19.439 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:19.439 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:19.440 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:19.440 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:19.440 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129480 2024-09-17T02:22:19.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.440 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:19.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:19.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:19.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:19.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:19.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:19.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542696+0000", 2024-09-17T02:22:19.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9999999999999995e-07 2024-09-17T02:22:19.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:19.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542701+0000", 2024-09-17T02:22:19.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2240000000000003e-06 2024-09-17T02:22:19.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:19.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542716+0000", 2024-09-17T02:22:19.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4970000000000001e-05 2024-09-17T02:22:19.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542726+0000", 2024-09-17T02:22:19.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2879999999999998e-06 2024-09-17T02:22:19.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542832+0000", 2024-09-17T02:22:19.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010597199999999999 2024-09-17T02:22:19.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:19.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542843+0000", 2024-09-17T02:22:19.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.098e-05 2024-09-17T02:22:19.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538436+0000", 2024-09-17T02:22:19.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99559286800000002 2024-09-17T02:22:19.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:19.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538791+0000", 2024-09-17T02:22:19.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035585499999999997 2024-09-17T02:22:19.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:19.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.539144+0000", 2024-09-17T02:22:19.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035268499999999999 2024-09-17T02:22:19.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:19.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545880+0000", 2024-09-17T02:22:19.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00673552 2024-09-17T02:22:19.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:19.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546330+0000", 2024-09-17T02:22:19.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045039599999999999 2024-09-17T02:22:19.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:19.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546414+0000", 2024-09-17T02:22:19.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4468000000000005e-05 2024-09-17T02:22:19.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:19.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546588+0000", 2024-09-17T02:22:19.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017341899999999999 2024-09-17T02:22:19.453 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.453 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:19.453 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.454 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129505 5.4 5:294f2ec7:::benchmark_data_smithi001_23533_object1388:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:19.454 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:19.454 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.831817991000001, 2024-09-17T02:22:19.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98589826199999997, 2024-09-17T02:22:19.455 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:19.455 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:19.455 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:19.455 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:19.455 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:19.456 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:19.456 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129505 2024-09-17T02:22:19.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.456 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:19.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:19.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:19.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:19.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:19.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:19.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561710+0000", 2024-09-17T02:22:19.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7060000000000001e-06 2024-09-17T02:22:19.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:19.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561718+0000", 2024-09-17T02:22:19.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.542e-06 2024-09-17T02:22:19.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:19.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561741+0000", 2024-09-17T02:22:19.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3357e-05 2024-09-17T02:22:19.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561754+0000", 2024-09-17T02:22:19.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3200000000000001e-05 2024-09-17T02:22:19.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561867+0000", 2024-09-17T02:22:19.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113211 2024-09-17T02:22:19.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:19.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561888+0000", 2024-09-17T02:22:19.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0809999999999999e-05 2024-09-17T02:22:19.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542140+0000", 2024-09-17T02:22:19.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98025195799999998 2024-09-17T02:22:19.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:19.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542331+0000", 2024-09-17T02:22:19.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019127599999999999 2024-09-17T02:22:19.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:19.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542517+0000", 2024-09-17T02:22:19.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000185625 2024-09-17T02:22:19.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:19.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547114+0000", 2024-09-17T02:22:19.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045968620000000002 2024-09-17T02:22:19.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:19.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547187+0000", 2024-09-17T02:22:19.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3348000000000003e-05 2024-09-17T02:22:19.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:19.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547324+0000", 2024-09-17T02:22:19.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013681699999999999 2024-09-17T02:22:19.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:19.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547607+0000", 2024-09-17T02:22:19.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028255000000000001 2024-09-17T02:22:19.464 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.464 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:19.464 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.464 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129508 5.4 5:2892b582:::benchmark_data_smithi001_23533_object1391:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:19.464 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:19.465 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.830480897999998, 2024-09-17T02:22:19.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99697919099999999, 2024-09-17T02:22:19.465 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:19.465 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:19.465 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:19.465 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:19.465 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:19.465 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:19.465 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129508 2024-09-17T02:22:19.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.465 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:19.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:19.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:19.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:19.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:19.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:19.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563047+0000", 2024-09-17T02:22:19.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.274e-06 2024-09-17T02:22:19.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:19.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563054+0000", 2024-09-17T02:22:19.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2799999999999998e-06 2024-09-17T02:22:19.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:19.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563070+0000", 2024-09-17T02:22:19.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5991999999999999e-05 2024-09-17T02:22:19.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563078+0000", 2024-09-17T02:22:19.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2390000000000002e-06 2024-09-17T02:22:19.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563181+0000", 2024-09-17T02:22:19.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102249 2024-09-17T02:22:19.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:19.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563199+0000", 2024-09-17T02:22:19.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8215000000000001e-05 2024-09-17T02:22:19.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547713+0000", 2024-09-17T02:22:19.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98451446399999998 2024-09-17T02:22:19.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:19.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548063+0000", 2024-09-17T02:22:19.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034985499999999999 2024-09-17T02:22:19.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:19.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548490+0000", 2024-09-17T02:22:19.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042658600000000001 2024-09-17T02:22:19.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:19.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555655+0000", 2024-09-17T02:22:19.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071652579999999999 2024-09-17T02:22:19.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:19.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559612+0000", 2024-09-17T02:22:19.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003957103 2024-09-17T02:22:19.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:19.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559768+0000", 2024-09-17T02:22:19.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015556899999999999 2024-09-17T02:22:19.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:19.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560025+0000", 2024-09-17T02:22:19.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025710700000000002 2024-09-17T02:22:19.472 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.472 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:19.472 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.472 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129509 5.4 5:2c35515e:::benchmark_data_smithi001_23533_object1392:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:19.473 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:19.473 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.829853845000002, 2024-09-17T02:22:19.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99969384900000002, 2024-09-17T02:22:19.473 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:19.473 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:19.473 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:19.473 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:19.473 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:19.473 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:19.473 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129509 2024-09-17T02:22:19.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.473 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:19.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:19.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:19.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:19.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:19.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:19.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563674+0000", 2024-09-17T02:22:19.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0920000000000001e-06 2024-09-17T02:22:19.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:19.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563679+0000", 2024-09-17T02:22:19.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7660000000000004e-06 2024-09-17T02:22:19.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:19.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563693+0000", 2024-09-17T02:22:19.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3139000000000001e-05 2024-09-17T02:22:19.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563701+0000", 2024-09-17T02:22:19.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9859999999999994e-06 2024-09-17T02:22:19.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563775+0000", 2024-09-17T02:22:19.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4659000000000005e-05 2024-09-17T02:22:19.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:19.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563785+0000", 2024-09-17T02:22:19.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4839999999999993e-06 2024-09-17T02:22:19.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552085+0000", 2024-09-17T02:22:19.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98829986999999997 2024-09-17T02:22:19.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:19.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552554+0000", 2024-09-17T02:22:19.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046908900000000001 2024-09-17T02:22:19.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:19.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552931+0000", 2024-09-17T02:22:19.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377778 2024-09-17T02:22:19.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:19.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563106+0000", 2024-09-17T02:22:19.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010174186 2024-09-17T02:22:19.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:19.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563138+0000", 2024-09-17T02:22:19.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2495e-05 2024-09-17T02:22:19.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:19.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563225+0000", 2024-09-17T02:22:19.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6677999999999999e-05 2024-09-17T02:22:19.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:19.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563366+0000", 2024-09-17T02:22:19.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014162699999999999 2024-09-17T02:22:19.479 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.479 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:19.479 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.479 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129524 5.4 5:25dca7dd:::benchmark_data_smithi001_23533_object1407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:19.479 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:19.479 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.823162490999998, 2024-09-17T02:22:19.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99999501999999996, 2024-09-17T02:22:19.480 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:19.480 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:19.480 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:19.480 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:19.480 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:19.480 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:19.480 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129524 2024-09-17T02:22:19.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.480 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:19.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.480 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:19.481 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:19.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.481 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:19.481 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:19.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:19.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570365+0000", 2024-09-17T02:22:19.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.142e-06 2024-09-17T02:22:19.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:19.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570369+0000", 2024-09-17T02:22:19.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.856e-06 2024-09-17T02:22:19.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:19.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570385+0000", 2024-09-17T02:22:19.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5855e-05 2024-09-17T02:22:19.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570392+0000", 2024-09-17T02:22:19.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5340000000000002e-06 2024-09-17T02:22:19.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570484+0000", 2024-09-17T02:22:19.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1212999999999996e-05 2024-09-17T02:22:19.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:19.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570498+0000", 2024-09-17T02:22:19.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4331000000000001e-05 2024-09-17T02:22:19.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555835+0000", 2024-09-17T02:22:19.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98533757700000002 2024-09-17T02:22:19.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:19.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556329+0000", 2024-09-17T02:22:19.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000493458 2024-09-17T02:22:19.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:19.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556784+0000", 2024-09-17T02:22:19.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045476499999999999 2024-09-17T02:22:19.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:19.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569852+0000", 2024-09-17T02:22:19.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013068270999999999 2024-09-17T02:22:19.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:19.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569958+0000", 2024-09-17T02:22:19.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106214 2024-09-17T02:22:19.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:19.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570124+0000", 2024-09-17T02:22:19.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165546 2024-09-17T02:22:19.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:19.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570359+0000", 2024-09-17T02:22:19.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023525799999999999 2024-09-17T02:22:19.486 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.486 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:19.486 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.487 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129537 5.4 5:260327c6:::benchmark_data_smithi001_23533_object1420:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:19.487 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:19.487 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.815255962000002, 2024-09-17T02:22:19.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99624596499999996, 2024-09-17T02:22:19.487 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:19.487 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:19.487 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:19.487 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:19.487 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:19.487 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:19.487 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129537 2024-09-17T02:22:19.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.488 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:19.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.488 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:19.488 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:19.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.488 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:19.488 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:19.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.488 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:19.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578272+0000", 2024-09-17T02:22:19.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.164e-06 2024-09-17T02:22:19.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:19.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578278+0000", 2024-09-17T02:22:19.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5060000000000001e-06 2024-09-17T02:22:19.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:19.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578294+0000", 2024-09-17T02:22:19.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5687000000000001e-05 2024-09-17T02:22:19.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578329+0000", 2024-09-17T02:22:19.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5311999999999997e-05 2024-09-17T02:22:19.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578419+0000", 2024-09-17T02:22:19.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0054000000000002e-05 2024-09-17T02:22:19.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:19.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578435+0000", 2024-09-17T02:22:19.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5645999999999999e-05 2024-09-17T02:22:19.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560148+0000", 2024-09-17T02:22:19.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98171342299999997 2024-09-17T02:22:19.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:19.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560383+0000", 2024-09-17T02:22:19.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000234935 2024-09-17T02:22:19.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:19.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560586+0000", 2024-09-17T02:22:19.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000202909 2024-09-17T02:22:19.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:19.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570472+0000", 2024-09-17T02:22:19.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098856959999999994 2024-09-17T02:22:19.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:19.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574138+0000", 2024-09-17T02:22:19.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036660170000000001 2024-09-17T02:22:19.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574298+0000", 2024-09-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016025600000000001 2024-09-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574516+0000", 2024-09-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021835999999999999 2024-09-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129545 5.4 5:22366489:::benchmark_data_smithi001_23533_object1428:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:19.494 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:19.494 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.809393239000002, 2024-09-17T02:22:19.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99074544499999995, 2024-09-17T02:22:19.494 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:19.494 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:19.494 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:19.494 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:19.494 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:19.494 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:19.494 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129545 2024-09-17T02:22:19.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.494 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:19.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:19.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:19.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:19.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:19.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:19.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584135+0000", 2024-09-17T02:22:19.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4699999999999999e-06 2024-09-17T02:22:19.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:19.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584142+0000", 2024-09-17T02:22:19.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1620000000000002e-06 2024-09-17T02:22:19.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:19.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584170+0000", 2024-09-17T02:22:19.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7897000000000001e-05 2024-09-17T02:22:19.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584183+0000", 2024-09-17T02:22:19.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2814e-05 2024-09-17T02:22:19.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584299+0000", 2024-09-17T02:22:19.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116153 2024-09-17T02:22:19.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:19.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584316+0000", 2024-09-17T02:22:19.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7524999999999999e-05 2024-09-17T02:22:19.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563461+0000", 2024-09-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97914436699999996 2024-09-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563667+0000", 2024-09-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020689800000000001 2024-09-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563878+0000", 2024-09-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210275 2024-09-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:19.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570584+0000", 2024-09-17T02:22:19.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067066080000000002 2024-09-17T02:22:19.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:19.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574539+0000", 2024-09-17T02:22:19.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039550360000000003 2024-09-17T02:22:19.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:19.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574653+0000", 2024-09-17T02:22:19.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114003 2024-09-17T02:22:19.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:19.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574879+0000", 2024-09-17T02:22:19.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022523700000000001 2024-09-17T02:22:19.500 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.500 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:19.500 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.500 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129553 5.4 5:2e41ad40:::benchmark_data_smithi001_23533_object1436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:19.500 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:19.500 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.803970603000003, 2024-09-17T02:22:19.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99213429600000003, 2024-09-17T02:22:19.500 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:19.501 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:19.501 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:19.501 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:19.501 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:19.501 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:19.501 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129553 2024-09-17T02:22:19.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.501 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:19.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:19.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:19.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:19.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:19.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:19.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589557+0000", 2024-09-17T02:22:19.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2219999999999999e-06 2024-09-17T02:22:19.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:19.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589562+0000", 2024-09-17T02:22:19.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0649999999999998e-06 2024-09-17T02:22:19.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:19.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589575+0000", 2024-09-17T02:22:19.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3129000000000001e-05 2024-09-17T02:22:19.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589584+0000", 2024-09-17T02:22:19.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6200000000000005e-06 2024-09-17T02:22:19.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589693+0000", 2024-09-17T02:22:19.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109319 2024-09-17T02:22:19.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:19.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589714+0000", 2024-09-17T02:22:19.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0849999999999999e-05 2024-09-17T02:22:19.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566273+0000", 2024-09-17T02:22:19.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97655884999999998 2024-09-17T02:22:19.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:19.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566543+0000", 2024-09-17T02:22:19.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027059099999999998 2024-09-17T02:22:19.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:19.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566832+0000", 2024-09-17T02:22:19.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028898200000000002 2024-09-17T02:22:19.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:19.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581040+0000", 2024-09-17T02:22:19.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014208001 2024-09-17T02:22:19.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:19.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581200+0000", 2024-09-17T02:22:19.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159956 2024-09-17T02:22:19.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:19.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581427+0000", 2024-09-17T02:22:19.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000226309 2024-09-17T02:22:19.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:19.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581690+0000", 2024-09-17T02:22:19.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026340199999999998 2024-09-17T02:22:19.506 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.507 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:19.507 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.507 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129580 5.4 5:25ed887b:::benchmark_data_smithi001_23533_object1463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:19.507 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:19.507 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.782198559000001, 2024-09-17T02:22:19.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98001430499999997, 2024-09-17T02:22:19.507 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:19.507 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:19.507 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:19.507 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:19.507 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:19.507 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:19.508 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129580 2024-09-17T02:22:19.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.508 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:19.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:19.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:19.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:19.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:19.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:19.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611329+0000", 2024-09-17T02:22:19.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.22e-06 2024-09-17T02:22:19.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:19.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611335+0000", 2024-09-17T02:22:19.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1129999999999997e-06 2024-09-17T02:22:19.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:19.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611348+0000", 2024-09-17T02:22:19.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2342e-05 2024-09-17T02:22:19.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611356+0000", 2024-09-17T02:22:19.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.371e-06 2024-09-17T02:22:19.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611419+0000", 2024-09-17T02:22:19.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3393999999999996e-05 2024-09-17T02:22:19.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:19.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611427+0000", 2024-09-17T02:22:19.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999997e-06 2024-09-17T02:22:19.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570705+0000", 2024-09-17T02:22:19.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.95927859199999999 2024-09-17T02:22:19.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:19.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571009+0000", 2024-09-17T02:22:19.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030414599999999998 2024-09-17T02:22:19.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:19.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571241+0000", 2024-09-17T02:22:19.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023106799999999999 2024-09-17T02:22:19.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:19.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590789+0000", 2024-09-17T02:22:19.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019548763 2024-09-17T02:22:19.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:19.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590928+0000", 2024-09-17T02:22:19.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000139092 2024-09-17T02:22:19.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:19.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591086+0000", 2024-09-17T02:22:19.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015787400000000001 2024-09-17T02:22:19.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:19.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591342+0000", 2024-09-17T02:22:19.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025589900000000002 2024-09-17T02:22:19.513 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.513 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:19.513 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.513 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129603 5.4 5:25aaa5e8:::benchmark_data_smithi001_23533_object1486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:19.514 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:19.514 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.766138763000001, 2024-09-17T02:22:19.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96463198999999999, 2024-09-17T02:22:19.514 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:19.514 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:19.514 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:19.514 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:19.514 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:19.514 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:19.514 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129603 2024-09-17T02:22:19.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.514 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:19.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:19.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:19.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:19.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:19.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:19.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:19.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:22:19.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:19.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627392+0000", 2024-09-17T02:22:19.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0790000000000002e-06 2024-09-17T02:22:19.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:19.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627403+0000", 2024-09-17T02:22:19.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0866000000000001e-05 2024-09-17T02:22:19.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627409+0000", 2024-09-17T02:22:19.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.305e-06 2024-09-17T02:22:19.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627485+0000", 2024-09-17T02:22:19.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6582000000000006e-05 2024-09-17T02:22:19.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:19.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627499+0000", 2024-09-17T02:22:19.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:22:19.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574991+0000", 2024-09-17T02:22:19.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94749182300000001 2024-09-17T02:22:19.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:19.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575377+0000", 2024-09-17T02:22:19.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038629400000000003 2024-09-17T02:22:19.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:19.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575665+0000", 2024-09-17T02:22:19.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028759499999999997 2024-09-17T02:22:19.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:19.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590802+0000", 2024-09-17T02:22:19.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015136479 2024-09-17T02:22:19.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:19.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591614+0000", 2024-09-17T02:22:19.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081293100000000003 2024-09-17T02:22:19.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:19.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591764+0000", 2024-09-17T02:22:19.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014932199999999999 2024-09-17T02:22:19.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:19.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592020+0000", 2024-09-17T02:22:19.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025585099999999997 2024-09-17T02:22:19.520 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.520 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:19.520 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.520 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129607 5.4 5:2f638f1e:::benchmark_data_smithi001_23533_object1490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:19.520 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:19.520 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.764611856999998, 2024-09-17T02:22:19.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96352375899999998, 2024-09-17T02:22:19.520 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:19.520 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:19.521 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:19.521 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:19.521 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:19.521 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:19.521 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129607 2024-09-17T02:22:19.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.521 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:19.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:19.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:19.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:19.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:19.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:19.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628916+0000", 2024-09-17T02:22:19.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1710000000000001e-06 2024-09-17T02:22:19.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:19.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628920+0000", 2024-09-17T02:22:19.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-17T02:22:19.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:19.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628935+0000", 2024-09-17T02:22:19.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4474000000000001e-05 2024-09-17T02:22:19.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628944+0000", 2024-09-17T02:22:19.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9940000000000006e-06 2024-09-17T02:22:19.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628997+0000", 2024-09-17T02:22:19.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3579000000000003e-05 2024-09-17T02:22:19.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:19.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.629006+0000", 2024-09-17T02:22:19.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4009999999999997e-06 2024-09-17T02:22:19.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.577862+0000", 2024-09-17T02:22:19.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.948856335 2024-09-17T02:22:19.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:19.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578167+0000", 2024-09-17T02:22:19.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030532399999999999 2024-09-17T02:22:19.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:19.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578532+0000", 2024-09-17T02:22:19.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036428200000000001 2024-09-17T02:22:19.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:19.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591442+0000", 2024-09-17T02:22:19.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012910374000000001 2024-09-17T02:22:19.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:19.526 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592164+0000", 2024-09-17T02:22:19.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072242499999999996 2024-09-17T02:22:19.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.526 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.526 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:19.526 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592267+0000", 2024-09-17T02:22:19.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102205 2024-09-17T02:22:19.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.526 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.526 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:19.526 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592438+0000", 2024-09-17T02:22:19.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017165299999999999 2024-09-17T02:22:19.526 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.526 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:19.527 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.527 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129623 5.4 5:2cf5174b:::benchmark_data_smithi001_23533_object1506:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:19.527 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:19.527 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.740667571000003, 2024-09-17T02:22:19.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94334114499999999, 2024-09-17T02:22:19.527 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:19.527 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:19.527 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:19.527 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:19.527 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:19.527 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:19.527 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129623 2024-09-17T02:22:19.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.528 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:19.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:19.528 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:19.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:19.528 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:19.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:19.529 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652860+0000", 2024-09-17T02:22:19.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0330000000000001e-06 2024-09-17T02:22:19.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.529 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.529 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:19.529 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652864+0000", 2024-09-17T02:22:19.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.634e-06 2024-09-17T02:22:19.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.529 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.529 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:19.529 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652877+0000", 2024-09-17T02:22:19.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2591e-05 2024-09-17T02:22:19.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652883+0000", 2024-09-17T02:22:19.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1460000000000001e-06 2024-09-17T02:22:19.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652943+0000", 2024-09-17T02:22:19.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9833999999999997e-05 2024-09-17T02:22:19.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:19.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652950+0000", 2024-09-17T02:22:19.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.401e-06 2024-09-17T02:22:19.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581800+0000", 2024-09-17T02:22:19.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.92884935700000004 2024-09-17T02:22:19.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:19.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582122+0000", 2024-09-17T02:22:19.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032185200000000002 2024-09-17T02:22:19.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:19.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582689+0000", 2024-09-17T02:22:19.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056750400000000003 2024-09-17T02:22:19.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:19.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591458+0000", 2024-09-17T02:22:19.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008768685 2024-09-17T02:22:19.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:19.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595856+0000", 2024-09-17T02:22:19.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043977909999999999 2024-09-17T02:22:19.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.533 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:19.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595955+0000", 2024-09-17T02:22:19.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9166000000000006e-05 2024-09-17T02:22:19.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.533 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:19.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596200+0000", 2024-09-17T02:22:19.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024515099999999998 2024-09-17T02:22:19.533 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.533 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:19.533 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.533 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129642 5.4 5:255eb796:::benchmark_data_smithi001_23533_object1525:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:19.534 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:19.534 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.709431406999997, 2024-09-17T02:22:19.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.91257397299999998, 2024-09-17T02:22:19.534 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:19.534 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:19.534 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:19.534 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:19.534 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:19.534 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:19.534 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129642 2024-09-17T02:22:19.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.534 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:19.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:19.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:19.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:19.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:19.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:19.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684096+0000", 2024-09-17T02:22:19.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659999999999999e-06 2024-09-17T02:22:19.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:19.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684101+0000", 2024-09-17T02:22:19.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8110000000000002e-06 2024-09-17T02:22:19.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:19.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684114+0000", 2024-09-17T02:22:19.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2653000000000001e-05 2024-09-17T02:22:19.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684121+0000", 2024-09-17T02:22:19.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5100000000000001e-06 2024-09-17T02:22:19.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684181+0000", 2024-09-17T02:22:19.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0307999999999999e-05 2024-09-17T02:22:19.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:19.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684194+0000", 2024-09-17T02:22:19.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2916e-05 2024-09-17T02:22:19.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.587917+0000", 2024-09-17T02:22:19.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.90372220400000003 2024-09-17T02:22:19.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:19.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588215+0000", 2024-09-17T02:22:19.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029845400000000003 2024-09-17T02:22:19.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:19.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588470+0000", 2024-09-17T02:22:19.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025455399999999999 2024-09-17T02:22:19.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:19.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596318+0000", 2024-09-17T02:22:19.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078485589999999997 2024-09-17T02:22:19.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:19.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596354+0000", 2024-09-17T02:22:19.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5976999999999998e-05 2024-09-17T02:22:19.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:19.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596449+0000", 2024-09-17T02:22:19.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4728999999999994e-05 2024-09-17T02:22:19.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.540 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:19.540 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596669+0000", 2024-09-17T02:22:19.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220132 2024-09-17T02:22:19.540 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.540 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:19.540 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.540 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.540 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129649 5.4 5:2fe27050:::benchmark_data_smithi001_23533_object1532:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:19.540 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:19.540 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.677874664000001, 2024-09-17T02:22:19.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.88508119100000004, 2024-09-17T02:22:19.540 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:19.541 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:19.541 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:19.541 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:19.541 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:19.541 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:19.541 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129649 2024-09-17T02:22:19.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.541 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:19.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:19.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:19.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:19.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:19.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:19.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:19.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715653+0000", 2024-09-17T02:22:19.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3519999999999999e-06 2024-09-17T02:22:19.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:19.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715658+0000", 2024-09-17T02:22:19.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3120000000000001e-06 2024-09-17T02:22:19.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:19.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715677+0000", 2024-09-17T02:22:19.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-17T02:22:19.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715687+0000", 2024-09-17T02:22:19.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0146000000000001e-05 2024-09-17T02:22:19.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715821+0000", 2024-09-17T02:22:19.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013421 2024-09-17T02:22:19.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:19.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715840+0000", 2024-09-17T02:22:19.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8153999999999999e-05 2024-09-17T02:22:19.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:19.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592528+0000", 2024-09-17T02:22:19.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.87668860000000004 2024-09-17T02:22:19.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:19.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592702+0000", 2024-09-17T02:22:19.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017429300000000001 2024-09-17T02:22:19.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:19.545 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592945+0000", 2024-09-17T02:22:19.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000242048 2024-09-17T02:22:19.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:19.545 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600234+0000", 2024-09-17T02:22:19.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072897600000000002 2024-09-17T02:22:19.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:19.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600494+0000", 2024-09-17T02:22:19.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000259984 2024-09-17T02:22:19.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:19.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600555+0000", 2024-09-17T02:22:19.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1138999999999999e-05 2024-09-17T02:22:19.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:19.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:19.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:19.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600733+0000", 2024-09-17T02:22:19.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017753300000000001 2024-09-17T02:22:19.546 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.546 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:19.546 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.547 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:19.547 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:19.547 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:19.548 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:19.549 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:19.546+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:19.648 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:19.646+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:19.700 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:19.700 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:22:19.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.700 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:223008 5.8 5:158ce4b0:::benchmark_data_smithi001_23533_object94891:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T02:22:19.700 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:19.700506+0000", 2024-09-17T02:22:19.700 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.003140248, 2024-09-17T02:22:19.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031572620000000001, 2024-09-17T02:22:19.701 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:19.701 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:19.701 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:19.701 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:19.701 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:19.701 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:19.701 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 223008 2024-09-17T02:22:19.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.701 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:19.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:19.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700506+0000", 2024-09-17T02:22:19.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:19.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:19.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700506+0000", 2024-09-17T02:22:19.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:19.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:19.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700508+0000", 2024-09-17T02:22:19.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3090000000000001e-06 2024-09-17T02:22:19.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:19.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700513+0000", 2024-09-17T02:22:19.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7380000000000002e-06 2024-09-17T02:22:19.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:19.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700524+0000", 2024-09-17T02:22:19.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1523e-05 2024-09-17T02:22:19.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700532+0000", 2024-09-17T02:22:19.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6550000000000004e-06 2024-09-17T02:22:19.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:19.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700568+0000", 2024-09-17T02:22:19.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6650999999999999e-05 2024-09-17T02:22:19.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:19.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700646+0000", 2024-09-17T02:22:19.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7181000000000005e-05 2024-09-17T02:22:19.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:19.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700707+0000", 2024-09-17T02:22:19.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1779000000000006e-05 2024-09-17T02:22:19.705 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:19.705 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:19.705 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:19.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.705 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:223009 5.2 5:41e783cf:::benchmark_data_smithi001_23533_object94892:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T02:22:19.705 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:19.700558+0000", 2024-09-17T02:22:19.705 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0030888180000000001, 2024-09-17T02:22:19.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031521050000000001, 2024-09-17T02:22:19.705 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:19.705 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:19.705 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:19.706 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:19.706 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:19.706 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:19.706 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 223009 2024-09-17T02:22:19.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.706 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:19.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:19.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700558+0000", 2024-09-17T02:22:19.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:19.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:19.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700558+0000", 2024-09-17T02:22:19.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:19.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:19.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700558+0000", 2024-09-17T02:22:19.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9599999999999999e-07 2024-09-17T02:22:19.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:19.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700565+0000", 2024-09-17T02:22:19.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.759e-06 2024-09-17T02:22:19.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:19.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700574+0000", 2024-09-17T02:22:19.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2099999999999999e-06 2024-09-17T02:22:19.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700582+0000", 2024-09-17T02:22:19.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6350000000000006e-06 2024-09-17T02:22:19.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:19.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700632+0000", 2024-09-17T02:22:19.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9842000000000002e-05 2024-09-17T02:22:19.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:19.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700704+0000", 2024-09-17T02:22:19.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2366999999999993e-05 2024-09-17T02:22:19.709 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:19.709 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:19.709 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:19.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.709 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:223011 5.2 5:478a867a:::benchmark_data_smithi001_23533_object94894:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T02:22:19.709 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:19.700598+0000", 2024-09-17T02:22:19.709 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0030491099999999998, 2024-09-17T02:22:19.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00314804, 2024-09-17T02:22:19.710 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:19.710 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:19.710 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:19.710 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:19.710 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:19.710 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:19.710 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 223011 2024-09-17T02:22:19.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.710 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:19.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:19.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700598+0000", 2024-09-17T02:22:19.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:19.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:19.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700598+0000", 2024-09-17T02:22:19.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:19.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:19.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700598+0000", 2024-09-17T02:22:19.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.68e-07 2024-09-17T02:22:19.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:19.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700601+0000", 2024-09-17T02:22:19.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6010000000000002e-06 2024-09-17T02:22:19.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:19.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700608+0000", 2024-09-17T02:22:19.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8360000000000003e-06 2024-09-17T02:22:19.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700613+0000", 2024-09-17T02:22:19.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3460000000000001e-06 2024-09-17T02:22:19.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:19.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.702868+0000", 2024-09-17T02:22:19.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022548989999999999 2024-09-17T02:22:19.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:19.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.702991+0000", 2024-09-17T02:22:19.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000123072 2024-09-17T02:22:19.713 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:19.713 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:19.713 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:19.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.714 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:223012 5.8 5.e8666168 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T02:22:19.714 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:19.700627+0000", 2024-09-17T02:22:19.714 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.003019744, 2024-09-17T02:22:19.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031511149999999999, 2024-09-17T02:22:19.714 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:19.714 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:19.714 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:19.714 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:19.714 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:19.714 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:19.714 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 223012 2024-09-17T02:22:19.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.714 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:19.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:19.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700627+0000", 2024-09-17T02:22:19.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:19.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:19.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700627+0000", 2024-09-17T02:22:19.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:19.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:19.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700627+0000", 2024-09-17T02:22:19.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2800000000000002e-07 2024-09-17T02:22:19.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:19.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700629+0000", 2024-09-17T02:22:19.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0820000000000001e-06 2024-09-17T02:22:19.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:19.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700635+0000", 2024-09-17T02:22:19.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1429999999999997e-06 2024-09-17T02:22:19.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700640+0000", 2024-09-17T02:22:19.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9869999999999999e-06 2024-09-17T02:22:19.717 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:19.717 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:19.717 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:19.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.717 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:223014 5.a 5:500268cb:::benchmark_data_smithi001_23533_object94897:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T02:22:19.717 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:19.700727+0000", 2024-09-17T02:22:19.717 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.002919507, 2024-09-17T02:22:19.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030805770000000001, 2024-09-17T02:22:19.717 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:19.717 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:19.718 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:19.718 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:19.718 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:19.718 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:19.718 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 223014 2024-09-17T02:22:19.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.718 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:19.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:19.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700727+0000", 2024-09-17T02:22:19.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:19.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:19.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700727+0000", 2024-09-17T02:22:19.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:19.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:19.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700728+0000", 2024-09-17T02:22:19.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.03e-07 2024-09-17T02:22:19.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:19.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700730+0000", 2024-09-17T02:22:19.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2350000000000002e-06 2024-09-17T02:22:19.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:19.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700737+0000", 2024-09-17T02:22:19.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4909999999999999e-06 2024-09-17T02:22:19.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700741+0000", 2024-09-17T02:22:19.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7189999999999999e-06 2024-09-17T02:22:19.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:19.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.702851+0000", 2024-09-17T02:22:19.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002109727 2024-09-17T02:22:19.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:19.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.702975+0000", 2024-09-17T02:22:19.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012414899999999999 2024-09-17T02:22:19.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:19.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.703068+0000", 2024-09-17T02:22:19.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2887999999999996e-05 2024-09-17T02:22:19.721 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:19.721 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:19.721 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:19.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.722 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:223015 5.0 5:048220ca:::benchmark_data_smithi001_23533_object94898:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T02:22:19.722 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:19.700834+0000", 2024-09-17T02:22:19.722 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0028127270000000001, 2024-09-17T02:22:19.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030104350000000001, 2024-09-17T02:22:19.722 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:19.722 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:19.722 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:19.722 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:19.722 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:19.722 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:19.722 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 223015 2024-09-17T02:22:19.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.723 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:19.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:19.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700834+0000", 2024-09-17T02:22:19.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:19.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:19.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700834+0000", 2024-09-17T02:22:19.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:19.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:19.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700835+0000", 2024-09-17T02:22:19.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2300000000000001e-07 2024-09-17T02:22:19.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:19.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700837+0000", 2024-09-17T02:22:19.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2539999999999999e-06 2024-09-17T02:22:19.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:19.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700843+0000", 2024-09-17T02:22:19.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8499999999999999e-06 2024-09-17T02:22:19.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.700846+0000", 2024-09-17T02:22:19.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3909999999999998e-06 2024-09-17T02:22:19.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:19.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.702406+0000", 2024-09-17T02:22:19.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015595139999999999 2024-09-17T02:22:19.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:19.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.702472+0000", 2024-09-17T02:22:19.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6890000000000005e-05 2024-09-17T02:22:19.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:19.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.702530+0000", 2024-09-17T02:22:19.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7247000000000003e-05 2024-09-17T02:22:19.726 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:19.726 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:19.726 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:19.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.726 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:223020 5.0 5.6e8bf2e0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T02:22:19.726 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:19.701178+0000", 2024-09-17T02:22:19.726 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0024687820000000001, 2024-09-17T02:22:19.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027014980000000001, 2024-09-17T02:22:19.726 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:19.727 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:19.727 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:19.727 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:19.727 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:19.727 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:19.727 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 223020 2024-09-17T02:22:19.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.727 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:19.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:19.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.701178+0000", 2024-09-17T02:22:19.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:19.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:19.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.701178+0000", 2024-09-17T02:22:19.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:19.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:19.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.701179+0000", 2024-09-17T02:22:19.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.82e-07 2024-09-17T02:22:19.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:19.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.701181+0000", 2024-09-17T02:22:19.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2740000000000002e-06 2024-09-17T02:22:19.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:19.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.701189+0000", 2024-09-17T02:22:19.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3839999999999997e-06 2024-09-17T02:22:19.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.701193+0000", 2024-09-17T02:22:19.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8089999999999999e-06 2024-09-17T02:22:19.729 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:19.729 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:19.730 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:19.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.730 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:223016 5.4 e69/52 5:2c370a0d:::benchmark_data_smithi001_23533_object94899:head v 69'13735, mlcod=69'13733)", 2024-09-17T02:22:19.730 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:19.701342+0000", 2024-09-17T02:22:19.730 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0023045840000000001, 2024-09-17T02:22:19.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025676079999999999, 2024-09-17T02:22:19.730 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:19.730 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:19.730 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:19.730 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:19.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:19.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.701342+0000", 2024-09-17T02:22:19.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:19.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:19.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.701342+0000", 2024-09-17T02:22:19.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:19.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:19.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.701342+0000", 2024-09-17T02:22:19.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.67e-07 2024-09-17T02:22:19.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:19.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.701345+0000", 2024-09-17T02:22:19.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1900000000000002e-06 2024-09-17T02:22:19.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:19.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.701351+0000", 2024-09-17T02:22:19.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7170000000000002e-06 2024-09-17T02:22:19.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:19.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.701354+0000", 2024-09-17T02:22:19.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6819999999999999e-06 2024-09-17T02:22:19.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:19.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.701389+0000", 2024-09-17T02:22:19.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5216999999999998e-05 2024-09-17T02:22:19.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:19.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:19.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:19.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:19.701402+0000", 2024-09-17T02:22:19.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3071000000000001e-05 2024-09-17T02:22:19.733 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:19.733 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:19.733 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:19.733 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:19.733 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:22:19.733 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 8 2024-09-17T02:22:19.734 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:19.735 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:19.750 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:19.750+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:19.850 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:19.852+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:19.879 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:19.879 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:22:19.879 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:22:19.879 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:22:19.879 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:19.896 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:19.985 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:19.988+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:20.052 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:20.050+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:20.093 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:20.094 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:22:20.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:22:20.094 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:22:20.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.094 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:22:20.094 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:20.094 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.527169346999997, 2024-09-17T02:22:20.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:22:20.094 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:20.094 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:20.094 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.094 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:20.095 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:20.095 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.095 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:22:20.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.095 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:20.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:20.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:20.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:20.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:20.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:20.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:22:20.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:22:20.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:20.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:22:20.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:22:20.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:20.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:22:20.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:22:20.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:22:20.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:22:20.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:20.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:22:20.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:22:20.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:20.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:22:20.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:22:20.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:20.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:22:20.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:22:20.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:20.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:22:20.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:22:20.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:22:20.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:22:20.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:20.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:22:20.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:22:20.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:20.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:22:20.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:22:20.100 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.100 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:20.100 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.100 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:22:20.100 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:20.100 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.523267097000002, 2024-09-17T02:22:20.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:22:20.100 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:20.100 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:20.101 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.101 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:20.101 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:20.101 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.101 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:22:20.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.101 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:20.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:20.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:20.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:20.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:20.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:20.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:22:20.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:22:20.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:20.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:22:20.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:22:20.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:20.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:22:20.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:22:20.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:22:20.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:22:20.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:20.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:22:20.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:22:20.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:20.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:22:20.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:22:20.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:20.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:22:20.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:22:20.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:20.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:22:20.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:22:20.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:22:20.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:22:20.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:20.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:22:20.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:22:20.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:20.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:22:20.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:22:20.106 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.106 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:20.106 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.106 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97759 5.a 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:20.106 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:20.106 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.497247274000003, 2024-09-17T02:22:20.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.089694871999999995, 2024-09-17T02:22:20.106 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:20.106 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:20.107 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.107 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:20.107 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:20.107 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.107 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97759 2024-09-17T02:22:20.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.107 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:20.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:20.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:20.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:20.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:20.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:20.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598386+0000", 2024-09-17T02:22:20.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999999e-07 2024-09-17T02:22:20.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:20.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598414+0000", 2024-09-17T02:22:20.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8013000000000001e-05 2024-09-17T02:22:20.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:20.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598420+0000", 2024-09-17T02:22:20.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1149999999999999e-06 2024-09-17T02:22:20.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598424+0000", 2024-09-17T02:22:20.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:22:20.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:20.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598479+0000", 2024-09-17T02:22:20.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4648999999999998e-05 2024-09-17T02:22:20.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:20.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598587+0000", 2024-09-17T02:22:20.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010853000000000001 2024-09-17T02:22:20.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:20.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598676+0000", 2024-09-17T02:22:20.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8381999999999995e-05 2024-09-17T02:22:20.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:20.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603766+0000", 2024-09-17T02:22:20.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050902559999999996 2024-09-17T02:22:20.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.687988+0000", 2024-09-17T02:22:20.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.084221753999999996 2024-09-17T02:22:20.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:20.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688037+0000", 2024-09-17T02:22:20.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-05 2024-09-17T02:22:20.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:20.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688080+0000", 2024-09-17T02:22:20.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3149999999999999e-05 2024-09-17T02:22:20.112 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.112 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:20.112 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.112 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97770 5.0 5:09c75033:::benchmark_data_smithi001_23533_object97769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:20.112 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:20.112 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.492104843999996, 2024-09-17T02:22:20.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.086380868, 2024-09-17T02:22:20.113 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:20.113 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:20.113 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.113 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:20.113 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:20.113 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.113 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97770 2024-09-17T02:22:20.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.113 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:20.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:20.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:20.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:20.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:20.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:20.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603529+0000", 2024-09-17T02:22:20.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:22:20.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:20.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603593+0000", 2024-09-17T02:22:20.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4216999999999999e-05 2024-09-17T02:22:20.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:20.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603603+0000", 2024-09-17T02:22:20.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5179999999999993e-06 2024-09-17T02:22:20.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603608+0000", 2024-09-17T02:22:20.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2039999999999996e-06 2024-09-17T02:22:20.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:20.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603653+0000", 2024-09-17T02:22:20.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5247000000000002e-05 2024-09-17T02:22:20.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:20.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603758+0000", 2024-09-17T02:22:20.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105352 2024-09-17T02:22:20.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:20.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603900+0000", 2024-09-17T02:22:20.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014198999999999999 2024-09-17T02:22:20.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:20.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.606097+0000", 2024-09-17T02:22:20.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021969839999999999 2024-09-17T02:22:20.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689756+0000", 2024-09-17T02:22:20.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.083659077999999998 2024-09-17T02:22:20.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:20.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689846+0000", 2024-09-17T02:22:20.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9320999999999994e-05 2024-09-17T02:22:20.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:20.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689908+0000", 2024-09-17T02:22:20.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720999999999998e-05 2024-09-17T02:22:20.118 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.118 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:20.118 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.118 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127513 5.c 5:3eca08e4:::benchmark_data_smithi001_23533_object127512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:20.118 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:20.119 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.651328419999999, 2024-09-17T02:22:20.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046626399999999998, 2024-09-17T02:22:20.119 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:20.119 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:20.119 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.119 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:20.119 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:20.119 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.119 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127513 2024-09-17T02:22:20.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.119 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:20.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:20.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:20.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:20.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:20.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:20.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444305+0000", 2024-09-17T02:22:20.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2529999999999999e-06 2024-09-17T02:22:20.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:20.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444466+0000", 2024-09-17T02:22:20.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016069700000000001 2024-09-17T02:22:20.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:20.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444479+0000", 2024-09-17T02:22:20.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2602999999999999e-05 2024-09-17T02:22:20.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444485+0000", 2024-09-17T02:22:20.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.669e-06 2024-09-17T02:22:20.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:20.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444560+0000", 2024-09-17T02:22:20.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4276999999999994e-05 2024-09-17T02:22:20.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:20.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444656+0000", 2024-09-17T02:22:20.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6490000000000006e-05 2024-09-17T02:22:20.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:20.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444739+0000", 2024-09-17T02:22:20.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3139999999999993e-05 2024-09-17T02:22:20.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:20.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.448438+0000", 2024-09-17T02:22:20.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036985490000000002 2024-09-17T02:22:20.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490732+0000", 2024-09-17T02:22:20.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042294353999999999 2024-09-17T02:22:20.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:20.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490859+0000", 2024-09-17T02:22:20.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012708899999999999 2024-09-17T02:22:20.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:20.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490930+0000", 2024-09-17T02:22:20.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:20.124 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.124 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:20.124 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.124 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127514 5.c 5:39cc1feb:::benchmark_data_smithi001_23533_object127513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:20.124 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:20.125 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.651131651, 2024-09-17T02:22:20.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049357228000000003, 2024-09-17T02:22:20.125 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:20.125 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:20.125 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.125 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:20.125 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:20.125 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.125 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127514 2024-09-17T02:22:20.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.125 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:20.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:20.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:20.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:20.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:20.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:20.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:20.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8599999999999998e-07 2024-09-17T02:22:20.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:20.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444554+0000", 2024-09-17T02:22:20.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3047999999999998e-05 2024-09-17T02:22:20.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:20.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444562+0000", 2024-09-17T02:22:20.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5830000000000001e-06 2024-09-17T02:22:20.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444567+0000", 2024-09-17T02:22:20.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4179999999999996e-06 2024-09-17T02:22:20.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:20.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446566+0000", 2024-09-17T02:22:20.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001998788 2024-09-17T02:22:20.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:20.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446696+0000", 2024-09-17T02:22:20.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129393 2024-09-17T02:22:20.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:20.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446794+0000", 2024-09-17T02:22:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8462999999999996e-05 2024-09-17T02:22:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.449036+0000", 2024-09-17T02:22:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022415880000000001 2024-09-17T02:22:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493737+0000", 2024-09-17T02:22:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044701682 2024-09-17T02:22:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:20.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493808+0000", 2024-09-17T02:22:20.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0846000000000006e-05 2024-09-17T02:22:20.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:20.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493858+0000", 2024-09-17T02:22:20.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9932999999999998e-05 2024-09-17T02:22:20.130 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.130 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:20.130 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.130 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129441 5.1 5:84c3199f:::benchmark_data_smithi001_23533_object1324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:20.130 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.592121163000002, 2024-09-17T02:22:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034387011000000002, 2024-09-17T02:22:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129441 2024-09-17T02:22:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:20.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:20.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:20.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:20.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503513+0000", 2024-09-17T02:22:20.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4759999999999999e-06 2024-09-17T02:22:20.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503518+0000", 2024-09-17T02:22:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-09-17T02:22:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503532+0000", 2024-09-17T02:22:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4049999999999999e-05 2024-09-17T02:22:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503541+0000", 2024-09-17T02:22:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5320000000000006e-06 2024-09-17T02:22:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:20.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506331+0000", 2024-09-17T02:22:20.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027899190000000001 2024-09-17T02:22:20.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:20.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506402+0000", 2024-09-17T02:22:20.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:20.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:20.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506477+0000", 2024-09-17T02:22:20.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4626e-05 2024-09-17T02:22:20.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:20.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509749+0000", 2024-09-17T02:22:20.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032726980000000001 2024-09-17T02:22:20.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537758+0000", 2024-09-17T02:22:20.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028008890000000002 2024-09-17T02:22:20.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:20.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537812+0000", 2024-09-17T02:22:20.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3300000000000001e-05 2024-09-17T02:22:20.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:20.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537898+0000", 2024-09-17T02:22:20.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6691000000000001e-05 2024-09-17T02:22:20.136 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.136 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:20.136 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.136 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129442 5.1 5:8f7f2a95:::benchmark_data_smithi001_23533_object1325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:20.136 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:20.137 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.589150554, 2024-09-17T02:22:20.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031546698999999997, 2024-09-17T02:22:20.137 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:20.137 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:20.137 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.137 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:20.137 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:20.137 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.137 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129442 2024-09-17T02:22:20.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.137 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:20.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:20.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:20.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:20.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:20.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:20.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506483+0000", 2024-09-17T02:22:20.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2869999999999999e-06 2024-09-17T02:22:20.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:20.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506489+0000", 2024-09-17T02:22:20.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2330000000000003e-06 2024-09-17T02:22:20.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:20.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506502+0000", 2024-09-17T02:22:20.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2286999999999999e-05 2024-09-17T02:22:20.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506511+0000", 2024-09-17T02:22:20.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7799999999999995e-06 2024-09-17T02:22:20.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:20.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.507966+0000", 2024-09-17T02:22:20.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014541549999999999 2024-09-17T02:22:20.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:20.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508130+0000", 2024-09-17T02:22:20.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016455199999999999 2024-09-17T02:22:20.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:20.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508287+0000", 2024-09-17T02:22:20.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015730400000000001 2024-09-17T02:22:20.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:20.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510577+0000", 2024-09-17T02:22:20.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022899449999999998 2024-09-17T02:22:20.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537932+0000", 2024-09-17T02:22:20.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027354471000000002 2024-09-17T02:22:20.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:20.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537964+0000", 2024-09-17T02:22:20.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1909999999999998e-05 2024-09-17T02:22:20.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:20.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.538029+0000", 2024-09-17T02:22:20.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4775000000000002e-05 2024-09-17T02:22:20.142 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.142 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:20.142 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.142 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:150458 5.a 5:59b62890:::benchmark_data_smithi001_23533_object22341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:22:20.142 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:20.142 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.257306747000001, 2024-09-17T02:22:20.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028150173000000001, 2024-09-17T02:22:20.143 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:20.143 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:20.143 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.143 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:20.143 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:20.143 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.143 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 150458 2024-09-17T02:22:20.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.143 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:20.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:20.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:20.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:20.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:20.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:20.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:20.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7800000000000002e-07 2024-09-17T02:22:20.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:20.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838328+0000", 2024-09-17T02:22:20.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.838e-06 2024-09-17T02:22:20.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:20.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838335+0000", 2024-09-17T02:22:20.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1999999999999997e-06 2024-09-17T02:22:20.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838340+0000", 2024-09-17T02:22:20.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7389999999999999e-06 2024-09-17T02:22:20.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:20.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849082+0000", 2024-09-17T02:22:20.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01074174 2024-09-17T02:22:20.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:20.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849192+0000", 2024-09-17T02:22:20.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011040300000000001 2024-09-17T02:22:20.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:20.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849297+0000", 2024-09-17T02:22:20.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104764 2024-09-17T02:22:20.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.857853+0000", 2024-09-17T02:22:20.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085558490000000008 2024-09-17T02:22:20.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:20.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866430+0000", 2024-09-17T02:22:20.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085768140000000003 2024-09-17T02:22:20.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:20.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866454+0000", 2024-09-17T02:22:20.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4428000000000001e-05 2024-09-17T02:22:20.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:20.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866476+0000", 2024-09-17T02:22:20.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.192e-05 2024-09-17T02:22:20.148 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.148 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:20.148 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.148 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190780 5.3 e65/64 5:c634f18a:::benchmark_data_smithi001_23533_object62663:head v 65'12039, mlcod=0'0)", 2024-09-17T02:22:20.148 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.182278+0000", 2024-09-17T02:22:20.148 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.913354657999999, 2024-09-17T02:22:20.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028943393000000001, 2024-09-17T02:22:20.149 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:20.149 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:20.149 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.149 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:20.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:20.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182278+0000", 2024-09-17T02:22:20.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:20.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182278+0000", 2024-09-17T02:22:20.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:20.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182280+0000", 2024-09-17T02:22:20.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.736e-06 2024-09-17T02:22:20.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:20.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182291+0000", 2024-09-17T02:22:20.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1933000000000001e-05 2024-09-17T02:22:20.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:20.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182317+0000", 2024-09-17T02:22:20.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6024999999999999e-05 2024-09-17T02:22:20.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182332+0000", 2024-09-17T02:22:20.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4856e-05 2024-09-17T02:22:20.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:20.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182463+0000", 2024-09-17T02:22:20.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130674 2024-09-17T02:22:20.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:20.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182533+0000", 2024-09-17T02:22:20.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0296999999999995e-05 2024-09-17T02:22:20.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:20.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211153+0000", 2024-09-17T02:22:20.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028619265000000001 2024-09-17T02:22:20.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:20.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211221+0000", 2024-09-17T02:22:20.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8607000000000002e-05 2024-09-17T02:22:20.152 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.153 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:20.153 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.153 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190799 5.3 e65/64 5:c0e8780b:::benchmark_data_smithi001_23533_object62682:head v 65'12040, mlcod=0'0)", 2024-09-17T02:22:20.153 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.193849+0000", 2024-09-17T02:22:20.153 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.901783306, 2024-09-17T02:22:20.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02989934, 2024-09-17T02:22:20.153 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:20.153 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:20.153 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.153 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:20.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:20.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193849+0000", 2024-09-17T02:22:20.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:20.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193849+0000", 2024-09-17T02:22:20.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:20.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193851+0000", 2024-09-17T02:22:20.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.137e-06 2024-09-17T02:22:20.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:20.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193865+0000", 2024-09-17T02:22:20.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3845999999999999e-05 2024-09-17T02:22:20.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:20.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193888+0000", 2024-09-17T02:22:20.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3312e-05 2024-09-17T02:22:20.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193901+0000", 2024-09-17T02:22:20.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2896e-05 2024-09-17T02:22:20.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:20.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.204084+0000", 2024-09-17T02:22:20.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010182538 2024-09-17T02:22:20.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:20.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.204126+0000", 2024-09-17T02:22:20.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1828e-05 2024-09-17T02:22:20.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:20.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223688+0000", 2024-09-17T02:22:20.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019562408999999999 2024-09-17T02:22:20.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:20.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223748+0000", 2024-09-17T02:22:20.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0374000000000002e-05 2024-09-17T02:22:20.157 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.157 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:20.157 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.157 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190836 5.3 e65/64 5:c72f74ff:::benchmark_data_smithi001_23533_object62719:head v 65'12042, mlcod=0'0)", 2024-09-17T02:22:20.157 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.198478+0000", 2024-09-17T02:22:20.157 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.897154413999999, 2024-09-17T02:22:20.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031214246000000001, 2024-09-17T02:22:20.158 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:20.158 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:20.158 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.158 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:20.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:20.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198478+0000", 2024-09-17T02:22:20.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:20.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198478+0000", 2024-09-17T02:22:20.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:20.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198480+0000", 2024-09-17T02:22:20.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0899999999999999e-06 2024-09-17T02:22:20.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:20.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198494+0000", 2024-09-17T02:22:20.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3572e-05 2024-09-17T02:22:20.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:20.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198521+0000", 2024-09-17T02:22:20.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7178999999999998e-05 2024-09-17T02:22:20.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198533+0000", 2024-09-17T02:22:20.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2588999999999999e-05 2024-09-17T02:22:20.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:20.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208944+0000", 2024-09-17T02:22:20.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010410236 2024-09-17T02:22:20.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:20.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208979+0000", 2024-09-17T02:22:20.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5555000000000001e-05 2024-09-17T02:22:20.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:20.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229627+0000", 2024-09-17T02:22:20.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020647993999999999 2024-09-17T02:22:20.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:20.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229692+0000", 2024-09-17T02:22:20.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5030999999999995e-05 2024-09-17T02:22:20.161 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.162 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:20.162 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.162 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190852 5.3 e65/64 5:c63de204:::benchmark_data_smithi001_23533_object62735:head v 65'12043, mlcod=0'0)", 2024-09-17T02:22:20.162 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.200082+0000", 2024-09-17T02:22:20.162 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.895550416000001, 2024-09-17T02:22:20.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029657795000000001, 2024-09-17T02:22:20.162 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:20.162 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:20.162 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.162 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:20.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:20.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200082+0000", 2024-09-17T02:22:20.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:20.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200082+0000", 2024-09-17T02:22:20.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:20.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200084+0000", 2024-09-17T02:22:20.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1900000000000002e-06 2024-09-17T02:22:20.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:20.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200099+0000", 2024-09-17T02:22:20.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4392999999999999e-05 2024-09-17T02:22:20.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:20.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200122+0000", 2024-09-17T02:22:20.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3292e-05 2024-09-17T02:22:20.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200134+0000", 2024-09-17T02:22:20.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2489e-05 2024-09-17T02:22:20.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:20.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211322+0000", 2024-09-17T02:22:20.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011187689000000001 2024-09-17T02:22:20.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:20.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211383+0000", 2024-09-17T02:22:20.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0707e-05 2024-09-17T02:22:20.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:20.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229698+0000", 2024-09-17T02:22:20.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018315306999999999 2024-09-17T02:22:20.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:20.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229740+0000", 2024-09-17T02:22:20.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1727999999999998e-05 2024-09-17T02:22:20.166 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.166 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:20.166 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.166 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190887 5.3 e65/64 5:cc339b34:::benchmark_data_smithi001_23533_object62770:head v 65'12044, mlcod=0'0)", 2024-09-17T02:22:20.167 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.201631+0000", 2024-09-17T02:22:20.167 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.894001068, 2024-09-17T02:22:20.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028149121999999999, 2024-09-17T02:22:20.167 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:20.167 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:20.167 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.167 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:20.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:20.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201631+0000", 2024-09-17T02:22:20.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:20.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201631+0000", 2024-09-17T02:22:20.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:20.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201634+0000", 2024-09-17T02:22:20.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1629999999999999e-06 2024-09-17T02:22:20.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:20.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201647+0000", 2024-09-17T02:22:20.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3943e-05 2024-09-17T02:22:20.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:20.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201690+0000", 2024-09-17T02:22:20.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2660999999999997e-05 2024-09-17T02:22:20.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.201707+0000", 2024-09-17T02:22:20.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.647e-05 2024-09-17T02:22:20.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:20.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.213560+0000", 2024-09-17T02:22:20.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011852945 2024-09-17T02:22:20.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:20.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.213617+0000", 2024-09-17T02:22:20.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7170999999999999e-05 2024-09-17T02:22:20.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:20.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229744+0000", 2024-09-17T02:22:20.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016127617 2024-09-17T02:22:20.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:20.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229781+0000", 2024-09-17T02:22:20.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6152000000000002e-05 2024-09-17T02:22:20.171 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.171 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:20.171 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.171 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190920 5.3 e65/64 5:c7bc6082:::benchmark_data_smithi001_23533_object62803:head v 65'12047, mlcod=0'0)", 2024-09-17T02:22:20.171 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.206674+0000", 2024-09-17T02:22:20.171 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.88895844, 2024-09-17T02:22:20.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.033826457999999997, 2024-09-17T02:22:20.171 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:20.171 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:20.172 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.172 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:20.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:20.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206674+0000", 2024-09-17T02:22:20.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:20.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206674+0000", 2024-09-17T02:22:20.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:20.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206676+0000", 2024-09-17T02:22:20.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.646e-06 2024-09-17T02:22:20.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:20.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206689+0000", 2024-09-17T02:22:20.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3196999999999999e-05 2024-09-17T02:22:20.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:20.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206718+0000", 2024-09-17T02:22:20.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8988000000000001e-05 2024-09-17T02:22:20.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206736+0000", 2024-09-17T02:22:20.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8221999999999999e-05 2024-09-17T02:22:20.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:20.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.221517+0000", 2024-09-17T02:22:20.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014781247000000001 2024-09-17T02:22:20.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:20.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.221563+0000", 2024-09-17T02:22:20.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5343999999999998e-05 2024-09-17T02:22:20.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:20.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240391+0000", 2024-09-17T02:22:20.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018828693000000001 2024-09-17T02:22:20.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:20.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240500+0000", 2024-09-17T02:22:20.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109121 2024-09-17T02:22:20.175 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.175 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:20.175 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.176 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190947 5.3 e65/64 5:ca95b398:::benchmark_data_smithi001_23533_object62830:head v 65'12048, mlcod=0'0)", 2024-09-17T02:22:20.176 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.208183+0000", 2024-09-17T02:22:20.176 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.887449087, 2024-09-17T02:22:20.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032404800999999997, 2024-09-17T02:22:20.176 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:20.176 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:20.176 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.176 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:20.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:20.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208183+0000", 2024-09-17T02:22:20.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:20.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208183+0000", 2024-09-17T02:22:20.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:20.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208185+0000", 2024-09-17T02:22:20.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.64e-06 2024-09-17T02:22:20.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:20.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208197+0000", 2024-09-17T02:22:20.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1589e-05 2024-09-17T02:22:20.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:20.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208217+0000", 2024-09-17T02:22:20.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0242e-05 2024-09-17T02:22:20.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208227+0000", 2024-09-17T02:22:20.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0256e-05 2024-09-17T02:22:20.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:20.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223908+0000", 2024-09-17T02:22:20.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015680726999999998 2024-09-17T02:22:20.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:20.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223969+0000", 2024-09-17T02:22:20.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1277000000000003e-05 2024-09-17T02:22:20.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:20.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240509+0000", 2024-09-17T02:22:20.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016539484 2024-09-17T02:22:20.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:20.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240588+0000", 2024-09-17T02:22:20.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9585999999999993e-05 2024-09-17T02:22:20.180 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.180 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:20.180 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.180 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190958 5.3 e65/64 5:c9337cc4:::benchmark_data_smithi001_23533_object62841:head v 65'12049, mlcod=0'0)", 2024-09-17T02:22:20.180 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.209746+0000", 2024-09-17T02:22:20.180 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.88588674, 2024-09-17T02:22:20.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030921212999999999, 2024-09-17T02:22:20.181 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:20.181 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:20.181 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.181 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:20.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:20.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209746+0000", 2024-09-17T02:22:20.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:20.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209746+0000", 2024-09-17T02:22:20.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:20.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209748+0000", 2024-09-17T02:22:20.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9989999999999998e-06 2024-09-17T02:22:20.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:20.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209761+0000", 2024-09-17T02:22:20.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3317e-05 2024-09-17T02:22:20.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:20.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209786+0000", 2024-09-17T02:22:20.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4941999999999999e-05 2024-09-17T02:22:20.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209799+0000", 2024-09-17T02:22:20.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2556e-05 2024-09-17T02:22:20.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:20.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.226753+0000", 2024-09-17T02:22:20.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016954100999999999 2024-09-17T02:22:20.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:20.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.226810+0000", 2024-09-17T02:22:20.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7207000000000003e-05 2024-09-17T02:22:20.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:20.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240599+0000", 2024-09-17T02:22:20.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013789228000000001 2024-09-17T02:22:20.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:20.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240667+0000", 2024-09-17T02:22:20.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7862999999999997e-05 2024-09-17T02:22:20.184 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.185 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:20.185 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.185 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:191023 5.3 e65/64 5:cfca4af2:::benchmark_data_smithi001_23533_object62906:head v 65'12050, mlcod=0'0)", 2024-09-17T02:22:20.185 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.210919+0000", 2024-09-17T02:22:20.185 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.884713383999999, 2024-09-17T02:22:20.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029830820000000001, 2024-09-17T02:22:20.185 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:20.185 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:20.185 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.185 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:20.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:20.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210919+0000", 2024-09-17T02:22:20.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:20.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210919+0000", 2024-09-17T02:22:20.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:20.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210921+0000", 2024-09-17T02:22:20.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-09-17T02:22:20.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:20.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210935+0000", 2024-09-17T02:22:20.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3436e-05 2024-09-17T02:22:20.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:20.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210961+0000", 2024-09-17T02:22:20.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6767999999999999e-05 2024-09-17T02:22:20.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210974+0000", 2024-09-17T02:22:20.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2904e-05 2024-09-17T02:22:20.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:20.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229967+0000", 2024-09-17T02:22:20.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018992774 2024-09-17T02:22:20.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:20.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.230023+0000", 2024-09-17T02:22:20.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6334e-05 2024-09-17T02:22:20.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:20.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240673+0000", 2024-09-17T02:22:20.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010649908 2024-09-17T02:22:20.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:20.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240750+0000", 2024-09-17T02:22:20.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6556000000000004e-05 2024-09-17T02:22:20.189 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.189 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:20.189 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.189 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:191048 5.3 e65/64 5:c4115f14:::benchmark_data_smithi001_23533_object62931:head v 65'12051, mlcod=0'0)", 2024-09-17T02:22:20.189 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.211763+0000", 2024-09-17T02:22:20.189 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.883869462, 2024-09-17T02:22:20.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029064577000000001, 2024-09-17T02:22:20.190 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:20.190 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:20.190 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.190 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:20.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:20.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211763+0000", 2024-09-17T02:22:20.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:20.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211763+0000", 2024-09-17T02:22:20.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:20.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211765+0000", 2024-09-17T02:22:20.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.717e-06 2024-09-17T02:22:20.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:20.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211776+0000", 2024-09-17T02:22:20.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1358999999999999e-05 2024-09-17T02:22:20.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:20.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211806+0000", 2024-09-17T02:22:20.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9924999999999999e-05 2024-09-17T02:22:20.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211824+0000", 2024-09-17T02:22:20.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7782999999999999e-05 2024-09-17T02:22:20.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:20.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.232521+0000", 2024-09-17T02:22:20.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020696902 2024-09-17T02:22:20.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:20.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.232574+0000", 2024-09-17T02:22:20.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3044000000000002e-05 2024-09-17T02:22:20.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:20.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240757+0000", 2024-09-17T02:22:20.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081828579999999995 2024-09-17T02:22:20.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:20.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240828+0000", 2024-09-17T02:22:20.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0988999999999994e-05 2024-09-17T02:22:20.193 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.193 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:20.194 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.194 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:191114 5.3 e65/64 5:c2a7e5a9:::benchmark_data_smithi001_23533_object62997:head v 65'12054, mlcod=63'12038)", 2024-09-17T02:22:20.194 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.217495+0000", 2024-09-17T02:22:20.194 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.878137831, 2024-09-17T02:22:20.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029944788, 2024-09-17T02:22:20.194 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:20.194 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:20.194 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.194 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:20.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:20.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217495+0000", 2024-09-17T02:22:20.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:20.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217495+0000", 2024-09-17T02:22:20.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:20.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:20.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217496+0000", 2024-09-17T02:22:20.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.46e-06 2024-09-17T02:22:20.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:20.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217508+0000", 2024-09-17T02:22:20.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2157000000000001e-05 2024-09-17T02:22:20.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:20.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217535+0000", 2024-09-17T02:22:20.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7058000000000001e-05 2024-09-17T02:22:20.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217551+0000", 2024-09-17T02:22:20.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5709000000000002e-05 2024-09-17T02:22:20.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:20.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.241029+0000", 2024-09-17T02:22:20.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023478452 2024-09-17T02:22:20.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:20.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.241078+0000", 2024-09-17T02:22:20.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8068000000000001e-05 2024-09-17T02:22:20.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:20.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.247369+0000", 2024-09-17T02:22:20.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0062912740000000003 2024-09-17T02:22:20.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:20.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:20.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:20.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.247439+0000", 2024-09-17T02:22:20.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0610000000000003e-05 2024-09-17T02:22:20.198 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.198 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:20.198 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.198 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:20.198 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:20.198 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:20.199 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T02:22:20.200 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:20.200+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:20.201 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:20.300 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~41s 2024-09-17T02:22:20.302 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:20.302+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:20.355 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:20.355 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:22:20.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.355 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:224538 5.1 5:869e0b05:::benchmark_data_smithi001_23533_object96421:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T02:22:20.355 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:20.354501+0000", 2024-09-17T02:22:20.355 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0037959869999999998, 2024-09-17T02:22:20.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038191840000000002, 2024-09-17T02:22:20.355 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:20.355 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:20.355 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:20.356 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:20.356 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:20.356 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.356 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 224538 2024-09-17T02:22:20.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.356 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:20.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:20.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.354501+0000", 2024-09-17T02:22:20.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:20.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.354501+0000", 2024-09-17T02:22:20.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:20.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.354501+0000", 2024-09-17T02:22:20.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4e-07 2024-09-17T02:22:20.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:20.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.354509+0000", 2024-09-17T02:22:20.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.486e-06 2024-09-17T02:22:20.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:20.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.354518+0000", 2024-09-17T02:22:20.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9020000000000005e-06 2024-09-17T02:22:20.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.354523+0000", 2024-09-17T02:22:20.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9439999999999996e-06 2024-09-17T02:22:20.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.354571+0000", 2024-09-17T02:22:20.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8578000000000001e-05 2024-09-17T02:22:20.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:20.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.354670+0000", 2024-09-17T02:22:20.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8400999999999995e-05 2024-09-17T02:22:20.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:20.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.354793+0000", 2024-09-17T02:22:20.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012366999999999999 2024-09-17T02:22:20.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:20.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.356791+0000", 2024-09-17T02:22:20.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001997253 2024-09-17T02:22:20.360 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.360 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.360 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.360 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:224539 5.9 5:9dce68ac:::benchmark_data_smithi001_23533_object96422:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T02:22:20.360 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:20.354536+0000", 2024-09-17T02:22:20.360 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0037605300000000002, 2024-09-17T02:22:20.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003846183, 2024-09-17T02:22:20.360 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:20.360 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:20.360 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:20.360 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:20.361 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:20.361 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.361 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 224539 2024-09-17T02:22:20.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.361 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:20.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:20.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.354536+0000", 2024-09-17T02:22:20.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:20.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.354536+0000", 2024-09-17T02:22:20.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:20.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.354537+0000", 2024-09-17T02:22:20.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8800000000000003e-07 2024-09-17T02:22:20.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:20.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.354539+0000", 2024-09-17T02:22:20.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9100000000000001e-06 2024-09-17T02:22:20.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:20.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.354547+0000", 2024-09-17T02:22:20.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4869999999999996e-06 2024-09-17T02:22:20.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.354553+0000", 2024-09-17T02:22:20.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8340000000000004e-06 2024-09-17T02:22:20.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.354591+0000", 2024-09-17T02:22:20.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8262000000000001e-05 2024-09-17T02:22:20.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:20.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.354740+0000", 2024-09-17T02:22:20.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000148923 2024-09-17T02:22:20.366 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.366 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.366 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.366 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:224536 5.0 e69/26 5:0d92c2e4:::benchmark_data_smithi001_23533_object96419:head v 69'14037, mlcod=69'14034)", 2024-09-17T02:22:20.366 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:20.354717+0000", 2024-09-17T02:22:20.366 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.003579582, 2024-09-17T02:22:20.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037132049999999998, 2024-09-17T02:22:20.367 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:20.367 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:20.367 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:20.367 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:20.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:20.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.354717+0000", 2024-09-17T02:22:20.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:20.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.354717+0000", 2024-09-17T02:22:20.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:20.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.354718+0000", 2024-09-17T02:22:20.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5400000000000001e-07 2024-09-17T02:22:20.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:20.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.354725+0000", 2024-09-17T02:22:20.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5750000000000003e-06 2024-09-17T02:22:20.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:20.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.354736+0000", 2024-09-17T02:22:20.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0958000000000001e-05 2024-09-17T02:22:20.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.354743+0000", 2024-09-17T02:22:20.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5640000000000002e-06 2024-09-17T02:22:20.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.354788+0000", 2024-09-17T02:22:20.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4922000000000001e-05 2024-09-17T02:22:20.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:20.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.354805+0000", 2024-09-17T02:22:20.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7779999999999999e-05 2024-09-17T02:22:20.370 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.370 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.370 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.370 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:224542 5.9 5:9c009061:::benchmark_data_smithi001_23533_object96425:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T02:22:20.370 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:20.355950+0000", 2024-09-17T02:22:20.370 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0023469989999999998, 2024-09-17T02:22:20.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002516019, 2024-09-17T02:22:20.370 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:20.370 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:20.371 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:20.371 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:20.371 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:20.371 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.371 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 224542 2024-09-17T02:22:20.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.371 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:20.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:20.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.355950+0000", 2024-09-17T02:22:20.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:20.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.355950+0000", 2024-09-17T02:22:20.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:20.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.355950+0000", 2024-09-17T02:22:20.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2999999999999999e-07 2024-09-17T02:22:20.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:20.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.355954+0000", 2024-09-17T02:22:20.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5489999999999998e-06 2024-09-17T02:22:20.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.355964+0000", 2024-09-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9869999999999994e-06 2024-09-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.355970+0000", 2024-09-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2310000000000001e-06 2024-09-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.356666+0000", 2024-09-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00069621199999999998 2024-09-17T02:22:20.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:20.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.356807+0000", 2024-09-17T02:22:20.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000140424 2024-09-17T02:22:20.374 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.374 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.374 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.374 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:224546 5.1 5:81bb79e6:::benchmark_data_smithi001_23533_object96429:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T02:22:20.374 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:20.356798+0000", 2024-09-17T02:22:20.374 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.001498929, 2024-09-17T02:22:20.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001705645, 2024-09-17T02:22:20.375 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:20.375 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:20.375 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:20.375 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:20.375 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:20.375 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.375 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 224546 2024-09-17T02:22:20.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.375 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:20.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:20.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.356798+0000", 2024-09-17T02:22:20.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:20.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.356798+0000", 2024-09-17T02:22:20.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:20.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.356799+0000", 2024-09-17T02:22:20.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1399999999999995e-07 2024-09-17T02:22:20.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:20.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.356803+0000", 2024-09-17T02:22:20.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3059999999999999e-06 2024-09-17T02:22:20.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:20.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.356815+0000", 2024-09-17T02:22:20.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1838000000000001e-05 2024-09-17T02:22:20.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.356822+0000", 2024-09-17T02:22:20.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5839999999999997e-06 2024-09-17T02:22:20.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.356856+0000", 2024-09-17T02:22:20.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3763000000000002e-05 2024-09-17T02:22:20.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:20.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.356976+0000", 2024-09-17T02:22:20.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000119659 2024-09-17T02:22:20.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:20.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.357085+0000", 2024-09-17T02:22:20.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108795 2024-09-17T02:22:20.378 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.378 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.379 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.379 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:224547 5.4 5:28fd772d:::benchmark_data_smithi001_23533_object96430:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T02:22:20.379 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:20.356837+0000", 2024-09-17T02:22:20.379 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0014594009999999999, 2024-09-17T02:22:20.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017050399999999999, 2024-09-17T02:22:20.379 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:20.379 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:20.379 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:20.379 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:20.379 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:20.379 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.380 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 224547 2024-09-17T02:22:20.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.380 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:20.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:20.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.356837+0000", 2024-09-17T02:22:20.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:20.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.356837+0000", 2024-09-17T02:22:20.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:20.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.356838+0000", 2024-09-17T02:22:20.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5499999999999998e-07 2024-09-17T02:22:20.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:20.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.356840+0000", 2024-09-17T02:22:20.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.497e-06 2024-09-17T02:22:20.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:20.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.356847+0000", 2024-09-17T02:22:20.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1659999999999997e-06 2024-09-17T02:22:20.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.356854+0000", 2024-09-17T02:22:20.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2670000000000003e-06 2024-09-17T02:22:20.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.356945+0000", 2024-09-17T02:22:20.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1211000000000005e-05 2024-09-17T02:22:20.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:20.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.357055+0000", 2024-09-17T02:22:20.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110234 2024-09-17T02:22:20.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:20.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.357161+0000", 2024-09-17T02:22:20.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106427 2024-09-17T02:22:20.383 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.383 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.383 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.383 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:224540 5.8 e69/26 5:1bc27976:::benchmark_data_smithi001_23533_object96423:head v 69'14251, mlcod=69'14248)", 2024-09-17T02:22:20.383 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:20.356922+0000", 2024-09-17T02:22:20.383 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.001375097, 2024-09-17T02:22:20.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016587489999999999, 2024-09-17T02:22:20.384 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:20.384 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:20.384 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:20.384 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:20.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:20.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.356922+0000", 2024-09-17T02:22:20.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:20.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.356922+0000", 2024-09-17T02:22:20.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:20.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.356922+0000", 2024-09-17T02:22:20.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1600000000000001e-07 2024-09-17T02:22:20.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:20.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.356927+0000", 2024-09-17T02:22:20.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5770000000000004e-06 2024-09-17T02:22:20.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:20.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.356938+0000", 2024-09-17T02:22:20.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1246e-05 2024-09-17T02:22:20.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.356944+0000", 2024-09-17T02:22:20.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4779999999999996e-06 2024-09-17T02:22:20.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.356989+0000", 2024-09-17T02:22:20.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4613999999999997e-05 2024-09-17T02:22:20.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:20.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:20.357007+0000", 2024-09-17T02:22:20.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7575e-05 2024-09-17T02:22:20.387 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.387 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.387 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.387 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.387 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:22:20.387 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 7 2024-09-17T02:22:20.387 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:20.388 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:20.402 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:20.404+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:20.503 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:20.502+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:20.590 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:20.590 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:22:20.590 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:22:20.590 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:22:20.591 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:20.604 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:20.602+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:20.609 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:20.705 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:20.702+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:20.806 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:20.808+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:20.808 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:20.808 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:22:20.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:22:20.808 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:22:20.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.808 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97749 5.b 5:d930ef52:::benchmark_data_smithi001_23533_object97748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:20.809 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:20.809 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.216989933000001, 2024-09-17T02:22:20.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092964343000000005, 2024-09-17T02:22:20.809 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:20.809 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:20.809 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.809 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:20.809 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:20.809 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.809 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97749 2024-09-17T02:22:20.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.809 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:20.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:20.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:20.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:20.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:20.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:20.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591947+0000", 2024-09-17T02:22:20.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:22:20.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:20.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592011+0000", 2024-09-17T02:22:20.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3608000000000005e-05 2024-09-17T02:22:20.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:20.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592021+0000", 2024-09-17T02:22:20.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9979999999999998e-06 2024-09-17T02:22:20.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592028+0000", 2024-09-17T02:22:20.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1439999999999997e-06 2024-09-17T02:22:20.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593633+0000", 2024-09-17T02:22:20.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001604636 2024-09-17T02:22:20.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:20.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593757+0000", 2024-09-17T02:22:20.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012432099999999999 2024-09-17T02:22:20.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:20.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593866+0000", 2024-09-17T02:22:20.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109094 2024-09-17T02:22:20.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:20.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601190+0000", 2024-09-17T02:22:20.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073237620000000002 2024-09-17T02:22:20.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601356+0000", 2024-09-17T02:22:20.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016651900000000001 2024-09-17T02:22:20.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684618+0000", 2024-09-17T02:22:20.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083261356999999994 2024-09-17T02:22:20.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:20.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684724+0000", 2024-09-17T02:22:20.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010681800000000001 2024-09-17T02:22:20.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:20.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684911+0000", 2024-09-17T02:22:20.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186243 2024-09-17T02:22:20.816 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.816 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.816 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.816 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97752 5.b 5:d146f486:::benchmark_data_smithi001_23533_object97751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:20.817 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:20.817 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.215637239000003, 2024-09-17T02:22:20.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091989557, 2024-09-17T02:22:20.817 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:20.817 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:20.817 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.817 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:20.817 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:20.817 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.817 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97752 2024-09-17T02:22:20.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.818 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:20.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:20.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:20.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:20.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:20.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:20.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593300+0000", 2024-09-17T02:22:20.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8199999999999998e-07 2024-09-17T02:22:20.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:20.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593364+0000", 2024-09-17T02:22:20.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3831999999999995e-05 2024-09-17T02:22:20.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:20.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593376+0000", 2024-09-17T02:22:20.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1800999999999999e-05 2024-09-17T02:22:20.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593382+0000", 2024-09-17T02:22:20.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6780000000000003e-06 2024-09-17T02:22:20.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595491+0000", 2024-09-17T02:22:20.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021090689999999999 2024-09-17T02:22:20.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:20.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595614+0000", 2024-09-17T02:22:20.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012321500000000001 2024-09-17T02:22:20.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:20.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595778+0000", 2024-09-17T02:22:20.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016321900000000001 2024-09-17T02:22:20.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:20.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601197+0000", 2024-09-17T02:22:20.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054195600000000003 2024-09-17T02:22:20.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601396+0000", 2024-09-17T02:22:20.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019825299999999999 2024-09-17T02:22:20.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684990+0000", 2024-09-17T02:22:20.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083594878999999997 2024-09-17T02:22:20.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:20.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685116+0000", 2024-09-17T02:22:20.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012522799999999999 2024-09-17T02:22:20.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:20.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685289+0000", 2024-09-17T02:22:20.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172941 2024-09-17T02:22:20.823 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.823 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.824 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.824 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97754 5.b 5:da0615e5:::benchmark_data_smithi001_23533_object97753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:20.824 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:20.824 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.213999317000003, 2024-09-17T02:22:20.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092097207, 2024-09-17T02:22:20.824 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:20.824 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:20.824 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.824 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:20.824 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:20.825 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.825 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97754 2024-09-17T02:22:20.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.825 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:20.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:20.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:20.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:20.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:20.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:20.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594938+0000", 2024-09-17T02:22:20.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5000000000000002e-07 2024-09-17T02:22:20.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:20.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595075+0000", 2024-09-17T02:22:20.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137742 2024-09-17T02:22:20.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:20.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595087+0000", 2024-09-17T02:22:20.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1243000000000001e-05 2024-09-17T02:22:20.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595095+0000", 2024-09-17T02:22:20.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1030000000000002e-06 2024-09-17T02:22:20.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598461+0000", 2024-09-17T02:22:20.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033661170000000001 2024-09-17T02:22:20.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:20.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598540+0000", 2024-09-17T02:22:20.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8937999999999995e-05 2024-09-17T02:22:20.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:20.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598626+0000", 2024-09-17T02:22:20.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6042000000000001e-05 2024-09-17T02:22:20.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:20.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684258+0000", 2024-09-17T02:22:20.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085632394000000001 2024-09-17T02:22:20.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685369+0000", 2024-09-17T02:22:20.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001111063 2024-09-17T02:22:20.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685511+0000", 2024-09-17T02:22:20.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141965 2024-09-17T02:22:20.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:20.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685604+0000", 2024-09-17T02:22:20.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2935000000000004e-05 2024-09-17T02:22:20.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:20.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687034+0000", 2024-09-17T02:22:20.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001430015 2024-09-17T02:22:20.831 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.831 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.831 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.831 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97755 5.b 5:d36a03a1:::benchmark_data_smithi001_23533_object97754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:20.831 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:20.831 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.213826167000001, 2024-09-17T02:22:20.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0924904, 2024-09-17T02:22:20.831 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:20.831 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:20.832 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.832 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:20.832 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:20.832 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.832 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97755 2024-09-17T02:22:20.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.832 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:20.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:20.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:20.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:20.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:20.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:20.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595111+0000", 2024-09-17T02:22:20.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:22:20.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:20.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595145+0000", 2024-09-17T02:22:20.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3927000000000002e-05 2024-09-17T02:22:20.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:20.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595155+0000", 2024-09-17T02:22:20.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0023e-05 2024-09-17T02:22:20.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595162+0000", 2024-09-17T02:22:20.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3950000000000003e-06 2024-09-17T02:22:20.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599821+0000", 2024-09-17T02:22:20.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046592880000000001 2024-09-17T02:22:20.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:20.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599912+0000", 2024-09-17T02:22:20.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1049000000000002e-05 2024-09-17T02:22:20.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:20.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600062+0000", 2024-09-17T02:22:20.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015001700000000001 2024-09-17T02:22:20.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:20.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685307+0000", 2024-09-17T02:22:20.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085244340000000002 2024-09-17T02:22:20.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685446+0000", 2024-09-17T02:22:20.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013955700000000001 2024-09-17T02:22:20.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687375+0000", 2024-09-17T02:22:20.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019291079999999999 2024-09-17T02:22:20.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:20.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687462+0000", 2024-09-17T02:22:20.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6148000000000003e-05 2024-09-17T02:22:20.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:20.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687600+0000", 2024-09-17T02:22:20.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013887900000000001 2024-09-17T02:22:20.838 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.838 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.838 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.839 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 44/44 lb 5:c4567a04:::benchmark_data_smithi001_23533_object4200:head)", 2024-09-17T02:22:20.839 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:20.839 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.211729540999997, 2024-09-17T02:22:20.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092483421999999996, 2024-09-17T02:22:20.839 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:20.839 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:20.839 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:20.839 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:20.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:20.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:20.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:20.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:20.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:20.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:20.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6399999999999998e-07 2024-09-17T02:22:20.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:20.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597213+0000", 2024-09-17T02:22:20.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3659999999999997e-06 2024-09-17T02:22:20.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:20.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597222+0000", 2024-09-17T02:22:20.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0510000000000002e-06 2024-09-17T02:22:20.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597228+0000", 2024-09-17T02:22:20.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1569999999999999e-06 2024-09-17T02:22:20.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689588+0000", 2024-09-17T02:22:20.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092359931000000006 2024-09-17T02:22:20.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:20.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689622+0000", 2024-09-17T02:22:20.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4425999999999999e-05 2024-09-17T02:22:20.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:20.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689690+0000", 2024-09-17T02:22:20.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8126999999999993e-05 2024-09-17T02:22:20.843 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.843 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.843 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.843 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129462 5.4 5:2e0acc16:::benchmark_data_smithi001_23533_object1345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:20.843 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:20.844 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.273995472000003, 2024-09-17T02:22:20.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0112774899999999, 2024-09-17T02:22:20.844 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:20.844 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:20.844 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.844 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:20.844 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:20.844 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.844 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129462 2024-09-17T02:22:20.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.844 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:20.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:20.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:20.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:20.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:20.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:20.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534943+0000", 2024-09-17T02:22:20.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8759999999999999e-06 2024-09-17T02:22:20.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:20.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534951+0000", 2024-09-17T02:22:20.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3219999999999993e-06 2024-09-17T02:22:20.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:20.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534977+0000", 2024-09-17T02:22:20.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6245e-05 2024-09-17T02:22:20.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534992+0000", 2024-09-17T02:22:20.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4936000000000001e-05 2024-09-17T02:22:20.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535133+0000", 2024-09-17T02:22:20.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014051299999999999 2024-09-17T02:22:20.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:20.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:22:20.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1741000000000001e-05 2024-09-17T02:22:20.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.533906+0000", 2024-09-17T02:22:20.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99875209300000001 2024-09-17T02:22:20.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:20.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534348+0000", 2024-09-17T02:22:20.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044128899999999998 2024-09-17T02:22:20.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:20.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534762+0000", 2024-09-17T02:22:20.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000414707 2024-09-17T02:22:20.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:20.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545024+0000", 2024-09-17T02:22:20.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010261283 2024-09-17T02:22:20.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545953+0000", 2024-09-17T02:22:20.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000929618 2024-09-17T02:22:20.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:20.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546047+0000", 2024-09-17T02:22:20.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3697999999999996e-05 2024-09-17T02:22:20.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:20.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546218+0000", 2024-09-17T02:22:20.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017116899999999999 2024-09-17T02:22:20.851 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.851 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.851 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.851 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129480 5.4 5:2b1d398b:::benchmark_data_smithi001_23533_object1363:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:20.851 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:20.852 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.266241006000001, 2024-09-17T02:22:20.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0038926450000001, 2024-09-17T02:22:20.852 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:20.852 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:20.852 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.852 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:20.852 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:20.852 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.852 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129480 2024-09-17T02:22:20.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.852 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:20.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:20.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:20.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:20.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:20.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:20.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542696+0000", 2024-09-17T02:22:20.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9999999999999995e-07 2024-09-17T02:22:20.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:20.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542701+0000", 2024-09-17T02:22:20.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2240000000000003e-06 2024-09-17T02:22:20.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:20.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542716+0000", 2024-09-17T02:22:20.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4970000000000001e-05 2024-09-17T02:22:20.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542726+0000", 2024-09-17T02:22:20.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2879999999999998e-06 2024-09-17T02:22:20.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542832+0000", 2024-09-17T02:22:20.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010597199999999999 2024-09-17T02:22:20.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:20.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542843+0000", 2024-09-17T02:22:20.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.098e-05 2024-09-17T02:22:20.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538436+0000", 2024-09-17T02:22:20.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99559286800000002 2024-09-17T02:22:20.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:20.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538791+0000", 2024-09-17T02:22:20.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035585499999999997 2024-09-17T02:22:20.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:20.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.539144+0000", 2024-09-17T02:22:20.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035268499999999999 2024-09-17T02:22:20.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:20.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545880+0000", 2024-09-17T02:22:20.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00673552 2024-09-17T02:22:20.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546330+0000", 2024-09-17T02:22:20.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045039599999999999 2024-09-17T02:22:20.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:20.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546414+0000", 2024-09-17T02:22:20.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4468000000000005e-05 2024-09-17T02:22:20.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:20.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546588+0000", 2024-09-17T02:22:20.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017341899999999999 2024-09-17T02:22:20.858 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.858 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.858 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.858 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129505 5.4 5:294f2ec7:::benchmark_data_smithi001_23533_object1388:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:20.858 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:20.859 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.247227832999997, 2024-09-17T02:22:20.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98589826199999997, 2024-09-17T02:22:20.859 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:20.859 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:20.859 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.859 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:20.859 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:20.859 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.859 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129505 2024-09-17T02:22:20.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.859 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:20.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:20.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:20.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:20.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:20.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:20.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561710+0000", 2024-09-17T02:22:20.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7060000000000001e-06 2024-09-17T02:22:20.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:20.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561718+0000", 2024-09-17T02:22:20.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.542e-06 2024-09-17T02:22:20.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:20.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561741+0000", 2024-09-17T02:22:20.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3357e-05 2024-09-17T02:22:20.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561754+0000", 2024-09-17T02:22:20.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3200000000000001e-05 2024-09-17T02:22:20.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561867+0000", 2024-09-17T02:22:20.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113211 2024-09-17T02:22:20.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:20.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561888+0000", 2024-09-17T02:22:20.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0809999999999999e-05 2024-09-17T02:22:20.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542140+0000", 2024-09-17T02:22:20.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98025195799999998 2024-09-17T02:22:20.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:20.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542331+0000", 2024-09-17T02:22:20.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019127599999999999 2024-09-17T02:22:20.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:20.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542517+0000", 2024-09-17T02:22:20.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000185625 2024-09-17T02:22:20.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547114+0000", 2024-09-17T02:22:20.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045968620000000002 2024-09-17T02:22:20.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:20.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547187+0000", 2024-09-17T02:22:20.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3348000000000003e-05 2024-09-17T02:22:20.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:20.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547324+0000", 2024-09-17T02:22:20.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013681699999999999 2024-09-17T02:22:20.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:20.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547607+0000", 2024-09-17T02:22:20.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028255000000000001 2024-09-17T02:22:20.865 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.865 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.865 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.865 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129508 5.4 5:2892b582:::benchmark_data_smithi001_23533_object1391:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:20.866 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:20.866 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.24589074, 2024-09-17T02:22:20.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99697919099999999, 2024-09-17T02:22:20.866 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:20.866 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:20.866 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.866 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:20.866 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:20.866 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.866 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129508 2024-09-17T02:22:20.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.866 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:20.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:20.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:20.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:20.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:20.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:20.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563047+0000", 2024-09-17T02:22:20.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.274e-06 2024-09-17T02:22:20.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:20.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563054+0000", 2024-09-17T02:22:20.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2799999999999998e-06 2024-09-17T02:22:20.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:20.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563070+0000", 2024-09-17T02:22:20.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5991999999999999e-05 2024-09-17T02:22:20.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563078+0000", 2024-09-17T02:22:20.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2390000000000002e-06 2024-09-17T02:22:20.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563181+0000", 2024-09-17T02:22:20.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102249 2024-09-17T02:22:20.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:20.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563199+0000", 2024-09-17T02:22:20.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8215000000000001e-05 2024-09-17T02:22:20.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547713+0000", 2024-09-17T02:22:20.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98451446399999998 2024-09-17T02:22:20.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:20.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548063+0000", 2024-09-17T02:22:20.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034985499999999999 2024-09-17T02:22:20.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:20.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548490+0000", 2024-09-17T02:22:20.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042658600000000001 2024-09-17T02:22:20.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555655+0000", 2024-09-17T02:22:20.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071652579999999999 2024-09-17T02:22:20.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:20.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559612+0000", 2024-09-17T02:22:20.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003957103 2024-09-17T02:22:20.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:20.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559768+0000", 2024-09-17T02:22:20.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015556899999999999 2024-09-17T02:22:20.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:20.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560025+0000", 2024-09-17T02:22:20.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025710700000000002 2024-09-17T02:22:20.872 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.872 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.872 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.872 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129509 5.4 5:2c35515e:::benchmark_data_smithi001_23533_object1392:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:20.872 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:20.872 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.245263686999998, 2024-09-17T02:22:20.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99969384900000002, 2024-09-17T02:22:20.873 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:20.873 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:20.873 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.873 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:20.873 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:20.873 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.873 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129509 2024-09-17T02:22:20.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.873 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:20.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:20.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:20.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:20.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:20.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:20.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563674+0000", 2024-09-17T02:22:20.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0920000000000001e-06 2024-09-17T02:22:20.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:20.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563679+0000", 2024-09-17T02:22:20.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7660000000000004e-06 2024-09-17T02:22:20.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:20.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563693+0000", 2024-09-17T02:22:20.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3139000000000001e-05 2024-09-17T02:22:20.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563701+0000", 2024-09-17T02:22:20.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9859999999999994e-06 2024-09-17T02:22:20.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563775+0000", 2024-09-17T02:22:20.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4659000000000005e-05 2024-09-17T02:22:20.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:20.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563785+0000", 2024-09-17T02:22:20.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4839999999999993e-06 2024-09-17T02:22:20.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552085+0000", 2024-09-17T02:22:20.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98829986999999997 2024-09-17T02:22:20.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:20.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552554+0000", 2024-09-17T02:22:20.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046908900000000001 2024-09-17T02:22:20.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:20.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552931+0000", 2024-09-17T02:22:20.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377778 2024-09-17T02:22:20.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563106+0000", 2024-09-17T02:22:20.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010174186 2024-09-17T02:22:20.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:20.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563138+0000", 2024-09-17T02:22:20.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2495e-05 2024-09-17T02:22:20.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:20.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563225+0000", 2024-09-17T02:22:20.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6677999999999999e-05 2024-09-17T02:22:20.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:20.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563366+0000", 2024-09-17T02:22:20.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014162699999999999 2024-09-17T02:22:20.879 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.879 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.879 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.879 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129524 5.4 5:25dca7dd:::benchmark_data_smithi001_23533_object1407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:20.879 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:20.879 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.238572333, 2024-09-17T02:22:20.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99999501999999996, 2024-09-17T02:22:20.879 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:20.879 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:20.879 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.879 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:20.880 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:20.880 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.880 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129524 2024-09-17T02:22:20.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.880 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:20.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:20.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:20.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:20.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:20.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:20.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570365+0000", 2024-09-17T02:22:20.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.142e-06 2024-09-17T02:22:20.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:20.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570369+0000", 2024-09-17T02:22:20.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.856e-06 2024-09-17T02:22:20.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:20.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570385+0000", 2024-09-17T02:22:20.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5855e-05 2024-09-17T02:22:20.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570392+0000", 2024-09-17T02:22:20.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5340000000000002e-06 2024-09-17T02:22:20.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570484+0000", 2024-09-17T02:22:20.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1212999999999996e-05 2024-09-17T02:22:20.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:20.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570498+0000", 2024-09-17T02:22:20.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4331000000000001e-05 2024-09-17T02:22:20.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555835+0000", 2024-09-17T02:22:20.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98533757700000002 2024-09-17T02:22:20.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:20.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556329+0000", 2024-09-17T02:22:20.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000493458 2024-09-17T02:22:20.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:20.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556784+0000", 2024-09-17T02:22:20.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045476499999999999 2024-09-17T02:22:20.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569852+0000", 2024-09-17T02:22:20.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013068270999999999 2024-09-17T02:22:20.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:20.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569958+0000", 2024-09-17T02:22:20.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106214 2024-09-17T02:22:20.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:20.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570124+0000", 2024-09-17T02:22:20.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165546 2024-09-17T02:22:20.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:20.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570359+0000", 2024-09-17T02:22:20.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023525799999999999 2024-09-17T02:22:20.885 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.885 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.885 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.886 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129537 5.4 5:260327c6:::benchmark_data_smithi001_23533_object1420:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:20.886 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:20.886 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.230665803999997, 2024-09-17T02:22:20.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99624596499999996, 2024-09-17T02:22:20.886 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:20.886 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:20.886 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.886 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:20.886 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:20.886 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.886 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129537 2024-09-17T02:22:20.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.887 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:20.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:20.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:20.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:20.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:20.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:20.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578272+0000", 2024-09-17T02:22:20.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.164e-06 2024-09-17T02:22:20.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:20.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578278+0000", 2024-09-17T02:22:20.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5060000000000001e-06 2024-09-17T02:22:20.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:20.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578294+0000", 2024-09-17T02:22:20.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5687000000000001e-05 2024-09-17T02:22:20.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578329+0000", 2024-09-17T02:22:20.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5311999999999997e-05 2024-09-17T02:22:20.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578419+0000", 2024-09-17T02:22:20.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0054000000000002e-05 2024-09-17T02:22:20.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:20.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578435+0000", 2024-09-17T02:22:20.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5645999999999999e-05 2024-09-17T02:22:20.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560148+0000", 2024-09-17T02:22:20.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98171342299999997 2024-09-17T02:22:20.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:20.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560383+0000", 2024-09-17T02:22:20.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000234935 2024-09-17T02:22:20.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:20.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560586+0000", 2024-09-17T02:22:20.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000202909 2024-09-17T02:22:20.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570472+0000", 2024-09-17T02:22:20.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098856959999999994 2024-09-17T02:22:20.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:20.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574138+0000", 2024-09-17T02:22:20.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036660170000000001 2024-09-17T02:22:20.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:20.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574298+0000", 2024-09-17T02:22:20.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016025600000000001 2024-09-17T02:22:20.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:20.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574516+0000", 2024-09-17T02:22:20.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021835999999999999 2024-09-17T02:22:20.892 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.892 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.892 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.893 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129545 5.4 5:22366489:::benchmark_data_smithi001_23533_object1428:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:20.893 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:20.893 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.224803080999997, 2024-09-17T02:22:20.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99074544499999995, 2024-09-17T02:22:20.893 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:20.893 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:20.893 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.893 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:20.893 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:20.893 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.893 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129545 2024-09-17T02:22:20.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.893 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:20.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:20.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:20.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:20.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:20.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:20.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584135+0000", 2024-09-17T02:22:20.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4699999999999999e-06 2024-09-17T02:22:20.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:20.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584142+0000", 2024-09-17T02:22:20.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1620000000000002e-06 2024-09-17T02:22:20.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:20.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584170+0000", 2024-09-17T02:22:20.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7897000000000001e-05 2024-09-17T02:22:20.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584183+0000", 2024-09-17T02:22:20.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2814e-05 2024-09-17T02:22:20.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584299+0000", 2024-09-17T02:22:20.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116153 2024-09-17T02:22:20.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:20.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584316+0000", 2024-09-17T02:22:20.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7524999999999999e-05 2024-09-17T02:22:20.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563461+0000", 2024-09-17T02:22:20.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97914436699999996 2024-09-17T02:22:20.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:20.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563667+0000", 2024-09-17T02:22:20.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020689800000000001 2024-09-17T02:22:20.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:20.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563878+0000", 2024-09-17T02:22:20.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210275 2024-09-17T02:22:20.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570584+0000", 2024-09-17T02:22:20.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067066080000000002 2024-09-17T02:22:20.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:20.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574539+0000", 2024-09-17T02:22:20.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039550360000000003 2024-09-17T02:22:20.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:20.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574653+0000", 2024-09-17T02:22:20.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114003 2024-09-17T02:22:20.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:20.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574879+0000", 2024-09-17T02:22:20.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022523700000000001 2024-09-17T02:22:20.899 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.899 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.899 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.899 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129553 5.4 5:2e41ad40:::benchmark_data_smithi001_23533_object1436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:20.899 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:20.899 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.219380444999999, 2024-09-17T02:22:20.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99213429600000003, 2024-09-17T02:22:20.900 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:20.900 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:20.900 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.900 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:20.900 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:20.900 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.900 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129553 2024-09-17T02:22:20.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.900 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:20.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:20.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:20.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:20.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:20.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:20.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589557+0000", 2024-09-17T02:22:20.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2219999999999999e-06 2024-09-17T02:22:20.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:20.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589562+0000", 2024-09-17T02:22:20.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0649999999999998e-06 2024-09-17T02:22:20.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:20.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589575+0000", 2024-09-17T02:22:20.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3129000000000001e-05 2024-09-17T02:22:20.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589584+0000", 2024-09-17T02:22:20.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6200000000000005e-06 2024-09-17T02:22:20.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589693+0000", 2024-09-17T02:22:20.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109319 2024-09-17T02:22:20.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:20.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589714+0000", 2024-09-17T02:22:20.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0849999999999999e-05 2024-09-17T02:22:20.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566273+0000", 2024-09-17T02:22:20.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97655884999999998 2024-09-17T02:22:20.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:20.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566543+0000", 2024-09-17T02:22:20.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027059099999999998 2024-09-17T02:22:20.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:20.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566832+0000", 2024-09-17T02:22:20.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028898200000000002 2024-09-17T02:22:20.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:20.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581040+0000", 2024-09-17T02:22:20.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014208001 2024-09-17T02:22:20.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581200+0000", 2024-09-17T02:22:20.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159956 2024-09-17T02:22:20.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:20.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581427+0000", 2024-09-17T02:22:20.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000226309 2024-09-17T02:22:20.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:20.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581690+0000", 2024-09-17T02:22:20.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026340199999999998 2024-09-17T02:22:20.906 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.906 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.906 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.906 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129580 5.4 5:25ed887b:::benchmark_data_smithi001_23533_object1463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:20.906 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:20.906 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.197608400999997, 2024-09-17T02:22:20.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98001430499999997, 2024-09-17T02:22:20.906 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:20.906 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:20.906 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.907 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:20.907 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:20.907 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.907 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129580 2024-09-17T02:22:20.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.907 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:20.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:20.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:20.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:20.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:20.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:20.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611329+0000", 2024-09-17T02:22:20.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.22e-06 2024-09-17T02:22:20.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:20.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611335+0000", 2024-09-17T02:22:20.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1129999999999997e-06 2024-09-17T02:22:20.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:20.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611348+0000", 2024-09-17T02:22:20.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2342e-05 2024-09-17T02:22:20.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611356+0000", 2024-09-17T02:22:20.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.371e-06 2024-09-17T02:22:20.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611419+0000", 2024-09-17T02:22:20.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3393999999999996e-05 2024-09-17T02:22:20.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:20.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611427+0000", 2024-09-17T02:22:20.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999997e-06 2024-09-17T02:22:20.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570705+0000", 2024-09-17T02:22:20.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.95927859199999999 2024-09-17T02:22:20.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:20.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571009+0000", 2024-09-17T02:22:20.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030414599999999998 2024-09-17T02:22:20.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:20.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571241+0000", 2024-09-17T02:22:20.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023106799999999999 2024-09-17T02:22:20.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:20.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590789+0000", 2024-09-17T02:22:20.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019548763 2024-09-17T02:22:20.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590928+0000", 2024-09-17T02:22:20.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000139092 2024-09-17T02:22:20.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:20.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591086+0000", 2024-09-17T02:22:20.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015787400000000001 2024-09-17T02:22:20.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:20.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591342+0000", 2024-09-17T02:22:20.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025589900000000002 2024-09-17T02:22:20.912 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.912 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.912 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.913 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129603 5.4 5:25aaa5e8:::benchmark_data_smithi001_23533_object1486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:20.913 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:20.913 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.181548605000003, 2024-09-17T02:22:20.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96463198999999999, 2024-09-17T02:22:20.913 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:20.913 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:20.913 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.913 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:20.913 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:20.913 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.913 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129603 2024-09-17T02:22:20.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.913 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:20.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:20.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:20.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:20.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:20.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:20.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:20.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:22:20.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:20.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627392+0000", 2024-09-17T02:22:20.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0790000000000002e-06 2024-09-17T02:22:20.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:20.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627403+0000", 2024-09-17T02:22:20.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0866000000000001e-05 2024-09-17T02:22:20.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627409+0000", 2024-09-17T02:22:20.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.305e-06 2024-09-17T02:22:20.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627485+0000", 2024-09-17T02:22:20.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6582000000000006e-05 2024-09-17T02:22:20.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:20.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627499+0000", 2024-09-17T02:22:20.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:22:20.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574991+0000", 2024-09-17T02:22:20.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94749182300000001 2024-09-17T02:22:20.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:20.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575377+0000", 2024-09-17T02:22:20.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038629400000000003 2024-09-17T02:22:20.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:20.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575665+0000", 2024-09-17T02:22:20.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028759499999999997 2024-09-17T02:22:20.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:20.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590802+0000", 2024-09-17T02:22:20.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015136479 2024-09-17T02:22:20.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591614+0000", 2024-09-17T02:22:20.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081293100000000003 2024-09-17T02:22:20.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:20.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591764+0000", 2024-09-17T02:22:20.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014932199999999999 2024-09-17T02:22:20.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:20.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592020+0000", 2024-09-17T02:22:20.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025585099999999997 2024-09-17T02:22:20.919 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.919 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.919 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.919 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129607 5.4 5:2f638f1e:::benchmark_data_smithi001_23533_object1490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:20.919 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:20.919 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.180021699000001, 2024-09-17T02:22:20.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96352375899999998, 2024-09-17T02:22:20.920 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:20.920 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:20.920 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.920 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:20.920 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:20.920 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.920 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129607 2024-09-17T02:22:20.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.921 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:20.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:20.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:20.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:20.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:20.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:20.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628916+0000", 2024-09-17T02:22:20.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1710000000000001e-06 2024-09-17T02:22:20.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:20.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628920+0000", 2024-09-17T02:22:20.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-17T02:22:20.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:20.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628935+0000", 2024-09-17T02:22:20.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4474000000000001e-05 2024-09-17T02:22:20.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628944+0000", 2024-09-17T02:22:20.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9940000000000006e-06 2024-09-17T02:22:20.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628997+0000", 2024-09-17T02:22:20.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3579000000000003e-05 2024-09-17T02:22:20.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:20.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.629006+0000", 2024-09-17T02:22:20.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4009999999999997e-06 2024-09-17T02:22:20.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.577862+0000", 2024-09-17T02:22:20.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.948856335 2024-09-17T02:22:20.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:20.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578167+0000", 2024-09-17T02:22:20.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030532399999999999 2024-09-17T02:22:20.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:20.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578532+0000", 2024-09-17T02:22:20.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036428200000000001 2024-09-17T02:22:20.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:20.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591442+0000", 2024-09-17T02:22:20.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012910374000000001 2024-09-17T02:22:20.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592164+0000", 2024-09-17T02:22:20.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072242499999999996 2024-09-17T02:22:20.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:20.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592267+0000", 2024-09-17T02:22:20.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102205 2024-09-17T02:22:20.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:20.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592438+0000", 2024-09-17T02:22:20.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017165299999999999 2024-09-17T02:22:20.926 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.926 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.926 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.927 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129623 5.4 5:2cf5174b:::benchmark_data_smithi001_23533_object1506:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:20.927 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:20.927 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.156077412999998, 2024-09-17T02:22:20.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94334114499999999, 2024-09-17T02:22:20.927 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:20.927 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:20.927 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.927 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:20.927 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:20.927 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.927 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129623 2024-09-17T02:22:20.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.928 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:20.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:20.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:20.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:20.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:20.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:20.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652860+0000", 2024-09-17T02:22:20.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0330000000000001e-06 2024-09-17T02:22:20.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:20.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652864+0000", 2024-09-17T02:22:20.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.634e-06 2024-09-17T02:22:20.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:20.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652877+0000", 2024-09-17T02:22:20.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2591e-05 2024-09-17T02:22:20.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652883+0000", 2024-09-17T02:22:20.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1460000000000001e-06 2024-09-17T02:22:20.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652943+0000", 2024-09-17T02:22:20.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9833999999999997e-05 2024-09-17T02:22:20.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:20.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652950+0000", 2024-09-17T02:22:20.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.401e-06 2024-09-17T02:22:20.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581800+0000", 2024-09-17T02:22:20.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.92884935700000004 2024-09-17T02:22:20.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:20.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582122+0000", 2024-09-17T02:22:20.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032185200000000002 2024-09-17T02:22:20.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:20.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582689+0000", 2024-09-17T02:22:20.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056750400000000003 2024-09-17T02:22:20.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:20.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591458+0000", 2024-09-17T02:22:20.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008768685 2024-09-17T02:22:20.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595856+0000", 2024-09-17T02:22:20.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043977909999999999 2024-09-17T02:22:20.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:20.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595955+0000", 2024-09-17T02:22:20.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9166000000000006e-05 2024-09-17T02:22:20.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:20.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596200+0000", 2024-09-17T02:22:20.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024515099999999998 2024-09-17T02:22:20.933 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.933 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.933 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.934 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129642 5.4 5:255eb796:::benchmark_data_smithi001_23533_object1525:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:20.934 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:20.934 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.124841248999999, 2024-09-17T02:22:20.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.91257397299999998, 2024-09-17T02:22:20.934 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:20.934 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:20.934 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.934 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:20.934 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:20.934 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.934 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129642 2024-09-17T02:22:20.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.934 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:20.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:20.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:20.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:20.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:20.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:20.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684096+0000", 2024-09-17T02:22:20.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659999999999999e-06 2024-09-17T02:22:20.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:20.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684101+0000", 2024-09-17T02:22:20.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8110000000000002e-06 2024-09-17T02:22:20.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:20.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684114+0000", 2024-09-17T02:22:20.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2653000000000001e-05 2024-09-17T02:22:20.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684121+0000", 2024-09-17T02:22:20.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5100000000000001e-06 2024-09-17T02:22:20.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684181+0000", 2024-09-17T02:22:20.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0307999999999999e-05 2024-09-17T02:22:20.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:20.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684194+0000", 2024-09-17T02:22:20.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2916e-05 2024-09-17T02:22:20.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.587917+0000", 2024-09-17T02:22:20.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.90372220400000003 2024-09-17T02:22:20.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:20.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588215+0000", 2024-09-17T02:22:20.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029845400000000003 2024-09-17T02:22:20.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:20.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588470+0000", 2024-09-17T02:22:20.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025455399999999999 2024-09-17T02:22:20.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596318+0000", 2024-09-17T02:22:20.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078485589999999997 2024-09-17T02:22:20.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:20.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596354+0000", 2024-09-17T02:22:20.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5976999999999998e-05 2024-09-17T02:22:20.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:20.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596449+0000", 2024-09-17T02:22:20.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4728999999999994e-05 2024-09-17T02:22:20.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:20.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596669+0000", 2024-09-17T02:22:20.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220132 2024-09-17T02:22:20.940 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.940 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.940 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.940 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129649 5.4 5:2fe27050:::benchmark_data_smithi001_23533_object1532:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:20.940 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:20.940 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.093284506000003, 2024-09-17T02:22:20.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.88508119100000004, 2024-09-17T02:22:20.940 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:20.941 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:20.941 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:20.941 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:20.941 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:20.941 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:20.941 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129649 2024-09-17T02:22:20.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.941 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:20.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:20.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:20.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:20.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:20.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:20.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:20.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715653+0000", 2024-09-17T02:22:20.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3519999999999999e-06 2024-09-17T02:22:20.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:20.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715658+0000", 2024-09-17T02:22:20.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3120000000000001e-06 2024-09-17T02:22:20.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:20.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715677+0000", 2024-09-17T02:22:20.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-17T02:22:20.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:20.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715687+0000", 2024-09-17T02:22:20.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0146000000000001e-05 2024-09-17T02:22:20.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715821+0000", 2024-09-17T02:22:20.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013421 2024-09-17T02:22:20.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:20.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715840+0000", 2024-09-17T02:22:20.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8153999999999999e-05 2024-09-17T02:22:20.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:20.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592528+0000", 2024-09-17T02:22:20.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.87668860000000004 2024-09-17T02:22:20.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:20.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592702+0000", 2024-09-17T02:22:20.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017429300000000001 2024-09-17T02:22:20.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:20.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592945+0000", 2024-09-17T02:22:20.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000242048 2024-09-17T02:22:20.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:20.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600234+0000", 2024-09-17T02:22:20.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072897600000000002 2024-09-17T02:22:20.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:20.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600494+0000", 2024-09-17T02:22:20.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000259984 2024-09-17T02:22:20.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:20.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600555+0000", 2024-09-17T02:22:20.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1138999999999999e-05 2024-09-17T02:22:20.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:20.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:20.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:20.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600733+0000", 2024-09-17T02:22:20.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017753300000000001 2024-09-17T02:22:20.946 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.946 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.946 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.946 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:20.947 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:20.947 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:20.947 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:22:20.948 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:20.948+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:20.949 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:21.048 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:21.046+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:21.099 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:21.099 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:22:21.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.099 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:226363 5.6 5:669f917a:::benchmark_data_smithi001_23533_object98246:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T02:22:21.100 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:21.096064+0000", 2024-09-17T02:22:21.100 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0059067989999999999, 2024-09-17T02:22:21.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0059358730000000004, 2024-09-17T02:22:21.100 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:21.100 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:21.100 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:21.100 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:21.100 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:21.100 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:21.100 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 226363 2024-09-17T02:22:21.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.100 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:21.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:21.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.096064+0000", 2024-09-17T02:22:21.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:21.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:21.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.096064+0000", 2024-09-17T02:22:21.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:21.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:21.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.096064+0000", 2024-09-17T02:22:21.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9199999999999999e-07 2024-09-17T02:22:21.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:21.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.096069+0000", 2024-09-17T02:22:21.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1609999999999996e-06 2024-09-17T02:22:21.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:21.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.096081+0000", 2024-09-17T02:22:21.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1919999999999999e-05 2024-09-17T02:22:21.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:21.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.096088+0000", 2024-09-17T02:22:21.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9979999999999997e-06 2024-09-17T02:22:21.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:21.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.100101+0000", 2024-09-17T02:22:21.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040135509999999998 2024-09-17T02:22:21.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:21.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.100210+0000", 2024-09-17T02:22:21.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010936400000000001 2024-09-17T02:22:21.104 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:21.104 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:21.104 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:21.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.105 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:226364 5.0 5:05ee5492:::benchmark_data_smithi001_23533_object98247:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T02:22:21.105 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:21.096115+0000", 2024-09-17T02:22:21.105 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0058549470000000001, 2024-09-17T02:22:21.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0059545750000000001, 2024-09-17T02:22:21.105 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:21.105 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:21.105 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:21.105 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:21.105 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:21.105 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:21.106 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 226364 2024-09-17T02:22:21.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.106 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:21.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:21.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.096115+0000", 2024-09-17T02:22:21.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:21.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:21.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.096115+0000", 2024-09-17T02:22:21.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:21.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:21.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.096116+0000", 2024-09-17T02:22:21.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2200000000000003e-07 2024-09-17T02:22:21.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:21.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.096119+0000", 2024-09-17T02:22:21.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.796e-06 2024-09-17T02:22:21.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:21.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.096127+0000", 2024-09-17T02:22:21.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5180000000000004e-06 2024-09-17T02:22:21.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:21.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.096133+0000", 2024-09-17T02:22:21.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3399999999999997e-06 2024-09-17T02:22:21.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:21.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.096180+0000", 2024-09-17T02:22:21.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7224000000000001e-05 2024-09-17T02:22:21.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:21.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.096291+0000", 2024-09-17T02:22:21.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111092 2024-09-17T02:22:21.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:21.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.096388+0000", 2024-09-17T02:22:21.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6695999999999997e-05 2024-09-17T02:22:21.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:21.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099004+0000", 2024-09-17T02:22:21.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026162780000000001 2024-09-17T02:22:21.110 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:21.110 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:21.110 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:21.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.110 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:226361 5.3 e69/64 5:c5ed9c52:::benchmark_data_smithi001_23533_object98244:head v 69'14263, mlcod=69'14259)", 2024-09-17T02:22:21.110 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:21.098743+0000", 2024-09-17T02:22:21.110 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0032272569999999999, 2024-09-17T02:22:21.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034008210000000001, 2024-09-17T02:22:21.110 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:21.110 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:21.110 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:21.110 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:21.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:21.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.098743+0000", 2024-09-17T02:22:21.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:21.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:21.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.098743+0000", 2024-09-17T02:22:21.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:21.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:21.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.098744+0000", 2024-09-17T02:22:21.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0999999999999997e-07 2024-09-17T02:22:21.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:21.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.098749+0000", 2024-09-17T02:22:21.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5559999999999998e-06 2024-09-17T02:22:21.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:21.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.098760+0000", 2024-09-17T02:22:21.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0086e-05 2024-09-17T02:22:21.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:21.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.098766+0000", 2024-09-17T02:22:21.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4590000000000003e-06 2024-09-17T02:22:21.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:21.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.098823+0000", 2024-09-17T02:22:21.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7077000000000003e-05 2024-09-17T02:22:21.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:21.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.098843+0000", 2024-09-17T02:22:21.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9545999999999999e-05 2024-09-17T02:22:21.114 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:21.115 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:21.115 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:21.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.115 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:226362 5.3 e69/64)", 2024-09-17T02:22:21.115 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:21.098804+0000", 2024-09-17T02:22:21.115 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0031667179999999998, 2024-09-17T02:22:21.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033940060000000002, 2024-09-17T02:22:21.116 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:21.116 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:21.116 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:21.116 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:21.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:21.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.098804+0000", 2024-09-17T02:22:21.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:21.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:21.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.098804+0000", 2024-09-17T02:22:21.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:21.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:21.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.098804+0000", 2024-09-17T02:22:21.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9600000000000001e-07 2024-09-17T02:22:21.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:21.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.098807+0000", 2024-09-17T02:22:21.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4860000000000002e-06 2024-09-17T02:22:21.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:21.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.098814+0000", 2024-09-17T02:22:21.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9149999999999999e-06 2024-09-17T02:22:21.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:21.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.098820+0000", 2024-09-17T02:22:21.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5720000000000002e-06 2024-09-17T02:22:21.118 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:21.118 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:21.118 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:21.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.118 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:226365 5.8 5:1bb3c698:::benchmark_data_smithi001_23533_object98248:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T02:22:21.118 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:21.099061+0000", 2024-09-17T02:22:21.119 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0029091999999999998, 2024-09-17T02:22:21.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031893360000000001, 2024-09-17T02:22:21.119 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:21.119 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:21.119 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:21.119 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:21.119 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:21.119 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:21.119 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 226365 2024-09-17T02:22:21.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.119 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:21.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:21.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099061+0000", 2024-09-17T02:22:21.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:21.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:21.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099061+0000", 2024-09-17T02:22:21.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:21.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:21.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099063+0000", 2024-09-17T02:22:21.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.361e-06 2024-09-17T02:22:21.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:21.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099066+0000", 2024-09-17T02:22:21.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8039999999999999e-06 2024-09-17T02:22:21.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:21.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099076+0000", 2024-09-17T02:22:21.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8859999999999999e-06 2024-09-17T02:22:21.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:21.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099083+0000", 2024-09-17T02:22:21.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7009999999999999e-06 2024-09-17T02:22:21.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:21.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099135+0000", 2024-09-17T02:22:21.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1879000000000003e-05 2024-09-17T02:22:21.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:21.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099542+0000", 2024-09-17T02:22:21.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00040676500000000001 2024-09-17T02:22:21.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:21.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099636+0000", 2024-09-17T02:22:21.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4512999999999994e-05 2024-09-17T02:22:21.122 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:21.123 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:21.123 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:21.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.123 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:226366 5.a 5:57de20ad:::benchmark_data_smithi001_23533_object98249:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T02:22:21.123 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:21.099096+0000", 2024-09-17T02:22:21.123 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0028746990000000001, 2024-09-17T02:22:21.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032318970000000001, 2024-09-17T02:22:21.123 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:21.123 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:21.123 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:21.123 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:21.124 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:21.124 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:21.124 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 226366 2024-09-17T02:22:21.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.124 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:21.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:21.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099096+0000", 2024-09-17T02:22:21.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:21.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:21.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099096+0000", 2024-09-17T02:22:21.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:21.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:21.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099096+0000", 2024-09-17T02:22:21.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1800000000000001e-07 2024-09-17T02:22:21.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:21.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099098+0000", 2024-09-17T02:22:21.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0540000000000002e-06 2024-09-17T02:22:21.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:21.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099105+0000", 2024-09-17T02:22:21.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8090000000000004e-06 2024-09-17T02:22:21.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:21.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099110+0000", 2024-09-17T02:22:21.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5909999999999998e-06 2024-09-17T02:22:21.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:21.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099156+0000", 2024-09-17T02:22:21.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6557000000000002e-05 2024-09-17T02:22:21.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:21.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099260+0000", 2024-09-17T02:22:21.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103599 2024-09-17T02:22:21.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:21.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099362+0000", 2024-09-17T02:22:21.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010215100000000001 2024-09-17T02:22:21.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:21.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.101968+0000", 2024-09-17T02:22:21.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026056629999999998 2024-09-17T02:22:21.129 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:21.129 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:21.129 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:21.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.129 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:226369 5.7 5:e2bd7f95:::benchmark_data_smithi001_23533_object98252:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T02:22:21.129 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:21.099189+0000", 2024-09-17T02:22:21.129 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0027817010000000001, 2024-09-17T02:22:21.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032083680000000001, 2024-09-17T02:22:21.129 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:21.129 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:21.130 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:21.130 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:21.130 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:21.130 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:21.130 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 226369 2024-09-17T02:22:21.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.130 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:21.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:21.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099189+0000", 2024-09-17T02:22:21.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:21.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:21.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099189+0000", 2024-09-17T02:22:21.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:21.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:21.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099189+0000", 2024-09-17T02:22:21.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4499999999999996e-07 2024-09-17T02:22:21.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:21.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099193+0000", 2024-09-17T02:22:21.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7419999999999999e-06 2024-09-17T02:22:21.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:21.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099202+0000", 2024-09-17T02:22:21.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4430000000000003e-06 2024-09-17T02:22:21.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:21.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099208+0000", 2024-09-17T02:22:21.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0909999999999998e-06 2024-09-17T02:22:21.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:21.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099256+0000", 2024-09-17T02:22:21.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7908999999999998e-05 2024-09-17T02:22:21.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:21.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099363+0000", 2024-09-17T02:22:21.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107649 2024-09-17T02:22:21.133 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:21.133 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:21.133 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:21.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.133 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:226368 5.1 e69/61 5:8347a907:::benchmark_data_smithi001_23533_object98251:head v 69'14108, mlcod=69'14106)", 2024-09-17T02:22:21.133 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:21.099800+0000", 2024-09-17T02:22:21.133 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0021705219999999998, 2024-09-17T02:22:21.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026681420000000001, 2024-09-17T02:22:21.134 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:21.134 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:21.134 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:21.134 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:21.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:21.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099800+0000", 2024-09-17T02:22:21.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:21.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:21.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099800+0000", 2024-09-17T02:22:21.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:21.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:21.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099801+0000", 2024-09-17T02:22:21.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4199999999999995e-07 2024-09-17T02:22:21.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:21.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099805+0000", 2024-09-17T02:22:21.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7890000000000002e-06 2024-09-17T02:22:21.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:21.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099815+0000", 2024-09-17T02:22:21.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0023999999999999e-05 2024-09-17T02:22:21.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:21.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099821+0000", 2024-09-17T02:22:21.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7960000000000001e-06 2024-09-17T02:22:21.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:21.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099876+0000", 2024-09-17T02:22:21.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5189000000000003e-05 2024-09-17T02:22:21.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:21.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.099894+0000", 2024-09-17T02:22:21.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7665000000000001e-05 2024-09-17T02:22:21.138 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:21.138 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:21.138 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:21.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.138 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:226372 5.6 5.e547396 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T02:22:21.138 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:21.100031+0000", 2024-09-17T02:22:21.138 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0019389069999999999, 2024-09-17T02:22:21.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024896200000000001, 2024-09-17T02:22:21.138 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:21.139 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:21.139 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-17T02:22:21.139 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:21.139 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:21.139 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:21.139 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 226372 2024-09-17T02:22:21.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.139 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:21.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:21.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.100031+0000", 2024-09-17T02:22:21.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:21.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:21.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.100031+0000", 2024-09-17T02:22:21.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:21.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:21.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.100032+0000", 2024-09-17T02:22:21.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0699999999999996e-07 2024-09-17T02:22:21.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:21.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.100036+0000", 2024-09-17T02:22:21.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5360000000000001e-06 2024-09-17T02:22:21.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:21.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.100046+0000", 2024-09-17T02:22:21.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0356e-05 2024-09-17T02:22:21.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:21.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.100053+0000", 2024-09-17T02:22:21.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3159999999999999e-06 2024-09-17T02:22:21.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:21.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.102520+0000", 2024-09-17T02:22:21.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024668279999999999 2024-09-17T02:22:21.142 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:21.142 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:21.142 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:21.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.143 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:226374 5.6 5.51589786 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T02:22:21.143 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:21.101153+0000", 2024-09-17T02:22:21.143 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00081744000000000001, 2024-09-17T02:22:21.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014273020000000001, 2024-09-17T02:22:21.143 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:21.143 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:21.144 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:21.144 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:21.144 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:21.144 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:21.144 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 226374 2024-09-17T02:22:21.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.144 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:21.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:21.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.101153+0000", 2024-09-17T02:22:21.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:21.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:21.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.101153+0000", 2024-09-17T02:22:21.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:21.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:21.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.101154+0000", 2024-09-17T02:22:21.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0200000000000001e-07 2024-09-17T02:22:21.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:21.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.101157+0000", 2024-09-17T02:22:21.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4470000000000002e-06 2024-09-17T02:22:21.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:21.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.101169+0000", 2024-09-17T02:22:21.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1701e-05 2024-09-17T02:22:21.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:21.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.101176+0000", 2024-09-17T02:22:21.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6699999999999997e-06 2024-09-17T02:22:21.148 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:21.148 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:21.148 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:21.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.148 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:226376 5.4 e69/52 5:2ee8af02:::benchmark_data_smithi001_23533_object98259:head v 69'13956, mlcod=69'13954)", 2024-09-17T02:22:21.148 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:21.102395+0000", 2024-09-17T02:22:21.148 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9995751, 2024-09-17T02:22:21.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024238100000000001, 2024-09-17T02:22:21.148 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:21.148 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:21.148 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:21.148 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:21.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:21.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.102395+0000", 2024-09-17T02:22:21.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:21.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:21.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.102395+0000", 2024-09-17T02:22:21.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:21.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:21.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.102396+0000", 2024-09-17T02:22:21.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3499999999999996e-07 2024-09-17T02:22:21.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:21.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.102403+0000", 2024-09-17T02:22:21.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1570000000000003e-06 2024-09-17T02:22:21.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:21.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.102419+0000", 2024-09-17T02:22:21.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6303e-05 2024-09-17T02:22:21.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:21.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.102426+0000", 2024-09-17T02:22:21.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7279999999999998e-06 2024-09-17T02:22:21.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:21.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.102473+0000", 2024-09-17T02:22:21.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7017000000000001e-05 2024-09-17T02:22:21.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:21.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.102492+0000", 2024-09-17T02:22:21.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8612000000000001e-05 2024-09-17T02:22:21.153 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:21.153 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:21.154 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:21.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.154 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:226377 5.a 5:5ee8bb27:::benchmark_data_smithi001_23533_object98260:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T02:22:21.154 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:21.102500+0000", 2024-09-17T02:22:21.155 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9994707, 2024-09-17T02:22:21.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020083300000000001, 2024-09-17T02:22:21.155 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:21.155 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:21.155 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-17T02:22:21.155 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:21.155 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:21.155 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:21.155 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 226377 2024-09-17T02:22:21.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.156 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:21.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:21.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.102500+0000", 2024-09-17T02:22:21.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:21.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:21.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.102500+0000", 2024-09-17T02:22:21.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:21.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:21.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.102501+0000", 2024-09-17T02:22:21.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5700000000000001e-07 2024-09-17T02:22:21.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:21.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.102505+0000", 2024-09-17T02:22:21.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3780000000000003e-06 2024-09-17T02:22:21.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:21.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.102513+0000", 2024-09-17T02:22:21.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3210000000000005e-06 2024-09-17T02:22:21.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:21.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.102520+0000", 2024-09-17T02:22:21.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6939999999999998e-06 2024-09-17T02:22:21.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:21.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.102584+0000", 2024-09-17T02:22:21.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3794999999999995e-05 2024-09-17T02:22:21.159 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:21.159 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:21.159 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:21.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.160 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:226378 5.8 5.62989b08 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T02:22:21.160 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:21.102548+0000", 2024-09-17T02:22:21.160 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.999423, 2024-09-17T02:22:21.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021772100000000001, 2024-09-17T02:22:21.160 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:21.160 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:21.160 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:21.160 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:21.160 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:21.160 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:21.160 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 226378 2024-09-17T02:22:21.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.161 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:21.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:21.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.102548+0000", 2024-09-17T02:22:21.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:21.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:21.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.102548+0000", 2024-09-17T02:22:21.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:21.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:21.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.102548+0000", 2024-09-17T02:22:21.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7999999999999995e-07 2024-09-17T02:22:21.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:21.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.102551+0000", 2024-09-17T02:22:21.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.039e-06 2024-09-17T02:22:21.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:21.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.102559+0000", 2024-09-17T02:22:21.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8339999999999999e-06 2024-09-17T02:22:21.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:21.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:21.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:21.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:21.102565+0000", 2024-09-17T02:22:21.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8039999999999998e-06 2024-09-17T02:22:21.163 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:21.164 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:21.164 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:21.164 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:21.164 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:22:21.164 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 13 2024-09-17T02:22:21.164 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:21.165 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:22:21.165 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:22:21.166 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:22:21.167 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:21.167 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:22:21.168 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:22:21.168 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:22:21.169 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:22:21.169 INFO:teuthology.orchestra.run.smithi001.stderr:nodeep-scrub is set 2024-09-17T02:22:21.170 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:21.168+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:21.266 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:21.266+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:21.318 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:21.318 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:21.338 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:21.385 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:21.388+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:21.469 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:21.467+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:21.490 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:21.490 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:21.509 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:21.569 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:21.571+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:21.658 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:21.658 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:21.669 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:21.671+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:21.677 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:21.770 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:21.770+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:21.829 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:21.829 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:21.848 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:21.871 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:21.871+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:21.972 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:21.975+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:22.043 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:22.043 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:22.063 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:22.109 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:22.111+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:22.174 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:22.174+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:22.217 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:22.218 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:22.236 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:22.275 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:22.274+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:22.376 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:22.374+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:22.425 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:22.425 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:22.446 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:22.493 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:22.495+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:22.578 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:22.578+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:22.596 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:22.596 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:22.615 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:22.678 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:22.679+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:22.758 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:22.758 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:22.776 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:22.821 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:22.822+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:22.881 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:22.883+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:22.930 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:22.930 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:22.946 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:22.982 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:22.983+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:23.083 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:23.082+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:23.139 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:23.139 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:23.158 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:23.169 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:22:23.170 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T02:22:23.205 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:23.206+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:23.285 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:23.287+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:23.305 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:23.305 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:23.324 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:23.329 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:22:23.330 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:22:23.348 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:22:23.348 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:22:23.348 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:22:23.351 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:22:23.352 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:22:23.385 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:23.382+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:23.486 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:23.486+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:23.514 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:23.514 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:22:23.514 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:22:23.515 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:22:23.515 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:23.532 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:23.587 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:23.586+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:23.687 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:23.686+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:23.689 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:23.689 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:22:23.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:22:23.689 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:22:23.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.689 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:22:23.689 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:23.690 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.122108103, 2024-09-17T02:22:23.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:22:23.690 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:23.690 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:23.690 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:23.690 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:23.690 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:23.690 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:23.690 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:22:23.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.690 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:23.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:23.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:23.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:23.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:23.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:23.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:22:23.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:22:23.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:23.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:22:23.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:22:23.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:23.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:22:23.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:22:23.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:22:23.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:22:23.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:23.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:22:23.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:22:23.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:23.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:22:23.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:22:23.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:23.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:22:23.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:22:23.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:23.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:22:23.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:22:23.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:23.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:22:23.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:22:23.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:23.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:22:23.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:22:23.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:23.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:22:23.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:22:23.696 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.696 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:23.696 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.696 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:22:23.696 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:23.697 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.11820585300001, 2024-09-17T02:22:23.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:22:23.697 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:23.697 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:23.697 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:23.697 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:23.697 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:23.697 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:23.697 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:22:23.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.697 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:23.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:23.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:23.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:23.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:23.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:23.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:22:23.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:22:23.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:23.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:22:23.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:22:23.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:23.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:22:23.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:22:23.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:22:23.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:22:23.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:23.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:22:23.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:22:23.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:23.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:22:23.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:22:23.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:23.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:22:23.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:22:23.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:23.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:22:23.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:22:23.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:23.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:22:23.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:22:23.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:23.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:22:23.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:22:23.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:23.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:22:23.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:22:23.702 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.702 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:23.702 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.703 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97759 5.a 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:23.703 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:23.703 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.092186029999993, 2024-09-17T02:22:23.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.089694871999999995, 2024-09-17T02:22:23.703 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:23.703 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:23.703 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:23.703 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:23.703 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:23.703 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:23.703 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97759 2024-09-17T02:22:23.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.703 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:23.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:23.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:23.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:23.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:23.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:23.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598386+0000", 2024-09-17T02:22:23.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999999e-07 2024-09-17T02:22:23.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:23.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598414+0000", 2024-09-17T02:22:23.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8013000000000001e-05 2024-09-17T02:22:23.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:23.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598420+0000", 2024-09-17T02:22:23.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1149999999999999e-06 2024-09-17T02:22:23.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598424+0000", 2024-09-17T02:22:23.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:22:23.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:23.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598479+0000", 2024-09-17T02:22:23.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4648999999999998e-05 2024-09-17T02:22:23.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:23.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598587+0000", 2024-09-17T02:22:23.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010853000000000001 2024-09-17T02:22:23.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:23.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598676+0000", 2024-09-17T02:22:23.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8381999999999995e-05 2024-09-17T02:22:23.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:23.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603766+0000", 2024-09-17T02:22:23.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050902559999999996 2024-09-17T02:22:23.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:23.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.687988+0000", 2024-09-17T02:22:23.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.084221753999999996 2024-09-17T02:22:23.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:23.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688037+0000", 2024-09-17T02:22:23.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-05 2024-09-17T02:22:23.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:23.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688080+0000", 2024-09-17T02:22:23.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3149999999999999e-05 2024-09-17T02:22:23.708 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.708 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:23.709 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.709 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97770 5.0 5:09c75033:::benchmark_data_smithi001_23533_object97769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:23.709 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:23.709 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.087043600000001, 2024-09-17T02:22:23.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.086380868, 2024-09-17T02:22:23.709 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:23.709 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:23.709 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:23.709 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:23.709 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:23.709 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:23.710 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97770 2024-09-17T02:22:23.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.710 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:23.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:23.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:23.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:23.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:23.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:23.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603529+0000", 2024-09-17T02:22:23.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:22:23.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:23.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603593+0000", 2024-09-17T02:22:23.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4216999999999999e-05 2024-09-17T02:22:23.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:23.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603603+0000", 2024-09-17T02:22:23.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5179999999999993e-06 2024-09-17T02:22:23.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603608+0000", 2024-09-17T02:22:23.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2039999999999996e-06 2024-09-17T02:22:23.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:23.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603653+0000", 2024-09-17T02:22:23.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5247000000000002e-05 2024-09-17T02:22:23.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:23.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603758+0000", 2024-09-17T02:22:23.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105352 2024-09-17T02:22:23.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:23.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603900+0000", 2024-09-17T02:22:23.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014198999999999999 2024-09-17T02:22:23.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:23.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.606097+0000", 2024-09-17T02:22:23.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021969839999999999 2024-09-17T02:22:23.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:23.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689756+0000", 2024-09-17T02:22:23.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.083659077999999998 2024-09-17T02:22:23.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:23.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689846+0000", 2024-09-17T02:22:23.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9320999999999994e-05 2024-09-17T02:22:23.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:23.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689908+0000", 2024-09-17T02:22:23.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720999999999998e-05 2024-09-17T02:22:23.715 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.715 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:23.715 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.715 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127513 5.c 5:3eca08e4:::benchmark_data_smithi001_23533_object127512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:23.715 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:23.715 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.246267176000003, 2024-09-17T02:22:23.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046626399999999998, 2024-09-17T02:22:23.715 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:23.715 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:23.716 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:23.716 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:23.716 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:23.716 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:23.716 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127513 2024-09-17T02:22:23.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.716 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:23.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:23.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:23.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:23.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:23.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:23.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444305+0000", 2024-09-17T02:22:23.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2529999999999999e-06 2024-09-17T02:22:23.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:23.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444466+0000", 2024-09-17T02:22:23.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016069700000000001 2024-09-17T02:22:23.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:23.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444479+0000", 2024-09-17T02:22:23.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2602999999999999e-05 2024-09-17T02:22:23.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444485+0000", 2024-09-17T02:22:23.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.669e-06 2024-09-17T02:22:23.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:23.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444560+0000", 2024-09-17T02:22:23.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4276999999999994e-05 2024-09-17T02:22:23.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:23.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444656+0000", 2024-09-17T02:22:23.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6490000000000006e-05 2024-09-17T02:22:23.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:23.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444739+0000", 2024-09-17T02:22:23.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3139999999999993e-05 2024-09-17T02:22:23.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:23.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.448438+0000", 2024-09-17T02:22:23.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036985490000000002 2024-09-17T02:22:23.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:23.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490732+0000", 2024-09-17T02:22:23.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042294353999999999 2024-09-17T02:22:23.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:23.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490859+0000", 2024-09-17T02:22:23.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012708899999999999 2024-09-17T02:22:23.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:23.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490930+0000", 2024-09-17T02:22:23.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:23.721 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.721 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:23.721 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.721 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127514 5.c 5:39cc1feb:::benchmark_data_smithi001_23533_object127513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:23.721 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:23.721 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.246070406999998, 2024-09-17T02:22:23.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049357228000000003, 2024-09-17T02:22:23.721 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:23.721 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:23.722 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:23.722 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:23.722 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:23.722 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:23.722 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127514 2024-09-17T02:22:23.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.722 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:23.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:23.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:23.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:23.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:23.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:23.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:23.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8599999999999998e-07 2024-09-17T02:22:23.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:23.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444554+0000", 2024-09-17T02:22:23.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3047999999999998e-05 2024-09-17T02:22:23.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:23.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444562+0000", 2024-09-17T02:22:23.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5830000000000001e-06 2024-09-17T02:22:23.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444567+0000", 2024-09-17T02:22:23.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4179999999999996e-06 2024-09-17T02:22:23.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:23.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446566+0000", 2024-09-17T02:22:23.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001998788 2024-09-17T02:22:23.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:23.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446696+0000", 2024-09-17T02:22:23.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129393 2024-09-17T02:22:23.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:23.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446794+0000", 2024-09-17T02:22:23.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8462999999999996e-05 2024-09-17T02:22:23.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:23.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.449036+0000", 2024-09-17T02:22:23.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022415880000000001 2024-09-17T02:22:23.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:23.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493737+0000", 2024-09-17T02:22:23.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044701682 2024-09-17T02:22:23.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:23.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493808+0000", 2024-09-17T02:22:23.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0846000000000006e-05 2024-09-17T02:22:23.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:23.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493858+0000", 2024-09-17T02:22:23.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9932999999999998e-05 2024-09-17T02:22:23.727 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.727 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:23.727 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.727 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129441 5.1 5:84c3199f:::benchmark_data_smithi001_23533_object1324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:23.727 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:23.727 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.187059918999999, 2024-09-17T02:22:23.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034387011000000002, 2024-09-17T02:22:23.727 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:23.727 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:23.728 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:23.728 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:23.728 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:23.728 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:23.728 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129441 2024-09-17T02:22:23.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.728 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:23.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:23.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:23.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:23.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:23.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:23.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503513+0000", 2024-09-17T02:22:23.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4759999999999999e-06 2024-09-17T02:22:23.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:23.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503518+0000", 2024-09-17T02:22:23.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-09-17T02:22:23.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:23.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503532+0000", 2024-09-17T02:22:23.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4049999999999999e-05 2024-09-17T02:22:23.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503541+0000", 2024-09-17T02:22:23.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5320000000000006e-06 2024-09-17T02:22:23.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:23.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506331+0000", 2024-09-17T02:22:23.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027899190000000001 2024-09-17T02:22:23.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:23.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506402+0000", 2024-09-17T02:22:23.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:23.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:23.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506477+0000", 2024-09-17T02:22:23.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4626e-05 2024-09-17T02:22:23.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:23.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509749+0000", 2024-09-17T02:22:23.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032726980000000001 2024-09-17T02:22:23.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:23.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537758+0000", 2024-09-17T02:22:23.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028008890000000002 2024-09-17T02:22:23.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:23.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537812+0000", 2024-09-17T02:22:23.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3300000000000001e-05 2024-09-17T02:22:23.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:23.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537898+0000", 2024-09-17T02:22:23.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6691000000000001e-05 2024-09-17T02:22:23.733 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.733 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:23.733 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.734 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129442 5.1 5:8f7f2a95:::benchmark_data_smithi001_23533_object1325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:23.734 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:23.734 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.184089309999997, 2024-09-17T02:22:23.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031546698999999997, 2024-09-17T02:22:23.734 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:23.734 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:23.734 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:23.734 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:23.734 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:23.734 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:23.734 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129442 2024-09-17T02:22:23.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.734 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:23.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:23.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:23.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:23.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:23.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:23.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506483+0000", 2024-09-17T02:22:23.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2869999999999999e-06 2024-09-17T02:22:23.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:23.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506489+0000", 2024-09-17T02:22:23.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2330000000000003e-06 2024-09-17T02:22:23.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:23.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506502+0000", 2024-09-17T02:22:23.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2286999999999999e-05 2024-09-17T02:22:23.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506511+0000", 2024-09-17T02:22:23.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7799999999999995e-06 2024-09-17T02:22:23.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:23.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.507966+0000", 2024-09-17T02:22:23.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014541549999999999 2024-09-17T02:22:23.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:23.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508130+0000", 2024-09-17T02:22:23.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016455199999999999 2024-09-17T02:22:23.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:23.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508287+0000", 2024-09-17T02:22:23.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015730400000000001 2024-09-17T02:22:23.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:23.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510577+0000", 2024-09-17T02:22:23.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022899449999999998 2024-09-17T02:22:23.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:23.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537932+0000", 2024-09-17T02:22:23.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027354471000000002 2024-09-17T02:22:23.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:23.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537964+0000", 2024-09-17T02:22:23.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1909999999999998e-05 2024-09-17T02:22:23.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:23.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.538029+0000", 2024-09-17T02:22:23.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4775000000000002e-05 2024-09-17T02:22:23.739 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.739 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:23.739 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.740 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:150458 5.a 5:59b62890:::benchmark_data_smithi001_23533_object22341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:22:23.740 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:23.740 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.852245502999999, 2024-09-17T02:22:23.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028150173000000001, 2024-09-17T02:22:23.740 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:23.740 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:23.740 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:23.740 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:23.740 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:23.740 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:23.740 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 150458 2024-09-17T02:22:23.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.741 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:23.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:23.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:23.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:23.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:23.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:23.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:23.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7800000000000002e-07 2024-09-17T02:22:23.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:23.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838328+0000", 2024-09-17T02:22:23.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.838e-06 2024-09-17T02:22:23.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:23.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838335+0000", 2024-09-17T02:22:23.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1999999999999997e-06 2024-09-17T02:22:23.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838340+0000", 2024-09-17T02:22:23.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7389999999999999e-06 2024-09-17T02:22:23.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:23.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849082+0000", 2024-09-17T02:22:23.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01074174 2024-09-17T02:22:23.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:23.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849192+0000", 2024-09-17T02:22:23.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011040300000000001 2024-09-17T02:22:23.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:23.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849297+0000", 2024-09-17T02:22:23.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104764 2024-09-17T02:22:23.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:23.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.857853+0000", 2024-09-17T02:22:23.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085558490000000008 2024-09-17T02:22:23.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:23.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866430+0000", 2024-09-17T02:22:23.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085768140000000003 2024-09-17T02:22:23.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:23.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866454+0000", 2024-09-17T02:22:23.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4428000000000001e-05 2024-09-17T02:22:23.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:23.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866476+0000", 2024-09-17T02:22:23.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.192e-05 2024-09-17T02:22:23.745 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.745 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:23.746 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.746 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190780 5.3 e65/64 5:c634f18a:::benchmark_data_smithi001_23533_object62663:head v 65'12039, mlcod=0'0)", 2024-09-17T02:22:23.746 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.182278+0000", 2024-09-17T02:22:23.746 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.508293414000001, 2024-09-17T02:22:23.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028943393000000001, 2024-09-17T02:22:23.746 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:23.746 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:23.746 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:23.746 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:23.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:23.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182278+0000", 2024-09-17T02:22:23.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:23.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182278+0000", 2024-09-17T02:22:23.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:23.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182280+0000", 2024-09-17T02:22:23.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.736e-06 2024-09-17T02:22:23.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:23.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182291+0000", 2024-09-17T02:22:23.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1933000000000001e-05 2024-09-17T02:22:23.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:23.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182317+0000", 2024-09-17T02:22:23.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6024999999999999e-05 2024-09-17T02:22:23.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182332+0000", 2024-09-17T02:22:23.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4856e-05 2024-09-17T02:22:23.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:23.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182463+0000", 2024-09-17T02:22:23.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130674 2024-09-17T02:22:23.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:23.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182533+0000", 2024-09-17T02:22:23.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0296999999999995e-05 2024-09-17T02:22:23.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:23.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211153+0000", 2024-09-17T02:22:23.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028619265000000001 2024-09-17T02:22:23.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:23.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211221+0000", 2024-09-17T02:22:23.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8607000000000002e-05 2024-09-17T02:22:23.750 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.750 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:23.751 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.751 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190799 5.3 e65/64 5:c0e8780b:::benchmark_data_smithi001_23533_object62682:head v 65'12040, mlcod=0'0)", 2024-09-17T02:22:23.751 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.193849+0000", 2024-09-17T02:22:23.751 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.496722062, 2024-09-17T02:22:23.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02989934, 2024-09-17T02:22:23.751 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:23.751 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:23.751 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:23.751 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:23.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:23.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193849+0000", 2024-09-17T02:22:23.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:23.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193849+0000", 2024-09-17T02:22:23.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:23.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193851+0000", 2024-09-17T02:22:23.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.137e-06 2024-09-17T02:22:23.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:23.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193865+0000", 2024-09-17T02:22:23.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3845999999999999e-05 2024-09-17T02:22:23.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:23.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193888+0000", 2024-09-17T02:22:23.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3312e-05 2024-09-17T02:22:23.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193901+0000", 2024-09-17T02:22:23.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2896e-05 2024-09-17T02:22:23.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:23.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.204084+0000", 2024-09-17T02:22:23.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010182538 2024-09-17T02:22:23.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:23.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.204126+0000", 2024-09-17T02:22:23.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1828e-05 2024-09-17T02:22:23.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:23.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223688+0000", 2024-09-17T02:22:23.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019562408999999999 2024-09-17T02:22:23.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:23.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223748+0000", 2024-09-17T02:22:23.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0374000000000002e-05 2024-09-17T02:22:23.755 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.755 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:23.755 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.755 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190836 5.3 e65/64 5:c72f74ff:::benchmark_data_smithi001_23533_object62719:head v 65'12042, mlcod=0'0)", 2024-09-17T02:22:23.755 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.198478+0000", 2024-09-17T02:22:23.755 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.49209317, 2024-09-17T02:22:23.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031214246000000001, 2024-09-17T02:22:23.756 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:23.756 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:23.756 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:23.756 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:23.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:23.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198478+0000", 2024-09-17T02:22:23.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:23.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198478+0000", 2024-09-17T02:22:23.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:23.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198480+0000", 2024-09-17T02:22:23.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0899999999999999e-06 2024-09-17T02:22:23.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:23.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198494+0000", 2024-09-17T02:22:23.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3572e-05 2024-09-17T02:22:23.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:23.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198521+0000", 2024-09-17T02:22:23.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7178999999999998e-05 2024-09-17T02:22:23.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198533+0000", 2024-09-17T02:22:23.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2588999999999999e-05 2024-09-17T02:22:23.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:23.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208944+0000", 2024-09-17T02:22:23.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010410236 2024-09-17T02:22:23.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:23.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208979+0000", 2024-09-17T02:22:23.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5555000000000001e-05 2024-09-17T02:22:23.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:23.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229627+0000", 2024-09-17T02:22:23.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020647993999999999 2024-09-17T02:22:23.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:23.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229692+0000", 2024-09-17T02:22:23.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5030999999999995e-05 2024-09-17T02:22:23.760 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.760 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:23.760 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.760 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190852 5.3 e65/64 5:c63de204:::benchmark_data_smithi001_23533_object62735:head v 65'12043, mlcod=0'0)", 2024-09-17T02:22:23.760 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.200082+0000", 2024-09-17T02:22:23.760 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.490489172, 2024-09-17T02:22:23.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029657795000000001, 2024-09-17T02:22:23.760 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:23.760 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:23.760 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:23.760 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:23.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200082+0000", 2024-09-17T02:22:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200082+0000", 2024-09-17T02:22:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200084+0000", 2024-09-17T02:22:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1900000000000002e-06 2024-09-17T02:22:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:23.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200099+0000", 2024-09-17T02:22:23.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4392999999999999e-05 2024-09-17T02:22:23.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:23.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200122+0000", 2024-09-17T02:22:23.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3292e-05 2024-09-17T02:22:23.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200134+0000", 2024-09-17T02:22:23.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2489e-05 2024-09-17T02:22:23.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:23.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211322+0000", 2024-09-17T02:22:23.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011187689000000001 2024-09-17T02:22:23.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:23.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211383+0000", 2024-09-17T02:22:23.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0707e-05 2024-09-17T02:22:23.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:23.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229698+0000", 2024-09-17T02:22:23.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018315306999999999 2024-09-17T02:22:23.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:23.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229740+0000", 2024-09-17T02:22:23.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1727999999999998e-05 2024-09-17T02:22:23.764 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.764 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:23.764 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.764 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190920 5.3 e65/64 5:c7bc6082:::benchmark_data_smithi001_23533_object62803:head v 65'12047, mlcod=0'0)", 2024-09-17T02:22:23.765 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.206674+0000", 2024-09-17T02:22:23.765 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.483897196000001, 2024-09-17T02:22:23.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.033826457999999997, 2024-09-17T02:22:23.765 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:23.765 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:23.765 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:23.765 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:23.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:23.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206674+0000", 2024-09-17T02:22:23.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:23.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206674+0000", 2024-09-17T02:22:23.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:23.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206676+0000", 2024-09-17T02:22:23.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.646e-06 2024-09-17T02:22:23.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:23.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206689+0000", 2024-09-17T02:22:23.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3196999999999999e-05 2024-09-17T02:22:23.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206718+0000", 2024-09-17T02:22:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8988000000000001e-05 2024-09-17T02:22:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206736+0000", 2024-09-17T02:22:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8221999999999999e-05 2024-09-17T02:22:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.221517+0000", 2024-09-17T02:22:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014781247000000001 2024-09-17T02:22:23.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:23.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.221563+0000", 2024-09-17T02:22:23.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5343999999999998e-05 2024-09-17T02:22:23.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:23.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240391+0000", 2024-09-17T02:22:23.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018828693000000001 2024-09-17T02:22:23.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:23.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240500+0000", 2024-09-17T02:22:23.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109121 2024-09-17T02:22:23.769 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.769 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:23.769 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.769 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190947 5.3 e65/64 5:ca95b398:::benchmark_data_smithi001_23533_object62830:head v 65'12048, mlcod=0'0)", 2024-09-17T02:22:23.769 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.208183+0000", 2024-09-17T02:22:23.769 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.482387843000001, 2024-09-17T02:22:23.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032404800999999997, 2024-09-17T02:22:23.769 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:23.769 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:23.769 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:23.770 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:23.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:23.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208183+0000", 2024-09-17T02:22:23.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:23.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208183+0000", 2024-09-17T02:22:23.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208185+0000", 2024-09-17T02:22:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.64e-06 2024-09-17T02:22:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208197+0000", 2024-09-17T02:22:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1589e-05 2024-09-17T02:22:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208217+0000", 2024-09-17T02:22:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0242e-05 2024-09-17T02:22:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208227+0000", 2024-09-17T02:22:23.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0256e-05 2024-09-17T02:22:23.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:23.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223908+0000", 2024-09-17T02:22:23.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015680726999999998 2024-09-17T02:22:23.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:23.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223969+0000", 2024-09-17T02:22:23.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1277000000000003e-05 2024-09-17T02:22:23.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:23.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240509+0000", 2024-09-17T02:22:23.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016539484 2024-09-17T02:22:23.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:23.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240588+0000", 2024-09-17T02:22:23.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9585999999999993e-05 2024-09-17T02:22:23.773 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.773 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:23.773 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.774 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190958 5.3 e65/64 5:c9337cc4:::benchmark_data_smithi001_23533_object62841:head v 65'12049, mlcod=0'0)", 2024-09-17T02:22:23.774 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.209746+0000", 2024-09-17T02:22:23.774 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.480825496000001, 2024-09-17T02:22:23.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030921212999999999, 2024-09-17T02:22:23.774 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:23.774 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:23.774 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:23.774 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:23.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:23.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209746+0000", 2024-09-17T02:22:23.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209746+0000", 2024-09-17T02:22:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209748+0000", 2024-09-17T02:22:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9989999999999998e-06 2024-09-17T02:22:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209761+0000", 2024-09-17T02:22:23.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3317e-05 2024-09-17T02:22:23.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:23.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209786+0000", 2024-09-17T02:22:23.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4941999999999999e-05 2024-09-17T02:22:23.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209799+0000", 2024-09-17T02:22:23.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2556e-05 2024-09-17T02:22:23.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:23.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.226753+0000", 2024-09-17T02:22:23.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016954100999999999 2024-09-17T02:22:23.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:23.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.226810+0000", 2024-09-17T02:22:23.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7207000000000003e-05 2024-09-17T02:22:23.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:23.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240599+0000", 2024-09-17T02:22:23.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013789228000000001 2024-09-17T02:22:23.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:23.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240667+0000", 2024-09-17T02:22:23.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7862999999999997e-05 2024-09-17T02:22:23.778 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.778 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:23.778 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.778 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:191023 5.3 e65/64 5:cfca4af2:::benchmark_data_smithi001_23533_object62906:head v 65'12050, mlcod=0'0)", 2024-09-17T02:22:23.778 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.210919+0000", 2024-09-17T02:22:23.778 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.479652139999999, 2024-09-17T02:22:23.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029830820000000001, 2024-09-17T02:22:23.778 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:23.779 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:23.779 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:23.779 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:23.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:23.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210919+0000", 2024-09-17T02:22:23.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:23.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210919+0000", 2024-09-17T02:22:23.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:23.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210921+0000", 2024-09-17T02:22:23.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-09-17T02:22:23.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:23.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210935+0000", 2024-09-17T02:22:23.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3436e-05 2024-09-17T02:22:23.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:23.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210961+0000", 2024-09-17T02:22:23.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6767999999999999e-05 2024-09-17T02:22:23.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210974+0000", 2024-09-17T02:22:23.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2904e-05 2024-09-17T02:22:23.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:23.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229967+0000", 2024-09-17T02:22:23.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018992774 2024-09-17T02:22:23.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.230023+0000", 2024-09-17T02:22:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6334e-05 2024-09-17T02:22:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240673+0000", 2024-09-17T02:22:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010649908 2024-09-17T02:22:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240750+0000", 2024-09-17T02:22:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6556000000000004e-05 2024-09-17T02:22:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:191048 5.3 e65/64 5:c4115f14:::benchmark_data_smithi001_23533_object62931:head v 65'12051, mlcod=0'0)", 2024-09-17T02:22:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.211763+0000", 2024-09-17T02:22:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.478808218000001, 2024-09-17T02:22:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029064577000000001, 2024-09-17T02:22:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:23.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211763+0000", 2024-09-17T02:22:23.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:23.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211763+0000", 2024-09-17T02:22:23.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:23.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211765+0000", 2024-09-17T02:22:23.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.717e-06 2024-09-17T02:22:23.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:23.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211776+0000", 2024-09-17T02:22:23.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1358999999999999e-05 2024-09-17T02:22:23.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:23.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211806+0000", 2024-09-17T02:22:23.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9924999999999999e-05 2024-09-17T02:22:23.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211824+0000", 2024-09-17T02:22:23.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7782999999999999e-05 2024-09-17T02:22:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.232521+0000", 2024-09-17T02:22:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020696902 2024-09-17T02:22:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.232574+0000", 2024-09-17T02:22:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3044000000000002e-05 2024-09-17T02:22:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240757+0000", 2024-09-17T02:22:23.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081828579999999995 2024-09-17T02:22:23.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:23.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240828+0000", 2024-09-17T02:22:23.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0988999999999994e-05 2024-09-17T02:22:23.787 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.787 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:23.787 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.787 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:191114 5.3 e65/64 5:c2a7e5a9:::benchmark_data_smithi001_23533_object62997:head v 65'12054, mlcod=63'12038)", 2024-09-17T02:22:23.787 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.217495+0000", 2024-09-17T02:22:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.473076587000001, 2024-09-17T02:22:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029944788, 2024-09-17T02:22:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217495+0000", 2024-09-17T02:22:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217495+0000", 2024-09-17T02:22:23.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:23.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217496+0000", 2024-09-17T02:22:23.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.46e-06 2024-09-17T02:22:23.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:23.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217508+0000", 2024-09-17T02:22:23.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2157000000000001e-05 2024-09-17T02:22:23.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217535+0000", 2024-09-17T02:22:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7058000000000001e-05 2024-09-17T02:22:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217551+0000", 2024-09-17T02:22:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5709000000000002e-05 2024-09-17T02:22:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.241029+0000", 2024-09-17T02:22:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023478452 2024-09-17T02:22:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:23.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.241078+0000", 2024-09-17T02:22:23.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8068000000000001e-05 2024-09-17T02:22:23.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:23.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.247369+0000", 2024-09-17T02:22:23.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0062912740000000003 2024-09-17T02:22:23.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:23.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.247439+0000", 2024-09-17T02:22:23.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0610000000000003e-05 2024-09-17T02:22:23.791 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.792 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:23.792 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.792 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:232047 5.5 5:afcad6c1:::benchmark_data_smithi001_23533_object103930:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-17T02:22:23.792 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:23.568037+0000", 2024-09-17T02:22:23.792 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.122534221, 2024-09-17T02:22:23.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029456251999999999, 2024-09-17T02:22:23.792 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:23.792 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:23.792 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:23.792 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:23.792 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:23.793 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:23.793 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 232047 2024-09-17T02:22:23.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.793 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:23.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:23.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.568037+0000", 2024-09-17T02:22:23.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:23.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.568037+0000", 2024-09-17T02:22:23.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:23.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:23.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.568039+0000", 2024-09-17T02:22:23.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.708e-06 2024-09-17T02:22:23.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:23.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.568043+0000", 2024-09-17T02:22:23.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6999999999999999e-06 2024-09-17T02:22:23.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:23.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.568053+0000", 2024-09-17T02:22:23.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1179999999999998e-06 2024-09-17T02:22:23.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.568060+0000", 2024-09-17T02:22:23.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6820000000000003e-06 2024-09-17T02:22:23.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:23.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.576949+0000", 2024-09-17T02:22:23.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0088892650000000004 2024-09-17T02:22:23.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:23.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.577080+0000", 2024-09-17T02:22:23.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130908 2024-09-17T02:22:23.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:23.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.597391+0000", 2024-09-17T02:22:23.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020310987999999999 2024-09-17T02:22:23.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:23.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.597420+0000", 2024-09-17T02:22:23.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9070000000000001e-05 2024-09-17T02:22:23.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:23.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:23.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:23.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.597493+0000", 2024-09-17T02:22:23.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2812999999999996e-05 2024-09-17T02:22:23.797 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.797 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:23.797 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.797 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:23.797 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:23.797 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:23.799 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:23.799 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:23.798+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:23.899 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:23.899+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:23.950 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:23.950 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:22:23.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.950 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:232965 5.0 e70/26 5:04a6cd69:::benchmark_data_smithi001_23533_object104848:head v 70'14522, mlcod=70'14519)", 2024-09-17T02:22:23.950 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:23.949824+0000", 2024-09-17T02:22:23.950 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0026137930000000001, 2024-09-17T02:22:23.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002636237, 2024-09-17T02:22:23.951 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:23.951 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:23.951 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:23.951 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:23.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:23.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.949824+0000", 2024-09-17T02:22:23.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:23.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:23.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.949824+0000", 2024-09-17T02:22:23.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:23.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:23.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.949825+0000", 2024-09-17T02:22:23.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8200000000000001e-07 2024-09-17T02:22:23.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:23.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.949828+0000", 2024-09-17T02:22:23.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4570000000000001e-06 2024-09-17T02:22:23.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:23.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.949835+0000", 2024-09-17T02:22:23.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9550000000000003e-06 2024-09-17T02:22:23.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.949851+0000", 2024-09-17T02:22:23.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5569e-05 2024-09-17T02:22:23.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:23.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.949898+0000", 2024-09-17T02:22:23.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7577000000000002e-05 2024-09-17T02:22:23.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:23.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.949921+0000", 2024-09-17T02:22:23.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3383999999999998e-05 2024-09-17T02:22:23.954 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:23.954 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:23.954 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:23.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.954 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:232968 5.d 5:bfcade0c:::benchmark_data_smithi001_23533_object104851:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-17T02:22:23.954 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:23.949887+0000", 2024-09-17T02:22:23.954 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0025512180000000001, 2024-09-17T02:22:23.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026473379999999999, 2024-09-17T02:22:23.954 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:23.955 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:23.955 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:23.955 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:23.955 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:23.955 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:23.955 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 232968 2024-09-17T02:22:23.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.955 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:23.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:23.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.949887+0000", 2024-09-17T02:22:23.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:23.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:23.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.949887+0000", 2024-09-17T02:22:23.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:23.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:23.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.949888+0000", 2024-09-17T02:22:23.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6300000000000005e-07 2024-09-17T02:22:23.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:23.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.949891+0000", 2024-09-17T02:22:23.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5779999999999999e-06 2024-09-17T02:22:23.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:23.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.949900+0000", 2024-09-17T02:22:23.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9029999999999993e-06 2024-09-17T02:22:23.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.949907+0000", 2024-09-17T02:22:23.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.968e-06 2024-09-17T02:22:23.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:23.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.949959+0000", 2024-09-17T02:22:23.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1638000000000003e-05 2024-09-17T02:22:23.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:23.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950080+0000", 2024-09-17T02:22:23.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121433 2024-09-17T02:22:23.958 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:23.958 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:23.958 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:23.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.958 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:232970 5.d 5:be9b1e97:::benchmark_data_smithi001_23533_object104853:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-17T02:22:23.959 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:23.950143+0000", 2024-09-17T02:22:23.959 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0022949120000000001, 2024-09-17T02:22:23.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024677499999999999, 2024-09-17T02:22:23.959 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:23.959 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:23.959 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:23.959 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:23.959 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:23.959 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:23.959 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 232970 2024-09-17T02:22:23.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.959 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:23.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:23.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950143+0000", 2024-09-17T02:22:23.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:23.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:23.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950143+0000", 2024-09-17T02:22:23.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:23.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:23.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950144+0000", 2024-09-17T02:22:23.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2200000000000003e-07 2024-09-17T02:22:23.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:23.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950148+0000", 2024-09-17T02:22:23.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5829999999999998e-06 2024-09-17T02:22:23.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:23.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950160+0000", 2024-09-17T02:22:23.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2162e-05 2024-09-17T02:22:23.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950167+0000", 2024-09-17T02:22:23.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.661e-06 2024-09-17T02:22:23.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:23.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.951783+0000", 2024-09-17T02:22:23.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016152009999999999 2024-09-17T02:22:23.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:23.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.951892+0000", 2024-09-17T02:22:23.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109382 2024-09-17T02:22:23.962 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:23.962 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:23.963 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:23.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.963 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:232971 5.d 5.42ebc00d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-17T02:22:23.963 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:23.950292+0000", 2024-09-17T02:22:23.963 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.002145657, 2024-09-17T02:22:23.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023897480000000001, 2024-09-17T02:22:23.963 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:23.963 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:23.963 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:23.963 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:23.963 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:23.963 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:23.963 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 232971 2024-09-17T02:22:23.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.964 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:23.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:23.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950292+0000", 2024-09-17T02:22:23.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:23.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:23.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950292+0000", 2024-09-17T02:22:23.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:23.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:23.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950293+0000", 2024-09-17T02:22:23.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4600000000000003e-07 2024-09-17T02:22:23.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:23.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950297+0000", 2024-09-17T02:22:23.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1999999999999996e-06 2024-09-17T02:22:23.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:23.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950307+0000", 2024-09-17T02:22:23.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9569999999999997e-06 2024-09-17T02:22:23.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950316+0000", 2024-09-17T02:22:23.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5019999999999992e-06 2024-09-17T02:22:23.966 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:23.966 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:23.966 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:23.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.966 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:232973 5.b 5:d454f317:::benchmark_data_smithi001_23533_object104856:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-17T02:22:23.966 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:23.950506+0000", 2024-09-17T02:22:23.966 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.001931999, 2024-09-17T02:22:23.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022367649999999999, 2024-09-17T02:22:23.967 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:23.967 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:23.967 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:23.967 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:23.967 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:23.967 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:23.967 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 232973 2024-09-17T02:22:23.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.967 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:23.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:23.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950506+0000", 2024-09-17T02:22:23.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:23.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:23.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950506+0000", 2024-09-17T02:22:23.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:23.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:23.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950507+0000", 2024-09-17T02:22:23.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2200000000000002e-07 2024-09-17T02:22:23.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:23.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950511+0000", 2024-09-17T02:22:23.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.16e-06 2024-09-17T02:22:23.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:23.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950522+0000", 2024-09-17T02:22:23.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0519e-05 2024-09-17T02:22:23.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950529+0000", 2024-09-17T02:22:23.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1640000000000004e-06 2024-09-17T02:22:23.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:23.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950576+0000", 2024-09-17T02:22:23.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7559000000000003e-05 2024-09-17T02:22:23.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:23.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950686+0000", 2024-09-17T02:22:23.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010992 2024-09-17T02:22:23.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:23.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950791+0000", 2024-09-17T02:22:23.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000104196 2024-09-17T02:22:23.971 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:23.971 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:23.971 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:23.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.971 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:232974 5.1 5:86756af9:::benchmark_data_smithi001_23533_object104857:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-17T02:22:23.971 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:23.950717+0000", 2024-09-17T02:22:23.972 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0017206630000000001, 2024-09-17T02:22:23.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020975429999999999, 2024-09-17T02:22:23.972 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:23.972 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:23.972 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:23.972 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:23.972 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:23.972 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:23.972 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 232974 2024-09-17T02:22:23.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.972 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:23.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:23.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950717+0000", 2024-09-17T02:22:23.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:23.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:23.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950717+0000", 2024-09-17T02:22:23.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:23.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:23.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950718+0000", 2024-09-17T02:22:23.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5300000000000003e-07 2024-09-17T02:22:23.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:23.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950722+0000", 2024-09-17T02:22:23.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0770000000000001e-06 2024-09-17T02:22:23.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:23.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950733+0000", 2024-09-17T02:22:23.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0331e-05 2024-09-17T02:22:23.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950740+0000", 2024-09-17T02:22:23.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5209999999999997e-06 2024-09-17T02:22:23.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:23.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.952347+0000", 2024-09-17T02:22:23.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016070100000000001 2024-09-17T02:22:23.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:23.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.952469+0000", 2024-09-17T02:22:23.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000122266 2024-09-17T02:22:23.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:23.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.952584+0000", 2024-09-17T02:22:23.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114636 2024-09-17T02:22:23.976 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:23.976 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:23.976 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:23.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.976 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:232975 5.3 5.112c7dd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-17T02:22:23.976 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:23.950868+0000", 2024-09-17T02:22:23.976 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0015705560000000001, 2024-09-17T02:22:23.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020168719999999998, 2024-09-17T02:22:23.976 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:23.976 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:23.977 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:23.977 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:23.977 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:23.977 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:23.977 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 232975 2024-09-17T02:22:23.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.977 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:23.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:23.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950868+0000", 2024-09-17T02:22:23.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:23.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:23.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950868+0000", 2024-09-17T02:22:23.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:23.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:23.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950868+0000", 2024-09-17T02:22:23.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3399999999999999e-07 2024-09-17T02:22:23.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:23.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950872+0000", 2024-09-17T02:22:23.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4460000000000001e-06 2024-09-17T02:22:23.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:23.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950881+0000", 2024-09-17T02:22:23.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0780000000000002e-06 2024-09-17T02:22:23.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950888+0000", 2024-09-17T02:22:23.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8189999999999992e-06 2024-09-17T02:22:23.979 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:23.979 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:23.979 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:23.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.979 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:232969 5.8 e70/26 5:1461353f:::benchmark_data_smithi001_23533_object104852:head v 70'14774, mlcod=70'14772)", 2024-09-17T02:22:23.979 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:23.951184+0000", 2024-09-17T02:22:23.980 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.001253589, 2024-09-17T02:22:23.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001756089, 2024-09-17T02:22:23.980 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:23.980 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:23.980 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:23.980 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:23.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:23.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.951184+0000", 2024-09-17T02:22:23.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:23.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:23.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.951184+0000", 2024-09-17T02:22:23.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:23.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:23.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.951185+0000", 2024-09-17T02:22:23.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8999999999999996e-07 2024-09-17T02:22:23.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:23.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.951189+0000", 2024-09-17T02:22:23.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2910000000000001e-06 2024-09-17T02:22:23.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:23.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.951198+0000", 2024-09-17T02:22:23.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8009999999999993e-06 2024-09-17T02:22:23.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.951204+0000", 2024-09-17T02:22:23.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.536e-06 2024-09-17T02:22:23.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:23.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.951291+0000", 2024-09-17T02:22:23.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7027000000000006e-05 2024-09-17T02:22:23.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:23.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.951308+0000", 2024-09-17T02:22:23.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6793e-05 2024-09-17T02:22:23.983 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:23.983 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:23.983 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:23.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.983 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:232977 5.1 5.a26e1911 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-17T02:22:23.983 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:23.951235+0000", 2024-09-17T02:22:23.984 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0012028469999999999, 2024-09-17T02:22:23.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017646929999999999, 2024-09-17T02:22:23.984 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:23.984 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:23.984 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:23.984 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:23.984 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:23.984 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:23.984 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 232977 2024-09-17T02:22:23.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.984 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:23.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:23.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.951235+0000", 2024-09-17T02:22:23.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:23.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:23.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.951235+0000", 2024-09-17T02:22:23.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:23.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:23.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.951236+0000", 2024-09-17T02:22:23.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3799999999999997e-07 2024-09-17T02:22:23.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:23.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.951239+0000", 2024-09-17T02:22:23.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8480000000000001e-06 2024-09-17T02:22:23.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:23.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.951247+0000", 2024-09-17T02:22:23.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2099999999999993e-06 2024-09-17T02:22:23.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.951253+0000", 2024-09-17T02:22:23.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7429999999999999e-06 2024-09-17T02:22:23.987 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:23.987 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:23.987 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:23.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.987 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:232958 5.1 5:8e2fba3b:::benchmark_data_smithi001_23533_object104841:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-17T02:22:23.987 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:23.943493+0000", 2024-09-17T02:22:23.987 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0089454649999999997, 2024-09-17T02:22:23.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0095635809999999998, 2024-09-17T02:22:23.987 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:23.987 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:23.987 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:23.987 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:23.988 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:23.988 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:23.988 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 232958 2024-09-17T02:22:23.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.988 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:23.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:23.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.943493+0000", 2024-09-17T02:22:23.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:23.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:23.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.943493+0000", 2024-09-17T02:22:23.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:23.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:23.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.943493+0000", 2024-09-17T02:22:23.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8899999999999998e-07 2024-09-17T02:22:23.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:23.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.943497+0000", 2024-09-17T02:22:23.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:22:23.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:23.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.943506+0000", 2024-09-17T02:22:23.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8969999999999997e-06 2024-09-17T02:22:23.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.943517+0000", 2024-09-17T02:22:23.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0858e-05 2024-09-17T02:22:23.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:23.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.948312+0000", 2024-09-17T02:22:23.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047948069999999999 2024-09-17T02:22:23.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:23.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.948436+0000", 2024-09-17T02:22:23.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012397800000000001 2024-09-17T02:22:23.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:23.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.948569+0000", 2024-09-17T02:22:23.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013291900000000001 2024-09-17T02:22:23.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:23.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.952307+0000", 2024-09-17T02:22:23.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037383519999999999 2024-09-17T02:22:23.992 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:23.992 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:23.992 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:23.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.992 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:232963 5.e 5:712a927a:::benchmark_data_smithi001_23533_object104846:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-17T02:22:23.992 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:23.946646+0000", 2024-09-17T02:22:23.992 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0057918459999999998, 2024-09-17T02:22:23.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064871979999999996, 2024-09-17T02:22:23.992 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:23.992 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:23.992 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:23.992 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:23.993 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:23.993 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:23.993 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 232963 2024-09-17T02:22:23.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.993 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:23.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:23.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.946646+0000", 2024-09-17T02:22:23.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:23.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:23.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.946646+0000", 2024-09-17T02:22:23.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:23.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:23.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.946647+0000", 2024-09-17T02:22:23.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8800000000000003e-07 2024-09-17T02:22:23.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:23.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.946649+0000", 2024-09-17T02:22:23.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3999999999999999e-06 2024-09-17T02:22:23.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:23.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.946655+0000", 2024-09-17T02:22:23.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.319e-06 2024-09-17T02:22:23.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:23.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.946660+0000", 2024-09-17T02:22:23.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1529999999999999e-06 2024-09-17T02:22:23.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:23.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.946921+0000", 2024-09-17T02:22:23.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026117799999999999 2024-09-17T02:22:23.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:23.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.947067+0000", 2024-09-17T02:22:23.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000146663 2024-09-17T02:22:23.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:23.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.947200+0000", 2024-09-17T02:22:23.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013293800000000001 2024-09-17T02:22:23.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:23.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.948804+0000", 2024-09-17T02:22:23.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001603365 2024-09-17T02:22:23.997 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:23.997 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:23.997 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:23.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.997 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:232964 5.3 5:cdb33c29:::benchmark_data_smithi001_23533_object104847:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-17T02:22:23.997 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:23.948495+0000", 2024-09-17T02:22:23.997 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0039425939999999998, 2024-09-17T02:22:23.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047157880000000003, 2024-09-17T02:22:23.998 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:23.998 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:23.998 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:23.998 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:23.998 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:23.998 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:23.998 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 232964 2024-09-17T02:22:23.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.998 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:23.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:23.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.948495+0000", 2024-09-17T02:22:23.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:23.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:23.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.948495+0000", 2024-09-17T02:22:23.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:23.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:23.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:23.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.948496+0000", 2024-09-17T02:22:23.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.09e-07 2024-09-17T02:22:23.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:23.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:24.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.948501+0000", 2024-09-17T02:22:24.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.527e-06 2024-09-17T02:22:24.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:24.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.948513+0000", 2024-09-17T02:22:24.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1984000000000001e-05 2024-09-17T02:22:24.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.948521+0000", 2024-09-17T02:22:24.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3359999999999995e-06 2024-09-17T02:22:24.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.949668+0000", 2024-09-17T02:22:24.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001146425 2024-09-17T02:22:24.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:24.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.949823+0000", 2024-09-17T02:22:24.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000155332 2024-09-17T02:22:24.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:24.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.949972+0000", 2024-09-17T02:22:24.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014939700000000001 2024-09-17T02:22:24.002 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.002 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:24.002 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.002 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:232966 5.1 5:8d1543fc:::benchmark_data_smithi001_23533_object104849:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-17T02:22:24.002 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:23.949646+0000", 2024-09-17T02:22:24.002 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0027920319999999998, 2024-09-17T02:22:24.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036387239999999999, 2024-09-17T02:22:24.002 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:24.002 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:24.002 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:24.003 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:24.003 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:24.003 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.003 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 232966 2024-09-17T02:22:24.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.003 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:24.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:24.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.949646+0000", 2024-09-17T02:22:24.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:24.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.949646+0000", 2024-09-17T02:22:24.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:24.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.949647+0000", 2024-09-17T02:22:24.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2600000000000002e-07 2024-09-17T02:22:24.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:24.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.949651+0000", 2024-09-17T02:22:24.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.985e-06 2024-09-17T02:22:24.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:24.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.949660+0000", 2024-09-17T02:22:24.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2019999999999993e-06 2024-09-17T02:22:24.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.949668+0000", 2024-09-17T02:22:24.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0169999999999996e-06 2024-09-17T02:22:24.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950619+0000", 2024-09-17T02:22:24.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095102999999999995 2024-09-17T02:22:24.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:24.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950739+0000", 2024-09-17T02:22:24.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011964 2024-09-17T02:22:24.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:24.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:23.950855+0000", 2024-09-17T02:22:24.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116527 2024-09-17T02:22:24.006 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.006 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:24.006 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.006 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.006 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:22:24.006 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 13 2024-09-17T02:22:24.007 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:24.008 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:24.007+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:24.008 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:24.108 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:24.106+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:24.158 INFO:teuthology.orchestra.run.smithi001.stderr:noscrub is unset 2024-09-17T02:22:24.164 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:24.164 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:22:24.164 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:22:24.164 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:22:24.164 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:24.185 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:24.210 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:24.211+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:24.311 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:24.311+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:24.381 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:24.381 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:22:24.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:22:24.381 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:22:24.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.381 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97749 5.b 5:d930ef52:::benchmark_data_smithi001_23533_object97748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:24.381 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:24.382 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 66.790377239999998, 2024-09-17T02:22:24.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092964343000000005, 2024-09-17T02:22:24.382 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:24.382 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:24.382 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:24.382 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:24.382 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:24.382 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.382 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97749 2024-09-17T02:22:24.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.382 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:24.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:24.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:24.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:24.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:24.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:24.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591947+0000", 2024-09-17T02:22:24.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:22:24.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:24.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592011+0000", 2024-09-17T02:22:24.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3608000000000005e-05 2024-09-17T02:22:24.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:24.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592021+0000", 2024-09-17T02:22:24.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9979999999999998e-06 2024-09-17T02:22:24.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592028+0000", 2024-09-17T02:22:24.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1439999999999997e-06 2024-09-17T02:22:24.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593633+0000", 2024-09-17T02:22:24.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001604636 2024-09-17T02:22:24.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:24.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593757+0000", 2024-09-17T02:22:24.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012432099999999999 2024-09-17T02:22:24.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:24.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593866+0000", 2024-09-17T02:22:24.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109094 2024-09-17T02:22:24.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:24.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601190+0000", 2024-09-17T02:22:24.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073237620000000002 2024-09-17T02:22:24.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:24.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601356+0000", 2024-09-17T02:22:24.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016651900000000001 2024-09-17T02:22:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684618+0000", 2024-09-17T02:22:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083261356999999994 2024-09-17T02:22:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684724+0000", 2024-09-17T02:22:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010681800000000001 2024-09-17T02:22:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:24.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684911+0000", 2024-09-17T02:22:24.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186243 2024-09-17T02:22:24.388 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.388 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:24.388 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.388 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97752 5.b 5:d146f486:::benchmark_data_smithi001_23533_object97751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:24.388 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:24.388 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 66.789024545999993, 2024-09-17T02:22:24.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091989557, 2024-09-17T02:22:24.388 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:24.388 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:24.389 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:24.389 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:24.389 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:24.389 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.389 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97752 2024-09-17T02:22:24.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.389 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:24.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:24.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:24.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:24.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:24.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:24.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593300+0000", 2024-09-17T02:22:24.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8199999999999998e-07 2024-09-17T02:22:24.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:24.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593364+0000", 2024-09-17T02:22:24.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3831999999999995e-05 2024-09-17T02:22:24.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:24.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593376+0000", 2024-09-17T02:22:24.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1800999999999999e-05 2024-09-17T02:22:24.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593382+0000", 2024-09-17T02:22:24.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6780000000000003e-06 2024-09-17T02:22:24.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595491+0000", 2024-09-17T02:22:24.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021090689999999999 2024-09-17T02:22:24.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:24.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595614+0000", 2024-09-17T02:22:24.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012321500000000001 2024-09-17T02:22:24.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:24.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595778+0000", 2024-09-17T02:22:24.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016321900000000001 2024-09-17T02:22:24.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:24.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601197+0000", 2024-09-17T02:22:24.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054195600000000003 2024-09-17T02:22:24.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:24.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601396+0000", 2024-09-17T02:22:24.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019825299999999999 2024-09-17T02:22:24.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:24.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684990+0000", 2024-09-17T02:22:24.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083594878999999997 2024-09-17T02:22:24.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:24.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685116+0000", 2024-09-17T02:22:24.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012522799999999999 2024-09-17T02:22:24.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:24.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685289+0000", 2024-09-17T02:22:24.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172941 2024-09-17T02:22:24.395 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.395 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:24.395 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.395 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97754 5.b 5:da0615e5:::benchmark_data_smithi001_23533_object97753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:24.395 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:24.395 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 66.787386624000007, 2024-09-17T02:22:24.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092097207, 2024-09-17T02:22:24.395 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:24.395 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:24.395 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:24.395 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:24.395 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:24.396 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.396 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97754 2024-09-17T02:22:24.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.396 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:24.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:24.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:24.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:24.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:24.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594938+0000", 2024-09-17T02:22:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5000000000000002e-07 2024-09-17T02:22:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595075+0000", 2024-09-17T02:22:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137742 2024-09-17T02:22:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:24.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595087+0000", 2024-09-17T02:22:24.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1243000000000001e-05 2024-09-17T02:22:24.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595095+0000", 2024-09-17T02:22:24.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1030000000000002e-06 2024-09-17T02:22:24.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598461+0000", 2024-09-17T02:22:24.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033661170000000001 2024-09-17T02:22:24.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:24.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598540+0000", 2024-09-17T02:22:24.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8937999999999995e-05 2024-09-17T02:22:24.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:24.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598626+0000", 2024-09-17T02:22:24.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6042000000000001e-05 2024-09-17T02:22:24.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:24.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684258+0000", 2024-09-17T02:22:24.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085632394000000001 2024-09-17T02:22:24.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:24.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685369+0000", 2024-09-17T02:22:24.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001111063 2024-09-17T02:22:24.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:24.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685511+0000", 2024-09-17T02:22:24.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141965 2024-09-17T02:22:24.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:24.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685604+0000", 2024-09-17T02:22:24.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2935000000000004e-05 2024-09-17T02:22:24.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:24.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687034+0000", 2024-09-17T02:22:24.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001430015 2024-09-17T02:22:24.401 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.401 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:24.401 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.402 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97755 5.b 5:d36a03a1:::benchmark_data_smithi001_23533_object97754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:24.402 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:24.402 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 66.787213473999998, 2024-09-17T02:22:24.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0924904, 2024-09-17T02:22:24.402 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:24.402 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:24.402 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:24.402 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:24.402 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:24.403 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.403 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97755 2024-09-17T02:22:24.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.403 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:24.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:24.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:24.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:24.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:24.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:24.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595111+0000", 2024-09-17T02:22:24.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:22:24.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:24.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595145+0000", 2024-09-17T02:22:24.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3927000000000002e-05 2024-09-17T02:22:24.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:24.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595155+0000", 2024-09-17T02:22:24.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0023e-05 2024-09-17T02:22:24.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595162+0000", 2024-09-17T02:22:24.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3950000000000003e-06 2024-09-17T02:22:24.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599821+0000", 2024-09-17T02:22:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046592880000000001 2024-09-17T02:22:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599912+0000", 2024-09-17T02:22:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1049000000000002e-05 2024-09-17T02:22:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600062+0000", 2024-09-17T02:22:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015001700000000001 2024-09-17T02:22:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685307+0000", 2024-09-17T02:22:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085244340000000002 2024-09-17T02:22:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685446+0000", 2024-09-17T02:22:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013955700000000001 2024-09-17T02:22:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687375+0000", 2024-09-17T02:22:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019291079999999999 2024-09-17T02:22:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687462+0000", 2024-09-17T02:22:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6148000000000003e-05 2024-09-17T02:22:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687600+0000", 2024-09-17T02:22:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013887900000000001 2024-09-17T02:22:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 44/44 lb 5:c4567a04:::benchmark_data_smithi001_23533_object4200:head)", 2024-09-17T02:22:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 66.785116848000001, 2024-09-17T02:22:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092483421999999996, 2024-09-17T02:22:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6399999999999998e-07 2024-09-17T02:22:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597213+0000", 2024-09-17T02:22:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3659999999999997e-06 2024-09-17T02:22:24.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:24.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597222+0000", 2024-09-17T02:22:24.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0510000000000002e-06 2024-09-17T02:22:24.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597228+0000", 2024-09-17T02:22:24.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1569999999999999e-06 2024-09-17T02:22:24.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689588+0000", 2024-09-17T02:22:24.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092359931000000006 2024-09-17T02:22:24.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:24.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689622+0000", 2024-09-17T02:22:24.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4425999999999999e-05 2024-09-17T02:22:24.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:24.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689690+0000", 2024-09-17T02:22:24.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8126999999999993e-05 2024-09-17T02:22:24.412 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.413 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:24.413 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.413 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129462 5.4 5:2e0acc16:::benchmark_data_smithi001_23533_object1345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:24.413 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:24.413 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.847382779, 2024-09-17T02:22:24.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0112774899999999, 2024-09-17T02:22:24.413 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:24.413 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129462 2024-09-17T02:22:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:24.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:24.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:24.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534943+0000", 2024-09-17T02:22:24.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8759999999999999e-06 2024-09-17T02:22:24.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:24.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534951+0000", 2024-09-17T02:22:24.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3219999999999993e-06 2024-09-17T02:22:24.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:24.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534977+0000", 2024-09-17T02:22:24.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6245e-05 2024-09-17T02:22:24.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534992+0000", 2024-09-17T02:22:24.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4936000000000001e-05 2024-09-17T02:22:24.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535133+0000", 2024-09-17T02:22:24.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014051299999999999 2024-09-17T02:22:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:22:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1741000000000001e-05 2024-09-17T02:22:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.533906+0000", 2024-09-17T02:22:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99875209300000001 2024-09-17T02:22:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534348+0000", 2024-09-17T02:22:24.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044128899999999998 2024-09-17T02:22:24.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:24.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534762+0000", 2024-09-17T02:22:24.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000414707 2024-09-17T02:22:24.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:24.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545024+0000", 2024-09-17T02:22:24.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010261283 2024-09-17T02:22:24.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:24.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545953+0000", 2024-09-17T02:22:24.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000929618 2024-09-17T02:22:24.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:24.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546047+0000", 2024-09-17T02:22:24.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3697999999999996e-05 2024-09-17T02:22:24.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:24.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546218+0000", 2024-09-17T02:22:24.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017116899999999999 2024-09-17T02:22:24.419 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.420 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:24.420 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.420 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129480 5.4 5:2b1d398b:::benchmark_data_smithi001_23533_object1363:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:24.420 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:24.420 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.839628312999999, 2024-09-17T02:22:24.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0038926450000001, 2024-09-17T02:22:24.420 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:24.420 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:24.420 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:24.420 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:24.420 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:24.421 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.421 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129480 2024-09-17T02:22:24.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.421 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:24.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:24.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:24.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:24.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:24.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:24.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542696+0000", 2024-09-17T02:22:24.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9999999999999995e-07 2024-09-17T02:22:24.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:24.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542701+0000", 2024-09-17T02:22:24.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2240000000000003e-06 2024-09-17T02:22:24.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:24.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542716+0000", 2024-09-17T02:22:24.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4970000000000001e-05 2024-09-17T02:22:24.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542726+0000", 2024-09-17T02:22:24.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2879999999999998e-06 2024-09-17T02:22:24.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542832+0000", 2024-09-17T02:22:24.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010597199999999999 2024-09-17T02:22:24.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:24.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542843+0000", 2024-09-17T02:22:24.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.098e-05 2024-09-17T02:22:24.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538436+0000", 2024-09-17T02:22:24.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99559286800000002 2024-09-17T02:22:24.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:24.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538791+0000", 2024-09-17T02:22:24.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035585499999999997 2024-09-17T02:22:24.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:24.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.539144+0000", 2024-09-17T02:22:24.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035268499999999999 2024-09-17T02:22:24.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:24.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545880+0000", 2024-09-17T02:22:24.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00673552 2024-09-17T02:22:24.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:24.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546330+0000", 2024-09-17T02:22:24.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045039599999999999 2024-09-17T02:22:24.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:24.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546414+0000", 2024-09-17T02:22:24.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4468000000000005e-05 2024-09-17T02:22:24.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:24.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546588+0000", 2024-09-17T02:22:24.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017341899999999999 2024-09-17T02:22:24.426 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.427 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:24.427 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.427 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129505 5.4 5:294f2ec7:::benchmark_data_smithi001_23533_object1388:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:24.427 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:24.427 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.820615140000001, 2024-09-17T02:22:24.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98589826199999997, 2024-09-17T02:22:24.427 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:24.427 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:24.427 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:24.427 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:24.427 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:24.428 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.428 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129505 2024-09-17T02:22:24.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.428 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:24.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:24.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:24.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:24.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561710+0000", 2024-09-17T02:22:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7060000000000001e-06 2024-09-17T02:22:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561718+0000", 2024-09-17T02:22:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.542e-06 2024-09-17T02:22:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:24.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561741+0000", 2024-09-17T02:22:24.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3357e-05 2024-09-17T02:22:24.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561754+0000", 2024-09-17T02:22:24.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3200000000000001e-05 2024-09-17T02:22:24.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561867+0000", 2024-09-17T02:22:24.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113211 2024-09-17T02:22:24.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561888+0000", 2024-09-17T02:22:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0809999999999999e-05 2024-09-17T02:22:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542140+0000", 2024-09-17T02:22:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98025195799999998 2024-09-17T02:22:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542331+0000", 2024-09-17T02:22:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019127599999999999 2024-09-17T02:22:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:24.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542517+0000", 2024-09-17T02:22:24.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000185625 2024-09-17T02:22:24.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:24.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547114+0000", 2024-09-17T02:22:24.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045968620000000002 2024-09-17T02:22:24.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:24.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547187+0000", 2024-09-17T02:22:24.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3348000000000003e-05 2024-09-17T02:22:24.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:24.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547324+0000", 2024-09-17T02:22:24.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013681699999999999 2024-09-17T02:22:24.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:24.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547607+0000", 2024-09-17T02:22:24.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028255000000000001 2024-09-17T02:22:24.433 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.433 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:24.434 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.434 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129508 5.4 5:2892b582:::benchmark_data_smithi001_23533_object1391:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:24.434 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:24.434 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.819278046999997, 2024-09-17T02:22:24.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99697919099999999, 2024-09-17T02:22:24.434 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:24.434 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:24.434 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:24.434 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:24.434 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:24.434 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.434 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129508 2024-09-17T02:22:24.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.435 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:24.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:24.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:24.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:24.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:24.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563047+0000", 2024-09-17T02:22:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.274e-06 2024-09-17T02:22:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563054+0000", 2024-09-17T02:22:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2799999999999998e-06 2024-09-17T02:22:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563070+0000", 2024-09-17T02:22:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5991999999999999e-05 2024-09-17T02:22:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563078+0000", 2024-09-17T02:22:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2390000000000002e-06 2024-09-17T02:22:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563181+0000", 2024-09-17T02:22:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102249 2024-09-17T02:22:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563199+0000", 2024-09-17T02:22:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8215000000000001e-05 2024-09-17T02:22:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547713+0000", 2024-09-17T02:22:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98451446399999998 2024-09-17T02:22:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548063+0000", 2024-09-17T02:22:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034985499999999999 2024-09-17T02:22:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548490+0000", 2024-09-17T02:22:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042658600000000001 2024-09-17T02:22:24.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:24.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555655+0000", 2024-09-17T02:22:24.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071652579999999999 2024-09-17T02:22:24.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:24.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559612+0000", 2024-09-17T02:22:24.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003957103 2024-09-17T02:22:24.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:24.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559768+0000", 2024-09-17T02:22:24.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015556899999999999 2024-09-17T02:22:24.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:24.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560025+0000", 2024-09-17T02:22:24.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025710700000000002 2024-09-17T02:22:24.440 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.440 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:24.440 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.441 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129509 5.4 5:2c35515e:::benchmark_data_smithi001_23533_object1392:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:24.441 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:24.441 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.818650994000002, 2024-09-17T02:22:24.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99969384900000002, 2024-09-17T02:22:24.441 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:24.441 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:24.441 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:24.441 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:24.441 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:24.441 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.441 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129509 2024-09-17T02:22:24.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.441 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:24.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:24.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:24.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:24.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:24.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:24.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563674+0000", 2024-09-17T02:22:24.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0920000000000001e-06 2024-09-17T02:22:24.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:24.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563679+0000", 2024-09-17T02:22:24.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7660000000000004e-06 2024-09-17T02:22:24.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:24.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563693+0000", 2024-09-17T02:22:24.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3139000000000001e-05 2024-09-17T02:22:24.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563701+0000", 2024-09-17T02:22:24.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9859999999999994e-06 2024-09-17T02:22:24.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563775+0000", 2024-09-17T02:22:24.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4659000000000005e-05 2024-09-17T02:22:24.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:24.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563785+0000", 2024-09-17T02:22:24.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4839999999999993e-06 2024-09-17T02:22:24.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552085+0000", 2024-09-17T02:22:24.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98829986999999997 2024-09-17T02:22:24.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:24.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552554+0000", 2024-09-17T02:22:24.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046908900000000001 2024-09-17T02:22:24.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:24.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552931+0000", 2024-09-17T02:22:24.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377778 2024-09-17T02:22:24.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:24.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563106+0000", 2024-09-17T02:22:24.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010174186 2024-09-17T02:22:24.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:24.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563138+0000", 2024-09-17T02:22:24.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2495e-05 2024-09-17T02:22:24.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:24.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563225+0000", 2024-09-17T02:22:24.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6677999999999999e-05 2024-09-17T02:22:24.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:24.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563366+0000", 2024-09-17T02:22:24.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014162699999999999 2024-09-17T02:22:24.447 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.447 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:24.447 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.447 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129524 5.4 5:25dca7dd:::benchmark_data_smithi001_23533_object1407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:24.448 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:24.448 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.811959639999998, 2024-09-17T02:22:24.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99999501999999996, 2024-09-17T02:22:24.448 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:24.448 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:24.448 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:24.448 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:24.448 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:24.448 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.448 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129524 2024-09-17T02:22:24.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.448 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:24.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:24.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:24.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:24.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:24.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:24.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570365+0000", 2024-09-17T02:22:24.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.142e-06 2024-09-17T02:22:24.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:24.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570369+0000", 2024-09-17T02:22:24.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.856e-06 2024-09-17T02:22:24.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:24.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570385+0000", 2024-09-17T02:22:24.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5855e-05 2024-09-17T02:22:24.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570392+0000", 2024-09-17T02:22:24.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5340000000000002e-06 2024-09-17T02:22:24.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570484+0000", 2024-09-17T02:22:24.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1212999999999996e-05 2024-09-17T02:22:24.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:24.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570498+0000", 2024-09-17T02:22:24.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4331000000000001e-05 2024-09-17T02:22:24.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555835+0000", 2024-09-17T02:22:24.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98533757700000002 2024-09-17T02:22:24.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:24.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556329+0000", 2024-09-17T02:22:24.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000493458 2024-09-17T02:22:24.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:24.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556784+0000", 2024-09-17T02:22:24.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045476499999999999 2024-09-17T02:22:24.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:24.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569852+0000", 2024-09-17T02:22:24.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013068270999999999 2024-09-17T02:22:24.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:24.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569958+0000", 2024-09-17T02:22:24.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106214 2024-09-17T02:22:24.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:24.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570124+0000", 2024-09-17T02:22:24.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165546 2024-09-17T02:22:24.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:24.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570359+0000", 2024-09-17T02:22:24.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023525799999999999 2024-09-17T02:22:24.458 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.458 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:24.458 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.458 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129537 5.4 5:260327c6:::benchmark_data_smithi001_23533_object1420:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:24.458 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:24.459 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.804053111000002, 2024-09-17T02:22:24.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99624596499999996, 2024-09-17T02:22:24.459 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:24.459 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:24.459 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:24.459 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:24.459 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:24.459 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.459 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129537 2024-09-17T02:22:24.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.459 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:24.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:24.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:24.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:24.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:24.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:24.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578272+0000", 2024-09-17T02:22:24.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.164e-06 2024-09-17T02:22:24.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:24.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578278+0000", 2024-09-17T02:22:24.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5060000000000001e-06 2024-09-17T02:22:24.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:24.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578294+0000", 2024-09-17T02:22:24.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5687000000000001e-05 2024-09-17T02:22:24.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578329+0000", 2024-09-17T02:22:24.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5311999999999997e-05 2024-09-17T02:22:24.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578419+0000", 2024-09-17T02:22:24.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0054000000000002e-05 2024-09-17T02:22:24.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:24.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578435+0000", 2024-09-17T02:22:24.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5645999999999999e-05 2024-09-17T02:22:24.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560148+0000", 2024-09-17T02:22:24.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98171342299999997 2024-09-17T02:22:24.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:24.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560383+0000", 2024-09-17T02:22:24.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000234935 2024-09-17T02:22:24.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:24.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560586+0000", 2024-09-17T02:22:24.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000202909 2024-09-17T02:22:24.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:24.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570472+0000", 2024-09-17T02:22:24.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098856959999999994 2024-09-17T02:22:24.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:24.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574138+0000", 2024-09-17T02:22:24.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036660170000000001 2024-09-17T02:22:24.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:24.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574298+0000", 2024-09-17T02:22:24.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016025600000000001 2024-09-17T02:22:24.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:24.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574516+0000", 2024-09-17T02:22:24.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021835999999999999 2024-09-17T02:22:24.466 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.466 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:24.466 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.467 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129545 5.4 5:22366489:::benchmark_data_smithi001_23533_object1428:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:24.467 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:24.467 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.798190388000002, 2024-09-17T02:22:24.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99074544499999995, 2024-09-17T02:22:24.467 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:24.467 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:24.467 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:24.467 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:24.467 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:24.467 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.467 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129545 2024-09-17T02:22:24.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.467 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:24.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:24.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:24.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:24.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:24.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:24.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584135+0000", 2024-09-17T02:22:24.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4699999999999999e-06 2024-09-17T02:22:24.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:24.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584142+0000", 2024-09-17T02:22:24.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1620000000000002e-06 2024-09-17T02:22:24.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:24.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584170+0000", 2024-09-17T02:22:24.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7897000000000001e-05 2024-09-17T02:22:24.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584183+0000", 2024-09-17T02:22:24.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2814e-05 2024-09-17T02:22:24.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584299+0000", 2024-09-17T02:22:24.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116153 2024-09-17T02:22:24.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:24.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584316+0000", 2024-09-17T02:22:24.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7524999999999999e-05 2024-09-17T02:22:24.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563461+0000", 2024-09-17T02:22:24.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97914436699999996 2024-09-17T02:22:24.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:24.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563667+0000", 2024-09-17T02:22:24.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020689800000000001 2024-09-17T02:22:24.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:24.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563878+0000", 2024-09-17T02:22:24.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210275 2024-09-17T02:22:24.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:24.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570584+0000", 2024-09-17T02:22:24.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067066080000000002 2024-09-17T02:22:24.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:24.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574539+0000", 2024-09-17T02:22:24.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039550360000000003 2024-09-17T02:22:24.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:24.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574653+0000", 2024-09-17T02:22:24.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114003 2024-09-17T02:22:24.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:24.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574879+0000", 2024-09-17T02:22:24.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022523700000000001 2024-09-17T02:22:24.473 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.473 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:24.473 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.473 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129553 5.4 5:2e41ad40:::benchmark_data_smithi001_23533_object1436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:24.473 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:24.474 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.792767752000003, 2024-09-17T02:22:24.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99213429600000003, 2024-09-17T02:22:24.474 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:24.474 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:24.474 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:24.474 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:24.474 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:24.474 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.474 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129553 2024-09-17T02:22:24.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.474 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:24.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:24.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:24.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:24.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:24.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:24.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589557+0000", 2024-09-17T02:22:24.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2219999999999999e-06 2024-09-17T02:22:24.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:24.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589562+0000", 2024-09-17T02:22:24.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0649999999999998e-06 2024-09-17T02:22:24.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:24.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589575+0000", 2024-09-17T02:22:24.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3129000000000001e-05 2024-09-17T02:22:24.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589584+0000", 2024-09-17T02:22:24.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6200000000000005e-06 2024-09-17T02:22:24.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589693+0000", 2024-09-17T02:22:24.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109319 2024-09-17T02:22:24.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:24.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589714+0000", 2024-09-17T02:22:24.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0849999999999999e-05 2024-09-17T02:22:24.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566273+0000", 2024-09-17T02:22:24.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97655884999999998 2024-09-17T02:22:24.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:24.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566543+0000", 2024-09-17T02:22:24.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027059099999999998 2024-09-17T02:22:24.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:24.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566832+0000", 2024-09-17T02:22:24.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028898200000000002 2024-09-17T02:22:24.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:24.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581040+0000", 2024-09-17T02:22:24.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014208001 2024-09-17T02:22:24.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.480 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:24.480 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581200+0000", 2024-09-17T02:22:24.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159956 2024-09-17T02:22:24.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.480 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:24.480 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581427+0000", 2024-09-17T02:22:24.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000226309 2024-09-17T02:22:24.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.480 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:24.480 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581690+0000", 2024-09-17T02:22:24.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026340199999999998 2024-09-17T02:22:24.481 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.481 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:24.481 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.481 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129580 5.4 5:25ed887b:::benchmark_data_smithi001_23533_object1463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:24.481 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:24.481 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.770995708000001, 2024-09-17T02:22:24.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98001430499999997, 2024-09-17T02:22:24.481 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:24.481 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:24.482 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:24.482 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:24.482 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:24.482 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.482 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129580 2024-09-17T02:22:24.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.482 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:24.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:24.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:24.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:24.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:24.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:24.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611329+0000", 2024-09-17T02:22:24.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.22e-06 2024-09-17T02:22:24.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:24.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611335+0000", 2024-09-17T02:22:24.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1129999999999997e-06 2024-09-17T02:22:24.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:24.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611348+0000", 2024-09-17T02:22:24.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2342e-05 2024-09-17T02:22:24.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611356+0000", 2024-09-17T02:22:24.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.371e-06 2024-09-17T02:22:24.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611419+0000", 2024-09-17T02:22:24.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3393999999999996e-05 2024-09-17T02:22:24.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:24.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611427+0000", 2024-09-17T02:22:24.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999997e-06 2024-09-17T02:22:24.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570705+0000", 2024-09-17T02:22:24.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.95927859199999999 2024-09-17T02:22:24.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:24.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571009+0000", 2024-09-17T02:22:24.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030414599999999998 2024-09-17T02:22:24.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:24.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571241+0000", 2024-09-17T02:22:24.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023106799999999999 2024-09-17T02:22:24.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:24.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590789+0000", 2024-09-17T02:22:24.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019548763 2024-09-17T02:22:24.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:24.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590928+0000", 2024-09-17T02:22:24.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000139092 2024-09-17T02:22:24.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:24.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591086+0000", 2024-09-17T02:22:24.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015787400000000001 2024-09-17T02:22:24.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:24.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591342+0000", 2024-09-17T02:22:24.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025589900000000002 2024-09-17T02:22:24.487 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.487 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:24.487 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.488 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129603 5.4 5:25aaa5e8:::benchmark_data_smithi001_23533_object1486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:24.488 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:24.488 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.754935912000001, 2024-09-17T02:22:24.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96463198999999999, 2024-09-17T02:22:24.488 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:24.488 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:24.488 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:24.488 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:24.488 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:24.488 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.488 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129603 2024-09-17T02:22:24.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.489 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:24.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:24.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:24.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:24.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:24.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:24.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:24.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:22:24.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:24.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627392+0000", 2024-09-17T02:22:24.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0790000000000002e-06 2024-09-17T02:22:24.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:24.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627403+0000", 2024-09-17T02:22:24.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0866000000000001e-05 2024-09-17T02:22:24.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627409+0000", 2024-09-17T02:22:24.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.305e-06 2024-09-17T02:22:24.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627485+0000", 2024-09-17T02:22:24.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6582000000000006e-05 2024-09-17T02:22:24.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:24.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627499+0000", 2024-09-17T02:22:24.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:22:24.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574991+0000", 2024-09-17T02:22:24.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94749182300000001 2024-09-17T02:22:24.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:24.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575377+0000", 2024-09-17T02:22:24.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038629400000000003 2024-09-17T02:22:24.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.493 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:24.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575665+0000", 2024-09-17T02:22:24.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028759499999999997 2024-09-17T02:22:24.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.493 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:24.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590802+0000", 2024-09-17T02:22:24.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015136479 2024-09-17T02:22:24.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.493 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:24.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591614+0000", 2024-09-17T02:22:24.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081293100000000003 2024-09-17T02:22:24.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:24.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591764+0000", 2024-09-17T02:22:24.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014932199999999999 2024-09-17T02:22:24.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:24.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592020+0000", 2024-09-17T02:22:24.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025585099999999997 2024-09-17T02:22:24.494 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.494 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:24.495 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.495 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129607 5.4 5:2f638f1e:::benchmark_data_smithi001_23533_object1490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:24.495 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:24.495 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.753409005999998, 2024-09-17T02:22:24.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96352375899999998, 2024-09-17T02:22:24.495 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:24.495 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:24.495 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:24.495 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:24.495 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:24.495 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.496 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129607 2024-09-17T02:22:24.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.496 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:24.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:24.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:24.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:24.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:24.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:24.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628916+0000", 2024-09-17T02:22:24.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1710000000000001e-06 2024-09-17T02:22:24.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:24.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628920+0000", 2024-09-17T02:22:24.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-17T02:22:24.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:24.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628935+0000", 2024-09-17T02:22:24.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4474000000000001e-05 2024-09-17T02:22:24.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628944+0000", 2024-09-17T02:22:24.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9940000000000006e-06 2024-09-17T02:22:24.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628997+0000", 2024-09-17T02:22:24.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3579000000000003e-05 2024-09-17T02:22:24.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:24.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.629006+0000", 2024-09-17T02:22:24.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4009999999999997e-06 2024-09-17T02:22:24.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.577862+0000", 2024-09-17T02:22:24.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.948856335 2024-09-17T02:22:24.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:24.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578167+0000", 2024-09-17T02:22:24.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030532399999999999 2024-09-17T02:22:24.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:24.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578532+0000", 2024-09-17T02:22:24.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036428200000000001 2024-09-17T02:22:24.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:24.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591442+0000", 2024-09-17T02:22:24.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012910374000000001 2024-09-17T02:22:24.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:24.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592164+0000", 2024-09-17T02:22:24.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072242499999999996 2024-09-17T02:22:24.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:24.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592267+0000", 2024-09-17T02:22:24.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102205 2024-09-17T02:22:24.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:24.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592438+0000", 2024-09-17T02:22:24.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017165299999999999 2024-09-17T02:22:24.501 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.501 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:24.501 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.502 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129623 5.4 5:2cf5174b:::benchmark_data_smithi001_23533_object1506:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:24.502 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:24.502 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.729464720000003, 2024-09-17T02:22:24.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94334114499999999, 2024-09-17T02:22:24.502 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:24.502 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:24.502 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:24.502 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:24.502 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:24.502 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.502 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129623 2024-09-17T02:22:24.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.503 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:24.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:24.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:24.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:24.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:24.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:24.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652860+0000", 2024-09-17T02:22:24.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0330000000000001e-06 2024-09-17T02:22:24.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:24.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652864+0000", 2024-09-17T02:22:24.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.634e-06 2024-09-17T02:22:24.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:24.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652877+0000", 2024-09-17T02:22:24.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2591e-05 2024-09-17T02:22:24.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652883+0000", 2024-09-17T02:22:24.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1460000000000001e-06 2024-09-17T02:22:24.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652943+0000", 2024-09-17T02:22:24.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9833999999999997e-05 2024-09-17T02:22:24.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:24.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652950+0000", 2024-09-17T02:22:24.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.401e-06 2024-09-17T02:22:24.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581800+0000", 2024-09-17T02:22:24.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.92884935700000004 2024-09-17T02:22:24.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:24.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582122+0000", 2024-09-17T02:22:24.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032185200000000002 2024-09-17T02:22:24.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:24.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582689+0000", 2024-09-17T02:22:24.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056750400000000003 2024-09-17T02:22:24.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:24.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591458+0000", 2024-09-17T02:22:24.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008768685 2024-09-17T02:22:24.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:24.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595856+0000", 2024-09-17T02:22:24.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043977909999999999 2024-09-17T02:22:24.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:24.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595955+0000", 2024-09-17T02:22:24.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9166000000000006e-05 2024-09-17T02:22:24.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:24.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596200+0000", 2024-09-17T02:22:24.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024515099999999998 2024-09-17T02:22:24.508 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.509 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:24.509 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.509 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129642 5.4 5:255eb796:::benchmark_data_smithi001_23533_object1525:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:24.509 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:24.509 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.698228555999997, 2024-09-17T02:22:24.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.91257397299999998, 2024-09-17T02:22:24.509 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:24.509 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:24.509 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:24.509 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:24.510 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:24.510 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.510 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129642 2024-09-17T02:22:24.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.510 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:24.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:24.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:24.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:24.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:24.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:24.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684096+0000", 2024-09-17T02:22:24.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659999999999999e-06 2024-09-17T02:22:24.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:24.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684101+0000", 2024-09-17T02:22:24.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8110000000000002e-06 2024-09-17T02:22:24.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:24.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684114+0000", 2024-09-17T02:22:24.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2653000000000001e-05 2024-09-17T02:22:24.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684121+0000", 2024-09-17T02:22:24.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5100000000000001e-06 2024-09-17T02:22:24.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684181+0000", 2024-09-17T02:22:24.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0307999999999999e-05 2024-09-17T02:22:24.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:24.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684194+0000", 2024-09-17T02:22:24.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2916e-05 2024-09-17T02:22:24.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.587917+0000", 2024-09-17T02:22:24.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.90372220400000003 2024-09-17T02:22:24.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:24.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588215+0000", 2024-09-17T02:22:24.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029845400000000003 2024-09-17T02:22:24.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:24.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588470+0000", 2024-09-17T02:22:24.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025455399999999999 2024-09-17T02:22:24.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:24.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596318+0000", 2024-09-17T02:22:24.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078485589999999997 2024-09-17T02:22:24.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:24.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596354+0000", 2024-09-17T02:22:24.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5976999999999998e-05 2024-09-17T02:22:24.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:24.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596449+0000", 2024-09-17T02:22:24.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4728999999999994e-05 2024-09-17T02:22:24.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:24.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596669+0000", 2024-09-17T02:22:24.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220132 2024-09-17T02:22:24.516 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.516 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:24.516 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.516 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129649 5.4 5:2fe27050:::benchmark_data_smithi001_23533_object1532:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:24.516 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:24.516 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.666671813000001, 2024-09-17T02:22:24.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.88508119100000004, 2024-09-17T02:22:24.516 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:24.516 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:24.516 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:24.517 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:24.517 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:24.517 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.517 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129649 2024-09-17T02:22:24.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.517 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:24.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:24.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:24.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:24.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:24.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:24.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:24.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715653+0000", 2024-09-17T02:22:24.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3519999999999999e-06 2024-09-17T02:22:24.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:24.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715658+0000", 2024-09-17T02:22:24.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3120000000000001e-06 2024-09-17T02:22:24.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:24.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715677+0000", 2024-09-17T02:22:24.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-17T02:22:24.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715687+0000", 2024-09-17T02:22:24.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0146000000000001e-05 2024-09-17T02:22:24.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715821+0000", 2024-09-17T02:22:24.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013421 2024-09-17T02:22:24.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:24.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715840+0000", 2024-09-17T02:22:24.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8153999999999999e-05 2024-09-17T02:22:24.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:24.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592528+0000", 2024-09-17T02:22:24.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.87668860000000004 2024-09-17T02:22:24.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:24.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592702+0000", 2024-09-17T02:22:24.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017429300000000001 2024-09-17T02:22:24.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:24.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592945+0000", 2024-09-17T02:22:24.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000242048 2024-09-17T02:22:24.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:24.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600234+0000", 2024-09-17T02:22:24.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072897600000000002 2024-09-17T02:22:24.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:24.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600494+0000", 2024-09-17T02:22:24.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000259984 2024-09-17T02:22:24.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:24.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600555+0000", 2024-09-17T02:22:24.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1138999999999999e-05 2024-09-17T02:22:24.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:24.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:24.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:24.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600733+0000", 2024-09-17T02:22:24.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017753300000000001 2024-09-17T02:22:24.522 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.523 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:24.523 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.523 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:24.523 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:24.523 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:24.525 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:24.525 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:24.522+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:24.624 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:24.622+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:24.679 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:24.680 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:22:24.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.680 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:234745 5.5 5:add7048e:::benchmark_data_smithi001_23533_object106628:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T02:22:24.680 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:24.672658+0000", 2024-09-17T02:22:24.680 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.010042031, 2024-09-17T02:22:24.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010066065000000001, 2024-09-17T02:22:24.680 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:24.680 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:24.680 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:24.680 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:24.680 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:24.681 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.681 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 234745 2024-09-17T02:22:24.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.681 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:24.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:24.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.672658+0000", 2024-09-17T02:22:24.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:24.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:24.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.672658+0000", 2024-09-17T02:22:24.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:24.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:24.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.672659+0000", 2024-09-17T02:22:24.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2900000000000003e-07 2024-09-17T02:22:24.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:24.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.672662+0000", 2024-09-17T02:22:24.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0249999999999998e-06 2024-09-17T02:22:24.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:24.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.672672+0000", 2024-09-17T02:22:24.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7159999999999998e-06 2024-09-17T02:22:24.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.672679+0000", 2024-09-17T02:22:24.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9870000000000002e-06 2024-09-17T02:22:24.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:24.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.676368+0000", 2024-09-17T02:22:24.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003689665 2024-09-17T02:22:24.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:24.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.676468+0000", 2024-09-17T02:22:24.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9846000000000006e-05 2024-09-17T02:22:24.684 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:24.684 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:24.684 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:24.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.684 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:234748 5.5 5:a8148240:::benchmark_data_smithi001_23533_object106631:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T02:22:24.684 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:24.676494+0000", 2024-09-17T02:22:24.684 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00620581, 2024-09-17T02:22:24.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063123830000000004, 2024-09-17T02:22:24.685 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:24.685 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:24.685 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:24.685 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:24.685 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:24.685 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.685 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 234748 2024-09-17T02:22:24.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.685 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:24.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:24.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.676494+0000", 2024-09-17T02:22:24.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:24.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:24.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.676494+0000", 2024-09-17T02:22:24.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:24.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:24.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.676495+0000", 2024-09-17T02:22:24.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8599999999999998e-07 2024-09-17T02:22:24.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:24.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.676498+0000", 2024-09-17T02:22:24.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3620000000000002e-06 2024-09-17T02:22:24.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:24.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.676505+0000", 2024-09-17T02:22:24.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.99e-06 2024-09-17T02:22:24.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.676511+0000", 2024-09-17T02:22:24.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5310000000000001e-06 2024-09-17T02:22:24.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:24.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.678441+0000", 2024-09-17T02:22:24.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019296000000000001 2024-09-17T02:22:24.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:24.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.678553+0000", 2024-09-17T02:22:24.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011262800000000001 2024-09-17T02:22:24.688 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:24.688 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:24.688 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:24.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.688 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:234750 5.5 5:a399ca8d:::benchmark_data_smithi001_23533_object106633:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T02:22:24.688 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:24.676523+0000", 2024-09-17T02:22:24.689 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0061773330000000001, 2024-09-17T02:22:24.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063275470000000002, 2024-09-17T02:22:24.689 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:24.689 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:24.689 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:24.689 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:24.689 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:24.689 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.689 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 234750 2024-09-17T02:22:24.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.689 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:24.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:24.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.676523+0000", 2024-09-17T02:22:24.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:24.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:24.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.676523+0000", 2024-09-17T02:22:24.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:24.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:24.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.676523+0000", 2024-09-17T02:22:24.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6199999999999999e-07 2024-09-17T02:22:24.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:24.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.676525+0000", 2024-09-17T02:22:24.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7489999999999999e-06 2024-09-17T02:22:24.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:24.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.676529+0000", 2024-09-17T02:22:24.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9219999999999999e-06 2024-09-17T02:22:24.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.676533+0000", 2024-09-17T02:22:24.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3579999999999996e-06 2024-09-17T02:22:24.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:24.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.680456+0000", 2024-09-17T02:22:24.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039226460000000001 2024-09-17T02:22:24.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:24.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.680583+0000", 2024-09-17T02:22:24.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012729700000000001 2024-09-17T02:22:24.692 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:24.692 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:24.692 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:24.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.693 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:234753 5.5 5:ae82fa18:::benchmark_data_smithi001_23533_object106636:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T02:22:24.693 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:24.676565+0000", 2024-09-17T02:22:24.693 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0061354210000000003, 2024-09-17T02:22:24.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006322556, 2024-09-17T02:22:24.693 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:24.693 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:24.693 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:24.693 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:24.693 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:24.693 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.693 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 234753 2024-09-17T02:22:24.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.693 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:24.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:24.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.676565+0000", 2024-09-17T02:22:24.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:24.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:24.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.676565+0000", 2024-09-17T02:22:24.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:24.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:24.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.676565+0000", 2024-09-17T02:22:24.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.96e-07 2024-09-17T02:22:24.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:24.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.676568+0000", 2024-09-17T02:22:24.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8250000000000001e-06 2024-09-17T02:22:24.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:24.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.676573+0000", 2024-09-17T02:22:24.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2050000000000001e-06 2024-09-17T02:22:24.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.676576+0000", 2024-09-17T02:22:24.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7599999999999998e-06 2024-09-17T02:22:24.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:24.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.682455+0000", 2024-09-17T02:22:24.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058787839999999997 2024-09-17T02:22:24.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:24.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.682621+0000", 2024-09-17T02:22:24.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016638499999999999 2024-09-17T02:22:24.696 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:24.696 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:24.696 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:24.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.696 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:234755 5.e e71/22 5:78112bf0:::benchmark_data_smithi001_23533_object106638:head v 71'14717, mlcod=71'14715)", 2024-09-17T02:22:24.697 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:24.678831+0000", 2024-09-17T02:22:24.697 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0038688860000000002, 2024-09-17T02:22:24.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040921489999999998, 2024-09-17T02:22:24.697 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:24.697 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:24.697 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:24.697 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:24.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:24.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.678831+0000", 2024-09-17T02:22:24.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:24.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:24.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.678831+0000", 2024-09-17T02:22:24.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:24.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:24.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.678832+0000", 2024-09-17T02:22:24.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9500000000000001e-07 2024-09-17T02:22:24.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:24.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.678838+0000", 2024-09-17T02:22:24.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5199999999999997e-06 2024-09-17T02:22:24.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:24.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.678845+0000", 2024-09-17T02:22:24.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3880000000000002e-06 2024-09-17T02:22:24.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.678850+0000", 2024-09-17T02:22:24.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7870000000000001e-06 2024-09-17T02:22:24.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:24.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.678895+0000", 2024-09-17T02:22:24.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5609999999999999e-05 2024-09-17T02:22:24.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:24.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.678918+0000", 2024-09-17T02:22:24.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2741000000000001e-05 2024-09-17T02:22:24.700 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:24.700 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:24.700 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:24.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.700 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:234761 5.0 5:0c1846b3:::benchmark_data_smithi001_23533_object106644:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T02:22:24.700 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:24.679166+0000", 2024-09-17T02:22:24.700 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0035340699999999998, 2024-09-17T02:22:24.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037891470000000001, 2024-09-17T02:22:24.701 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:24.701 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:24.701 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:24.701 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:24.701 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:24.701 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.701 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 234761 2024-09-17T02:22:24.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.701 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:24.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:24.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.679166+0000", 2024-09-17T02:22:24.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:24.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:24.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.679166+0000", 2024-09-17T02:22:24.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:24.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:24.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.679167+0000", 2024-09-17T02:22:24.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9399999999999993e-07 2024-09-17T02:22:24.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:24.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.679171+0000", 2024-09-17T02:22:24.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2030000000000002e-06 2024-09-17T02:22:24.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:24.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.679181+0000", 2024-09-17T02:22:24.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6269999999999995e-06 2024-09-17T02:22:24.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.679187+0000", 2024-09-17T02:22:24.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4520000000000002e-06 2024-09-17T02:22:24.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:24.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.679240+0000", 2024-09-17T02:22:24.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3100000000000003e-05 2024-09-17T02:22:24.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:24.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.679326+0000", 2024-09-17T02:22:24.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5190000000000003e-05 2024-09-17T02:22:24.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:24.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.679386+0000", 2024-09-17T02:22:24.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0803e-05 2024-09-17T02:22:24.704 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:24.704 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:24.704 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:24.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.705 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:234763 5.6 5:6e706eb0:::benchmark_data_smithi001_23533_object106646:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T02:22:24.705 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:24.679841+0000", 2024-09-17T02:22:24.705 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0028593999999999998, 2024-09-17T02:22:24.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003152041, 2024-09-17T02:22:24.705 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:24.705 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:24.705 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:24.705 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:24.705 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:24.705 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.705 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 234763 2024-09-17T02:22:24.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.706 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:24.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:24.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.679841+0000", 2024-09-17T02:22:24.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:24.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:24.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.679841+0000", 2024-09-17T02:22:24.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:24.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:24.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.679841+0000", 2024-09-17T02:22:24.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4499999999999996e-07 2024-09-17T02:22:24.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:24.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.679845+0000", 2024-09-17T02:22:24.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4039999999999999e-06 2024-09-17T02:22:24.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:24.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.679856+0000", 2024-09-17T02:22:24.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0713999999999999e-05 2024-09-17T02:22:24.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.679862+0000", 2024-09-17T02:22:24.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1909999999999997e-06 2024-09-17T02:22:24.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:24.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.679908+0000", 2024-09-17T02:22:24.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5929e-05 2024-09-17T02:22:24.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:24.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.680019+0000", 2024-09-17T02:22:24.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111631 2024-09-17T02:22:24.708 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:24.708 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:24.708 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:24.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.709 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:234766 5.0 5:06be4fe9:::benchmark_data_smithi001_23533_object106649:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T02:22:24.709 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:24.681385+0000", 2024-09-17T02:22:24.709 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001314771, 2024-09-17T02:22:24.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016427060000000001, 2024-09-17T02:22:24.709 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:24.709 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:24.709 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:24.709 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:24.709 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:24.709 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.710 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 234766 2024-09-17T02:22:24.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.710 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:24.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:24.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.681385+0000", 2024-09-17T02:22:24.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:24.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:24.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.681385+0000", 2024-09-17T02:22:24.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:24.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:24.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.681386+0000", 2024-09-17T02:22:24.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.16e-07 2024-09-17T02:22:24.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:24.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.681391+0000", 2024-09-17T02:22:24.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7169999999999999e-06 2024-09-17T02:22:24.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:24.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.681402+0000", 2024-09-17T02:22:24.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0956e-05 2024-09-17T02:22:24.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.681409+0000", 2024-09-17T02:22:24.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6769999999999998e-06 2024-09-17T02:22:24.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:24.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.682096+0000", 2024-09-17T02:22:24.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00068750300000000001 2024-09-17T02:22:24.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:24.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.682213+0000", 2024-09-17T02:22:24.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000116854 2024-09-17T02:22:24.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:24.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.682331+0000", 2024-09-17T02:22:24.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117976 2024-09-17T02:22:24.713 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:24.713 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:24.713 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:24.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.713 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:234767 5.c 5:3658ad9a:::benchmark_data_smithi001_23533_object106650:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T02:22:24.713 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:24.681431+0000", 2024-09-17T02:22:24.714 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0012689800000000001, 2024-09-17T02:22:24.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00163328, 2024-09-17T02:22:24.714 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:24.714 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:24.714 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:24.714 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:24.714 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:24.714 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.714 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 234767 2024-09-17T02:22:24.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.714 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:24.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:24.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.681431+0000", 2024-09-17T02:22:24.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:24.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:24.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.681431+0000", 2024-09-17T02:22:24.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:24.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:24.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.681432+0000", 2024-09-17T02:22:24.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6600000000000002e-07 2024-09-17T02:22:24.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:24.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.681434+0000", 2024-09-17T02:22:24.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.305e-06 2024-09-17T02:22:24.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:24.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.681442+0000", 2024-09-17T02:22:24.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8169999999999999e-06 2024-09-17T02:22:24.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.681447+0000", 2024-09-17T02:22:24.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7759999999999997e-06 2024-09-17T02:22:24.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:24.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.681581+0000", 2024-09-17T02:22:24.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013437599999999999 2024-09-17T02:22:24.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:24.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.681697+0000", 2024-09-17T02:22:24.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011634200000000001 2024-09-17T02:22:24.717 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:24.717 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:24.717 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:24.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.718 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:234768 5.4 e71/52 5:26e7f5c7:::benchmark_data_smithi001_23533_object106651:head v 71'14467, mlcod=71'14465)", 2024-09-17T02:22:24.718 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:24.682638+0000", 2024-09-17T02:22:24.718 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 6.1822999999999994e-05, 2024-09-17T02:22:24.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00045900200000000002, 2024-09-17T02:22:24.718 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:24.718 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:24.718 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:24.718 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:24.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:24.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.682638+0000", 2024-09-17T02:22:24.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:24.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:24.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.682638+0000", 2024-09-17T02:22:24.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:24.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:24.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.682639+0000", 2024-09-17T02:22:24.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8599999999999999e-07 2024-09-17T02:22:24.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:24.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.682643+0000", 2024-09-17T02:22:24.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1309999999999999e-06 2024-09-17T02:22:24.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:24.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.682650+0000", 2024-09-17T02:22:24.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3889999999999999e-06 2024-09-17T02:22:24.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.682654+0000", 2024-09-17T02:22:24.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2130000000000002e-06 2024-09-17T02:22:24.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:24.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.682733+0000", 2024-09-17T02:22:24.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8512999999999999e-05 2024-09-17T02:22:24.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:24.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.682752+0000", 2024-09-17T02:22:24.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9069e-05 2024-09-17T02:22:24.721 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:24.721 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:24.721 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:24.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.721 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4466.0:234761 5.0 e71/26)", 2024-09-17T02:22:24.721 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:24.682665+0000", 2024-09-17T02:22:24.721 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.5417999999999999e-05, 2024-09-17T02:22:24.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00046024199999999998, 2024-09-17T02:22:24.722 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:24.722 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:24.722 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:24.722 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:24.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:24.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.682665+0000", 2024-09-17T02:22:24.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:24.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:24.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.682665+0000", 2024-09-17T02:22:24.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:24.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:24.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.682665+0000", 2024-09-17T02:22:24.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.35e-07 2024-09-17T02:22:24.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:24.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.682667+0000", 2024-09-17T02:22:24.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7710000000000001e-06 2024-09-17T02:22:24.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:24.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.682672+0000", 2024-09-17T02:22:24.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-09-17T02:22:24.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.682676+0000", 2024-09-17T02:22:24.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9809999999999997e-06 2024-09-17T02:22:24.724 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:24.724 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:24.724 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:24.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.724 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:234769 5.0 5.ec0cc140 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T02:22:24.725 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:24.682686+0000", 2024-09-17T02:22:24.725 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.4090999999999999e-05, 2024-09-17T02:22:24.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000462626, 2024-09-17T02:22:24.725 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:24.725 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:24.725 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:24.725 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:24.725 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:24.725 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.725 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 234769 2024-09-17T02:22:24.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.725 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:24.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:24.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.682686+0000", 2024-09-17T02:22:24.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:24.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:24.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.682686+0000", 2024-09-17T02:22:24.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:24.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:24.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.682687+0000", 2024-09-17T02:22:24.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7800000000000002e-07 2024-09-17T02:22:24.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:24.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.682689+0000", 2024-09-17T02:22:24.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3420000000000002e-06 2024-09-17T02:22:24.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:24.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.682696+0000", 2024-09-17T02:22:24.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3599999999999998e-06 2024-09-17T02:22:24.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.682701+0000", 2024-09-17T02:22:24.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9429999999999999e-06 2024-09-17T02:22:24.727 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:24.727 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:24.728 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:24.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.728 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:234744 5.5 5:ae9711df:::benchmark_data_smithi001_23533_object106627:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T02:22:24.728 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:24.672186+0000", 2024-09-17T02:22:24.728 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.010513817, 2024-09-17T02:22:24.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010990893, 2024-09-17T02:22:24.728 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:24.728 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:24.728 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:24.728 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:24.729 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:24.729 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:24.729 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 234744 2024-09-17T02:22:24.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.729 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:24.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:24.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.672186+0000", 2024-09-17T02:22:24.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:24.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:24.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.672186+0000", 2024-09-17T02:22:24.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:24.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:24.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.672187+0000", 2024-09-17T02:22:24.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2600000000000002e-07 2024-09-17T02:22:24.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:24.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.672191+0000", 2024-09-17T02:22:24.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9040000000000002e-06 2024-09-17T02:22:24.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:24.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.672200+0000", 2024-09-17T02:22:24.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2860000000000005e-06 2024-09-17T02:22:24.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:24.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.672207+0000", 2024-09-17T02:22:24.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7649999999999996e-06 2024-09-17T02:22:24.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:24.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.674081+0000", 2024-09-17T02:22:24.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018740460000000001 2024-09-17T02:22:24.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:24.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:24.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:24.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:24.674197+0000", 2024-09-17T02:22:24.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011555100000000001 2024-09-17T02:22:24.732 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:24.732 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:24.732 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:24.732 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:24.732 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:22:24.732 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 13 2024-09-17T02:22:24.732 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:24.734 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:24.734 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:24.735+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:24.834 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:24.834+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:24.929 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:24.930 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:22:24.930 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:22:24.930 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:22:24.930 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:24.934 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:24.935+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:24.949 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:25.037 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:25.039+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:25.138 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:25.135+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:25.146 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:25.146 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:22:25.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:22:25.146 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:22:25.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.146 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:22:25.146 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:25.146 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 102.5787423, 2024-09-17T02:22:25.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:22:25.147 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:25.147 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:25.147 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:25.147 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:25.147 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:25.147 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:25.147 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:22:25.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.147 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:25.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:25.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:25.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:25.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:25.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:25.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:22:25.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:22:25.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:25.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:22:25.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:22:25.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:25.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:22:25.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:22:25.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:22:25.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:22:25.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:25.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:22:25.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:22:25.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:25.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:22:25.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:22:25.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:25.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:22:25.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:22:25.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:25.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:22:25.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:22:25.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:25.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:22:25.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:22:25.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:25.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:22:25.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:22:25.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:25.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:22:25.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:22:25.153 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.153 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:25.154 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.154 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:22:25.154 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:25.154 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 102.57484005000001, 2024-09-17T02:22:25.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:22:25.154 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:25.154 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:25.154 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:25.155 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:25.155 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:25.155 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:25.155 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:22:25.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.155 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:25.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:25.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:25.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:25.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:25.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:25.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:22:25.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:22:25.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:25.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:22:25.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:22:25.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:25.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:22:25.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:22:25.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:22:25.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:22:25.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:25.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:22:25.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:22:25.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:25.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:22:25.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:22:25.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:25.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:22:25.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:22:25.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:25.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:22:25.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:22:25.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:25.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:22:25.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:22:25.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:25.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:22:25.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:22:25.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:25.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:22:25.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:22:25.160 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.160 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:25.160 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.161 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97759 5.a 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:25.161 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:25.161 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 67.548820226999993, 2024-09-17T02:22:25.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.089694871999999995, 2024-09-17T02:22:25.161 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:25.161 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:25.161 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:25.161 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:25.161 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:25.161 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:25.161 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97759 2024-09-17T02:22:25.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.162 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:25.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:25.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:25.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:25.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:25.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:25.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598386+0000", 2024-09-17T02:22:25.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999999e-07 2024-09-17T02:22:25.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:25.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598414+0000", 2024-09-17T02:22:25.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8013000000000001e-05 2024-09-17T02:22:25.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:25.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598420+0000", 2024-09-17T02:22:25.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1149999999999999e-06 2024-09-17T02:22:25.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598424+0000", 2024-09-17T02:22:25.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:22:25.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:25.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598479+0000", 2024-09-17T02:22:25.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4648999999999998e-05 2024-09-17T02:22:25.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:25.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598587+0000", 2024-09-17T02:22:25.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010853000000000001 2024-09-17T02:22:25.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:25.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598676+0000", 2024-09-17T02:22:25.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8381999999999995e-05 2024-09-17T02:22:25.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:25.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603766+0000", 2024-09-17T02:22:25.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050902559999999996 2024-09-17T02:22:25.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:25.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.687988+0000", 2024-09-17T02:22:25.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.084221753999999996 2024-09-17T02:22:25.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:25.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688037+0000", 2024-09-17T02:22:25.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-05 2024-09-17T02:22:25.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:25.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688080+0000", 2024-09-17T02:22:25.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3149999999999999e-05 2024-09-17T02:22:25.167 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.167 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:25.167 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.167 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97770 5.0 5:09c75033:::benchmark_data_smithi001_23533_object97769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:25.167 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:25.167 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 67.543677797000001, 2024-09-17T02:22:25.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.086380868, 2024-09-17T02:22:25.167 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:25.168 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:25.168 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:25.168 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:25.168 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:25.168 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:25.168 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97770 2024-09-17T02:22:25.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.168 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:25.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:25.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:25.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:25.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:25.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:25.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603529+0000", 2024-09-17T02:22:25.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:22:25.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:25.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603593+0000", 2024-09-17T02:22:25.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4216999999999999e-05 2024-09-17T02:22:25.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:25.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603603+0000", 2024-09-17T02:22:25.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5179999999999993e-06 2024-09-17T02:22:25.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603608+0000", 2024-09-17T02:22:25.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2039999999999996e-06 2024-09-17T02:22:25.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:25.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603653+0000", 2024-09-17T02:22:25.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5247000000000002e-05 2024-09-17T02:22:25.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:25.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603758+0000", 2024-09-17T02:22:25.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105352 2024-09-17T02:22:25.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:25.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603900+0000", 2024-09-17T02:22:25.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014198999999999999 2024-09-17T02:22:25.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:25.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.606097+0000", 2024-09-17T02:22:25.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021969839999999999 2024-09-17T02:22:25.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:25.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689756+0000", 2024-09-17T02:22:25.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.083659077999999998 2024-09-17T02:22:25.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:25.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689846+0000", 2024-09-17T02:22:25.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9320999999999994e-05 2024-09-17T02:22:25.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:25.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689908+0000", 2024-09-17T02:22:25.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720999999999998e-05 2024-09-17T02:22:25.173 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.173 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:25.173 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.174 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127513 5.c 5:3eca08e4:::benchmark_data_smithi001_23533_object127512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:25.174 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:25.174 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 52.702901373000003, 2024-09-17T02:22:25.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046626399999999998, 2024-09-17T02:22:25.174 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:25.174 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:25.174 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:25.174 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:25.174 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:25.174 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:25.174 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127513 2024-09-17T02:22:25.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.175 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:25.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:25.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:25.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:25.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:25.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:25.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444305+0000", 2024-09-17T02:22:25.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2529999999999999e-06 2024-09-17T02:22:25.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:25.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444466+0000", 2024-09-17T02:22:25.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016069700000000001 2024-09-17T02:22:25.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:25.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444479+0000", 2024-09-17T02:22:25.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2602999999999999e-05 2024-09-17T02:22:25.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444485+0000", 2024-09-17T02:22:25.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.669e-06 2024-09-17T02:22:25.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:25.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444560+0000", 2024-09-17T02:22:25.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4276999999999994e-05 2024-09-17T02:22:25.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:25.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444656+0000", 2024-09-17T02:22:25.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6490000000000006e-05 2024-09-17T02:22:25.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:25.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444739+0000", 2024-09-17T02:22:25.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3139999999999993e-05 2024-09-17T02:22:25.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:25.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.448438+0000", 2024-09-17T02:22:25.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036985490000000002 2024-09-17T02:22:25.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:25.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490732+0000", 2024-09-17T02:22:25.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042294353999999999 2024-09-17T02:22:25.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:25.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490859+0000", 2024-09-17T02:22:25.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012708899999999999 2024-09-17T02:22:25.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:25.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490930+0000", 2024-09-17T02:22:25.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:25.180 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.180 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:25.180 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.180 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127514 5.c 5:39cc1feb:::benchmark_data_smithi001_23533_object127513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:25.180 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:25.180 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 52.702704603999997, 2024-09-17T02:22:25.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049357228000000003, 2024-09-17T02:22:25.180 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:25.180 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:25.180 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:25.181 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:25.181 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:25.181 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:25.181 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127514 2024-09-17T02:22:25.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.181 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:25.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:25.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:25.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:25.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:25.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:25.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:25.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8599999999999998e-07 2024-09-17T02:22:25.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:25.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444554+0000", 2024-09-17T02:22:25.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3047999999999998e-05 2024-09-17T02:22:25.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:25.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444562+0000", 2024-09-17T02:22:25.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5830000000000001e-06 2024-09-17T02:22:25.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444567+0000", 2024-09-17T02:22:25.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4179999999999996e-06 2024-09-17T02:22:25.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:25.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446566+0000", 2024-09-17T02:22:25.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001998788 2024-09-17T02:22:25.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:25.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446696+0000", 2024-09-17T02:22:25.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129393 2024-09-17T02:22:25.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:25.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446794+0000", 2024-09-17T02:22:25.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8462999999999996e-05 2024-09-17T02:22:25.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:25.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.449036+0000", 2024-09-17T02:22:25.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022415880000000001 2024-09-17T02:22:25.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:25.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493737+0000", 2024-09-17T02:22:25.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044701682 2024-09-17T02:22:25.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:25.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493808+0000", 2024-09-17T02:22:25.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0846000000000006e-05 2024-09-17T02:22:25.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:25.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493858+0000", 2024-09-17T02:22:25.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9932999999999998e-05 2024-09-17T02:22:25.186 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.186 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:25.187 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.187 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129441 5.1 5:84c3199f:::benchmark_data_smithi001_23533_object1324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:25.187 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:25.187 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.643694115999999, 2024-09-17T02:22:25.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034387011000000002, 2024-09-17T02:22:25.187 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:25.187 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:25.187 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:25.187 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:25.188 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:25.188 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:25.188 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129441 2024-09-17T02:22:25.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.188 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:25.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:25.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:25.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:25.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:25.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:25.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503513+0000", 2024-09-17T02:22:25.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4759999999999999e-06 2024-09-17T02:22:25.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:25.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503518+0000", 2024-09-17T02:22:25.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-09-17T02:22:25.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:25.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503532+0000", 2024-09-17T02:22:25.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4049999999999999e-05 2024-09-17T02:22:25.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503541+0000", 2024-09-17T02:22:25.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5320000000000006e-06 2024-09-17T02:22:25.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:25.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506331+0000", 2024-09-17T02:22:25.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027899190000000001 2024-09-17T02:22:25.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:25.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506402+0000", 2024-09-17T02:22:25.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:25.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:25.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506477+0000", 2024-09-17T02:22:25.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4626e-05 2024-09-17T02:22:25.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:25.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509749+0000", 2024-09-17T02:22:25.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032726980000000001 2024-09-17T02:22:25.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:25.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537758+0000", 2024-09-17T02:22:25.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028008890000000002 2024-09-17T02:22:25.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:25.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537812+0000", 2024-09-17T02:22:25.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3300000000000001e-05 2024-09-17T02:22:25.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:25.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537898+0000", 2024-09-17T02:22:25.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6691000000000001e-05 2024-09-17T02:22:25.193 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.193 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:25.193 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.193 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129442 5.1 5:8f7f2a95:::benchmark_data_smithi001_23533_object1325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:25.193 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:25.193 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.640723506999997, 2024-09-17T02:22:25.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031546698999999997, 2024-09-17T02:22:25.194 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:25.194 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:25.194 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:25.194 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:25.194 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:25.194 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:25.194 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129442 2024-09-17T02:22:25.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.194 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:25.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:25.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:25.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:25.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:25.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:25.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506483+0000", 2024-09-17T02:22:25.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2869999999999999e-06 2024-09-17T02:22:25.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:25.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506489+0000", 2024-09-17T02:22:25.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2330000000000003e-06 2024-09-17T02:22:25.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:25.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506502+0000", 2024-09-17T02:22:25.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2286999999999999e-05 2024-09-17T02:22:25.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506511+0000", 2024-09-17T02:22:25.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7799999999999995e-06 2024-09-17T02:22:25.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:25.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.507966+0000", 2024-09-17T02:22:25.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014541549999999999 2024-09-17T02:22:25.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:25.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508130+0000", 2024-09-17T02:22:25.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016455199999999999 2024-09-17T02:22:25.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:25.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508287+0000", 2024-09-17T02:22:25.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015730400000000001 2024-09-17T02:22:25.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:25.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510577+0000", 2024-09-17T02:22:25.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022899449999999998 2024-09-17T02:22:25.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:25.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537932+0000", 2024-09-17T02:22:25.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027354471000000002 2024-09-17T02:22:25.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:25.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537964+0000", 2024-09-17T02:22:25.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1909999999999998e-05 2024-09-17T02:22:25.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:25.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.538029+0000", 2024-09-17T02:22:25.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4775000000000002e-05 2024-09-17T02:22:25.199 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.199 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:25.200 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.200 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:150458 5.a 5:59b62890:::benchmark_data_smithi001_23533_object22341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:22:25.200 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:25.200 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.308879699999999, 2024-09-17T02:22:25.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028150173000000001, 2024-09-17T02:22:25.200 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:25.200 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:25.200 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:25.200 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:25.200 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:25.200 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:25.201 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 150458 2024-09-17T02:22:25.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.201 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:25.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:25.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:25.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:25.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:25.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:25.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:25.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7800000000000002e-07 2024-09-17T02:22:25.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:25.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838328+0000", 2024-09-17T02:22:25.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.838e-06 2024-09-17T02:22:25.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:25.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838335+0000", 2024-09-17T02:22:25.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1999999999999997e-06 2024-09-17T02:22:25.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838340+0000", 2024-09-17T02:22:25.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7389999999999999e-06 2024-09-17T02:22:25.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:25.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849082+0000", 2024-09-17T02:22:25.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01074174 2024-09-17T02:22:25.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:25.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849192+0000", 2024-09-17T02:22:25.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011040300000000001 2024-09-17T02:22:25.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:25.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849297+0000", 2024-09-17T02:22:25.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104764 2024-09-17T02:22:25.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:25.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.857853+0000", 2024-09-17T02:22:25.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085558490000000008 2024-09-17T02:22:25.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:25.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866430+0000", 2024-09-17T02:22:25.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085768140000000003 2024-09-17T02:22:25.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:25.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866454+0000", 2024-09-17T02:22:25.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4428000000000001e-05 2024-09-17T02:22:25.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:25.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866476+0000", 2024-09-17T02:22:25.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.192e-05 2024-09-17T02:22:25.206 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.206 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:25.206 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.206 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190780 5.3 e65/64 5:c634f18a:::benchmark_data_smithi001_23533_object62663:head v 65'12039, mlcod=0'0)", 2024-09-17T02:22:25.206 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.182278+0000", 2024-09-17T02:22:25.207 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.964927611, 2024-09-17T02:22:25.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028943393000000001, 2024-09-17T02:22:25.207 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:25.207 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:25.207 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:25.207 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:25.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:25.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182278+0000", 2024-09-17T02:22:25.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:25.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182278+0000", 2024-09-17T02:22:25.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:25.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182280+0000", 2024-09-17T02:22:25.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.736e-06 2024-09-17T02:22:25.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:25.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182291+0000", 2024-09-17T02:22:25.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1933000000000001e-05 2024-09-17T02:22:25.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:25.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182317+0000", 2024-09-17T02:22:25.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6024999999999999e-05 2024-09-17T02:22:25.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182332+0000", 2024-09-17T02:22:25.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4856e-05 2024-09-17T02:22:25.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:25.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182463+0000", 2024-09-17T02:22:25.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130674 2024-09-17T02:22:25.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:25.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182533+0000", 2024-09-17T02:22:25.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0296999999999995e-05 2024-09-17T02:22:25.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:25.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211153+0000", 2024-09-17T02:22:25.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028619265000000001 2024-09-17T02:22:25.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:25.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211221+0000", 2024-09-17T02:22:25.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8607000000000002e-05 2024-09-17T02:22:25.211 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.211 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:25.211 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.211 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190799 5.3 e65/64 5:c0e8780b:::benchmark_data_smithi001_23533_object62682:head v 65'12040, mlcod=0'0)", 2024-09-17T02:22:25.211 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.193849+0000", 2024-09-17T02:22:25.211 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.953356259, 2024-09-17T02:22:25.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02989934, 2024-09-17T02:22:25.211 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:25.211 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:25.211 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:25.211 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:25.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:25.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193849+0000", 2024-09-17T02:22:25.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:25.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193849+0000", 2024-09-17T02:22:25.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:25.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193851+0000", 2024-09-17T02:22:25.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.137e-06 2024-09-17T02:22:25.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:25.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193865+0000", 2024-09-17T02:22:25.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3845999999999999e-05 2024-09-17T02:22:25.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:25.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193888+0000", 2024-09-17T02:22:25.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3312e-05 2024-09-17T02:22:25.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193901+0000", 2024-09-17T02:22:25.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2896e-05 2024-09-17T02:22:25.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:25.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.204084+0000", 2024-09-17T02:22:25.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010182538 2024-09-17T02:22:25.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:25.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.204126+0000", 2024-09-17T02:22:25.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1828e-05 2024-09-17T02:22:25.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:25.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223688+0000", 2024-09-17T02:22:25.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019562408999999999 2024-09-17T02:22:25.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:25.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223748+0000", 2024-09-17T02:22:25.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0374000000000002e-05 2024-09-17T02:22:25.215 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.215 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:25.215 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.216 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190836 5.3 e65/64 5:c72f74ff:::benchmark_data_smithi001_23533_object62719:head v 65'12042, mlcod=0'0)", 2024-09-17T02:22:25.216 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.198478+0000", 2024-09-17T02:22:25.216 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.948727367, 2024-09-17T02:22:25.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031214246000000001, 2024-09-17T02:22:25.216 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:25.216 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:25.216 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:25.216 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:25.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:25.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198478+0000", 2024-09-17T02:22:25.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:25.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198478+0000", 2024-09-17T02:22:25.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:25.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198480+0000", 2024-09-17T02:22:25.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0899999999999999e-06 2024-09-17T02:22:25.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:25.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198494+0000", 2024-09-17T02:22:25.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3572e-05 2024-09-17T02:22:25.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:25.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198521+0000", 2024-09-17T02:22:25.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7178999999999998e-05 2024-09-17T02:22:25.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198533+0000", 2024-09-17T02:22:25.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2588999999999999e-05 2024-09-17T02:22:25.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:25.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208944+0000", 2024-09-17T02:22:25.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010410236 2024-09-17T02:22:25.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:25.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208979+0000", 2024-09-17T02:22:25.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5555000000000001e-05 2024-09-17T02:22:25.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:25.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229627+0000", 2024-09-17T02:22:25.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020647993999999999 2024-09-17T02:22:25.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:25.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229692+0000", 2024-09-17T02:22:25.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5030999999999995e-05 2024-09-17T02:22:25.220 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.220 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:25.220 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.220 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190852 5.3 e65/64 5:c63de204:::benchmark_data_smithi001_23533_object62735:head v 65'12043, mlcod=0'0)", 2024-09-17T02:22:25.220 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.200082+0000", 2024-09-17T02:22:25.220 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.947123369, 2024-09-17T02:22:25.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029657795000000001, 2024-09-17T02:22:25.220 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:25.220 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:25.220 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:25.220 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:25.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:25.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200082+0000", 2024-09-17T02:22:25.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:25.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200082+0000", 2024-09-17T02:22:25.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:25.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200084+0000", 2024-09-17T02:22:25.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1900000000000002e-06 2024-09-17T02:22:25.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:25.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200099+0000", 2024-09-17T02:22:25.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4392999999999999e-05 2024-09-17T02:22:25.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:25.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200122+0000", 2024-09-17T02:22:25.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3292e-05 2024-09-17T02:22:25.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200134+0000", 2024-09-17T02:22:25.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2489e-05 2024-09-17T02:22:25.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:25.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211322+0000", 2024-09-17T02:22:25.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011187689000000001 2024-09-17T02:22:25.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:25.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211383+0000", 2024-09-17T02:22:25.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0707e-05 2024-09-17T02:22:25.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:25.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229698+0000", 2024-09-17T02:22:25.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018315306999999999 2024-09-17T02:22:25.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:25.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229740+0000", 2024-09-17T02:22:25.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1727999999999998e-05 2024-09-17T02:22:25.224 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.224 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:25.224 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.224 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190920 5.3 e65/64 5:c7bc6082:::benchmark_data_smithi001_23533_object62803:head v 65'12047, mlcod=0'0)", 2024-09-17T02:22:25.225 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.206674+0000", 2024-09-17T02:22:25.225 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.940531393000001, 2024-09-17T02:22:25.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.033826457999999997, 2024-09-17T02:22:25.225 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:25.225 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:25.225 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:25.225 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:25.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:25.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206674+0000", 2024-09-17T02:22:25.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:25.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206674+0000", 2024-09-17T02:22:25.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:25.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206676+0000", 2024-09-17T02:22:25.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.646e-06 2024-09-17T02:22:25.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:25.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206689+0000", 2024-09-17T02:22:25.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3196999999999999e-05 2024-09-17T02:22:25.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:25.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206718+0000", 2024-09-17T02:22:25.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8988000000000001e-05 2024-09-17T02:22:25.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206736+0000", 2024-09-17T02:22:25.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8221999999999999e-05 2024-09-17T02:22:25.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:25.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.221517+0000", 2024-09-17T02:22:25.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014781247000000001 2024-09-17T02:22:25.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:25.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.221563+0000", 2024-09-17T02:22:25.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5343999999999998e-05 2024-09-17T02:22:25.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:25.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240391+0000", 2024-09-17T02:22:25.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018828693000000001 2024-09-17T02:22:25.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:25.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240500+0000", 2024-09-17T02:22:25.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109121 2024-09-17T02:22:25.229 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.229 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:25.229 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.229 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190947 5.3 e65/64 5:ca95b398:::benchmark_data_smithi001_23533_object62830:head v 65'12048, mlcod=0'0)", 2024-09-17T02:22:25.229 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.208183+0000", 2024-09-17T02:22:25.229 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.939022040000001, 2024-09-17T02:22:25.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032404800999999997, 2024-09-17T02:22:25.230 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:25.230 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:25.230 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:25.230 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:25.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:25.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208183+0000", 2024-09-17T02:22:25.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:25.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208183+0000", 2024-09-17T02:22:25.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:25.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208185+0000", 2024-09-17T02:22:25.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.64e-06 2024-09-17T02:22:25.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:25.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208197+0000", 2024-09-17T02:22:25.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1589e-05 2024-09-17T02:22:25.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:25.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208217+0000", 2024-09-17T02:22:25.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0242e-05 2024-09-17T02:22:25.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208227+0000", 2024-09-17T02:22:25.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0256e-05 2024-09-17T02:22:25.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:25.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223908+0000", 2024-09-17T02:22:25.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015680726999999998 2024-09-17T02:22:25.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:25.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223969+0000", 2024-09-17T02:22:25.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1277000000000003e-05 2024-09-17T02:22:25.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:25.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240509+0000", 2024-09-17T02:22:25.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016539484 2024-09-17T02:22:25.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:25.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240588+0000", 2024-09-17T02:22:25.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9585999999999993e-05 2024-09-17T02:22:25.234 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.234 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:25.234 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.234 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190958 5.3 e65/64 5:c9337cc4:::benchmark_data_smithi001_23533_object62841:head v 65'12049, mlcod=0'0)", 2024-09-17T02:22:25.234 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.209746+0000", 2024-09-17T02:22:25.234 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.937459693000001, 2024-09-17T02:22:25.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030921212999999999, 2024-09-17T02:22:25.234 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:25.234 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:25.234 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:25.235 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:25.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:25.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209746+0000", 2024-09-17T02:22:25.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:25.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209746+0000", 2024-09-17T02:22:25.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:25.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209748+0000", 2024-09-17T02:22:25.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9989999999999998e-06 2024-09-17T02:22:25.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:25.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209761+0000", 2024-09-17T02:22:25.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3317e-05 2024-09-17T02:22:25.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:25.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209786+0000", 2024-09-17T02:22:25.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4941999999999999e-05 2024-09-17T02:22:25.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209799+0000", 2024-09-17T02:22:25.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2556e-05 2024-09-17T02:22:25.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:25.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.226753+0000", 2024-09-17T02:22:25.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016954100999999999 2024-09-17T02:22:25.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:25.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.226810+0000", 2024-09-17T02:22:25.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7207000000000003e-05 2024-09-17T02:22:25.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:25.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240599+0000", 2024-09-17T02:22:25.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013789228000000001 2024-09-17T02:22:25.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:25.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240667+0000", 2024-09-17T02:22:25.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7862999999999997e-05 2024-09-17T02:22:25.238 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.238 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:25.238 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.239 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:191023 5.3 e65/64 5:cfca4af2:::benchmark_data_smithi001_23533_object62906:head v 65'12050, mlcod=0'0)", 2024-09-17T02:22:25.239 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.210919+0000", 2024-09-17T02:22:25.239 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.936286336999999, 2024-09-17T02:22:25.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029830820000000001, 2024-09-17T02:22:25.239 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:25.239 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:25.239 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:25.239 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:25.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:25.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210919+0000", 2024-09-17T02:22:25.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:25.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210919+0000", 2024-09-17T02:22:25.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:25.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210921+0000", 2024-09-17T02:22:25.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-09-17T02:22:25.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:25.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210935+0000", 2024-09-17T02:22:25.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3436e-05 2024-09-17T02:22:25.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:25.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210961+0000", 2024-09-17T02:22:25.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6767999999999999e-05 2024-09-17T02:22:25.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210974+0000", 2024-09-17T02:22:25.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2904e-05 2024-09-17T02:22:25.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:25.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229967+0000", 2024-09-17T02:22:25.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018992774 2024-09-17T02:22:25.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:25.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.230023+0000", 2024-09-17T02:22:25.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6334e-05 2024-09-17T02:22:25.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:25.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240673+0000", 2024-09-17T02:22:25.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010649908 2024-09-17T02:22:25.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:25.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240750+0000", 2024-09-17T02:22:25.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6556000000000004e-05 2024-09-17T02:22:25.243 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.243 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:25.243 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.243 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:191048 5.3 e65/64 5:c4115f14:::benchmark_data_smithi001_23533_object62931:head v 65'12051, mlcod=0'0)", 2024-09-17T02:22:25.244 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.211763+0000", 2024-09-17T02:22:25.244 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.935442415000001, 2024-09-17T02:22:25.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029064577000000001, 2024-09-17T02:22:25.244 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:25.244 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:25.244 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:25.244 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:25.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:25.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211763+0000", 2024-09-17T02:22:25.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:25.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211763+0000", 2024-09-17T02:22:25.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:25.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211765+0000", 2024-09-17T02:22:25.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.717e-06 2024-09-17T02:22:25.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:25.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211776+0000", 2024-09-17T02:22:25.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1358999999999999e-05 2024-09-17T02:22:25.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:25.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211806+0000", 2024-09-17T02:22:25.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9924999999999999e-05 2024-09-17T02:22:25.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211824+0000", 2024-09-17T02:22:25.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7782999999999999e-05 2024-09-17T02:22:25.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:25.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.232521+0000", 2024-09-17T02:22:25.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020696902 2024-09-17T02:22:25.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:25.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.232574+0000", 2024-09-17T02:22:25.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3044000000000002e-05 2024-09-17T02:22:25.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:25.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240757+0000", 2024-09-17T02:22:25.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081828579999999995 2024-09-17T02:22:25.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:25.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240828+0000", 2024-09-17T02:22:25.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0988999999999994e-05 2024-09-17T02:22:25.248 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.248 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:25.248 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.248 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:191114 5.3 e65/64 5:c2a7e5a9:::benchmark_data_smithi001_23533_object62997:head v 65'12054, mlcod=63'12038)", 2024-09-17T02:22:25.248 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.217495+0000", 2024-09-17T02:22:25.248 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.929710784000001, 2024-09-17T02:22:25.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029944788, 2024-09-17T02:22:25.248 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:25.248 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:25.248 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:25.249 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:25.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:25.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217495+0000", 2024-09-17T02:22:25.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:25.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217495+0000", 2024-09-17T02:22:25.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:25.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217496+0000", 2024-09-17T02:22:25.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.46e-06 2024-09-17T02:22:25.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:25.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217508+0000", 2024-09-17T02:22:25.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2157000000000001e-05 2024-09-17T02:22:25.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:25.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217535+0000", 2024-09-17T02:22:25.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7058000000000001e-05 2024-09-17T02:22:25.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217551+0000", 2024-09-17T02:22:25.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5709000000000002e-05 2024-09-17T02:22:25.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:25.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.241029+0000", 2024-09-17T02:22:25.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023478452 2024-09-17T02:22:25.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:25.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.241078+0000", 2024-09-17T02:22:25.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8068000000000001e-05 2024-09-17T02:22:25.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:25.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.247369+0000", 2024-09-17T02:22:25.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0062912740000000003 2024-09-17T02:22:25.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:25.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.247439+0000", 2024-09-17T02:22:25.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0610000000000003e-05 2024-09-17T02:22:25.252 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.252 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:25.252 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.252 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:232047 5.5 5:afcad6c1:::benchmark_data_smithi001_23533_object103930:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-17T02:22:25.253 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:23.568037+0000", 2024-09-17T02:22:25.253 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.5791684180000001, 2024-09-17T02:22:25.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029456251999999999, 2024-09-17T02:22:25.253 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:25.253 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:25.253 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:25.253 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:25.253 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:25.253 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:25.253 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 232047 2024-09-17T02:22:25.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.253 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:25.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:25.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.568037+0000", 2024-09-17T02:22:25.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:25.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.568037+0000", 2024-09-17T02:22:25.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:25.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:25.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.568039+0000", 2024-09-17T02:22:25.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.708e-06 2024-09-17T02:22:25.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:25.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.568043+0000", 2024-09-17T02:22:25.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6999999999999999e-06 2024-09-17T02:22:25.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:25.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.568053+0000", 2024-09-17T02:22:25.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1179999999999998e-06 2024-09-17T02:22:25.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.568060+0000", 2024-09-17T02:22:25.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6820000000000003e-06 2024-09-17T02:22:25.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:25.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.576949+0000", 2024-09-17T02:22:25.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0088892650000000004 2024-09-17T02:22:25.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:25.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.577080+0000", 2024-09-17T02:22:25.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130908 2024-09-17T02:22:25.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:25.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.597391+0000", 2024-09-17T02:22:25.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020310987999999999 2024-09-17T02:22:25.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:25.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.597420+0000", 2024-09-17T02:22:25.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9070000000000001e-05 2024-09-17T02:22:25.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:25.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:25.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:25.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.597493+0000", 2024-09-17T02:22:25.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2812999999999996e-05 2024-09-17T02:22:25.257 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.257 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:25.258 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.258 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:25.258 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:25.258 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:25.259 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:25.259+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:25.259 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:25.352 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:22:25.360 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:25.359+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:25.410 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:25.410 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:22:25.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.410 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:236508 5.e 5:79e451fb:::benchmark_data_smithi001_23533_object108391:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T02:22:25.410 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:25.409841+0000", 2024-09-17T02:22:25.410 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.003396114, 2024-09-17T02:22:25.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003415469, 2024-09-17T02:22:25.411 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:25.411 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:25.411 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:25.411 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:25.411 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:25.411 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:25.411 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236508 2024-09-17T02:22:25.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.411 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:25.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:25.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.409841+0000", 2024-09-17T02:22:25.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:25.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:25.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.409841+0000", 2024-09-17T02:22:25.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:25.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:25.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.409842+0000", 2024-09-17T02:22:25.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3799999999999997e-07 2024-09-17T02:22:25.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:25.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.409845+0000", 2024-09-17T02:22:25.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2009999999999999e-06 2024-09-17T02:22:25.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:25.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.409854+0000", 2024-09-17T02:22:25.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2469999999999997e-06 2024-09-17T02:22:25.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.409861+0000", 2024-09-17T02:22:25.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0879999999999997e-06 2024-09-17T02:22:25.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:25.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.409921+0000", 2024-09-17T02:22:25.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9352999999999999e-05 2024-09-17T02:22:25.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:25.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.410027+0000", 2024-09-17T02:22:25.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106524 2024-09-17T02:22:25.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:25.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.410129+0000", 2024-09-17T02:22:25.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010155 2024-09-17T02:22:25.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:25.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412424+0000", 2024-09-17T02:22:25.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022951949999999999 2024-09-17T02:22:25.416 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:25.416 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:25.416 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:25.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.416 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:236510 5.3 5:c746dd75:::benchmark_data_smithi001_23533_object108393:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T02:22:25.416 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:25.409983+0000", 2024-09-17T02:22:25.416 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0032540450000000001, 2024-09-17T02:22:25.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00332512, 2024-09-17T02:22:25.416 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:25.416 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:25.416 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:25.417 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:25.417 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:25.417 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:25.417 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236510 2024-09-17T02:22:25.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.417 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:25.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:25.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.409983+0000", 2024-09-17T02:22:25.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:25.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:25.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.409983+0000", 2024-09-17T02:22:25.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:25.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:25.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.409984+0000", 2024-09-17T02:22:25.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3499999999999996e-07 2024-09-17T02:22:25.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:25.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.409986+0000", 2024-09-17T02:22:25.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8200000000000001e-06 2024-09-17T02:22:25.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:25.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.409994+0000", 2024-09-17T02:22:25.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1890000000000001e-06 2024-09-17T02:22:25.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.409998+0000", 2024-09-17T02:22:25.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0829999999999997e-06 2024-09-17T02:22:25.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:25.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.410115+0000", 2024-09-17T02:22:25.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117253 2024-09-17T02:22:25.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:25.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.410238+0000", 2024-09-17T02:22:25.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000122698 2024-09-17T02:22:25.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:25.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.410353+0000", 2024-09-17T02:22:25.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115699 2024-09-17T02:22:25.421 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:25.421 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:25.421 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:25.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.421 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:236512 5.3 5:c290eb47:::benchmark_data_smithi001_23533_object108395:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T02:22:25.421 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:25.410217+0000", 2024-09-17T02:22:25.421 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0030197179999999998, 2024-09-17T02:22:25.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031317760000000002, 2024-09-17T02:22:25.421 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:25.421 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:25.422 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:25.422 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:25.422 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:25.422 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:25.422 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236512 2024-09-17T02:22:25.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.422 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:25.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:25.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.410217+0000", 2024-09-17T02:22:25.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:25.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:25.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.410217+0000", 2024-09-17T02:22:25.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:25.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:25.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.410218+0000", 2024-09-17T02:22:25.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8599999999999998e-07 2024-09-17T02:22:25.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:25.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.410221+0000", 2024-09-17T02:22:25.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6809999999999998e-06 2024-09-17T02:22:25.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:25.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.410228+0000", 2024-09-17T02:22:25.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6310000000000003e-06 2024-09-17T02:22:25.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.410234+0000", 2024-09-17T02:22:25.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9519999999999999e-06 2024-09-17T02:22:25.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:25.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412051+0000", 2024-09-17T02:22:25.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018169250000000001 2024-09-17T02:22:25.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:25.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412209+0000", 2024-09-17T02:22:25.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157799 2024-09-17T02:22:25.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:25.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412343+0000", 2024-09-17T02:22:25.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000134246 2024-09-17T02:22:25.426 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:25.426 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:25.426 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:25.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.426 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:236513 5.f 5:f08337ed:::benchmark_data_smithi001_23533_object108396:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T02:22:25.426 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:25.412441+0000", 2024-09-17T02:22:25.426 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00079578299999999999, 2024-09-17T02:22:25.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095137800000000001, 2024-09-17T02:22:25.427 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:25.427 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:25.427 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:25.427 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:25.427 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:25.427 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:25.427 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236513 2024-09-17T02:22:25.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.427 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:25.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:25.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412441+0000", 2024-09-17T02:22:25.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:25.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:25.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412441+0000", 2024-09-17T02:22:25.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:25.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:25.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412442+0000", 2024-09-17T02:22:25.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6899999999999996e-07 2024-09-17T02:22:25.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:25.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412447+0000", 2024-09-17T02:22:25.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0989999999999998e-06 2024-09-17T02:22:25.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:25.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412456+0000", 2024-09-17T02:22:25.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7129999999999994e-06 2024-09-17T02:22:25.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412461+0000", 2024-09-17T02:22:25.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8770000000000001e-06 2024-09-17T02:22:25.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:25.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412504+0000", 2024-09-17T02:22:25.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2790999999999997e-05 2024-09-17T02:22:25.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:25.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412609+0000", 2024-09-17T02:22:25.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105723 2024-09-17T02:22:25.431 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:25.431 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:25.431 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:25.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.431 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:236514 5.3 5.ce0a8833 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T02:22:25.431 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:25.412798+0000", 2024-09-17T02:22:25.431 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00043884499999999999, 2024-09-17T02:22:25.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063122700000000005, 2024-09-17T02:22:25.431 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:25.431 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:25.431 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:25.431 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:25.432 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:25.432 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:25.432 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236514 2024-09-17T02:22:25.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.432 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:25.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:25.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412798+0000", 2024-09-17T02:22:25.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:25.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:25.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412798+0000", 2024-09-17T02:22:25.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:25.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:25.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412799+0000", 2024-09-17T02:22:25.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9800000000000003e-07 2024-09-17T02:22:25.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:25.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412802+0000", 2024-09-17T02:22:25.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.365e-06 2024-09-17T02:22:25.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:25.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412809+0000", 2024-09-17T02:22:25.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2840000000000001e-06 2024-09-17T02:22:25.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412814+0000", 2024-09-17T02:22:25.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.989e-06 2024-09-17T02:22:25.434 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:25.434 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:25.434 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:25.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.434 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:236515 5.1 5:82afa23d:::benchmark_data_smithi001_23533_object108398:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T02:22:25.435 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:25.412823+0000", 2024-09-17T02:22:25.435 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00041364499999999997, 2024-09-17T02:22:25.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063615500000000001, 2024-09-17T02:22:25.435 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:25.435 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:25.435 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:25.435 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:25.435 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:25.435 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:25.435 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236515 2024-09-17T02:22:25.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.435 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:25.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:25.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412823+0000", 2024-09-17T02:22:25.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:25.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:25.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412823+0000", 2024-09-17T02:22:25.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:25.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:25.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412824+0000", 2024-09-17T02:22:25.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7500000000000001e-07 2024-09-17T02:22:25.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:25.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412825+0000", 2024-09-17T02:22:25.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4729999999999999e-06 2024-09-17T02:22:25.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:25.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412830+0000", 2024-09-17T02:22:25.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1100000000000002e-06 2024-09-17T02:22:25.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412834+0000", 2024-09-17T02:22:25.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4379999999999999e-06 2024-09-17T02:22:25.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:25.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412871+0000", 2024-09-17T02:22:25.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7512000000000003e-05 2024-09-17T02:22:25.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:25.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412991+0000", 2024-09-17T02:22:25.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011966799999999999 2024-09-17T02:22:25.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:25.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.413101+0000", 2024-09-17T02:22:25.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110569 2024-09-17T02:22:25.439 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:25.439 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:25.439 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:25.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.439 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:236516 5.3 5.a6524133 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T02:22:25.440 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:25.412842+0000", 2024-09-17T02:22:25.440 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.000395568, 2024-09-17T02:22:25.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065524799999999998, 2024-09-17T02:22:25.440 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:25.440 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:25.440 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:25.440 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:25.440 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:25.440 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:25.441 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236516 2024-09-17T02:22:25.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.441 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:25.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:25.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412842+0000", 2024-09-17T02:22:25.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:25.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:25.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412842+0000", 2024-09-17T02:22:25.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:25.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:25.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412842+0000", 2024-09-17T02:22:25.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.58e-07 2024-09-17T02:22:25.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:25.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412844+0000", 2024-09-17T02:22:25.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.559e-06 2024-09-17T02:22:25.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:25.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412852+0000", 2024-09-17T02:22:25.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.17e-06 2024-09-17T02:22:25.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412855+0000", 2024-09-17T02:22:25.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6689999999999999e-06 2024-09-17T02:22:25.443 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:25.443 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:25.443 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:25.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.443 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:236517 5.f 5.8ac1e40f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T02:22:25.443 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:25.412863+0000", 2024-09-17T02:22:25.444 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00037424499999999999, 2024-09-17T02:22:25.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066386400000000001, 2024-09-17T02:22:25.444 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:25.444 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:25.444 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:25.444 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:25.444 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:25.444 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:25.444 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236517 2024-09-17T02:22:25.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.444 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:25.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:25.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412863+0000", 2024-09-17T02:22:25.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:25.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:25.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412863+0000", 2024-09-17T02:22:25.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:25.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:25.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412863+0000", 2024-09-17T02:22:25.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.84e-07 2024-09-17T02:22:25.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:25.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412865+0000", 2024-09-17T02:22:25.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2510000000000001e-06 2024-09-17T02:22:25.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:25.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412871+0000", 2024-09-17T02:22:25.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8860000000000001e-06 2024-09-17T02:22:25.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412874+0000", 2024-09-17T02:22:25.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.796e-06 2024-09-17T02:22:25.447 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:25.447 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:25.447 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:25.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.447 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:236520 5.3 5.b02afc73 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T02:22:25.447 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:25.413065+0000", 2024-09-17T02:22:25.447 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.000172036, 2024-09-17T02:22:25.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048926799999999995, 2024-09-17T02:22:25.447 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:25.448 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:25.448 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:25.448 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:25.448 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:25.448 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:25.448 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236520 2024-09-17T02:22:25.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.448 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:25.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:25.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.413065+0000", 2024-09-17T02:22:25.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:25.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:25.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.413065+0000", 2024-09-17T02:22:25.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:25.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:25.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.413066+0000", 2024-09-17T02:22:25.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8299999999999997e-07 2024-09-17T02:22:25.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:25.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.413068+0000", 2024-09-17T02:22:25.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4959999999999999e-06 2024-09-17T02:22:25.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:25.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.413075+0000", 2024-09-17T02:22:25.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9800000000000001e-06 2024-09-17T02:22:25.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.413079+0000", 2024-09-17T02:22:25.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0929999999999996e-06 2024-09-17T02:22:25.451 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:25.451 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:25.451 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:25.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.451 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:236504 5.3 5:c399fa0c:::benchmark_data_smithi001_23533_object108387:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T02:22:25.451 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:25.407733+0000", 2024-09-17T02:22:25.451 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0055037380000000002, 2024-09-17T02:22:25.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005851162, 2024-09-17T02:22:25.451 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:25.451 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:25.451 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:25.452 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:25.452 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:25.452 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:25.452 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236504 2024-09-17T02:22:25.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.452 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:25.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:25.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.407733+0000", 2024-09-17T02:22:25.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:25.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:25.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.407733+0000", 2024-09-17T02:22:25.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:25.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:25.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.407734+0000", 2024-09-17T02:22:25.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3300000000000002e-07 2024-09-17T02:22:25.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:25.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.407737+0000", 2024-09-17T02:22:25.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3680000000000002e-06 2024-09-17T02:22:25.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:25.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.407746+0000", 2024-09-17T02:22:25.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.602e-06 2024-09-17T02:22:25.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.407751+0000", 2024-09-17T02:22:25.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7060000000000003e-06 2024-09-17T02:22:25.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:25.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.407799+0000", 2024-09-17T02:22:25.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7837000000000003e-05 2024-09-17T02:22:25.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:25.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.407919+0000", 2024-09-17T02:22:25.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012041599999999999 2024-09-17T02:22:25.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:25.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.408038+0000", 2024-09-17T02:22:25.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011912 2024-09-17T02:22:25.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:25.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.410086+0000", 2024-09-17T02:22:25.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020477160000000002 2024-09-17T02:22:25.456 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:25.456 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:25.456 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:25.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.456 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:236506 5.b 5:d85399b5:::benchmark_data_smithi001_23533_object108389:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T02:22:25.456 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:25.407912+0000", 2024-09-17T02:22:25.457 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0053253240000000002, 2024-09-17T02:22:25.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057255049999999997, 2024-09-17T02:22:25.457 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:25.457 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:25.457 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:25.457 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:25.457 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:25.457 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:25.457 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236506 2024-09-17T02:22:25.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.457 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:25.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:25.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.407912+0000", 2024-09-17T02:22:25.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:25.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:25.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.407912+0000", 2024-09-17T02:22:25.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:25.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:25.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.407912+0000", 2024-09-17T02:22:25.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2399999999999999e-07 2024-09-17T02:22:25.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:25.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.407915+0000", 2024-09-17T02:22:25.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5019999999999999e-06 2024-09-17T02:22:25.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:25.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.407921+0000", 2024-09-17T02:22:25.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1059999999999996e-06 2024-09-17T02:22:25.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:25.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.407925+0000", 2024-09-17T02:22:25.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9369999999999997e-06 2024-09-17T02:22:25.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:25.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.409649+0000", 2024-09-17T02:22:25.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017244980000000001 2024-09-17T02:22:25.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:25.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.409730+0000", 2024-09-17T02:22:25.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0916999999999998e-05 2024-09-17T02:22:25.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:25.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.409796+0000", 2024-09-17T02:22:25.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6185000000000004e-05 2024-09-17T02:22:25.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:25.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:25.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:25.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:25.412111+0000", 2024-09-17T02:22:25.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023145290000000001 2024-09-17T02:22:25.462 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:25.462 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:25.462 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:25.462 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:25.462 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:22:25.462 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 11 2024-09-17T02:22:25.462 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:25.464 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:25.464 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:25.463+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:25.513 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:22:25.513 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:22:25.531 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:22:25.531 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:22:25.531 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:22:25.535 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:22:25.535 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:22:25.565 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:25.563+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:25.618 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:25.618 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:25.637 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:25.681 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:25.682+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:25.766 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:25.767+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:25.793 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:25.794 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:25.813 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:25.867 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:25.867+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:25.964 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:25.964 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:25.970 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:25.967+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:25.983 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:26.073 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:26.075+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:26.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~47s 2024-09-17T02:22:26.170 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:26.171+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:26.180 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:26.180 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:26.184 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T02:22:26.199 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:26.286 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:26.287+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:26.372 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:26.371+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:26.393 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:26.393 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:26.413 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:26.472 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:26.471+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:26.560 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:26.560 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:26.574 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:26.574+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:26.578 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:26.675 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:26.674+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:26.775 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:26.775+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:26.776 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:26.776 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:26.796 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:26.881 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:26.882+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:26.977 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:26.974+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:26.988 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:26.988 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:27.009 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:27.078 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:27.078+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:27.155 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:27.156 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:27.175 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:27.178 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:27.178+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:27.186 INFO:teuthology.orchestra.run.smithi001.stderr:nodeep-scrub is unset 2024-09-17T02:22:27.279 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:27.278+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:27.325 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:27.325 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:27.344 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:27.391 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:27.391+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:27.482 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:27.482+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:27.491 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:27.491 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:27.510 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:27.536 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:22:27.583 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:27.583+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:27.663 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:27.664 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:27.684 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:27.684 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:27.682+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:27.697 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:22:27.698 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:22:27.718 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:22:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:22:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:22:27.721 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:22:27.722 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:22:27.785 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:27.782+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:27.879 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:27.879 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:22:27.879 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:22:27.879 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:22:27.879 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:27.885 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:27.887+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:27.898 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:27.987 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:27.987+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:28.088 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:28.086+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:28.094 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:28.094 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:22:28.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:22:28.095 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:22:28.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.095 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97749 5.b 5:d930ef52:::benchmark_data_smithi001_23533_object97748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:28.095 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:28.095 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 70.503443207999993, 2024-09-17T02:22:28.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092964343000000005, 2024-09-17T02:22:28.096 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:28.096 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:28.096 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.096 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:28.097 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:28.097 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.097 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97749 2024-09-17T02:22:28.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.097 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:28.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:28.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:28.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:28.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:28.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:28.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591947+0000", 2024-09-17T02:22:28.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:22:28.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:28.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592011+0000", 2024-09-17T02:22:28.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3608000000000005e-05 2024-09-17T02:22:28.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:28.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592021+0000", 2024-09-17T02:22:28.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9979999999999998e-06 2024-09-17T02:22:28.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592028+0000", 2024-09-17T02:22:28.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1439999999999997e-06 2024-09-17T02:22:28.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593633+0000", 2024-09-17T02:22:28.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001604636 2024-09-17T02:22:28.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:28.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593757+0000", 2024-09-17T02:22:28.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012432099999999999 2024-09-17T02:22:28.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:28.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593866+0000", 2024-09-17T02:22:28.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109094 2024-09-17T02:22:28.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:28.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601190+0000", 2024-09-17T02:22:28.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073237620000000002 2024-09-17T02:22:28.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601356+0000", 2024-09-17T02:22:28.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016651900000000001 2024-09-17T02:22:28.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684618+0000", 2024-09-17T02:22:28.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083261356999999994 2024-09-17T02:22:28.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:28.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684724+0000", 2024-09-17T02:22:28.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010681800000000001 2024-09-17T02:22:28.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:28.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684911+0000", 2024-09-17T02:22:28.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186243 2024-09-17T02:22:28.110 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.111 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:28.111 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.111 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97752 5.b 5:d146f486:::benchmark_data_smithi001_23533_object97751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:28.112 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:28.112 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 70.502090514000002, 2024-09-17T02:22:28.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091989557, 2024-09-17T02:22:28.112 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:28.112 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:28.112 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.113 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:28.113 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:28.113 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.113 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97752 2024-09-17T02:22:28.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.114 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:28.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:28.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:28.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:28.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:28.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:28.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593300+0000", 2024-09-17T02:22:28.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8199999999999998e-07 2024-09-17T02:22:28.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:28.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593364+0000", 2024-09-17T02:22:28.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3831999999999995e-05 2024-09-17T02:22:28.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:28.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593376+0000", 2024-09-17T02:22:28.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1800999999999999e-05 2024-09-17T02:22:28.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593382+0000", 2024-09-17T02:22:28.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6780000000000003e-06 2024-09-17T02:22:28.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595491+0000", 2024-09-17T02:22:28.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021090689999999999 2024-09-17T02:22:28.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:28.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595614+0000", 2024-09-17T02:22:28.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012321500000000001 2024-09-17T02:22:28.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:28.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595778+0000", 2024-09-17T02:22:28.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016321900000000001 2024-09-17T02:22:28.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:28.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601197+0000", 2024-09-17T02:22:28.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054195600000000003 2024-09-17T02:22:28.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601396+0000", 2024-09-17T02:22:28.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019825299999999999 2024-09-17T02:22:28.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684990+0000", 2024-09-17T02:22:28.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083594878999999997 2024-09-17T02:22:28.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:28.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685116+0000", 2024-09-17T02:22:28.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012522799999999999 2024-09-17T02:22:28.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:28.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685289+0000", 2024-09-17T02:22:28.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172941 2024-09-17T02:22:28.127 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.127 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:28.127 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.127 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97754 5.b 5:da0615e5:::benchmark_data_smithi001_23533_object97753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:28.128 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:28.128 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 70.500452592000002, 2024-09-17T02:22:28.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092097207, 2024-09-17T02:22:28.128 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:28.128 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:28.129 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.129 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:28.129 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:28.129 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.129 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97754 2024-09-17T02:22:28.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.130 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:28.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:28.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:28.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:28.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:28.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:28.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594938+0000", 2024-09-17T02:22:28.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5000000000000002e-07 2024-09-17T02:22:28.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:28.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595075+0000", 2024-09-17T02:22:28.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137742 2024-09-17T02:22:28.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:28.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595087+0000", 2024-09-17T02:22:28.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1243000000000001e-05 2024-09-17T02:22:28.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595095+0000", 2024-09-17T02:22:28.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1030000000000002e-06 2024-09-17T02:22:28.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598461+0000", 2024-09-17T02:22:28.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033661170000000001 2024-09-17T02:22:28.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:28.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598540+0000", 2024-09-17T02:22:28.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8937999999999995e-05 2024-09-17T02:22:28.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:28.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598626+0000", 2024-09-17T02:22:28.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6042000000000001e-05 2024-09-17T02:22:28.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:28.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684258+0000", 2024-09-17T02:22:28.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085632394000000001 2024-09-17T02:22:28.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685369+0000", 2024-09-17T02:22:28.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001111063 2024-09-17T02:22:28.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685511+0000", 2024-09-17T02:22:28.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141965 2024-09-17T02:22:28.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:28.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685604+0000", 2024-09-17T02:22:28.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2935000000000004e-05 2024-09-17T02:22:28.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:28.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687034+0000", 2024-09-17T02:22:28.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001430015 2024-09-17T02:22:28.142 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.143 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:28.143 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.144 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97755 5.b 5:d36a03a1:::benchmark_data_smithi001_23533_object97754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:28.144 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:28.144 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 70.500279441999993, 2024-09-17T02:22:28.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0924904, 2024-09-17T02:22:28.145 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:28.145 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:28.145 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.145 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:28.145 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:28.145 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.146 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97755 2024-09-17T02:22:28.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.146 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:28.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:28.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:28.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:28.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:28.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:28.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595111+0000", 2024-09-17T02:22:28.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:22:28.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:28.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595145+0000", 2024-09-17T02:22:28.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3927000000000002e-05 2024-09-17T02:22:28.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:28.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595155+0000", 2024-09-17T02:22:28.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0023e-05 2024-09-17T02:22:28.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595162+0000", 2024-09-17T02:22:28.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3950000000000003e-06 2024-09-17T02:22:28.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599821+0000", 2024-09-17T02:22:28.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046592880000000001 2024-09-17T02:22:28.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:28.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599912+0000", 2024-09-17T02:22:28.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1049000000000002e-05 2024-09-17T02:22:28.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:28.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600062+0000", 2024-09-17T02:22:28.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015001700000000001 2024-09-17T02:22:28.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:28.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685307+0000", 2024-09-17T02:22:28.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085244340000000002 2024-09-17T02:22:28.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685446+0000", 2024-09-17T02:22:28.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013955700000000001 2024-09-17T02:22:28.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687375+0000", 2024-09-17T02:22:28.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019291079999999999 2024-09-17T02:22:28.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:28.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687462+0000", 2024-09-17T02:22:28.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6148000000000003e-05 2024-09-17T02:22:28.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:28.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687600+0000", 2024-09-17T02:22:28.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013887900000000001 2024-09-17T02:22:28.160 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.161 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:28.161 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.161 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 44/44 lb 5:c4567a04:::benchmark_data_smithi001_23533_object4200:head)", 2024-09-17T02:22:28.162 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:28.162 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 70.498182815999996, 2024-09-17T02:22:28.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092483421999999996, 2024-09-17T02:22:28.162 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:28.162 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:28.162 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:28.163 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:28.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:28.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:28.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:28.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:28.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:28.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:28.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6399999999999998e-07 2024-09-17T02:22:28.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:28.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597213+0000", 2024-09-17T02:22:28.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3659999999999997e-06 2024-09-17T02:22:28.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:28.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597222+0000", 2024-09-17T02:22:28.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0510000000000002e-06 2024-09-17T02:22:28.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597228+0000", 2024-09-17T02:22:28.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1569999999999999e-06 2024-09-17T02:22:28.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689588+0000", 2024-09-17T02:22:28.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092359931000000006 2024-09-17T02:22:28.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:28.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689622+0000", 2024-09-17T02:22:28.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4425999999999999e-05 2024-09-17T02:22:28.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:28.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689690+0000", 2024-09-17T02:22:28.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8126999999999993e-05 2024-09-17T02:22:28.171 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.171 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:28.171 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.172 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129462 5.4 5:2e0acc16:::benchmark_data_smithi001_23533_object1345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:28.172 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:28.172 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.560448747000002, 2024-09-17T02:22:28.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0112774899999999, 2024-09-17T02:22:28.173 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:28.173 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:28.173 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.173 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:28.173 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:28.174 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.174 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129462 2024-09-17T02:22:28.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.174 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:28.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:28.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:28.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:28.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:28.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:28.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534943+0000", 2024-09-17T02:22:28.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8759999999999999e-06 2024-09-17T02:22:28.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:28.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534951+0000", 2024-09-17T02:22:28.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3219999999999993e-06 2024-09-17T02:22:28.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:28.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534977+0000", 2024-09-17T02:22:28.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6245e-05 2024-09-17T02:22:28.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534992+0000", 2024-09-17T02:22:28.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4936000000000001e-05 2024-09-17T02:22:28.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535133+0000", 2024-09-17T02:22:28.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014051299999999999 2024-09-17T02:22:28.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:28.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:22:28.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1741000000000001e-05 2024-09-17T02:22:28.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.533906+0000", 2024-09-17T02:22:28.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99875209300000001 2024-09-17T02:22:28.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:28.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534348+0000", 2024-09-17T02:22:28.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044128899999999998 2024-09-17T02:22:28.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:28.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534762+0000", 2024-09-17T02:22:28.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000414707 2024-09-17T02:22:28.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:28.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545024+0000", 2024-09-17T02:22:28.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010261283 2024-09-17T02:22:28.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545953+0000", 2024-09-17T02:22:28.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000929618 2024-09-17T02:22:28.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:28.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546047+0000", 2024-09-17T02:22:28.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3697999999999996e-05 2024-09-17T02:22:28.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:28.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546218+0000", 2024-09-17T02:22:28.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017116899999999999 2024-09-17T02:22:28.181 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.181 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:28.181 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.181 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129480 5.4 5:2b1d398b:::benchmark_data_smithi001_23533_object1363:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:28.181 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:28.182 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.552694281000001, 2024-09-17T02:22:28.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0038926450000001, 2024-09-17T02:22:28.182 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:28.182 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:28.182 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.182 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:28.182 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:28.182 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.182 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129480 2024-09-17T02:22:28.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.182 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:28.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:28.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:28.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:28.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:28.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:28.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542696+0000", 2024-09-17T02:22:28.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9999999999999995e-07 2024-09-17T02:22:28.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:28.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542701+0000", 2024-09-17T02:22:28.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2240000000000003e-06 2024-09-17T02:22:28.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:28.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542716+0000", 2024-09-17T02:22:28.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4970000000000001e-05 2024-09-17T02:22:28.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542726+0000", 2024-09-17T02:22:28.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2879999999999998e-06 2024-09-17T02:22:28.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542832+0000", 2024-09-17T02:22:28.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010597199999999999 2024-09-17T02:22:28.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:28.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542843+0000", 2024-09-17T02:22:28.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.098e-05 2024-09-17T02:22:28.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538436+0000", 2024-09-17T02:22:28.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99559286800000002 2024-09-17T02:22:28.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:28.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538791+0000", 2024-09-17T02:22:28.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035585499999999997 2024-09-17T02:22:28.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:28.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.539144+0000", 2024-09-17T02:22:28.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035268499999999999 2024-09-17T02:22:28.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:28.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545880+0000", 2024-09-17T02:22:28.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00673552 2024-09-17T02:22:28.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546330+0000", 2024-09-17T02:22:28.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045039599999999999 2024-09-17T02:22:28.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:28.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546414+0000", 2024-09-17T02:22:28.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4468000000000005e-05 2024-09-17T02:22:28.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:28.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546588+0000", 2024-09-17T02:22:28.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017341899999999999 2024-09-17T02:22:28.188 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.188 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:28.188 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.189 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129505 5.4 5:294f2ec7:::benchmark_data_smithi001_23533_object1388:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:28.189 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:28.189 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.533681108000003, 2024-09-17T02:22:28.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98589826199999997, 2024-09-17T02:22:28.189 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:28.189 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:28.189 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.189 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:28.189 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:28.189 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.189 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129505 2024-09-17T02:22:28.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.189 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:28.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:28.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:28.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:28.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:28.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:28.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561710+0000", 2024-09-17T02:22:28.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7060000000000001e-06 2024-09-17T02:22:28.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:28.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561718+0000", 2024-09-17T02:22:28.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.542e-06 2024-09-17T02:22:28.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:28.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561741+0000", 2024-09-17T02:22:28.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3357e-05 2024-09-17T02:22:28.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561754+0000", 2024-09-17T02:22:28.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3200000000000001e-05 2024-09-17T02:22:28.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561867+0000", 2024-09-17T02:22:28.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113211 2024-09-17T02:22:28.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:28.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561888+0000", 2024-09-17T02:22:28.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0809999999999999e-05 2024-09-17T02:22:28.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542140+0000", 2024-09-17T02:22:28.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98025195799999998 2024-09-17T02:22:28.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:28.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542331+0000", 2024-09-17T02:22:28.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019127599999999999 2024-09-17T02:22:28.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:28.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542517+0000", 2024-09-17T02:22:28.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000185625 2024-09-17T02:22:28.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547114+0000", 2024-09-17T02:22:28.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045968620000000002 2024-09-17T02:22:28.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:28.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547187+0000", 2024-09-17T02:22:28.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3348000000000003e-05 2024-09-17T02:22:28.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:28.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547324+0000", 2024-09-17T02:22:28.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013681699999999999 2024-09-17T02:22:28.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:28.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547607+0000", 2024-09-17T02:22:28.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028255000000000001 2024-09-17T02:22:28.195 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.195 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:28.195 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.195 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129508 5.4 5:2892b582:::benchmark_data_smithi001_23533_object1391:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:28.195 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:28.195 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.532344015, 2024-09-17T02:22:28.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99697919099999999, 2024-09-17T02:22:28.196 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:28.196 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:28.196 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.196 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:28.196 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:28.196 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.196 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129508 2024-09-17T02:22:28.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.196 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:28.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:28.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:28.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:28.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:28.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:28.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563047+0000", 2024-09-17T02:22:28.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.274e-06 2024-09-17T02:22:28.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:28.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563054+0000", 2024-09-17T02:22:28.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2799999999999998e-06 2024-09-17T02:22:28.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:28.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563070+0000", 2024-09-17T02:22:28.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5991999999999999e-05 2024-09-17T02:22:28.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563078+0000", 2024-09-17T02:22:28.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2390000000000002e-06 2024-09-17T02:22:28.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563181+0000", 2024-09-17T02:22:28.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102249 2024-09-17T02:22:28.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:28.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563199+0000", 2024-09-17T02:22:28.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8215000000000001e-05 2024-09-17T02:22:28.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547713+0000", 2024-09-17T02:22:28.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98451446399999998 2024-09-17T02:22:28.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:28.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548063+0000", 2024-09-17T02:22:28.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034985499999999999 2024-09-17T02:22:28.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:28.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548490+0000", 2024-09-17T02:22:28.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042658600000000001 2024-09-17T02:22:28.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555655+0000", 2024-09-17T02:22:28.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071652579999999999 2024-09-17T02:22:28.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:28.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559612+0000", 2024-09-17T02:22:28.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003957103 2024-09-17T02:22:28.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:28.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559768+0000", 2024-09-17T02:22:28.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015556899999999999 2024-09-17T02:22:28.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:28.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560025+0000", 2024-09-17T02:22:28.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025710700000000002 2024-09-17T02:22:28.202 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.202 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:28.202 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.202 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129509 5.4 5:2c35515e:::benchmark_data_smithi001_23533_object1392:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:28.202 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:28.202 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.531716961999997, 2024-09-17T02:22:28.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99969384900000002, 2024-09-17T02:22:28.202 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:28.202 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:28.203 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.203 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:28.203 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:28.203 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.203 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129509 2024-09-17T02:22:28.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.203 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:28.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:28.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:28.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:28.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:28.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:28.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563674+0000", 2024-09-17T02:22:28.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0920000000000001e-06 2024-09-17T02:22:28.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:28.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563679+0000", 2024-09-17T02:22:28.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7660000000000004e-06 2024-09-17T02:22:28.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:28.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563693+0000", 2024-09-17T02:22:28.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3139000000000001e-05 2024-09-17T02:22:28.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563701+0000", 2024-09-17T02:22:28.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9859999999999994e-06 2024-09-17T02:22:28.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563775+0000", 2024-09-17T02:22:28.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4659000000000005e-05 2024-09-17T02:22:28.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:28.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563785+0000", 2024-09-17T02:22:28.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4839999999999993e-06 2024-09-17T02:22:28.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552085+0000", 2024-09-17T02:22:28.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98829986999999997 2024-09-17T02:22:28.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:28.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552554+0000", 2024-09-17T02:22:28.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046908900000000001 2024-09-17T02:22:28.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:28.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552931+0000", 2024-09-17T02:22:28.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377778 2024-09-17T02:22:28.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563106+0000", 2024-09-17T02:22:28.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010174186 2024-09-17T02:22:28.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:28.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563138+0000", 2024-09-17T02:22:28.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2495e-05 2024-09-17T02:22:28.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:28.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563225+0000", 2024-09-17T02:22:28.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6677999999999999e-05 2024-09-17T02:22:28.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:28.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563366+0000", 2024-09-17T02:22:28.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014162699999999999 2024-09-17T02:22:28.209 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.209 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:28.209 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.209 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129524 5.4 5:25dca7dd:::benchmark_data_smithi001_23533_object1407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:28.209 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:28.209 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.525025608, 2024-09-17T02:22:28.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99999501999999996, 2024-09-17T02:22:28.209 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:28.209 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:28.210 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.210 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:28.210 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:28.210 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.210 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129524 2024-09-17T02:22:28.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.210 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:28.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:28.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:28.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:28.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:28.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:28.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570365+0000", 2024-09-17T02:22:28.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.142e-06 2024-09-17T02:22:28.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:28.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570369+0000", 2024-09-17T02:22:28.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.856e-06 2024-09-17T02:22:28.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:28.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570385+0000", 2024-09-17T02:22:28.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5855e-05 2024-09-17T02:22:28.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570392+0000", 2024-09-17T02:22:28.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5340000000000002e-06 2024-09-17T02:22:28.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570484+0000", 2024-09-17T02:22:28.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1212999999999996e-05 2024-09-17T02:22:28.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:28.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570498+0000", 2024-09-17T02:22:28.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4331000000000001e-05 2024-09-17T02:22:28.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555835+0000", 2024-09-17T02:22:28.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98533757700000002 2024-09-17T02:22:28.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:28.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556329+0000", 2024-09-17T02:22:28.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000493458 2024-09-17T02:22:28.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:28.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556784+0000", 2024-09-17T02:22:28.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045476499999999999 2024-09-17T02:22:28.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569852+0000", 2024-09-17T02:22:28.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013068270999999999 2024-09-17T02:22:28.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:28.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569958+0000", 2024-09-17T02:22:28.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106214 2024-09-17T02:22:28.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:28.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570124+0000", 2024-09-17T02:22:28.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165546 2024-09-17T02:22:28.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:28.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570359+0000", 2024-09-17T02:22:28.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023525799999999999 2024-09-17T02:22:28.215 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.215 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:28.216 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.216 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129537 5.4 5:260327c6:::benchmark_data_smithi001_23533_object1420:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:28.216 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:28.216 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.517119078999997, 2024-09-17T02:22:28.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99624596499999996, 2024-09-17T02:22:28.216 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:28.216 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:28.216 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.216 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:28.216 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:28.216 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.216 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129537 2024-09-17T02:22:28.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.217 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:28.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:28.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:28.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:28.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:28.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:28.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578272+0000", 2024-09-17T02:22:28.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.164e-06 2024-09-17T02:22:28.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:28.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578278+0000", 2024-09-17T02:22:28.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5060000000000001e-06 2024-09-17T02:22:28.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:28.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578294+0000", 2024-09-17T02:22:28.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5687000000000001e-05 2024-09-17T02:22:28.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578329+0000", 2024-09-17T02:22:28.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5311999999999997e-05 2024-09-17T02:22:28.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578419+0000", 2024-09-17T02:22:28.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0054000000000002e-05 2024-09-17T02:22:28.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:28.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578435+0000", 2024-09-17T02:22:28.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5645999999999999e-05 2024-09-17T02:22:28.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560148+0000", 2024-09-17T02:22:28.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98171342299999997 2024-09-17T02:22:28.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:28.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560383+0000", 2024-09-17T02:22:28.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000234935 2024-09-17T02:22:28.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:28.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560586+0000", 2024-09-17T02:22:28.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000202909 2024-09-17T02:22:28.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570472+0000", 2024-09-17T02:22:28.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098856959999999994 2024-09-17T02:22:28.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:28.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574138+0000", 2024-09-17T02:22:28.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036660170000000001 2024-09-17T02:22:28.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:28.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574298+0000", 2024-09-17T02:22:28.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016025600000000001 2024-09-17T02:22:28.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:28.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574516+0000", 2024-09-17T02:22:28.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021835999999999999 2024-09-17T02:22:28.222 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.222 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:28.222 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.223 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129545 5.4 5:22366489:::benchmark_data_smithi001_23533_object1428:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:28.223 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:28.223 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.511256355999997, 2024-09-17T02:22:28.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99074544499999995, 2024-09-17T02:22:28.223 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:28.223 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:28.223 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.223 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:28.223 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:28.223 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.223 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129545 2024-09-17T02:22:28.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.224 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:28.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:28.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:28.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:28.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:28.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:28.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584135+0000", 2024-09-17T02:22:28.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4699999999999999e-06 2024-09-17T02:22:28.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:28.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584142+0000", 2024-09-17T02:22:28.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1620000000000002e-06 2024-09-17T02:22:28.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:28.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584170+0000", 2024-09-17T02:22:28.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7897000000000001e-05 2024-09-17T02:22:28.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584183+0000", 2024-09-17T02:22:28.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2814e-05 2024-09-17T02:22:28.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584299+0000", 2024-09-17T02:22:28.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116153 2024-09-17T02:22:28.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:28.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584316+0000", 2024-09-17T02:22:28.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7524999999999999e-05 2024-09-17T02:22:28.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563461+0000", 2024-09-17T02:22:28.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97914436699999996 2024-09-17T02:22:28.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:28.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563667+0000", 2024-09-17T02:22:28.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020689800000000001 2024-09-17T02:22:28.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:28.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563878+0000", 2024-09-17T02:22:28.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210275 2024-09-17T02:22:28.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570584+0000", 2024-09-17T02:22:28.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067066080000000002 2024-09-17T02:22:28.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:28.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574539+0000", 2024-09-17T02:22:28.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039550360000000003 2024-09-17T02:22:28.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:28.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574653+0000", 2024-09-17T02:22:28.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114003 2024-09-17T02:22:28.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:28.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574879+0000", 2024-09-17T02:22:28.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022523700000000001 2024-09-17T02:22:28.229 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.229 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:28.229 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.229 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129553 5.4 5:2e41ad40:::benchmark_data_smithi001_23533_object1436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:28.229 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:28.230 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.505833719999998, 2024-09-17T02:22:28.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99213429600000003, 2024-09-17T02:22:28.230 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:28.230 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:28.230 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.230 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:28.230 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:28.230 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.230 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129553 2024-09-17T02:22:28.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.230 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:28.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:28.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:28.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:28.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:28.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:28.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589557+0000", 2024-09-17T02:22:28.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2219999999999999e-06 2024-09-17T02:22:28.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:28.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589562+0000", 2024-09-17T02:22:28.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0649999999999998e-06 2024-09-17T02:22:28.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:28.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589575+0000", 2024-09-17T02:22:28.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3129000000000001e-05 2024-09-17T02:22:28.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589584+0000", 2024-09-17T02:22:28.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6200000000000005e-06 2024-09-17T02:22:28.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589693+0000", 2024-09-17T02:22:28.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109319 2024-09-17T02:22:28.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:28.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589714+0000", 2024-09-17T02:22:28.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0849999999999999e-05 2024-09-17T02:22:28.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566273+0000", 2024-09-17T02:22:28.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97655884999999998 2024-09-17T02:22:28.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:28.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566543+0000", 2024-09-17T02:22:28.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027059099999999998 2024-09-17T02:22:28.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:28.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566832+0000", 2024-09-17T02:22:28.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028898200000000002 2024-09-17T02:22:28.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:28.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581040+0000", 2024-09-17T02:22:28.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014208001 2024-09-17T02:22:28.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581200+0000", 2024-09-17T02:22:28.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159956 2024-09-17T02:22:28.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:28.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581427+0000", 2024-09-17T02:22:28.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000226309 2024-09-17T02:22:28.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:28.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581690+0000", 2024-09-17T02:22:28.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026340199999999998 2024-09-17T02:22:28.236 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.236 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:28.236 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.236 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129580 5.4 5:25ed887b:::benchmark_data_smithi001_23533_object1463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:28.236 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:28.236 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.484061676000003, 2024-09-17T02:22:28.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98001430499999997, 2024-09-17T02:22:28.237 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:28.237 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:28.237 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.237 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:28.237 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:28.237 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.237 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129580 2024-09-17T02:22:28.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.237 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:28.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:28.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:28.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:28.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:28.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:28.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611329+0000", 2024-09-17T02:22:28.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.22e-06 2024-09-17T02:22:28.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:28.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611335+0000", 2024-09-17T02:22:28.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1129999999999997e-06 2024-09-17T02:22:28.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:28.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611348+0000", 2024-09-17T02:22:28.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2342e-05 2024-09-17T02:22:28.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611356+0000", 2024-09-17T02:22:28.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.371e-06 2024-09-17T02:22:28.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611419+0000", 2024-09-17T02:22:28.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3393999999999996e-05 2024-09-17T02:22:28.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:28.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611427+0000", 2024-09-17T02:22:28.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999997e-06 2024-09-17T02:22:28.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570705+0000", 2024-09-17T02:22:28.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.95927859199999999 2024-09-17T02:22:28.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:28.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571009+0000", 2024-09-17T02:22:28.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030414599999999998 2024-09-17T02:22:28.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:28.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571241+0000", 2024-09-17T02:22:28.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023106799999999999 2024-09-17T02:22:28.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:28.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590789+0000", 2024-09-17T02:22:28.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019548763 2024-09-17T02:22:28.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590928+0000", 2024-09-17T02:22:28.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000139092 2024-09-17T02:22:28.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:28.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591086+0000", 2024-09-17T02:22:28.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015787400000000001 2024-09-17T02:22:28.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:28.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591342+0000", 2024-09-17T02:22:28.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025589900000000002 2024-09-17T02:22:28.243 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.243 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:28.243 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.243 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129603 5.4 5:25aaa5e8:::benchmark_data_smithi001_23533_object1486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:28.243 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:28.243 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.468001880000003, 2024-09-17T02:22:28.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96463198999999999, 2024-09-17T02:22:28.243 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:28.243 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:28.243 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.244 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:28.244 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:28.244 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.244 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129603 2024-09-17T02:22:28.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.244 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:28.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:28.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:28.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:28.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:28.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:28.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:28.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:22:28.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:28.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627392+0000", 2024-09-17T02:22:28.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0790000000000002e-06 2024-09-17T02:22:28.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:28.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627403+0000", 2024-09-17T02:22:28.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0866000000000001e-05 2024-09-17T02:22:28.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627409+0000", 2024-09-17T02:22:28.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.305e-06 2024-09-17T02:22:28.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627485+0000", 2024-09-17T02:22:28.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6582000000000006e-05 2024-09-17T02:22:28.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:28.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627499+0000", 2024-09-17T02:22:28.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:22:28.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574991+0000", 2024-09-17T02:22:28.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94749182300000001 2024-09-17T02:22:28.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:28.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575377+0000", 2024-09-17T02:22:28.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038629400000000003 2024-09-17T02:22:28.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:28.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575665+0000", 2024-09-17T02:22:28.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028759499999999997 2024-09-17T02:22:28.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:28.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590802+0000", 2024-09-17T02:22:28.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015136479 2024-09-17T02:22:28.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591614+0000", 2024-09-17T02:22:28.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081293100000000003 2024-09-17T02:22:28.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:28.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591764+0000", 2024-09-17T02:22:28.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014932199999999999 2024-09-17T02:22:28.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:28.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592020+0000", 2024-09-17T02:22:28.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025585099999999997 2024-09-17T02:22:28.249 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.249 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:28.250 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.250 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129607 5.4 5:2f638f1e:::benchmark_data_smithi001_23533_object1490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:28.250 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:28.250 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.466474974, 2024-09-17T02:22:28.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96352375899999998, 2024-09-17T02:22:28.250 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:28.250 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:28.250 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.250 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:28.250 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:28.250 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.250 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129607 2024-09-17T02:22:28.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.251 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:28.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:28.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:28.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:28.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:28.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:28.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628916+0000", 2024-09-17T02:22:28.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1710000000000001e-06 2024-09-17T02:22:28.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:28.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628920+0000", 2024-09-17T02:22:28.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-17T02:22:28.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:28.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628935+0000", 2024-09-17T02:22:28.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4474000000000001e-05 2024-09-17T02:22:28.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628944+0000", 2024-09-17T02:22:28.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9940000000000006e-06 2024-09-17T02:22:28.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628997+0000", 2024-09-17T02:22:28.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3579000000000003e-05 2024-09-17T02:22:28.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:28.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.629006+0000", 2024-09-17T02:22:28.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4009999999999997e-06 2024-09-17T02:22:28.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.577862+0000", 2024-09-17T02:22:28.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.948856335 2024-09-17T02:22:28.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:28.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578167+0000", 2024-09-17T02:22:28.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030532399999999999 2024-09-17T02:22:28.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:28.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578532+0000", 2024-09-17T02:22:28.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036428200000000001 2024-09-17T02:22:28.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:28.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591442+0000", 2024-09-17T02:22:28.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012910374000000001 2024-09-17T02:22:28.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592164+0000", 2024-09-17T02:22:28.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072242499999999996 2024-09-17T02:22:28.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:28.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592267+0000", 2024-09-17T02:22:28.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102205 2024-09-17T02:22:28.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:28.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592438+0000", 2024-09-17T02:22:28.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017165299999999999 2024-09-17T02:22:28.256 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.256 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:28.256 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.257 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129623 5.4 5:2cf5174b:::benchmark_data_smithi001_23533_object1506:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:28.257 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:28.257 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.442530687999998, 2024-09-17T02:22:28.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94334114499999999, 2024-09-17T02:22:28.257 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:28.257 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:28.257 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.257 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:28.257 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:28.257 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.257 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129623 2024-09-17T02:22:28.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.257 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:28.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:28.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:28.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:28.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:28.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:28.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652860+0000", 2024-09-17T02:22:28.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0330000000000001e-06 2024-09-17T02:22:28.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:28.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652864+0000", 2024-09-17T02:22:28.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.634e-06 2024-09-17T02:22:28.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:28.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652877+0000", 2024-09-17T02:22:28.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2591e-05 2024-09-17T02:22:28.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652883+0000", 2024-09-17T02:22:28.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1460000000000001e-06 2024-09-17T02:22:28.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652943+0000", 2024-09-17T02:22:28.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9833999999999997e-05 2024-09-17T02:22:28.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:28.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652950+0000", 2024-09-17T02:22:28.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.401e-06 2024-09-17T02:22:28.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581800+0000", 2024-09-17T02:22:28.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.92884935700000004 2024-09-17T02:22:28.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:28.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582122+0000", 2024-09-17T02:22:28.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032185200000000002 2024-09-17T02:22:28.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:28.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582689+0000", 2024-09-17T02:22:28.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056750400000000003 2024-09-17T02:22:28.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:28.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591458+0000", 2024-09-17T02:22:28.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008768685 2024-09-17T02:22:28.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595856+0000", 2024-09-17T02:22:28.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043977909999999999 2024-09-17T02:22:28.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:28.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595955+0000", 2024-09-17T02:22:28.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9166000000000006e-05 2024-09-17T02:22:28.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:28.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596200+0000", 2024-09-17T02:22:28.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024515099999999998 2024-09-17T02:22:28.263 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.263 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:28.263 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.263 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129642 5.4 5:255eb796:::benchmark_data_smithi001_23533_object1525:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:28.263 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:28.263 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.411294523999999, 2024-09-17T02:22:28.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.91257397299999998, 2024-09-17T02:22:28.264 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:28.264 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:28.264 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.264 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:28.264 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:28.264 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.264 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129642 2024-09-17T02:22:28.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.264 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:28.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:28.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:28.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:28.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:28.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:28.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684096+0000", 2024-09-17T02:22:28.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659999999999999e-06 2024-09-17T02:22:28.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:28.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684101+0000", 2024-09-17T02:22:28.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8110000000000002e-06 2024-09-17T02:22:28.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:28.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684114+0000", 2024-09-17T02:22:28.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2653000000000001e-05 2024-09-17T02:22:28.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684121+0000", 2024-09-17T02:22:28.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5100000000000001e-06 2024-09-17T02:22:28.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684181+0000", 2024-09-17T02:22:28.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0307999999999999e-05 2024-09-17T02:22:28.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:28.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684194+0000", 2024-09-17T02:22:28.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2916e-05 2024-09-17T02:22:28.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.587917+0000", 2024-09-17T02:22:28.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.90372220400000003 2024-09-17T02:22:28.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:28.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588215+0000", 2024-09-17T02:22:28.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029845400000000003 2024-09-17T02:22:28.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:28.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588470+0000", 2024-09-17T02:22:28.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025455399999999999 2024-09-17T02:22:28.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596318+0000", 2024-09-17T02:22:28.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078485589999999997 2024-09-17T02:22:28.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:28.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596354+0000", 2024-09-17T02:22:28.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5976999999999998e-05 2024-09-17T02:22:28.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:28.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596449+0000", 2024-09-17T02:22:28.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4728999999999994e-05 2024-09-17T02:22:28.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:28.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596669+0000", 2024-09-17T02:22:28.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220132 2024-09-17T02:22:28.270 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.270 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:28.270 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.270 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129649 5.4 5:2fe27050:::benchmark_data_smithi001_23533_object1532:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:28.270 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:28.270 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.379737781000003, 2024-09-17T02:22:28.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.88508119100000004, 2024-09-17T02:22:28.270 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:28.270 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:28.270 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.270 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:28.271 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:28.271 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.271 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129649 2024-09-17T02:22:28.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.271 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:28.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:28.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:28.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:28.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:28.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:28.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.272 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:28.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715653+0000", 2024-09-17T02:22:28.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3519999999999999e-06 2024-09-17T02:22:28.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.272 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:28.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715658+0000", 2024-09-17T02:22:28.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3120000000000001e-06 2024-09-17T02:22:28.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:28.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715677+0000", 2024-09-17T02:22:28.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-17T02:22:28.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715687+0000", 2024-09-17T02:22:28.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0146000000000001e-05 2024-09-17T02:22:28.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715821+0000", 2024-09-17T02:22:28.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013421 2024-09-17T02:22:28.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:28.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715840+0000", 2024-09-17T02:22:28.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8153999999999999e-05 2024-09-17T02:22:28.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:28.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592528+0000", 2024-09-17T02:22:28.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.87668860000000004 2024-09-17T02:22:28.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:28.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592702+0000", 2024-09-17T02:22:28.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017429300000000001 2024-09-17T02:22:28.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:28.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592945+0000", 2024-09-17T02:22:28.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000242048 2024-09-17T02:22:28.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:28.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600234+0000", 2024-09-17T02:22:28.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072897600000000002 2024-09-17T02:22:28.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600494+0000", 2024-09-17T02:22:28.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000259984 2024-09-17T02:22:28.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:28.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600555+0000", 2024-09-17T02:22:28.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1138999999999999e-05 2024-09-17T02:22:28.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:28.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:28.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:28.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600733+0000", 2024-09-17T02:22:28.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017753300000000001 2024-09-17T02:22:28.276 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.276 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:28.276 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.277 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:28.277 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:28.277 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:28.278 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:28.279 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:28.278+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:28.378 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:28.379+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:28.432 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:28.432 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:22:28.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.432 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:243680 5.0 5:070d642b:::benchmark_data_smithi001_23533_object115563:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T02:22:28.433 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:28.422924+0000", 2024-09-17T02:22:28.433 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.012032337000000001, 2024-09-17T02:22:28.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012050981000000001, 2024-09-17T02:22:28.433 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.433 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.433 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:28.433 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:28.433 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:28.433 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.433 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 243680 2024-09-17T02:22:28.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.433 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.422924+0000", 2024-09-17T02:22:28.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.422924+0000", 2024-09-17T02:22:28.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.422924+0000", 2024-09-17T02:22:28.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1699999999999998e-07 2024-09-17T02:22:28.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.422927+0000", 2024-09-17T02:22:28.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.869e-06 2024-09-17T02:22:28.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:28.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.422934+0000", 2024-09-17T02:22:28.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3289999999999996e-06 2024-09-17T02:22:28.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.422941+0000", 2024-09-17T02:22:28.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1859999999999997e-06 2024-09-17T02:22:28.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:28.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.427468+0000", 2024-09-17T02:22:28.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045278289999999997 2024-09-17T02:22:28.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:28.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.427540+0000", 2024-09-17T02:22:28.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1019000000000006e-05 2024-09-17T02:22:28.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:28.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.427599+0000", 2024-09-17T02:22:28.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9076999999999997e-05 2024-09-17T02:22:28.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.433716+0000", 2024-09-17T02:22:28.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0061178489999999999 2024-09-17T02:22:28.437 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.437 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:28.438 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.438 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:243687 5.0 5:07180fa6:::benchmark_data_smithi001_23533_object115570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T02:22:28.438 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:28.426962+0000", 2024-09-17T02:22:28.438 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0079942209999999993, 2024-09-17T02:22:28.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0080618830000000006, 2024-09-17T02:22:28.438 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.438 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.438 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:28.438 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:28.438 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:28.438 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.438 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 243687 2024-09-17T02:22:28.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.439 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.426962+0000", 2024-09-17T02:22:28.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.426962+0000", 2024-09-17T02:22:28.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.426962+0000", 2024-09-17T02:22:28.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5299999999999999e-07 2024-09-17T02:22:28.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.426965+0000", 2024-09-17T02:22:28.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.117e-06 2024-09-17T02:22:28.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:28.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.426972+0000", 2024-09-17T02:22:28.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5429999999999999e-06 2024-09-17T02:22:28.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.426977+0000", 2024-09-17T02:22:28.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3020000000000002e-06 2024-09-17T02:22:28.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:28.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.429159+0000", 2024-09-17T02:22:28.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021822040000000001 2024-09-17T02:22:28.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:28.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.429223+0000", 2024-09-17T02:22:28.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4045000000000001e-05 2024-09-17T02:22:28.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:28.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.429290+0000", 2024-09-17T02:22:28.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7020000000000005e-05 2024-09-17T02:22:28.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.433739+0000", 2024-09-17T02:22:28.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044483270000000002 2024-09-17T02:22:28.443 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.443 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:28.443 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.443 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:243692 5.8 5:1427910d:::benchmark_data_smithi001_23533_object115575:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T02:22:28.443 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:28.429504+0000", 2024-09-17T02:22:28.443 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0054521910000000003, 2024-09-17T02:22:28.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055677449999999998, 2024-09-17T02:22:28.443 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.443 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.443 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:28.443 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:28.444 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:28.444 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.444 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 243692 2024-09-17T02:22:28.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.444 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.429504+0000", 2024-09-17T02:22:28.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.429504+0000", 2024-09-17T02:22:28.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.429504+0000", 2024-09-17T02:22:28.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2200000000000004e-07 2024-09-17T02:22:28.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.429507+0000", 2024-09-17T02:22:28.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6850000000000001e-06 2024-09-17T02:22:28.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:28.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.429515+0000", 2024-09-17T02:22:28.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4449999999999999e-06 2024-09-17T02:22:28.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.429520+0000", 2024-09-17T02:22:28.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6969999999999998e-06 2024-09-17T02:22:28.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:28.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.431142+0000", 2024-09-17T02:22:28.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00162141 2024-09-17T02:22:28.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:28.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.431305+0000", 2024-09-17T02:22:28.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000163361 2024-09-17T02:22:28.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:28.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.431414+0000", 2024-09-17T02:22:28.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109357 2024-09-17T02:22:28.447 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.447 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:28.448 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.448 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:243695 5.8 5:15a54d64:::benchmark_data_smithi001_23533_object115578:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T02:22:28.448 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:28.429655+0000", 2024-09-17T02:22:28.448 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0053011669999999999, 2024-09-17T02:22:28.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0054593230000000003, 2024-09-17T02:22:28.448 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.448 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.448 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:28.448 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:28.448 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:28.449 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.449 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 243695 2024-09-17T02:22:28.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.449 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.429655+0000", 2024-09-17T02:22:28.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.429655+0000", 2024-09-17T02:22:28.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.429655+0000", 2024-09-17T02:22:28.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4199999999999996e-07 2024-09-17T02:22:28.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.429659+0000", 2024-09-17T02:22:28.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4979999999999998e-06 2024-09-17T02:22:28.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:28.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.429666+0000", 2024-09-17T02:22:28.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6170000000000001e-06 2024-09-17T02:22:28.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.429672+0000", 2024-09-17T02:22:28.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8860000000000001e-06 2024-09-17T02:22:28.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:28.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.433730+0000", 2024-09-17T02:22:28.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004058112 2024-09-17T02:22:28.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:28.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.433852+0000", 2024-09-17T02:22:28.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000121087 2024-09-17T02:22:28.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:28.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.433969+0000", 2024-09-17T02:22:28.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117707 2024-09-17T02:22:28.452 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.452 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:28.452 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.452 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:243694 5.b e72/51 5:dd3debe4:::benchmark_data_smithi001_23533_object115577:head v 72'15092, mlcod=72'15088)", 2024-09-17T02:22:28.452 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:28.430461+0000", 2024-09-17T02:22:28.452 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0044948820000000004, 2024-09-17T02:22:28.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047211800000000002, 2024-09-17T02:22:28.453 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.453 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.453 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:28.453 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.430461+0000", 2024-09-17T02:22:28.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.430461+0000", 2024-09-17T02:22:28.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.430462+0000", 2024-09-17T02:22:28.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3399999999999999e-07 2024-09-17T02:22:28.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.430466+0000", 2024-09-17T02:22:28.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0180000000000003e-06 2024-09-17T02:22:28.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:28.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.430474+0000", 2024-09-17T02:22:28.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4290000000000001e-06 2024-09-17T02:22:28.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.430481+0000", 2024-09-17T02:22:28.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.669e-06 2024-09-17T02:22:28.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:28.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.432733+0000", 2024-09-17T02:22:28.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002251641 2024-09-17T02:22:28.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:28.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.432753+0000", 2024-09-17T02:22:28.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0168000000000001e-05 2024-09-17T02:22:28.456 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.456 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:28.456 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.456 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4466.0:243692 5.8 e72/26)", 2024-09-17T02:22:28.456 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:28.434069+0000", 2024-09-17T02:22:28.456 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00088727700000000001, 2024-09-17T02:22:28.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011650720000000001, 2024-09-17T02:22:28.457 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.457 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.457 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:28.457 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434069+0000", 2024-09-17T02:22:28.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434069+0000", 2024-09-17T02:22:28.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434069+0000", 2024-09-17T02:22:28.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0500000000000003e-07 2024-09-17T02:22:28.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434073+0000", 2024-09-17T02:22:28.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4860000000000002e-06 2024-09-17T02:22:28.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:28.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434081+0000", 2024-09-17T02:22:28.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3629999999999994e-06 2024-09-17T02:22:28.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434087+0000", 2024-09-17T02:22:28.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9030000000000001e-06 2024-09-17T02:22:28.459 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.459 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:28.459 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.460 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:243697 5.3 e72/64 5:c988a1df:::benchmark_data_smithi001_23533_object115580:head v 72'15325, mlcod=72'15323)", 2024-09-17T02:22:28.460 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:28.434099+0000", 2024-09-17T02:22:28.460 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.000856951, 2024-09-17T02:22:28.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001179339, 2024-09-17T02:22:28.460 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.460 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.460 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:28.460 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434099+0000", 2024-09-17T02:22:28.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434099+0000", 2024-09-17T02:22:28.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434099+0000", 2024-09-17T02:22:28.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8900000000000001e-07 2024-09-17T02:22:28.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434103+0000", 2024-09-17T02:22:28.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8800000000000001e-06 2024-09-17T02:22:28.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:28.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434110+0000", 2024-09-17T02:22:28.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5180000000000001e-06 2024-09-17T02:22:28.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434114+0000", 2024-09-17T02:22:28.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9009999999999996e-06 2024-09-17T02:22:28.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:28.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434152+0000", 2024-09-17T02:22:28.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8658000000000002e-05 2024-09-17T02:22:28.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:28.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434170+0000", 2024-09-17T02:22:28.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.804e-05 2024-09-17T02:22:28.463 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.463 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:28.463 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.463 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:243698 5.5 5:a46e2e0f:::benchmark_data_smithi001_23533_object115581:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T02:22:28.464 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:28.434129+0000", 2024-09-17T02:22:28.464 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00082665500000000003, 2024-09-17T02:22:28.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012074189999999999, 2024-09-17T02:22:28.464 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.464 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.464 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:28.464 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:28.464 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:28.464 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.464 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 243698 2024-09-17T02:22:28.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.465 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434129+0000", 2024-09-17T02:22:28.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434129+0000", 2024-09-17T02:22:28.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434130+0000", 2024-09-17T02:22:28.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7000000000000004e-07 2024-09-17T02:22:28.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434133+0000", 2024-09-17T02:22:28.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8030000000000001e-06 2024-09-17T02:22:28.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:28.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434138+0000", 2024-09-17T02:22:28.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9300000000000002e-06 2024-09-17T02:22:28.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434141+0000", 2024-09-17T02:22:28.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.495e-06 2024-09-17T02:22:28.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:28.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434195+0000", 2024-09-17T02:22:28.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3949999999999997e-05 2024-09-17T02:22:28.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:28.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434279+0000", 2024-09-17T02:22:28.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3590000000000004e-05 2024-09-17T02:22:28.468 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.468 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:28.468 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.468 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:243699 5.6 5:645e7ea0:::benchmark_data_smithi001_23533_object115582:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T02:22:28.468 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:28.434584+0000", 2024-09-17T02:22:28.468 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00037201999999999998, 2024-09-17T02:22:28.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00081290799999999999, 2024-09-17T02:22:28.468 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.468 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.468 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:28.469 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:28.469 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:28.469 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.469 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 243699 2024-09-17T02:22:28.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.469 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434584+0000", 2024-09-17T02:22:28.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434584+0000", 2024-09-17T02:22:28.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434585+0000", 2024-09-17T02:22:28.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4200000000000005e-07 2024-09-17T02:22:28.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434588+0000", 2024-09-17T02:22:28.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5200000000000002e-06 2024-09-17T02:22:28.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:28.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434598+0000", 2024-09-17T02:22:28.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2660000000000007e-06 2024-09-17T02:22:28.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434604+0000", 2024-09-17T02:22:28.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.46e-06 2024-09-17T02:22:28.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:28.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434643+0000", 2024-09-17T02:22:28.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8461000000000003e-05 2024-09-17T02:22:28.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:28.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434718+0000", 2024-09-17T02:22:28.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5642000000000005e-05 2024-09-17T02:22:28.472 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.473 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:28.473 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.473 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:243701 5.8 5.f22f6b8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T02:22:28.473 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:28.434679+0000", 2024-09-17T02:22:28.473 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00027704299999999998, 2024-09-17T02:22:28.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00077598200000000004, 2024-09-17T02:22:28.473 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.473 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.473 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:28.473 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:28.473 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:28.473 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.474 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 243701 2024-09-17T02:22:28.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.474 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434679+0000", 2024-09-17T02:22:28.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434679+0000", 2024-09-17T02:22:28.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434680+0000", 2024-09-17T02:22:28.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8599999999999998e-07 2024-09-17T02:22:28.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434683+0000", 2024-09-17T02:22:28.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.988e-06 2024-09-17T02:22:28.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:28.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434692+0000", 2024-09-17T02:22:28.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1009999999999998e-06 2024-09-17T02:22:28.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434697+0000", 2024-09-17T02:22:28.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4399999999999996e-06 2024-09-17T02:22:28.476 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.476 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:28.476 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.476 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:243676 5.0 5:00e5d171:::benchmark_data_smithi001_23533_object115559:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T02:22:28.476 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:28.422550+0000", 2024-09-17T02:22:28.476 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.01240603, 2024-09-17T02:22:28.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012956687, 2024-09-17T02:22:28.477 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.477 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.477 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:28.477 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:28.477 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:28.477 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.477 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 243676 2024-09-17T02:22:28.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.477 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.422550+0000", 2024-09-17T02:22:28.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.422550+0000", 2024-09-17T02:22:28.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.422550+0000", 2024-09-17T02:22:28.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9900000000000001e-07 2024-09-17T02:22:28.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.422553+0000", 2024-09-17T02:22:28.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7149999999999998e-06 2024-09-17T02:22:28.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:28.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.422560+0000", 2024-09-17T02:22:28.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1130000000000003e-06 2024-09-17T02:22:28.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.422578+0000", 2024-09-17T02:22:28.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7669999999999999e-05 2024-09-17T02:22:28.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:28.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.425101+0000", 2024-09-17T02:22:28.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025232100000000001 2024-09-17T02:22:28.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:28.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.425226+0000", 2024-09-17T02:22:28.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000124957 2024-09-17T02:22:28.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:28.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.425328+0000", 2024-09-17T02:22:28.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101582 2024-09-17T02:22:28.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.429139+0000", 2024-09-17T02:22:28.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003810796 2024-09-17T02:22:28.481 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.481 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:28.481 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.481 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:243703 5.a 5:54a87ba9:::benchmark_data_smithi001_23533_object115586:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T02:22:28.481 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:28.434778+0000", 2024-09-17T02:22:28.481 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00017804, 2024-09-17T02:22:28.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00079982700000000002, 2024-09-17T02:22:28.481 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.481 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.481 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:28.481 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:28.482 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:28.482 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.482 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 243703 2024-09-17T02:22:28.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.482 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434778+0000", 2024-09-17T02:22:28.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434778+0000", 2024-09-17T02:22:28.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434778+0000", 2024-09-17T02:22:28.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1799999999999995e-07 2024-09-17T02:22:28.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434781+0000", 2024-09-17T02:22:28.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7499999999999999e-06 2024-09-17T02:22:28.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:28.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434788+0000", 2024-09-17T02:22:28.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3709999999999996e-06 2024-09-17T02:22:28.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434793+0000", 2024-09-17T02:22:28.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5149999999999997e-06 2024-09-17T02:22:28.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:28.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.434917+0000", 2024-09-17T02:22:28.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012399700000000001 2024-09-17T02:22:28.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:28.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.435014+0000", 2024-09-17T02:22:28.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6935999999999995e-05 2024-09-17T02:22:28.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:28.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:28.435105+0000", 2024-09-17T02:22:28.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1042e-05 2024-09-17T02:22:28.485 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.485 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:28.485 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.485 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.485 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:22:28.485 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 12 2024-09-17T02:22:28.485 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:28.487 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:28.487 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:28.486+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:28.588 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:28.586+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:28.681 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:28.681 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:22:28.681 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:22:28.681 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:22:28.681 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:28.690 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:28.691+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:28.701 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:28.791 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:28.790+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:28.894 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:28.891+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:28.897 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:28.897 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:22:28.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:22:28.897 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:22:28.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.897 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:22:28.898 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:28.898 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 106.329725196, 2024-09-17T02:22:28.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:22:28.898 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.898 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.898 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.898 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:28.898 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:28.899 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.899 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:22:28.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.899 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:28.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:28.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:22:28.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:22:28.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:22:28.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:22:28.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:28.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:22:28.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:22:28.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:22:28.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:22:28.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:28.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:22:28.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:22:28.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:28.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:22:28.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:22:28.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:28.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:22:28.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:22:28.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:28.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:22:28.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:22:28.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:22:28.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:22:28.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:28.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:22:28.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:22:28.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:28.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:22:28.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:22:28.906 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.906 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:28.906 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.906 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28735 5.a 5:5d9367db:::benchmark_data_smithi001_23533_object28734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:22:28.906 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:28.906 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 106.325822946, 2024-09-17T02:22:28.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030748576999999999, 2024-09-17T02:22:28.907 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.907 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.907 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.907 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:28.907 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:28.908 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.908 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28735 2024-09-17T02:22:28.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.908 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:28.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572365+0000", 2024-09-17T02:22:28.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572366+0000", 2024-09-17T02:22:28.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0359999999999999e-06 2024-09-17T02:22:28.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572422+0000", 2024-09-17T02:22:28.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5398000000000001e-05 2024-09-17T02:22:28.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:28.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572433+0000", 2024-09-17T02:22:28.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1338000000000001e-05 2024-09-17T02:22:28.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572444+0000", 2024-09-17T02:22:28.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1123e-05 2024-09-17T02:22:28.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:28.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572490+0000", 2024-09-17T02:22:28.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6205000000000002e-05 2024-09-17T02:22:28.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:28.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572571+0000", 2024-09-17T02:22:28.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0210999999999995e-05 2024-09-17T02:22:28.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:28.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.572650+0000", 2024-09-17T02:22:28.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9072000000000005e-05 2024-09-17T02:22:28.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:28.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.574615+0000", 2024-09-17T02:22:28.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001965077 2024-09-17T02:22:28.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603012+0000", 2024-09-17T02:22:28.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028397399 2024-09-17T02:22:28.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:28.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603070+0000", 2024-09-17T02:22:28.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7797000000000002e-05 2024-09-17T02:22:28.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:28.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.603114+0000", 2024-09-17T02:22:28.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3921000000000002e-05 2024-09-17T02:22:28.913 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.913 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:28.913 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.914 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97759 5.a 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:28.914 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:28.914 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 71.299803123000004, 2024-09-17T02:22:28.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.089694871999999995, 2024-09-17T02:22:28.914 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.914 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.914 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.914 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:28.914 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:28.914 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.914 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97759 2024-09-17T02:22:28.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.915 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:28.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:28.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598386+0000", 2024-09-17T02:22:28.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999999e-07 2024-09-17T02:22:28.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598414+0000", 2024-09-17T02:22:28.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8013000000000001e-05 2024-09-17T02:22:28.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:28.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598420+0000", 2024-09-17T02:22:28.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1149999999999999e-06 2024-09-17T02:22:28.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598424+0000", 2024-09-17T02:22:28.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:22:28.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:28.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598479+0000", 2024-09-17T02:22:28.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4648999999999998e-05 2024-09-17T02:22:28.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:28.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598587+0000", 2024-09-17T02:22:28.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010853000000000001 2024-09-17T02:22:28.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:28.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598676+0000", 2024-09-17T02:22:28.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8381999999999995e-05 2024-09-17T02:22:28.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:28.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603766+0000", 2024-09-17T02:22:28.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050902559999999996 2024-09-17T02:22:28.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.687988+0000", 2024-09-17T02:22:28.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.084221753999999996 2024-09-17T02:22:28.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:28.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688037+0000", 2024-09-17T02:22:28.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-05 2024-09-17T02:22:28.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:28.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688080+0000", 2024-09-17T02:22:28.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3149999999999999e-05 2024-09-17T02:22:28.920 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.921 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:28.921 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.921 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97770 5.0 5:09c75033:::benchmark_data_smithi001_23533_object97769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:28.921 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:28.921 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 71.294660692999997, 2024-09-17T02:22:28.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.086380868, 2024-09-17T02:22:28.921 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.921 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.921 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.921 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:28.922 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:28.922 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.922 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97770 2024-09-17T02:22:28.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.922 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:28.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:28.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603529+0000", 2024-09-17T02:22:28.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:22:28.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603593+0000", 2024-09-17T02:22:28.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4216999999999999e-05 2024-09-17T02:22:28.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:28.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603603+0000", 2024-09-17T02:22:28.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5179999999999993e-06 2024-09-17T02:22:28.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603608+0000", 2024-09-17T02:22:28.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2039999999999996e-06 2024-09-17T02:22:28.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:28.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603653+0000", 2024-09-17T02:22:28.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5247000000000002e-05 2024-09-17T02:22:28.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:28.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603758+0000", 2024-09-17T02:22:28.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105352 2024-09-17T02:22:28.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:28.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603900+0000", 2024-09-17T02:22:28.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014198999999999999 2024-09-17T02:22:28.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:28.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.606097+0000", 2024-09-17T02:22:28.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021969839999999999 2024-09-17T02:22:28.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689756+0000", 2024-09-17T02:22:28.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.083659077999999998 2024-09-17T02:22:28.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:28.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689846+0000", 2024-09-17T02:22:28.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9320999999999994e-05 2024-09-17T02:22:28.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:28.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689908+0000", 2024-09-17T02:22:28.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720999999999998e-05 2024-09-17T02:22:28.929 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.929 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:28.929 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.930 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127513 5.c 5:3eca08e4:::benchmark_data_smithi001_23533_object127512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:28.930 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:28.930 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 56.453884269, 2024-09-17T02:22:28.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046626399999999998, 2024-09-17T02:22:28.931 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.931 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.931 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.931 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:28.931 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:28.931 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.932 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127513 2024-09-17T02:22:28.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.932 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:28.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:28.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444305+0000", 2024-09-17T02:22:28.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2529999999999999e-06 2024-09-17T02:22:28.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444466+0000", 2024-09-17T02:22:28.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016069700000000001 2024-09-17T02:22:28.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:28.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444479+0000", 2024-09-17T02:22:28.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2602999999999999e-05 2024-09-17T02:22:28.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444485+0000", 2024-09-17T02:22:28.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.669e-06 2024-09-17T02:22:28.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:28.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444560+0000", 2024-09-17T02:22:28.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4276999999999994e-05 2024-09-17T02:22:28.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:28.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444656+0000", 2024-09-17T02:22:28.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6490000000000006e-05 2024-09-17T02:22:28.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:28.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444739+0000", 2024-09-17T02:22:28.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3139999999999993e-05 2024-09-17T02:22:28.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:28.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.448438+0000", 2024-09-17T02:22:28.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036985490000000002 2024-09-17T02:22:28.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490732+0000", 2024-09-17T02:22:28.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042294353999999999 2024-09-17T02:22:28.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:28.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490859+0000", 2024-09-17T02:22:28.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012708899999999999 2024-09-17T02:22:28.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:28.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490930+0000", 2024-09-17T02:22:28.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:28.943 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.943 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:28.943 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.944 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127514 5.c 5:39cc1feb:::benchmark_data_smithi001_23533_object127513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:28.944 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:28.944 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 56.453687500000001, 2024-09-17T02:22:28.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049357228000000003, 2024-09-17T02:22:28.945 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.945 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.945 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.945 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:28.945 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:28.945 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.945 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127514 2024-09-17T02:22:28.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.946 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:28.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:28.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:28.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8599999999999998e-07 2024-09-17T02:22:28.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444554+0000", 2024-09-17T02:22:28.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3047999999999998e-05 2024-09-17T02:22:28.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:28.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444562+0000", 2024-09-17T02:22:28.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5830000000000001e-06 2024-09-17T02:22:28.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444567+0000", 2024-09-17T02:22:28.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4179999999999996e-06 2024-09-17T02:22:28.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:28.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446566+0000", 2024-09-17T02:22:28.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001998788 2024-09-17T02:22:28.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:28.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446696+0000", 2024-09-17T02:22:28.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129393 2024-09-17T02:22:28.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:28.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446794+0000", 2024-09-17T02:22:28.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8462999999999996e-05 2024-09-17T02:22:28.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:28.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.449036+0000", 2024-09-17T02:22:28.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022415880000000001 2024-09-17T02:22:28.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493737+0000", 2024-09-17T02:22:28.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044701682 2024-09-17T02:22:28.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:28.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493808+0000", 2024-09-17T02:22:28.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0846000000000006e-05 2024-09-17T02:22:28.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:28.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493858+0000", 2024-09-17T02:22:28.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9932999999999998e-05 2024-09-17T02:22:28.950 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.951 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:28.951 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.951 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129441 5.1 5:84c3199f:::benchmark_data_smithi001_23533_object1324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:28.951 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:28.951 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.394677012000002, 2024-09-17T02:22:28.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034387011000000002, 2024-09-17T02:22:28.951 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.951 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.951 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.951 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:28.951 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:28.952 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.952 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129441 2024-09-17T02:22:28.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.952 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:28.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:28.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503513+0000", 2024-09-17T02:22:28.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4759999999999999e-06 2024-09-17T02:22:28.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503518+0000", 2024-09-17T02:22:28.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-09-17T02:22:28.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:28.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503532+0000", 2024-09-17T02:22:28.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4049999999999999e-05 2024-09-17T02:22:28.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503541+0000", 2024-09-17T02:22:28.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5320000000000006e-06 2024-09-17T02:22:28.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:28.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506331+0000", 2024-09-17T02:22:28.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027899190000000001 2024-09-17T02:22:28.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:28.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506402+0000", 2024-09-17T02:22:28.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:28.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:28.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506477+0000", 2024-09-17T02:22:28.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4626e-05 2024-09-17T02:22:28.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:28.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509749+0000", 2024-09-17T02:22:28.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032726980000000001 2024-09-17T02:22:28.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537758+0000", 2024-09-17T02:22:28.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028008890000000002 2024-09-17T02:22:28.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:28.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537812+0000", 2024-09-17T02:22:28.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3300000000000001e-05 2024-09-17T02:22:28.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:28.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537898+0000", 2024-09-17T02:22:28.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6691000000000001e-05 2024-09-17T02:22:28.957 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.957 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:28.957 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.957 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129442 5.1 5:8f7f2a95:::benchmark_data_smithi001_23533_object1325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:28.957 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:28.957 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.391706403000001, 2024-09-17T02:22:28.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031546698999999997, 2024-09-17T02:22:28.957 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.957 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.958 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.958 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:28.958 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:28.958 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.958 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129442 2024-09-17T02:22:28.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.958 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:28.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506482+0000", 2024-09-17T02:22:28.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506483+0000", 2024-09-17T02:22:28.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2869999999999999e-06 2024-09-17T02:22:28.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506489+0000", 2024-09-17T02:22:28.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2330000000000003e-06 2024-09-17T02:22:28.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:28.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506502+0000", 2024-09-17T02:22:28.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2286999999999999e-05 2024-09-17T02:22:28.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506511+0000", 2024-09-17T02:22:28.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7799999999999995e-06 2024-09-17T02:22:28.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:28.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.507966+0000", 2024-09-17T02:22:28.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014541549999999999 2024-09-17T02:22:28.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:28.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508130+0000", 2024-09-17T02:22:28.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016455199999999999 2024-09-17T02:22:28.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:28.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.508287+0000", 2024-09-17T02:22:28.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015730400000000001 2024-09-17T02:22:28.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:28.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.510577+0000", 2024-09-17T02:22:28.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022899449999999998 2024-09-17T02:22:28.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537932+0000", 2024-09-17T02:22:28.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027354471000000002 2024-09-17T02:22:28.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:28.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537964+0000", 2024-09-17T02:22:28.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1909999999999998e-05 2024-09-17T02:22:28.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:28.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.538029+0000", 2024-09-17T02:22:28.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4775000000000002e-05 2024-09-17T02:22:28.963 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.963 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:28.963 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.963 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:150458 5.a 5:59b62890:::benchmark_data_smithi001_23533_object22341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T02:22:28.963 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:28.963 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.059862596000002, 2024-09-17T02:22:28.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028150173000000001, 2024-09-17T02:22:28.964 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.964 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.964 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.964 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:28.964 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:28.964 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:28.964 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 150458 2024-09-17T02:22:28.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.964 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:28.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:28.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838326+0000", 2024-09-17T02:22:28.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7800000000000002e-07 2024-09-17T02:22:28.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838328+0000", 2024-09-17T02:22:28.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.838e-06 2024-09-17T02:22:28.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:28.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838335+0000", 2024-09-17T02:22:28.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1999999999999997e-06 2024-09-17T02:22:28.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.838340+0000", 2024-09-17T02:22:28.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7389999999999999e-06 2024-09-17T02:22:28.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:28.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849082+0000", 2024-09-17T02:22:28.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01074174 2024-09-17T02:22:28.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:28.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849192+0000", 2024-09-17T02:22:28.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011040300000000001 2024-09-17T02:22:28.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:28.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.849297+0000", 2024-09-17T02:22:28.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104764 2024-09-17T02:22:28.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:28.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.857853+0000", 2024-09-17T02:22:28.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085558490000000008 2024-09-17T02:22:28.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:28.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866430+0000", 2024-09-17T02:22:28.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085768140000000003 2024-09-17T02:22:28.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:28.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866454+0000", 2024-09-17T02:22:28.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4428000000000001e-05 2024-09-17T02:22:28.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:28.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:45.866476+0000", 2024-09-17T02:22:28.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.192e-05 2024-09-17T02:22:28.969 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.969 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:28.969 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.969 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190780 5.3 e65/64 5:c634f18a:::benchmark_data_smithi001_23533_object62663:head v 65'12039, mlcod=0'0)", 2024-09-17T02:22:28.969 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.182278+0000", 2024-09-17T02:22:28.970 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.715910507, 2024-09-17T02:22:28.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028943393000000001, 2024-09-17T02:22:28.970 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.970 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.970 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.970 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182278+0000", 2024-09-17T02:22:28.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182278+0000", 2024-09-17T02:22:28.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182280+0000", 2024-09-17T02:22:28.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.736e-06 2024-09-17T02:22:28.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182291+0000", 2024-09-17T02:22:28.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1933000000000001e-05 2024-09-17T02:22:28.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:28.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182317+0000", 2024-09-17T02:22:28.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6024999999999999e-05 2024-09-17T02:22:28.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182332+0000", 2024-09-17T02:22:28.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4856e-05 2024-09-17T02:22:28.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:28.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182463+0000", 2024-09-17T02:22:28.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130674 2024-09-17T02:22:28.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:28.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.182533+0000", 2024-09-17T02:22:28.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0296999999999995e-05 2024-09-17T02:22:28.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:28.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211153+0000", 2024-09-17T02:22:28.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028619265000000001 2024-09-17T02:22:28.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:28.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211221+0000", 2024-09-17T02:22:28.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8607000000000002e-05 2024-09-17T02:22:28.974 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.974 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:28.974 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.974 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190799 5.3 e65/64 5:c0e8780b:::benchmark_data_smithi001_23533_object62682:head v 65'12040, mlcod=0'0)", 2024-09-17T02:22:28.974 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.193849+0000", 2024-09-17T02:22:28.974 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.704339155, 2024-09-17T02:22:28.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02989934, 2024-09-17T02:22:28.974 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.974 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.974 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.975 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193849+0000", 2024-09-17T02:22:28.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193849+0000", 2024-09-17T02:22:28.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193851+0000", 2024-09-17T02:22:28.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.137e-06 2024-09-17T02:22:28.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193865+0000", 2024-09-17T02:22:28.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3845999999999999e-05 2024-09-17T02:22:28.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:28.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193888+0000", 2024-09-17T02:22:28.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3312e-05 2024-09-17T02:22:28.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.193901+0000", 2024-09-17T02:22:28.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2896e-05 2024-09-17T02:22:28.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:28.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.204084+0000", 2024-09-17T02:22:28.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010182538 2024-09-17T02:22:28.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:28.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.204126+0000", 2024-09-17T02:22:28.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1828e-05 2024-09-17T02:22:28.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:28.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223688+0000", 2024-09-17T02:22:28.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019562408999999999 2024-09-17T02:22:28.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:28.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223748+0000", 2024-09-17T02:22:28.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0374000000000002e-05 2024-09-17T02:22:28.978 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.978 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:28.978 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.979 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190836 5.3 e65/64 5:c72f74ff:::benchmark_data_smithi001_23533_object62719:head v 65'12042, mlcod=0'0)", 2024-09-17T02:22:28.979 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.198478+0000", 2024-09-17T02:22:28.979 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.699710263, 2024-09-17T02:22:28.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031214246000000001, 2024-09-17T02:22:28.979 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.979 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.979 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.979 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198478+0000", 2024-09-17T02:22:28.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198478+0000", 2024-09-17T02:22:28.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198480+0000", 2024-09-17T02:22:28.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0899999999999999e-06 2024-09-17T02:22:28.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198494+0000", 2024-09-17T02:22:28.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3572e-05 2024-09-17T02:22:28.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:28.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198521+0000", 2024-09-17T02:22:28.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7178999999999998e-05 2024-09-17T02:22:28.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.198533+0000", 2024-09-17T02:22:28.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2588999999999999e-05 2024-09-17T02:22:28.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:28.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208944+0000", 2024-09-17T02:22:28.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010410236 2024-09-17T02:22:28.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:28.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208979+0000", 2024-09-17T02:22:28.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5555000000000001e-05 2024-09-17T02:22:28.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:28.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229627+0000", 2024-09-17T02:22:28.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020647993999999999 2024-09-17T02:22:28.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:28.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229692+0000", 2024-09-17T02:22:28.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5030999999999995e-05 2024-09-17T02:22:28.983 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.983 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:28.983 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.983 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190852 5.3 e65/64 5:c63de204:::benchmark_data_smithi001_23533_object62735:head v 65'12043, mlcod=0'0)", 2024-09-17T02:22:28.983 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.200082+0000", 2024-09-17T02:22:28.983 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.698106265, 2024-09-17T02:22:28.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029657795000000001, 2024-09-17T02:22:28.984 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.984 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.984 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.984 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200082+0000", 2024-09-17T02:22:28.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200082+0000", 2024-09-17T02:22:28.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200084+0000", 2024-09-17T02:22:28.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1900000000000002e-06 2024-09-17T02:22:28.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200099+0000", 2024-09-17T02:22:28.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4392999999999999e-05 2024-09-17T02:22:28.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:28.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200122+0000", 2024-09-17T02:22:28.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3292e-05 2024-09-17T02:22:28.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.200134+0000", 2024-09-17T02:22:28.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2489e-05 2024-09-17T02:22:28.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:28.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211322+0000", 2024-09-17T02:22:28.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011187689000000001 2024-09-17T02:22:28.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:28.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211383+0000", 2024-09-17T02:22:28.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0707e-05 2024-09-17T02:22:28.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:28.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229698+0000", 2024-09-17T02:22:28.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018315306999999999 2024-09-17T02:22:28.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:28.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229740+0000", 2024-09-17T02:22:28.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1727999999999998e-05 2024-09-17T02:22:28.988 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.988 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:28.988 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.988 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190920 5.3 e65/64 5:c7bc6082:::benchmark_data_smithi001_23533_object62803:head v 65'12047, mlcod=0'0)", 2024-09-17T02:22:28.988 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.206674+0000", 2024-09-17T02:22:28.988 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.691514289000001, 2024-09-17T02:22:28.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.033826457999999997, 2024-09-17T02:22:28.988 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.988 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.988 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.988 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206674+0000", 2024-09-17T02:22:28.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206674+0000", 2024-09-17T02:22:28.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206676+0000", 2024-09-17T02:22:28.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.646e-06 2024-09-17T02:22:28.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206689+0000", 2024-09-17T02:22:28.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3196999999999999e-05 2024-09-17T02:22:28.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:28.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206718+0000", 2024-09-17T02:22:28.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8988000000000001e-05 2024-09-17T02:22:28.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.206736+0000", 2024-09-17T02:22:28.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8221999999999999e-05 2024-09-17T02:22:28.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:28.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.221517+0000", 2024-09-17T02:22:28.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014781247000000001 2024-09-17T02:22:28.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:28.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.221563+0000", 2024-09-17T02:22:28.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5343999999999998e-05 2024-09-17T02:22:28.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:28.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240391+0000", 2024-09-17T02:22:28.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018828693000000001 2024-09-17T02:22:28.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:28.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240500+0000", 2024-09-17T02:22:28.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109121 2024-09-17T02:22:28.992 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.992 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:28.992 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.993 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190947 5.3 e65/64 5:ca95b398:::benchmark_data_smithi001_23533_object62830:head v 65'12048, mlcod=0'0)", 2024-09-17T02:22:28.993 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.208183+0000", 2024-09-17T02:22:28.993 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.690004936000001, 2024-09-17T02:22:28.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032404800999999997, 2024-09-17T02:22:28.993 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.993 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.993 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.993 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208183+0000", 2024-09-17T02:22:28.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208183+0000", 2024-09-17T02:22:28.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208185+0000", 2024-09-17T02:22:28.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.64e-06 2024-09-17T02:22:28.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208197+0000", 2024-09-17T02:22:28.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1589e-05 2024-09-17T02:22:28.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:28.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208217+0000", 2024-09-17T02:22:28.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0242e-05 2024-09-17T02:22:28.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:28.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.208227+0000", 2024-09-17T02:22:28.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0256e-05 2024-09-17T02:22:28.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:28.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223908+0000", 2024-09-17T02:22:28.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015680726999999998 2024-09-17T02:22:28.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:28.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.223969+0000", 2024-09-17T02:22:28.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1277000000000003e-05 2024-09-17T02:22:28.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:28.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240509+0000", 2024-09-17T02:22:28.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016539484 2024-09-17T02:22:28.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:28.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240588+0000", 2024-09-17T02:22:28.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9585999999999993e-05 2024-09-17T02:22:28.997 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.997 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:28.997 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:28.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.998 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:190958 5.3 e65/64 5:c9337cc4:::benchmark_data_smithi001_23533_object62841:head v 65'12049, mlcod=0'0)", 2024-09-17T02:22:28.998 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.209746+0000", 2024-09-17T02:22:28.998 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.688442589000001, 2024-09-17T02:22:28.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030921212999999999, 2024-09-17T02:22:28.998 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:28.998 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:28.998 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:28.998 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:28.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:28.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209746+0000", 2024-09-17T02:22:28.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:28.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209746+0000", 2024-09-17T02:22:28.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:28.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:28.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209748+0000", 2024-09-17T02:22:28.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9989999999999998e-06 2024-09-17T02:22:28.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:28.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:28.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:28.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209761+0000", 2024-09-17T02:22:29.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3317e-05 2024-09-17T02:22:29.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:29.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209786+0000", 2024-09-17T02:22:29.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4941999999999999e-05 2024-09-17T02:22:29.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.209799+0000", 2024-09-17T02:22:29.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2556e-05 2024-09-17T02:22:29.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:29.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.226753+0000", 2024-09-17T02:22:29.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016954100999999999 2024-09-17T02:22:29.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:29.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.226810+0000", 2024-09-17T02:22:29.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7207000000000003e-05 2024-09-17T02:22:29.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:29.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240599+0000", 2024-09-17T02:22:29.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013789228000000001 2024-09-17T02:22:29.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:29.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240667+0000", 2024-09-17T02:22:29.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7862999999999997e-05 2024-09-17T02:22:29.002 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.002 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:29.002 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.002 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:191023 5.3 e65/64 5:cfca4af2:::benchmark_data_smithi001_23533_object62906:head v 65'12050, mlcod=0'0)", 2024-09-17T02:22:29.002 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.210919+0000", 2024-09-17T02:22:29.002 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.687269232999999, 2024-09-17T02:22:29.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029830820000000001, 2024-09-17T02:22:29.003 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:29.003 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:29.003 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:29.003 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:29.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:29.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210919+0000", 2024-09-17T02:22:29.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:29.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210919+0000", 2024-09-17T02:22:29.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:29.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210921+0000", 2024-09-17T02:22:29.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-09-17T02:22:29.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:29.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210935+0000", 2024-09-17T02:22:29.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3436e-05 2024-09-17T02:22:29.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:29.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210961+0000", 2024-09-17T02:22:29.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6767999999999999e-05 2024-09-17T02:22:29.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.210974+0000", 2024-09-17T02:22:29.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2904e-05 2024-09-17T02:22:29.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:29.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.229967+0000", 2024-09-17T02:22:29.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018992774 2024-09-17T02:22:29.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:29.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.230023+0000", 2024-09-17T02:22:29.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6334e-05 2024-09-17T02:22:29.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:29.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240673+0000", 2024-09-17T02:22:29.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010649908 2024-09-17T02:22:29.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:29.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240750+0000", 2024-09-17T02:22:29.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6556000000000004e-05 2024-09-17T02:22:29.007 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.007 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:29.007 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.007 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:191048 5.3 e65/64 5:c4115f14:::benchmark_data_smithi001_23533_object62931:head v 65'12051, mlcod=0'0)", 2024-09-17T02:22:29.007 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.211763+0000", 2024-09-17T02:22:29.007 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.686425311000001, 2024-09-17T02:22:29.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029064577000000001, 2024-09-17T02:22:29.007 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:29.007 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:29.007 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:29.007 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:29.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:29.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211763+0000", 2024-09-17T02:22:29.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:29.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211763+0000", 2024-09-17T02:22:29.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:29.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211765+0000", 2024-09-17T02:22:29.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.717e-06 2024-09-17T02:22:29.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:29.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211776+0000", 2024-09-17T02:22:29.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1358999999999999e-05 2024-09-17T02:22:29.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:29.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211806+0000", 2024-09-17T02:22:29.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9924999999999999e-05 2024-09-17T02:22:29.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.211824+0000", 2024-09-17T02:22:29.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7782999999999999e-05 2024-09-17T02:22:29.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:29.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.232521+0000", 2024-09-17T02:22:29.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020696902 2024-09-17T02:22:29.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:29.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.232574+0000", 2024-09-17T02:22:29.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3044000000000002e-05 2024-09-17T02:22:29.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:29.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240757+0000", 2024-09-17T02:22:29.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081828579999999995 2024-09-17T02:22:29.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:29.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.240828+0000", 2024-09-17T02:22:29.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0988999999999994e-05 2024-09-17T02:22:29.011 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.011 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:29.011 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.012 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:191114 5.3 e65/64 5:c2a7e5a9:::benchmark_data_smithi001_23533_object62997:head v 65'12054, mlcod=63'12038)", 2024-09-17T02:22:29.012 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:06.217495+0000", 2024-09-17T02:22:29.012 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.680693680000001, 2024-09-17T02:22:29.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029944788, 2024-09-17T02:22:29.012 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:29.012 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:29.012 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:29.012 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:29.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:29.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217495+0000", 2024-09-17T02:22:29.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:29.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217495+0000", 2024-09-17T02:22:29.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:29.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217496+0000", 2024-09-17T02:22:29.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.46e-06 2024-09-17T02:22:29.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:29.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217508+0000", 2024-09-17T02:22:29.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2157000000000001e-05 2024-09-17T02:22:29.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:29.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217535+0000", 2024-09-17T02:22:29.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7058000000000001e-05 2024-09-17T02:22:29.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.217551+0000", 2024-09-17T02:22:29.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5709000000000002e-05 2024-09-17T02:22:29.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:29.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.241029+0000", 2024-09-17T02:22:29.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023478452 2024-09-17T02:22:29.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:29.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.241078+0000", 2024-09-17T02:22:29.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8068000000000001e-05 2024-09-17T02:22:29.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:29.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.247369+0000", 2024-09-17T02:22:29.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0062912740000000003 2024-09-17T02:22:29.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:29.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:06.247439+0000", 2024-09-17T02:22:29.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0610000000000003e-05 2024-09-17T02:22:29.016 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.016 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:29.016 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.016 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:232047 5.5 5:afcad6c1:::benchmark_data_smithi001_23533_object103930:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-17T02:22:29.016 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:23.568037+0000", 2024-09-17T02:22:29.016 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.3301513140000001, 2024-09-17T02:22:29.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029456251999999999, 2024-09-17T02:22:29.016 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:29.017 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:29.017 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:29.017 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:29.017 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:29.017 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.017 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 232047 2024-09-17T02:22:29.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.017 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:29.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:29.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.568037+0000", 2024-09-17T02:22:29.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:29.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.568037+0000", 2024-09-17T02:22:29.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:29.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.568039+0000", 2024-09-17T02:22:29.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.708e-06 2024-09-17T02:22:29.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:29.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.568043+0000", 2024-09-17T02:22:29.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6999999999999999e-06 2024-09-17T02:22:29.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:29.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.568053+0000", 2024-09-17T02:22:29.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1179999999999998e-06 2024-09-17T02:22:29.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.568060+0000", 2024-09-17T02:22:29.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6820000000000003e-06 2024-09-17T02:22:29.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:29.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.576949+0000", 2024-09-17T02:22:29.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0088892650000000004 2024-09-17T02:22:29.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:29.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.577080+0000", 2024-09-17T02:22:29.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130908 2024-09-17T02:22:29.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:29.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.597391+0000", 2024-09-17T02:22:29.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020310987999999999 2024-09-17T02:22:29.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:29.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.597420+0000", 2024-09-17T02:22:29.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9070000000000001e-05 2024-09-17T02:22:29.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:29.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:23.597493+0000", 2024-09-17T02:22:29.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2812999999999996e-05 2024-09-17T02:22:29.021 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.022 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:29.022 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.022 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.022 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:29.022 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:29.023 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:29.023+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:29.024 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:29.124 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:29.123+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:29.177 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:29.177 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:22:29.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.178 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:245435 5.b 5:d95a438b:::benchmark_data_smithi001_23533_object117318:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T02:22:29.178 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:29.172325+0000", 2024-09-17T02:22:29.178 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0071742660000000003, 2024-09-17T02:22:29.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071911939999999997, 2024-09-17T02:22:29.178 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.178 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.178 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:29.178 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:29.178 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:29.178 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.178 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 245435 2024-09-17T02:22:29.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.178 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.172325+0000", 2024-09-17T02:22:29.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.172325+0000", 2024-09-17T02:22:29.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.172326+0000", 2024-09-17T02:22:29.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6899999999999998e-07 2024-09-17T02:22:29.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.172328+0000", 2024-09-17T02:22:29.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0329999999999998e-06 2024-09-17T02:22:29.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.172334+0000", 2024-09-17T02:22:29.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6259999999999997e-06 2024-09-17T02:22:29.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.172338+0000", 2024-09-17T02:22:29.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9840000000000003e-06 2024-09-17T02:22:29.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.172370+0000", 2024-09-17T02:22:29.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1494e-05 2024-09-17T02:22:29.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:29.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.172458+0000", 2024-09-17T02:22:29.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8560000000000006e-05 2024-09-17T02:22:29.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:29.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.172566+0000", 2024-09-17T02:22:29.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010804899999999999 2024-09-17T02:22:29.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:29.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.174827+0000", 2024-09-17T02:22:29.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002260378 2024-09-17T02:22:29.182 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.182 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.183 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.183 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:245436 5.e 5:793bb1f9:::benchmark_data_smithi001_23533_object117319:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T02:22:29.183 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:29.172440+0000", 2024-09-17T02:22:29.183 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.007059287, 2024-09-17T02:22:29.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071427239999999996, 2024-09-17T02:22:29.183 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.183 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.183 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:29.184 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:29.184 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:29.184 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.184 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 245436 2024-09-17T02:22:29.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.184 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.172440+0000", 2024-09-17T02:22:29.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.172440+0000", 2024-09-17T02:22:29.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.172441+0000", 2024-09-17T02:22:29.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3200000000000005e-07 2024-09-17T02:22:29.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.172444+0000", 2024-09-17T02:22:29.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9979999999999999e-06 2024-09-17T02:22:29.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.172450+0000", 2024-09-17T02:22:29.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3090000000000001e-06 2024-09-17T02:22:29.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.172454+0000", 2024-09-17T02:22:29.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8349999999999997e-06 2024-09-17T02:22:29.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.172504+0000", 2024-09-17T02:22:29.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9926000000000003e-05 2024-09-17T02:22:29.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:29.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.172616+0000", 2024-09-17T02:22:29.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112494 2024-09-17T02:22:29.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:29.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.172720+0000", 2024-09-17T02:22:29.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010354899999999999 2024-09-17T02:22:29.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:29.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.174854+0000", 2024-09-17T02:22:29.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002133977 2024-09-17T02:22:29.188 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.188 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.188 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.189 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:245438 5.4 5:2bbce06f:::benchmark_data_smithi001_23533_object117321:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T02:22:29.189 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:29.172980+0000", 2024-09-17T02:22:29.189 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0065197700000000003, 2024-09-17T02:22:29.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0066509789999999996, 2024-09-17T02:22:29.189 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.189 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.189 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:29.189 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:29.189 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:29.189 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.189 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 245438 2024-09-17T02:22:29.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.189 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.172980+0000", 2024-09-17T02:22:29.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.172980+0000", 2024-09-17T02:22:29.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.172981+0000", 2024-09-17T02:22:29.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2200000000000003e-07 2024-09-17T02:22:29.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.172984+0000", 2024-09-17T02:22:29.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9489999999999998e-06 2024-09-17T02:22:29.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.172997+0000", 2024-09-17T02:22:29.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2510999999999999e-05 2024-09-17T02:22:29.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.173004+0000", 2024-09-17T02:22:29.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.635e-06 2024-09-17T02:22:29.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.173057+0000", 2024-09-17T02:22:29.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3152000000000002e-05 2024-09-17T02:22:29.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:29.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.173179+0000", 2024-09-17T02:22:29.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012269200000000001 2024-09-17T02:22:29.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:29.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.173290+0000", 2024-09-17T02:22:29.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011064400000000001 2024-09-17T02:22:29.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:29.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.175125+0000", 2024-09-17T02:22:29.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018346180000000001 2024-09-17T02:22:29.194 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.194 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.194 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.195 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:245441 5.1 5:849d1b84:::benchmark_data_smithi001_23533_object117324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T02:22:29.195 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:29.175407+0000", 2024-09-17T02:22:29.195 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0040925759999999997, 2024-09-17T02:22:29.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042728339999999997, 2024-09-17T02:22:29.195 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.195 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.195 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:29.195 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:29.195 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:29.195 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.195 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 245441 2024-09-17T02:22:29.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.196 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.175407+0000", 2024-09-17T02:22:29.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.175407+0000", 2024-09-17T02:22:29.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.175408+0000", 2024-09-17T02:22:29.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0500000000000003e-07 2024-09-17T02:22:29.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.175411+0000", 2024-09-17T02:22:29.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0180000000000002e-06 2024-09-17T02:22:29.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.175420+0000", 2024-09-17T02:22:29.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1840000000000005e-06 2024-09-17T02:22:29.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.175425+0000", 2024-09-17T02:22:29.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7380000000000002e-06 2024-09-17T02:22:29.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.175453+0000", 2024-09-17T02:22:29.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.809e-05 2024-09-17T02:22:29.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:29.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.175526+0000", 2024-09-17T02:22:29.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3413999999999999e-05 2024-09-17T02:22:29.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:29.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.175588+0000", 2024-09-17T02:22:29.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1865000000000005e-05 2024-09-17T02:22:29.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:29.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.177350+0000", 2024-09-17T02:22:29.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001762235 2024-09-17T02:22:29.199 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.199 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.200 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.200 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:245439 5.8 e72/26 5:1ba7e406:::benchmark_data_smithi001_23533_object117322:head v 72'15570, mlcod=72'15568)", 2024-09-17T02:22:29.200 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:29.175871+0000", 2024-09-17T02:22:29.200 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0036287730000000001, 2024-09-17T02:22:29.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038540139999999998, 2024-09-17T02:22:29.200 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.200 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.200 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:29.200 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.175871+0000", 2024-09-17T02:22:29.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.175871+0000", 2024-09-17T02:22:29.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.175871+0000", 2024-09-17T02:22:29.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.01e-07 2024-09-17T02:22:29.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.175886+0000", 2024-09-17T02:22:29.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4584e-05 2024-09-17T02:22:29.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.175892+0000", 2024-09-17T02:22:29.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.703e-06 2024-09-17T02:22:29.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.175896+0000", 2024-09-17T02:22:29.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4960000000000001e-06 2024-09-17T02:22:29.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.175940+0000", 2024-09-17T02:22:29.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4465999999999997e-05 2024-09-17T02:22:29.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:29.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.175958+0000", 2024-09-17T02:22:29.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7546000000000001e-05 2024-09-17T02:22:29.203 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.203 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.203 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.204 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:245444 5.b 5:d391b1d0:::benchmark_data_smithi001_23533_object117327:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T02:22:29.204 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:29.177160+0000", 2024-09-17T02:22:29.204 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0023393870000000001, 2024-09-17T02:22:29.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026001349999999999, 2024-09-17T02:22:29.204 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.204 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.204 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:29.204 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:29.204 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:29.204 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.204 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 245444 2024-09-17T02:22:29.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.205 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.177160+0000", 2024-09-17T02:22:29.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.177160+0000", 2024-09-17T02:22:29.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.177161+0000", 2024-09-17T02:22:29.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5000000000000001e-07 2024-09-17T02:22:29.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.177165+0000", 2024-09-17T02:22:29.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3599999999999998e-06 2024-09-17T02:22:29.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.177176+0000", 2024-09-17T02:22:29.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1066999999999999e-05 2024-09-17T02:22:29.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.177183+0000", 2024-09-17T02:22:29.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9870000000000002e-06 2024-09-17T02:22:29.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.177240+0000", 2024-09-17T02:22:29.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6450000000000003e-05 2024-09-17T02:22:29.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:29.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.177353+0000", 2024-09-17T02:22:29.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113434 2024-09-17T02:22:29.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:29.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.177417+0000", 2024-09-17T02:22:29.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3524999999999999e-05 2024-09-17T02:22:29.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:29.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.179039+0000", 2024-09-17T02:22:29.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001622226 2024-09-17T02:22:29.208 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.208 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.208 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.208 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:245440 5.8 e72/26 5:146ef0c5:::benchmark_data_smithi001_23533_object117323:head v 72'15571, mlcod=72'15568)", 2024-09-17T02:22:29.209 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:29.177765+0000", 2024-09-17T02:22:29.209 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.001734148, 2024-09-17T02:22:29.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020457819999999999, 2024-09-17T02:22:29.209 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.209 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.209 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:29.209 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.177765+0000", 2024-09-17T02:22:29.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.177765+0000", 2024-09-17T02:22:29.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.177766+0000", 2024-09-17T02:22:29.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1699999999999998e-07 2024-09-17T02:22:29.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.177770+0000", 2024-09-17T02:22:29.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2139999999999998e-06 2024-09-17T02:22:29.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.177779+0000", 2024-09-17T02:22:29.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6340000000000007e-06 2024-09-17T02:22:29.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.177784+0000", 2024-09-17T02:22:29.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.921e-06 2024-09-17T02:22:29.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.177963+0000", 2024-09-17T02:22:29.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000179147 2024-09-17T02:22:29.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:29.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.177978+0000", 2024-09-17T02:22:29.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4768e-05 2024-09-17T02:22:29.212 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.212 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.212 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.213 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:245442 5.8 e72/26)", 2024-09-17T02:22:29.213 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:29.179574+0000", 2024-09-17T02:22:29.213 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4294967295.9999251, 2024-09-17T02:22:29.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027015900000000001, 2024-09-17T02:22:29.213 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.213 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.213 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-17T02:22:29.213 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.179574+0000", 2024-09-17T02:22:29.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.179574+0000", 2024-09-17T02:22:29.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.179575+0000", 2024-09-17T02:22:29.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1400000000000001e-07 2024-09-17T02:22:29.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.179578+0000", 2024-09-17T02:22:29.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0460000000000001e-06 2024-09-17T02:22:29.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.179583+0000", 2024-09-17T02:22:29.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5210000000000002e-06 2024-09-17T02:22:29.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.179587+0000", 2024-09-17T02:22:29.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9999999999999998e-06 2024-09-17T02:22:29.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:29.179835+0000", 2024-09-17T02:22:29.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000247321 2024-09-17T02:22:29.216 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.216 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.216 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.216 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.216 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:22:29.216 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 8 2024-09-17T02:22:29.216 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:29.217 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T02:22:29.218 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:29.224 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:29.223+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:29.325 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:29.322+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:29.368 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:29.369 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:22:29.369 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:22:29.369 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:22:29.369 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:29.388 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:29.427 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:29.427+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:29.528 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:29.527+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:29.581 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:29.581 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:22:29.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:22:29.582 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:22:29.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.582 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97749 5.b 5:d930ef52:::benchmark_data_smithi001_23533_object97748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:29.582 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:29.582 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 71.990017186000003, 2024-09-17T02:22:29.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092964343000000005, 2024-09-17T02:22:29.582 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.582 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.582 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:29.582 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:29.582 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:29.582 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.582 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97749 2024-09-17T02:22:29.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.583 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:29.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:29.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591947+0000", 2024-09-17T02:22:29.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:22:29.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592011+0000", 2024-09-17T02:22:29.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3608000000000005e-05 2024-09-17T02:22:29.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592021+0000", 2024-09-17T02:22:29.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9979999999999998e-06 2024-09-17T02:22:29.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592028+0000", 2024-09-17T02:22:29.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1439999999999997e-06 2024-09-17T02:22:29.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593633+0000", 2024-09-17T02:22:29.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001604636 2024-09-17T02:22:29.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:29.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593757+0000", 2024-09-17T02:22:29.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012432099999999999 2024-09-17T02:22:29.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:29.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593866+0000", 2024-09-17T02:22:29.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109094 2024-09-17T02:22:29.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:29.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601190+0000", 2024-09-17T02:22:29.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073237620000000002 2024-09-17T02:22:29.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:29.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601356+0000", 2024-09-17T02:22:29.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016651900000000001 2024-09-17T02:22:29.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:29.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684618+0000", 2024-09-17T02:22:29.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083261356999999994 2024-09-17T02:22:29.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:29.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684724+0000", 2024-09-17T02:22:29.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010681800000000001 2024-09-17T02:22:29.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:29.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684911+0000", 2024-09-17T02:22:29.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186243 2024-09-17T02:22:29.591 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.592 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.592 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.592 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97752 5.b 5:d146f486:::benchmark_data_smithi001_23533_object97751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:29.592 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:29.592 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 71.988664491999998, 2024-09-17T02:22:29.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091989557, 2024-09-17T02:22:29.593 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.593 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.593 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:29.593 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:29.593 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:29.593 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.593 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97752 2024-09-17T02:22:29.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.593 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:29.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:29.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593300+0000", 2024-09-17T02:22:29.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8199999999999998e-07 2024-09-17T02:22:29.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593364+0000", 2024-09-17T02:22:29.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3831999999999995e-05 2024-09-17T02:22:29.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593376+0000", 2024-09-17T02:22:29.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1800999999999999e-05 2024-09-17T02:22:29.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593382+0000", 2024-09-17T02:22:29.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6780000000000003e-06 2024-09-17T02:22:29.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595491+0000", 2024-09-17T02:22:29.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021090689999999999 2024-09-17T02:22:29.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:29.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595614+0000", 2024-09-17T02:22:29.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012321500000000001 2024-09-17T02:22:29.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:29.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595778+0000", 2024-09-17T02:22:29.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016321900000000001 2024-09-17T02:22:29.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:29.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601197+0000", 2024-09-17T02:22:29.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054195600000000003 2024-09-17T02:22:29.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:29.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601396+0000", 2024-09-17T02:22:29.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019825299999999999 2024-09-17T02:22:29.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:29.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684990+0000", 2024-09-17T02:22:29.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083594878999999997 2024-09-17T02:22:29.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:29.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685116+0000", 2024-09-17T02:22:29.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012522799999999999 2024-09-17T02:22:29.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:29.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685289+0000", 2024-09-17T02:22:29.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172941 2024-09-17T02:22:29.600 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.601 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.601 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.601 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97754 5.b 5:da0615e5:::benchmark_data_smithi001_23533_object97753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:29.601 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:29.602 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 71.987026569999998, 2024-09-17T02:22:29.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092097207, 2024-09-17T02:22:29.602 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.602 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.602 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:29.602 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:29.602 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:29.602 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.602 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97754 2024-09-17T02:22:29.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.602 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:29.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:29.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594938+0000", 2024-09-17T02:22:29.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5000000000000002e-07 2024-09-17T02:22:29.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595075+0000", 2024-09-17T02:22:29.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137742 2024-09-17T02:22:29.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595087+0000", 2024-09-17T02:22:29.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1243000000000001e-05 2024-09-17T02:22:29.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595095+0000", 2024-09-17T02:22:29.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1030000000000002e-06 2024-09-17T02:22:29.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598461+0000", 2024-09-17T02:22:29.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033661170000000001 2024-09-17T02:22:29.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:29.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598540+0000", 2024-09-17T02:22:29.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8937999999999995e-05 2024-09-17T02:22:29.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:29.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598626+0000", 2024-09-17T02:22:29.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6042000000000001e-05 2024-09-17T02:22:29.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:29.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684258+0000", 2024-09-17T02:22:29.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085632394000000001 2024-09-17T02:22:29.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:29.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685369+0000", 2024-09-17T02:22:29.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001111063 2024-09-17T02:22:29.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:29.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685511+0000", 2024-09-17T02:22:29.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141965 2024-09-17T02:22:29.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:29.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685604+0000", 2024-09-17T02:22:29.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2935000000000004e-05 2024-09-17T02:22:29.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:29.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687034+0000", 2024-09-17T02:22:29.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001430015 2024-09-17T02:22:29.609 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.609 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.609 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.609 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97755 5.b 5:d36a03a1:::benchmark_data_smithi001_23533_object97754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:29.609 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:29.610 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 71.986853420000003, 2024-09-17T02:22:29.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0924904, 2024-09-17T02:22:29.610 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.610 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.610 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:29.610 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:29.610 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:29.610 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.610 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97755 2024-09-17T02:22:29.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.610 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:29.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:29.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595111+0000", 2024-09-17T02:22:29.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:22:29.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595145+0000", 2024-09-17T02:22:29.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3927000000000002e-05 2024-09-17T02:22:29.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595155+0000", 2024-09-17T02:22:29.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0023e-05 2024-09-17T02:22:29.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595162+0000", 2024-09-17T02:22:29.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3950000000000003e-06 2024-09-17T02:22:29.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599821+0000", 2024-09-17T02:22:29.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046592880000000001 2024-09-17T02:22:29.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:29.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599912+0000", 2024-09-17T02:22:29.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1049000000000002e-05 2024-09-17T02:22:29.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:29.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600062+0000", 2024-09-17T02:22:29.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015001700000000001 2024-09-17T02:22:29.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:29.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685307+0000", 2024-09-17T02:22:29.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085244340000000002 2024-09-17T02:22:29.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:29.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685446+0000", 2024-09-17T02:22:29.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013955700000000001 2024-09-17T02:22:29.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:29.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687375+0000", 2024-09-17T02:22:29.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019291079999999999 2024-09-17T02:22:29.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:29.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687462+0000", 2024-09-17T02:22:29.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6148000000000003e-05 2024-09-17T02:22:29.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:29.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687600+0000", 2024-09-17T02:22:29.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013887900000000001 2024-09-17T02:22:29.617 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.617 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.617 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.617 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 44/44 lb 5:c4567a04:::benchmark_data_smithi001_23533_object4200:head)", 2024-09-17T02:22:29.617 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:29.617 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 71.984756794000006, 2024-09-17T02:22:29.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092483421999999996, 2024-09-17T02:22:29.617 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.617 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.617 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:29.618 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:29.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:29.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:29.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6399999999999998e-07 2024-09-17T02:22:29.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597213+0000", 2024-09-17T02:22:29.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3659999999999997e-06 2024-09-17T02:22:29.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597222+0000", 2024-09-17T02:22:29.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0510000000000002e-06 2024-09-17T02:22:29.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597228+0000", 2024-09-17T02:22:29.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1569999999999999e-06 2024-09-17T02:22:29.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689588+0000", 2024-09-17T02:22:29.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092359931000000006 2024-09-17T02:22:29.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:29.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689622+0000", 2024-09-17T02:22:29.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4425999999999999e-05 2024-09-17T02:22:29.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:29.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689690+0000", 2024-09-17T02:22:29.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8126999999999993e-05 2024-09-17T02:22:29.622 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.622 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.622 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.622 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129462 5.4 5:2e0acc16:::benchmark_data_smithi001_23533_object1345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:29.622 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:29.622 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.047022724999998, 2024-09-17T02:22:29.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0112774899999999, 2024-09-17T02:22:29.623 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.623 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.623 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:29.623 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:29.623 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:29.623 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.623 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129462 2024-09-17T02:22:29.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.623 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:29.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:29.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534943+0000", 2024-09-17T02:22:29.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8759999999999999e-06 2024-09-17T02:22:29.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534951+0000", 2024-09-17T02:22:29.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3219999999999993e-06 2024-09-17T02:22:29.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534977+0000", 2024-09-17T02:22:29.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6245e-05 2024-09-17T02:22:29.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534992+0000", 2024-09-17T02:22:29.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4936000000000001e-05 2024-09-17T02:22:29.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535133+0000", 2024-09-17T02:22:29.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014051299999999999 2024-09-17T02:22:29.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:29.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:22:29.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1741000000000001e-05 2024-09-17T02:22:29.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.533906+0000", 2024-09-17T02:22:29.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99875209300000001 2024-09-17T02:22:29.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:29.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534348+0000", 2024-09-17T02:22:29.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044128899999999998 2024-09-17T02:22:29.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:29.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534762+0000", 2024-09-17T02:22:29.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000414707 2024-09-17T02:22:29.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:29.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545024+0000", 2024-09-17T02:22:29.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010261283 2024-09-17T02:22:29.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:29.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545953+0000", 2024-09-17T02:22:29.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000929618 2024-09-17T02:22:29.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:29.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546047+0000", 2024-09-17T02:22:29.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3697999999999996e-05 2024-09-17T02:22:29.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:29.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546218+0000", 2024-09-17T02:22:29.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017116899999999999 2024-09-17T02:22:29.631 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.632 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.632 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.632 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129480 5.4 5:2b1d398b:::benchmark_data_smithi001_23533_object1363:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:29.632 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:29.632 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.039268259000004, 2024-09-17T02:22:29.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0038926450000001, 2024-09-17T02:22:29.632 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.632 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.632 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:29.632 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:29.632 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:29.633 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.633 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129480 2024-09-17T02:22:29.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.633 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:29.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:29.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542696+0000", 2024-09-17T02:22:29.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9999999999999995e-07 2024-09-17T02:22:29.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542701+0000", 2024-09-17T02:22:29.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2240000000000003e-06 2024-09-17T02:22:29.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542716+0000", 2024-09-17T02:22:29.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4970000000000001e-05 2024-09-17T02:22:29.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542726+0000", 2024-09-17T02:22:29.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2879999999999998e-06 2024-09-17T02:22:29.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542832+0000", 2024-09-17T02:22:29.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010597199999999999 2024-09-17T02:22:29.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:29.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542843+0000", 2024-09-17T02:22:29.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.098e-05 2024-09-17T02:22:29.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538436+0000", 2024-09-17T02:22:29.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99559286800000002 2024-09-17T02:22:29.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:29.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538791+0000", 2024-09-17T02:22:29.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035585499999999997 2024-09-17T02:22:29.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:29.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.539144+0000", 2024-09-17T02:22:29.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035268499999999999 2024-09-17T02:22:29.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:29.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545880+0000", 2024-09-17T02:22:29.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00673552 2024-09-17T02:22:29.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:29.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546330+0000", 2024-09-17T02:22:29.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045039599999999999 2024-09-17T02:22:29.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:29.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546414+0000", 2024-09-17T02:22:29.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4468000000000005e-05 2024-09-17T02:22:29.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:29.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546588+0000", 2024-09-17T02:22:29.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017341899999999999 2024-09-17T02:22:29.638 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.638 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.638 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.639 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129505 5.4 5:294f2ec7:::benchmark_data_smithi001_23533_object1388:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:29.639 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:29.639 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.020255085999999, 2024-09-17T02:22:29.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98589826199999997, 2024-09-17T02:22:29.639 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.639 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.640 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:29.640 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:29.640 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:29.640 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.640 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129505 2024-09-17T02:22:29.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.640 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:29.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:29.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561710+0000", 2024-09-17T02:22:29.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7060000000000001e-06 2024-09-17T02:22:29.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561718+0000", 2024-09-17T02:22:29.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.542e-06 2024-09-17T02:22:29.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561741+0000", 2024-09-17T02:22:29.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3357e-05 2024-09-17T02:22:29.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561754+0000", 2024-09-17T02:22:29.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3200000000000001e-05 2024-09-17T02:22:29.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561867+0000", 2024-09-17T02:22:29.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113211 2024-09-17T02:22:29.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:29.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561888+0000", 2024-09-17T02:22:29.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0809999999999999e-05 2024-09-17T02:22:29.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542140+0000", 2024-09-17T02:22:29.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98025195799999998 2024-09-17T02:22:29.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:29.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542331+0000", 2024-09-17T02:22:29.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019127599999999999 2024-09-17T02:22:29.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:29.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542517+0000", 2024-09-17T02:22:29.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000185625 2024-09-17T02:22:29.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:29.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547114+0000", 2024-09-17T02:22:29.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045968620000000002 2024-09-17T02:22:29.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:29.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547187+0000", 2024-09-17T02:22:29.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3348000000000003e-05 2024-09-17T02:22:29.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:29.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547324+0000", 2024-09-17T02:22:29.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013681699999999999 2024-09-17T02:22:29.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:29.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547607+0000", 2024-09-17T02:22:29.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028255000000000001 2024-09-17T02:22:29.649 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.649 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.649 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.649 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129508 5.4 5:2892b582:::benchmark_data_smithi001_23533_object1391:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:29.650 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:29.650 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.018917993000002, 2024-09-17T02:22:29.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99697919099999999, 2024-09-17T02:22:29.650 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.650 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.650 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:29.650 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:29.650 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:29.651 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.651 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129508 2024-09-17T02:22:29.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.651 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:29.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:29.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563047+0000", 2024-09-17T02:22:29.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.274e-06 2024-09-17T02:22:29.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563054+0000", 2024-09-17T02:22:29.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2799999999999998e-06 2024-09-17T02:22:29.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563070+0000", 2024-09-17T02:22:29.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5991999999999999e-05 2024-09-17T02:22:29.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563078+0000", 2024-09-17T02:22:29.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2390000000000002e-06 2024-09-17T02:22:29.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563181+0000", 2024-09-17T02:22:29.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102249 2024-09-17T02:22:29.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:29.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563199+0000", 2024-09-17T02:22:29.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8215000000000001e-05 2024-09-17T02:22:29.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547713+0000", 2024-09-17T02:22:29.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98451446399999998 2024-09-17T02:22:29.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:29.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548063+0000", 2024-09-17T02:22:29.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034985499999999999 2024-09-17T02:22:29.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:29.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548490+0000", 2024-09-17T02:22:29.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042658600000000001 2024-09-17T02:22:29.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:29.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555655+0000", 2024-09-17T02:22:29.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071652579999999999 2024-09-17T02:22:29.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:29.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559612+0000", 2024-09-17T02:22:29.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003957103 2024-09-17T02:22:29.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:29.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559768+0000", 2024-09-17T02:22:29.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015556899999999999 2024-09-17T02:22:29.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:29.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560025+0000", 2024-09-17T02:22:29.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025710700000000002 2024-09-17T02:22:29.660 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.660 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.660 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.661 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129509 5.4 5:2c35515e:::benchmark_data_smithi001_23533_object1392:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:29.661 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:29.661 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.01829094, 2024-09-17T02:22:29.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99969384900000002, 2024-09-17T02:22:29.661 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.661 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.661 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:29.661 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:29.662 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:29.662 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.662 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129509 2024-09-17T02:22:29.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.662 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:29.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:29.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563674+0000", 2024-09-17T02:22:29.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0920000000000001e-06 2024-09-17T02:22:29.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563679+0000", 2024-09-17T02:22:29.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7660000000000004e-06 2024-09-17T02:22:29.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563693+0000", 2024-09-17T02:22:29.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3139000000000001e-05 2024-09-17T02:22:29.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563701+0000", 2024-09-17T02:22:29.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9859999999999994e-06 2024-09-17T02:22:29.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563775+0000", 2024-09-17T02:22:29.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4659000000000005e-05 2024-09-17T02:22:29.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:29.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563785+0000", 2024-09-17T02:22:29.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4839999999999993e-06 2024-09-17T02:22:29.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552085+0000", 2024-09-17T02:22:29.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98829986999999997 2024-09-17T02:22:29.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:29.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552554+0000", 2024-09-17T02:22:29.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046908900000000001 2024-09-17T02:22:29.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:29.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552931+0000", 2024-09-17T02:22:29.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377778 2024-09-17T02:22:29.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:29.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563106+0000", 2024-09-17T02:22:29.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010174186 2024-09-17T02:22:29.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:29.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563138+0000", 2024-09-17T02:22:29.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2495e-05 2024-09-17T02:22:29.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:29.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563225+0000", 2024-09-17T02:22:29.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6677999999999999e-05 2024-09-17T02:22:29.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:29.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563366+0000", 2024-09-17T02:22:29.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014162699999999999 2024-09-17T02:22:29.667 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.668 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.668 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.668 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129524 5.4 5:25dca7dd:::benchmark_data_smithi001_23533_object1407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:29.668 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:29.668 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.011599586000003, 2024-09-17T02:22:29.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99999501999999996, 2024-09-17T02:22:29.668 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.668 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.668 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:29.668 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:29.668 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:29.668 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.669 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129524 2024-09-17T02:22:29.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.669 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:29.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:29.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570365+0000", 2024-09-17T02:22:29.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.142e-06 2024-09-17T02:22:29.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570369+0000", 2024-09-17T02:22:29.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.856e-06 2024-09-17T02:22:29.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570385+0000", 2024-09-17T02:22:29.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5855e-05 2024-09-17T02:22:29.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570392+0000", 2024-09-17T02:22:29.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5340000000000002e-06 2024-09-17T02:22:29.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570484+0000", 2024-09-17T02:22:29.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1212999999999996e-05 2024-09-17T02:22:29.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:29.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570498+0000", 2024-09-17T02:22:29.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4331000000000001e-05 2024-09-17T02:22:29.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555835+0000", 2024-09-17T02:22:29.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98533757700000002 2024-09-17T02:22:29.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:29.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556329+0000", 2024-09-17T02:22:29.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000493458 2024-09-17T02:22:29.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:29.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556784+0000", 2024-09-17T02:22:29.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045476499999999999 2024-09-17T02:22:29.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:29.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569852+0000", 2024-09-17T02:22:29.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013068270999999999 2024-09-17T02:22:29.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:29.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569958+0000", 2024-09-17T02:22:29.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106214 2024-09-17T02:22:29.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:29.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570124+0000", 2024-09-17T02:22:29.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165546 2024-09-17T02:22:29.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:29.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570359+0000", 2024-09-17T02:22:29.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023525799999999999 2024-09-17T02:22:29.676 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.676 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.676 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.676 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129537 5.4 5:260327c6:::benchmark_data_smithi001_23533_object1420:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:29.676 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:29.676 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.003693057, 2024-09-17T02:22:29.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99624596499999996, 2024-09-17T02:22:29.676 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.676 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.676 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:29.676 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:29.677 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:29.677 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.677 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129537 2024-09-17T02:22:29.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.677 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:29.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:29.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578272+0000", 2024-09-17T02:22:29.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.164e-06 2024-09-17T02:22:29.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578278+0000", 2024-09-17T02:22:29.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5060000000000001e-06 2024-09-17T02:22:29.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578294+0000", 2024-09-17T02:22:29.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5687000000000001e-05 2024-09-17T02:22:29.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578329+0000", 2024-09-17T02:22:29.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5311999999999997e-05 2024-09-17T02:22:29.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578419+0000", 2024-09-17T02:22:29.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0054000000000002e-05 2024-09-17T02:22:29.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:29.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578435+0000", 2024-09-17T02:22:29.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5645999999999999e-05 2024-09-17T02:22:29.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560148+0000", 2024-09-17T02:22:29.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98171342299999997 2024-09-17T02:22:29.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:29.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560383+0000", 2024-09-17T02:22:29.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000234935 2024-09-17T02:22:29.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:29.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560586+0000", 2024-09-17T02:22:29.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000202909 2024-09-17T02:22:29.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:29.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570472+0000", 2024-09-17T02:22:29.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098856959999999994 2024-09-17T02:22:29.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:29.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574138+0000", 2024-09-17T02:22:29.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036660170000000001 2024-09-17T02:22:29.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:29.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574298+0000", 2024-09-17T02:22:29.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016025600000000001 2024-09-17T02:22:29.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:29.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574516+0000", 2024-09-17T02:22:29.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021835999999999999 2024-09-17T02:22:29.683 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.683 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.683 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.683 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129545 5.4 5:22366489:::benchmark_data_smithi001_23533_object1428:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:29.683 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:29.684 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.997830334, 2024-09-17T02:22:29.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99074544499999995, 2024-09-17T02:22:29.684 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.684 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.684 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:29.684 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:29.684 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:29.684 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.684 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129545 2024-09-17T02:22:29.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.684 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:29.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:29.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584135+0000", 2024-09-17T02:22:29.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4699999999999999e-06 2024-09-17T02:22:29.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584142+0000", 2024-09-17T02:22:29.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1620000000000002e-06 2024-09-17T02:22:29.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584170+0000", 2024-09-17T02:22:29.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7897000000000001e-05 2024-09-17T02:22:29.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584183+0000", 2024-09-17T02:22:29.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2814e-05 2024-09-17T02:22:29.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584299+0000", 2024-09-17T02:22:29.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116153 2024-09-17T02:22:29.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:29.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584316+0000", 2024-09-17T02:22:29.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7524999999999999e-05 2024-09-17T02:22:29.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563461+0000", 2024-09-17T02:22:29.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97914436699999996 2024-09-17T02:22:29.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:29.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563667+0000", 2024-09-17T02:22:29.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020689800000000001 2024-09-17T02:22:29.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:29.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563878+0000", 2024-09-17T02:22:29.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210275 2024-09-17T02:22:29.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:29.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570584+0000", 2024-09-17T02:22:29.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067066080000000002 2024-09-17T02:22:29.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:29.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574539+0000", 2024-09-17T02:22:29.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039550360000000003 2024-09-17T02:22:29.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:29.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574653+0000", 2024-09-17T02:22:29.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114003 2024-09-17T02:22:29.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:29.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574879+0000", 2024-09-17T02:22:29.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022523700000000001 2024-09-17T02:22:29.691 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.691 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.691 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.691 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129553 5.4 5:2e41ad40:::benchmark_data_smithi001_23533_object1436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:29.692 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:29.692 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.992407698000001, 2024-09-17T02:22:29.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99213429600000003, 2024-09-17T02:22:29.692 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.692 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.692 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:29.692 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:29.692 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:29.692 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.692 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129553 2024-09-17T02:22:29.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.692 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:29.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:29.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589557+0000", 2024-09-17T02:22:29.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2219999999999999e-06 2024-09-17T02:22:29.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589562+0000", 2024-09-17T02:22:29.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0649999999999998e-06 2024-09-17T02:22:29.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589575+0000", 2024-09-17T02:22:29.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3129000000000001e-05 2024-09-17T02:22:29.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589584+0000", 2024-09-17T02:22:29.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6200000000000005e-06 2024-09-17T02:22:29.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589693+0000", 2024-09-17T02:22:29.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109319 2024-09-17T02:22:29.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:29.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589714+0000", 2024-09-17T02:22:29.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0849999999999999e-05 2024-09-17T02:22:29.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566273+0000", 2024-09-17T02:22:29.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97655884999999998 2024-09-17T02:22:29.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:29.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566543+0000", 2024-09-17T02:22:29.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027059099999999998 2024-09-17T02:22:29.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:29.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566832+0000", 2024-09-17T02:22:29.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028898200000000002 2024-09-17T02:22:29.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:29.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581040+0000", 2024-09-17T02:22:29.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014208001 2024-09-17T02:22:29.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:29.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581200+0000", 2024-09-17T02:22:29.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159956 2024-09-17T02:22:29.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:29.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581427+0000", 2024-09-17T02:22:29.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000226309 2024-09-17T02:22:29.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:29.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581690+0000", 2024-09-17T02:22:29.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026340199999999998 2024-09-17T02:22:29.699 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.699 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.699 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.699 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129580 5.4 5:25ed887b:::benchmark_data_smithi001_23533_object1463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:29.699 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:29.699 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.970635653999999, 2024-09-17T02:22:29.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98001430499999997, 2024-09-17T02:22:29.699 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.699 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.699 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:29.699 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:29.699 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:29.700 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.700 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129580 2024-09-17T02:22:29.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.700 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:29.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:29.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611329+0000", 2024-09-17T02:22:29.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.22e-06 2024-09-17T02:22:29.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611335+0000", 2024-09-17T02:22:29.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1129999999999997e-06 2024-09-17T02:22:29.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611348+0000", 2024-09-17T02:22:29.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2342e-05 2024-09-17T02:22:29.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611356+0000", 2024-09-17T02:22:29.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.371e-06 2024-09-17T02:22:29.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611419+0000", 2024-09-17T02:22:29.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3393999999999996e-05 2024-09-17T02:22:29.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:29.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611427+0000", 2024-09-17T02:22:29.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999997e-06 2024-09-17T02:22:29.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570705+0000", 2024-09-17T02:22:29.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.95927859199999999 2024-09-17T02:22:29.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:29.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571009+0000", 2024-09-17T02:22:29.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030414599999999998 2024-09-17T02:22:29.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:29.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571241+0000", 2024-09-17T02:22:29.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023106799999999999 2024-09-17T02:22:29.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:29.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590789+0000", 2024-09-17T02:22:29.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019548763 2024-09-17T02:22:29.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:29.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590928+0000", 2024-09-17T02:22:29.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000139092 2024-09-17T02:22:29.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:29.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591086+0000", 2024-09-17T02:22:29.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015787400000000001 2024-09-17T02:22:29.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:29.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591342+0000", 2024-09-17T02:22:29.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025589900000000002 2024-09-17T02:22:29.708 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.708 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.708 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.708 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129603 5.4 5:25aaa5e8:::benchmark_data_smithi001_23533_object1486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:29.708 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:29.708 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.954575857999998, 2024-09-17T02:22:29.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96463198999999999, 2024-09-17T02:22:29.708 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.708 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.709 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:29.709 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:29.709 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:29.709 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.709 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129603 2024-09-17T02:22:29.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.709 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:29.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:29.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:29.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:22:29.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627392+0000", 2024-09-17T02:22:29.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0790000000000002e-06 2024-09-17T02:22:29.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627403+0000", 2024-09-17T02:22:29.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0866000000000001e-05 2024-09-17T02:22:29.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627409+0000", 2024-09-17T02:22:29.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.305e-06 2024-09-17T02:22:29.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627485+0000", 2024-09-17T02:22:29.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6582000000000006e-05 2024-09-17T02:22:29.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:29.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627499+0000", 2024-09-17T02:22:29.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:22:29.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574991+0000", 2024-09-17T02:22:29.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94749182300000001 2024-09-17T02:22:29.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:29.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575377+0000", 2024-09-17T02:22:29.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038629400000000003 2024-09-17T02:22:29.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:29.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575665+0000", 2024-09-17T02:22:29.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028759499999999997 2024-09-17T02:22:29.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:29.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590802+0000", 2024-09-17T02:22:29.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015136479 2024-09-17T02:22:29.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:29.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591614+0000", 2024-09-17T02:22:29.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081293100000000003 2024-09-17T02:22:29.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:29.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591764+0000", 2024-09-17T02:22:29.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014932199999999999 2024-09-17T02:22:29.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:29.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592020+0000", 2024-09-17T02:22:29.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025585099999999997 2024-09-17T02:22:29.715 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.715 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.715 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.715 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129607 5.4 5:2f638f1e:::benchmark_data_smithi001_23533_object1490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:29.715 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:29.715 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.953048952000003, 2024-09-17T02:22:29.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96352375899999998, 2024-09-17T02:22:29.715 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.715 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.715 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:29.715 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:29.716 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:29.716 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.716 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129607 2024-09-17T02:22:29.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.716 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:29.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:29.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628916+0000", 2024-09-17T02:22:29.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1710000000000001e-06 2024-09-17T02:22:29.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628920+0000", 2024-09-17T02:22:29.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-17T02:22:29.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628935+0000", 2024-09-17T02:22:29.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4474000000000001e-05 2024-09-17T02:22:29.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628944+0000", 2024-09-17T02:22:29.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9940000000000006e-06 2024-09-17T02:22:29.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628997+0000", 2024-09-17T02:22:29.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3579000000000003e-05 2024-09-17T02:22:29.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:29.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.629006+0000", 2024-09-17T02:22:29.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4009999999999997e-06 2024-09-17T02:22:29.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.577862+0000", 2024-09-17T02:22:29.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.948856335 2024-09-17T02:22:29.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:29.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578167+0000", 2024-09-17T02:22:29.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030532399999999999 2024-09-17T02:22:29.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:29.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578532+0000", 2024-09-17T02:22:29.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036428200000000001 2024-09-17T02:22:29.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:29.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591442+0000", 2024-09-17T02:22:29.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012910374000000001 2024-09-17T02:22:29.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:29.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592164+0000", 2024-09-17T02:22:29.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072242499999999996 2024-09-17T02:22:29.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:29.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592267+0000", 2024-09-17T02:22:29.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102205 2024-09-17T02:22:29.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:29.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592438+0000", 2024-09-17T02:22:29.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017165299999999999 2024-09-17T02:22:29.722 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.722 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.722 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.722 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129623 5.4 5:2cf5174b:::benchmark_data_smithi001_23533_object1506:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:29.722 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:29.722 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.929104666000001, 2024-09-17T02:22:29.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94334114499999999, 2024-09-17T02:22:29.722 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.722 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.723 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:29.723 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:29.723 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:29.723 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.723 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129623 2024-09-17T02:22:29.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.723 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:29.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:29.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652860+0000", 2024-09-17T02:22:29.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0330000000000001e-06 2024-09-17T02:22:29.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652864+0000", 2024-09-17T02:22:29.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.634e-06 2024-09-17T02:22:29.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652877+0000", 2024-09-17T02:22:29.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2591e-05 2024-09-17T02:22:29.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652883+0000", 2024-09-17T02:22:29.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1460000000000001e-06 2024-09-17T02:22:29.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652943+0000", 2024-09-17T02:22:29.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9833999999999997e-05 2024-09-17T02:22:29.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:29.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652950+0000", 2024-09-17T02:22:29.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.401e-06 2024-09-17T02:22:29.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581800+0000", 2024-09-17T02:22:29.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.92884935700000004 2024-09-17T02:22:29.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:29.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582122+0000", 2024-09-17T02:22:29.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032185200000000002 2024-09-17T02:22:29.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:29.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582689+0000", 2024-09-17T02:22:29.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056750400000000003 2024-09-17T02:22:29.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:29.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591458+0000", 2024-09-17T02:22:29.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008768685 2024-09-17T02:22:29.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:29.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595856+0000", 2024-09-17T02:22:29.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043977909999999999 2024-09-17T02:22:29.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:29.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595955+0000", 2024-09-17T02:22:29.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9166000000000006e-05 2024-09-17T02:22:29.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:29.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596200+0000", 2024-09-17T02:22:29.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024515099999999998 2024-09-17T02:22:29.729 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.729 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.729 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.729 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129642 5.4 5:255eb796:::benchmark_data_smithi001_23533_object1525:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:29.730 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:29.730 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.897868502000001, 2024-09-17T02:22:29.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.91257397299999998, 2024-09-17T02:22:29.730 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.730 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.730 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:29.730 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:29.730 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:29.730 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.730 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129642 2024-09-17T02:22:29.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.730 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:29.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:29.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684096+0000", 2024-09-17T02:22:29.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659999999999999e-06 2024-09-17T02:22:29.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684101+0000", 2024-09-17T02:22:29.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8110000000000002e-06 2024-09-17T02:22:29.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684114+0000", 2024-09-17T02:22:29.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2653000000000001e-05 2024-09-17T02:22:29.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684121+0000", 2024-09-17T02:22:29.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5100000000000001e-06 2024-09-17T02:22:29.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684181+0000", 2024-09-17T02:22:29.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0307999999999999e-05 2024-09-17T02:22:29.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:29.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684194+0000", 2024-09-17T02:22:29.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2916e-05 2024-09-17T02:22:29.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.587917+0000", 2024-09-17T02:22:29.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.90372220400000003 2024-09-17T02:22:29.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:29.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588215+0000", 2024-09-17T02:22:29.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029845400000000003 2024-09-17T02:22:29.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:29.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588470+0000", 2024-09-17T02:22:29.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025455399999999999 2024-09-17T02:22:29.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:29.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596318+0000", 2024-09-17T02:22:29.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078485589999999997 2024-09-17T02:22:29.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:29.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596354+0000", 2024-09-17T02:22:29.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5976999999999998e-05 2024-09-17T02:22:29.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:29.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596449+0000", 2024-09-17T02:22:29.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4728999999999994e-05 2024-09-17T02:22:29.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:29.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596669+0000", 2024-09-17T02:22:29.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220132 2024-09-17T02:22:29.736 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.736 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.736 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.736 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129649 5.4 5:2fe27050:::benchmark_data_smithi001_23533_object1532:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:29.736 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:29.736 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.866311758999998, 2024-09-17T02:22:29.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.88508119100000004, 2024-09-17T02:22:29.737 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:29.737 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:29.737 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:29.737 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:29.737 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:29.737 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.737 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129649 2024-09-17T02:22:29.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.737 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:29.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:29.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:29.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:29.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:29.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:29.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:29.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715653+0000", 2024-09-17T02:22:29.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3519999999999999e-06 2024-09-17T02:22:29.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:29.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715658+0000", 2024-09-17T02:22:29.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3120000000000001e-06 2024-09-17T02:22:29.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:29.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715677+0000", 2024-09-17T02:22:29.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-17T02:22:29.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715687+0000", 2024-09-17T02:22:29.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0146000000000001e-05 2024-09-17T02:22:29.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715821+0000", 2024-09-17T02:22:29.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013421 2024-09-17T02:22:29.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:29.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715840+0000", 2024-09-17T02:22:29.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8153999999999999e-05 2024-09-17T02:22:29.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:29.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592528+0000", 2024-09-17T02:22:29.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.87668860000000004 2024-09-17T02:22:29.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:29.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592702+0000", 2024-09-17T02:22:29.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017429300000000001 2024-09-17T02:22:29.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:29.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592945+0000", 2024-09-17T02:22:29.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000242048 2024-09-17T02:22:29.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:29.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600234+0000", 2024-09-17T02:22:29.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072897600000000002 2024-09-17T02:22:29.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:29.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600494+0000", 2024-09-17T02:22:29.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000259984 2024-09-17T02:22:29.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:29.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600555+0000", 2024-09-17T02:22:29.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1138999999999999e-05 2024-09-17T02:22:29.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:29.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:29.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:29.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600733+0000", 2024-09-17T02:22:29.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017753300000000001 2024-09-17T02:22:29.743 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.743 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.743 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.743 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:29.743 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:29.743 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:29.744 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:22:29.745 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:29.743+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:29.745 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:29.845 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:29.847+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:29.893 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:29.893 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:22:29.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.894 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:247163 5.7 5:eac48aa1:::benchmark_data_smithi001_23533_object119046:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T02:22:29.894 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:29.887073+0000", 2024-09-17T02:22:29.894 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0091921969999999992, 2024-09-17T02:22:29.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.009211917, 2024-09-17T02:22:29.894 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:29.894 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:29.894 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:29.894 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:29.894 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:29.894 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.894 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 247163 2024-09-17T02:22:29.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.894 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:29.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:29.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887073+0000", 2024-09-17T02:22:29.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:29.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887073+0000", 2024-09-17T02:22:29.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:29.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887073+0000", 2024-09-17T02:22:29.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3999999999999997e-07 2024-09-17T02:22:29.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:29.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887075+0000", 2024-09-17T02:22:29.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9099999999999999e-06 2024-09-17T02:22:29.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:29.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887086+0000", 2024-09-17T02:22:29.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1103e-05 2024-09-17T02:22:29.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887091+0000", 2024-09-17T02:22:29.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1450000000000001e-06 2024-09-17T02:22:29.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:29.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887129+0000", 2024-09-17T02:22:29.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8099000000000002e-05 2024-09-17T02:22:29.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:29.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887231+0000", 2024-09-17T02:22:29.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010264600000000001 2024-09-17T02:22:29.897 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.897 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:29.898 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.898 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:247164 5.a 5:53485188:::benchmark_data_smithi001_23533_object119047:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T02:22:29.898 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:29.887099+0000", 2024-09-17T02:22:29.898 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0091661959999999997, 2024-09-17T02:22:29.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0092284259999999996, 2024-09-17T02:22:29.898 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:29.898 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:29.898 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:29.898 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:29.898 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:29.898 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.898 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 247164 2024-09-17T02:22:29.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.899 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:29.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:29.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887099+0000", 2024-09-17T02:22:29.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:29.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887099+0000", 2024-09-17T02:22:29.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:29.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887099+0000", 2024-09-17T02:22:29.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3700000000000001e-07 2024-09-17T02:22:29.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:29.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887102+0000", 2024-09-17T02:22:29.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.278e-06 2024-09-17T02:22:29.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:29.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887108+0000", 2024-09-17T02:22:29.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0650000000000004e-06 2024-09-17T02:22:29.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887114+0000", 2024-09-17T02:22:29.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2990000000000002e-06 2024-09-17T02:22:29.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:29.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.889512+0000", 2024-09-17T02:22:29.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00239806 2024-09-17T02:22:29.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:29.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.889598+0000", 2024-09-17T02:22:29.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6298999999999995e-05 2024-09-17T02:22:29.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:29.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.889657+0000", 2024-09-17T02:22:29.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8910999999999999e-05 2024-09-17T02:22:29.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:29.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.892445+0000", 2024-09-17T02:22:29.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027878680000000002 2024-09-17T02:22:29.903 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.903 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:29.903 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.903 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:247166 5.7 5:e9d80227:::benchmark_data_smithi001_23533_object119049:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T02:22:29.903 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:29.887122+0000", 2024-09-17T02:22:29.903 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0091427910000000008, 2024-09-17T02:22:29.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0092466990000000006, 2024-09-17T02:22:29.904 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:29.904 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:29.904 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:29.904 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:29.904 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:29.904 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.904 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 247166 2024-09-17T02:22:29.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.904 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:29.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:29.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887122+0000", 2024-09-17T02:22:29.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:29.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887122+0000", 2024-09-17T02:22:29.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:29.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887123+0000", 2024-09-17T02:22:29.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8100000000000003e-07 2024-09-17T02:22:29.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:29.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887125+0000", 2024-09-17T02:22:29.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2390000000000001e-06 2024-09-17T02:22:29.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:29.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887129+0000", 2024-09-17T02:22:29.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9040000000000002e-06 2024-09-17T02:22:29.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887132+0000", 2024-09-17T02:22:29.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1259999999999998e-06 2024-09-17T02:22:29.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:29.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.889440+0000", 2024-09-17T02:22:29.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023075399999999999 2024-09-17T02:22:29.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:29.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.889510+0000", 2024-09-17T02:22:29.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9727999999999994e-05 2024-09-17T02:22:29.907 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.907 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:29.907 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.908 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:247167 5.8 5:1821cea0:::benchmark_data_smithi001_23533_object119050:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T02:22:29.908 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:29.887401+0000", 2024-09-17T02:22:29.908 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0088641380000000006, 2024-09-17T02:22:29.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.009002253, 2024-09-17T02:22:29.908 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:29.908 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:29.908 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:29.908 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:29.908 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:29.908 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.908 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 247167 2024-09-17T02:22:29.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.909 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:29.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:29.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887401+0000", 2024-09-17T02:22:29.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:29.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887401+0000", 2024-09-17T02:22:29.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:29.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887402+0000", 2024-09-17T02:22:29.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4200000000000005e-07 2024-09-17T02:22:29.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:29.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887406+0000", 2024-09-17T02:22:29.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9779999999999999e-06 2024-09-17T02:22:29.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:29.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887416+0000", 2024-09-17T02:22:29.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0190000000000001e-05 2024-09-17T02:22:29.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887423+0000", 2024-09-17T02:22:29.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9999999999999999e-06 2024-09-17T02:22:29.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:29.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.888957+0000", 2024-09-17T02:22:29.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015338330000000001 2024-09-17T02:22:29.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:29.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.889069+0000", 2024-09-17T02:22:29.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000112229 2024-09-17T02:22:29.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:29.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.889168+0000", 2024-09-17T02:22:29.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9290999999999995e-05 2024-09-17T02:22:29.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:29.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.892694+0000", 2024-09-17T02:22:29.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035253060000000002 2024-09-17T02:22:29.912 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.912 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:29.913 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.913 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:247170 5.6 5:68bfb414:::benchmark_data_smithi001_23533_object119053:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T02:22:29.913 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:29.887444+0000", 2024-09-17T02:22:29.913 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0088211890000000001, 2024-09-17T02:22:29.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0090011020000000004, 2024-09-17T02:22:29.913 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:29.913 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:29.913 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:29.913 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:29.913 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:29.914 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.914 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 247170 2024-09-17T02:22:29.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.914 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:29.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:29.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887444+0000", 2024-09-17T02:22:29.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:29.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887444+0000", 2024-09-17T02:22:29.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:29.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887445+0000", 2024-09-17T02:22:29.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1200000000000003e-07 2024-09-17T02:22:29.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:29.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887447+0000", 2024-09-17T02:22:29.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4310000000000001e-06 2024-09-17T02:22:29.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:29.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887454+0000", 2024-09-17T02:22:29.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8419999999999999e-06 2024-09-17T02:22:29.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887459+0000", 2024-09-17T02:22:29.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2279999999999998e-06 2024-09-17T02:22:29.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:29.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887514+0000", 2024-09-17T02:22:29.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4494999999999999e-05 2024-09-17T02:22:29.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:29.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887647+0000", 2024-09-17T02:22:29.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000133757 2024-09-17T02:22:29.917 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.917 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:29.917 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.917 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:247175 5.6 5.7ce176d6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T02:22:29.917 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:29.890994+0000", 2024-09-17T02:22:29.917 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0052714659999999998, 2024-09-17T02:22:29.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0054837999999999996, 2024-09-17T02:22:29.917 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:29.917 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:29.917 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:29.918 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:29.918 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:29.918 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.918 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 247175 2024-09-17T02:22:29.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.918 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:29.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:29.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.890994+0000", 2024-09-17T02:22:29.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:29.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.890994+0000", 2024-09-17T02:22:29.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:29.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.890995+0000", 2024-09-17T02:22:29.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.311e-06 2024-09-17T02:22:29.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:29.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.891000+0000", 2024-09-17T02:22:29.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6990000000000002e-06 2024-09-17T02:22:29.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:29.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.891011+0000", 2024-09-17T02:22:29.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1593000000000001e-05 2024-09-17T02:22:29.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.891018+0000", 2024-09-17T02:22:29.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9369999999999998e-06 2024-09-17T02:22:29.920 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.920 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:29.920 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.920 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:247176 5.7 5.6d9c4537 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T02:22:29.921 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:29.891037+0000", 2024-09-17T02:22:29.921 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0052279140000000002, 2024-09-17T02:22:29.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005466996, 2024-09-17T02:22:29.921 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:29.921 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:29.921 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:29.921 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:29.921 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:29.921 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.921 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 247176 2024-09-17T02:22:29.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.921 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:29.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:29.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.891037+0000", 2024-09-17T02:22:29.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:29.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.891037+0000", 2024-09-17T02:22:29.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:29.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.891038+0000", 2024-09-17T02:22:29.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3799999999999997e-07 2024-09-17T02:22:29.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:29.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.891041+0000", 2024-09-17T02:22:29.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8669999999999998e-06 2024-09-17T02:22:29.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:29.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.891049+0000", 2024-09-17T02:22:29.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0029999999999994e-06 2024-09-17T02:22:29.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.891055+0000", 2024-09-17T02:22:29.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3829999999999997e-06 2024-09-17T02:22:29.923 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.924 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:29.924 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.924 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:247174 5.3 e72/64 5:c174f6d3:::benchmark_data_smithi001_23533_object119057:head v 72'15538, mlcod=72'15535)", 2024-09-17T02:22:29.924 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:29.891162+0000", 2024-09-17T02:22:29.924 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0051027779999999997, 2024-09-17T02:22:29.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053720080000000002, 2024-09-17T02:22:29.924 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:29.924 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:29.924 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:29.924 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:29.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:29.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.891162+0000", 2024-09-17T02:22:29.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:29.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.891162+0000", 2024-09-17T02:22:29.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:29.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.891163+0000", 2024-09-17T02:22:29.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3600000000000004e-07 2024-09-17T02:22:29.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:29.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.891167+0000", 2024-09-17T02:22:29.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3189999999999996e-06 2024-09-17T02:22:29.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:29.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.891176+0000", 2024-09-17T02:22:29.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9840000000000007e-06 2024-09-17T02:22:29.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.891182+0000", 2024-09-17T02:22:29.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.75e-06 2024-09-17T02:22:29.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:29.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.891618+0000", 2024-09-17T02:22:29.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00043564899999999998 2024-09-17T02:22:29.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:29.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.891634+0000", 2024-09-17T02:22:29.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6650000000000002e-05 2024-09-17T02:22:29.928 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.928 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:29.928 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.928 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:247177 5.2 5.6e705852 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T02:22:29.928 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:29.891829+0000", 2024-09-17T02:22:29.928 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0044357709999999998, 2024-09-17T02:22:29.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004734495, 2024-09-17T02:22:29.928 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:29.928 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:29.928 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:29.928 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:29.929 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:29.929 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.929 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 247177 2024-09-17T02:22:29.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.929 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:29.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:29.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.891829+0000", 2024-09-17T02:22:29.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:29.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.891829+0000", 2024-09-17T02:22:29.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:29.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.891830+0000", 2024-09-17T02:22:29.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1999999999999998e-07 2024-09-17T02:22:29.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:29.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.891835+0000", 2024-09-17T02:22:29.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4220000000000002e-06 2024-09-17T02:22:29.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:29.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.891848+0000", 2024-09-17T02:22:29.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2738999999999999e-05 2024-09-17T02:22:29.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.891855+0000", 2024-09-17T02:22:29.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2350000000000002e-06 2024-09-17T02:22:29.931 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.931 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:29.931 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.931 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:247179 5.6 5.fd404816 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T02:22:29.932 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:29.892313+0000", 2024-09-17T02:22:29.932 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0039522050000000003, 2024-09-17T02:22:29.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042779749999999998, 2024-09-17T02:22:29.932 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:29.932 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:29.932 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:29.932 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:29.932 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:29.932 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.932 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 247179 2024-09-17T02:22:29.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.932 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:29.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:29.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.892313+0000", 2024-09-17T02:22:29.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:29.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.892313+0000", 2024-09-17T02:22:29.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:29.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.892314+0000", 2024-09-17T02:22:29.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3499999999999995e-07 2024-09-17T02:22:29.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:29.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.892317+0000", 2024-09-17T02:22:29.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4989999999999999e-06 2024-09-17T02:22:29.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:29.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.892327+0000", 2024-09-17T02:22:29.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4429999999999992e-06 2024-09-17T02:22:29.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.892333+0000", 2024-09-17T02:22:29.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.139e-06 2024-09-17T02:22:29.935 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.935 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:29.935 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.935 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:247180 5.b e72/51 5:da889e36:::benchmark_data_smithi001_23533_object119063:head v 72'15299, mlcod=72'15296)", 2024-09-17T02:22:29.935 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:29.892878+0000", 2024-09-17T02:22:29.935 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00338675, 2024-09-17T02:22:29.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037397810000000002, 2024-09-17T02:22:29.935 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:29.935 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:29.935 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:29.935 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:29.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:29.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.892878+0000", 2024-09-17T02:22:29.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:29.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.892878+0000", 2024-09-17T02:22:29.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:29.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.892879+0000", 2024-09-17T02:22:29.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.82e-07 2024-09-17T02:22:29.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:29.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.892883+0000", 2024-09-17T02:22:29.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0690000000000003e-06 2024-09-17T02:22:29.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:29.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.892890+0000", 2024-09-17T02:22:29.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0450000000000003e-06 2024-09-17T02:22:29.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.892901+0000", 2024-09-17T02:22:29.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0756e-05 2024-09-17T02:22:29.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:29.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.892941+0000", 2024-09-17T02:22:29.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0388e-05 2024-09-17T02:22:29.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:29.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.892954+0000", 2024-09-17T02:22:29.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3118e-05 2024-09-17T02:22:29.938 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.938 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:29.938 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.939 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:247181 5.8 5.d3f769f8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T02:22:29.939 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:29.893079+0000", 2024-09-17T02:22:29.939 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0031862359999999998, 2024-09-17T02:22:29.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035677669999999999, 2024-09-17T02:22:29.939 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:29.939 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:29.939 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:29.939 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:29.939 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:29.939 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.939 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 247181 2024-09-17T02:22:29.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.940 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:29.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:29.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.893079+0000", 2024-09-17T02:22:29.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:29.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.893079+0000", 2024-09-17T02:22:29.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:29.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.893080+0000", 2024-09-17T02:22:29.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1200000000000002e-07 2024-09-17T02:22:29.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:29.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.893084+0000", 2024-09-17T02:22:29.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8380000000000004e-06 2024-09-17T02:22:29.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:29.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.893094+0000", 2024-09-17T02:22:29.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0213e-05 2024-09-17T02:22:29.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.893100+0000", 2024-09-17T02:22:29.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2029999999999997e-06 2024-09-17T02:22:29.942 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.942 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:29.942 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.942 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:247182 5.4 e72/52 5:2c0a3628:::benchmark_data_smithi001_23533_object119065:head v 72'15239, mlcod=72'15237)", 2024-09-17T02:22:29.942 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:29.894713+0000", 2024-09-17T02:22:29.942 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0015520550000000001, 2024-09-17T02:22:29.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019606300000000001, 2024-09-17T02:22:29.942 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:29.943 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:29.943 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:29.943 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:29.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:29.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.894713+0000", 2024-09-17T02:22:29.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:29.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.894713+0000", 2024-09-17T02:22:29.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:29.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.894714+0000", 2024-09-17T02:22:29.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6800000000000001e-07 2024-09-17T02:22:29.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:29.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.894717+0000", 2024-09-17T02:22:29.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5870000000000001e-06 2024-09-17T02:22:29.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:29.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.894724+0000", 2024-09-17T02:22:29.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1849999999999998e-06 2024-09-17T02:22:29.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.894729+0000", 2024-09-17T02:22:29.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9300000000000002e-06 2024-09-17T02:22:29.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:29.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.894770+0000", 2024-09-17T02:22:29.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0635e-05 2024-09-17T02:22:29.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:29.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.894782+0000", 2024-09-17T02:22:29.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1936000000000001e-05 2024-09-17T02:22:29.946 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.946 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:29.946 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.946 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:247183 5.e e72/22)", 2024-09-17T02:22:29.946 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:29.895878+0000", 2024-09-17T02:22:29.946 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00038682199999999999, 2024-09-17T02:22:29.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00082325599999999997, 2024-09-17T02:22:29.946 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:29.946 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:29.946 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:29.947 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:29.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:29.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.895878+0000", 2024-09-17T02:22:29.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:29.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.895878+0000", 2024-09-17T02:22:29.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:29.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.895879+0000", 2024-09-17T02:22:29.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.51e-07 2024-09-17T02:22:29.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:29.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.895883+0000", 2024-09-17T02:22:29.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1640000000000003e-06 2024-09-17T02:22:29.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:29.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.895893+0000", 2024-09-17T02:22:29.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7429999999999997e-06 2024-09-17T02:22:29.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.895898+0000", 2024-09-17T02:22:29.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5829999999999997e-06 2024-09-17T02:22:29.949 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.949 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:29.949 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.949 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:247162 5.a 5:5f6173e0:::benchmark_data_smithi001_23533_object119045:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T02:22:29.949 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:29.887043+0000", 2024-09-17T02:22:29.949 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0092222469999999994, 2024-09-17T02:22:29.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0096840959999999997, 2024-09-17T02:22:29.949 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:29.949 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:29.950 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:29.950 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:29.950 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:29.950 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:29.950 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 247162 2024-09-17T02:22:29.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.950 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:29.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:29.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887043+0000", 2024-09-17T02:22:29.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:29.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887043+0000", 2024-09-17T02:22:29.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:29.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:29.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887044+0000", 2024-09-17T02:22:29.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7499999999999999e-07 2024-09-17T02:22:29.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:29.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887048+0000", 2024-09-17T02:22:29.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8039999999999999e-06 2024-09-17T02:22:29.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:29.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887056+0000", 2024-09-17T02:22:29.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1240000000000005e-06 2024-09-17T02:22:29.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:29.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887060+0000", 2024-09-17T02:22:29.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.724e-06 2024-09-17T02:22:29.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:29.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887105+0000", 2024-09-17T02:22:29.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4115e-05 2024-09-17T02:22:29.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:29.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887214+0000", 2024-09-17T02:22:29.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109448 2024-09-17T02:22:29.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:29.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.887324+0000", 2024-09-17T02:22:29.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109975 2024-09-17T02:22:29.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:29.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:29.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:29.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:29.892139+0000", 2024-09-17T02:22:29.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048146539999999998 2024-09-17T02:22:29.954 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.954 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:29.954 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.954 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:29.954 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:22:29.954 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 15 2024-09-17T02:22:29.954 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:29.955 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:22:29.956 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:29.954+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:29.956 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:22:29.957 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:22:29.957 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:29.958 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:22:29.958 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:22:29.958 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:22:29.958 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:22:30.056 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:30.054+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:30.150 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:30.150 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:30.157 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:30.159+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:30.169 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:30.261 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:30.263+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:30.358 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:30.358+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:30.361 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:30.361 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:30.380 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:30.443 INFO:teuthology.orchestra.run.smithi001.stderr:noscrub is set 2024-09-17T02:22:30.461 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:30.459+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:30.532 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:30.532 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:30.550 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:30.560 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:30.559+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:30.661 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:30.662+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:30.701 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:30.701 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:30.719 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:30.762 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:30.763+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:30.865 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:30.862+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:30.913 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:30.913 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:30.934 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:30.981 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:30.983+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:31.067 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:31.067+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:31.088 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:31.088 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:31.107 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:31.165 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:31.162+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:31.266 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:31.267+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:31.294 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:31.295 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:31.313 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:31.367 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:31.366+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:31.468 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:31.467+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:31.504 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:31.504 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:31.524 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:31.570 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:31.570+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:31.670 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:31.671+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:31.683 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:31.684 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:31.703 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:31.790 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:31.790+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:31.872 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:31.870+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:31.897 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:31.897 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:31.912 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~53s 2024-09-17T02:22:31.916 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:31.959 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:22:31.973 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:31.975+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:32.074 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:32.074+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:32.112 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:32.112 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:32.122 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:22:32.122 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:22:32.131 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:32.140 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:22:32.141 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:22:32.141 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:22:32.144 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:22:32.144 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:22:32.181 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:32.179+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:32.276 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:32.274+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:32.291 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:32.291 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:22:32.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.291 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252803 5.8 5:1aaa7b2e:::benchmark_data_smithi001_23533_object124686:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:32.291 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.288390+0000", 2024-09-17T02:22:32.291 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0037116430000000001, 2024-09-17T02:22:32.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037347779999999998, 2024-09-17T02:22:32.292 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.292 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.292 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:32.292 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:32.292 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:32.292 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:32.292 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252803 2024-09-17T02:22:32.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.292 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288390+0000", 2024-09-17T02:22:32.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288390+0000", 2024-09-17T02:22:32.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288390+0000", 2024-09-17T02:22:32.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9999999999999998e-07 2024-09-17T02:22:32.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288393+0000", 2024-09-17T02:22:32.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8679999999999999e-06 2024-09-17T02:22:32.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288400+0000", 2024-09-17T02:22:32.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1500000000000002e-06 2024-09-17T02:22:32.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288406+0000", 2024-09-17T02:22:32.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1749999999999996e-06 2024-09-17T02:22:32.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288449+0000", 2024-09-17T02:22:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3065999999999997e-05 2024-09-17T02:22:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288568+0000", 2024-09-17T02:22:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000119537 2024-09-17T02:22:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288674+0000", 2024-09-17T02:22:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105455 2024-09-17T02:22:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252805 5.c 5:3bbcc4af:::benchmark_data_smithi001_23533_object124688:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.288964+0000", 2024-09-17T02:22:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0031376300000000002, 2024-09-17T02:22:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032359810000000002, 2024-09-17T02:22:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252805 2024-09-17T02:22:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288964+0000", 2024-09-17T02:22:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288964+0000", 2024-09-17T02:22:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288965+0000", 2024-09-17T02:22:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9099999999999991e-07 2024-09-17T02:22:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288969+0000", 2024-09-17T02:22:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1829999999999996e-06 2024-09-17T02:22:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288981+0000", 2024-09-17T02:22:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1980999999999999e-05 2024-09-17T02:22:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288995+0000", 2024-09-17T02:22:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3546999999999999e-05 2024-09-17T02:22:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.290304+0000", 2024-09-17T02:22:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013092640000000001 2024-09-17T02:22:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.290419+0000", 2024-09-17T02:22:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011507599999999999 2024-09-17T02:22:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252799 5.1 e73/61)", 2024-09-17T02:22:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.289177+0000", 2024-09-17T02:22:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0029242320000000001, 2024-09-17T02:22:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030801589999999998, 2024-09-17T02:22:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.289177+0000", 2024-09-17T02:22:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.289177+0000", 2024-09-17T02:22:32.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.289178+0000", 2024-09-17T02:22:32.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2699999999999999e-07 2024-09-17T02:22:32.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.289182+0000", 2024-09-17T02:22:32.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.549e-06 2024-09-17T02:22:32.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.289194+0000", 2024-09-17T02:22:32.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1573000000000001e-05 2024-09-17T02:22:32.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.289200+0000", 2024-09-17T02:22:32.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4679999999999997e-06 2024-09-17T02:22:32.303 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.303 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.303 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.304 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252798 5.3 e73/64 5:c9823c9b:::benchmark_data_smithi001_23533_object124681:head v 73'15925, mlcod=73'15922)", 2024-09-17T02:22:32.304 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.290277+0000", 2024-09-17T02:22:32.304 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001823999, 2024-09-17T02:22:32.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020269569999999998, 2024-09-17T02:22:32.304 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.304 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.304 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:32.304 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.290277+0000", 2024-09-17T02:22:32.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.290277+0000", 2024-09-17T02:22:32.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.290278+0000", 2024-09-17T02:22:32.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5199999999999997e-07 2024-09-17T02:22:32.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.290298+0000", 2024-09-17T02:22:32.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0179000000000001e-05 2024-09-17T02:22:32.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.290309+0000", 2024-09-17T02:22:32.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0498e-05 2024-09-17T02:22:32.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.290315+0000", 2024-09-17T02:22:32.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2389999999999999e-06 2024-09-17T02:22:32.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.290642+0000", 2024-09-17T02:22:32.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032655 2024-09-17T02:22:32.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.290658+0000", 2024-09-17T02:22:32.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6799e-05 2024-09-17T02:22:32.307 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.307 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.307 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.307 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252800 5.b e73/51 5:d4d1ac35:::benchmark_data_smithi001_23533_object124683:head v 73'15645, mlcod=73'15643)", 2024-09-17T02:22:32.308 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.290327+0000", 2024-09-17T02:22:32.308 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0017749630000000001, 2024-09-17T02:22:32.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020345910000000001, 2024-09-17T02:22:32.308 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.308 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.308 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:32.308 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.290327+0000", 2024-09-17T02:22:32.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.290327+0000", 2024-09-17T02:22:32.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.290327+0000", 2024-09-17T02:22:32.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.41e-07 2024-09-17T02:22:32.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.290330+0000", 2024-09-17T02:22:32.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4580000000000002e-06 2024-09-17T02:22:32.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.290337+0000", 2024-09-17T02:22:32.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6120000000000004e-06 2024-09-17T02:22:32.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.290342+0000", 2024-09-17T02:22:32.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6720000000000003e-06 2024-09-17T02:22:32.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.292263+0000", 2024-09-17T02:22:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019213780000000001 2024-09-17T02:22:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.292281+0000", 2024-09-17T02:22:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7737e-05 2024-09-17T02:22:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252806 5.0 5:0bc4b596:::benchmark_data_smithi001_23533_object124689:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.290425+0000", 2024-09-17T02:22:32.311 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001676893, 2024-09-17T02:22:32.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019912969999999999, 2024-09-17T02:22:32.312 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.312 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.312 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:32.312 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:32.312 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:32.312 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:32.312 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252806 2024-09-17T02:22:32.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.312 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.290425+0000", 2024-09-17T02:22:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.290425+0000", 2024-09-17T02:22:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.290426+0000", 2024-09-17T02:22:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.046e-06 2024-09-17T02:22:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.290429+0000", 2024-09-17T02:22:32.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.58e-06 2024-09-17T02:22:32.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.290441+0000", 2024-09-17T02:22:32.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1291000000000001e-05 2024-09-17T02:22:32.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.290447+0000", 2024-09-17T02:22:32.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9090000000000003e-06 2024-09-17T02:22:32.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.290593+0000", 2024-09-17T02:22:32.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000145768 2024-09-17T02:22:32.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.290702+0000", 2024-09-17T02:22:32.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010842 2024-09-17T02:22:32.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:32.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.290796+0000", 2024-09-17T02:22:32.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4794000000000001e-05 2024-09-17T02:22:32.316 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.316 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.316 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.316 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252807 5.e e73/22 5:73431b2b:::benchmark_data_smithi001_23533_object124690:head v 73'15814, mlcod=73'15812)", 2024-09-17T02:22:32.316 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.291446+0000", 2024-09-17T02:22:32.316 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00065557899999999999, 2024-09-17T02:22:32.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010349109999999999, 2024-09-17T02:22:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.291446+0000", 2024-09-17T02:22:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.291446+0000", 2024-09-17T02:22:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.291447+0000", 2024-09-17T02:22:32.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1099999999999995e-07 2024-09-17T02:22:32.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.291452+0000", 2024-09-17T02:22:32.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1950000000000002e-06 2024-09-17T02:22:32.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.291461+0000", 2024-09-17T02:22:32.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9910000000000008e-06 2024-09-17T02:22:32.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.291467+0000", 2024-09-17T02:22:32.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720000000000003e-06 2024-09-17T02:22:32.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.291512+0000", 2024-09-17T02:22:32.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5228000000000001e-05 2024-09-17T02:22:32.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.291529+0000", 2024-09-17T02:22:32.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6835999999999999e-05 2024-09-17T02:22:32.320 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.320 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.320 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.320 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252792 5.7 5:e2273259:::benchmark_data_smithi001_23533_object124675:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:32.320 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.286040+0000", 2024-09-17T02:22:32.320 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0060611520000000002, 2024-09-17T02:22:32.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064963740000000001, 2024-09-17T02:22:32.320 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.320 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.320 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:32.321 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:32.321 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:32.321 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:32.321 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252792 2024-09-17T02:22:32.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.321 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.286040+0000", 2024-09-17T02:22:32.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.286040+0000", 2024-09-17T02:22:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.286041+0000", 2024-09-17T02:22:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.001e-06 2024-09-17T02:22:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.286046+0000", 2024-09-17T02:22:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8590000000000004e-06 2024-09-17T02:22:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.286055+0000", 2024-09-17T02:22:32.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4700000000000002e-06 2024-09-17T02:22:32.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.286063+0000", 2024-09-17T02:22:32.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-09-17T02:22:32.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.286364+0000", 2024-09-17T02:22:32.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030141800000000002 2024-09-17T02:22:32.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.286486+0000", 2024-09-17T02:22:32.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000121101 2024-09-17T02:22:32.324 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.324 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.324 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.325 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252791 5.1 e73/61 5:8f76d780:::benchmark_data_smithi001_23533_object124674:head v 73'15770, mlcod=73'15767)", 2024-09-17T02:22:32.325 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.287739+0000", 2024-09-17T02:22:32.325 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0043622269999999998, 2024-09-17T02:22:32.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048593890000000004, 2024-09-17T02:22:32.325 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.325 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.325 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:32.325 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.287739+0000", 2024-09-17T02:22:32.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.287739+0000", 2024-09-17T02:22:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.287740+0000", 2024-09-17T02:22:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4900000000000001e-07 2024-09-17T02:22:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.287744+0000", 2024-09-17T02:22:32.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2819999999999998e-06 2024-09-17T02:22:32.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.287748+0000", 2024-09-17T02:22:32.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0069999999999999e-06 2024-09-17T02:22:32.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.287751+0000", 2024-09-17T02:22:32.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7410000000000001e-06 2024-09-17T02:22:32.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.287787+0000", 2024-09-17T02:22:32.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6445000000000001e-05 2024-09-17T02:22:32.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.287808+0000", 2024-09-17T02:22:32.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0789e-05 2024-09-17T02:22:32.328 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.328 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.328 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.328 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252794 5.2 5:48ebbab9:::benchmark_data_smithi001_23533_object124677:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:32.328 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.287808+0000", 2024-09-17T02:22:32.329 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0042934339999999996, 2024-09-17T02:22:32.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048465189999999997, 2024-09-17T02:22:32.329 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.329 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.329 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:32.329 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:32.329 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:32.329 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:32.329 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252794 2024-09-17T02:22:32.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.329 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.287808+0000", 2024-09-17T02:22:32.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.287808+0000", 2024-09-17T02:22:32.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.287809+0000", 2024-09-17T02:22:32.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4600000000000005e-07 2024-09-17T02:22:32.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.287811+0000", 2024-09-17T02:22:32.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.548e-06 2024-09-17T02:22:32.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.287819+0000", 2024-09-17T02:22:32.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1009999999999992e-06 2024-09-17T02:22:32.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.287825+0000", 2024-09-17T02:22:32.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8799999999999996e-06 2024-09-17T02:22:32.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288074+0000", 2024-09-17T02:22:32.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024855400000000001 2024-09-17T02:22:32.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288174+0000", 2024-09-17T02:22:32.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100708 2024-09-17T02:22:32.332 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.332 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.332 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.332 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252795 5.1 e73/61 5:8686e7e0:::benchmark_data_smithi001_23533_object124678:head v 73'15771, mlcod=73'15767)", 2024-09-17T02:22:32.333 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.287892+0000", 2024-09-17T02:22:32.333 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0042098470000000001, 2024-09-17T02:22:32.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048240399999999999, 2024-09-17T02:22:32.333 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.333 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.333 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:32.333 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.287892+0000", 2024-09-17T02:22:32.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.287892+0000", 2024-09-17T02:22:32.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.287892+0000", 2024-09-17T02:22:32.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3900000000000004e-07 2024-09-17T02:22:32.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.287897+0000", 2024-09-17T02:22:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9570000000000001e-06 2024-09-17T02:22:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.287907+0000", 2024-09-17T02:22:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4890000000000001e-06 2024-09-17T02:22:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.287913+0000", 2024-09-17T02:22:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6789999999999999e-06 2024-09-17T02:22:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.291237+0000", 2024-09-17T02:22:32.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033235750000000001 2024-09-17T02:22:32.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.291255+0000", 2024-09-17T02:22:32.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7861999999999999e-05 2024-09-17T02:22:32.336 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.336 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.336 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.337 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252796 5.5 5:af880d7d:::benchmark_data_smithi001_23533_object124679:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:32.337 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.287961+0000", 2024-09-17T02:22:32.337 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0041403680000000002, 2024-09-17T02:22:32.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048102819999999999, 2024-09-17T02:22:32.337 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.337 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.337 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:32.337 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:32.337 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:32.337 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:32.337 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252796 2024-09-17T02:22:32.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.337 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.287961+0000", 2024-09-17T02:22:32.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.287961+0000", 2024-09-17T02:22:32.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.287962+0000", 2024-09-17T02:22:32.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6400000000000001e-07 2024-09-17T02:22:32.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.287966+0000", 2024-09-17T02:22:32.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.664e-06 2024-09-17T02:22:32.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.287976+0000", 2024-09-17T02:22:32.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0552e-05 2024-09-17T02:22:32.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.287983+0000", 2024-09-17T02:22:32.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2169999999999997e-06 2024-09-17T02:22:32.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.290981+0000", 2024-09-17T02:22:32.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029978119999999999 2024-09-17T02:22:32.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.291100+0000", 2024-09-17T02:22:32.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000119256 2024-09-17T02:22:32.341 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.341 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.341 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.341 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252801 5.a 5:5e5e1649:::benchmark_data_smithi001_23533_object124684:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:32.341 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.288125+0000", 2024-09-17T02:22:32.341 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0039762490000000003, 2024-09-17T02:22:32.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047139039999999997, 2024-09-17T02:22:32.341 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.341 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.341 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:32.341 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:32.341 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252801 2024-09-17T02:22:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288125+0000", 2024-09-17T02:22:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288125+0000", 2024-09-17T02:22:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288126+0000", 2024-09-17T02:22:32.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.61e-07 2024-09-17T02:22:32.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288130+0000", 2024-09-17T02:22:32.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.58e-06 2024-09-17T02:22:32.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288143+0000", 2024-09-17T02:22:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3495999999999999e-05 2024-09-17T02:22:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288149+0000", 2024-09-17T02:22:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.015e-06 2024-09-17T02:22:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288225+0000", 2024-09-17T02:22:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5407999999999994e-05 2024-09-17T02:22:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288352+0000", 2024-09-17T02:22:32.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000127928 2024-09-17T02:22:32.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:32.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288461+0000", 2024-09-17T02:22:32.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010840600000000001 2024-09-17T02:22:32.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:32.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.291266+0000", 2024-09-17T02:22:32.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028047480000000001 2024-09-17T02:22:32.345 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.345 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.346 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.346 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252802 5.2 5.a6e58ed2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:32.346 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.288246+0000", 2024-09-17T02:22:32.346 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0038550759999999998, 2024-09-17T02:22:32.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046778389999999996, 2024-09-17T02:22:32.346 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.346 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.346 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-17T02:22:32.346 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:32.346 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:32.346 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:32.346 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252802 2024-09-17T02:22:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288246+0000", 2024-09-17T02:22:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288246+0000", 2024-09-17T02:22:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288247+0000", 2024-09-17T02:22:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3e-07 2024-09-17T02:22:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288250+0000", 2024-09-17T02:22:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9550000000000001e-06 2024-09-17T02:22:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288258+0000", 2024-09-17T02:22:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8949999999999998e-06 2024-09-17T02:22:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288263+0000", 2024-09-17T02:22:32.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3809999999999998e-06 2024-09-17T02:22:32.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.290536+0000", 2024-09-17T02:22:32.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022729899999999999 2024-09-17T02:22:32.349 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.349 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.349 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.349 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252797 5.3 e73/64 5:cc70ff6c:::benchmark_data_smithi001_23533_object124680:head v 73'15924, mlcod=73'15922)", 2024-09-17T02:22:32.349 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.288339+0000", 2024-09-17T02:22:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0037627419999999999, 2024-09-17T02:22:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046505100000000001, 2024-09-17T02:22:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-17T02:22:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288339+0000", 2024-09-17T02:22:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288339+0000", 2024-09-17T02:22:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288339+0000", 2024-09-17T02:22:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5400000000000002e-07 2024-09-17T02:22:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288343+0000", 2024-09-17T02:22:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9060000000000004e-06 2024-09-17T02:22:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288350+0000", 2024-09-17T02:22:32.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1890000000000001e-06 2024-09-17T02:22:32.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288355+0000", 2024-09-17T02:22:32.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.814e-06 2024-09-17T02:22:32.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288790+0000", 2024-09-17T02:22:32.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00043491800000000001 2024-09-17T02:22:32.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.288810+0000", 2024-09-17T02:22:32.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0380000000000001e-05 2024-09-17T02:22:32.353 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.353 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.353 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.353 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.353 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-17T02:22:32.353 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 15 2024-09-17T02:22:32.353 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:32.354 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:32.401 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:32.403+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:32.470 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T02:22:32.477 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:32.479+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:32.551 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:32.551 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:22:32.551 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:22:32.551 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:22:32.552 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:32.571 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:32.577 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:32.578+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:32.679 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:32.678+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:32.765 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:32.766 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:22:32.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:22:32.766 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:22:32.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.766 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:22:32.766 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:32.766 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 110.199052886, 2024-09-17T02:22:32.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:22:32.766 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.766 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.766 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:32.766 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:32.767 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:32.767 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:32.767 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:22:32.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.767 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:32.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:32.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:22:32.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:22:32.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:22:32.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:22:32.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:22:32.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:22:32.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:22:32.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:22:32.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:22:32.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:22:32.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:22:32.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:22:32.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:32.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:22:32.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:22:32.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:22:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:22:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:22:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:22:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:22:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:22:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:32.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:22:32.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:22:32.773 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.773 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.773 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.773 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97759 5.a 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:32.773 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:32.773 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.169130812999995, 2024-09-17T02:22:32.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.089694871999999995, 2024-09-17T02:22:32.774 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.774 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.774 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:32.774 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:32.774 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:32.774 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:32.774 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97759 2024-09-17T02:22:32.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.774 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:32.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598386+0000", 2024-09-17T02:22:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999999e-07 2024-09-17T02:22:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598414+0000", 2024-09-17T02:22:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8013000000000001e-05 2024-09-17T02:22:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598420+0000", 2024-09-17T02:22:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1149999999999999e-06 2024-09-17T02:22:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598424+0000", 2024-09-17T02:22:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:22:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598479+0000", 2024-09-17T02:22:32.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4648999999999998e-05 2024-09-17T02:22:32.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598587+0000", 2024-09-17T02:22:32.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010853000000000001 2024-09-17T02:22:32.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:32.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598676+0000", 2024-09-17T02:22:32.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8381999999999995e-05 2024-09-17T02:22:32.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:32.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603766+0000", 2024-09-17T02:22:32.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050902559999999996 2024-09-17T02:22:32.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:32.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.687988+0000", 2024-09-17T02:22:32.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.084221753999999996 2024-09-17T02:22:32.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:32.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688037+0000", 2024-09-17T02:22:32.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-05 2024-09-17T02:22:32.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:32.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688080+0000", 2024-09-17T02:22:32.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3149999999999999e-05 2024-09-17T02:22:32.779 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.779 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.779 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.779 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97770 5.0 5:09c75033:::benchmark_data_smithi001_23533_object97769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:32.779 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:32.779 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.163988383000003, 2024-09-17T02:22:32.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.086380868, 2024-09-17T02:22:32.779 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97770 2024-09-17T02:22:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:32.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603529+0000", 2024-09-17T02:22:32.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:22:32.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603593+0000", 2024-09-17T02:22:32.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4216999999999999e-05 2024-09-17T02:22:32.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603603+0000", 2024-09-17T02:22:32.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5179999999999993e-06 2024-09-17T02:22:32.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603608+0000", 2024-09-17T02:22:32.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2039999999999996e-06 2024-09-17T02:22:32.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603653+0000", 2024-09-17T02:22:32.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5247000000000002e-05 2024-09-17T02:22:32.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603758+0000", 2024-09-17T02:22:32.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105352 2024-09-17T02:22:32.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:32.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603900+0000", 2024-09-17T02:22:32.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014198999999999999 2024-09-17T02:22:32.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:32.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.606097+0000", 2024-09-17T02:22:32.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021969839999999999 2024-09-17T02:22:32.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:32.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689756+0000", 2024-09-17T02:22:32.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.083659077999999998 2024-09-17T02:22:32.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:32.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689846+0000", 2024-09-17T02:22:32.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9320999999999994e-05 2024-09-17T02:22:32.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:32.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689908+0000", 2024-09-17T02:22:32.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720999999999998e-05 2024-09-17T02:22:32.785 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.785 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.785 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.785 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127513 5.c 5:3eca08e4:::benchmark_data_smithi001_23533_object127512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:32.785 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:32.785 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.323211958999998, 2024-09-17T02:22:32.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046626399999999998, 2024-09-17T02:22:32.786 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.786 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.786 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:32.786 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:32.786 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:32.786 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:32.786 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127513 2024-09-17T02:22:32.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.786 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:32.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:32.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444305+0000", 2024-09-17T02:22:32.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2529999999999999e-06 2024-09-17T02:22:32.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444466+0000", 2024-09-17T02:22:32.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016069700000000001 2024-09-17T02:22:32.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444479+0000", 2024-09-17T02:22:32.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2602999999999999e-05 2024-09-17T02:22:32.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444485+0000", 2024-09-17T02:22:32.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.669e-06 2024-09-17T02:22:32.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444560+0000", 2024-09-17T02:22:32.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4276999999999994e-05 2024-09-17T02:22:32.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444656+0000", 2024-09-17T02:22:32.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6490000000000006e-05 2024-09-17T02:22:32.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:32.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444739+0000", 2024-09-17T02:22:32.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3139999999999993e-05 2024-09-17T02:22:32.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:32.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.448438+0000", 2024-09-17T02:22:32.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036985490000000002 2024-09-17T02:22:32.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:32.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490732+0000", 2024-09-17T02:22:32.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042294353999999999 2024-09-17T02:22:32.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:32.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490859+0000", 2024-09-17T02:22:32.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012708899999999999 2024-09-17T02:22:32.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:32.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490930+0000", 2024-09-17T02:22:32.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:32.791 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.791 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.791 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.791 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127514 5.c 5:39cc1feb:::benchmark_data_smithi001_23533_object127513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:32.791 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:32.791 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.32301519, 2024-09-17T02:22:32.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049357228000000003, 2024-09-17T02:22:32.792 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.792 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.792 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:32.792 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:32.792 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:32.792 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:32.792 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127514 2024-09-17T02:22:32.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.792 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:32.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:32.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:32.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8599999999999998e-07 2024-09-17T02:22:32.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444554+0000", 2024-09-17T02:22:32.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3047999999999998e-05 2024-09-17T02:22:32.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444562+0000", 2024-09-17T02:22:32.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5830000000000001e-06 2024-09-17T02:22:32.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444567+0000", 2024-09-17T02:22:32.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4179999999999996e-06 2024-09-17T02:22:32.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446566+0000", 2024-09-17T02:22:32.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001998788 2024-09-17T02:22:32.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446696+0000", 2024-09-17T02:22:32.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129393 2024-09-17T02:22:32.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:32.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446794+0000", 2024-09-17T02:22:32.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8462999999999996e-05 2024-09-17T02:22:32.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:32.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.449036+0000", 2024-09-17T02:22:32.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022415880000000001 2024-09-17T02:22:32.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:32.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493737+0000", 2024-09-17T02:22:32.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044701682 2024-09-17T02:22:32.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:32.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493808+0000", 2024-09-17T02:22:32.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0846000000000006e-05 2024-09-17T02:22:32.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:32.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493858+0000", 2024-09-17T02:22:32.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9932999999999998e-05 2024-09-17T02:22:32.797 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.797 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.797 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.797 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129441 5.1 5:84c3199f:::benchmark_data_smithi001_23533_object1324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:32.797 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:32.798 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.264004702000001, 2024-09-17T02:22:32.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034387011000000002, 2024-09-17T02:22:32.798 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.798 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.798 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:32.798 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:32.798 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:32.798 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:32.798 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129441 2024-09-17T02:22:32.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.798 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:32.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:32.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503513+0000", 2024-09-17T02:22:32.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4759999999999999e-06 2024-09-17T02:22:32.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503518+0000", 2024-09-17T02:22:32.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-09-17T02:22:32.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503532+0000", 2024-09-17T02:22:32.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4049999999999999e-05 2024-09-17T02:22:32.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503541+0000", 2024-09-17T02:22:32.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5320000000000006e-06 2024-09-17T02:22:32.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506331+0000", 2024-09-17T02:22:32.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027899190000000001 2024-09-17T02:22:32.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506402+0000", 2024-09-17T02:22:32.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:32.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:32.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506477+0000", 2024-09-17T02:22:32.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4626e-05 2024-09-17T02:22:32.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:32.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509749+0000", 2024-09-17T02:22:32.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032726980000000001 2024-09-17T02:22:32.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:32.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537758+0000", 2024-09-17T02:22:32.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028008890000000002 2024-09-17T02:22:32.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:32.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537812+0000", 2024-09-17T02:22:32.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3300000000000001e-05 2024-09-17T02:22:32.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:32.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537898+0000", 2024-09-17T02:22:32.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6691000000000001e-05 2024-09-17T02:22:32.803 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.803 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.803 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.803 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252853 5.8 5:10eae6ef:::benchmark_data_smithi001_23533_object124736:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:32.803 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.319189+0000", 2024-09-17T02:22:32.803 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.44832675599999999, 2024-09-17T02:22:32.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042307663000000002, 2024-09-17T02:22:32.803 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.804 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.804 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:32.804 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:32.804 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:32.804 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:32.804 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252853 2024-09-17T02:22:32.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.804 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319189+0000", 2024-09-17T02:22:32.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319189+0000", 2024-09-17T02:22:32.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319190+0000", 2024-09-17T02:22:32.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4900000000000001e-07 2024-09-17T02:22:32.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319191+0000", 2024-09-17T02:22:32.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.714e-06 2024-09-17T02:22:32.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319197+0000", 2024-09-17T02:22:32.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7169999999999996e-06 2024-09-17T02:22:32.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319200+0000", 2024-09-17T02:22:32.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1389999999999999e-06 2024-09-17T02:22:32.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319233+0000", 2024-09-17T02:22:32.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2830000000000002e-05 2024-09-17T02:22:32.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319307+0000", 2024-09-17T02:22:32.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3794999999999994e-05 2024-09-17T02:22:32.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:32.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319401+0000", 2024-09-17T02:22:32.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4600999999999998e-05 2024-09-17T02:22:32.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:32.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321482+0000", 2024-09-17T02:22:32.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020808480000000002 2024-09-17T02:22:32.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:32.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361420+0000", 2024-09-17T02:22:32.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039937707000000003 2024-09-17T02:22:32.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:32.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361468+0000", 2024-09-17T02:22:32.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7722999999999997e-05 2024-09-17T02:22:32.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:32.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361497+0000", 2024-09-17T02:22:32.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9240000000000001e-05 2024-09-17T02:22:32.809 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.809 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.809 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.809 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252854 5.6 5:6f0fbabd:::benchmark_data_smithi001_23533_object124737:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:32.809 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.319209+0000", 2024-09-17T02:22:32.809 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.44830723700000003, 2024-09-17T02:22:32.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041094994000000003, 2024-09-17T02:22:32.809 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.809 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.809 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:32.809 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:32.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:32.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:32.810 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252854 2024-09-17T02:22:32.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.810 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319209+0000", 2024-09-17T02:22:32.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319209+0000", 2024-09-17T02:22:32.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319209+0000", 2024-09-17T02:22:32.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9099999999999999e-07 2024-09-17T02:22:32.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319211+0000", 2024-09-17T02:22:32.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9520000000000001e-06 2024-09-17T02:22:32.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319218+0000", 2024-09-17T02:22:32.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3350000000000001e-06 2024-09-17T02:22:32.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319224+0000", 2024-09-17T02:22:32.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6849999999999998e-06 2024-09-17T02:22:32.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321118+0000", 2024-09-17T02:22:32.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018940070000000001 2024-09-17T02:22:32.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321185+0000", 2024-09-17T02:22:32.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6806999999999999e-05 2024-09-17T02:22:32.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:32.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.360143+0000", 2024-09-17T02:22:32.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038958333999999997 2024-09-17T02:22:32.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:32.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.360227+0000", 2024-09-17T02:22:32.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3732000000000004e-05 2024-09-17T02:22:32.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:32.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.360304+0000", 2024-09-17T02:22:32.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6750999999999998e-05 2024-09-17T02:22:32.814 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.814 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.814 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.814 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252859 5.2 5:4a025e38:::benchmark_data_smithi001_23533_object124742:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:32.814 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.319239+0000", 2024-09-17T02:22:32.814 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.44827672699999999, 2024-09-17T02:22:32.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042922412, 2024-09-17T02:22:32.814 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.814 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.814 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:32.814 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:32.815 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:32.815 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:32.815 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252859 2024-09-17T02:22:32.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.815 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319239+0000", 2024-09-17T02:22:32.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319239+0000", 2024-09-17T02:22:32.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319240+0000", 2024-09-17T02:22:32.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7599999999999997e-07 2024-09-17T02:22:32.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319242+0000", 2024-09-17T02:22:32.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.294e-06 2024-09-17T02:22:32.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319248+0000", 2024-09-17T02:22:32.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.139e-06 2024-09-17T02:22:32.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319252+0000", 2024-09-17T02:22:32.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6389999999999998e-06 2024-09-17T02:22:32.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319312+0000", 2024-09-17T02:22:32.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9741000000000003e-05 2024-09-17T02:22:32.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319435+0000", 2024-09-17T02:22:32.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012350800000000001 2024-09-17T02:22:32.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:32.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.362015+0000", 2024-09-17T02:22:32.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042579662999999997 2024-09-17T02:22:32.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:32.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.362072+0000", 2024-09-17T02:22:32.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7453e-05 2024-09-17T02:22:32.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:32.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.362162+0000", 2024-09-17T02:22:32.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9399000000000002e-05 2024-09-17T02:22:32.819 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.819 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.819 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.819 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252860 5.0 5:00535124:::benchmark_data_smithi001_23533_object124743:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:32.819 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.319263+0000", 2024-09-17T02:22:32.819 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.44825262100000002, 2024-09-17T02:22:32.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044660535000000001, 2024-09-17T02:22:32.820 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.820 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.820 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:32.820 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:32.820 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:32.820 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:32.820 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252860 2024-09-17T02:22:32.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.820 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319263+0000", 2024-09-17T02:22:32.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319263+0000", 2024-09-17T02:22:32.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319264+0000", 2024-09-17T02:22:32.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9999999999999998e-07 2024-09-17T02:22:32.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319265+0000", 2024-09-17T02:22:32.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5319999999999999e-06 2024-09-17T02:22:32.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319269+0000", 2024-09-17T02:22:32.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9419999999999997e-06 2024-09-17T02:22:32.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319272+0000", 2024-09-17T02:22:32.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1879999999999998e-06 2024-09-17T02:22:32.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319310+0000", 2024-09-17T02:22:32.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7509000000000003e-05 2024-09-17T02:22:32.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319433+0000", 2024-09-17T02:22:32.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012351500000000001 2024-09-17T02:22:32.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:32.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319544+0000", 2024-09-17T02:22:32.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111011 2024-09-17T02:22:32.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:32.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363800+0000", 2024-09-17T02:22:32.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044255456999999998 2024-09-17T02:22:32.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:32.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363837+0000", 2024-09-17T02:22:32.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.684e-05 2024-09-17T02:22:32.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:32.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363885+0000", 2024-09-17T02:22:32.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8324e-05 2024-09-17T02:22:32.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:32.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363924+0000", 2024-09-17T02:22:32.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8816999999999998e-05 2024-09-17T02:22:32.825 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.825 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.825 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.825 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252861 5.6 5:64c353c8:::benchmark_data_smithi001_23533_object124744:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:32.825 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.321550+0000", 2024-09-17T02:22:32.825 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.445965946, 2024-09-17T02:22:32.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039569213999999998, 2024-09-17T02:22:32.826 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.826 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.826 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:32.826 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:32.826 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:32.826 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:32.826 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252861 2024-09-17T02:22:32.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.826 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321550+0000", 2024-09-17T02:22:32.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321550+0000", 2024-09-17T02:22:32.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321551+0000", 2024-09-17T02:22:32.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1710000000000001e-06 2024-09-17T02:22:32.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321559+0000", 2024-09-17T02:22:32.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8399999999999995e-06 2024-09-17T02:22:32.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321569+0000", 2024-09-17T02:22:32.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9499999999999996e-06 2024-09-17T02:22:32.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321576+0000", 2024-09-17T02:22:32.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8979999999999999e-06 2024-09-17T02:22:32.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322921+0000", 2024-09-17T02:22:32.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001345026 2024-09-17T02:22:32.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323020+0000", 2024-09-17T02:22:32.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9505000000000004e-05 2024-09-17T02:22:32.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:32.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361001+0000", 2024-09-17T02:22:32.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037980216999999997 2024-09-17T02:22:32.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:32.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361039+0000", 2024-09-17T02:22:32.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8729999999999997e-05 2024-09-17T02:22:32.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:32.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361119+0000", 2024-09-17T02:22:32.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9876999999999994e-05 2024-09-17T02:22:32.830 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.830 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.830 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.831 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252862 5.0 5:027af5f9:::benchmark_data_smithi001_23533_object124745:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:32.831 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.321589+0000", 2024-09-17T02:22:32.831 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.445927185, 2024-09-17T02:22:32.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042469481000000003, 2024-09-17T02:22:32.831 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.831 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.831 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:32.831 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:32.831 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:32.831 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:32.831 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252862 2024-09-17T02:22:32.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.831 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321589+0000", 2024-09-17T02:22:32.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321589+0000", 2024-09-17T02:22:32.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321589+0000", 2024-09-17T02:22:32.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7999999999999996e-07 2024-09-17T02:22:32.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321591+0000", 2024-09-17T02:22:32.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.12e-06 2024-09-17T02:22:32.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321597+0000", 2024-09-17T02:22:32.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7880000000000003e-06 2024-09-17T02:22:32.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321602+0000", 2024-09-17T02:22:32.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6450000000000004e-06 2024-09-17T02:22:32.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321634+0000", 2024-09-17T02:22:32.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1959999999999999e-05 2024-09-17T02:22:32.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321736+0000", 2024-09-17T02:22:32.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101879 2024-09-17T02:22:32.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:32.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321856+0000", 2024-09-17T02:22:32.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120227 2024-09-17T02:22:32.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:32.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363941+0000", 2024-09-17T02:22:32.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042085514999999997 2024-09-17T02:22:32.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:32.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363978+0000", 2024-09-17T02:22:32.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7002000000000002e-05 2024-09-17T02:22:32.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:32.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.364023+0000", 2024-09-17T02:22:32.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4978999999999997e-05 2024-09-17T02:22:32.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:32.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.364058+0000", 2024-09-17T02:22:32.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4885999999999998e-05 2024-09-17T02:22:32.836 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.836 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.836 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.836 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252852 5.3 e73/64 5:c3aafdc8:::benchmark_data_smithi001_23533_object124735:head v 73'15929, mlcod=73'15927)", 2024-09-17T02:22:32.836 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.321622+0000", 2024-09-17T02:22:32.836 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.44589369699999998, 2024-09-17T02:22:32.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037496129000000003, 2024-09-17T02:22:32.837 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.837 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.837 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:32.837 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321622+0000", 2024-09-17T02:22:32.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321622+0000", 2024-09-17T02:22:32.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321623+0000", 2024-09-17T02:22:32.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0900000000000001e-07 2024-09-17T02:22:32.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321631+0000", 2024-09-17T02:22:32.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6790000000000005e-06 2024-09-17T02:22:32.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321637+0000", 2024-09-17T02:22:32.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4500000000000001e-06 2024-09-17T02:22:32.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321642+0000", 2024-09-17T02:22:32.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7480000000000001e-06 2024-09-17T02:22:32.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321690+0000", 2024-09-17T02:22:32.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8541999999999997e-05 2024-09-17T02:22:32.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321705+0000", 2024-09-17T02:22:32.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.517e-05 2024-09-17T02:22:32.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:32.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359076+0000", 2024-09-17T02:22:32.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037370642000000003 2024-09-17T02:22:32.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:32.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359118+0000", 2024-09-17T02:22:32.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2289000000000001e-05 2024-09-17T02:22:32.841 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.841 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.841 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.841 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252856 5.1 e73/61 5:82c49704:::benchmark_data_smithi001_23533_object124739:head v 73'15774, mlcod=73'15772)", 2024-09-17T02:22:32.841 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.321652+0000", 2024-09-17T02:22:32.841 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.44586400700000001, 2024-09-17T02:22:32.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037495563000000003, 2024-09-17T02:22:32.841 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.841 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.841 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:32.841 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321652+0000", 2024-09-17T02:22:32.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321652+0000", 2024-09-17T02:22:32.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321652+0000", 2024-09-17T02:22:32.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7700000000000001e-07 2024-09-17T02:22:32.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321655+0000", 2024-09-17T02:22:32.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6220000000000001e-06 2024-09-17T02:22:32.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321660+0000", 2024-09-17T02:22:32.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.967e-06 2024-09-17T02:22:32.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321664+0000", 2024-09-17T02:22:32.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8039999999999999e-06 2024-09-17T02:22:32.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321706+0000", 2024-09-17T02:22:32.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2138000000000002e-05 2024-09-17T02:22:32.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321726+0000", 2024-09-17T02:22:32.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0236000000000001e-05 2024-09-17T02:22:32.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:32.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359072+0000", 2024-09-17T02:22:32.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037346435999999997 2024-09-17T02:22:32.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:32.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359148+0000", 2024-09-17T02:22:32.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5082999999999999e-05 2024-09-17T02:22:32.845 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.845 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.845 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.845 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252857 5.3 e73/64 5:c255b9a8:::benchmark_data_smithi001_23533_object124740:head v 73'15930, mlcod=73'15927)", 2024-09-17T02:22:32.845 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.321676+0000", 2024-09-17T02:22:32.846 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.44584019200000002, 2024-09-17T02:22:32.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044692651999999999, 2024-09-17T02:22:32.846 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.846 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.846 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:32.846 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321676+0000", 2024-09-17T02:22:32.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321676+0000", 2024-09-17T02:22:32.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321676+0000", 2024-09-17T02:22:32.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4299999999999999e-07 2024-09-17T02:22:32.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321683+0000", 2024-09-17T02:22:32.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.652e-06 2024-09-17T02:22:32.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321689+0000", 2024-09-17T02:22:32.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9340000000000003e-06 2024-09-17T02:22:32.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321693+0000", 2024-09-17T02:22:32.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3309999999999997e-06 2024-09-17T02:22:32.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323151+0000", 2024-09-17T02:22:32.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014580260000000001 2024-09-17T02:22:32.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323170+0000", 2024-09-17T02:22:32.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8998999999999999e-05 2024-09-17T02:22:32.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:32.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.366320+0000", 2024-09-17T02:22:32.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.043150177999999997 2024-09-17T02:22:32.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:32.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.366368+0000", 2024-09-17T02:22:32.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8288999999999998e-05 2024-09-17T02:22:32.849 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.849 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.850 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.850 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252866 5.0 5:0b646666:::benchmark_data_smithi001_23533_object124749:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:32.850 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.322387+0000", 2024-09-17T02:22:32.850 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.44512872199999998, 2024-09-17T02:22:32.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041814680999999999, 2024-09-17T02:22:32.850 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.850 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.850 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:32.850 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:32.850 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:32.850 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:32.851 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252866 2024-09-17T02:22:32.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.851 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322387+0000", 2024-09-17T02:22:32.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322387+0000", 2024-09-17T02:22:32.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322388+0000", 2024-09-17T02:22:32.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6300000000000004e-07 2024-09-17T02:22:32.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322392+0000", 2024-09-17T02:22:32.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-06 2024-09-17T02:22:32.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322402+0000", 2024-09-17T02:22:32.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0165e-05 2024-09-17T02:22:32.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322409+0000", 2024-09-17T02:22:32.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5180000000000001e-06 2024-09-17T02:22:32.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323635+0000", 2024-09-17T02:22:32.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001226296 2024-09-17T02:22:32.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323738+0000", 2024-09-17T02:22:32.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103491 2024-09-17T02:22:32.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:32.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359170+0000", 2024-09-17T02:22:32.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035431547000000001 2024-09-17T02:22:32.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:32.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363946+0000", 2024-09-17T02:22:32.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047759090000000001 2024-09-17T02:22:32.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:32.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.364118+0000", 2024-09-17T02:22:32.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017171600000000001 2024-09-17T02:22:32.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:32.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.364163+0000", 2024-09-17T02:22:32.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5176000000000003e-05 2024-09-17T02:22:32.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:32.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.364202+0000", 2024-09-17T02:22:32.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9103000000000002e-05 2024-09-17T02:22:32.856 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.856 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.856 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.856 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252864 5.e e73/22 5:79949647:::benchmark_data_smithi001_23533_object124747:head v 73'15818, mlcod=73'15816)", 2024-09-17T02:22:32.856 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.322434+0000", 2024-09-17T02:22:32.856 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.44508235099999999, 2024-09-17T02:22:32.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038558940999999999, 2024-09-17T02:22:32.856 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.856 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.857 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:32.857 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322434+0000", 2024-09-17T02:22:32.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322434+0000", 2024-09-17T02:22:32.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322434+0000", 2024-09-17T02:22:32.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0499999999999999e-07 2024-09-17T02:22:32.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322441+0000", 2024-09-17T02:22:32.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.545e-06 2024-09-17T02:22:32.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322447+0000", 2024-09-17T02:22:32.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6089999999999997e-06 2024-09-17T02:22:32.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322452+0000", 2024-09-17T02:22:32.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4549999999999997e-06 2024-09-17T02:22:32.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322786+0000", 2024-09-17T02:22:32.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033476699999999997 2024-09-17T02:22:32.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322806+0000", 2024-09-17T02:22:32.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0013e-05 2024-09-17T02:22:32.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:32.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.360954+0000", 2024-09-17T02:22:32.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038147984000000003 2024-09-17T02:22:32.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:32.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.360993+0000", 2024-09-17T02:22:32.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8163e-05 2024-09-17T02:22:32.860 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.860 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.860 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.861 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252867 5.0 5:098def42:::benchmark_data_smithi001_23533_object124750:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:32.861 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.323296+0000", 2024-09-17T02:22:32.861 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.44422017800000002, 2024-09-17T02:22:32.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046048453000000003, 2024-09-17T02:22:32.861 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.861 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.861 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:32.861 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:32.861 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:32.861 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:32.861 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252867 2024-09-17T02:22:32.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.861 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323296+0000", 2024-09-17T02:22:32.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323296+0000", 2024-09-17T02:22:32.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323297+0000", 2024-09-17T02:22:32.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.06e-07 2024-09-17T02:22:32.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323300+0000", 2024-09-17T02:22:32.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5140000000000002e-06 2024-09-17T02:22:32.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323307+0000", 2024-09-17T02:22:32.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4039999999999998e-06 2024-09-17T02:22:32.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323312+0000", 2024-09-17T02:22:32.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8420000000000004e-06 2024-09-17T02:22:32.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361424+0000", 2024-09-17T02:22:32.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038111313000000001 2024-09-17T02:22:32.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361547+0000", 2024-09-17T02:22:32.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000123621 2024-09-17T02:22:32.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:32.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361676+0000", 2024-09-17T02:22:32.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129016 2024-09-17T02:22:32.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:32.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.366632+0000", 2024-09-17T02:22:32.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049562149999999999 2024-09-17T02:22:32.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:32.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.369184+0000", 2024-09-17T02:22:32.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025512960000000002 2024-09-17T02:22:32.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:32.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.369270+0000", 2024-09-17T02:22:32.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5873999999999998e-05 2024-09-17T02:22:32.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:32.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.369344+0000", 2024-09-17T02:22:32.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4652000000000003e-05 2024-09-17T02:22:32.866 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.866 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.866 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.866 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252865 5.1 e73/61 5:81978d99:::benchmark_data_smithi001_23533_object124748:head v 73'15775, mlcod=73'15772)", 2024-09-17T02:22:32.867 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.323335+0000", 2024-09-17T02:22:32.867 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.44418117899999998, 2024-09-17T02:22:32.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037706556000000002, 2024-09-17T02:22:32.867 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.867 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.867 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:32.867 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323335+0000", 2024-09-17T02:22:32.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323335+0000", 2024-09-17T02:22:32.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323335+0000", 2024-09-17T02:22:32.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1399999999999998e-07 2024-09-17T02:22:32.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323338+0000", 2024-09-17T02:22:32.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3419999999999999e-06 2024-09-17T02:22:32.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323352+0000", 2024-09-17T02:22:32.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3771000000000001e-05 2024-09-17T02:22:32.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323356+0000", 2024-09-17T02:22:32.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6600000000000001e-06 2024-09-17T02:22:32.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323403+0000", 2024-09-17T02:22:32.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7290000000000003e-05 2024-09-17T02:22:32.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323419+0000", 2024-09-17T02:22:32.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5434000000000002e-05 2024-09-17T02:22:32.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:32.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.360952+0000", 2024-09-17T02:22:32.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037533314999999998 2024-09-17T02:22:32.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:32.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361041+0000", 2024-09-17T02:22:32.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9430000000000003e-05 2024-09-17T02:22:32.871 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.871 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.871 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.871 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252868 5.b e73/51 5:d27fb132:::benchmark_data_smithi001_23533_object124751:head v 73'15650, mlcod=73'15648)", 2024-09-17T02:22:32.871 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.323831+0000", 2024-09-17T02:22:32.871 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.44368544799999998, 2024-09-17T02:22:32.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042577492000000002, 2024-09-17T02:22:32.871 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:32.871 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:32.871 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:32.871 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:32.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:32.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323831+0000", 2024-09-17T02:22:32.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:32.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323831+0000", 2024-09-17T02:22:32.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:32.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:32.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323831+0000", 2024-09-17T02:22:32.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4199999999999996e-07 2024-09-17T02:22:32.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:32.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323839+0000", 2024-09-17T02:22:32.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8380000000000002e-06 2024-09-17T02:22:32.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:32.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359009+0000", 2024-09-17T02:22:32.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035169733000000002 2024-09-17T02:22:32.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:32.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359022+0000", 2024-09-17T02:22:32.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3801000000000001e-05 2024-09-17T02:22:32.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:32.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359086+0000", 2024-09-17T02:22:32.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3559000000000006e-05 2024-09-17T02:22:32.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:32.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359105+0000", 2024-09-17T02:22:32.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8865999999999999e-05 2024-09-17T02:22:32.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:32.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.366372+0000", 2024-09-17T02:22:32.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.007266827 2024-09-17T02:22:32.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:32.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:32.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:32.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.366408+0000", 2024-09-17T02:22:32.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6325999999999997e-05 2024-09-17T02:22:32.875 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.875 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.875 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.875 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:32.875 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:32.875 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:32.877 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:32.875+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:32.877 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:32.977 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:32.974+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:33.039 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:33.039 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:22:33.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.039 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:254459 5.9 5:9686c953:::benchmark_data_smithi001_23533_object126342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:33.040 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:33.037719+0000", 2024-09-17T02:22:33.040 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0033281209999999999, 2024-09-17T02:22:33.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033596659999999999, 2024-09-17T02:22:33.040 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.040 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.040 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:33.040 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.040 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.040 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.040 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 254459 2024-09-17T02:22:33.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.040 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.037719+0000", 2024-09-17T02:22:33.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.037719+0000", 2024-09-17T02:22:33.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.037720+0000", 2024-09-17T02:22:33.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.359e-06 2024-09-17T02:22:33.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.037726+0000", 2024-09-17T02:22:33.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8549999999999998e-06 2024-09-17T02:22:33.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.037739+0000", 2024-09-17T02:22:33.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2395000000000001e-05 2024-09-17T02:22:33.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.037747+0000", 2024-09-17T02:22:33.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9869999999999999e-06 2024-09-17T02:22:33.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.037797+0000", 2024-09-17T02:22:33.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0670000000000001e-05 2024-09-17T02:22:33.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.037882+0000", 2024-09-17T02:22:33.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5160000000000005e-05 2024-09-17T02:22:33.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:33.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.040955+0000", 2024-09-17T02:22:33.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00307202 2024-09-17T02:22:33.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:33.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041006+0000", 2024-09-17T02:22:33.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1325000000000001e-05 2024-09-17T02:22:33.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:33.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041081+0000", 2024-09-17T02:22:33.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5177000000000002e-05 2024-09-17T02:22:33.044 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.045 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.045 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.045 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:254460 5.4 5:216e00d9:::benchmark_data_smithi001_23533_object126343:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:33.045 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:33.037763+0000", 2024-09-17T02:22:33.045 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0032838680000000001, 2024-09-17T02:22:33.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034109890000000001, 2024-09-17T02:22:33.045 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.045 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.045 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:33.045 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.045 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.046 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.046 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 254460 2024-09-17T02:22:33.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.046 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.037763+0000", 2024-09-17T02:22:33.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.037763+0000", 2024-09-17T02:22:33.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.037764+0000", 2024-09-17T02:22:33.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5899999999999996e-07 2024-09-17T02:22:33.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.037767+0000", 2024-09-17T02:22:33.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3139999999999999e-06 2024-09-17T02:22:33.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.037776+0000", 2024-09-17T02:22:33.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8929999999999994e-06 2024-09-17T02:22:33.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.037782+0000", 2024-09-17T02:22:33.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7259999999999999e-06 2024-09-17T02:22:33.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.037825+0000", 2024-09-17T02:22:33.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3127999999999998e-05 2024-09-17T02:22:33.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.037903+0000", 2024-09-17T02:22:33.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8152999999999995e-05 2024-09-17T02:22:33.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:33.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.037970+0000", 2024-09-17T02:22:33.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7224000000000006e-05 2024-09-17T02:22:33.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:33.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.040920+0000", 2024-09-17T02:22:33.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029497830000000001 2024-09-17T02:22:33.050 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.050 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.050 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.050 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:254461 5.3 5:c2036783:::benchmark_data_smithi001_23533_object126344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:33.050 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:33.038428+0000", 2024-09-17T02:22:33.050 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0026191330000000001, 2024-09-17T02:22:33.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028429430000000001, 2024-09-17T02:22:33.050 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.050 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.050 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:33.050 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.050 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.051 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.051 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 254461 2024-09-17T02:22:33.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.051 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038428+0000", 2024-09-17T02:22:33.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038428+0000", 2024-09-17T02:22:33.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038429+0000", 2024-09-17T02:22:33.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9199999999999999e-07 2024-09-17T02:22:33.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038433+0000", 2024-09-17T02:22:33.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0430000000000001e-06 2024-09-17T02:22:33.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038446+0000", 2024-09-17T02:22:33.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2876e-05 2024-09-17T02:22:33.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038453+0000", 2024-09-17T02:22:33.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3459999999999996e-06 2024-09-17T02:22:33.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038889+0000", 2024-09-17T02:22:33.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043556200000000002 2024-09-17T02:22:33.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038958+0000", 2024-09-17T02:22:33.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9567999999999995e-05 2024-09-17T02:22:33.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:33.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.039065+0000", 2024-09-17T02:22:33.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010637300000000001 2024-09-17T02:22:33.054 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.054 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.054 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.054 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:254462 5.3 5:c4149bf8:::benchmark_data_smithi001_23533_object126345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:33.054 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:33.038467+0000", 2024-09-17T02:22:33.054 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0025803419999999998, 2024-09-17T02:22:33.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028786440000000001, 2024-09-17T02:22:33.055 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.055 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.055 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:33.055 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.055 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.055 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.055 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 254462 2024-09-17T02:22:33.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.055 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038467+0000", 2024-09-17T02:22:33.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038467+0000", 2024-09-17T02:22:33.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038467+0000", 2024-09-17T02:22:33.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.63e-07 2024-09-17T02:22:33.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038470+0000", 2024-09-17T02:22:33.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3750000000000001e-06 2024-09-17T02:22:33.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038478+0000", 2024-09-17T02:22:33.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0260000000000007e-06 2024-09-17T02:22:33.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038483+0000", 2024-09-17T02:22:33.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.113e-06 2024-09-17T02:22:33.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.040875+0000", 2024-09-17T02:22:33.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002392089 2024-09-17T02:22:33.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041023+0000", 2024-09-17T02:22:33.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000147749 2024-09-17T02:22:33.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:33.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041146+0000", 2024-09-17T02:22:33.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012343799999999999 2024-09-17T02:22:33.059 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.059 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.059 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.059 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:254465 5.e 5:7436ffb5:::benchmark_data_smithi001_23533_object126348:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:33.059 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:33.038489+0000", 2024-09-17T02:22:33.059 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0025579169999999998, 2024-09-17T02:22:33.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029366449999999999, 2024-09-17T02:22:33.059 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.059 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.059 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:33.059 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.059 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.060 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.060 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 254465 2024-09-17T02:22:33.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.060 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038489+0000", 2024-09-17T02:22:33.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038489+0000", 2024-09-17T02:22:33.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038490+0000", 2024-09-17T02:22:33.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6100000000000002e-07 2024-09-17T02:22:33.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038492+0000", 2024-09-17T02:22:33.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9069999999999999e-06 2024-09-17T02:22:33.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038498+0000", 2024-09-17T02:22:33.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.934e-06 2024-09-17T02:22:33.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038503+0000", 2024-09-17T02:22:33.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5050000000000001e-06 2024-09-17T02:22:33.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038552+0000", 2024-09-17T02:22:33.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9382000000000003e-05 2024-09-17T02:22:33.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038666+0000", 2024-09-17T02:22:33.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113466 2024-09-17T02:22:33.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:33.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038782+0000", 2024-09-17T02:22:33.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011582900000000001 2024-09-17T02:22:33.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:33.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.040907+0000", 2024-09-17T02:22:33.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002125086 2024-09-17T02:22:33.063 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.063 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.063 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.064 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:254466 5.3 5.5b101053 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:33.064 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:33.038563+0000", 2024-09-17T02:22:33.064 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0024843080000000002, 2024-09-17T02:22:33.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029130950000000001, 2024-09-17T02:22:33.064 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.064 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.064 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:33.064 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.064 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.064 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.064 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 254466 2024-09-17T02:22:33.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.065 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038563+0000", 2024-09-17T02:22:33.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038563+0000", 2024-09-17T02:22:33.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038564+0000", 2024-09-17T02:22:33.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4000000000000001e-07 2024-09-17T02:22:33.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038567+0000", 2024-09-17T02:22:33.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0680000000000001e-06 2024-09-17T02:22:33.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038576+0000", 2024-09-17T02:22:33.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.166e-06 2024-09-17T02:22:33.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038582+0000", 2024-09-17T02:22:33.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7769999999999999e-06 2024-09-17T02:22:33.067 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.067 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.067 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.067 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4466.0:254463 5.0 e73/26 5:00723082:::benchmark_data_smithi001_23533_object126346:head v 73'15903, mlcod=73'15901)", 2024-09-17T02:22:33.067 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:33.038925+0000", 2024-09-17T02:22:33.067 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0021224630000000002, 2024-09-17T02:22:33.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025817599999999998, 2024-09-17T02:22:33.067 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.067 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.067 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:33.068 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038925+0000", 2024-09-17T02:22:33.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038925+0000", 2024-09-17T02:22:33.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038925+0000", 2024-09-17T02:22:33.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4199999999999995e-07 2024-09-17T02:22:33.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038932+0000", 2024-09-17T02:22:33.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4860000000000002e-06 2024-09-17T02:22:33.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038942+0000", 2024-09-17T02:22:33.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7219999999999994e-06 2024-09-17T02:22:33.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.038948+0000", 2024-09-17T02:22:33.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.55e-06 2024-09-17T02:22:33.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.039004+0000", 2024-09-17T02:22:33.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6162000000000002e-05 2024-09-17T02:22:33.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.039024+0000", 2024-09-17T02:22:33.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9758999999999998e-05 2024-09-17T02:22:33.071 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.071 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.071 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.071 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:254443 5.3 e73/64)", 2024-09-17T02:22:33.071 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:33.040443+0000", 2024-09-17T02:22:33.071 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00060428700000000001, 2024-09-17T02:22:33.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001096028, 2024-09-17T02:22:33.071 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.071 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.071 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:33.071 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.040443+0000", 2024-09-17T02:22:33.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.040443+0000", 2024-09-17T02:22:33.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.040444+0000", 2024-09-17T02:22:33.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3600000000000003e-07 2024-09-17T02:22:33.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.040448+0000", 2024-09-17T02:22:33.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3880000000000002e-06 2024-09-17T02:22:33.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.040458+0000", 2024-09-17T02:22:33.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0035e-05 2024-09-17T02:22:33.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.040464+0000", 2024-09-17T02:22:33.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1739999999999997e-06 2024-09-17T02:22:33.074 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.074 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.074 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.074 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:254469 5.9 5:9e09dfa1:::benchmark_data_smithi001_23533_object126352:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:33.074 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:33.040920+0000", 2024-09-17T02:22:33.074 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.00012682500000000001, 2024-09-17T02:22:33.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064623999999999997, 2024-09-17T02:22:33.074 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.074 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.074 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:33.075 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.075 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.075 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.075 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 254469 2024-09-17T02:22:33.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.075 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.040920+0000", 2024-09-17T02:22:33.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.040920+0000", 2024-09-17T02:22:33.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.040921+0000", 2024-09-17T02:22:33.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:22:33.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.040926+0000", 2024-09-17T02:22:33.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9389999999999996e-06 2024-09-17T02:22:33.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.040935+0000", 2024-09-17T02:22:33.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2390000000000008e-06 2024-09-17T02:22:33.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.040943+0000", 2024-09-17T02:22:33.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1690000000000003e-06 2024-09-17T02:22:33.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041188+0000", 2024-09-17T02:22:33.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024508700000000001 2024-09-17T02:22:33.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041275+0000", 2024-09-17T02:22:33.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7131000000000003e-05 2024-09-17T02:22:33.078 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.078 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.078 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.078 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:254470 5.3 5.dda048f3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:33.078 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:33.040978+0000", 2024-09-17T02:22:33.078 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.9519999999999998e-05, 2024-09-17T02:22:33.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065695499999999997, 2024-09-17T02:22:33.079 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.079 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.079 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:33.079 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.079 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.079 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.079 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 254470 2024-09-17T02:22:33.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.079 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.040978+0000", 2024-09-17T02:22:33.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.040978+0000", 2024-09-17T02:22:33.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.040978+0000", 2024-09-17T02:22:33.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.61e-07 2024-09-17T02:22:33.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.040982+0000", 2024-09-17T02:22:33.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5020000000000001e-06 2024-09-17T02:22:33.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.040992+0000", 2024-09-17T02:22:33.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7999999999999993e-06 2024-09-17T02:22:33.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041011+0000", 2024-09-17T02:22:33.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9437999999999999e-05 2024-09-17T02:22:33.081 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.081 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.081 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.081 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:254448 5.3 e73/64)", 2024-09-17T02:22:33.082 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:33.041059+0000", 2024-09-17T02:22:33.082 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4294967295.9999886, 2024-09-17T02:22:33.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063356800000000004, 2024-09-17T02:22:33.082 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.082 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.082 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:33.082 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041059+0000", 2024-09-17T02:22:33.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041059+0000", 2024-09-17T02:22:33.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041059+0000", 2024-09-17T02:22:33.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0999999999999999e-07 2024-09-17T02:22:33.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041063+0000", 2024-09-17T02:22:33.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2610000000000002e-06 2024-09-17T02:22:33.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041071+0000", 2024-09-17T02:22:33.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6090000000000001e-06 2024-09-17T02:22:33.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041077+0000", 2024-09-17T02:22:33.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0820000000000004e-06 2024-09-17T02:22:33.084 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.084 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.084 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.085 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:254457 5.b e73/51)", 2024-09-17T02:22:33.085 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:33.041097+0000", 2024-09-17T02:22:33.085 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4294967295.9999499, 2024-09-17T02:22:33.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000646387, 2024-09-17T02:22:33.085 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.085 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.085 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:33.085 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041097+0000", 2024-09-17T02:22:33.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041097+0000", 2024-09-17T02:22:33.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041097+0000", 2024-09-17T02:22:33.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6300000000000001e-07 2024-09-17T02:22:33.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041100+0000", 2024-09-17T02:22:33.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.728e-06 2024-09-17T02:22:33.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041107+0000", 2024-09-17T02:22:33.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8260000000000004e-06 2024-09-17T02:22:33.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041112+0000", 2024-09-17T02:22:33.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2109999999999997e-06 2024-09-17T02:22:33.087 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.087 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.087 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.088 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:254443 5.3 5:cce4bcd9:::benchmark_data_smithi001_23533_object126326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:33.088 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:33.030487+0000", 2024-09-17T02:22:33.088 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.010559789999999999, 2024-09-17T02:22:33.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011315412, 2024-09-17T02:22:33.088 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.088 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.088 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:33.088 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.088 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.088 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.088 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 254443 2024-09-17T02:22:33.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.089 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.030487+0000", 2024-09-17T02:22:33.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.030487+0000", 2024-09-17T02:22:33.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.030488+0000", 2024-09-17T02:22:33.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2399999999999996e-07 2024-09-17T02:22:33.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.030493+0000", 2024-09-17T02:22:33.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.233e-06 2024-09-17T02:22:33.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.030505+0000", 2024-09-17T02:22:33.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2269000000000001e-05 2024-09-17T02:22:33.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.030511+0000", 2024-09-17T02:22:33.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6769999999999998e-06 2024-09-17T02:22:33.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.033397+0000", 2024-09-17T02:22:33.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002885159 2024-09-17T02:22:33.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.033470+0000", 2024-09-17T02:22:33.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3174000000000001e-05 2024-09-17T02:22:33.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:33.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.033545+0000", 2024-09-17T02:22:33.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5019999999999997e-05 2024-09-17T02:22:33.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:33.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.040845+0000", 2024-09-17T02:22:33.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072997950000000004 2024-09-17T02:22:33.094 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.094 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.094 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.094 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4466.0:254461 5.3 e73/64)", 2024-09-17T02:22:33.094 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:33.041123+0000", 2024-09-17T02:22:33.094 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4294967295.9999247, 2024-09-17T02:22:33.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00076462999999999998, 2024-09-17T02:22:33.094 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.094 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.094 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:33.094 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041123+0000", 2024-09-17T02:22:33.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041123+0000", 2024-09-17T02:22:33.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041123+0000", 2024-09-17T02:22:33.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3999999999999998e-07 2024-09-17T02:22:33.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041125+0000", 2024-09-17T02:22:33.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.075e-06 2024-09-17T02:22:33.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041131+0000", 2024-09-17T02:22:33.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7579999999999998e-06 2024-09-17T02:22:33.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041135+0000", 2024-09-17T02:22:33.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6709999999999998e-06 2024-09-17T02:22:33.097 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.097 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.097 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.097 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:254471 5.9 5.a3250849 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:33.097 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:33.041263+0000", 2024-09-17T02:22:33.097 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4294967295.9997835, 2024-09-17T02:22:33.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065499999999999998, 2024-09-17T02:22:33.097 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.097 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.097 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "queued for pg", 2024-09-17T02:22:33.097 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.097 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.098 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.098 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 254471 2024-09-17T02:22:33.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.098 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041263+0000", 2024-09-17T02:22:33.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041263+0000", 2024-09-17T02:22:33.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041264+0000", 2024-09-17T02:22:33.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9800000000000003e-07 2024-09-17T02:22:33.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041268+0000", 2024-09-17T02:22:33.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7050000000000001e-06 2024-09-17T02:22:33.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041279+0000", 2024-09-17T02:22:33.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1308000000000001e-05 2024-09-17T02:22:33.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041286+0000", 2024-09-17T02:22:33.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.511e-06 2024-09-17T02:22:33.100 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.100 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.100 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.100 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:254472 5.4 5:2c06af24:::benchmark_data_smithi001_23533_object126355:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:33.100 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:33.041594+0000", 2024-09-17T02:22:33.100 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4294967295.9994531, 2024-09-17T02:22:33.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000382653, 2024-09-17T02:22:33.101 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.101 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.101 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:33.101 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.101 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.101 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.101 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 254472 2024-09-17T02:22:33.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.101 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041594+0000", 2024-09-17T02:22:33.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041594+0000", 2024-09-17T02:22:33.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041595+0000", 2024-09-17T02:22:33.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5000000000000001e-07 2024-09-17T02:22:33.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041599+0000", 2024-09-17T02:22:33.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9040000000000002e-06 2024-09-17T02:22:33.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041620+0000", 2024-09-17T02:22:33.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1231999999999999e-05 2024-09-17T02:22:33.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041628+0000", 2024-09-17T02:22:33.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1640000000000004e-06 2024-09-17T02:22:33.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041668+0000", 2024-09-17T02:22:33.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0549000000000001e-05 2024-09-17T02:22:33.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041758+0000", 2024-09-17T02:22:33.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0008999999999998e-05 2024-09-17T02:22:33.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:33.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.041824+0000", 2024-09-17T02:22:33.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5749999999999999e-05 2024-09-17T02:22:33.104 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.104 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.105 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.105 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:254448 5.3 5:c7dd632c:::benchmark_data_smithi001_23533_object126331:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:33.105 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:33.030703+0000", 2024-09-17T02:22:33.105 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.010343718, 2024-09-17T02:22:33.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011316231, 2024-09-17T02:22:33.105 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.105 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.105 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:33.105 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.105 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.105 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.105 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 254448 2024-09-17T02:22:33.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.106 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.030703+0000", 2024-09-17T02:22:33.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.030703+0000", 2024-09-17T02:22:33.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.030704+0000", 2024-09-17T02:22:33.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7300000000000001e-07 2024-09-17T02:22:33.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.030706+0000", 2024-09-17T02:22:33.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4710000000000001e-06 2024-09-17T02:22:33.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.030714+0000", 2024-09-17T02:22:33.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1910000000000003e-06 2024-09-17T02:22:33.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.030719+0000", 2024-09-17T02:22:33.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6980000000000003e-06 2024-09-17T02:22:33.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.036891+0000", 2024-09-17T02:22:33.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061715110000000002 2024-09-17T02:22:33.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.037009+0000", 2024-09-17T02:22:33.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118038 2024-09-17T02:22:33.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:33.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.037142+0000", 2024-09-17T02:22:33.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013307600000000001 2024-09-17T02:22:33.109 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.109 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.109 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.109 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:254453 5.e 5:7aa4abac:::benchmark_data_smithi001_23533_object126336:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:33.109 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:33.033325+0000", 2024-09-17T02:22:33.109 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0077217259999999999, 2024-09-17T02:22:33.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0087344899999999993, 2024-09-17T02:22:33.109 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.109 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.109 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:33.109 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.109 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.110 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.110 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 254453 2024-09-17T02:22:33.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.110 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.033325+0000", 2024-09-17T02:22:33.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.033325+0000", 2024-09-17T02:22:33.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.033326+0000", 2024-09-17T02:22:33.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.017e-06 2024-09-17T02:22:33.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.033331+0000", 2024-09-17T02:22:33.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6720000000000003e-06 2024-09-17T02:22:33.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.033345+0000", 2024-09-17T02:22:33.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3426e-05 2024-09-17T02:22:33.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.033352+0000", 2024-09-17T02:22:33.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8979999999999996e-06 2024-09-17T02:22:33.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.035434+0000", 2024-09-17T02:22:33.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020813239999999998 2024-09-17T02:22:33.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.035567+0000", 2024-09-17T02:22:33.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013340100000000001 2024-09-17T02:22:33.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:33.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.035692+0000", 2024-09-17T02:22:33.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012441899999999999 2024-09-17T02:22:33.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:33.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.037578+0000", 2024-09-17T02:22:33.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018863420000000001 2024-09-17T02:22:33.113 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.113 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.114 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.114 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:254457 5.b 5:d7d7dee0:::benchmark_data_smithi001_23533_object126340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:33.114 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:22:33.034936+0000", 2024-09-17T02:22:33.114 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.0061112830000000003, 2024-09-17T02:22:33.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071681039999999998, 2024-09-17T02:22:33.114 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.114 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.114 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-17T02:22:33.114 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.114 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.114 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.114 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 254457 2024-09-17T02:22:33.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.115 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.034936+0000", 2024-09-17T02:22:33.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.034936+0000", 2024-09-17T02:22:33.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.034936+0000", 2024-09-17T02:22:33.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9100000000000004e-07 2024-09-17T02:22:33.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.034940+0000", 2024-09-17T02:22:33.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1810000000000001e-06 2024-09-17T02:22:33.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.034948+0000", 2024-09-17T02:22:33.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3999999999999992e-06 2024-09-17T02:22:33.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.034953+0000", 2024-09-17T02:22:33.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7859999999999996e-06 2024-09-17T02:22:33.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.035118+0000", 2024-09-17T02:22:33.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000164668 2024-09-17T02:22:33.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.035251+0000", 2024-09-17T02:22:33.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013308699999999999 2024-09-17T02:22:33.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:33.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.035373+0000", 2024-09-17T02:22:33.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012224499999999999 2024-09-17T02:22:33.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:33.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:22:33.040853+0000", 2024-09-17T02:22:33.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054806059999999998 2024-09-17T02:22:33.118 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.118 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.118 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.119 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.119 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-17T02:22:33.119 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 19 2024-09-17T02:22:33.119 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:33.120 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:33.121 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:33.118+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:33.220 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:33.223+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:33.321 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:33.318+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:33.322 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:33.322 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:22:33.322 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:22:33.322 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:22:33.322 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:33.343 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:33.430 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:33.430+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:33.478 INFO:teuthology.orchestra.run.smithi001.stderr:nodeep-scrub is set 2024-09-17T02:22:33.524 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:33.522+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:33.547 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:33.547 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:22:33.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:22:33.547 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:22:33.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.547 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97749 5.b 5:d930ef52:::benchmark_data_smithi001_23533_object97748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:33.547 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:33.547 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 75.955661758000005, 2024-09-17T02:22:33.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092964343000000005, 2024-09-17T02:22:33.548 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.548 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.548 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:33.548 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.548 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.548 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.548 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97749 2024-09-17T02:22:33.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.548 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.548 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:33.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:33.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591947+0000", 2024-09-17T02:22:33.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:22:33.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592011+0000", 2024-09-17T02:22:33.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3608000000000005e-05 2024-09-17T02:22:33.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592021+0000", 2024-09-17T02:22:33.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9979999999999998e-06 2024-09-17T02:22:33.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592028+0000", 2024-09-17T02:22:33.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1439999999999997e-06 2024-09-17T02:22:33.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.551 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593633+0000", 2024-09-17T02:22:33.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001604636 2024-09-17T02:22:33.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.551 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593757+0000", 2024-09-17T02:22:33.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012432099999999999 2024-09-17T02:22:33.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:33.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593866+0000", 2024-09-17T02:22:33.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109094 2024-09-17T02:22:33.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:33.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601190+0000", 2024-09-17T02:22:33.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073237620000000002 2024-09-17T02:22:33.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:33.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601356+0000", 2024-09-17T02:22:33.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016651900000000001 2024-09-17T02:22:33.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:33.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684618+0000", 2024-09-17T02:22:33.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083261356999999994 2024-09-17T02:22:33.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:33.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684724+0000", 2024-09-17T02:22:33.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010681800000000001 2024-09-17T02:22:33.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:33.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684911+0000", 2024-09-17T02:22:33.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186243 2024-09-17T02:22:33.554 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.554 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.554 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.554 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97752 5.b 5:d146f486:::benchmark_data_smithi001_23533_object97751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:33.554 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:33.555 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 75.954309064, 2024-09-17T02:22:33.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091989557, 2024-09-17T02:22:33.555 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.555 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.555 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:33.555 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.555 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.555 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.555 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97752 2024-09-17T02:22:33.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.555 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:33.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:33.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593300+0000", 2024-09-17T02:22:33.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8199999999999998e-07 2024-09-17T02:22:33.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593364+0000", 2024-09-17T02:22:33.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3831999999999995e-05 2024-09-17T02:22:33.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593376+0000", 2024-09-17T02:22:33.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1800999999999999e-05 2024-09-17T02:22:33.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593382+0000", 2024-09-17T02:22:33.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6780000000000003e-06 2024-09-17T02:22:33.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595491+0000", 2024-09-17T02:22:33.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021090689999999999 2024-09-17T02:22:33.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595614+0000", 2024-09-17T02:22:33.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012321500000000001 2024-09-17T02:22:33.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:33.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595778+0000", 2024-09-17T02:22:33.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016321900000000001 2024-09-17T02:22:33.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:33.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601197+0000", 2024-09-17T02:22:33.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054195600000000003 2024-09-17T02:22:33.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:33.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601396+0000", 2024-09-17T02:22:33.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019825299999999999 2024-09-17T02:22:33.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:33.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684990+0000", 2024-09-17T02:22:33.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083594878999999997 2024-09-17T02:22:33.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:33.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685116+0000", 2024-09-17T02:22:33.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012522799999999999 2024-09-17T02:22:33.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:33.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685289+0000", 2024-09-17T02:22:33.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172941 2024-09-17T02:22:33.562 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.562 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.562 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.562 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97754 5.b 5:da0615e5:::benchmark_data_smithi001_23533_object97753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:33.562 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:33.562 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 75.952671142, 2024-09-17T02:22:33.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092097207, 2024-09-17T02:22:33.562 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.563 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.563 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:33.563 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.563 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.563 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.563 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97754 2024-09-17T02:22:33.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.563 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:33.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:33.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594938+0000", 2024-09-17T02:22:33.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5000000000000002e-07 2024-09-17T02:22:33.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595075+0000", 2024-09-17T02:22:33.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137742 2024-09-17T02:22:33.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595087+0000", 2024-09-17T02:22:33.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1243000000000001e-05 2024-09-17T02:22:33.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595095+0000", 2024-09-17T02:22:33.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1030000000000002e-06 2024-09-17T02:22:33.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598461+0000", 2024-09-17T02:22:33.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033661170000000001 2024-09-17T02:22:33.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598540+0000", 2024-09-17T02:22:33.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8937999999999995e-05 2024-09-17T02:22:33.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:33.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598626+0000", 2024-09-17T02:22:33.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6042000000000001e-05 2024-09-17T02:22:33.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:33.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684258+0000", 2024-09-17T02:22:33.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085632394000000001 2024-09-17T02:22:33.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:33.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685369+0000", 2024-09-17T02:22:33.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001111063 2024-09-17T02:22:33.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:33.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685511+0000", 2024-09-17T02:22:33.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141965 2024-09-17T02:22:33.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:33.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685604+0000", 2024-09-17T02:22:33.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2935000000000004e-05 2024-09-17T02:22:33.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:33.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687034+0000", 2024-09-17T02:22:33.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001430015 2024-09-17T02:22:33.569 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.569 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.569 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.570 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97755 5.b 5:d36a03a1:::benchmark_data_smithi001_23533_object97754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:33.570 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:33.570 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 75.952497992000005, 2024-09-17T02:22:33.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0924904, 2024-09-17T02:22:33.570 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.570 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.570 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:33.570 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.570 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.570 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.571 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97755 2024-09-17T02:22:33.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.571 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:33.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.572 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:33.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.572 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595111+0000", 2024-09-17T02:22:33.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:22:33.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.572 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595145+0000", 2024-09-17T02:22:33.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3927000000000002e-05 2024-09-17T02:22:33.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595155+0000", 2024-09-17T02:22:33.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0023e-05 2024-09-17T02:22:33.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595162+0000", 2024-09-17T02:22:33.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3950000000000003e-06 2024-09-17T02:22:33.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599821+0000", 2024-09-17T02:22:33.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046592880000000001 2024-09-17T02:22:33.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599912+0000", 2024-09-17T02:22:33.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1049000000000002e-05 2024-09-17T02:22:33.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:33.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600062+0000", 2024-09-17T02:22:33.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015001700000000001 2024-09-17T02:22:33.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:33.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685307+0000", 2024-09-17T02:22:33.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085244340000000002 2024-09-17T02:22:33.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:33.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685446+0000", 2024-09-17T02:22:33.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013955700000000001 2024-09-17T02:22:33.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:33.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687375+0000", 2024-09-17T02:22:33.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019291079999999999 2024-09-17T02:22:33.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:33.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687462+0000", 2024-09-17T02:22:33.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6148000000000003e-05 2024-09-17T02:22:33.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:33.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687600+0000", 2024-09-17T02:22:33.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013887900000000001 2024-09-17T02:22:33.578 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.578 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.578 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.578 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 44/44 lb 5:c4567a04:::benchmark_data_smithi001_23533_object4200:head)", 2024-09-17T02:22:33.578 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:33.578 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 75.950401365999994, 2024-09-17T02:22:33.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092483421999999996, 2024-09-17T02:22:33.579 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.579 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.579 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:33.579 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:33.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:33.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:33.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6399999999999998e-07 2024-09-17T02:22:33.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597213+0000", 2024-09-17T02:22:33.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3659999999999997e-06 2024-09-17T02:22:33.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597222+0000", 2024-09-17T02:22:33.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0510000000000002e-06 2024-09-17T02:22:33.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597228+0000", 2024-09-17T02:22:33.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1569999999999999e-06 2024-09-17T02:22:33.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689588+0000", 2024-09-17T02:22:33.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092359931000000006 2024-09-17T02:22:33.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689622+0000", 2024-09-17T02:22:33.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4425999999999999e-05 2024-09-17T02:22:33.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:33.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689690+0000", 2024-09-17T02:22:33.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8126999999999993e-05 2024-09-17T02:22:33.582 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.582 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.582 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.583 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129462 5.4 5:2e0acc16:::benchmark_data_smithi001_23533_object1345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:33.583 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:33.583 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.012667297, 2024-09-17T02:22:33.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0112774899999999, 2024-09-17T02:22:33.583 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.583 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.583 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:33.583 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.583 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.583 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.583 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129462 2024-09-17T02:22:33.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.584 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:33.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:33.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534943+0000", 2024-09-17T02:22:33.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8759999999999999e-06 2024-09-17T02:22:33.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534951+0000", 2024-09-17T02:22:33.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3219999999999993e-06 2024-09-17T02:22:33.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534977+0000", 2024-09-17T02:22:33.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6245e-05 2024-09-17T02:22:33.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534992+0000", 2024-09-17T02:22:33.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4936000000000001e-05 2024-09-17T02:22:33.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535133+0000", 2024-09-17T02:22:33.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014051299999999999 2024-09-17T02:22:33.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:33.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:22:33.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1741000000000001e-05 2024-09-17T02:22:33.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.533906+0000", 2024-09-17T02:22:33.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99875209300000001 2024-09-17T02:22:33.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534348+0000", 2024-09-17T02:22:33.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044128899999999998 2024-09-17T02:22:33.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:33.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534762+0000", 2024-09-17T02:22:33.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000414707 2024-09-17T02:22:33.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:33.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545024+0000", 2024-09-17T02:22:33.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010261283 2024-09-17T02:22:33.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:33.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545953+0000", 2024-09-17T02:22:33.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000929618 2024-09-17T02:22:33.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:33.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546047+0000", 2024-09-17T02:22:33.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3697999999999996e-05 2024-09-17T02:22:33.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:33.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546218+0000", 2024-09-17T02:22:33.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017116899999999999 2024-09-17T02:22:33.590 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.590 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.590 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.590 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129480 5.4 5:2b1d398b:::benchmark_data_smithi001_23533_object1363:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:33.590 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:33.590 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.004912830999999, 2024-09-17T02:22:33.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0038926450000001, 2024-09-17T02:22:33.590 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.590 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.590 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:33.590 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.590 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.591 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.591 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129480 2024-09-17T02:22:33.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.591 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:33.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:33.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542696+0000", 2024-09-17T02:22:33.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9999999999999995e-07 2024-09-17T02:22:33.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542701+0000", 2024-09-17T02:22:33.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2240000000000003e-06 2024-09-17T02:22:33.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542716+0000", 2024-09-17T02:22:33.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4970000000000001e-05 2024-09-17T02:22:33.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542726+0000", 2024-09-17T02:22:33.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2879999999999998e-06 2024-09-17T02:22:33.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542832+0000", 2024-09-17T02:22:33.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010597199999999999 2024-09-17T02:22:33.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:33.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542843+0000", 2024-09-17T02:22:33.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.098e-05 2024-09-17T02:22:33.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538436+0000", 2024-09-17T02:22:33.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99559286800000002 2024-09-17T02:22:33.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538791+0000", 2024-09-17T02:22:33.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035585499999999997 2024-09-17T02:22:33.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:33.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.539144+0000", 2024-09-17T02:22:33.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035268499999999999 2024-09-17T02:22:33.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:33.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545880+0000", 2024-09-17T02:22:33.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00673552 2024-09-17T02:22:33.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:33.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546330+0000", 2024-09-17T02:22:33.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045039599999999999 2024-09-17T02:22:33.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:33.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546414+0000", 2024-09-17T02:22:33.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4468000000000005e-05 2024-09-17T02:22:33.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:33.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546588+0000", 2024-09-17T02:22:33.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017341899999999999 2024-09-17T02:22:33.597 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.597 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.597 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.597 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129505 5.4 5:294f2ec7:::benchmark_data_smithi001_23533_object1388:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:33.597 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:33.597 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.985899658000001, 2024-09-17T02:22:33.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98589826199999997, 2024-09-17T02:22:33.598 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.598 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.598 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:33.598 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.598 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.598 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.598 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129505 2024-09-17T02:22:33.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.598 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:33.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:33.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561710+0000", 2024-09-17T02:22:33.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7060000000000001e-06 2024-09-17T02:22:33.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561718+0000", 2024-09-17T02:22:33.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.542e-06 2024-09-17T02:22:33.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561741+0000", 2024-09-17T02:22:33.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3357e-05 2024-09-17T02:22:33.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561754+0000", 2024-09-17T02:22:33.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3200000000000001e-05 2024-09-17T02:22:33.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561867+0000", 2024-09-17T02:22:33.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113211 2024-09-17T02:22:33.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:33.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561888+0000", 2024-09-17T02:22:33.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0809999999999999e-05 2024-09-17T02:22:33.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542140+0000", 2024-09-17T02:22:33.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98025195799999998 2024-09-17T02:22:33.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542331+0000", 2024-09-17T02:22:33.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019127599999999999 2024-09-17T02:22:33.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:33.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542517+0000", 2024-09-17T02:22:33.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000185625 2024-09-17T02:22:33.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:33.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547114+0000", 2024-09-17T02:22:33.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045968620000000002 2024-09-17T02:22:33.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:33.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547187+0000", 2024-09-17T02:22:33.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3348000000000003e-05 2024-09-17T02:22:33.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:33.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547324+0000", 2024-09-17T02:22:33.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013681699999999999 2024-09-17T02:22:33.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:33.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547607+0000", 2024-09-17T02:22:33.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028255000000000001 2024-09-17T02:22:33.604 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.605 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.605 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.605 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129508 5.4 5:2892b582:::benchmark_data_smithi001_23533_object1391:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:33.605 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:33.605 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.984562564999997, 2024-09-17T02:22:33.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99697919099999999, 2024-09-17T02:22:33.605 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.606 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.606 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:33.606 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.606 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.606 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.606 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129508 2024-09-17T02:22:33.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.606 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:33.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:33.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563047+0000", 2024-09-17T02:22:33.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.274e-06 2024-09-17T02:22:33.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563054+0000", 2024-09-17T02:22:33.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2799999999999998e-06 2024-09-17T02:22:33.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563070+0000", 2024-09-17T02:22:33.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5991999999999999e-05 2024-09-17T02:22:33.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563078+0000", 2024-09-17T02:22:33.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2390000000000002e-06 2024-09-17T02:22:33.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563181+0000", 2024-09-17T02:22:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102249 2024-09-17T02:22:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563199+0000", 2024-09-17T02:22:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8215000000000001e-05 2024-09-17T02:22:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547713+0000", 2024-09-17T02:22:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98451446399999998 2024-09-17T02:22:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548063+0000", 2024-09-17T02:22:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034985499999999999 2024-09-17T02:22:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548490+0000", 2024-09-17T02:22:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042658600000000001 2024-09-17T02:22:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:33.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555655+0000", 2024-09-17T02:22:33.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071652579999999999 2024-09-17T02:22:33.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:33.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559612+0000", 2024-09-17T02:22:33.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003957103 2024-09-17T02:22:33.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:33.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559768+0000", 2024-09-17T02:22:33.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015556899999999999 2024-09-17T02:22:33.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:33.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560025+0000", 2024-09-17T02:22:33.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025710700000000002 2024-09-17T02:22:33.613 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.613 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.613 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.613 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129509 5.4 5:2c35515e:::benchmark_data_smithi001_23533_object1392:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:33.613 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:33.613 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.983935512000002, 2024-09-17T02:22:33.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99969384900000002, 2024-09-17T02:22:33.614 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.614 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.614 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:33.614 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.614 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.614 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.614 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129509 2024-09-17T02:22:33.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.614 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563674+0000", 2024-09-17T02:22:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0920000000000001e-06 2024-09-17T02:22:33.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563679+0000", 2024-09-17T02:22:33.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7660000000000004e-06 2024-09-17T02:22:33.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563693+0000", 2024-09-17T02:22:33.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3139000000000001e-05 2024-09-17T02:22:33.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563701+0000", 2024-09-17T02:22:33.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9859999999999994e-06 2024-09-17T02:22:33.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563775+0000", 2024-09-17T02:22:33.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4659000000000005e-05 2024-09-17T02:22:33.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:33.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563785+0000", 2024-09-17T02:22:33.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4839999999999993e-06 2024-09-17T02:22:33.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552085+0000", 2024-09-17T02:22:33.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98829986999999997 2024-09-17T02:22:33.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552554+0000", 2024-09-17T02:22:33.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046908900000000001 2024-09-17T02:22:33.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:33.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552931+0000", 2024-09-17T02:22:33.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377778 2024-09-17T02:22:33.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:33.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563106+0000", 2024-09-17T02:22:33.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010174186 2024-09-17T02:22:33.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:33.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563138+0000", 2024-09-17T02:22:33.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2495e-05 2024-09-17T02:22:33.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:33.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563225+0000", 2024-09-17T02:22:33.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6677999999999999e-05 2024-09-17T02:22:33.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:33.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563366+0000", 2024-09-17T02:22:33.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014162699999999999 2024-09-17T02:22:33.620 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.621 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.621 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.621 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129524 5.4 5:25dca7dd:::benchmark_data_smithi001_23533_object1407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:33.621 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:33.621 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.977244157999998, 2024-09-17T02:22:33.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99999501999999996, 2024-09-17T02:22:33.621 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.621 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.621 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:33.621 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.621 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.622 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.622 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129524 2024-09-17T02:22:33.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.622 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:33.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:33.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570365+0000", 2024-09-17T02:22:33.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.142e-06 2024-09-17T02:22:33.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570369+0000", 2024-09-17T02:22:33.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.856e-06 2024-09-17T02:22:33.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570385+0000", 2024-09-17T02:22:33.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5855e-05 2024-09-17T02:22:33.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570392+0000", 2024-09-17T02:22:33.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5340000000000002e-06 2024-09-17T02:22:33.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570484+0000", 2024-09-17T02:22:33.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1212999999999996e-05 2024-09-17T02:22:33.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:33.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570498+0000", 2024-09-17T02:22:33.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4331000000000001e-05 2024-09-17T02:22:33.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555835+0000", 2024-09-17T02:22:33.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98533757700000002 2024-09-17T02:22:33.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556329+0000", 2024-09-17T02:22:33.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000493458 2024-09-17T02:22:33.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:33.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556784+0000", 2024-09-17T02:22:33.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045476499999999999 2024-09-17T02:22:33.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:33.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569852+0000", 2024-09-17T02:22:33.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013068270999999999 2024-09-17T02:22:33.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:33.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569958+0000", 2024-09-17T02:22:33.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106214 2024-09-17T02:22:33.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:33.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570124+0000", 2024-09-17T02:22:33.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165546 2024-09-17T02:22:33.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:33.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570359+0000", 2024-09-17T02:22:33.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023525799999999999 2024-09-17T02:22:33.628 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.628 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.628 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.628 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129537 5.4 5:260327c6:::benchmark_data_smithi001_23533_object1420:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:33.628 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:33.628 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.969337629000002, 2024-09-17T02:22:33.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99624596499999996, 2024-09-17T02:22:33.628 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.629 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.629 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:33.629 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.629 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.629 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.629 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129537 2024-09-17T02:22:33.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.629 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:33.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:33.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578272+0000", 2024-09-17T02:22:33.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.164e-06 2024-09-17T02:22:33.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578278+0000", 2024-09-17T02:22:33.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5060000000000001e-06 2024-09-17T02:22:33.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578294+0000", 2024-09-17T02:22:33.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5687000000000001e-05 2024-09-17T02:22:33.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578329+0000", 2024-09-17T02:22:33.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5311999999999997e-05 2024-09-17T02:22:33.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578419+0000", 2024-09-17T02:22:33.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0054000000000002e-05 2024-09-17T02:22:33.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:33.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578435+0000", 2024-09-17T02:22:33.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5645999999999999e-05 2024-09-17T02:22:33.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560148+0000", 2024-09-17T02:22:33.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98171342299999997 2024-09-17T02:22:33.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560383+0000", 2024-09-17T02:22:33.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000234935 2024-09-17T02:22:33.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:33.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560586+0000", 2024-09-17T02:22:33.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000202909 2024-09-17T02:22:33.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:33.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570472+0000", 2024-09-17T02:22:33.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098856959999999994 2024-09-17T02:22:33.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:33.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574138+0000", 2024-09-17T02:22:33.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036660170000000001 2024-09-17T02:22:33.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:33.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574298+0000", 2024-09-17T02:22:33.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016025600000000001 2024-09-17T02:22:33.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:33.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574516+0000", 2024-09-17T02:22:33.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021835999999999999 2024-09-17T02:22:33.635 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.635 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.635 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.635 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129545 5.4 5:22366489:::benchmark_data_smithi001_23533_object1428:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:33.636 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:33.636 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.963474906000002, 2024-09-17T02:22:33.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99074544499999995, 2024-09-17T02:22:33.636 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.636 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.636 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:33.636 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.636 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.636 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.636 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129545 2024-09-17T02:22:33.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.636 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:33.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:33.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584135+0000", 2024-09-17T02:22:33.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4699999999999999e-06 2024-09-17T02:22:33.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584142+0000", 2024-09-17T02:22:33.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1620000000000002e-06 2024-09-17T02:22:33.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584170+0000", 2024-09-17T02:22:33.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7897000000000001e-05 2024-09-17T02:22:33.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584183+0000", 2024-09-17T02:22:33.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2814e-05 2024-09-17T02:22:33.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584299+0000", 2024-09-17T02:22:33.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116153 2024-09-17T02:22:33.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:33.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584316+0000", 2024-09-17T02:22:33.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7524999999999999e-05 2024-09-17T02:22:33.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563461+0000", 2024-09-17T02:22:33.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97914436699999996 2024-09-17T02:22:33.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563667+0000", 2024-09-17T02:22:33.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020689800000000001 2024-09-17T02:22:33.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:33.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563878+0000", 2024-09-17T02:22:33.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210275 2024-09-17T02:22:33.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:33.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570584+0000", 2024-09-17T02:22:33.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067066080000000002 2024-09-17T02:22:33.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:33.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574539+0000", 2024-09-17T02:22:33.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039550360000000003 2024-09-17T02:22:33.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:33.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574653+0000", 2024-09-17T02:22:33.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114003 2024-09-17T02:22:33.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:33.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574879+0000", 2024-09-17T02:22:33.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022523700000000001 2024-09-17T02:22:33.643 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.643 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.643 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.643 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129553 5.4 5:2e41ad40:::benchmark_data_smithi001_23533_object1436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:33.643 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:33.644 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.958052270000003, 2024-09-17T02:22:33.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99213429600000003, 2024-09-17T02:22:33.644 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.644 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.644 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:33.644 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.644 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.644 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.644 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129553 2024-09-17T02:22:33.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.644 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:33.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:33.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589557+0000", 2024-09-17T02:22:33.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2219999999999999e-06 2024-09-17T02:22:33.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589562+0000", 2024-09-17T02:22:33.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0649999999999998e-06 2024-09-17T02:22:33.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589575+0000", 2024-09-17T02:22:33.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3129000000000001e-05 2024-09-17T02:22:33.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589584+0000", 2024-09-17T02:22:33.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6200000000000005e-06 2024-09-17T02:22:33.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589693+0000", 2024-09-17T02:22:33.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109319 2024-09-17T02:22:33.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:33.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589714+0000", 2024-09-17T02:22:33.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0849999999999999e-05 2024-09-17T02:22:33.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566273+0000", 2024-09-17T02:22:33.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97655884999999998 2024-09-17T02:22:33.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566543+0000", 2024-09-17T02:22:33.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027059099999999998 2024-09-17T02:22:33.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:33.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566832+0000", 2024-09-17T02:22:33.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028898200000000002 2024-09-17T02:22:33.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:33.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581040+0000", 2024-09-17T02:22:33.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014208001 2024-09-17T02:22:33.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:33.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581200+0000", 2024-09-17T02:22:33.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159956 2024-09-17T02:22:33.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:33.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581427+0000", 2024-09-17T02:22:33.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000226309 2024-09-17T02:22:33.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:33.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581690+0000", 2024-09-17T02:22:33.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026340199999999998 2024-09-17T02:22:33.650 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.650 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.650 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.650 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129580 5.4 5:25ed887b:::benchmark_data_smithi001_23533_object1463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:33.651 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:33.651 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.936280226000001, 2024-09-17T02:22:33.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98001430499999997, 2024-09-17T02:22:33.651 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.651 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.651 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:33.651 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.651 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.651 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.651 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129580 2024-09-17T02:22:33.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.651 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:33.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:33.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611329+0000", 2024-09-17T02:22:33.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.22e-06 2024-09-17T02:22:33.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611335+0000", 2024-09-17T02:22:33.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1129999999999997e-06 2024-09-17T02:22:33.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611348+0000", 2024-09-17T02:22:33.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2342e-05 2024-09-17T02:22:33.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611356+0000", 2024-09-17T02:22:33.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.371e-06 2024-09-17T02:22:33.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611419+0000", 2024-09-17T02:22:33.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3393999999999996e-05 2024-09-17T02:22:33.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:33.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611427+0000", 2024-09-17T02:22:33.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999997e-06 2024-09-17T02:22:33.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570705+0000", 2024-09-17T02:22:33.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.95927859199999999 2024-09-17T02:22:33.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571009+0000", 2024-09-17T02:22:33.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030414599999999998 2024-09-17T02:22:33.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:33.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571241+0000", 2024-09-17T02:22:33.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023106799999999999 2024-09-17T02:22:33.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:33.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590789+0000", 2024-09-17T02:22:33.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019548763 2024-09-17T02:22:33.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:33.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590928+0000", 2024-09-17T02:22:33.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000139092 2024-09-17T02:22:33.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:33.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591086+0000", 2024-09-17T02:22:33.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015787400000000001 2024-09-17T02:22:33.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:33.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591342+0000", 2024-09-17T02:22:33.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025589900000000002 2024-09-17T02:22:33.657 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.657 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.657 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.657 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129603 5.4 5:25aaa5e8:::benchmark_data_smithi001_23533_object1486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:33.658 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:33.658 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.920220430000001, 2024-09-17T02:22:33.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96463198999999999, 2024-09-17T02:22:33.658 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.658 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.658 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:33.658 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.658 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.658 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.658 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129603 2024-09-17T02:22:33.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.658 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:33.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:33.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:33.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:22:33.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627392+0000", 2024-09-17T02:22:33.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0790000000000002e-06 2024-09-17T02:22:33.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627403+0000", 2024-09-17T02:22:33.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0866000000000001e-05 2024-09-17T02:22:33.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627409+0000", 2024-09-17T02:22:33.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.305e-06 2024-09-17T02:22:33.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627485+0000", 2024-09-17T02:22:33.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6582000000000006e-05 2024-09-17T02:22:33.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:33.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627499+0000", 2024-09-17T02:22:33.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:22:33.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574991+0000", 2024-09-17T02:22:33.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94749182300000001 2024-09-17T02:22:33.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575377+0000", 2024-09-17T02:22:33.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038629400000000003 2024-09-17T02:22:33.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:33.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575665+0000", 2024-09-17T02:22:33.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028759499999999997 2024-09-17T02:22:33.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:33.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590802+0000", 2024-09-17T02:22:33.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015136479 2024-09-17T02:22:33.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:33.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591614+0000", 2024-09-17T02:22:33.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081293100000000003 2024-09-17T02:22:33.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:33.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591764+0000", 2024-09-17T02:22:33.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014932199999999999 2024-09-17T02:22:33.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:33.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592020+0000", 2024-09-17T02:22:33.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025585099999999997 2024-09-17T02:22:33.664 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.664 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.664 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.664 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129607 5.4 5:2f638f1e:::benchmark_data_smithi001_23533_object1490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:33.664 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:33.665 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.918693523999998, 2024-09-17T02:22:33.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96352375899999998, 2024-09-17T02:22:33.665 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.665 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.665 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:33.665 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.665 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.665 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.665 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129607 2024-09-17T02:22:33.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.665 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:33.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:33.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628916+0000", 2024-09-17T02:22:33.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1710000000000001e-06 2024-09-17T02:22:33.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628920+0000", 2024-09-17T02:22:33.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-17T02:22:33.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628935+0000", 2024-09-17T02:22:33.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4474000000000001e-05 2024-09-17T02:22:33.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628944+0000", 2024-09-17T02:22:33.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9940000000000006e-06 2024-09-17T02:22:33.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628997+0000", 2024-09-17T02:22:33.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3579000000000003e-05 2024-09-17T02:22:33.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:33.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.629006+0000", 2024-09-17T02:22:33.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4009999999999997e-06 2024-09-17T02:22:33.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.577862+0000", 2024-09-17T02:22:33.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.948856335 2024-09-17T02:22:33.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578167+0000", 2024-09-17T02:22:33.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030532399999999999 2024-09-17T02:22:33.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:33.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578532+0000", 2024-09-17T02:22:33.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036428200000000001 2024-09-17T02:22:33.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:33.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591442+0000", 2024-09-17T02:22:33.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012910374000000001 2024-09-17T02:22:33.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:33.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592164+0000", 2024-09-17T02:22:33.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072242499999999996 2024-09-17T02:22:33.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:33.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592267+0000", 2024-09-17T02:22:33.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102205 2024-09-17T02:22:33.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:33.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592438+0000", 2024-09-17T02:22:33.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017165299999999999 2024-09-17T02:22:33.671 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.671 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.671 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.671 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129623 5.4 5:2cf5174b:::benchmark_data_smithi001_23533_object1506:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:33.671 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:33.672 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.894749238000003, 2024-09-17T02:22:33.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94334114499999999, 2024-09-17T02:22:33.672 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.672 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.672 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:33.672 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.672 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.672 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.672 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129623 2024-09-17T02:22:33.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.672 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:33.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:33.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652860+0000", 2024-09-17T02:22:33.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0330000000000001e-06 2024-09-17T02:22:33.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652864+0000", 2024-09-17T02:22:33.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.634e-06 2024-09-17T02:22:33.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652877+0000", 2024-09-17T02:22:33.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2591e-05 2024-09-17T02:22:33.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652883+0000", 2024-09-17T02:22:33.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1460000000000001e-06 2024-09-17T02:22:33.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652943+0000", 2024-09-17T02:22:33.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9833999999999997e-05 2024-09-17T02:22:33.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:33.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652950+0000", 2024-09-17T02:22:33.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.401e-06 2024-09-17T02:22:33.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581800+0000", 2024-09-17T02:22:33.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.92884935700000004 2024-09-17T02:22:33.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582122+0000", 2024-09-17T02:22:33.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032185200000000002 2024-09-17T02:22:33.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:33.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582689+0000", 2024-09-17T02:22:33.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056750400000000003 2024-09-17T02:22:33.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:33.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591458+0000", 2024-09-17T02:22:33.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008768685 2024-09-17T02:22:33.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:33.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595856+0000", 2024-09-17T02:22:33.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043977909999999999 2024-09-17T02:22:33.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:33.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595955+0000", 2024-09-17T02:22:33.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9166000000000006e-05 2024-09-17T02:22:33.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:33.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596200+0000", 2024-09-17T02:22:33.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024515099999999998 2024-09-17T02:22:33.678 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.678 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.678 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.678 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129642 5.4 5:255eb796:::benchmark_data_smithi001_23533_object1525:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:33.678 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:33.678 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.863513073999997, 2024-09-17T02:22:33.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.91257397299999998, 2024-09-17T02:22:33.679 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.679 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.679 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:33.679 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.679 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.679 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.679 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129642 2024-09-17T02:22:33.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.679 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:33.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:33.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684096+0000", 2024-09-17T02:22:33.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659999999999999e-06 2024-09-17T02:22:33.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684101+0000", 2024-09-17T02:22:33.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8110000000000002e-06 2024-09-17T02:22:33.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684114+0000", 2024-09-17T02:22:33.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2653000000000001e-05 2024-09-17T02:22:33.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684121+0000", 2024-09-17T02:22:33.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5100000000000001e-06 2024-09-17T02:22:33.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684181+0000", 2024-09-17T02:22:33.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0307999999999999e-05 2024-09-17T02:22:33.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:33.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684194+0000", 2024-09-17T02:22:33.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2916e-05 2024-09-17T02:22:33.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.587917+0000", 2024-09-17T02:22:33.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.90372220400000003 2024-09-17T02:22:33.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588215+0000", 2024-09-17T02:22:33.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029845400000000003 2024-09-17T02:22:33.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:33.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588470+0000", 2024-09-17T02:22:33.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025455399999999999 2024-09-17T02:22:33.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:33.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596318+0000", 2024-09-17T02:22:33.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078485589999999997 2024-09-17T02:22:33.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:33.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596354+0000", 2024-09-17T02:22:33.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5976999999999998e-05 2024-09-17T02:22:33.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:33.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596449+0000", 2024-09-17T02:22:33.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4728999999999994e-05 2024-09-17T02:22:33.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:33.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596669+0000", 2024-09-17T02:22:33.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220132 2024-09-17T02:22:33.685 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.685 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.685 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.685 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129649 5.4 5:2fe27050:::benchmark_data_smithi001_23533_object1532:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:33.685 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:33.685 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.831956331000001, 2024-09-17T02:22:33.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.88508119100000004, 2024-09-17T02:22:33.685 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:33.686 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:33.686 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:33.686 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:33.686 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:33.686 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:33.686 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129649 2024-09-17T02:22:33.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.686 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:33.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:33.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:33.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:33.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:33.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:33.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:33.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715653+0000", 2024-09-17T02:22:33.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3519999999999999e-06 2024-09-17T02:22:33.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:33.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715658+0000", 2024-09-17T02:22:33.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3120000000000001e-06 2024-09-17T02:22:33.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:33.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715677+0000", 2024-09-17T02:22:33.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-17T02:22:33.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:33.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715687+0000", 2024-09-17T02:22:33.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0146000000000001e-05 2024-09-17T02:22:33.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715821+0000", 2024-09-17T02:22:33.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013421 2024-09-17T02:22:33.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:33.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715840+0000", 2024-09-17T02:22:33.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8153999999999999e-05 2024-09-17T02:22:33.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:33.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592528+0000", 2024-09-17T02:22:33.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.87668860000000004 2024-09-17T02:22:33.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:33.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592702+0000", 2024-09-17T02:22:33.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017429300000000001 2024-09-17T02:22:33.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:33.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592945+0000", 2024-09-17T02:22:33.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000242048 2024-09-17T02:22:33.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:33.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600234+0000", 2024-09-17T02:22:33.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072897600000000002 2024-09-17T02:22:33.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:33.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600494+0000", 2024-09-17T02:22:33.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000259984 2024-09-17T02:22:33.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:33.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600555+0000", 2024-09-17T02:22:33.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1138999999999999e-05 2024-09-17T02:22:33.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:33.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:33.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:33.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600733+0000", 2024-09-17T02:22:33.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017753300000000001 2024-09-17T02:22:33.692 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.692 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.692 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.692 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:33.692 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:33.692 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:33.693 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:33.694 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:33.690+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:33.792 INFO:tasks.radosbench.radosbench.0.smithi001.stdout:Removed 128114 objects 2024-09-17T02:22:33.792 INFO:tasks.radosbench.radosbench.0.smithi001.stdout:Clean up completed and total clean up time :60.0059 2024-09-17T02:22:33.795 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:33.794+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:33.825 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:33.825 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:22:33.825 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-17T02:22:33.825 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:33.837 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:33.896 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:33.894+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:33.942 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:33.942 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:22:33.942 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:22:33.942 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:22:33.942 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:33.954 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:33.997 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:33.998+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:34.063 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:34.063 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:22:34.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:22:34.064 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:22:34.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.064 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:22:34.064 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:34.064 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 111.49504407800001, 2024-09-17T02:22:34.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:22:34.064 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:34.064 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:34.064 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:34.064 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:34.064 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:34.065 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:34.065 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:22:34.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.065 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:34.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:34.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:34.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:34.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:34.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:34.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:22:34.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:22:34.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:34.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:22:34.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:22:34.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:34.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:22:34.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:22:34.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:34.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:22:34.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:22:34.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:34.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:22:34.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:22:34.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:34.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:22:34.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:22:34.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:34.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:22:34.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:22:34.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:34.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:22:34.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:22:34.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:34.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:22:34.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:22:34.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:34.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:22:34.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:22:34.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:34.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:22:34.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:22:34.070 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.070 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:34.070 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.070 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97759 5.a 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:34.070 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:34.070 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 76.465122004999998, 2024-09-17T02:22:34.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.089694871999999995, 2024-09-17T02:22:34.070 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:34.070 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:34.071 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:34.071 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:34.071 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:34.071 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:34.071 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97759 2024-09-17T02:22:34.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.071 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:34.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:34.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:34.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:34.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:34.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:34.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598386+0000", 2024-09-17T02:22:34.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999999e-07 2024-09-17T02:22:34.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:34.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598414+0000", 2024-09-17T02:22:34.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8013000000000001e-05 2024-09-17T02:22:34.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:34.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598420+0000", 2024-09-17T02:22:34.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1149999999999999e-06 2024-09-17T02:22:34.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:34.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598424+0000", 2024-09-17T02:22:34.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:22:34.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:34.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598479+0000", 2024-09-17T02:22:34.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4648999999999998e-05 2024-09-17T02:22:34.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:34.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598587+0000", 2024-09-17T02:22:34.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010853000000000001 2024-09-17T02:22:34.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:34.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598676+0000", 2024-09-17T02:22:34.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8381999999999995e-05 2024-09-17T02:22:34.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:34.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603766+0000", 2024-09-17T02:22:34.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050902559999999996 2024-09-17T02:22:34.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:34.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.687988+0000", 2024-09-17T02:22:34.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.084221753999999996 2024-09-17T02:22:34.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:34.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688037+0000", 2024-09-17T02:22:34.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-05 2024-09-17T02:22:34.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:34.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688080+0000", 2024-09-17T02:22:34.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3149999999999999e-05 2024-09-17T02:22:34.076 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.076 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:34.076 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.076 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97770 5.0 5:09c75033:::benchmark_data_smithi001_23533_object97769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:34.076 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:34.076 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 76.459979575000006, 2024-09-17T02:22:34.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.086380868, 2024-09-17T02:22:34.076 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:34.077 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:34.077 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:34.077 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:34.077 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:34.077 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:34.077 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97770 2024-09-17T02:22:34.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.077 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:34.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:34.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:34.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:34.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:34.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:34.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603529+0000", 2024-09-17T02:22:34.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:22:34.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:34.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603593+0000", 2024-09-17T02:22:34.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4216999999999999e-05 2024-09-17T02:22:34.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:34.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603603+0000", 2024-09-17T02:22:34.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5179999999999993e-06 2024-09-17T02:22:34.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:34.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603608+0000", 2024-09-17T02:22:34.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2039999999999996e-06 2024-09-17T02:22:34.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:34.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603653+0000", 2024-09-17T02:22:34.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5247000000000002e-05 2024-09-17T02:22:34.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:34.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603758+0000", 2024-09-17T02:22:34.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105352 2024-09-17T02:22:34.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:34.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603900+0000", 2024-09-17T02:22:34.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014198999999999999 2024-09-17T02:22:34.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:34.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.606097+0000", 2024-09-17T02:22:34.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021969839999999999 2024-09-17T02:22:34.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:34.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689756+0000", 2024-09-17T02:22:34.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.083659077999999998 2024-09-17T02:22:34.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:34.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689846+0000", 2024-09-17T02:22:34.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9320999999999994e-05 2024-09-17T02:22:34.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:34.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689908+0000", 2024-09-17T02:22:34.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720999999999998e-05 2024-09-17T02:22:34.084 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.084 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:34.084 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.084 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127513 5.c 5:3eca08e4:::benchmark_data_smithi001_23533_object127512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:34.084 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:34.084 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 61.619203151000001, 2024-09-17T02:22:34.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046626399999999998, 2024-09-17T02:22:34.084 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:34.084 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:34.085 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:34.085 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:34.085 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:34.085 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:34.085 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127513 2024-09-17T02:22:34.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.085 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:34.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:34.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:34.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:34.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:34.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:34.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444305+0000", 2024-09-17T02:22:34.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2529999999999999e-06 2024-09-17T02:22:34.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:34.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444466+0000", 2024-09-17T02:22:34.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016069700000000001 2024-09-17T02:22:34.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:34.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444479+0000", 2024-09-17T02:22:34.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2602999999999999e-05 2024-09-17T02:22:34.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:34.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444485+0000", 2024-09-17T02:22:34.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.669e-06 2024-09-17T02:22:34.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:34.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444560+0000", 2024-09-17T02:22:34.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4276999999999994e-05 2024-09-17T02:22:34.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:34.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444656+0000", 2024-09-17T02:22:34.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6490000000000006e-05 2024-09-17T02:22:34.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:34.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444739+0000", 2024-09-17T02:22:34.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3139999999999993e-05 2024-09-17T02:22:34.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:34.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.448438+0000", 2024-09-17T02:22:34.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036985490000000002 2024-09-17T02:22:34.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:34.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490732+0000", 2024-09-17T02:22:34.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042294353999999999 2024-09-17T02:22:34.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:34.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490859+0000", 2024-09-17T02:22:34.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012708899999999999 2024-09-17T02:22:34.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:34.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490930+0000", 2024-09-17T02:22:34.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:34.090 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.090 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:34.090 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.090 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127514 5.c 5:39cc1feb:::benchmark_data_smithi001_23533_object127513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:34.090 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:34.091 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 61.619006382000002, 2024-09-17T02:22:34.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049357228000000003, 2024-09-17T02:22:34.091 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:34.091 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:34.091 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:34.091 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:34.091 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:34.091 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:34.091 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127514 2024-09-17T02:22:34.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.091 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:34.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:34.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:34.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:34.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:34.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:34.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:34.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8599999999999998e-07 2024-09-17T02:22:34.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:34.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444554+0000", 2024-09-17T02:22:34.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3047999999999998e-05 2024-09-17T02:22:34.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:34.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444562+0000", 2024-09-17T02:22:34.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5830000000000001e-06 2024-09-17T02:22:34.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:34.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444567+0000", 2024-09-17T02:22:34.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4179999999999996e-06 2024-09-17T02:22:34.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:34.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446566+0000", 2024-09-17T02:22:34.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001998788 2024-09-17T02:22:34.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:34.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446696+0000", 2024-09-17T02:22:34.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129393 2024-09-17T02:22:34.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:34.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446794+0000", 2024-09-17T02:22:34.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8462999999999996e-05 2024-09-17T02:22:34.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:34.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.449036+0000", 2024-09-17T02:22:34.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022415880000000001 2024-09-17T02:22:34.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:34.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493737+0000", 2024-09-17T02:22:34.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044701682 2024-09-17T02:22:34.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:34.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493808+0000", 2024-09-17T02:22:34.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0846000000000006e-05 2024-09-17T02:22:34.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:34.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493858+0000", 2024-09-17T02:22:34.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9932999999999998e-05 2024-09-17T02:22:34.099 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.099 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:34.100 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.100 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129441 5.1 5:84c3199f:::benchmark_data_smithi001_23533_object1324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:34.100 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:34.100 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 58.559995893999996, 2024-09-17T02:22:34.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034387011000000002, 2024-09-17T02:22:34.100 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:34.100 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:34.100 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:34.100 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:34.100 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:34.100 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:34.101 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129441 2024-09-17T02:22:34.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.101 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:34.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:34.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:34.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:34.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:34.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:34.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503513+0000", 2024-09-17T02:22:34.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4759999999999999e-06 2024-09-17T02:22:34.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:34.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503518+0000", 2024-09-17T02:22:34.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-09-17T02:22:34.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:34.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503532+0000", 2024-09-17T02:22:34.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4049999999999999e-05 2024-09-17T02:22:34.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:34.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503541+0000", 2024-09-17T02:22:34.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5320000000000006e-06 2024-09-17T02:22:34.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:34.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506331+0000", 2024-09-17T02:22:34.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027899190000000001 2024-09-17T02:22:34.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506402+0000", 2024-09-17T02:22:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506477+0000", 2024-09-17T02:22:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4626e-05 2024-09-17T02:22:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509749+0000", 2024-09-17T02:22:34.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032726980000000001 2024-09-17T02:22:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537758+0000", 2024-09-17T02:22:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028008890000000002 2024-09-17T02:22:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537812+0000", 2024-09-17T02:22:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3300000000000001e-05 2024-09-17T02:22:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537898+0000", 2024-09-17T02:22:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6691000000000001e-05 2024-09-17T02:22:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252853 5.8 5:10eae6ef:::benchmark_data_smithi001_23533_object124736:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.319189+0000", 2024-09-17T02:22:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.744317948, 2024-09-17T02:22:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042307663000000002, 2024-09-17T02:22:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:34.106 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252853 2024-09-17T02:22:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319189+0000", 2024-09-17T02:22:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319189+0000", 2024-09-17T02:22:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319190+0000", 2024-09-17T02:22:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4900000000000001e-07 2024-09-17T02:22:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:34.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319191+0000", 2024-09-17T02:22:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.714e-06 2024-09-17T02:22:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319197+0000", 2024-09-17T02:22:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7169999999999996e-06 2024-09-17T02:22:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319200+0000", 2024-09-17T02:22:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1389999999999999e-06 2024-09-17T02:22:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319233+0000", 2024-09-17T02:22:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2830000000000002e-05 2024-09-17T02:22:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319307+0000", 2024-09-17T02:22:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3794999999999994e-05 2024-09-17T02:22:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319401+0000", 2024-09-17T02:22:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4600999999999998e-05 2024-09-17T02:22:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321482+0000", 2024-09-17T02:22:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020808480000000002 2024-09-17T02:22:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361420+0000", 2024-09-17T02:22:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039937707000000003 2024-09-17T02:22:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361468+0000", 2024-09-17T02:22:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7722999999999997e-05 2024-09-17T02:22:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361497+0000", 2024-09-17T02:22:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9240000000000001e-05 2024-09-17T02:22:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252854 5.6 5:6f0fbabd:::benchmark_data_smithi001_23533_object124737:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.319209+0000", 2024-09-17T02:22:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.7442984290000001, 2024-09-17T02:22:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041094994000000003, 2024-09-17T02:22:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252854 2024-09-17T02:22:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:34.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319209+0000", 2024-09-17T02:22:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319209+0000", 2024-09-17T02:22:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:34.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319209+0000", 2024-09-17T02:22:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9099999999999999e-07 2024-09-17T02:22:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319211+0000", 2024-09-17T02:22:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9520000000000001e-06 2024-09-17T02:22:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319218+0000", 2024-09-17T02:22:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3350000000000001e-06 2024-09-17T02:22:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:34.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319224+0000", 2024-09-17T02:22:34.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6849999999999998e-06 2024-09-17T02:22:34.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:34.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321118+0000", 2024-09-17T02:22:34.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018940070000000001 2024-09-17T02:22:34.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:34.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321185+0000", 2024-09-17T02:22:34.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6806999999999999e-05 2024-09-17T02:22:34.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:34.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.360143+0000", 2024-09-17T02:22:34.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038958333999999997 2024-09-17T02:22:34.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:34.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.360227+0000", 2024-09-17T02:22:34.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3732000000000004e-05 2024-09-17T02:22:34.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:34.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.360304+0000", 2024-09-17T02:22:34.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6750999999999998e-05 2024-09-17T02:22:34.118 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.118 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:34.118 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.118 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252859 5.2 5:4a025e38:::benchmark_data_smithi001_23533_object124742:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:34.118 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.319239+0000", 2024-09-17T02:22:34.118 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.7442679189999999, 2024-09-17T02:22:34.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042922412, 2024-09-17T02:22:34.118 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:34.118 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:34.119 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:34.119 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:34.119 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:34.119 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:34.119 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252859 2024-09-17T02:22:34.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.119 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:34.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:34.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319239+0000", 2024-09-17T02:22:34.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:34.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319239+0000", 2024-09-17T02:22:34.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:34.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319240+0000", 2024-09-17T02:22:34.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7599999999999997e-07 2024-09-17T02:22:34.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:34.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319242+0000", 2024-09-17T02:22:34.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.294e-06 2024-09-17T02:22:34.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:34.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319248+0000", 2024-09-17T02:22:34.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.139e-06 2024-09-17T02:22:34.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:34.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319252+0000", 2024-09-17T02:22:34.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6389999999999998e-06 2024-09-17T02:22:34.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:34.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319312+0000", 2024-09-17T02:22:34.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9741000000000003e-05 2024-09-17T02:22:34.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:34.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319435+0000", 2024-09-17T02:22:34.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012350800000000001 2024-09-17T02:22:34.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:34.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.362015+0000", 2024-09-17T02:22:34.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042579662999999997 2024-09-17T02:22:34.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:34.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.362072+0000", 2024-09-17T02:22:34.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7453e-05 2024-09-17T02:22:34.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:34.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.362162+0000", 2024-09-17T02:22:34.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9399000000000002e-05 2024-09-17T02:22:34.123 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.123 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:34.123 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.124 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252860 5.0 5:00535124:::benchmark_data_smithi001_23533_object124743:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:34.124 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.319263+0000", 2024-09-17T02:22:34.124 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.744243813, 2024-09-17T02:22:34.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044660535000000001, 2024-09-17T02:22:34.124 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:34.124 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:34.124 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:34.124 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:34.124 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:34.124 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:34.125 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252860 2024-09-17T02:22:34.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.125 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:34.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:34.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319263+0000", 2024-09-17T02:22:34.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:34.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319263+0000", 2024-09-17T02:22:34.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:34.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319264+0000", 2024-09-17T02:22:34.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9999999999999998e-07 2024-09-17T02:22:34.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:34.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319265+0000", 2024-09-17T02:22:34.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5319999999999999e-06 2024-09-17T02:22:34.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:34.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319269+0000", 2024-09-17T02:22:34.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9419999999999997e-06 2024-09-17T02:22:34.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:34.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319272+0000", 2024-09-17T02:22:34.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1879999999999998e-06 2024-09-17T02:22:34.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:34.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319310+0000", 2024-09-17T02:22:34.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7509000000000003e-05 2024-09-17T02:22:34.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:34.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319433+0000", 2024-09-17T02:22:34.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012351500000000001 2024-09-17T02:22:34.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:34.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319544+0000", 2024-09-17T02:22:34.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111011 2024-09-17T02:22:34.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:34.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363800+0000", 2024-09-17T02:22:34.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044255456999999998 2024-09-17T02:22:34.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:34.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363837+0000", 2024-09-17T02:22:34.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.684e-05 2024-09-17T02:22:34.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:34.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363885+0000", 2024-09-17T02:22:34.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8324e-05 2024-09-17T02:22:34.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:34.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363924+0000", 2024-09-17T02:22:34.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8816999999999998e-05 2024-09-17T02:22:34.130 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.130 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:34.130 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.131 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252861 5.6 5:64c353c8:::benchmark_data_smithi001_23533_object124744:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:34.131 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.321550+0000", 2024-09-17T02:22:34.131 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.7419571380000001, 2024-09-17T02:22:34.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039569213999999998, 2024-09-17T02:22:34.131 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:34.131 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:34.131 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:34.131 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:34.131 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:34.131 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:34.132 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252861 2024-09-17T02:22:34.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.132 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:34.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:34.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321550+0000", 2024-09-17T02:22:34.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:34.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321550+0000", 2024-09-17T02:22:34.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:34.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321551+0000", 2024-09-17T02:22:34.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1710000000000001e-06 2024-09-17T02:22:34.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:34.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321559+0000", 2024-09-17T02:22:34.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8399999999999995e-06 2024-09-17T02:22:34.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:34.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321569+0000", 2024-09-17T02:22:34.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9499999999999996e-06 2024-09-17T02:22:34.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:34.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321576+0000", 2024-09-17T02:22:34.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8979999999999999e-06 2024-09-17T02:22:34.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:34.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322921+0000", 2024-09-17T02:22:34.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001345026 2024-09-17T02:22:34.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:34.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323020+0000", 2024-09-17T02:22:34.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9505000000000004e-05 2024-09-17T02:22:34.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:34.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361001+0000", 2024-09-17T02:22:34.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037980216999999997 2024-09-17T02:22:34.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:34.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361039+0000", 2024-09-17T02:22:34.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8729999999999997e-05 2024-09-17T02:22:34.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:34.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361119+0000", 2024-09-17T02:22:34.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9876999999999994e-05 2024-09-17T02:22:34.136 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.136 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:34.136 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.137 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252862 5.0 5:027af5f9:::benchmark_data_smithi001_23533_object124745:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:34.137 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.321589+0000", 2024-09-17T02:22:34.137 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.741918377, 2024-09-17T02:22:34.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042469481000000003, 2024-09-17T02:22:34.137 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:34.137 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:34.137 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:34.137 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:34.137 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:34.137 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:34.137 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252862 2024-09-17T02:22:34.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.138 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:34.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:34.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321589+0000", 2024-09-17T02:22:34.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:34.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321589+0000", 2024-09-17T02:22:34.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:34.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321589+0000", 2024-09-17T02:22:34.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7999999999999996e-07 2024-09-17T02:22:34.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:34.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321591+0000", 2024-09-17T02:22:34.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.12e-06 2024-09-17T02:22:34.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:34.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321597+0000", 2024-09-17T02:22:34.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7880000000000003e-06 2024-09-17T02:22:34.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:34.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321602+0000", 2024-09-17T02:22:34.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6450000000000004e-06 2024-09-17T02:22:34.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:34.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321634+0000", 2024-09-17T02:22:34.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1959999999999999e-05 2024-09-17T02:22:34.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:34.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321736+0000", 2024-09-17T02:22:34.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101879 2024-09-17T02:22:34.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:34.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321856+0000", 2024-09-17T02:22:34.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120227 2024-09-17T02:22:34.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:34.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363941+0000", 2024-09-17T02:22:34.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042085514999999997 2024-09-17T02:22:34.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:34.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363978+0000", 2024-09-17T02:22:34.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7002000000000002e-05 2024-09-17T02:22:34.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:34.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.364023+0000", 2024-09-17T02:22:34.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4978999999999997e-05 2024-09-17T02:22:34.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:34.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.364058+0000", 2024-09-17T02:22:34.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4885999999999998e-05 2024-09-17T02:22:34.143 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.143 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:34.143 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.143 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252852 5.3 e73/64 5:c3aafdc8:::benchmark_data_smithi001_23533_object124735:head v 73'15929, mlcod=73'15927)", 2024-09-17T02:22:34.143 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.321622+0000", 2024-09-17T02:22:34.143 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.741884889, 2024-09-17T02:22:34.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037496129000000003, 2024-09-17T02:22:34.143 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:34.143 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:34.143 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:34.144 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:34.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:34.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321622+0000", 2024-09-17T02:22:34.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:34.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321622+0000", 2024-09-17T02:22:34.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:34.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321623+0000", 2024-09-17T02:22:34.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0900000000000001e-07 2024-09-17T02:22:34.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:34.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321631+0000", 2024-09-17T02:22:34.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6790000000000005e-06 2024-09-17T02:22:34.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:34.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321637+0000", 2024-09-17T02:22:34.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4500000000000001e-06 2024-09-17T02:22:34.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:34.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321642+0000", 2024-09-17T02:22:34.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7480000000000001e-06 2024-09-17T02:22:34.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:34.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321690+0000", 2024-09-17T02:22:34.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8541999999999997e-05 2024-09-17T02:22:34.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:34.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321705+0000", 2024-09-17T02:22:34.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.517e-05 2024-09-17T02:22:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359076+0000", 2024-09-17T02:22:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037370642000000003 2024-09-17T02:22:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359118+0000", 2024-09-17T02:22:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2289000000000001e-05 2024-09-17T02:22:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252856 5.1 e73/61 5:82c49704:::benchmark_data_smithi001_23533_object124739:head v 73'15774, mlcod=73'15772)", 2024-09-17T02:22:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.321652+0000", 2024-09-17T02:22:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.741855199, 2024-09-17T02:22:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037495563000000003, 2024-09-17T02:22:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321652+0000", 2024-09-17T02:22:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321652+0000", 2024-09-17T02:22:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321652+0000", 2024-09-17T02:22:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7700000000000001e-07 2024-09-17T02:22:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321655+0000", 2024-09-17T02:22:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6220000000000001e-06 2024-09-17T02:22:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321660+0000", 2024-09-17T02:22:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.967e-06 2024-09-17T02:22:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321664+0000", 2024-09-17T02:22:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8039999999999999e-06 2024-09-17T02:22:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321706+0000", 2024-09-17T02:22:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2138000000000002e-05 2024-09-17T02:22:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321726+0000", 2024-09-17T02:22:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0236000000000001e-05 2024-09-17T02:22:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359072+0000", 2024-09-17T02:22:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037346435999999997 2024-09-17T02:22:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359148+0000", 2024-09-17T02:22:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5082999999999999e-05 2024-09-17T02:22:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252857 5.3 e73/64 5:c255b9a8:::benchmark_data_smithi001_23533_object124740:head v 73'15930, mlcod=73'15927)", 2024-09-17T02:22:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.321676+0000", 2024-09-17T02:22:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.7418313840000001, 2024-09-17T02:22:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044692651999999999, 2024-09-17T02:22:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321676+0000", 2024-09-17T02:22:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321676+0000", 2024-09-17T02:22:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321676+0000", 2024-09-17T02:22:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4299999999999999e-07 2024-09-17T02:22:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321683+0000", 2024-09-17T02:22:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.652e-06 2024-09-17T02:22:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321689+0000", 2024-09-17T02:22:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9340000000000003e-06 2024-09-17T02:22:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321693+0000", 2024-09-17T02:22:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3309999999999997e-06 2024-09-17T02:22:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323151+0000", 2024-09-17T02:22:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014580260000000001 2024-09-17T02:22:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323170+0000", 2024-09-17T02:22:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8998999999999999e-05 2024-09-17T02:22:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.366320+0000", 2024-09-17T02:22:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.043150177999999997 2024-09-17T02:22:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.366368+0000", 2024-09-17T02:22:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8288999999999998e-05 2024-09-17T02:22:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252866 5.0 5:0b646666:::benchmark_data_smithi001_23533_object124749:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.322387+0000", 2024-09-17T02:22:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.741119914, 2024-09-17T02:22:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041814680999999999, 2024-09-17T02:22:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252866 2024-09-17T02:22:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322387+0000", 2024-09-17T02:22:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322387+0000", 2024-09-17T02:22:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322388+0000", 2024-09-17T02:22:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6300000000000004e-07 2024-09-17T02:22:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322392+0000", 2024-09-17T02:22:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-06 2024-09-17T02:22:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322402+0000", 2024-09-17T02:22:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0165e-05 2024-09-17T02:22:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322409+0000", 2024-09-17T02:22:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5180000000000001e-06 2024-09-17T02:22:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323635+0000", 2024-09-17T02:22:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001226296 2024-09-17T02:22:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323738+0000", 2024-09-17T02:22:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103491 2024-09-17T02:22:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359170+0000", 2024-09-17T02:22:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035431547000000001 2024-09-17T02:22:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363946+0000", 2024-09-17T02:22:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047759090000000001 2024-09-17T02:22:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.364118+0000", 2024-09-17T02:22:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017171600000000001 2024-09-17T02:22:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.364163+0000", 2024-09-17T02:22:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5176000000000003e-05 2024-09-17T02:22:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.364202+0000", 2024-09-17T02:22:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9103000000000002e-05 2024-09-17T02:22:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252864 5.e e73/22 5:79949647:::benchmark_data_smithi001_23533_object124747:head v 73'15818, mlcod=73'15816)", 2024-09-17T02:22:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.322434+0000", 2024-09-17T02:22:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.7410735429999999, 2024-09-17T02:22:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038558940999999999, 2024-09-17T02:22:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322434+0000", 2024-09-17T02:22:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322434+0000", 2024-09-17T02:22:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322434+0000", 2024-09-17T02:22:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0499999999999999e-07 2024-09-17T02:22:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322441+0000", 2024-09-17T02:22:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.545e-06 2024-09-17T02:22:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322447+0000", 2024-09-17T02:22:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6089999999999997e-06 2024-09-17T02:22:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322452+0000", 2024-09-17T02:22:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4549999999999997e-06 2024-09-17T02:22:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322786+0000", 2024-09-17T02:22:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033476699999999997 2024-09-17T02:22:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322806+0000", 2024-09-17T02:22:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0013e-05 2024-09-17T02:22:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.360954+0000", 2024-09-17T02:22:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038147984000000003 2024-09-17T02:22:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:34.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.360993+0000", 2024-09-17T02:22:34.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8163e-05 2024-09-17T02:22:34.168 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.168 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:34.168 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.168 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252867 5.0 5:098def42:::benchmark_data_smithi001_23533_object124750:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:34.168 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.323296+0000", 2024-09-17T02:22:34.168 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.7402113699999999, 2024-09-17T02:22:34.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046048453000000003, 2024-09-17T02:22:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252867 2024-09-17T02:22:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323296+0000", 2024-09-17T02:22:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323296+0000", 2024-09-17T02:22:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323297+0000", 2024-09-17T02:22:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.06e-07 2024-09-17T02:22:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323300+0000", 2024-09-17T02:22:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5140000000000002e-06 2024-09-17T02:22:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323307+0000", 2024-09-17T02:22:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4039999999999998e-06 2024-09-17T02:22:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323312+0000", 2024-09-17T02:22:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8420000000000004e-06 2024-09-17T02:22:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361424+0000", 2024-09-17T02:22:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038111313000000001 2024-09-17T02:22:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361547+0000", 2024-09-17T02:22:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000123621 2024-09-17T02:22:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361676+0000", 2024-09-17T02:22:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129016 2024-09-17T02:22:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.366632+0000", 2024-09-17T02:22:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049562149999999999 2024-09-17T02:22:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.369184+0000", 2024-09-17T02:22:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025512960000000002 2024-09-17T02:22:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:34.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.369270+0000", 2024-09-17T02:22:34.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5873999999999998e-05 2024-09-17T02:22:34.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:34.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.369344+0000", 2024-09-17T02:22:34.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4652000000000003e-05 2024-09-17T02:22:34.174 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.174 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:34.174 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252865 5.1 e73/61 5:81978d99:::benchmark_data_smithi001_23533_object124748:head v 73'15775, mlcod=73'15772)", 2024-09-17T02:22:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.323335+0000", 2024-09-17T02:22:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.7401723709999999, 2024-09-17T02:22:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037706556000000002, 2024-09-17T02:22:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323335+0000", 2024-09-17T02:22:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323335+0000", 2024-09-17T02:22:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323335+0000", 2024-09-17T02:22:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1399999999999998e-07 2024-09-17T02:22:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323338+0000", 2024-09-17T02:22:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3419999999999999e-06 2024-09-17T02:22:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323352+0000", 2024-09-17T02:22:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3771000000000001e-05 2024-09-17T02:22:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323356+0000", 2024-09-17T02:22:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6600000000000001e-06 2024-09-17T02:22:34.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:34.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323403+0000", 2024-09-17T02:22:34.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7290000000000003e-05 2024-09-17T02:22:34.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:34.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323419+0000", 2024-09-17T02:22:34.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5434000000000002e-05 2024-09-17T02:22:34.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.360952+0000", 2024-09-17T02:22:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037533314999999998 2024-09-17T02:22:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361041+0000", 2024-09-17T02:22:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9430000000000003e-05 2024-09-17T02:22:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252868 5.b e73/51 5:d27fb132:::benchmark_data_smithi001_23533_object124751:head v 73'15650, mlcod=73'15648)", 2024-09-17T02:22:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.323831+0000", 2024-09-17T02:22:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.7396766399999999, 2024-09-17T02:22:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042577492000000002, 2024-09-17T02:22:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323831+0000", 2024-09-17T02:22:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323831+0000", 2024-09-17T02:22:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323831+0000", 2024-09-17T02:22:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4199999999999996e-07 2024-09-17T02:22:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323839+0000", 2024-09-17T02:22:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8380000000000002e-06 2024-09-17T02:22:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359009+0000", 2024-09-17T02:22:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035169733000000002 2024-09-17T02:22:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359022+0000", 2024-09-17T02:22:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3801000000000001e-05 2024-09-17T02:22:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359086+0000", 2024-09-17T02:22:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3559000000000006e-05 2024-09-17T02:22:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359105+0000", 2024-09-17T02:22:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8865999999999999e-05 2024-09-17T02:22:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.366372+0000", 2024-09-17T02:22:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.007266827 2024-09-17T02:22:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:34.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.366408+0000", 2024-09-17T02:22:34.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6325999999999997e-05 2024-09-17T02:22:34.184 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.184 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:34.184 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.184 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:34.184 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:34.184 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:34.185 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T02:22:34.186 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:34.187+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:34.186 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:34.287 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:34.287+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:34.316 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:34.316 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:22:34.316 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-17T02:22:34.316 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:34.328 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:34.345 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:22:34.345 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:22:34.366 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:22:34.366 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:22:34.366 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:22:34.369 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:22:34.370 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:22:34.387 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:34.386+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:34.453 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:34.453 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:34.469 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:34.510 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:34.510+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:34.589 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:34.591+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:34.635 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:34.635 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:34.649 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:34.689 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:34.690+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:34.776 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:34.776 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:34.789 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:34.790 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:34.791+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:34.892 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:34.890+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:34.904 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:34.904 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:34.917 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:34.992 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:34.991+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:35.032 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:35.032 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:35.046 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:35.094 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:35.094+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:35.180 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:35.180 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:35.194 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:35.195 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:35.195+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:35.296 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:35.299+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:35.362 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:35.362 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:35.376 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:35.397 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:35.399+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:35.498 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:35.499+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:35.499 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:35.499 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:35.502 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T02:22:35.511 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:35.599 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:35.599+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:35.639 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:35.640 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:35.653 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:35.741 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:35.743+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:35.802 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:35.802+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:35.811 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:35.812 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:35.825 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:35.917 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:35.919+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:35.993 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:35.994 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:36.003 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:36.003+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:36.009 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:36.104 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:36.107+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:36.139 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:36.139 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:36.154 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:36.204 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:36.202+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:36.271 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:36.272 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:36.285 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:36.305 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:36.307+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:36.371 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T02:22:36.406 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:36.407+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:36.456 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-17T02:22:36.457 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T02:22:36.470 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:36.507 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:36.506+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:36.526 INFO:teuthology.orchestra.run.smithi001.stderr:noscrub is unset 2024-09-17T02:22:36.539 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0: {} 2024-09-17T02:22:36.539 INFO:teuthology.orchestra.run.smithi001.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T02:22:36.563 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1: {} 2024-09-17T02:22:36.563 INFO:teuthology.orchestra.run.smithi001.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T02:22:36.563 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T02:22:36.566 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T02:22:36.566 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T02:22:36.605 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:36.605 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:22:36.605 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-17T02:22:36.605 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:36.607 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:36.607+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:36.619 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:36.709 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:36.711+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:36.726 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-09-17T02:22:36.727 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-09-17T02:22:36.781 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:36.782 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:22:36.782 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:22:36.782 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:22:36.782 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:36.797 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:36.810 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:36.810+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:36.911 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:36.911+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:36.964 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:36.964 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:22:36.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:22:36.965 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:22:36.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.965 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:22:36.965 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:36.965 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 114.397896002, 2024-09-17T02:22:36.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:22:36.965 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:36.965 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:36.965 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:36.965 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:36.965 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:36.966 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:36.966 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:22:36.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.966 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:36.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:36.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:36.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:36.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:36.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:36.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:36.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:36.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:22:36.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:22:36.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:36.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:22:36.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:22:36.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:36.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:22:36.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:22:36.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:36.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:22:36.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:22:36.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:36.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:22:36.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:22:36.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:36.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:22:36.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:22:36.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:36.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:22:36.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:22:36.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:36.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:22:36.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:22:36.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:36.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:22:36.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:22:36.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:36.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:22:36.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:22:36.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:36.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:22:36.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:22:36.971 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:36.971 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:36.971 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:36.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.971 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97759 5.a 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:36.971 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:36.971 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 79.367973929000001, 2024-09-17T02:22:36.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.089694871999999995, 2024-09-17T02:22:36.971 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:36.971 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:36.972 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:36.972 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:36.972 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:36.972 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:36.972 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97759 2024-09-17T02:22:36.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.972 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:36.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:36.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:36.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:36.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:36.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:36.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:36.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:36.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598386+0000", 2024-09-17T02:22:36.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999999e-07 2024-09-17T02:22:36.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:36.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598414+0000", 2024-09-17T02:22:36.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8013000000000001e-05 2024-09-17T02:22:36.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:36.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598420+0000", 2024-09-17T02:22:36.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1149999999999999e-06 2024-09-17T02:22:36.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:36.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598424+0000", 2024-09-17T02:22:36.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:22:36.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:36.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598479+0000", 2024-09-17T02:22:36.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4648999999999998e-05 2024-09-17T02:22:36.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:36.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598587+0000", 2024-09-17T02:22:36.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010853000000000001 2024-09-17T02:22:36.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:36.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598676+0000", 2024-09-17T02:22:36.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8381999999999995e-05 2024-09-17T02:22:36.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:36.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603766+0000", 2024-09-17T02:22:36.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050902559999999996 2024-09-17T02:22:36.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:36.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.687988+0000", 2024-09-17T02:22:36.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.084221753999999996 2024-09-17T02:22:36.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:36.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688037+0000", 2024-09-17T02:22:36.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-05 2024-09-17T02:22:36.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:36.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688080+0000", 2024-09-17T02:22:36.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3149999999999999e-05 2024-09-17T02:22:36.977 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:36.977 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:36.977 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:36.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.977 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97770 5.0 5:09c75033:::benchmark_data_smithi001_23533_object97769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:36.977 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:36.977 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 79.362831498999995, 2024-09-17T02:22:36.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.086380868, 2024-09-17T02:22:36.977 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:36.977 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:36.977 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:36.978 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:36.978 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:36.978 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:36.978 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97770 2024-09-17T02:22:36.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.978 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:36.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:36.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:36.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:36.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:36.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:36.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:36.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:36.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603529+0000", 2024-09-17T02:22:36.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:22:36.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:36.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603593+0000", 2024-09-17T02:22:36.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4216999999999999e-05 2024-09-17T02:22:36.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:36.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603603+0000", 2024-09-17T02:22:36.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5179999999999993e-06 2024-09-17T02:22:36.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:36.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603608+0000", 2024-09-17T02:22:36.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2039999999999996e-06 2024-09-17T02:22:36.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:36.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603653+0000", 2024-09-17T02:22:36.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5247000000000002e-05 2024-09-17T02:22:36.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:36.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603758+0000", 2024-09-17T02:22:36.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105352 2024-09-17T02:22:36.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:36.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603900+0000", 2024-09-17T02:22:36.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014198999999999999 2024-09-17T02:22:36.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:36.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.606097+0000", 2024-09-17T02:22:36.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021969839999999999 2024-09-17T02:22:36.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:36.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689756+0000", 2024-09-17T02:22:36.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.083659077999999998 2024-09-17T02:22:36.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:36.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689846+0000", 2024-09-17T02:22:36.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9320999999999994e-05 2024-09-17T02:22:36.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:36.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689908+0000", 2024-09-17T02:22:36.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720999999999998e-05 2024-09-17T02:22:36.983 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:36.983 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:36.983 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:36.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.983 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127513 5.c 5:3eca08e4:::benchmark_data_smithi001_23533_object127512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:36.983 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:36.983 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 64.522055074999997, 2024-09-17T02:22:36.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046626399999999998, 2024-09-17T02:22:36.983 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:36.984 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:36.984 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:36.984 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:36.984 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:36.984 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:36.984 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127513 2024-09-17T02:22:36.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.984 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:36.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:36.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:36.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:36.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:36.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:36.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:36.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:36.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444305+0000", 2024-09-17T02:22:36.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2529999999999999e-06 2024-09-17T02:22:36.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:36.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444466+0000", 2024-09-17T02:22:36.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016069700000000001 2024-09-17T02:22:36.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:36.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444479+0000", 2024-09-17T02:22:36.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2602999999999999e-05 2024-09-17T02:22:36.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:36.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444485+0000", 2024-09-17T02:22:36.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.669e-06 2024-09-17T02:22:36.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:36.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444560+0000", 2024-09-17T02:22:36.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4276999999999994e-05 2024-09-17T02:22:36.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:36.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444656+0000", 2024-09-17T02:22:36.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6490000000000006e-05 2024-09-17T02:22:36.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:36.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444739+0000", 2024-09-17T02:22:36.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3139999999999993e-05 2024-09-17T02:22:36.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:36.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.448438+0000", 2024-09-17T02:22:36.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036985490000000002 2024-09-17T02:22:36.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:36.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490732+0000", 2024-09-17T02:22:36.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042294353999999999 2024-09-17T02:22:36.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:36.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490859+0000", 2024-09-17T02:22:36.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012708899999999999 2024-09-17T02:22:36.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:36.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490930+0000", 2024-09-17T02:22:36.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:36.989 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:36.989 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:36.989 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:36.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.989 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127514 5.c 5:39cc1feb:::benchmark_data_smithi001_23533_object127513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:36.991 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:36.991 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 64.521858305999999, 2024-09-17T02:22:36.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049357228000000003, 2024-09-17T02:22:36.992 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:36.992 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:36.992 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:36.992 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:36.992 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:36.992 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:36.992 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127514 2024-09-17T02:22:36.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.992 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:36.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:36.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:36.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:36.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:36.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:36.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:36.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:36.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:36.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8599999999999998e-07 2024-09-17T02:22:36.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:36.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444554+0000", 2024-09-17T02:22:36.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3047999999999998e-05 2024-09-17T02:22:36.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:36.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444562+0000", 2024-09-17T02:22:36.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5830000000000001e-06 2024-09-17T02:22:36.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:36.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444567+0000", 2024-09-17T02:22:36.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4179999999999996e-06 2024-09-17T02:22:36.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:36.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446566+0000", 2024-09-17T02:22:36.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001998788 2024-09-17T02:22:36.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:36.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446696+0000", 2024-09-17T02:22:36.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129393 2024-09-17T02:22:36.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:36.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446794+0000", 2024-09-17T02:22:36.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8462999999999996e-05 2024-09-17T02:22:36.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:36.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.449036+0000", 2024-09-17T02:22:36.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022415880000000001 2024-09-17T02:22:36.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:36.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493737+0000", 2024-09-17T02:22:36.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044701682 2024-09-17T02:22:36.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:36.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493808+0000", 2024-09-17T02:22:36.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0846000000000006e-05 2024-09-17T02:22:36.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:36.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493858+0000", 2024-09-17T02:22:36.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9932999999999998e-05 2024-09-17T02:22:36.997 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:36.997 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:36.997 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:36.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.998 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129441 5.1 5:84c3199f:::benchmark_data_smithi001_23533_object1324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:36.998 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:36.998 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 61.462847818, 2024-09-17T02:22:36.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034387011000000002, 2024-09-17T02:22:36.998 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:36.998 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:36.998 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:36.998 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:36.998 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:36.998 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:36.998 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129441 2024-09-17T02:22:36.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.998 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:36.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:36.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:36.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:36.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:36.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:36.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:36.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:36.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:36.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:36.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503513+0000", 2024-09-17T02:22:36.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4759999999999999e-06 2024-09-17T02:22:36.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:37.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503518+0000", 2024-09-17T02:22:37.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-09-17T02:22:37.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:37.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503532+0000", 2024-09-17T02:22:37.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4049999999999999e-05 2024-09-17T02:22:37.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503541+0000", 2024-09-17T02:22:37.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5320000000000006e-06 2024-09-17T02:22:37.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:37.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506331+0000", 2024-09-17T02:22:37.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027899190000000001 2024-09-17T02:22:37.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:37.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506402+0000", 2024-09-17T02:22:37.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:37.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:37.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506477+0000", 2024-09-17T02:22:37.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4626e-05 2024-09-17T02:22:37.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:37.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509749+0000", 2024-09-17T02:22:37.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032726980000000001 2024-09-17T02:22:37.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537758+0000", 2024-09-17T02:22:37.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028008890000000002 2024-09-17T02:22:37.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:37.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537812+0000", 2024-09-17T02:22:37.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3300000000000001e-05 2024-09-17T02:22:37.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:37.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537898+0000", 2024-09-17T02:22:37.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6691000000000001e-05 2024-09-17T02:22:37.003 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.003 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:37.003 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.004 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252853 5.8 5:10eae6ef:::benchmark_data_smithi001_23533_object124736:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:37.004 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.319189+0000", 2024-09-17T02:22:37.004 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6471698720000001, 2024-09-17T02:22:37.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042307663000000002, 2024-09-17T02:22:37.004 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:37.004 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:37.004 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.004 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:37.004 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:37.004 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:37.004 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252853 2024-09-17T02:22:37.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.004 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:37.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:37.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319189+0000", 2024-09-17T02:22:37.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:37.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319189+0000", 2024-09-17T02:22:37.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:37.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319190+0000", 2024-09-17T02:22:37.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4900000000000001e-07 2024-09-17T02:22:37.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:37.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319191+0000", 2024-09-17T02:22:37.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.714e-06 2024-09-17T02:22:37.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:37.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319197+0000", 2024-09-17T02:22:37.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7169999999999996e-06 2024-09-17T02:22:37.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319200+0000", 2024-09-17T02:22:37.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1389999999999999e-06 2024-09-17T02:22:37.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:37.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319233+0000", 2024-09-17T02:22:37.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2830000000000002e-05 2024-09-17T02:22:37.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:37.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319307+0000", 2024-09-17T02:22:37.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3794999999999994e-05 2024-09-17T02:22:37.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:37.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319401+0000", 2024-09-17T02:22:37.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4600999999999998e-05 2024-09-17T02:22:37.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:37.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321482+0000", 2024-09-17T02:22:37.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020808480000000002 2024-09-17T02:22:37.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361420+0000", 2024-09-17T02:22:37.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039937707000000003 2024-09-17T02:22:37.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:37.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361468+0000", 2024-09-17T02:22:37.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7722999999999997e-05 2024-09-17T02:22:37.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:37.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361497+0000", 2024-09-17T02:22:37.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9240000000000001e-05 2024-09-17T02:22:37.009 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.009 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:37.009 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.009 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252854 5.6 5:6f0fbabd:::benchmark_data_smithi001_23533_object124737:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:37.009 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.319209+0000", 2024-09-17T02:22:37.010 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6471503529999998, 2024-09-17T02:22:37.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041094994000000003, 2024-09-17T02:22:37.010 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:37.010 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:37.010 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.010 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:37.010 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:37.010 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:37.010 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252854 2024-09-17T02:22:37.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.010 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:37.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:37.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319209+0000", 2024-09-17T02:22:37.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:37.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319209+0000", 2024-09-17T02:22:37.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:37.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319209+0000", 2024-09-17T02:22:37.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9099999999999999e-07 2024-09-17T02:22:37.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:37.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319211+0000", 2024-09-17T02:22:37.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9520000000000001e-06 2024-09-17T02:22:37.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:37.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319218+0000", 2024-09-17T02:22:37.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3350000000000001e-06 2024-09-17T02:22:37.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319224+0000", 2024-09-17T02:22:37.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6849999999999998e-06 2024-09-17T02:22:37.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:37.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321118+0000", 2024-09-17T02:22:37.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018940070000000001 2024-09-17T02:22:37.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:37.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321185+0000", 2024-09-17T02:22:37.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6806999999999999e-05 2024-09-17T02:22:37.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:37.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.360143+0000", 2024-09-17T02:22:37.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038958333999999997 2024-09-17T02:22:37.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:37.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.360227+0000", 2024-09-17T02:22:37.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3732000000000004e-05 2024-09-17T02:22:37.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:37.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.360304+0000", 2024-09-17T02:22:37.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6750999999999998e-05 2024-09-17T02:22:37.014 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.014 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:37.014 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.014 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252859 5.2 5:4a025e38:::benchmark_data_smithi001_23533_object124742:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:37.015 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.319239+0000", 2024-09-17T02:22:37.015 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6471198430000005, 2024-09-17T02:22:37.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042922412, 2024-09-17T02:22:37.015 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:37.015 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:37.015 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.015 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:37.015 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:37.015 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:37.015 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252859 2024-09-17T02:22:37.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.015 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:37.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:37.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319239+0000", 2024-09-17T02:22:37.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:37.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319239+0000", 2024-09-17T02:22:37.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:37.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319240+0000", 2024-09-17T02:22:37.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7599999999999997e-07 2024-09-17T02:22:37.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:37.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319242+0000", 2024-09-17T02:22:37.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.294e-06 2024-09-17T02:22:37.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:37.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319248+0000", 2024-09-17T02:22:37.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.139e-06 2024-09-17T02:22:37.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319252+0000", 2024-09-17T02:22:37.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6389999999999998e-06 2024-09-17T02:22:37.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:37.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319312+0000", 2024-09-17T02:22:37.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9741000000000003e-05 2024-09-17T02:22:37.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:37.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319435+0000", 2024-09-17T02:22:37.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012350800000000001 2024-09-17T02:22:37.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:37.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.362015+0000", 2024-09-17T02:22:37.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042579662999999997 2024-09-17T02:22:37.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:37.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.362072+0000", 2024-09-17T02:22:37.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7453e-05 2024-09-17T02:22:37.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:37.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.362162+0000", 2024-09-17T02:22:37.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9399000000000002e-05 2024-09-17T02:22:37.019 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.019 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:37.019 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.020 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252860 5.0 5:00535124:::benchmark_data_smithi001_23533_object124743:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:37.020 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.319263+0000", 2024-09-17T02:22:37.020 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6470957369999999, 2024-09-17T02:22:37.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044660535000000001, 2024-09-17T02:22:37.020 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:37.020 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:37.020 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.020 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:37.020 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:37.020 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:37.020 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252860 2024-09-17T02:22:37.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.020 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:37.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:37.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319263+0000", 2024-09-17T02:22:37.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:37.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319263+0000", 2024-09-17T02:22:37.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:37.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319264+0000", 2024-09-17T02:22:37.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9999999999999998e-07 2024-09-17T02:22:37.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:37.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319265+0000", 2024-09-17T02:22:37.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5319999999999999e-06 2024-09-17T02:22:37.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:37.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319269+0000", 2024-09-17T02:22:37.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9419999999999997e-06 2024-09-17T02:22:37.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319272+0000", 2024-09-17T02:22:37.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1879999999999998e-06 2024-09-17T02:22:37.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:37.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319310+0000", 2024-09-17T02:22:37.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7509000000000003e-05 2024-09-17T02:22:37.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:37.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319433+0000", 2024-09-17T02:22:37.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012351500000000001 2024-09-17T02:22:37.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:37.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319544+0000", 2024-09-17T02:22:37.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111011 2024-09-17T02:22:37.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:37.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363800+0000", 2024-09-17T02:22:37.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044255456999999998 2024-09-17T02:22:37.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363837+0000", 2024-09-17T02:22:37.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.684e-05 2024-09-17T02:22:37.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:37.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363885+0000", 2024-09-17T02:22:37.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8324e-05 2024-09-17T02:22:37.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:37.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363924+0000", 2024-09-17T02:22:37.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8816999999999998e-05 2024-09-17T02:22:37.025 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.025 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:37.025 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.026 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252861 5.6 5:64c353c8:::benchmark_data_smithi001_23533_object124744:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:37.026 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.321550+0000", 2024-09-17T02:22:37.026 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6448090620000002, 2024-09-17T02:22:37.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039569213999999998, 2024-09-17T02:22:37.026 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:37.026 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:37.026 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.026 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:37.026 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:37.026 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:37.026 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252861 2024-09-17T02:22:37.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.026 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:37.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:37.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321550+0000", 2024-09-17T02:22:37.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:37.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321550+0000", 2024-09-17T02:22:37.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:37.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321551+0000", 2024-09-17T02:22:37.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1710000000000001e-06 2024-09-17T02:22:37.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:37.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321559+0000", 2024-09-17T02:22:37.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8399999999999995e-06 2024-09-17T02:22:37.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:37.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321569+0000", 2024-09-17T02:22:37.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9499999999999996e-06 2024-09-17T02:22:37.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321576+0000", 2024-09-17T02:22:37.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8979999999999999e-06 2024-09-17T02:22:37.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:37.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322921+0000", 2024-09-17T02:22:37.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001345026 2024-09-17T02:22:37.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:37.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323020+0000", 2024-09-17T02:22:37.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9505000000000004e-05 2024-09-17T02:22:37.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:37.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361001+0000", 2024-09-17T02:22:37.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037980216999999997 2024-09-17T02:22:37.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:37.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361039+0000", 2024-09-17T02:22:37.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8729999999999997e-05 2024-09-17T02:22:37.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:37.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361119+0000", 2024-09-17T02:22:37.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9876999999999994e-05 2024-09-17T02:22:37.030 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.030 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:37.031 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.031 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252862 5.0 5:027af5f9:::benchmark_data_smithi001_23533_object124745:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:37.031 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.321589+0000", 2024-09-17T02:22:37.031 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6447703010000003, 2024-09-17T02:22:37.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042469481000000003, 2024-09-17T02:22:37.031 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:37.031 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:37.031 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.031 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:37.031 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:37.031 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:37.032 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252862 2024-09-17T02:22:37.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.032 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:37.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:37.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321589+0000", 2024-09-17T02:22:37.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:37.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321589+0000", 2024-09-17T02:22:37.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:37.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321589+0000", 2024-09-17T02:22:37.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7999999999999996e-07 2024-09-17T02:22:37.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:37.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321591+0000", 2024-09-17T02:22:37.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.12e-06 2024-09-17T02:22:37.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:37.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321597+0000", 2024-09-17T02:22:37.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7880000000000003e-06 2024-09-17T02:22:37.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321602+0000", 2024-09-17T02:22:37.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6450000000000004e-06 2024-09-17T02:22:37.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:37.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321634+0000", 2024-09-17T02:22:37.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1959999999999999e-05 2024-09-17T02:22:37.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:37.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321736+0000", 2024-09-17T02:22:37.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101879 2024-09-17T02:22:37.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:37.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321856+0000", 2024-09-17T02:22:37.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120227 2024-09-17T02:22:37.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:37.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363941+0000", 2024-09-17T02:22:37.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042085514999999997 2024-09-17T02:22:37.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363978+0000", 2024-09-17T02:22:37.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7002000000000002e-05 2024-09-17T02:22:37.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:37.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.364023+0000", 2024-09-17T02:22:37.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4978999999999997e-05 2024-09-17T02:22:37.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:37.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.364058+0000", 2024-09-17T02:22:37.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4885999999999998e-05 2024-09-17T02:22:37.036 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.036 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:37.036 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.037 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252852 5.3 e73/64 5:c3aafdc8:::benchmark_data_smithi001_23533_object124735:head v 73'15929, mlcod=73'15927)", 2024-09-17T02:22:37.037 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.321622+0000", 2024-09-17T02:22:37.037 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6447368129999997, 2024-09-17T02:22:37.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037496129000000003, 2024-09-17T02:22:37.037 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:37.037 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:37.037 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.037 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:37.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:37.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321622+0000", 2024-09-17T02:22:37.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:37.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321622+0000", 2024-09-17T02:22:37.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:37.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321623+0000", 2024-09-17T02:22:37.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0900000000000001e-07 2024-09-17T02:22:37.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:37.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321631+0000", 2024-09-17T02:22:37.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6790000000000005e-06 2024-09-17T02:22:37.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:37.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321637+0000", 2024-09-17T02:22:37.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4500000000000001e-06 2024-09-17T02:22:37.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321642+0000", 2024-09-17T02:22:37.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7480000000000001e-06 2024-09-17T02:22:37.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:37.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321690+0000", 2024-09-17T02:22:37.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8541999999999997e-05 2024-09-17T02:22:37.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:37.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321705+0000", 2024-09-17T02:22:37.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.517e-05 2024-09-17T02:22:37.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:37.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359076+0000", 2024-09-17T02:22:37.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037370642000000003 2024-09-17T02:22:37.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:37.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359118+0000", 2024-09-17T02:22:37.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2289000000000001e-05 2024-09-17T02:22:37.041 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.041 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:37.041 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.041 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252856 5.1 e73/61 5:82c49704:::benchmark_data_smithi001_23533_object124739:head v 73'15774, mlcod=73'15772)", 2024-09-17T02:22:37.041 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.321652+0000", 2024-09-17T02:22:37.041 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6447071229999999, 2024-09-17T02:22:37.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037495563000000003, 2024-09-17T02:22:37.042 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:37.042 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:37.042 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.042 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:37.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:37.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321652+0000", 2024-09-17T02:22:37.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:37.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321652+0000", 2024-09-17T02:22:37.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:37.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321652+0000", 2024-09-17T02:22:37.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7700000000000001e-07 2024-09-17T02:22:37.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:37.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321655+0000", 2024-09-17T02:22:37.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6220000000000001e-06 2024-09-17T02:22:37.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:37.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321660+0000", 2024-09-17T02:22:37.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.967e-06 2024-09-17T02:22:37.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321664+0000", 2024-09-17T02:22:37.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8039999999999999e-06 2024-09-17T02:22:37.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:37.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321706+0000", 2024-09-17T02:22:37.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2138000000000002e-05 2024-09-17T02:22:37.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:37.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321726+0000", 2024-09-17T02:22:37.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0236000000000001e-05 2024-09-17T02:22:37.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:37.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359072+0000", 2024-09-17T02:22:37.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037346435999999997 2024-09-17T02:22:37.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:37.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359148+0000", 2024-09-17T02:22:37.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5082999999999999e-05 2024-09-17T02:22:37.045 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.046 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:37.046 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.046 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252857 5.3 e73/64 5:c255b9a8:::benchmark_data_smithi001_23533_object124740:head v 73'15930, mlcod=73'15927)", 2024-09-17T02:22:37.046 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.321676+0000", 2024-09-17T02:22:37.046 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6446833080000003, 2024-09-17T02:22:37.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044692651999999999, 2024-09-17T02:22:37.046 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:37.046 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:37.046 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.046 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:37.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:37.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321676+0000", 2024-09-17T02:22:37.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:37.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321676+0000", 2024-09-17T02:22:37.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:37.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321676+0000", 2024-09-17T02:22:37.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4299999999999999e-07 2024-09-17T02:22:37.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:37.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321683+0000", 2024-09-17T02:22:37.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.652e-06 2024-09-17T02:22:37.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:37.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321689+0000", 2024-09-17T02:22:37.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9340000000000003e-06 2024-09-17T02:22:37.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321693+0000", 2024-09-17T02:22:37.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3309999999999997e-06 2024-09-17T02:22:37.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:37.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323151+0000", 2024-09-17T02:22:37.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014580260000000001 2024-09-17T02:22:37.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:37.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323170+0000", 2024-09-17T02:22:37.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8998999999999999e-05 2024-09-17T02:22:37.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:37.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.366320+0000", 2024-09-17T02:22:37.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.043150177999999997 2024-09-17T02:22:37.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:37.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.366368+0000", 2024-09-17T02:22:37.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8288999999999998e-05 2024-09-17T02:22:37.050 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.050 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:37.050 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.050 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252866 5.0 5:0b646666:::benchmark_data_smithi001_23533_object124749:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:37.050 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.322387+0000", 2024-09-17T02:22:37.050 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6439718379999997, 2024-09-17T02:22:37.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041814680999999999, 2024-09-17T02:22:37.050 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:37.051 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:37.051 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.051 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:37.051 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:37.051 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:37.051 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252866 2024-09-17T02:22:37.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.051 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:37.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:37.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322387+0000", 2024-09-17T02:22:37.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:37.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322387+0000", 2024-09-17T02:22:37.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:37.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322388+0000", 2024-09-17T02:22:37.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6300000000000004e-07 2024-09-17T02:22:37.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:37.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322392+0000", 2024-09-17T02:22:37.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-06 2024-09-17T02:22:37.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:37.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322402+0000", 2024-09-17T02:22:37.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0165e-05 2024-09-17T02:22:37.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322409+0000", 2024-09-17T02:22:37.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5180000000000001e-06 2024-09-17T02:22:37.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:37.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323635+0000", 2024-09-17T02:22:37.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001226296 2024-09-17T02:22:37.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:37.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323738+0000", 2024-09-17T02:22:37.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103491 2024-09-17T02:22:37.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:37.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359170+0000", 2024-09-17T02:22:37.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035431547000000001 2024-09-17T02:22:37.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:37.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363946+0000", 2024-09-17T02:22:37.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047759090000000001 2024-09-17T02:22:37.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.364118+0000", 2024-09-17T02:22:37.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017171600000000001 2024-09-17T02:22:37.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:37.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.364163+0000", 2024-09-17T02:22:37.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5176000000000003e-05 2024-09-17T02:22:37.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:37.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.364202+0000", 2024-09-17T02:22:37.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9103000000000002e-05 2024-09-17T02:22:37.056 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.056 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:37.056 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.056 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252864 5.e e73/22 5:79949647:::benchmark_data_smithi001_23533_object124747:head v 73'15818, mlcod=73'15816)", 2024-09-17T02:22:37.056 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.322434+0000", 2024-09-17T02:22:37.056 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6439254669999999, 2024-09-17T02:22:37.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038558940999999999, 2024-09-17T02:22:37.056 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:37.056 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:37.056 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.056 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:37.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:37.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322434+0000", 2024-09-17T02:22:37.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:37.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322434+0000", 2024-09-17T02:22:37.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:37.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322434+0000", 2024-09-17T02:22:37.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0499999999999999e-07 2024-09-17T02:22:37.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:37.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322441+0000", 2024-09-17T02:22:37.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.545e-06 2024-09-17T02:22:37.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:37.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322447+0000", 2024-09-17T02:22:37.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6089999999999997e-06 2024-09-17T02:22:37.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322452+0000", 2024-09-17T02:22:37.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4549999999999997e-06 2024-09-17T02:22:37.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:37.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322786+0000", 2024-09-17T02:22:37.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033476699999999997 2024-09-17T02:22:37.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:37.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322806+0000", 2024-09-17T02:22:37.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0013e-05 2024-09-17T02:22:37.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:37.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.360954+0000", 2024-09-17T02:22:37.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038147984000000003 2024-09-17T02:22:37.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:37.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.360993+0000", 2024-09-17T02:22:37.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8163e-05 2024-09-17T02:22:37.060 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.060 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:37.060 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.061 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252867 5.0 5:098def42:::benchmark_data_smithi001_23533_object124750:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:37.061 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.323296+0000", 2024-09-17T02:22:37.061 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6430632940000001, 2024-09-17T02:22:37.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046048453000000003, 2024-09-17T02:22:37.061 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:37.061 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:37.061 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.061 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:37.061 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:37.061 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:37.061 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252867 2024-09-17T02:22:37.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.062 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:37.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:37.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323296+0000", 2024-09-17T02:22:37.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:37.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323296+0000", 2024-09-17T02:22:37.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:37.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323297+0000", 2024-09-17T02:22:37.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.06e-07 2024-09-17T02:22:37.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:37.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323300+0000", 2024-09-17T02:22:37.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5140000000000002e-06 2024-09-17T02:22:37.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:37.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323307+0000", 2024-09-17T02:22:37.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4039999999999998e-06 2024-09-17T02:22:37.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323312+0000", 2024-09-17T02:22:37.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8420000000000004e-06 2024-09-17T02:22:37.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:37.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361424+0000", 2024-09-17T02:22:37.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038111313000000001 2024-09-17T02:22:37.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:37.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361547+0000", 2024-09-17T02:22:37.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000123621 2024-09-17T02:22:37.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:37.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361676+0000", 2024-09-17T02:22:37.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129016 2024-09-17T02:22:37.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.366632+0000", 2024-09-17T02:22:37.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049562149999999999 2024-09-17T02:22:37.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:37.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.369184+0000", 2024-09-17T02:22:37.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025512960000000002 2024-09-17T02:22:37.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:37.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.369270+0000", 2024-09-17T02:22:37.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5873999999999998e-05 2024-09-17T02:22:37.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:37.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.369344+0000", 2024-09-17T02:22:37.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4652000000000003e-05 2024-09-17T02:22:37.066 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.066 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:37.066 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.067 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252865 5.1 e73/61 5:81978d99:::benchmark_data_smithi001_23533_object124748:head v 73'15775, mlcod=73'15772)", 2024-09-17T02:22:37.067 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.323335+0000", 2024-09-17T02:22:37.067 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.643024295, 2024-09-17T02:22:37.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037706556000000002, 2024-09-17T02:22:37.067 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:37.067 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:37.067 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.067 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:37.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:37.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323335+0000", 2024-09-17T02:22:37.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:37.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323335+0000", 2024-09-17T02:22:37.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:37.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323335+0000", 2024-09-17T02:22:37.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1399999999999998e-07 2024-09-17T02:22:37.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:37.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323338+0000", 2024-09-17T02:22:37.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3419999999999999e-06 2024-09-17T02:22:37.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:37.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323352+0000", 2024-09-17T02:22:37.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3771000000000001e-05 2024-09-17T02:22:37.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323356+0000", 2024-09-17T02:22:37.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6600000000000001e-06 2024-09-17T02:22:37.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:37.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323403+0000", 2024-09-17T02:22:37.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7290000000000003e-05 2024-09-17T02:22:37.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:37.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323419+0000", 2024-09-17T02:22:37.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5434000000000002e-05 2024-09-17T02:22:37.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:37.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.360952+0000", 2024-09-17T02:22:37.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037533314999999998 2024-09-17T02:22:37.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:37.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361041+0000", 2024-09-17T02:22:37.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9430000000000003e-05 2024-09-17T02:22:37.071 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.071 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:37.071 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.071 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252868 5.b e73/51 5:d27fb132:::benchmark_data_smithi001_23533_object124751:head v 73'15650, mlcod=73'15648)", 2024-09-17T02:22:37.071 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.323831+0000", 2024-09-17T02:22:37.071 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.642528564, 2024-09-17T02:22:37.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042577492000000002, 2024-09-17T02:22:37.072 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:37.072 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:37.072 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.072 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:37.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:37.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323831+0000", 2024-09-17T02:22:37.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:37.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323831+0000", 2024-09-17T02:22:37.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:37.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:37.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323831+0000", 2024-09-17T02:22:37.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4199999999999996e-07 2024-09-17T02:22:37.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:37.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323839+0000", 2024-09-17T02:22:37.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8380000000000002e-06 2024-09-17T02:22:37.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:37.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359009+0000", 2024-09-17T02:22:37.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035169733000000002 2024-09-17T02:22:37.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359022+0000", 2024-09-17T02:22:37.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3801000000000001e-05 2024-09-17T02:22:37.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:37.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359086+0000", 2024-09-17T02:22:37.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3559000000000006e-05 2024-09-17T02:22:37.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:37.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359105+0000", 2024-09-17T02:22:37.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8865999999999999e-05 2024-09-17T02:22:37.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:37.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.366372+0000", 2024-09-17T02:22:37.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.007266827 2024-09-17T02:22:37.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:37.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:37.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:37.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.366408+0000", 2024-09-17T02:22:37.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6325999999999997e-05 2024-09-17T02:22:37.075 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.075 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:37.075 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.076 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:37.076 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:37.076 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:37.077 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T02:22:37.079+0000 7fd486b91640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22912) UID: 0 2024-09-17T02:22:37.078 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T02:22:37.179 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:37.178+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:37.214 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:37.214 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:22:37.214 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-17T02:22:37.214 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:37.230 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T02:22:37.318 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:37.318+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:37.379 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:37.378+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:37.398 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:37.399 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-17T02:22:37.399 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-17T02:22:37.399 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-17T02:22:37.399 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:37.414 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T02:22:37.455 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'unique_pool_0' removed 2024-09-17T02:22:37.482 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-17T02:22:37.492 INFO:tasks.thrashosds:joining thrashosds 2024-09-17T02:22:37.510 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-17T02:22:37.510+0000 7f252013a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22818) UID: 0 2024-09-17T02:22:37.633 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-17T02:22:37.633 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-17T02:22:37.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-17T02:22:37.633 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-17T02:22:37.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.634 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97749 5.b 5:d930ef52:::benchmark_data_smithi001_23533_object97748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:37.634 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:37.634 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 80.041732666000001, 2024-09-17T02:22:37.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092964343000000005, 2024-09-17T02:22:37.634 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:37.634 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:37.634 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.634 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:37.635 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:37.635 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:37.635 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97749 2024-09-17T02:22:37.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.635 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:37.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:37.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:37.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:37.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591946+0000", 2024-09-17T02:22:37.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:37.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.591947+0000", 2024-09-17T02:22:37.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-17T02:22:37.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:37.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592011+0000", 2024-09-17T02:22:37.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3608000000000005e-05 2024-09-17T02:22:37.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:37.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592021+0000", 2024-09-17T02:22:37.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9979999999999998e-06 2024-09-17T02:22:37.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.592028+0000", 2024-09-17T02:22:37.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1439999999999997e-06 2024-09-17T02:22:37.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593633+0000", 2024-09-17T02:22:37.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001604636 2024-09-17T02:22:37.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:37.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593757+0000", 2024-09-17T02:22:37.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012432099999999999 2024-09-17T02:22:37.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:37.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593866+0000", 2024-09-17T02:22:37.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109094 2024-09-17T02:22:37.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:37.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601190+0000", 2024-09-17T02:22:37.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073237620000000002 2024-09-17T02:22:37.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601356+0000", 2024-09-17T02:22:37.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016651900000000001 2024-09-17T02:22:37.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684618+0000", 2024-09-17T02:22:37.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083261356999999994 2024-09-17T02:22:37.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:37.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684724+0000", 2024-09-17T02:22:37.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010681800000000001 2024-09-17T02:22:37.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:37.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684911+0000", 2024-09-17T02:22:37.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186243 2024-09-17T02:22:37.640 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.641 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:37.641 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.641 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97752 5.b 5:d146f486:::benchmark_data_smithi001_23533_object97751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:37.641 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:37.641 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 80.040379971999997, 2024-09-17T02:22:37.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.091989557, 2024-09-17T02:22:37.641 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:37.641 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:37.641 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.641 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:37.641 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:37.642 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:37.642 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97752 2024-09-17T02:22:37.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.642 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:37.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:37.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:37.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:37.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593299+0000", 2024-09-17T02:22:37.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:37.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593300+0000", 2024-09-17T02:22:37.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8199999999999998e-07 2024-09-17T02:22:37.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:37.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593364+0000", 2024-09-17T02:22:37.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3831999999999995e-05 2024-09-17T02:22:37.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:37.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593376+0000", 2024-09-17T02:22:37.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1800999999999999e-05 2024-09-17T02:22:37.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.593382+0000", 2024-09-17T02:22:37.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6780000000000003e-06 2024-09-17T02:22:37.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595491+0000", 2024-09-17T02:22:37.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021090689999999999 2024-09-17T02:22:37.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:37.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595614+0000", 2024-09-17T02:22:37.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012321500000000001 2024-09-17T02:22:37.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:37.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595778+0000", 2024-09-17T02:22:37.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016321900000000001 2024-09-17T02:22:37.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:37.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601197+0000", 2024-09-17T02:22:37.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054195600000000003 2024-09-17T02:22:37.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.601396+0000", 2024-09-17T02:22:37.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019825299999999999 2024-09-17T02:22:37.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684990+0000", 2024-09-17T02:22:37.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.083594878999999997 2024-09-17T02:22:37.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:37.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685116+0000", 2024-09-17T02:22:37.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012522799999999999 2024-09-17T02:22:37.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:37.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685289+0000", 2024-09-17T02:22:37.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172941 2024-09-17T02:22:37.651 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.651 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:37.651 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.651 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97754 5.b 5:da0615e5:::benchmark_data_smithi001_23533_object97753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:37.652 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:37.652 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 80.038742049999996, 2024-09-17T02:22:37.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092097207, 2024-09-17T02:22:37.652 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:37.652 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:37.652 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.653 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:37.653 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:37.653 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:37.653 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97754 2024-09-17T02:22:37.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.654 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:37.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:37.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:37.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:37.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594937+0000", 2024-09-17T02:22:37.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:37.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.594938+0000", 2024-09-17T02:22:37.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5000000000000002e-07 2024-09-17T02:22:37.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:37.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595075+0000", 2024-09-17T02:22:37.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137742 2024-09-17T02:22:37.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:37.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595087+0000", 2024-09-17T02:22:37.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1243000000000001e-05 2024-09-17T02:22:37.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595095+0000", 2024-09-17T02:22:37.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1030000000000002e-06 2024-09-17T02:22:37.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598461+0000", 2024-09-17T02:22:37.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033661170000000001 2024-09-17T02:22:37.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:37.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598540+0000", 2024-09-17T02:22:37.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8937999999999995e-05 2024-09-17T02:22:37.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:37.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.598626+0000", 2024-09-17T02:22:37.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6042000000000001e-05 2024-09-17T02:22:37.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:37.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.684258+0000", 2024-09-17T02:22:37.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085632394000000001 2024-09-17T02:22:37.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685369+0000", 2024-09-17T02:22:37.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001111063 2024-09-17T02:22:37.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685511+0000", 2024-09-17T02:22:37.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141965 2024-09-17T02:22:37.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:37.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685604+0000", 2024-09-17T02:22:37.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2935000000000004e-05 2024-09-17T02:22:37.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:37.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687034+0000", 2024-09-17T02:22:37.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001430015 2024-09-17T02:22:37.666 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.666 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:37.666 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.667 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:97755 5.b 5:d36a03a1:::benchmark_data_smithi001_23533_object97754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:37.667 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:37.667 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 80.038568900000001, 2024-09-17T02:22:37.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0924904, 2024-09-17T02:22:37.668 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:37.668 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:37.668 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.668 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:37.668 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:37.669 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:37.669 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97755 2024-09-17T02:22:37.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.669 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:37.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:37.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:37.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:37.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595110+0000", 2024-09-17T02:22:37.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:37.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595111+0000", 2024-09-17T02:22:37.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6899999999999997e-07 2024-09-17T02:22:37.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:37.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595145+0000", 2024-09-17T02:22:37.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3927000000000002e-05 2024-09-17T02:22:37.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:37.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595155+0000", 2024-09-17T02:22:37.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0023e-05 2024-09-17T02:22:37.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.595162+0000", 2024-09-17T02:22:37.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3950000000000003e-06 2024-09-17T02:22:37.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599821+0000", 2024-09-17T02:22:37.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046592880000000001 2024-09-17T02:22:37.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:37.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.599912+0000", 2024-09-17T02:22:37.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1049000000000002e-05 2024-09-17T02:22:37.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1,2", 2024-09-17T02:22:37.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.600062+0000", 2024-09-17T02:22:37.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015001700000000001 2024-09-17T02:22:37.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:37.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685307+0000", 2024-09-17T02:22:37.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.085244340000000002 2024-09-17T02:22:37.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.685446+0000", 2024-09-17T02:22:37.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013955700000000001 2024-09-17T02:22:37.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687375+0000", 2024-09-17T02:22:37.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019291079999999999 2024-09-17T02:22:37.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:37.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687462+0000", 2024-09-17T02:22:37.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6148000000000003e-05 2024-09-17T02:22:37.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:37.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.687600+0000", 2024-09-17T02:22:37.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013887900000000001 2024-09-17T02:22:37.681 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.681 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:37.681 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.681 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_backfill(progress 5.3 e 44/44 lb 5:c4567a04:::benchmark_data_smithi001_23533_object4200:head)", 2024-09-17T02:22:37.681 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:37.682 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 80.036472274000005, 2024-09-17T02:22:37.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092483421999999996, 2024-09-17T02:22:37.682 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:37.682 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:37.682 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-17T02:22:37.682 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:37.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:37.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:37.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:37.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:37.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:37.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597207+0000", 2024-09-17T02:22:37.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6399999999999998e-07 2024-09-17T02:22:37.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:37.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597213+0000", 2024-09-17T02:22:37.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3659999999999997e-06 2024-09-17T02:22:37.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:37.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597222+0000", 2024-09-17T02:22:37.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0510000000000002e-06 2024-09-17T02:22:37.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.597228+0000", 2024-09-17T02:22:37.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1569999999999999e-06 2024-09-17T02:22:37.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689588+0000", 2024-09-17T02:22:37.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092359931000000006 2024-09-17T02:22:37.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:37.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689622+0000", 2024-09-17T02:22:37.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4425999999999999e-05 2024-09-17T02:22:37.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:37.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:17.689690+0000", 2024-09-17T02:22:37.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8126999999999993e-05 2024-09-17T02:22:37.687 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.687 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:37.687 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.687 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129462 5.4 5:2e0acc16:::benchmark_data_smithi001_23533_object1345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:37.687 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:37.687 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.098738204999997, 2024-09-17T02:22:37.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0112774899999999, 2024-09-17T02:22:37.687 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:37.687 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:37.688 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.688 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:37.688 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:37.688 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:37.688 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129462 2024-09-17T02:22:37.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.688 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:37.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:37.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:37.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:37.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534941+0000", 2024-09-17T02:22:37.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:37.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534943+0000", 2024-09-17T02:22:37.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8759999999999999e-06 2024-09-17T02:22:37.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:37.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534951+0000", 2024-09-17T02:22:37.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3219999999999993e-06 2024-09-17T02:22:37.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:37.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534977+0000", 2024-09-17T02:22:37.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6245e-05 2024-09-17T02:22:37.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.534992+0000", 2024-09-17T02:22:37.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4936000000000001e-05 2024-09-17T02:22:37.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535133+0000", 2024-09-17T02:22:37.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014051299999999999 2024-09-17T02:22:37.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:37.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.535154+0000", 2024-09-17T02:22:37.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1741000000000001e-05 2024-09-17T02:22:37.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.533906+0000", 2024-09-17T02:22:37.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99875209300000001 2024-09-17T02:22:37.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:37.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534348+0000", 2024-09-17T02:22:37.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044128899999999998 2024-09-17T02:22:37.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:37.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.534762+0000", 2024-09-17T02:22:37.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000414707 2024-09-17T02:22:37.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:37.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545024+0000", 2024-09-17T02:22:37.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010261283 2024-09-17T02:22:37.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545953+0000", 2024-09-17T02:22:37.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000929618 2024-09-17T02:22:37.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:37.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546047+0000", 2024-09-17T02:22:37.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3697999999999996e-05 2024-09-17T02:22:37.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:37.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546218+0000", 2024-09-17T02:22:37.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017116899999999999 2024-09-17T02:22:37.694 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.694 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:37.694 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.694 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129480 5.4 5:2b1d398b:::benchmark_data_smithi001_23533_object1363:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:37.694 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:37.694 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.090983739000002, 2024-09-17T02:22:37.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0038926450000001, 2024-09-17T02:22:37.695 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:37.695 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:37.695 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.695 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:37.695 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:37.695 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:37.695 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129480 2024-09-17T02:22:37.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.695 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:37.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:37.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:37.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:37.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542695+0000", 2024-09-17T02:22:37.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:37.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542696+0000", 2024-09-17T02:22:37.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9999999999999995e-07 2024-09-17T02:22:37.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:37.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542701+0000", 2024-09-17T02:22:37.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2240000000000003e-06 2024-09-17T02:22:37.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:37.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542716+0000", 2024-09-17T02:22:37.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4970000000000001e-05 2024-09-17T02:22:37.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542726+0000", 2024-09-17T02:22:37.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2879999999999998e-06 2024-09-17T02:22:37.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542832+0000", 2024-09-17T02:22:37.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010597199999999999 2024-09-17T02:22:37.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:37.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.542843+0000", 2024-09-17T02:22:37.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.098e-05 2024-09-17T02:22:37.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538436+0000", 2024-09-17T02:22:37.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99559286800000002 2024-09-17T02:22:37.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:37.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.538791+0000", 2024-09-17T02:22:37.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035585499999999997 2024-09-17T02:22:37.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:37.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.539144+0000", 2024-09-17T02:22:37.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035268499999999999 2024-09-17T02:22:37.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:37.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.545880+0000", 2024-09-17T02:22:37.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00673552 2024-09-17T02:22:37.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546330+0000", 2024-09-17T02:22:37.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045039599999999999 2024-09-17T02:22:37.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:37.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546414+0000", 2024-09-17T02:22:37.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4468000000000005e-05 2024-09-17T02:22:37.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:37.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.546588+0000", 2024-09-17T02:22:37.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017341899999999999 2024-09-17T02:22:37.701 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.701 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:37.701 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.701 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129505 5.4 5:294f2ec7:::benchmark_data_smithi001_23533_object1388:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:37.701 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:37.701 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.071970565999997, 2024-09-17T02:22:37.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98589826199999997, 2024-09-17T02:22:37.701 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:37.702 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:37.702 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.702 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:37.702 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:37.702 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:37.702 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129505 2024-09-17T02:22:37.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.702 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:37.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:37.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:37.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:37.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561708+0000", 2024-09-17T02:22:37.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:37.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561710+0000", 2024-09-17T02:22:37.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7060000000000001e-06 2024-09-17T02:22:37.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:37.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561718+0000", 2024-09-17T02:22:37.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.542e-06 2024-09-17T02:22:37.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:37.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561741+0000", 2024-09-17T02:22:37.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3357e-05 2024-09-17T02:22:37.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561754+0000", 2024-09-17T02:22:37.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3200000000000001e-05 2024-09-17T02:22:37.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561867+0000", 2024-09-17T02:22:37.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113211 2024-09-17T02:22:37.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:37.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.561888+0000", 2024-09-17T02:22:37.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0809999999999999e-05 2024-09-17T02:22:37.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542140+0000", 2024-09-17T02:22:37.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98025195799999998 2024-09-17T02:22:37.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:37.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542331+0000", 2024-09-17T02:22:37.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019127599999999999 2024-09-17T02:22:37.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:37.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.542517+0000", 2024-09-17T02:22:37.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000185625 2024-09-17T02:22:37.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547114+0000", 2024-09-17T02:22:37.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045968620000000002 2024-09-17T02:22:37.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:37.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547187+0000", 2024-09-17T02:22:37.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3348000000000003e-05 2024-09-17T02:22:37.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:37.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547324+0000", 2024-09-17T02:22:37.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013681699999999999 2024-09-17T02:22:37.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:37.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547607+0000", 2024-09-17T02:22:37.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028255000000000001 2024-09-17T02:22:37.708 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.708 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:37.708 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.709 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129508 5.4 5:2892b582:::benchmark_data_smithi001_23533_object1391:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:37.709 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:37.709 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.070633473000001, 2024-09-17T02:22:37.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99697919099999999, 2024-09-17T02:22:37.709 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:37.709 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:37.709 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.709 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:37.709 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:37.709 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:37.709 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129508 2024-09-17T02:22:37.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.709 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:37.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:37.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:37.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:37.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563045+0000", 2024-09-17T02:22:37.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:37.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563047+0000", 2024-09-17T02:22:37.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.274e-06 2024-09-17T02:22:37.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:37.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563054+0000", 2024-09-17T02:22:37.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2799999999999998e-06 2024-09-17T02:22:37.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:37.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563070+0000", 2024-09-17T02:22:37.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5991999999999999e-05 2024-09-17T02:22:37.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563078+0000", 2024-09-17T02:22:37.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2390000000000002e-06 2024-09-17T02:22:37.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563181+0000", 2024-09-17T02:22:37.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102249 2024-09-17T02:22:37.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:37.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563199+0000", 2024-09-17T02:22:37.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8215000000000001e-05 2024-09-17T02:22:37.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.547713+0000", 2024-09-17T02:22:37.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98451446399999998 2024-09-17T02:22:37.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:37.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548063+0000", 2024-09-17T02:22:37.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034985499999999999 2024-09-17T02:22:37.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:37.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.548490+0000", 2024-09-17T02:22:37.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042658600000000001 2024-09-17T02:22:37.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555655+0000", 2024-09-17T02:22:37.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071652579999999999 2024-09-17T02:22:37.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:37.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559612+0000", 2024-09-17T02:22:37.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003957103 2024-09-17T02:22:37.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:37.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.559768+0000", 2024-09-17T02:22:37.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015556899999999999 2024-09-17T02:22:37.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:37.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560025+0000", 2024-09-17T02:22:37.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025710700000000002 2024-09-17T02:22:37.715 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.715 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:37.715 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.716 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129509 5.4 5:2c35515e:::benchmark_data_smithi001_23533_object1392:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:37.716 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:37.716 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.070006419999999, 2024-09-17T02:22:37.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99969384900000002, 2024-09-17T02:22:37.716 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:37.716 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:37.716 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.716 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:37.716 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:37.716 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:37.716 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129509 2024-09-17T02:22:37.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.717 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:37.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:37.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:37.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:37.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563673+0000", 2024-09-17T02:22:37.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:37.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563674+0000", 2024-09-17T02:22:37.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0920000000000001e-06 2024-09-17T02:22:37.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:37.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563679+0000", 2024-09-17T02:22:37.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7660000000000004e-06 2024-09-17T02:22:37.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:37.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563693+0000", 2024-09-17T02:22:37.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3139000000000001e-05 2024-09-17T02:22:37.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563701+0000", 2024-09-17T02:22:37.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9859999999999994e-06 2024-09-17T02:22:37.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563775+0000", 2024-09-17T02:22:37.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4659000000000005e-05 2024-09-17T02:22:37.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:37.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.563785+0000", 2024-09-17T02:22:37.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4839999999999993e-06 2024-09-17T02:22:37.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552085+0000", 2024-09-17T02:22:37.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98829986999999997 2024-09-17T02:22:37.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:37.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552554+0000", 2024-09-17T02:22:37.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046908900000000001 2024-09-17T02:22:37.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:37.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.552931+0000", 2024-09-17T02:22:37.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377778 2024-09-17T02:22:37.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563106+0000", 2024-09-17T02:22:37.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010174186 2024-09-17T02:22:37.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:37.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563138+0000", 2024-09-17T02:22:37.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2495e-05 2024-09-17T02:22:37.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:37.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563225+0000", 2024-09-17T02:22:37.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6677999999999999e-05 2024-09-17T02:22:37.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:37.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563366+0000", 2024-09-17T02:22:37.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014162699999999999 2024-09-17T02:22:37.722 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.723 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:37.723 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.723 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129524 5.4 5:25dca7dd:::benchmark_data_smithi001_23533_object1407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:37.723 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:37.723 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.063315066000001, 2024-09-17T02:22:37.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99999501999999996, 2024-09-17T02:22:37.723 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:37.723 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:37.723 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.723 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:37.723 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:37.723 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:37.724 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129524 2024-09-17T02:22:37.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.724 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:37.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:37.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:37.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:37.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570364+0000", 2024-09-17T02:22:37.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:37.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570365+0000", 2024-09-17T02:22:37.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.142e-06 2024-09-17T02:22:37.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:37.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570369+0000", 2024-09-17T02:22:37.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.856e-06 2024-09-17T02:22:37.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:37.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570385+0000", 2024-09-17T02:22:37.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5855e-05 2024-09-17T02:22:37.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570392+0000", 2024-09-17T02:22:37.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5340000000000002e-06 2024-09-17T02:22:37.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570484+0000", 2024-09-17T02:22:37.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1212999999999996e-05 2024-09-17T02:22:37.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:37.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.570498+0000", 2024-09-17T02:22:37.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4331000000000001e-05 2024-09-17T02:22:37.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.555835+0000", 2024-09-17T02:22:37.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98533757700000002 2024-09-17T02:22:37.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:37.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556329+0000", 2024-09-17T02:22:37.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000493458 2024-09-17T02:22:37.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:37.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.556784+0000", 2024-09-17T02:22:37.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045476499999999999 2024-09-17T02:22:37.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569852+0000", 2024-09-17T02:22:37.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013068270999999999 2024-09-17T02:22:37.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:37.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.569958+0000", 2024-09-17T02:22:37.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106214 2024-09-17T02:22:37.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:37.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570124+0000", 2024-09-17T02:22:37.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165546 2024-09-17T02:22:37.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:37.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570359+0000", 2024-09-17T02:22:37.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023525799999999999 2024-09-17T02:22:37.730 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.730 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:37.730 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.731 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129537 5.4 5:260327c6:::benchmark_data_smithi001_23533_object1420:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:37.731 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:37.731 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.055408536999998, 2024-09-17T02:22:37.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99624596499999996, 2024-09-17T02:22:37.731 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:37.731 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:37.731 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.731 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:37.731 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:37.731 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:37.731 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129537 2024-09-17T02:22:37.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.732 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:37.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:37.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:37.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:37.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578270+0000", 2024-09-17T02:22:37.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:37.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578272+0000", 2024-09-17T02:22:37.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.164e-06 2024-09-17T02:22:37.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:37.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578278+0000", 2024-09-17T02:22:37.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5060000000000001e-06 2024-09-17T02:22:37.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:37.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578294+0000", 2024-09-17T02:22:37.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5687000000000001e-05 2024-09-17T02:22:37.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578329+0000", 2024-09-17T02:22:37.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5311999999999997e-05 2024-09-17T02:22:37.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578419+0000", 2024-09-17T02:22:37.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0054000000000002e-05 2024-09-17T02:22:37.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:37.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.578435+0000", 2024-09-17T02:22:37.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5645999999999999e-05 2024-09-17T02:22:37.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560148+0000", 2024-09-17T02:22:37.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98171342299999997 2024-09-17T02:22:37.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:37.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560383+0000", 2024-09-17T02:22:37.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000234935 2024-09-17T02:22:37.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:37.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.560586+0000", 2024-09-17T02:22:37.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000202909 2024-09-17T02:22:37.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570472+0000", 2024-09-17T02:22:37.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098856959999999994 2024-09-17T02:22:37.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:37.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574138+0000", 2024-09-17T02:22:37.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036660170000000001 2024-09-17T02:22:37.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:37.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574298+0000", 2024-09-17T02:22:37.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016025600000000001 2024-09-17T02:22:37.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:37.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574516+0000", 2024-09-17T02:22:37.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021835999999999999 2024-09-17T02:22:37.737 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.737 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:37.737 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.738 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129545 5.4 5:22366489:::benchmark_data_smithi001_23533_object1428:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:37.738 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:37.738 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.049545813999998, 2024-09-17T02:22:37.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99074544499999995, 2024-09-17T02:22:37.738 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:37.738 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:37.738 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.738 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:37.738 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:37.738 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:37.738 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129545 2024-09-17T02:22:37.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.738 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:37.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:37.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:37.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:37.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584133+0000", 2024-09-17T02:22:37.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:37.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584135+0000", 2024-09-17T02:22:37.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4699999999999999e-06 2024-09-17T02:22:37.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:37.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584142+0000", 2024-09-17T02:22:37.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1620000000000002e-06 2024-09-17T02:22:37.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:37.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584170+0000", 2024-09-17T02:22:37.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7897000000000001e-05 2024-09-17T02:22:37.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584183+0000", 2024-09-17T02:22:37.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2814e-05 2024-09-17T02:22:37.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584299+0000", 2024-09-17T02:22:37.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116153 2024-09-17T02:22:37.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:37.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.584316+0000", 2024-09-17T02:22:37.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7524999999999999e-05 2024-09-17T02:22:37.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563461+0000", 2024-09-17T02:22:37.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97914436699999996 2024-09-17T02:22:37.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:37.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563667+0000", 2024-09-17T02:22:37.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020689800000000001 2024-09-17T02:22:37.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:37.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.563878+0000", 2024-09-17T02:22:37.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000210275 2024-09-17T02:22:37.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570584+0000", 2024-09-17T02:22:37.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067066080000000002 2024-09-17T02:22:37.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:37.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574539+0000", 2024-09-17T02:22:37.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039550360000000003 2024-09-17T02:22:37.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:37.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574653+0000", 2024-09-17T02:22:37.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114003 2024-09-17T02:22:37.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:37.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574879+0000", 2024-09-17T02:22:37.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022523700000000001 2024-09-17T02:22:37.744 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.744 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:37.744 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.744 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129553 5.4 5:2e41ad40:::benchmark_data_smithi001_23533_object1436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:37.744 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:37.744 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.044123178, 2024-09-17T02:22:37.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.99213429600000003, 2024-09-17T02:22:37.745 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:37.745 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:37.745 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.745 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:37.745 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:37.745 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:37.745 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129553 2024-09-17T02:22:37.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.745 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:37.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:37.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:37.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:37.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589556+0000", 2024-09-17T02:22:37.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:37.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589557+0000", 2024-09-17T02:22:37.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2219999999999999e-06 2024-09-17T02:22:37.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:37.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589562+0000", 2024-09-17T02:22:37.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0649999999999998e-06 2024-09-17T02:22:37.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:37.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589575+0000", 2024-09-17T02:22:37.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3129000000000001e-05 2024-09-17T02:22:37.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589584+0000", 2024-09-17T02:22:37.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6200000000000005e-06 2024-09-17T02:22:37.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589693+0000", 2024-09-17T02:22:37.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109319 2024-09-17T02:22:37.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:37.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.589714+0000", 2024-09-17T02:22:37.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0849999999999999e-05 2024-09-17T02:22:37.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566273+0000", 2024-09-17T02:22:37.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.97655884999999998 2024-09-17T02:22:37.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:37.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566543+0000", 2024-09-17T02:22:37.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027059099999999998 2024-09-17T02:22:37.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:37.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.566832+0000", 2024-09-17T02:22:37.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028898200000000002 2024-09-17T02:22:37.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:37.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581040+0000", 2024-09-17T02:22:37.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014208001 2024-09-17T02:22:37.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581200+0000", 2024-09-17T02:22:37.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159956 2024-09-17T02:22:37.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:37.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581427+0000", 2024-09-17T02:22:37.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000226309 2024-09-17T02:22:37.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:37.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581690+0000", 2024-09-17T02:22:37.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026340199999999998 2024-09-17T02:22:37.751 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.751 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:37.751 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.751 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129580 5.4 5:25ed887b:::benchmark_data_smithi001_23533_object1463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:37.751 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:37.751 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.022351133999997, 2024-09-17T02:22:37.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.98001430499999997, 2024-09-17T02:22:37.751 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:37.751 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:37.751 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.752 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:37.752 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:37.752 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:37.752 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129580 2024-09-17T02:22:37.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.752 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:37.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:37.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:37.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:37.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611328+0000", 2024-09-17T02:22:37.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:37.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611329+0000", 2024-09-17T02:22:37.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.22e-06 2024-09-17T02:22:37.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:37.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611335+0000", 2024-09-17T02:22:37.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1129999999999997e-06 2024-09-17T02:22:37.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:37.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611348+0000", 2024-09-17T02:22:37.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2342e-05 2024-09-17T02:22:37.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611356+0000", 2024-09-17T02:22:37.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.371e-06 2024-09-17T02:22:37.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611419+0000", 2024-09-17T02:22:37.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3393999999999996e-05 2024-09-17T02:22:37.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:37.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.611427+0000", 2024-09-17T02:22:37.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999997e-06 2024-09-17T02:22:37.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.570705+0000", 2024-09-17T02:22:37.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.95927859199999999 2024-09-17T02:22:37.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:37.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571009+0000", 2024-09-17T02:22:37.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030414599999999998 2024-09-17T02:22:37.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:37.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.571241+0000", 2024-09-17T02:22:37.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023106799999999999 2024-09-17T02:22:37.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:37.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590789+0000", 2024-09-17T02:22:37.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019548763 2024-09-17T02:22:37.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590928+0000", 2024-09-17T02:22:37.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000139092 2024-09-17T02:22:37.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:37.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591086+0000", 2024-09-17T02:22:37.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015787400000000001 2024-09-17T02:22:37.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:37.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591342+0000", 2024-09-17T02:22:37.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025589900000000002 2024-09-17T02:22:37.757 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.757 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:37.758 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.758 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129603 5.4 5:25aaa5e8:::benchmark_data_smithi001_23533_object1486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:37.758 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:37.758 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.006291337999997, 2024-09-17T02:22:37.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96463198999999999, 2024-09-17T02:22:37.758 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:37.758 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:37.758 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.758 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:37.758 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:37.758 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129603 2024-09-17T02:22:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:37.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627388+0000", 2024-09-17T02:22:37.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8000000000000005e-07 2024-09-17T02:22:37.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:37.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627392+0000", 2024-09-17T02:22:37.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0790000000000002e-06 2024-09-17T02:22:37.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:37.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627403+0000", 2024-09-17T02:22:37.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0866000000000001e-05 2024-09-17T02:22:37.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627409+0000", 2024-09-17T02:22:37.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.305e-06 2024-09-17T02:22:37.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627485+0000", 2024-09-17T02:22:37.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6582000000000006e-05 2024-09-17T02:22:37.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:37.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.627499+0000", 2024-09-17T02:22:37.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4083000000000001e-05 2024-09-17T02:22:37.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.574991+0000", 2024-09-17T02:22:37.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94749182300000001 2024-09-17T02:22:37.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:37.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575377+0000", 2024-09-17T02:22:37.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038629400000000003 2024-09-17T02:22:37.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.575665+0000", 2024-09-17T02:22:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028759499999999997 2024-09-17T02:22:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.590802+0000", 2024-09-17T02:22:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015136479 2024-09-17T02:22:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591614+0000", 2024-09-17T02:22:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081293100000000003 2024-09-17T02:22:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591764+0000", 2024-09-17T02:22:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014932199999999999 2024-09-17T02:22:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592020+0000", 2024-09-17T02:22:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025585099999999997 2024-09-17T02:22:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.764 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129607 5.4 5:2f638f1e:::benchmark_data_smithi001_23533_object1490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:37.765 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:37.765 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.004764432000002, 2024-09-17T02:22:37.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.96352375899999998, 2024-09-17T02:22:37.765 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:37.765 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:37.765 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.765 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:37.765 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:37.765 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:37.765 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129607 2024-09-17T02:22:37.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.765 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:37.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628915+0000", 2024-09-17T02:22:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628916+0000", 2024-09-17T02:22:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1710000000000001e-06 2024-09-17T02:22:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:37.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628920+0000", 2024-09-17T02:22:37.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-17T02:22:37.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:37.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628935+0000", 2024-09-17T02:22:37.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4474000000000001e-05 2024-09-17T02:22:37.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628944+0000", 2024-09-17T02:22:37.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9940000000000006e-06 2024-09-17T02:22:37.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.628997+0000", 2024-09-17T02:22:37.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3579000000000003e-05 2024-09-17T02:22:37.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:37.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.629006+0000", 2024-09-17T02:22:37.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4009999999999997e-06 2024-09-17T02:22:37.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.577862+0000", 2024-09-17T02:22:37.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.948856335 2024-09-17T02:22:37.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:37.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578167+0000", 2024-09-17T02:22:37.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030532399999999999 2024-09-17T02:22:37.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:37.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.578532+0000", 2024-09-17T02:22:37.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036428200000000001 2024-09-17T02:22:37.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:37.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591442+0000", 2024-09-17T02:22:37.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012910374000000001 2024-09-17T02:22:37.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592164+0000", 2024-09-17T02:22:37.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072242499999999996 2024-09-17T02:22:37.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:37.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592267+0000", 2024-09-17T02:22:37.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102205 2024-09-17T02:22:37.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:37.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592438+0000", 2024-09-17T02:22:37.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017165299999999999 2024-09-17T02:22:37.771 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.771 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:37.771 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.771 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129623 5.4 5:2cf5174b:::benchmark_data_smithi001_23533_object1506:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:37.771 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:37.771 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 61.980820145999999, 2024-09-17T02:22:37.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.94334114499999999, 2024-09-17T02:22:37.771 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:37.771 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:37.771 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.771 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:37.772 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:37.772 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:37.772 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129623 2024-09-17T02:22:37.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.772 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:37.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:37.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:37.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:37.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652859+0000", 2024-09-17T02:22:37.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:37.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652860+0000", 2024-09-17T02:22:37.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0330000000000001e-06 2024-09-17T02:22:37.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:37.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652864+0000", 2024-09-17T02:22:37.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.634e-06 2024-09-17T02:22:37.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:37.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652877+0000", 2024-09-17T02:22:37.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2591e-05 2024-09-17T02:22:37.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652883+0000", 2024-09-17T02:22:37.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1460000000000001e-06 2024-09-17T02:22:37.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652943+0000", 2024-09-17T02:22:37.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9833999999999997e-05 2024-09-17T02:22:37.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:37.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.652950+0000", 2024-09-17T02:22:37.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.401e-06 2024-09-17T02:22:37.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.581800+0000", 2024-09-17T02:22:37.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.92884935700000004 2024-09-17T02:22:37.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:37.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582122+0000", 2024-09-17T02:22:37.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032185200000000002 2024-09-17T02:22:37.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:37.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.582689+0000", 2024-09-17T02:22:37.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056750400000000003 2024-09-17T02:22:37.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:37.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.591458+0000", 2024-09-17T02:22:37.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008768685 2024-09-17T02:22:37.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595856+0000", 2024-09-17T02:22:37.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043977909999999999 2024-09-17T02:22:37.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:37.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.595955+0000", 2024-09-17T02:22:37.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9166000000000006e-05 2024-09-17T02:22:37.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:37.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596200+0000", 2024-09-17T02:22:37.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024515099999999998 2024-09-17T02:22:37.777 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.777 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:37.777 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.778 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129642 5.4 5:255eb796:::benchmark_data_smithi001_23533_object1525:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:37.778 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:37.778 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 61.949583982, 2024-09-17T02:22:37.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.91257397299999998, 2024-09-17T02:22:37.778 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:37.778 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:37.778 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.778 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:37.778 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:37.778 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:37.778 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129642 2024-09-17T02:22:37.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.778 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:37.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:37.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:37.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:37.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684095+0000", 2024-09-17T02:22:37.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:37.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684096+0000", 2024-09-17T02:22:37.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659999999999999e-06 2024-09-17T02:22:37.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:37.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684101+0000", 2024-09-17T02:22:37.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8110000000000002e-06 2024-09-17T02:22:37.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:37.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684114+0000", 2024-09-17T02:22:37.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2653000000000001e-05 2024-09-17T02:22:37.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684121+0000", 2024-09-17T02:22:37.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5100000000000001e-06 2024-09-17T02:22:37.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684181+0000", 2024-09-17T02:22:37.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0307999999999999e-05 2024-09-17T02:22:37.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:37.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.684194+0000", 2024-09-17T02:22:37.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2916e-05 2024-09-17T02:22:37.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.587917+0000", 2024-09-17T02:22:37.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.90372220400000003 2024-09-17T02:22:37.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:37.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588215+0000", 2024-09-17T02:22:37.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029845400000000003 2024-09-17T02:22:37.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:37.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.588470+0000", 2024-09-17T02:22:37.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025455399999999999 2024-09-17T02:22:37.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596318+0000", 2024-09-17T02:22:37.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078485589999999997 2024-09-17T02:22:37.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:37.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596354+0000", 2024-09-17T02:22:37.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5976999999999998e-05 2024-09-17T02:22:37.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:37.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596449+0000", 2024-09-17T02:22:37.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4728999999999994e-05 2024-09-17T02:22:37.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:37.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.596669+0000", 2024-09-17T02:22:37.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220132 2024-09-17T02:22:37.784 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.784 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:37.784 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.784 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4466.0:129649 5.4 5:2fe27050:::benchmark_data_smithi001_23533_object1532:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:37.784 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:37.784 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 61.918027238999997, 2024-09-17T02:22:37.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.88508119100000004, 2024-09-17T02:22:37.784 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-17T02:22:37.785 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-17T02:22:37.785 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:37.785 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-17T02:22:37.785 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4466", 2024-09-17T02:22:37.785 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:37.785 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 129649 2024-09-17T02:22:37.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.785 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-17T02:22:37.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-17T02:22:37.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:37.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-17T02:22:37.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715652+0000", 2024-09-17T02:22:37.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-17T02:22:37.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-17T02:22:37.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715653+0000", 2024-09-17T02:22:37.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3519999999999999e-06 2024-09-17T02:22:37.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-17T02:22:37.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715658+0000", 2024-09-17T02:22:37.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3120000000000001e-06 2024-09-17T02:22:37.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-17T02:22:37.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715677+0000", 2024-09-17T02:22:37.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-17T02:22:37.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-17T02:22:37.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715687+0000", 2024-09-17T02:22:37.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0146000000000001e-05 2024-09-17T02:22:37.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715821+0000", 2024-09-17T02:22:37.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013421 2024-09-17T02:22:37.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-17T02:22:37.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:35.715840+0000", 2024-09-17T02:22:37.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8153999999999999e-05 2024-09-17T02:22:37.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-17T02:22:37.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592528+0000", 2024-09-17T02:22:37.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.87668860000000004 2024-09-17T02:22:37.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-17T02:22:37.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592702+0000", 2024-09-17T02:22:37.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017429300000000001 2024-09-17T02:22:37.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-17T02:22:37.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.592945+0000", 2024-09-17T02:22:37.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000242048 2024-09-17T02:22:37.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-17T02:22:37.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600234+0000", 2024-09-17T02:22:37.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072897600000000002 2024-09-17T02:22:37.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:37.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600494+0000", 2024-09-17T02:22:37.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000259984 2024-09-17T02:22:37.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-17T02:22:37.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600555+0000", 2024-09-17T02:22:37.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1138999999999999e-05 2024-09-17T02:22:37.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-17T02:22:37.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-17T02:22:37.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-17T02:22:37.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-17T02:21:36.600733+0000", 2024-09-17T02:22:37.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017753300000000001 2024-09-17T02:22:37.791 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.791 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:37.791 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.791 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-17T02:22:37.791 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-17T02:22:37.791 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-17T02:22:37.792 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T02:22:37.892 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~58s 2024-09-17T02:22:37.912 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:37.912 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:22:37.912 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-17T02:22:37.912 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:37.926 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T02:22:38.049 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:38.050 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-17T02:22:38.050 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-17T02:22:38.050 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-17T02:22:38.050 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:38.063 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T02:22:38.182 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T02:22:38.182 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-17T02:22:38.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-17T02:22:38.182 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-17T02:22:38.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.182 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:28721 5.a 5:5107d6ea:::benchmark_data_smithi001_23533_object28720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T02:22:38.182 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:38.182 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 115.614611888, 2024-09-17T02:22:38.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034495965000000003, 2024-09-17T02:22:38.182 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:38.182 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:38.183 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:38.183 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:38.183 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:38.183 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:38.183 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 28721 2024-09-17T02:22:38.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.183 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:38.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:38.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:38.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568463+0000", 2024-09-17T02:22:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568464+0000", 2024-09-17T02:22:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6899999999999996e-07 2024-09-17T02:22:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568565+0000", 2024-09-17T02:22:38.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100739 2024-09-17T02:22:38.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:38.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568573+0000", 2024-09-17T02:22:38.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.388e-06 2024-09-17T02:22:38.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:38.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568579+0000", 2024-09-17T02:22:38.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4670000000000003e-06 2024-09-17T02:22:38.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568652+0000", 2024-09-17T02:22:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2873999999999994e-05 2024-09-17T02:22:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568787+0000", 2024-09-17T02:22:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013537999999999999 2024-09-17T02:22:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.568940+0000", 2024-09-17T02:22:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015337900000000001 2024-09-17T02:22:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.570229+0000", 2024-09-17T02:22:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001288478 2024-09-17T02:22:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602856+0000", 2024-09-17T02:22:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.032627251000000003 2024-09-17T02:22:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602920+0000", 2024-09-17T02:22:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4419999999999996e-05 2024-09-17T02:22:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:20:42.602959+0000", 2024-09-17T02:22:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.862e-05 2024-09-17T02:22:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97759 5.a 5:5662fdd8:::benchmark_data_smithi001_23533_object97758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:38.189 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 80.584689815000004, 2024-09-17T02:22:38.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.089694871999999995, 2024-09-17T02:22:38.189 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:38.189 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:38.189 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:38.189 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:38.189 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:38.189 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:38.189 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97759 2024-09-17T02:22:38.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598385+0000", 2024-09-17T02:22:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598386+0000", 2024-09-17T02:22:38.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999999e-07 2024-09-17T02:22:38.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:38.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598414+0000", 2024-09-17T02:22:38.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8013000000000001e-05 2024-09-17T02:22:38.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:38.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598420+0000", 2024-09-17T02:22:38.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1149999999999999e-06 2024-09-17T02:22:38.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598424+0000", 2024-09-17T02:22:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9949999999999999e-06 2024-09-17T02:22:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598479+0000", 2024-09-17T02:22:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4648999999999998e-05 2024-09-17T02:22:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598587+0000", 2024-09-17T02:22:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010853000000000001 2024-09-17T02:22:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.598676+0000", 2024-09-17T02:22:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8381999999999995e-05 2024-09-17T02:22:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603766+0000", 2024-09-17T02:22:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050902559999999996 2024-09-17T02:22:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.687988+0000", 2024-09-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.084221753999999996 2024-09-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688037+0000", 2024-09-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-05 2024-09-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.688080+0000", 2024-09-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3149999999999999e-05 2024-09-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:97770 5.0 5:09c75033:::benchmark_data_smithi001_23533_object97769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-17T02:22:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 80.579547384999998, 2024-09-17T02:22:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.086380868, 2024-09-17T02:22:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 97770 2024-09-17T02:22:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603528+0000", 2024-09-17T02:22:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603529+0000", 2024-09-17T02:22:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-17T02:22:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603593+0000", 2024-09-17T02:22:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4216999999999999e-05 2024-09-17T02:22:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603603+0000", 2024-09-17T02:22:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5179999999999993e-06 2024-09-17T02:22:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603608+0000", 2024-09-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2039999999999996e-06 2024-09-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603653+0000", 2024-09-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5247000000000002e-05 2024-09-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603758+0000", 2024-09-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105352 2024-09-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.603900+0000", 2024-09-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014198999999999999 2024-09-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.606097+0000", 2024-09-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021969839999999999 2024-09-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689756+0000", 2024-09-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.083659077999999998 2024-09-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689846+0000", 2024-09-17T02:22:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9320999999999994e-05 2024-09-17T02:22:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:17.689908+0000", 2024-09-17T02:22:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720999999999998e-05 2024-09-17T02:22:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127513 5.c 5:3eca08e4:::benchmark_data_smithi001_23533_object127512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 65.738770961, 2024-09-17T02:22:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046626399999999998, 2024-09-17T02:22:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127513 2024-09-17T02:22:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:38.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:38.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:38.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444304+0000", 2024-09-17T02:22:38.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:38.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444305+0000", 2024-09-17T02:22:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2529999999999999e-06 2024-09-17T02:22:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444466+0000", 2024-09-17T02:22:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016069700000000001 2024-09-17T02:22:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444479+0000", 2024-09-17T02:22:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2602999999999999e-05 2024-09-17T02:22:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444485+0000", 2024-09-17T02:22:38.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.669e-06 2024-09-17T02:22:38.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:38.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444560+0000", 2024-09-17T02:22:38.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4276999999999994e-05 2024-09-17T02:22:38.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:38.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444656+0000", 2024-09-17T02:22:38.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6490000000000006e-05 2024-09-17T02:22:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444739+0000", 2024-09-17T02:22:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3139999999999993e-05 2024-09-17T02:22:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.448438+0000", 2024-09-17T02:22:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036985490000000002 2024-09-17T02:22:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490732+0000", 2024-09-17T02:22:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042294353999999999 2024-09-17T02:22:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490859+0000", 2024-09-17T02:22:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012708899999999999 2024-09-17T02:22:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.490930+0000", 2024-09-17T02:22:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.207 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:38.207 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.207 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:127514 5.c 5:39cc1feb:::benchmark_data_smithi001_23533_object127513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T02:22:38.207 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:38.207 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 65.738574192000002, 2024-09-17T02:22:38.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049357228000000003, 2024-09-17T02:22:38.207 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 127514 2024-09-17T02:22:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444501+0000", 2024-09-17T02:22:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8599999999999998e-07 2024-09-17T02:22:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444554+0000", 2024-09-17T02:22:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3047999999999998e-05 2024-09-17T02:22:38.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:38.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444562+0000", 2024-09-17T02:22:38.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5830000000000001e-06 2024-09-17T02:22:38.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:38.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.444567+0000", 2024-09-17T02:22:38.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4179999999999996e-06 2024-09-17T02:22:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446566+0000", 2024-09-17T02:22:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001998788 2024-09-17T02:22:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446696+0000", 2024-09-17T02:22:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129393 2024-09-17T02:22:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-09-17T02:22:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.446794+0000", 2024-09-17T02:22:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8462999999999996e-05 2024-09-17T02:22:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.449036+0000", 2024-09-17T02:22:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022415880000000001 2024-09-17T02:22:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493737+0000", 2024-09-17T02:22:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044701682 2024-09-17T02:22:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:38.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493808+0000", 2024-09-17T02:22:38.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0846000000000006e-05 2024-09-17T02:22:38.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:38.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:32.493858+0000", 2024-09-17T02:22:38.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9932999999999998e-05 2024-09-17T02:22:38.213 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.213 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:38.213 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.213 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:129441 5.1 5:84c3199f:::benchmark_data_smithi001_23533_object1324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T02:22:38.214 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:38.214 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.679563704000003, 2024-09-17T02:22:38.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034387011000000002, 2024-09-17T02:22:38.214 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:38.214 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:38.214 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:38.214 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:38.214 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:38.214 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:38.214 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129441 2024-09-17T02:22:38.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.214 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:38.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:38.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:38.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:38.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503511+0000", 2024-09-17T02:22:38.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:38.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503513+0000", 2024-09-17T02:22:38.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4759999999999999e-06 2024-09-17T02:22:38.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:38.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503518+0000", 2024-09-17T02:22:38.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-09-17T02:22:38.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:38.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503532+0000", 2024-09-17T02:22:38.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4049999999999999e-05 2024-09-17T02:22:38.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:38.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.503541+0000", 2024-09-17T02:22:38.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5320000000000006e-06 2024-09-17T02:22:38.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:38.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506331+0000", 2024-09-17T02:22:38.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027899190000000001 2024-09-17T02:22:38.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:38.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506402+0000", 2024-09-17T02:22:38.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1279000000000007e-05 2024-09-17T02:22:38.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:38.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.506477+0000", 2024-09-17T02:22:38.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4626e-05 2024-09-17T02:22:38.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:38.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.509749+0000", 2024-09-17T02:22:38.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032726980000000001 2024-09-17T02:22:38.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:38.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537758+0000", 2024-09-17T02:22:38.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028008890000000002 2024-09-17T02:22:38.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:38.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537812+0000", 2024-09-17T02:22:38.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3300000000000001e-05 2024-09-17T02:22:38.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:38.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:21:35.537898+0000", 2024-09-17T02:22:38.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6691000000000001e-05 2024-09-17T02:22:38.219 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.219 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:38.219 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.219 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252853 5.8 5:10eae6ef:::benchmark_data_smithi001_23533_object124736:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:38.220 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.319189+0000", 2024-09-17T02:22:38.220 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.8638857580000003, 2024-09-17T02:22:38.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042307663000000002, 2024-09-17T02:22:38.220 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:38.220 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:38.220 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:38.220 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:38.220 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:38.220 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:38.220 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252853 2024-09-17T02:22:38.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.220 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:38.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:38.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319189+0000", 2024-09-17T02:22:38.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:38.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319189+0000", 2024-09-17T02:22:38.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:38.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319190+0000", 2024-09-17T02:22:38.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4900000000000001e-07 2024-09-17T02:22:38.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:38.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319191+0000", 2024-09-17T02:22:38.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.714e-06 2024-09-17T02:22:38.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:38.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319197+0000", 2024-09-17T02:22:38.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7169999999999996e-06 2024-09-17T02:22:38.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:38.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319200+0000", 2024-09-17T02:22:38.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1389999999999999e-06 2024-09-17T02:22:38.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:38.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319233+0000", 2024-09-17T02:22:38.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2830000000000002e-05 2024-09-17T02:22:38.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:38.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319307+0000", 2024-09-17T02:22:38.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3794999999999994e-05 2024-09-17T02:22:38.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:38.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319401+0000", 2024-09-17T02:22:38.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4600999999999998e-05 2024-09-17T02:22:38.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:38.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321482+0000", 2024-09-17T02:22:38.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020808480000000002 2024-09-17T02:22:38.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:38.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361420+0000", 2024-09-17T02:22:38.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039937707000000003 2024-09-17T02:22:38.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:38.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361468+0000", 2024-09-17T02:22:38.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7722999999999997e-05 2024-09-17T02:22:38.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:38.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361497+0000", 2024-09-17T02:22:38.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9240000000000001e-05 2024-09-17T02:22:38.225 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.225 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:38.225 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.225 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252854 5.6 5:6f0fbabd:::benchmark_data_smithi001_23533_object124737:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:38.226 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.319209+0000", 2024-09-17T02:22:38.226 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.863866239, 2024-09-17T02:22:38.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041094994000000003, 2024-09-17T02:22:38.226 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:38.226 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:38.226 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:38.226 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:38.226 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:38.226 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:38.226 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252854 2024-09-17T02:22:38.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.226 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:38.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:38.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319209+0000", 2024-09-17T02:22:38.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:38.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319209+0000", 2024-09-17T02:22:38.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:38.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319209+0000", 2024-09-17T02:22:38.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9099999999999999e-07 2024-09-17T02:22:38.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:38.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319211+0000", 2024-09-17T02:22:38.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9520000000000001e-06 2024-09-17T02:22:38.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:38.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319218+0000", 2024-09-17T02:22:38.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3350000000000001e-06 2024-09-17T02:22:38.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:38.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319224+0000", 2024-09-17T02:22:38.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6849999999999998e-06 2024-09-17T02:22:38.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:38.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321118+0000", 2024-09-17T02:22:38.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018940070000000001 2024-09-17T02:22:38.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:38.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321185+0000", 2024-09-17T02:22:38.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6806999999999999e-05 2024-09-17T02:22:38.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:38.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.360143+0000", 2024-09-17T02:22:38.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038958333999999997 2024-09-17T02:22:38.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:38.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.360227+0000", 2024-09-17T02:22:38.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3732000000000004e-05 2024-09-17T02:22:38.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:38.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.360304+0000", 2024-09-17T02:22:38.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6750999999999998e-05 2024-09-17T02:22:38.230 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.230 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:38.231 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.231 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252859 5.2 5:4a025e38:::benchmark_data_smithi001_23533_object124742:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:38.231 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.319239+0000", 2024-09-17T02:22:38.231 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.8638357289999998, 2024-09-17T02:22:38.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042922412, 2024-09-17T02:22:38.231 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:38.231 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:38.231 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:38.231 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:38.231 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:38.231 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:38.232 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252859 2024-09-17T02:22:38.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.232 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:38.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:38.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319239+0000", 2024-09-17T02:22:38.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:38.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319239+0000", 2024-09-17T02:22:38.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:38.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319240+0000", 2024-09-17T02:22:38.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7599999999999997e-07 2024-09-17T02:22:38.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:38.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319242+0000", 2024-09-17T02:22:38.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.294e-06 2024-09-17T02:22:38.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:38.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319248+0000", 2024-09-17T02:22:38.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.139e-06 2024-09-17T02:22:38.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:38.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319252+0000", 2024-09-17T02:22:38.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6389999999999998e-06 2024-09-17T02:22:38.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:38.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319312+0000", 2024-09-17T02:22:38.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9741000000000003e-05 2024-09-17T02:22:38.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:38.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319435+0000", 2024-09-17T02:22:38.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012350800000000001 2024-09-17T02:22:38.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:38.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.362015+0000", 2024-09-17T02:22:38.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042579662999999997 2024-09-17T02:22:38.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:38.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.362072+0000", 2024-09-17T02:22:38.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7453e-05 2024-09-17T02:22:38.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:38.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.362162+0000", 2024-09-17T02:22:38.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9399000000000002e-05 2024-09-17T02:22:38.236 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.236 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:38.236 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.236 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252860 5.0 5:00535124:::benchmark_data_smithi001_23533_object124743:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:38.236 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.319263+0000", 2024-09-17T02:22:38.236 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.8638116230000001, 2024-09-17T02:22:38.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044660535000000001, 2024-09-17T02:22:38.236 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:38.236 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:38.236 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:38.236 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:38.236 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:38.237 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:38.237 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252860 2024-09-17T02:22:38.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.237 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:38.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:38.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319263+0000", 2024-09-17T02:22:38.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:38.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319263+0000", 2024-09-17T02:22:38.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:38.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319264+0000", 2024-09-17T02:22:38.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9999999999999998e-07 2024-09-17T02:22:38.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:38.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319265+0000", 2024-09-17T02:22:38.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5319999999999999e-06 2024-09-17T02:22:38.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:38.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319269+0000", 2024-09-17T02:22:38.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9419999999999997e-06 2024-09-17T02:22:38.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:38.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319272+0000", 2024-09-17T02:22:38.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1879999999999998e-06 2024-09-17T02:22:38.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:38.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319310+0000", 2024-09-17T02:22:38.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7509000000000003e-05 2024-09-17T02:22:38.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:38.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319433+0000", 2024-09-17T02:22:38.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012351500000000001 2024-09-17T02:22:38.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:38.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.319544+0000", 2024-09-17T02:22:38.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111011 2024-09-17T02:22:38.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:38.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363800+0000", 2024-09-17T02:22:38.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044255456999999998 2024-09-17T02:22:38.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:38.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363837+0000", 2024-09-17T02:22:38.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.684e-05 2024-09-17T02:22:38.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:38.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363885+0000", 2024-09-17T02:22:38.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8324e-05 2024-09-17T02:22:38.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:38.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363924+0000", 2024-09-17T02:22:38.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8816999999999998e-05 2024-09-17T02:22:38.242 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.242 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:38.242 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.242 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252861 5.6 5:64c353c8:::benchmark_data_smithi001_23533_object124744:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:38.242 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.321550+0000", 2024-09-17T02:22:38.242 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.8615249479999996, 2024-09-17T02:22:38.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039569213999999998, 2024-09-17T02:22:38.242 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:38.243 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:38.243 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:38.243 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:38.243 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:38.243 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:38.243 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252861 2024-09-17T02:22:38.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.243 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:38.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:38.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321550+0000", 2024-09-17T02:22:38.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:38.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321550+0000", 2024-09-17T02:22:38.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:38.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321551+0000", 2024-09-17T02:22:38.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1710000000000001e-06 2024-09-17T02:22:38.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:38.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321559+0000", 2024-09-17T02:22:38.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8399999999999995e-06 2024-09-17T02:22:38.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:38.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321569+0000", 2024-09-17T02:22:38.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9499999999999996e-06 2024-09-17T02:22:38.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:38.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321576+0000", 2024-09-17T02:22:38.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8979999999999999e-06 2024-09-17T02:22:38.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:38.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322921+0000", 2024-09-17T02:22:38.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001345026 2024-09-17T02:22:38.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:38.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323020+0000", 2024-09-17T02:22:38.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9505000000000004e-05 2024-09-17T02:22:38.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:38.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361001+0000", 2024-09-17T02:22:38.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037980216999999997 2024-09-17T02:22:38.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:38.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361039+0000", 2024-09-17T02:22:38.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8729999999999997e-05 2024-09-17T02:22:38.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:38.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361119+0000", 2024-09-17T02:22:38.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9876999999999994e-05 2024-09-17T02:22:38.247 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.247 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:38.247 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.247 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252862 5.0 5:027af5f9:::benchmark_data_smithi001_23533_object124745:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:38.247 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.321589+0000", 2024-09-17T02:22:38.248 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.8614861869999997, 2024-09-17T02:22:38.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042469481000000003, 2024-09-17T02:22:38.248 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:38.248 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:38.248 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:38.248 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:38.248 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:38.248 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:38.248 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252862 2024-09-17T02:22:38.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.248 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:38.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:38.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321589+0000", 2024-09-17T02:22:38.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:38.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321589+0000", 2024-09-17T02:22:38.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:38.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321589+0000", 2024-09-17T02:22:38.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7999999999999996e-07 2024-09-17T02:22:38.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:38.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321591+0000", 2024-09-17T02:22:38.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.12e-06 2024-09-17T02:22:38.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:38.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321597+0000", 2024-09-17T02:22:38.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7880000000000003e-06 2024-09-17T02:22:38.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:38.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321602+0000", 2024-09-17T02:22:38.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6450000000000004e-06 2024-09-17T02:22:38.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:38.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321634+0000", 2024-09-17T02:22:38.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1959999999999999e-05 2024-09-17T02:22:38.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:38.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321736+0000", 2024-09-17T02:22:38.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101879 2024-09-17T02:22:38.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:38.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321856+0000", 2024-09-17T02:22:38.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120227 2024-09-17T02:22:38.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:38.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363941+0000", 2024-09-17T02:22:38.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042085514999999997 2024-09-17T02:22:38.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:38.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363978+0000", 2024-09-17T02:22:38.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7002000000000002e-05 2024-09-17T02:22:38.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:38.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.364023+0000", 2024-09-17T02:22:38.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4978999999999997e-05 2024-09-17T02:22:38.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:38.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.364058+0000", 2024-09-17T02:22:38.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4885999999999998e-05 2024-09-17T02:22:38.253 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.253 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:38.253 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.253 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252852 5.3 e73/64 5:c3aafdc8:::benchmark_data_smithi001_23533_object124735:head v 73'15929, mlcod=73'15927)", 2024-09-17T02:22:38.253 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.321622+0000", 2024-09-17T02:22:38.253 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.861452699, 2024-09-17T02:22:38.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037496129000000003, 2024-09-17T02:22:38.254 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:38.254 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:38.254 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:38.254 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:38.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:38.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321622+0000", 2024-09-17T02:22:38.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:38.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321622+0000", 2024-09-17T02:22:38.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:38.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321623+0000", 2024-09-17T02:22:38.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0900000000000001e-07 2024-09-17T02:22:38.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:38.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321631+0000", 2024-09-17T02:22:38.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6790000000000005e-06 2024-09-17T02:22:38.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:38.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321637+0000", 2024-09-17T02:22:38.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4500000000000001e-06 2024-09-17T02:22:38.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:38.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321642+0000", 2024-09-17T02:22:38.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7480000000000001e-06 2024-09-17T02:22:38.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:38.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321690+0000", 2024-09-17T02:22:38.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8541999999999997e-05 2024-09-17T02:22:38.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:38.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321705+0000", 2024-09-17T02:22:38.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.517e-05 2024-09-17T02:22:38.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:38.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359076+0000", 2024-09-17T02:22:38.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037370642000000003 2024-09-17T02:22:38.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:38.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359118+0000", 2024-09-17T02:22:38.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2289000000000001e-05 2024-09-17T02:22:38.257 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.258 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:38.258 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.258 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252856 5.1 e73/61 5:82c49704:::benchmark_data_smithi001_23533_object124739:head v 73'15774, mlcod=73'15772)", 2024-09-17T02:22:38.258 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.321652+0000", 2024-09-17T02:22:38.258 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.8614230090000001, 2024-09-17T02:22:38.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037495563000000003, 2024-09-17T02:22:38.258 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:38.258 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:38.258 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:38.258 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:38.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:38.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321652+0000", 2024-09-17T02:22:38.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:38.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321652+0000", 2024-09-17T02:22:38.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:38.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321652+0000", 2024-09-17T02:22:38.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7700000000000001e-07 2024-09-17T02:22:38.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:38.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321655+0000", 2024-09-17T02:22:38.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6220000000000001e-06 2024-09-17T02:22:38.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:38.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321660+0000", 2024-09-17T02:22:38.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.967e-06 2024-09-17T02:22:38.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:38.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321664+0000", 2024-09-17T02:22:38.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8039999999999999e-06 2024-09-17T02:22:38.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:38.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321706+0000", 2024-09-17T02:22:38.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2138000000000002e-05 2024-09-17T02:22:38.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:38.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321726+0000", 2024-09-17T02:22:38.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0236000000000001e-05 2024-09-17T02:22:38.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:38.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359072+0000", 2024-09-17T02:22:38.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037346435999999997 2024-09-17T02:22:38.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:38.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359148+0000", 2024-09-17T02:22:38.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5082999999999999e-05 2024-09-17T02:22:38.262 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.262 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:38.262 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.262 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252857 5.3 e73/64 5:c255b9a8:::benchmark_data_smithi001_23533_object124740:head v 73'15930, mlcod=73'15927)", 2024-09-17T02:22:38.262 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.321676+0000", 2024-09-17T02:22:38.262 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.8613991939999996, 2024-09-17T02:22:38.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044692651999999999, 2024-09-17T02:22:38.263 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:38.263 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:38.263 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:38.263 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:38.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:38.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321676+0000", 2024-09-17T02:22:38.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:38.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321676+0000", 2024-09-17T02:22:38.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:38.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321676+0000", 2024-09-17T02:22:38.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4299999999999999e-07 2024-09-17T02:22:38.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:38.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321683+0000", 2024-09-17T02:22:38.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.652e-06 2024-09-17T02:22:38.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:38.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321689+0000", 2024-09-17T02:22:38.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9340000000000003e-06 2024-09-17T02:22:38.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:38.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.321693+0000", 2024-09-17T02:22:38.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3309999999999997e-06 2024-09-17T02:22:38.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:38.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323151+0000", 2024-09-17T02:22:38.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014580260000000001 2024-09-17T02:22:38.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:38.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323170+0000", 2024-09-17T02:22:38.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8998999999999999e-05 2024-09-17T02:22:38.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:38.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.366320+0000", 2024-09-17T02:22:38.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.043150177999999997 2024-09-17T02:22:38.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:38.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.366368+0000", 2024-09-17T02:22:38.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8288999999999998e-05 2024-09-17T02:22:38.266 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.267 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:38.267 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.267 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252866 5.0 5:0b646666:::benchmark_data_smithi001_23533_object124749:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:38.267 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.322387+0000", 2024-09-17T02:22:38.267 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.8606877239999999, 2024-09-17T02:22:38.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041814680999999999, 2024-09-17T02:22:38.267 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:38.267 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:38.267 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:38.267 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:38.267 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:38.268 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:38.268 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252866 2024-09-17T02:22:38.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.268 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:38.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:38.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322387+0000", 2024-09-17T02:22:38.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:38.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322387+0000", 2024-09-17T02:22:38.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:38.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322388+0000", 2024-09-17T02:22:38.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6300000000000004e-07 2024-09-17T02:22:38.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:38.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322392+0000", 2024-09-17T02:22:38.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-06 2024-09-17T02:22:38.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:38.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322402+0000", 2024-09-17T02:22:38.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0165e-05 2024-09-17T02:22:38.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:38.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322409+0000", 2024-09-17T02:22:38.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5180000000000001e-06 2024-09-17T02:22:38.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:38.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323635+0000", 2024-09-17T02:22:38.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001226296 2024-09-17T02:22:38.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:38.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323738+0000", 2024-09-17T02:22:38.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103491 2024-09-17T02:22:38.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:38.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359170+0000", 2024-09-17T02:22:38.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035431547000000001 2024-09-17T02:22:38.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:38.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.363946+0000", 2024-09-17T02:22:38.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047759090000000001 2024-09-17T02:22:38.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:38.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.364118+0000", 2024-09-17T02:22:38.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017171600000000001 2024-09-17T02:22:38.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:38.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.364163+0000", 2024-09-17T02:22:38.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5176000000000003e-05 2024-09-17T02:22:38.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:38.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.364202+0000", 2024-09-17T02:22:38.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9103000000000002e-05 2024-09-17T02:22:38.272 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.272 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:38.273 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.273 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252864 5.e e73/22 5:79949647:::benchmark_data_smithi001_23533_object124747:head v 73'15818, mlcod=73'15816)", 2024-09-17T02:22:38.273 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.322434+0000", 2024-09-17T02:22:38.273 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.8606413530000001, 2024-09-17T02:22:38.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038558940999999999, 2024-09-17T02:22:38.273 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:38.273 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:38.273 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:38.273 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:38.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:38.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322434+0000", 2024-09-17T02:22:38.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:38.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322434+0000", 2024-09-17T02:22:38.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:38.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322434+0000", 2024-09-17T02:22:38.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0499999999999999e-07 2024-09-17T02:22:38.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:38.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322441+0000", 2024-09-17T02:22:38.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.545e-06 2024-09-17T02:22:38.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:38.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322447+0000", 2024-09-17T02:22:38.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6089999999999997e-06 2024-09-17T02:22:38.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:38.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322452+0000", 2024-09-17T02:22:38.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4549999999999997e-06 2024-09-17T02:22:38.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:38.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322786+0000", 2024-09-17T02:22:38.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033476699999999997 2024-09-17T02:22:38.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:38.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.322806+0000", 2024-09-17T02:22:38.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0013e-05 2024-09-17T02:22:38.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:38.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.360954+0000", 2024-09-17T02:22:38.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038147984000000003 2024-09-17T02:22:38.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:38.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.360993+0000", 2024-09-17T02:22:38.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8163e-05 2024-09-17T02:22:38.277 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.277 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:38.277 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.277 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4466.0:252867 5.0 5:098def42:::benchmark_data_smithi001_23533_object124750:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-17T02:22:38.277 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.323296+0000", 2024-09-17T02:22:38.277 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.8597791800000003, 2024-09-17T02:22:38.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046048453000000003, 2024-09-17T02:22:38.277 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:38.277 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:38.277 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:38.277 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-17T02:22:38.278 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4466", 2024-09-17T02:22:38.278 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.1:0/734484500", 2024-09-17T02:22:38.278 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252867 2024-09-17T02:22:38.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.278 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:38.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:38.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323296+0000", 2024-09-17T02:22:38.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:38.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323296+0000", 2024-09-17T02:22:38.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:38.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323297+0000", 2024-09-17T02:22:38.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.06e-07 2024-09-17T02:22:38.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:38.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323300+0000", 2024-09-17T02:22:38.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5140000000000002e-06 2024-09-17T02:22:38.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:38.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323307+0000", 2024-09-17T02:22:38.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4039999999999998e-06 2024-09-17T02:22:38.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:38.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323312+0000", 2024-09-17T02:22:38.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8420000000000004e-06 2024-09-17T02:22:38.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:38.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361424+0000", 2024-09-17T02:22:38.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038111313000000001 2024-09-17T02:22:38.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:38.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361547+0000", 2024-09-17T02:22:38.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000123621 2024-09-17T02:22:38.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-17T02:22:38.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361676+0000", 2024-09-17T02:22:38.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129016 2024-09-17T02:22:38.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-17T02:22:38.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.366632+0000", 2024-09-17T02:22:38.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049562149999999999 2024-09-17T02:22:38.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-17T02:22:38.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.369184+0000", 2024-09-17T02:22:38.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025512960000000002 2024-09-17T02:22:38.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:38.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.369270+0000", 2024-09-17T02:22:38.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5873999999999998e-05 2024-09-17T02:22:38.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:38.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.369344+0000", 2024-09-17T02:22:38.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4652000000000003e-05 2024-09-17T02:22:38.282 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.283 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:38.283 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.283 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252865 5.1 e73/61 5:81978d99:::benchmark_data_smithi001_23533_object124748:head v 73'15775, mlcod=73'15772)", 2024-09-17T02:22:38.283 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.323335+0000", 2024-09-17T02:22:38.283 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.8597401810000003, 2024-09-17T02:22:38.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037706556000000002, 2024-09-17T02:22:38.283 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:38.283 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:38.283 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:38.283 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:38.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:38.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323335+0000", 2024-09-17T02:22:38.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:38.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323335+0000", 2024-09-17T02:22:38.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:38.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323335+0000", 2024-09-17T02:22:38.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1399999999999998e-07 2024-09-17T02:22:38.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:38.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323338+0000", 2024-09-17T02:22:38.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3419999999999999e-06 2024-09-17T02:22:38.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:38.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323352+0000", 2024-09-17T02:22:38.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3771000000000001e-05 2024-09-17T02:22:38.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:38.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323356+0000", 2024-09-17T02:22:38.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6600000000000001e-06 2024-09-17T02:22:38.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:38.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323403+0000", 2024-09-17T02:22:38.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7290000000000003e-05 2024-09-17T02:22:38.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:38.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323419+0000", 2024-09-17T02:22:38.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5434000000000002e-05 2024-09-17T02:22:38.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:38.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.360952+0000", 2024-09-17T02:22:38.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037533314999999998 2024-09-17T02:22:38.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:38.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.361041+0000", 2024-09-17T02:22:38.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9430000000000003e-05 2024-09-17T02:22:38.287 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.287 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:38.287 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.287 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4466.0:252868 5.b e73/51 5:d27fb132:::benchmark_data_smithi001_23533_object124751:head v 73'15650, mlcod=73'15648)", 2024-09-17T02:22:38.287 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-17T02:22:32.323831+0000", 2024-09-17T02:22:38.288 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.8592444500000003, 2024-09-17T02:22:38.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042577492000000002, 2024-09-17T02:22:38.288 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-17T02:22:38.288 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-17T02:22:38.288 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T02:22:38.288 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-17T02:22:38.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-17T02:22:38.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323831+0000", 2024-09-17T02:22:38.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-17T02:22:38.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323831+0000", 2024-09-17T02:22:38.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-17T02:22:38.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-17T02:22:38.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323831+0000", 2024-09-17T02:22:38.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4199999999999996e-07 2024-09-17T02:22:38.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-17T02:22:38.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.323839+0000", 2024-09-17T02:22:38.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8380000000000002e-06 2024-09-17T02:22:38.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-17T02:22:38.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359009+0000", 2024-09-17T02:22:38.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035169733000000002 2024-09-17T02:22:38.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-17T02:22:38.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359022+0000", 2024-09-17T02:22:38.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3801000000000001e-05 2024-09-17T02:22:38.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-17T02:22:38.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359086+0000", 2024-09-17T02:22:38.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3559000000000006e-05 2024-09-17T02:22:38.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-17T02:22:38.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.359105+0000", 2024-09-17T02:22:38.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8865999999999999e-05 2024-09-17T02:22:38.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-17T02:22:38.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.366372+0000", 2024-09-17T02:22:38.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.007266827 2024-09-17T02:22:38.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T02:22:38.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T02:22:38.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-17T02:22:38.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-17T02:22:32.366408+0000", 2024-09-17T02:22:38.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6325999999999997e-05 2024-09-17T02:22:38.291 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.292 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:38.292 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.292 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T02:22:38.292 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T02:22:38.292 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T02:22:38.551 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T02:22:38.928 INFO:teuthology.orchestra.run.smithi001.stderr:noscrub is unset 2024-09-17T02:22:38.951 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T02:22:39.949 INFO:teuthology.orchestra.run.smithi001.stderr:nodeep-scrub is unset 2024-09-17T02:22:43.700 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~64s 2024-09-17T02:22:49.508 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~70s 2024-09-17T02:22:55.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~76s 2024-09-17T02:23:01.122 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~82s 2024-09-17T02:23:06.929 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~88s 2024-09-17T02:23:12.738 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~93s 2024-09-17T02:23:18.544 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~99s 2024-09-17T02:23:24.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~105s 2024-09-17T02:23:30.159 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~111s 2024-09-17T02:23:35.965 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~117s 2024-09-17T02:23:41.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~123s 2024-09-17T02:23:47.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~128s 2024-09-17T02:23:53.388 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~134s 2024-09-17T02:23:59.195 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~140s 2024-09-17T02:24:05.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~146s 2024-09-17T02:24:08.279 DEBUG:teuthology.orchestra.console.smithi164:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 73 F3 GUID: 00000000 0000 0000 0000 0CC47AD934F4 DHCP./                    DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ CLIENT IP: 172.21.15.164 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:73:f3)... Configuring (net0 0c:c4:7a:88:73:f3).... Configuring (net0 0c:c4:7a:88:73:f3)..... Configuring (net0 0c:c4:7a:88:73:f3)...... ok  GNU GRUB version 2.04   ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************   Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 4s.  The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     Loading Linux 5.15.0-122-generic ... Loading initial ramdisk ... [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.15.0-122-generic (buildd@lcy02-amd64-034) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #132-Ubuntu SMP Thu Aug 29 13:45:52 UTC 2024 (Ubuntu 5.15.0-122.132-generic 5.15.163) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-122-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.742 MHz processor [ 0.000422] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000603] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001907] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.008294] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.008309] Using GB pages for direct mapping [ 0.008443] RAMDISK: [mem 0x300c3000-0x34058fff] [ 0.008448] ACPI: Early table checksum verification disabled [ 0.008451] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.008455] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.008460] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008465] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.008469] ACPI: FACS 0x0000000079D43F80 000040 [ 0.008471] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008474] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008477] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008480] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.008483] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.008486] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.008489] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008491] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008494] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.008497] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008500] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.008503] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.008506] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.008509] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008512] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008515] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008518] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008520] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008523] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.008524] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.008526] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.008527] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.008528] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.008529] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.008530] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.008531] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.008532] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.008533] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.008534] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.008535] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.008536] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.008536] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.008538] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.008539] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.008540] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.008541] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.008542] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.008543] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.008544] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.008639] No NUMA configuration found [ 0.008640] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.008649] NODE_DATA(0) allocated [mem 0x87ffd6000-0x87fffffff] [ 0.008981] Zone ranges: [ 0.008982] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.008984] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.008985] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.008987] Device empty [ 0.008988] Movable zone start for each node [ 0.008991] Early memory node ranges [ 0.008992] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.008993] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.008995] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.008999] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.009003] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.009038] On node 0, zone DMA: 118 pages in unavailable ranges [ 0.080795] On node 0, zone Normal: 28986 pages in unavailable ranges [ 0.080910] ACPI: PM-Timer IO Port: 0x408 [ 0.080918] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.080919] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.080920] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.080921] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.080922] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.080923] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.080924] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.080925] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.080934] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.080938] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.080941] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.080942] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.080946] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.080947] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.080951] TSC deadline timer available [ 0.080953] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.080962] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.080964] PM: hibernation: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.080965] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.080967] PM: hibernation: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.080968] PM: hibernation: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.080969] PM: hibernation: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.080970] PM: hibernation: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.080971] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.080972] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.080972] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.080973] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.080975] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.080976] Booting paravirtualized kernel on bare hardware [ 0.080978] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.080985] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.081197] percpu: Embedded 62 pages/cpu s217088 r8192 d28672 u262144 [ 0.081227] Built 1 zonelists, mobility grouping on. Total pages: 8228746 [ 0.081229] Policy zone: Normal [ 0.081231] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-122-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.081290] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-122-generic", will be passed to user space. [ 0.083435] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.084575] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.084668] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.171129] Memory: 32672660K/33438012K available (16392K kernel code, 4397K rwdata, 10964K rodata, 3368K init, 18700K bss, 765092K reserved, 0K cma-reserved) [ 0.171418] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.171433] Kernel/User page tables isolation: enabled [ 0.171466] ftrace: allocating 50768 entries in 199 pages [ 0.191720] ftrace: allocated 199 pages with 5 groups [ 0.191848] rcu: Hierarchical RCU implementation. [ 0.191850] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.191851] Rude variant of Tasks RCU enabled. [ 0.191852] Tracing variant of Tasks RCU enabled. [ 0.191853] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.191854] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.195304] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.195503] random: crng init done [ 0.200393] Console: colour VGA+ 80x25 [ 0.211849] printk: console [tty0] enabled [ 1.198850] printk: console [ttyS1] enabled [ 1.203110] ACPI: Core revision 20210730 [ 1.207279] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.216509] APIC: Switch to symmetric I/O mode setup [ 1.221545] DMAR: Host address width 46 [ 1.225448] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.231930] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.240026] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.246367] DMAR: ATSR flags: 0x0 [ 1.249750] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.256094] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.262524] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.268945] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.274414] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.274415] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.289600] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.294975] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.301278] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.324516] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32725d490fa, max_idle_ns: 440795358494 ns [ 1.335131] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.48 BogoMIPS (lpj=13998968) [ 1.339146] CPU0: Thermal monitoring enabled (TM1) [ 1.343181] process: using mwait in idle threads [ 1.347130] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.351129] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.355130] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.359130] Spectre V2 : Mitigation: Retpolines [ 1.363129] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.367129] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.371129] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.375129] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.379129] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.383129] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.387131] MDS: Mitigation: Clear CPU buffers [ 1.391129] TAA: Mitigation: Clear CPU buffers [ 1.395129] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.399134] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.403129] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.407129] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.411129] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.415129] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.437196] Freeing SMP alternatives memory: 44K [ 1.439129] pid_max: default: 32768 minimum: 301 [ 1.443151] LSM: Security Framework initializing [ 1.447137] landlock: Up and running. [ 1.450863] Yama: becoming mindful. [ 1.451145] AppArmor: AppArmor initialized [ 1.455188] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.459168] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.463489] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.467134] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.471238] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.475130] ... version: 3 [ 1.479129] ... bit width: 48 [ 1.483129] ... generic registers: 4 [ 1.487129] ... value mask: 0000ffffffffffff [ 1.491129] ... max period: 00007fffffffffff [ 1.495129] ... fixed-purpose events: 3 [ 1.499129] ... event mask: 000000070000000f [ 1.503189] signal: max sigframe size: 1776 [ 1.507144] rcu: Hierarchical SRCU implementation. [ 1.511850] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.515192] smp: Bringing up secondary CPUs ... [ 1.519211] x86: Booting SMP configuration: [ 1.523131] .... node #0, CPUs: #1 #2 #3 #4 [ 1.531307] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.539129] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.543129] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.547229] #5 #6 #7 [ 1.547773] smp: Brought up 1 node, 8 CPUs [ 1.555131] smpboot: Max logical packages: 1 [ 1.559129] smpboot: Total of 8 processors activated (55995.87 BogoMIPS) [ 1.567450] devtmpfs: initialized [ 1.570550] x86/mm: Memory block size: 128MB [ 1.572722] ACPI: PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.575204] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.579140] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.583174] pinctrl core: initialized pinctrl subsystem [ 1.587219] PM: RTC time: 02:23:32, date: 2024-09-17 [ 1.591235] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.595464] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.599428] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.603460] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.607139] audit: initializing netlink subsys (disabled) [ 1.611148] audit: type=2000 audit(1726539810.352:1): state=initialized audit_enabled=0 res=1 [ 1.611243] thermal_sys: Registered thermal governor 'fair_share' [ 1.615130] thermal_sys: Registered thermal governor 'bang_bang' [ 1.619129] thermal_sys: Registered thermal governor 'step_wise' [ 1.623129] thermal_sys: Registered thermal governor 'user_space' [ 1.627129] thermal_sys: Registered thermal governor 'power_allocator' [ 1.631134] EISA bus registered [ 1.638336] cpuidle: using governor ladder [ 1.639131] cpuidle: using governor menu [ 1.643146] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.647130] ACPI: bus type PCI registered [ 1.651130] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.655185] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.659131] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.663142] PCI: Using configuration type 1 for base access [ 1.668152] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.671145] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.675130] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.679204] ACPI: Added _OSI(Module Device) [ 1.683131] ACPI: Added _OSI(Processor Device) [ 1.687136] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.691129] ACPI: Added _OSI(Processor Aggregator Device) [ 1.695129] ACPI: Added _OSI(Linux-Dell-Video) [ 1.699129] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.703129] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.753148] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.758509] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.763282] ACPI: Dynamic OEM Table Load: [ 1.795043] ACPI: Interpreter enabled [ 1.795140] ACPI: PM: (supports S0 S4 S5) [ 1.799129] ACPI: Using IOAPIC for interrupt routing [ 1.803152] HEST: Enabling Firmware First mode for corrected errors. [ 1.807207] HEST: Table parsing has been initialized. [ 1.811281] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.815131] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.819129] PCI: Using E820 reservations for host bridge windows [ 1.823835] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.860518] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.863133] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.869149] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.872206] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.875129] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.879162] PCI host bridge to bus 0000:ff [ 1.883130] pci_bus 0000:ff: root bus resource [bus ff] [ 1.887139] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.891195] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.895181] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.899184] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.903181] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.907181] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.911179] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.915181] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.919184] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.923180] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.927180] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.931181] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.935182] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.939181] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.943181] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 1.947182] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 1.951183] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 1.955179] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 1.959181] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 1.963153] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 1.967190] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 1.971230] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 1.975193] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 1.979192] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 1.983195] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 1.987193] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 1.991192] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 1.995182] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 1.999183] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 2.003194] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 2.007193] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 2.011193] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 2.015194] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 2.019182] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 2.023182] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 2.027182] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 2.031183] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.035193] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.039192] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.043194] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.047196] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.051186] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.055182] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.059183] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.063188] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.067182] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.071182] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.075185] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.079188] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.083181] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.087181] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.091181] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.095155] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.099182] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.103181] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.111499] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.115131] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 2.119473] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 2.123605] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.127129] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.131427] PCI host bridge to bus 0000:00 [ 2.135130] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.139129] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.143129] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.147129] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.151129] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.155129] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.159129] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.163238] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.167342] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.171195] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.175303] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.179194] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.183296] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.187194] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.191294] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.195148] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.199326] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.203148] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.207324] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.211148] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.215324] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.219148] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.223325] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.227148] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.231326] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.235148] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.239323] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.243148] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.247323] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.251148] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.255275] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.259354] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.263279] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.267301] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.271143] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.275374] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.279424] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.283150] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.287140] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.291140] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.295140] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.299140] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.303140] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.307169] pci 0000:00:11.4: PME# supported from D3hot [ 2.311288] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.315155] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.319206] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.323282] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.327155] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.331206] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.335278] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.339155] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.343206] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.347297] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.351152] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.355234] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.359288] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.363218] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.367294] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.371222] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.375293] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.379221] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.383302] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.387152] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.391233] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.395288] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.399405] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.403148] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.407139] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.411139] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.415139] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.419139] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.423139] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.427163] pci 0000:00:1f.2: PME# supported from D3hot [ 2.431275] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.435154] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.439160] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.443343] acpiphp: Slot [1] registered [ 2.447146] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.451309] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.455149] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.459171] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.463132] pci 0000:02:00.0: enabling Extended Tags [ 2.467234] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.471131] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.475310] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.479151] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.483138] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.487151] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.491139] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.495170] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.499150] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.503129] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.507142] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.511129] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.515292] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.519150] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.523138] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.527151] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.531138] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.535169] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.539146] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.543129] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.547142] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.551129] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.555262] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.559130] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.563130] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.567130] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.571160] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.575195] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.579218] pci 0000:05:00.0: enabling Extended Tags [ 2.583207] pci 0000:05:00.0: supports D1 D2 [ 2.587129] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.591234] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.595131] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.599130] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.603177] pci_bus 0000:06: extended config space not accessible [ 2.607158] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.611162] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.615146] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.619146] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.623213] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.627171] pci 0000:06:00.0: supports D1 D2 [ 2.631129] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.635240] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.639135] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.643132] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.647226] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 2.651156] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 2.655157] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 2.659143] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 2.663264] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 2.667167] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.671130] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.675155] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.679129] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.683304] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 2.687156] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 2.691157] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 2.695143] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 2.699259] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 2.703166] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.707129] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.711155] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.715129] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.719284] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.723131] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.727130] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.731132] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 2.736057] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 2.739179] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 2.743178] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 2.747177] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 2.751178] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 2.755129] ACPI: PCI: Interrupt link LNKE disabled [ 2.759179] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 2.763129] ACPI: PCI: Interrupt link LNKF disabled [ 2.767177] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 2.771129] ACPI: PCI: Interrupt link LNKG disabled [ 2.775177] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 2.779129] ACPI: PCI: Interrupt link LNKH disabled [ 2.783318] iommu: Default domain type: Translated [ 2.787130] iommu: DMA domain TLB invalidation policy: lazy mode [ 2.791254] SCSI subsystem initialized [ 2.795141] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.799128] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.799129] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.803129] vgaarb: loaded [ 2.805910] ACPI: bus type USB registered [ 2.807138] usbcore: registered new interface driver usbfs [ 2.811134] usbcore: registered new interface driver hub [ 2.815133] usbcore: registered new device driver usb [ 2.819147] pps_core: LinuxPPS API ver. 1 registered [ 2.823129] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.827132] PTP clock support registered [ 2.831143] EDAC MC: Ver: 3.0.0 [ 2.834440] NetLabel: Initializing [ 2.835130] NetLabel: domain hash size = 128 [ 2.839129] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.843140] NetLabel: unlabeled traffic allowed by default [ 2.847138] PCI: Using ACPI for IRQ routing [ 2.856367] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.859130] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.865168] clocksource: Switched to clocksource tsc-early [ 2.877330] VFS: Disk quotas dquot_6.6.0 [ 2.881330] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.888366] AppArmor: AppArmor Filesystem Enabled [ 2.893166] pnp: PnP ACPI init [ 2.896752] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.902743] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.908733] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.914720] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.920708] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.926689] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.932680] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.939361] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.946045] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.952728] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.959410] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.966093] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.972777] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.979675] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.985665] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.991652] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.997640] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 3.003622] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.010577] pnp: PnP ACPI: found 5 devices [ 3.020120] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.029117] NET: Registered PF_INET protocol family [ 3.034230] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.043520] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.052343] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 3.060338] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.068745] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.076277] TCP: Hash tables configured (established 262144 bind 65536) [ 3.083101] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 3.090884] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.097903] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.105358] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 3.111085] NET: Registered PF_XDP protocol family [ 3.115963] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.127539] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.135451] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.140494] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.145530] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.152397] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.160049] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.168050] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.175787] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.183877] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.191528] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.199531] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.207267] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.215356] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.223008] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.231010] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.238747] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.246838] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.254490] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.262490] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.270230] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.278318] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.283346] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.289515] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.296372] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.304205] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.309253] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.314282] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.320452] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.327328] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.332621] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.338790] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.345657] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.353493] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.361415] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.369250] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.377172] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.382205] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.388369] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.395224] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.410852] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.417096] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.423345] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.430287] pci_bus 0000:00: resource 7 [mem 0x90000000-0xfbffbfff window] [ 3.437232] pci_bus 0000:00: resource 8 [mem 0xfedb0000-0xfedb000f window] [ 3.444173] pci_bus 0000:00: resource 9 [mem 0xfedc0000-0xfedc000f window] [ 3.451116] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.457451] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.463092] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.469432] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.476741] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.482378] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.488716] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.494356] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.500695] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.506335] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.512672] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.520194] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 3.551711] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x160 took 23652 usecs [ 3.583775] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x160 took 23986 usecs [ 3.591275] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 3.597834] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.597842] Trying to unpack rootfs image as initramfs... [ 3.604341] software IO TLB: mapped [mem 0x0000000074ec6000-0x0000000078ec6000] (64MB) [ 3.618303] Initialise system trusted keyrings [ 3.622827] Key type blacklist registered [ 3.626959] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.634433] zbud: loaded [ 3.637236] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 3.643289] fuse: init (API version 7.34) [ 3.647528] integrity: Platform Keyring initialized [ 3.660410] Key type asymmetric registered [ 3.664580] Asymmetric key parser 'x509' registered [ 3.669552] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) [ 3.677096] io scheduler mq-deadline registered [ 3.682082] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.688122] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.694145] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.700121] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.706104] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.712067] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.718038] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.724958] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 3.730895] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.739366] ACPI: button: Power Button [PWRB] [ 3.743824] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.751344] ACPI: button: Power Button [PWRF] [ 3.757132] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.764704] pstore: Registered erst as persistent store backend [ 3.770829] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 3.797759] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.826693] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.836328] Linux agpgart interface v0.103 [ 3.842178] loop: module loaded [ 3.845611] tun: Universal TUN/TAP device driver, 1.6 [ 3.850755] PPP generic driver version 2.4.2 [ 3.855144] VFIO - User Level meta-driver version: 0.3 [ 3.860444] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 3.867048] ehci-pci: EHCI PCI platform driver [ 3.871715] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.877017] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 3.884512] ehci-pci 0000:00:1a.0: debug port 2 [ 3.893043] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.911667] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.917532] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 3.925887] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.933199] usb usb1: Product: EHCI Host Controller [ 3.938153] usb usb1: Manufacturer: Linux 5.15.0-122-generic ehci_hcd [ 3.944667] usb usb1: SerialNumber: 0000:00:1a.0 [ 3.945193] Freeing initrd memory: 65112K [ 3.949483] hub 1-0:1.0: USB hub found [ 3.957251] hub 1-0:1.0: 2 ports detected [ 3.961572] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.966870] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 3.974360] ehci-pci 0000:00:1d.0: debug port 2 [ 3.982851] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 4.003700] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 4.009548] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.017896] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.025202] usb usb2: Product: EHCI Host Controller [ 4.030142] usb usb2: Manufacturer: Linux 5.15.0-122-generic ehci_hcd [ 4.036647] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.041427] hub 2-0:1.0: USB hub found [ 4.045246] hub 2-0:1.0: 2 ports detected [ 4.049443] ehci-platform: EHCI generic platform driver [ 4.054750] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.060998] ohci-pci: OHCI PCI platform driver [ 4.065526] ohci-platform: OHCI generic platform driver [ 4.070827] uhci_hcd: USB Universal Host Controller Interface driver [ 4.077294] i8042: PNP: No PS/2 controller found. [ 4.082127] mousedev: PS/2 mouse device common for all mice [ 4.087840] rtc_cmos 00:00: RTC can wake from S4 [ 4.092745] rtc_cmos 00:00: registered as rtc0 [ 4.097287] rtc_cmos 00:00: setting system clock to 2024-09-17T02:23:35 UTC (1726539815) [ 4.105488] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 4.112261] i2c_dev: i2c /dev entries driver [ 4.116759] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 4.129039] device-mapper: uevent: version 1.0.3 [ 4.133788] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com [ 4.142329] platform eisa.0: Probing EISA bus 0 [ 4.146929] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 4.153782] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 4.160290] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 4.166798] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 4.173308] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 4.179817] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 4.186326] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 4.192836] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 4.199345] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 4.205855] platform eisa.0: EISA: Detected 0 cards [ 4.210807] intel_pstate: Intel P-state driver initializing [ 4.217512] ledtrig-cpu: registered to indicate activity on CPUs [ 4.223741] drop_monitor: Initializing network drop monitor service [ 4.230182] NET: Registered PF_INET6 protocol family [ 4.240524] Segment Routing with IPv6 [ 4.244261] In-situ OAM (IOAM) with IPv6 [ 4.248263] NET: Registered PF_PACKET protocol family [ 4.253466] Key type dns_resolver registered [ 4.258458] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 4.264453] microcode: Microcode Update Driver: v2.2. [ 4.264521] resctrl: L3 allocation detected [ 4.273879] resctrl: L3 monitoring detected [ 4.278132] IPI shorthand broadcast: enabled [ 4.282481] sched_clock: Marking stable (3218837742, 1063631561)->(5276264529, -993795226) [ 4.291048] registered taskstats version 1 [ 4.295363] Loading compiled-in X.509 certificates [ 4.300769] Loaded X.509 cert 'Build time autogenerated kernel key: cf341c0246f305ce65bb84b8240a4185ace92bf9' [ 4.303662] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.311229] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 4.327660] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 4.337749] blacklist: Loading compiled-in revocation X.509 certificates [ 4.344533] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 4.354458] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 4.364992] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 4.375870] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 4.386400] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 4.397192] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 4.399689] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 4.408010] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 4.425407] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 4.437184] zswap: loaded using pool lzo/zbud [ 4.441897] Key type .fscrypt registered [ 4.445889] Key type fscrypt-provisioning registered [ 4.450977] pstore: Using crash dump compression: deflate [ 4.458428] Key type encrypted registered [ 4.462505] AppArmor: AppArmor sha1 policy hashing enabled [ 4.468068] ima: No TPM chip found, activating TPM-bypass! [ 4.481522] Loading compiled-in module X.509 certificates [ 4.484241] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.487456] Loaded X.509 cert 'Build time autogenerated kernel key: cf341c0246f305ce65bb84b8240a4185ace92bf9' [ 4.495279] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.505290] ima: Allocated hash algorithm: sha1 [ 4.505311] ima: No architecture policies found [ 4.512785] hub 1-1:1.0: USB hub found [ 4.517138] evm: Initialising EVM extended attributes: [ 4.525780] hub 1-1:1.0: 6 ports detected [ 4.530770] evm: security.selinux [ 4.530771] evm: security.SMACK64 [ 4.530771] evm: security.SMACK64EXEC [ 4.530772] evm: security.SMACK64TRANSMUTE [ 4.530772] evm: security.SMACK64MMAP [ 4.530773] evm: security.apparmor [ 4.530773] evm: security.ima [ 4.530773] evm: security.capability [ 4.530774] evm: HMAC attrs: 0x1 [ 4.531053] PM: Magic number: 8:328:359 [ 4.571188] RAS: Correctable Errors collector initialized. [ 4.571994] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 4.576768] clk: Disabling unused clocks [ 4.585036] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.596540] hub 2-1:1.0: USB hub found [ 4.600495] hub 2-1:1.0: 8 ports detected [ 4.600691] Freeing unused decrypted memory: 2036K [ 4.609920] Freeing unused kernel image (initmem) memory: 3368K [ 4.615942] Write protecting the kernel read-only data: 30720k [ 4.622236] Freeing unused kernel image (text/rodata gap) memory: 2036K [ 4.629152] Freeing unused kernel image (rodata/data gap) memory: 1324K [ 4.674692] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.681197] x86/mm: Checking user space page tables [ 4.686149] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 4.692398] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 4.735574] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.742089] clocksource: Switched to clocksource tsc [ 4.742093] Run /init as init process Loading, please wait... Starting version 249.11-0ubuntu3.6 [ 4.895166] dca service started, version 1.12.1 [ 4.902167] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.907499] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 4.915510] nvme nvme0: pci function 0000:02:00.0 [ 4.915728] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 4.915823] igb: Intel(R) Gigabit Ethernet Network Driver [ 4.915825] igb: Copyright (c) 2007-2014 Intel Corporation. [ 4.916087] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 4.916391] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.916395] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 4.916399] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 4.916447] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.916449] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.916451] usb usb3: Product: xHCI Host Controller [ 4.916452] usb usb3: Manufacturer: Linux 5.15.0-122-generic xhci-hcd [ 4.916453] usb usb3: SerialNumber: 0000:00:14.0 [ 4.916572] hub 3-0:1.0: USB hub found [ 4.916600] hub 3-0:1.0: 15 ports detected [ 4.919991] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.15 [ 4.919994] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.919995] usb usb4: Product: xHCI Host Controller [ 4.919997] usb usb4: Manufacturer: Linux 5.15.0-122-generic xhci-hcd [ 4.919998] usb usb4: SerialNumber: 0000:00:14.0 [ 4.920076] hub 4-0:1.0: USB hub found [ 4.920093] hub 4-0:1.0: 6 ports detected [ 4.923204] nvme nvme0: 8/0/0 default/read/poll queues [ 4.928503] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.975640] igb 0000:07:00.0: added PHC on eth0 [ 5.007821] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 5.016155] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.020046] scsi host0: ahci [ 5.020211] scsi host1: ahci [ 5.020351] scsi host2: ahci [ 5.020850] scsi host3: ahci [ 5.020899] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 33 [ 5.020902] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 33 [ 5.020904] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 33 [ 5.020907] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 33 [ 5.021230] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.021234] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.023440] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.028381] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:34:f4 [ 5.02845] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.043575] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 5.047497] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.080084] scsi host4: ahci [ 5.082110] i2c i2c-1: 2/8 memory slots populated (from DMI) [ 5.084220] scsi host5: ahci [ 5.086988] i2c i2c-1: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 5.104152] igb 0000:07:00.1: added PHC on eth1 [ 5.105120] scsi host6: ahci [ 5.112435] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 5.120067] scsi host7: ahci [ 5.128169] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:34:f5 [ 5.135962] scsi host8: ahci [ 5.141726] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 5.148962] scsi host9: ahci [ 5.154067] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.231967] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 54 [ 5.239450] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 54 [ 5.246928] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 54 [ 5.254408] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 54 [ 5.261891] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 54 [ 5.269390] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 54 [ 5.283638] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 5.330417] ata1: SATA link down (SStatus 0 SControl 300) [ 5.335901] ata4: SATA link down (SStatus 0 SControl 300) [ 5.341398] ata2: SATA link down (SStatus 0 SControl 300) [ 5.346884] ata3: SATA link down (SStatus 0 SControl 300) [ 5.435936] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.444304] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.452052] hub 3-12:1.0: USB hub found [ 5.456041] hub 3-12:1.0: 4 ports detected [ 5.590738] ata8: SATA link down (SStatus 0 SControl 300) [ 5.596224] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.602513] ata6: SATA link down (SStatus 0 SControl 300) [ 5.608011] ata9: SATA link down (SStatus 0 SControl 300) [ 5.613513] ata10: SATA link down (SStatus 0 SControl 300) [ 5.619106] ata7: SATA link down (SStatus 0 SControl 300) [ 5.624763] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.631620] ata5.00: NCQ Send/Recv Log not supported [ 5.636669] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.645239] ata5.00: NCQ Send/Recv Log not supported [ 5.650294] ata5.00: configured for UDMA/133 [ 5.654909] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 5.663418] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.6634512-byte logical5.676567] sd 4:0:0:0: [sda] Write Protect is off [ 5.681440] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.705094] sda: sda1 [ 5.707732] sd 4:0:0:0: [sda] Attached SCSI disk [ 5.713949] igb 0000:07:00.0 eno1: renamed from eth0 [ 5.744106] igb 0000:07:00.1 eno2: renamed from eth1 [ 5.771684] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 5.904053] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 5.912597] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.930762] hid: raw HID events driver (C) Jiri Kosina [ 5.939263] usbcore: registered new interface driver usbhid [ 5.944916] usbhid: USB HID core driver [ 5.951039] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.019908] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.031908] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.043814] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 6.220452] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.238931] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.247549] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 6.253804] ixgbe 0000:03:00.0: 0c:c4:7a:88:73:f2 [ 6.262178] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 6.432407] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.442805] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.451428] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.458550] ixgbe 0000:03:00.1: 0c:c4:7a:88:73:f3 [ 6.466928] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.475722] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 6.500289] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.37.2 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: recovering journal /dev/sda1: Clearing orphaned inode 24691 (uid=0, gid=0, mode=0100644, size=4447536) /dev/sda1: clean, 199176/61054976 files, 7051647/244190336 blocks done. [ 14.120508] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 14.906294] systemd[1]: Inserted module 'autofs4' [ 15.008735] systemd[1]: systemd 249.11-0ubuntu3.6 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 15.059866] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 22.04.1 LTS! [ 15.103720] systemd[1]: Hostname set to . [ 16.483117] systemd[1]: Queued start job for default target Graphical Interface. [ 16.491868] systemd[1]: Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/modprobe. [ 16.512056] systemd[1]: Created slice Slice /system/serial-getty. [ OK ] Created slice Slice /system/serial-getty. [ 16.536346] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 16.559853] systemd[1]: Started ntp-systemd-netif.path. [ OK ] Started ntp-systemd-netif.path. [ 16.579900] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 16.604110] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 16.631819] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 16.659786] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 16.687811] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 16.715769] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 16.743802] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 16.771774] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 16.799864] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 16.823810] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 16.843800] systemd[1]: Reached target Local Verity Protected Volumes. [ OK ] Reached target Local Verity Protected Volumes. [ 16.867910] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 16.892040] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 16.918010] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 16.944023] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 16.963998] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 16.987886] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 17.012254] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 17.032012] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 17.056045] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 17.076161] systemd[1]: Listening on Network Service Netlink Socket. [ OK ] Listening on Network Service Netlink Socket. [ 17.100070] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 17.119974] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 17.141453] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 17.161470] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 17.185227] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 17.209408] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 17.229573] systemd[1]: Mounting Kernel Trace File System... Mounting Kernel Trace File System... [ 17.250116] RPC: Registered named UNIX socket transport module. [ 17.250992] systemd[1]: Starting Journal Service... [ 17.256112] RPC: Registered udp transport module. [ 17.256114] RPC: Registered tcp transport module. [ 17.256115] RPC: Registered tcp NFSv4.1 backchannel transport module. Starting Journal Service... [ 17.291898] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 17.303102] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 17.325807] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 17.349344] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 17.376699] systemd[1]: Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module chromeos_pstore... [ 17.400357] systemd[1]: Starting Load Kernel Module configfs... Starting Load Kernel Module configfs... [ 17.420681] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 17.440360] systemd[1]: Starting Load Kernel Module efi_pstore... Starting Load Kernel Module efi_pstore... [ 17.464588] systemd[1]: Starting Load Kernel Module fuse... Starting Load Kernel Module fuse... [ 17.484731] systemd[1]: Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_blk... [ 17.508485] systemd[1]: Starting Load Kernel Module pstore_zone... Starting Load Kernel Module pstore_zone... [ 17.532466] systemd[1]: Starting Load Kernel Module ramoops... Starting Load Kernel Module ramoops... [ 17.551722] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 17.561477] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 17.580330] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 17.600839] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 17.624578] systemd[1]: Starting Coldplug All udev Devices... Starting Coldplug All udev Dev[ 17.634039] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr. Quota mode: none. ices... [ 17.653378] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ 17.663873] lp: driver loaded but no devices found [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ 17.708488] Loading iSCSI transport class v2.0-870. [ OK ] Mounted NFSD configuration filesystem. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. Activating swap /swapfile... Mounting FUSE [ 17.986838] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Control File System... Mounting Kernel Configuration File System... Starting Initial Check File System Quotas... Starting Flush Journal to Persistent Storage... [ 18.060173] systemd-journald[370]: Received client request to flush runtime journal. Starting Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished Coldplug All udev Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Reached target Swaps. Starting Helper to synchronize boot up for ifupdown... [ 18.257256] systemd-journald[370]: File /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/system.journal corrupted or uncleanly shut down, renaming and replacing. [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Initial Check File System Quotas. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting Rule-based Manage…for Device Events and Files... Starting Uncomplicated firewall... [ OK ] Finished Set console font and keymap. [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Uncomplicated firewall. [ OK ] Reached target Preparation for Network. [ OK ] Finished Flush Journal to Persistent Storage. Starting Create Volatile Files and Directories... [ OK ] Finished Create Volatile Files and Directories. [ OK ] Finished Load AppArmor profiles. Mounting RPC Pipe File System... Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module efi_pstore... Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_zone... Starting Load Kernel Module ramoops... Starting RPC bind portmap service... Starting Record System Boot/Shutdown in UTMP... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Mounted RPC Pipe File System. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Found device /dev/ttyS1. [ OK ] Started RPC bind portmap service. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Created slice Slice /system/lvm2-pvscan. [ OK ] Reached target rpc_pipefs.target. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Mounting /var/lib/ceph... Starting LVM event activation on device 259:0... Starting pNFS block layout mapping daemon... Starting NFSv4 ID-name mapping service... Starting NFSv4 Client Tracking Daemon... [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target NFS client services. Starting Network Configuration... [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Daily dpkg database backup timer. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API... [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on UUID daemon activation socket. [ OK ] Finished Helper to synchronize boot up for ifupdown. [ OK ] Mounted /var/lib/ceph. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Started pNFS block layout mapping daemon. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Started NFSv4 Client Tracking Daemon. [ OK ] Listening on Docker Socket for the API. [ OK ] Found device 82599ES 10-Gi…ork Connection (AOC-STGN-i2S). [ OK ] Reached target Socket Units. [ OK ] Reached target Basic System. Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started ifup for enp3s0f1. [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting Dispatcher daemon for systemd-networkd... Starting Raise network interfaces... [ OK ] Started ntp-systemd-netif.service. Starting RPC Remote Quota Server... Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting User Login Management... [ OK ] Started Network Configuration. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Finished Record successful boot for GRUB. [ OK ] Started User Login Management. Starting GRUB failed boot detection... [ OK ] Started ntp-systemd-netif.service. [ OK ] Started RPC Remote Quota Server. [ OK ] Started System Logging Service. [ OK ] Finished GRUB failed boot detection. [ OK ] Finished Wait for Network to be Configured. [ OK ] Started ntp-systemd-netif.service. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. [* ] (1 of 4) A start job is running for…r systemd-networkd (8s / 1min 34s) M [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon.  Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Dispatcher daemon for systemd-networkd. [** ] A start job is running for Raise network interfaces (8s / 5min 1s) M [*** ] A start job is running for Raise network interfaces (9s / 5min 1s) M [ OK ] Started ntp-systemd-netif.service. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. [ OK ] Reached target Network is Online. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting Connect NVMe-oF s…s automatically during boot... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr Starting NFS status monitor for NFSv2/3 locking.... ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... Starting Ubuntu FAN network setup... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. [ OK ] Finished Map RBD devices. [ OK ] Finished Availability of block devices. + myips=172.21.15.164 + attempts=1 + sleep 1 [ OK ] Started NFS status monitor for NFSv2/3 locking.. Starting NFS server and services... [ OK ] Started Network Time Service. [ OK ] Finished Ubuntu FAN network setup. [ OK ] Started OpenBSD Secure Shell server. [ OK ] Finished Connect NVMe-oF s…ems automatically during boot. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting The Apache HTTP Server... Starting LSB: Collectl monitors system performance.... [ OK ] Started Regular background program processing daemon. [ OK ] Started Nagios Remote Plugin Executor. Starting LSB: radosgw RESTful rados gateway... Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started LSB: radosgw RESTful rados gateway. [ OK ] Finished NFS server and services. Starting Notify NFS peers of a restart... [ OK ] Started Notify NFS peers of a restart. + '[' 172.21.15.164 '!=' '' ']' + set -e + '[' -n 172.21.15.164 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.164 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.164 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi164.front.sepia.ceph.com + '[' -n smithi164.front.sepia.ceph.com ']' + hostname smithi164.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi164 + echo smithi164 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.164 smithi164.front.sepia.ceph.com smithi164/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started (i)SCSI target daemon. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Finished Set console scheme. [ OK ] Created slice Slice /system/getty. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started The Apache HTTP Server. [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... [ OK ] Started LSB: Collectl monitors system performance.. [ OK ] Started Docker Application Container Engine. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Record Runlevel Change in UTMP... [ OK ] Finished Record Runlevel Change in UTMP. Ubuntu 22.04.1 LTS smithi164.front.sepia.ceph.com ttyS1 2024-09-17T02:24:08.281 DEBUG:teuthology.orchestra.console.smithi164:expect after: smithi164 login: 2024-09-17T02:24:08.333 DEBUG:teuthology.orchestra.console.smithi164:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 73 F3 GUID: 00000000 0000 0000 0000 0CC47AD934F4 DHCP./                    DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ CLIENT IP: 172.21.15.164 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:73:f3)... Configuring (net0 0c:c4:7a:88:73:f3).... Configuring (net0 0c:c4:7a:88:73:f3)..... Configuring (net0 0c:c4:7a:88:73:f3)...... ok  GNU GRUB version 2.04   ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************   Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 4s.  The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     Loading Linux 5.15.0-122-generic ... Loading initial ramdisk ... [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.15.0-122-generic (buildd@lcy02-amd64-034) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #132-Ubuntu SMP Thu Aug 29 13:45:52 UTC 2024 (Ubuntu 5.15.0-122.132-generic 5.15.163) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-122-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.742 MHz processor [ 0.000422] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000603] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001907] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.008294] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.008309] Using GB pages for direct mapping [ 0.008443] RAMDISK: [mem 0x300c3000-0x34058fff] [ 0.008448] ACPI: Early table checksum verification disabled [ 0.008451] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.008455] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.008460] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008465] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.008469] ACPI: FACS 0x0000000079D43F80 000040 [ 0.008471] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008474] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008477] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008480] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.008483] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.008486] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.008489] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008491] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008494] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.008497] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008500] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.008503] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.008506] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.008509] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008512] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008515] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008518] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008520] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008523] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.008524] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.008526] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.008527] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.008528] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.008529] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.008530] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.008531] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.008532] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.008533] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.008534] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.008535] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.008536] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.008536] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.008538] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.008539] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.008540] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.008541] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.008542] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.008543] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.008544] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.008639] No NUMA configuration found [ 0.008640] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.008649] NODE_DATA(0) allocated [mem 0x87ffd6000-0x87fffffff] [ 0.008981] Zone ranges: [ 0.008982] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.008984] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.008985] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.008987] Device empty [ 0.008988] Movable zone start for each node [ 0.008991] Early memory node ranges [ 0.008992] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.008993] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.008995] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.008999] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.009003] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.009038] On node 0, zone DMA: 118 pages in unavailable ranges [ 0.080795] On node 0, zone Normal: 28986 pages in unavailable ranges [ 0.080910] ACPI: PM-Timer IO Port: 0x408 [ 0.080918] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.080919] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.080920] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.080921] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.080922] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.080923] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.080924] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.080925] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.080934] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.080938] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.080941] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.080942] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.080946] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.080947] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.080951] TSC deadline timer available [ 0.080953] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.080962] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.080964] PM: hibernation: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.080965] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.080967] PM: hibernation: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.080968] PM: hibernation: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.080969] PM: hibernation: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.080970] PM: hibernation: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.080971] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.080972] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.080972] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.080973] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.080975] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.080976] Booting paravirtualized kernel on bare hardware [ 0.080978] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.080985] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.081197] percpu: Embedded 62 pages/cpu s217088 r8192 d28672 u262144 [ 0.081227] Built 1 zonelists, mobility grouping on. Total pages: 8228746 [ 0.081229] Policy zone: Normal [ 0.081231] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-122-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.081290] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-122-generic", will be passed to user space. [ 0.083435] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.084575] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.084668] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.171129] Memory: 32672660K/33438012K available (16392K kernel code, 4397K rwdata, 10964K rodata, 3368K init, 18700K bss, 765092K reserved, 0K cma-reserved) [ 0.171418] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.171433] Kernel/User page tables isolation: enabled [ 0.171466] ftrace: allocating 50768 entries in 199 pages [ 0.191720] ftrace: allocated 199 pages with 5 groups [ 0.191848] rcu: Hierarchical RCU implementation. [ 0.191850] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.191851] Rude variant of Tasks RCU enabled. [ 0.191852] Tracing variant of Tasks RCU enabled. [ 0.191853] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.191854] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.195304] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.195503] random: crng init done [ 0.200393] Console: colour VGA+ 80x25 [ 0.211849] printk: console [tty0] enabled [ 1.198850] printk: console [ttyS1] enabled [ 1.203110] ACPI: Core revision 20210730 [ 1.207279] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.216509] APIC: Switch to symmetric I/O mode setup [ 1.221545] DMAR: Host address width 46 [ 1.225448] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.231930] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.240026] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.246367] DMAR: ATSR flags: 0x0 [ 1.249750] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.256094] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.262524] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.268945] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.274414] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.274415] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.289600] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.294975] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.301278] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.324516] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32725d490fa, max_idle_ns: 440795358494 ns [ 1.335131] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.48 BogoMIPS (lpj=13998968) [ 1.339146] CPU0: Thermal monitoring enabled (TM1) [ 1.343181] process: using mwait in idle threads [ 1.347130] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.351129] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.355130] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.359130] Spectre V2 : Mitigation: Retpolines [ 1.363129] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.367129] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.371129] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.375129] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.379129] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.383129] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.387131] MDS: Mitigation: Clear CPU buffers [ 1.391129] TAA: Mitigation: Clear CPU buffers [ 1.395129] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.399134] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.403129] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.407129] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.411129] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.415129] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.437196] Freeing SMP alternatives memory: 44K [ 1.439129] pid_max: default: 32768 minimum: 301 [ 1.443151] LSM: Security Framework initializing [ 1.447137] landlock: Up and running. [ 1.450863] Yama: becoming mindful. [ 1.451145] AppArmor: AppArmor initialized [ 1.455188] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.459168] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.463489] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.467134] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.471238] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.475130] ... version: 3 [ 1.479129] ... bit width: 48 [ 1.483129] ... generic registers: 4 [ 1.487129] ... value mask: 0000ffffffffffff [ 1.491129] ... max period: 00007fffffffffff [ 1.495129] ... fixed-purpose events: 3 [ 1.499129] ... event mask: 000000070000000f [ 1.503189] signal: max sigframe size: 1776 [ 1.507144] rcu: Hierarchical SRCU implementation. [ 1.511850] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.515192] smp: Bringing up secondary CPUs ... [ 1.519211] x86: Booting SMP configuration: [ 1.523131] .... node #0, CPUs: #1 #2 #3 #4 [ 1.531307] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.539129] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.543129] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.547229] #5 #6 #7 [ 1.547773] smp: Brought up 1 node, 8 CPUs [ 1.555131] smpboot: Max logical packages: 1 [ 1.559129] smpboot: Total of 8 processors activated (55995.87 BogoMIPS) [ 1.567450] devtmpfs: initialized [ 1.570550] x86/mm: Memory block size: 128MB [ 1.572722] ACPI: PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.575204] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.579140] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.583174] pinctrl core: initialized pinctrl subsystem [ 1.587219] PM: RTC time: 02:23:32, date: 2024-09-17 [ 1.591235] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.595464] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.599428] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.603460] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.607139] audit: initializing netlink subsys (disabled) [ 1.611148] audit: type=2000 audit(1726539810.352:1): state=initialized audit_enabled=0 res=1 [ 1.611243] thermal_sys: Registered thermal governor 'fair_share' [ 1.615130] thermal_sys: Registered thermal governor 'bang_bang' [ 1.619129] thermal_sys: Registered thermal governor 'step_wise' [ 1.623129] thermal_sys: Registered thermal governor 'user_space' [ 1.627129] thermal_sys: Registered thermal governor 'power_allocator' [ 1.631134] EISA bus registered [ 1.638336] cpuidle: using governor ladder [ 1.639131] cpuidle: using governor menu [ 1.643146] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.647130] ACPI: bus type PCI registered [ 1.651130] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.655185] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.659131] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.663142] PCI: Using configuration type 1 for base access [ 1.668152] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.671145] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.675130] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.679204] ACPI: Added _OSI(Module Device) [ 1.683131] ACPI: Added _OSI(Processor Device) [ 1.687136] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.691129] ACPI: Added _OSI(Processor Aggregator Device) [ 1.695129] ACPI: Added _OSI(Linux-Dell-Video) [ 1.699129] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.703129] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.753148] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.758509] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.763282] ACPI: Dynamic OEM Table Load: [ 1.795043] ACPI: Interpreter enabled [ 1.795140] ACPI: PM: (supports S0 S4 S5) [ 1.799129] ACPI: Using IOAPIC for interrupt routing [ 1.803152] HEST: Enabling Firmware First mode for corrected errors. [ 1.807207] HEST: Table parsing has been initialized. [ 1.811281] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.815131] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.819129] PCI: Using E820 reservations for host bridge windows [ 1.823835] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.860518] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.863133] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.869149] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.872206] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.875129] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.879162] PCI host bridge to bus 0000:ff [ 1.883130] pci_bus 0000:ff: root bus resource [bus ff] [ 1.887139] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.891195] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.895181] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.899184] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.903181] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.907181] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.911179] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.915181] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.919184] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.923180] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.927180] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.931181] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.935182] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.939181] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.943181] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 1.947182] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 1.951183] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 1.955179] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 1.959181] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 1.963153] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 1.967190] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 1.971230] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 1.975193] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 1.979192] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 1.983195] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 1.987193] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 1.991192] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 1.995182] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 1.999183] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 2.003194] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 2.007193] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 2.011193] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 2.015194] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 2.019182] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 2.023182] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 2.027182] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 2.031183] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.035193] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.039192] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.043194] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.047196] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.051186] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.055182] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.059183] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.063188] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.067182] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.071182] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.075185] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.079188] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.083181] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.087181] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.091181] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.095155] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.099182] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.103181] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.111499] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.115131] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 2.119473] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 2.123605] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.127129] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.131427] PCI host bridge to bus 0000:00 [ 2.135130] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.139129] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.143129] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.147129] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.151129] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.155129] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.159129] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.163238] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.167342] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.171195] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.175303] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.179194] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.183296] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.187194] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.191294] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.195148] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.199326] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.203148] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.207324] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.211148] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.215324] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.219148] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.223325] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.227148] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.231326] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.235148] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.239323] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.243148] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.247323] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.251148] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.255275] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.259354] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.263279] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.267301] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.271143] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.275374] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.279424] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.283150] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.287140] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.291140] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.295140] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.299140] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.303140] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.307169] pci 0000:00:11.4: PME# supported from D3hot [ 2.311288] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.315155] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.319206] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.323282] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.327155] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.331206] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.335278] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.339155] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.343206] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.347297] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.351152] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.355234] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.359288] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.363218] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.367294] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.371222] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.375293] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.379221] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.383302] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.387152] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.391233] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.395288] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.399405] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.403148] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.407139] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.411139] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.415139] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.419139] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.423139] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.427163] pci 0000:00:1f.2: PME# supported from D3hot [ 2.431275] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.435154] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.439160] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.443343] acpiphp: Slot [1] registered [ 2.447146] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.451309] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.455149] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.459171] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.463132] pci 0000:02:00.0: enabling Extended Tags [ 2.467234] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.471131] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.475310] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.479151] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.483138] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.487151] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.491139] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.495170] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.499150] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.503129] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.507142] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.511129] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.515292] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.519150] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.523138] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.527151] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.531138] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.535169] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.539146] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.543129] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.547142] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.551129] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.555262] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.559130] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.563130] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.567130] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.571160] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.575195] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.579218] pci 0000:05:00.0: enabling Extended Tags [ 2.583207] pci 0000:05:00.0: supports D1 D2 [ 2.587129] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.591234] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.595131] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.599130] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.603177] pci_bus 0000:06: extended config space not accessible [ 2.607158] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.611162] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.615146] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.619146] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.623213] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.627171] pci 0000:06:00.0: supports D1 D2 [ 2.631129] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.635240] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.639135] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.643132] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.647226] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 2.651156] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 2.655157] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 2.659143] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 2.663264] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 2.667167] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.671130] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.675155] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.679129] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.683304] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 2.687156] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 2.691157] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 2.695143] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 2.699259] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 2.703166] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.707129] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.711155] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.715129] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.719284] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.723131] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.727130] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.731132] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 2.736057] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 2.739179] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 2.743178] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 2.747177] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 2.751178] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 2.755129] ACPI: PCI: Interrupt link LNKE disabled [ 2.759179] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 2.763129] ACPI: PCI: Interrupt link LNKF disabled [ 2.767177] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 2.771129] ACPI: PCI: Interrupt link LNKG disabled [ 2.775177] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 2.779129] ACPI: PCI: Interrupt link LNKH disabled [ 2.783318] iommu: Default domain type: Translated [ 2.787130] iommu: DMA domain TLB invalidation policy: lazy mode [ 2.791254] SCSI subsystem initialized [ 2.795141] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.799128] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.799129] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.803129] vgaarb: loaded [ 2.805910] ACPI: bus type USB registered [ 2.807138] usbcore: registered new interface driver usbfs [ 2.811134] usbcore: registered new interface driver hub [ 2.815133] usbcore: registered new device driver usb [ 2.819147] pps_core: LinuxPPS API ver. 1 registered [ 2.823129] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.827132] PTP clock support registered [ 2.831143] EDAC MC: Ver: 3.0.0 [ 2.834440] NetLabel: Initializing [ 2.835130] NetLabel: domain hash size = 128 [ 2.839129] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.843140] NetLabel: unlabeled traffic allowed by default [ 2.847138] PCI: Using ACPI for IRQ routing [ 2.856367] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.859130] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.865168] clocksource: Switched to clocksource tsc-early [ 2.877330] VFS: Disk quotas dquot_6.6.0 [ 2.881330] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.888366] AppArmor: AppArmor Filesystem Enabled [ 2.893166] pnp: PnP ACPI init [ 2.896752] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.902743] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.908733] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.914720] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.920708] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.926689] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.932680] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.939361] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.946045] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.952728] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.959410] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.966093] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.972777] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.979675] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.985665] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.991652] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.997640] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 3.003622] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.010577] pnp: PnP ACPI: found 5 devices [ 3.020120] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.029117] NET: Registered PF_INET protocol family [ 3.034230] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.043520] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.052343] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 3.060338] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.068745] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.076277] TCP: Hash tables configured (established 262144 bind 65536) [ 3.083101] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 3.090884] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.097903] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.105358] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 3.111085] NET: Registered PF_XDP protocol family [ 3.115963] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.127539] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.135451] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.140494] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.145530] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.152397] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.160049] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.168050] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.175787] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.183877] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.191528] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.199531] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.207267] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.215356] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.223008] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.231010] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.238747] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.246838] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.254490] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.262490] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.270230] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.278318] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.283346] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.289515] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.296372] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.304205] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.309253] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.314282] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.320452] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.327328] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.332621] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.338790] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.345657] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.353493] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.361415] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.369250] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.377172] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.382205] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.388369] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.395224] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.410852] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.417096] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.423345] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.430287] pci_bus 0000:00: resource 7 [mem 0x90000000-0xfbffbfff window] [ 3.437232] pci_bus 0000:00: resource 8 [mem 0xfedb0000-0xfedb000f window] [ 3.444173] pci_bus 0000:00: resource 9 [mem 0xfedc0000-0xfedc000f window] [ 3.451116] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.457451] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.463092] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.469432] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.476741] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.482378] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.488716] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.494356] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.500695] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.506335] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.512672] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.520194] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 3.551711] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x160 took 23652 usecs [ 3.583775] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x160 took 23986 usecs [ 3.591275] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 3.597834] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.597842] Trying to unpack rootfs image as initramfs... [ 3.604341] software IO TLB: mapped [mem 0x0000000074ec6000-0x0000000078ec6000] (64MB) [ 3.618303] Initialise system trusted keyrings [ 3.622827] Key type blacklist registered [ 3.626959] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.634433] zbud: loaded [ 3.637236] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 3.643289] fuse: init (API version 7.34) [ 3.647528] integrity: Platform Keyring initialized [ 3.660410] Key type asymmetric registered [ 3.664580] Asymmetric key parser 'x509' registered [ 3.669552] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) [ 3.677096] io scheduler mq-deadline registered [ 3.682082] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.688122] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.694145] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.700121] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.706104] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.712067] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.718038] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.724958] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 3.730895] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.739366] ACPI: button: Power Button [PWRB] [ 3.743824] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.751344] ACPI: button: Power Button [PWRF] [ 3.757132] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.764704] pstore: Registered erst as persistent store backend [ 3.770829] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 3.797759] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.826693] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.836328] Linux agpgart interface v0.103 [ 3.842178] loop: module loaded [ 3.845611] tun: Universal TUN/TAP device driver, 1.6 [ 3.850755] PPP generic driver version 2.4.2 [ 3.855144] VFIO - User Level meta-driver version: 0.3 [ 3.860444] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 3.867048] ehci-pci: EHCI PCI platform driver [ 3.871715] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.877017] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 3.884512] ehci-pci 0000:00:1a.0: debug port 2 [ 3.893043] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.911667] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.917532] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 3.925887] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.933199] usb usb1: Product: EHCI Host Controller [ 3.938153] usb usb1: Manufacturer: Linux 5.15.0-122-generic ehci_hcd [ 3.944667] usb usb1: SerialNumber: 0000:00:1a.0 [ 3.945193] Freeing initrd memory: 65112K [ 3.949483] hub 1-0:1.0: USB hub found [ 3.957251] hub 1-0:1.0: 2 ports detected [ 3.961572] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.966870] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 3.974360] ehci-pci 0000:00:1d.0: debug port 2 [ 3.982851] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 4.003700] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 4.009548] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.017896] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.025202] usb usb2: Product: EHCI Host Controller [ 4.030142] usb usb2: Manufacturer: Linux 5.15.0-122-generic ehci_hcd [ 4.036647] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.041427] hub 2-0:1.0: USB hub found [ 4.045246] hub 2-0:1.0: 2 ports detected [ 4.049443] ehci-platform: EHCI generic platform driver [ 4.054750] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.060998] ohci-pci: OHCI PCI platform driver [ 4.065526] ohci-platform: OHCI generic platform driver [ 4.070827] uhci_hcd: USB Universal Host Controller Interface driver [ 4.077294] i8042: PNP: No PS/2 controller found. [ 4.082127] mousedev: PS/2 mouse device common for all mice [ 4.087840] rtc_cmos 00:00: RTC can wake from S4 [ 4.092745] rtc_cmos 00:00: registered as rtc0 [ 4.097287] rtc_cmos 00:00: setting system clock to 2024-09-17T02:23:35 UTC (1726539815) [ 4.105488] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 4.112261] i2c_dev: i2c /dev entries driver [ 4.116759] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 4.129039] device-mapper: uevent: version 1.0.3 [ 4.133788] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com [ 4.142329] platform eisa.0: Probing EISA bus 0 [ 4.146929] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 4.153782] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 4.160290] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 4.166798] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 4.173308] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 4.179817] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 4.186326] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 4.192836] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 4.199345] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 4.205855] platform eisa.0: EISA: Detected 0 cards [ 4.210807] intel_pstate: Intel P-state driver initializing [ 4.217512] ledtrig-cpu: registered to indicate activity on CPUs [ 4.223741] drop_monitor: Initializing network drop monitor service [ 4.230182] NET: Registered PF_INET6 protocol family [ 4.240524] Segment Routing with IPv6 [ 4.244261] In-situ OAM (IOAM) with IPv6 [ 4.248263] NET: Registered PF_PACKET protocol family [ 4.253466] Key type dns_resolver registered [ 4.258458] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 4.264453] microcode: Microcode Update Driver: v2.2. [ 4.264521] resctrl: L3 allocation detected [ 4.273879] resctrl: L3 monitoring detected [ 4.278132] IPI shorthand broadcast: enabled [ 4.282481] sched_clock: Marking stable (3218837742, 1063631561)->(5276264529, -993795226) [ 4.291048] registered taskstats version 1 [ 4.295363] Loading compiled-in X.509 certificates [ 4.300769] Loaded X.509 cert 'Build time autogenerated kernel key: cf341c0246f305ce65bb84b8240a4185ace92bf9' [ 4.303662] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.311229] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 4.327660] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 4.337749] blacklist: Loading compiled-in revocation X.509 certificates [ 4.344533] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 4.354458] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 4.364992] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 4.375870] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 4.386400] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 4.397192] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 4.399689] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 4.408010] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 4.425407] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 4.437184] zswap: loaded using pool lzo/zbud [ 4.441897] Key type .fscrypt registered [ 4.445889] Key type fscrypt-provisioning registered [ 4.450977] pstore: Using crash dump compression: deflate [ 4.458428] Key type encrypted registered [ 4.462505] AppArmor: AppArmor sha1 policy hashing enabled [ 4.468068] ima: No TPM chip found, activating TPM-bypass! [ 4.481522] Loading compiled-in module X.509 certificates [ 4.484241] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.487456] Loaded X.509 cert 'Build time autogenerated kernel key: cf341c0246f305ce65bb84b8240a4185ace92bf9' [ 4.495279] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.505290] ima: Allocated hash algorithm: sha1 [ 4.505311] ima: No architecture policies found [ 4.512785] hub 1-1:1.0: USB hub found [ 4.517138] evm: Initialising EVM extended attributes: [ 4.525780] hub 1-1:1.0: 6 ports detected [ 4.530770] evm: security.selinux [ 4.530771] evm: security.SMACK64 [ 4.530771] evm: security.SMACK64EXEC [ 4.530772] evm: security.SMACK64TRANSMUTE [ 4.530772] evm: security.SMACK64MMAP [ 4.530773] evm: security.apparmor [ 4.530773] evm: security.ima [ 4.530773] evm: security.capability [ 4.530774] evm: HMAC attrs: 0x1 [ 4.531053] PM: Magic number: 8:328:359 [ 4.571188] RAS: Correctable Errors collector initialized. [ 4.571994] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 4.576768] clk: Disabling unused clocks [ 4.585036] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.596540] hub 2-1:1.0: USB hub found [ 4.600495] hub 2-1:1.0: 8 ports detected [ 4.600691] Freeing unused decrypted memory: 2036K [ 4.609920] Freeing unused kernel image (initmem) memory: 3368K [ 4.615942] Write protecting the kernel read-only data: 30720k [ 4.622236] Freeing unused kernel image (text/rodata gap) memory: 2036K [ 4.629152] Freeing unused kernel image (rodata/data gap) memory: 1324K [ 4.674692] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.681197] x86/mm: Checking user space page tables [ 4.686149] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 4.692398] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 4.735574] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.742089] clocksource: Switched to clocksource tsc [ 4.742093] Run /init as init process Loading, please wait... Starting version 249.11-0ubuntu3.6 [ 4.895166] dca service started, version 1.12.1 [ 4.902167] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.907499] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 4.915510] nvme nvme0: pci function 0000:02:00.0 [ 4.915728] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 4.915823] igb: Intel(R) Gigabit Ethernet Network Driver [ 4.915825] igb: Copyright (c) 2007-2014 Intel Corporation. [ 4.916087] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 4.916391] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.916395] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 4.916399] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 4.916447] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.916449] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.916451] usb usb3: Product: xHCI Host Controller [ 4.916452] usb usb3: Manufacturer: Linux 5.15.0-122-generic xhci-hcd [ 4.916453] usb usb3: SerialNumber: 0000:00:14.0 [ 4.916572] hub 3-0:1.0: USB hub found [ 4.916600] hub 3-0:1.0: 15 ports detected [ 4.919991] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.15 [ 4.919994] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.919995] usb usb4: Product: xHCI Host Controller [ 4.919997] usb usb4: Manufacturer: Linux 5.15.0-122-generic xhci-hcd [ 4.919998] usb usb4: SerialNumber: 0000:00:14.0 [ 4.920076] hub 4-0:1.0: USB hub found [ 4.920093] hub 4-0:1.0: 6 ports detected [ 4.923204] nvme nvme0: 8/0/0 default/read/poll queues [ 4.928503] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.975640] igb 0000:07:00.0: added PHC on eth0 [ 5.007821] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 5.016155] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.020046] scsi host0: ahci [ 5.020211] scsi host1: ahci [ 5.020351] scsi host2: ahci [ 5.020850] scsi host3: ahci [ 5.020899] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 33 [ 5.020902] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 33 [ 5.020904] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 33 [ 5.020907] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 33 [ 5.021230] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.021234] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.023440] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.028381] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:34:f4 [ 5.02845] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.043575] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 5.047497] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.080084] scsi host4: ahci [ 5.082110] i2c i2c-1: 2/8 memory slots populated (from DMI) [ 5.084220] scsi host5: ahci [ 5.086988] i2c i2c-1: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 5.104152] igb 0000:07:00.1: added PHC on eth1 [ 5.105120] scsi host6: ahci [ 5.112435] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 5.120067] scsi host7: ahci [ 5.128169] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:34:f5 [ 5.135962] scsi host8: ahci [ 5.141726] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 5.148962] scsi host9: ahci [ 5.154067] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.231967] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 54 [ 5.239450] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 54 [ 5.246928] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 54 [ 5.254408] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 54 [ 5.261891] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 54 [ 5.269390] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 54 [ 5.283638] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 5.330417] ata1: SATA link down (SStatus 0 SControl 300) [ 5.335901] ata4: SATA link down (SStatus 0 SControl 300) [ 5.341398] ata2: SATA link down (SStatus 0 SControl 300) [ 5.346884] ata3: SATA link down (SStatus 0 SControl 300) [ 5.435936] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.444304] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.452052] hub 3-12:1.0: USB hub found [ 5.456041] hub 3-12:1.0: 4 ports detected [ 5.590738] ata8: SATA link down (SStatus 0 SControl 300) [ 5.596224] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.602513] ata6: SATA link down (SStatus 0 SControl 300) [ 5.608011] ata9: SATA link down (SStatus 0 SControl 300) [ 5.613513] ata10: SATA link down (SStatus 0 SControl 300) [ 5.619106] ata7: SATA link down (SStatus 0 SControl 300) [ 5.624763] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.631620] ata5.00: NCQ Send/Recv Log not supported [ 5.636669] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.645239] ata5.00: NCQ Send/Recv Log not supported [ 5.650294] ata5.00: configured for UDMA/133 [ 5.654909] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 5.663418] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.6634512-byte logical5.676567] sd 4:0:0:0: [sda] Write Protect is off [ 5.681440] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.705094] sda: sda1 [ 5.707732] sd 4:0:0:0: [sda] Attached SCSI disk [ 5.713949] igb 0000:07:00.0 eno1: renamed from eth0 [ 5.744106] igb 0000:07:00.1 eno2: renamed from eth1 [ 5.771684] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 5.904053] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 5.912597] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.930762] hid: raw HID events driver (C) Jiri Kosina [ 5.939263] usbcore: registered new interface driver usbhid [ 5.944916] usbhid: USB HID core driver [ 5.951039] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.019908] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.031908] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.043814] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 6.220452] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.238931] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.247549] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 6.253804] ixgbe 0000:03:00.0: 0c:c4:7a:88:73:f2 [ 6.262178] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 6.432407] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.442805] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.451428] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.458550] ixgbe 0000:03:00.1: 0c:c4:7a:88:73:f3 [ 6.466928] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.475722] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 6.500289] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.37.2 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: recovering journal /dev/sda1: Clearing orphaned inode 24691 (uid=0, gid=0, mode=0100644, size=4447536) /dev/sda1: clean, 199176/61054976 files, 7051647/244190336 blocks done. [ 14.120508] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 14.906294] systemd[1]: Inserted module 'autofs4' [ 15.008735] systemd[1]: systemd 249.11-0ubuntu3.6 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 15.059866] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 22.04.1 LTS! [ 15.103720] systemd[1]: Hostname set to . [ 16.483117] systemd[1]: Queued start job for default target Graphical Interface. [ 16.491868] systemd[1]: Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/modprobe. [ 16.512056] systemd[1]: Created slice Slice /system/serial-getty. [ OK ] Created slice Slice /system/serial-getty. [ 16.536346] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 16.559853] systemd[1]: Started ntp-systemd-netif.path. [ OK ] Started ntp-systemd-netif.path. [ 16.579900] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 16.604110] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 16.631819] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 16.659786] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 16.687811] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 16.715769] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 16.743802] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 16.771774] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 16.799864] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 16.823810] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 16.843800] systemd[1]: Reached target Local Verity Protected Volumes. [ OK ] Reached target Local Verity Protected Volumes. [ 16.867910] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 16.892040] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 16.918010] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 16.944023] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 16.963998] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 16.987886] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 17.012254] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 17.032012] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 17.056045] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 17.076161] systemd[1]: Listening on Network Service Netlink Socket. [ OK ] Listening on Network Service Netlink Socket. [ 17.100070] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 17.119974] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 17.141453] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 17.161470] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 17.185227] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 17.209408] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 17.229573] systemd[1]: Mounting Kernel Trace File System... Mounting Kernel Trace File System... [ 17.250116] RPC: Registered named UNIX socket transport module. [ 17.250992] systemd[1]: Starting Journal Service... [ 17.256112] RPC: Registered udp transport module. [ 17.256114] RPC: Registered tcp transport module. [ 17.256115] RPC: Registered tcp NFSv4.1 backchannel transport module. Starting Journal Service... [ 17.291898] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 17.303102] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 17.325807] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 17.349344] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 17.376699] systemd[1]: Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module chromeos_pstore... [ 17.400357] systemd[1]: Starting Load Kernel Module configfs... Starting Load Kernel Module configfs... [ 17.420681] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 17.440360] systemd[1]: Starting Load Kernel Module efi_pstore... Starting Load Kernel Module efi_pstore... [ 17.464588] systemd[1]: Starting Load Kernel Module fuse... Starting Load Kernel Module fuse... [ 17.484731] systemd[1]: Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_blk... [ 17.508485] systemd[1]: Starting Load Kernel Module pstore_zone... Starting Load Kernel Module pstore_zone... [ 17.532466] systemd[1]: Starting Load Kernel Module ramoops... Starting Load Kernel Module ramoops... [ 17.551722] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 17.561477] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 17.580330] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 17.600839] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 17.624578] systemd[1]: Starting Coldplug All udev Devices... Starting Coldplug All udev Dev[ 17.634039] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr. Quota mode: none. ices... [ 17.653378] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ 17.663873] lp: driver loaded but no devices found [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ 17.708488] Loading iSCSI transport class v2.0-870. [ OK ] Mounted NFSD configuration filesystem. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. Activating swap /swapfile... Mounting FUSE [ 17.986838] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Control File System... Mounting Kernel Configuration File System... Starting Initial Check File System Quotas... Starting Flush Journal to Persistent Storage... [ 18.060173] systemd-journald[370]: Received client request to flush runtime journal. Starting Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished Coldplug All udev Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Reached target Swaps. Starting Helper to synchronize boot up for ifupdown... [ 18.257256] systemd-journald[370]: File /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/system.journal corrupted or uncleanly shut down, renaming and replacing. [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Initial Check File System Quotas. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting Rule-based Manage…for Device Events and Files... Starting Uncomplicated firewall... [ OK ] Finished Set console font and keymap. [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Uncomplicated firewall. [ OK ] Reached target Preparation for Network. [ OK ] Finished Flush Journal to Persistent Storage. Starting Create Volatile Files and Directories... [ OK ] Finished Create Volatile Files and Directories. [ OK ] Finished Load AppArmor profiles. Mounting RPC Pipe File System... Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module efi_pstore... Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_zone... Starting Load Kernel Module ramoops... Starting RPC bind portmap service... Starting Record System Boot/Shutdown in UTMP... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Mounted RPC Pipe File System. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Found device /dev/ttyS1. [ OK ] Started RPC bind portmap service. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Created slice Slice /system/lvm2-pvscan. [ OK ] Reached target rpc_pipefs.target. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Mounting /var/lib/ceph... Starting LVM event activation on device 259:0... Starting pNFS block layout mapping daemon... Starting NFSv4 ID-name mapping service... Starting NFSv4 Client Tracking Daemon... [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target NFS client services. Starting Network Configuration... [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Daily dpkg database backup timer. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API... [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on UUID daemon activation socket. [ OK ] Finished Helper to synchronize boot up for ifupdown. [ OK ] Mounted /var/lib/ceph. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Started pNFS block layout mapping daemon. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Started NFSv4 Client Tracking Daemon. [ OK ] Listening on Docker Socket for the API. [ OK ] Found device 82599ES 10-Gi…ork Connection (AOC-STGN-i2S). [ OK ] Reached target Socket Units. [ OK ] Reached target Basic System. Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started ifup for enp3s0f1. [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting Dispatcher daemon for systemd-networkd... Starting Raise network interfaces... [ OK ] Started ntp-systemd-netif.service. Starting RPC Remote Quota Server... Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting User Login Management... [ OK ] Started Network Configuration. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Finished Record successful boot for GRUB. [ OK ] Started User Login Management. Starting GRUB failed boot detection... [ OK ] Started ntp-systemd-netif.service. [ OK ] Started RPC Remote Quota Server. [ OK ] Started System Logging Service. [ OK ] Finished GRUB failed boot detection. [ OK ] Finished Wait for Network to be Configured. [ OK ] Started ntp-systemd-netif.service. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. [* ] (1 of 4) A start job is running for…r systemd-networkd (8s / 1min 34s) M [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon.  Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Dispatcher daemon for systemd-networkd. [** ] A start job is running for Raise network interfaces (8s / 5min 1s) M [*** ] A start job is running for Raise network interfaces (9s / 5min 1s) M [ OK ] Started ntp-systemd-netif.service. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. [ OK ] Reached target Network is Online. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting Connect NVMe-oF s…s automatically during boot... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr Starting NFS status monitor for NFSv2/3 locking.... ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... Starting Ubuntu FAN network setup... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. [ OK ] Finished Map RBD devices. [ OK ] Finished Availability of block devices. + myips=172.21.15.164 + attempts=1 + sleep 1 [ OK ] Started NFS status monitor for NFSv2/3 locking.. Starting NFS server and services... [ OK ] Started Network Time Service. [ OK ] Finished Ubuntu FAN network setup. [ OK ] Started OpenBSD Secure Shell server. [ OK ] Finished Connect NVMe-oF s…ems automatically during boot. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting The Apache HTTP Server... Starting LSB: Collectl monitors system performance.... [ OK ] Started Regular background program processing daemon. [ OK ] Started Nagios Remote Plugin Executor. Starting LSB: radosgw RESTful rados gateway... Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started LSB: radosgw RESTful rados gateway. [ OK ] Finished NFS server and services. Starting Notify NFS peers of a restart... [ OK ] Started Notify NFS peers of a restart. + '[' 172.21.15.164 '!=' '' ']' + set -e + '[' -n 172.21.15.164 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.164 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.164 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi164.front.sepia.ceph.com + '[' -n smithi164.front.sepia.ceph.com ']' + hostname smithi164.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi164 + echo smithi164 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.164 smithi164.front.sepia.ceph.com smithi164/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started (i)SCSI target daemon. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Finished Set console scheme. [ OK ] Created slice Slice /system/getty. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started The Apache HTTP Server. [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... [ OK ] Started LSB: Collectl monitors system performance.. [ OK ] Started Docker Application Container Engine. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Record Runlevel Change in UTMP... [ OK ] Finished Record Runlevel Change in UTMP. Ubuntu 22.04.1 LTS smithi164.front.sepia.ceph.com ttyS1 smithi164 login: [disconnect] 2024-09-17T02:24:08.434 INFO:teuthology.misc:Re-opening connections... 2024-09-17T02:24:08.435 INFO:teuthology.misc:trying to connect to ubuntu@smithi164.front.sepia.ceph.com 2024-09-17T02:24:08.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-17T02:24:08.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:24:08.778 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-09-17T02:24:09.264 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-17T02:24:09.264 DEBUG:teuthology.misc:waited 0.829505205154419 2024-09-17T02:24:10.265 DEBUG:tasks.ceph_manager:Mounting data for osd.2 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-17T02:24:10.265 INFO:tasks.ceph_manager:Mounting osd.2: dev: ubuntu@smithi164.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-2, type: xfs, options: ['noatime'] 2024-09-17T02:24:10.265 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-17T02:24:10.812 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~152s 2024-09-17T02:24:16.532 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T02:24:16.559 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-17T02:24:16.560 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-17T02:24:16.604 INFO:tasks.ceph.osd.2:Started 2024-09-17T02:24:16.604 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:24:16.620 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~157s 2024-09-17T02:24:16.735 INFO:teuthology.orchestra.run.smithi164.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-09-17T02:24:16.738 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T02:24:16.738 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-17T02:24:18.404 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:24:18.032+0000 7f93ce0b97c0 -1 Falling back to public interface 2024-09-17T02:24:21.739 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:24:21.868 INFO:teuthology.orchestra.run.smithi164.stderr:no valid command found; 10 closest matches: 2024-09-17T02:24:21.868 INFO:teuthology.orchestra.run.smithi164.stderr:0 2024-09-17T02:24:21.868 INFO:teuthology.orchestra.run.smithi164.stderr:1 2024-09-17T02:24:21.868 INFO:teuthology.orchestra.run.smithi164.stderr:2 2024-09-17T02:24:21.869 INFO:teuthology.orchestra.run.smithi164.stderr:abort 2024-09-17T02:24:21.869 INFO:teuthology.orchestra.run.smithi164.stderr:assert 2024-09-17T02:24:21.869 INFO:teuthology.orchestra.run.smithi164.stderr:bluefs debug_inject_read_zeros 2024-09-17T02:24:21.869 INFO:teuthology.orchestra.run.smithi164.stderr:bluefs files list 2024-09-17T02:24:21.869 INFO:teuthology.orchestra.run.smithi164.stderr:bluefs stats 2024-09-17T02:24:21.869 INFO:teuthology.orchestra.run.smithi164.stderr:bluestore bluefs device info [] 2024-09-17T02:24:21.869 INFO:teuthology.orchestra.run.smithi164.stderr:config diff 2024-09-17T02:24:21.869 INFO:teuthology.orchestra.run.smithi164.stderr:admin_socket: invalid command 2024-09-17T02:24:21.870 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T02:24:21.871 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-17T02:24:22.527 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-17T02:24:26.871 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:24:26.986 INFO:teuthology.orchestra.run.smithi164.stderr:no valid command found; 10 closest matches: 2024-09-17T02:24:26.987 INFO:teuthology.orchestra.run.smithi164.stderr:0 2024-09-17T02:24:26.987 INFO:teuthology.orchestra.run.smithi164.stderr:1 2024-09-17T02:24:26.987 INFO:teuthology.orchestra.run.smithi164.stderr:2 2024-09-17T02:24:26.987 INFO:teuthology.orchestra.run.smithi164.stderr:abort 2024-09-17T02:24:26.987 INFO:teuthology.orchestra.run.smithi164.stderr:assert 2024-09-17T02:24:26.987 INFO:teuthology.orchestra.run.smithi164.stderr:bluestore allocator dump block 2024-09-17T02:24:26.987 INFO:teuthology.orchestra.run.smithi164.stderr:bluestore allocator fragmentation block 2024-09-17T02:24:26.987 INFO:teuthology.orchestra.run.smithi164.stderr:bluestore allocator fragmentation histogram block [] [] 2024-09-17T02:24:26.987 INFO:teuthology.orchestra.run.smithi164.stderr:bluestore allocator score block 2024-09-17T02:24:26.987 INFO:teuthology.orchestra.run.smithi164.stderr:config diff 2024-09-17T02:24:26.988 INFO:teuthology.orchestra.run.smithi164.stderr:admin_socket: invalid command 2024-09-17T02:24:26.989 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T02:24:26.990 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-17T02:24:28.607 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:24:28.232+0000 7f93ce0b97c0 -1 osd.2 50 log_to_monitors true 2024-09-17T02:24:28.778 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-17T02:24:28.404+0000 7f93c1e97640 -1 osd.2 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T02:24:31.990 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T02:24:32.121 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-17T02:24:32.121 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-17T02:24:32.121 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-09-17T02:24:32.121 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-17T02:24:32.137 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-17T02:24:32.706 INFO:teuthology.orchestra.run.smithi001.stderr:reweighted osd.0 to 1 (10000) 2024-09-17T02:24:32.733 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-17T02:24:33.712 INFO:teuthology.orchestra.run.smithi001.stderr:reweighted osd.1 to 1 (10000) 2024-09-17T02:24:33.738 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-17T02:24:34.713 INFO:teuthology.orchestra.run.smithi001.stderr:reweighted osd.2 to 1 (10000) 2024-09-17T02:24:34.739 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-17T02:24:34.739 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:24:35.049 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:24:35.051 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-17T02:24:35.066 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":218,"stamp":"2024-09-17T02:24:34.711367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":202,"acting":202,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":746764,"kb_used_data":2828,"kb_used_omap":10,"kb_used_meta":743861,"kb_avail":282368756,"statfs":{"total":289910292480,"available":289145606144,"internally_reserved":0,"allocated":2895872,"data_stored":2251034,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10343,"internal_metadata":761714585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-25,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.033875"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":150,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.711545+0000","last_change":"2024-09-17T02:24:30.707199+0000","last_active":"2024-09-17T02:24:32.711545+0000","last_peered":"2024-09-17T02:24:32.711545+0000","last_clean":"2024-09-17T02:24:32.711545+0000","last_became_active":"2024-09-17T02:24:30.706528+0000","last_became_peered":"2024-09-17T02:24:30.706528+0000","last_unstale":"2024-09-17T02:24:32.711545+0000","last_undegraded":"2024-09-17T02:24:32.711545+0000","last_fullsized":"2024-09-17T02:24:32.711545+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:19.531357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":120,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.689233+0000","last_change":"2024-09-17T02:20:37.709698+0000","last_active":"2024-09-17T02:24:30.689233+0000","last_peered":"2024-09-17T02:24:30.689233+0000","last_clean":"2024-09-17T02:24:30.689233+0000","last_became_active":"2024-09-17T02:20:37.708951+0000","last_became_peered":"2024-09-17T02:20:37.708951+0000","last_unstale":"2024-09-17T02:24:30.689233+0000","last_undegraded":"2024-09-17T02:24:30.689233+0000","last_fullsized":"2024-09-17T02:24:30.689233+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:30.839358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.348689+0000","last_change":"2024-09-17T02:24:30.339249+0000","last_active":"2024-09-17T02:24:33.348689+0000","last_peered":"2024-09-17T02:24:33.348689+0000","last_clean":"2024-09-17T02:24:33.348689+0000","last_became_active":"2024-09-17T02:24:30.338199+0000","last_became_peered":"2024-09-17T02:24:30.338199+0000","last_unstale":"2024-09-17T02:24:33.348689+0000","last_undegraded":"2024-09-17T02:24:33.348689+0000","last_fullsized":"2024-09-17T02:24:33.348689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:51.734408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":68,"reported_epoch":82,"state":"peering","last_fresh":"2024-09-17T02:24:32.832321+0000","last_change":"2024-09-17T02:24:33.345198+0000","last_active":"2024-09-17T02:24:33.345198+0000","last_peered":"2024-09-17T02:24:32.832321+0000","last_clean":"2024-09-17T02:24:32.832321+0000","last_became_active":"2024-09-17T02:24:30.334825+0000","last_became_peered":"2024-09-17T02:24:30.334825+0000","last_unstale":"2024-09-17T02:24:32.832321+0000","last_undegraded":"2024-09-17T02:24:32.832321+0000","last_fullsized":"2024-09-17T02:24:32.832321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":81,"reported_epoch":78,"state":"active+undersized","last_fresh":"2024-09-17T02:22:39.957929+0000","last_change":"2024-09-17T02:21:35.525199+0000","last_active":"2024-09-17T02:22:39.957929+0000","last_peered":"2024-09-17T02:22:39.957929+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"2024-09-17T02:21:35.525199+0000","last_became_peered":"2024-09-17T02:21:35.525199+0000","last_unstale":"2024-09-17T02:22:39.957929+0000","last_undegraded":"2024-09-17T02:22:39.957929+0000","last_fullsized":"2024-09-17T02:21:35.499010+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:33.632506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.345428+0000","last_change":"2024-09-17T02:24:30.322619+0000","last_active":"2024-09-17T02:24:33.345428+0000","last_peered":"2024-09-17T02:24:33.345428+0000","last_clean":"2024-09-17T02:24:33.345428+0000","last_became_active":"2024-09-17T02:24:30.322191+0000","last_became_peered":"2024-09-17T02:24:30.322191+0000","last_unstale":"2024-09-17T02:24:33.345428+0000","last_undegraded":"2024-09-17T02:24:33.345428+0000","last_fullsized":"2024-09-17T02:24:33.345428+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:26.120304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.342568+0000","last_change":"2024-09-17T02:24:30.330077+0000","last_active":"2024-09-17T02:24:33.342568+0000","last_peered":"2024-09-17T02:24:33.342568+0000","last_clean":"2024-09-17T02:24:33.342568+0000","last_became_active":"2024-09-17T02:24:30.329814+0000","last_became_peered":"2024-09-17T02:24:30.329814+0000","last_unstale":"2024-09-17T02:24:33.342568+0000","last_undegraded":"2024-09-17T02:24:33.342568+0000","last_fullsized":"2024-09-17T02:24:33.342568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:09.933024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.341786+0000","last_change":"2024-09-17T02:24:30.319625+0000","last_active":"2024-09-17T02:24:33.341786+0000","last_peered":"2024-09-17T02:24:33.341786+0000","last_clean":"2024-09-17T02:24:33.341786+0000","last_became_active":"2024-09-17T02:24:30.319316+0000","last_became_peered":"2024-09-17T02:24:30.319316+0000","last_unstale":"2024-09-17T02:24:33.341786+0000","last_undegraded":"2024-09-17T02:24:33.341786+0000","last_fullsized":"2024-09-17T02:24:33.341786+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:30.753462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.689266+0000","last_change":"2024-09-17T02:20:16.584665+0000","last_active":"2024-09-17T02:24:30.689266+0000","last_peered":"2024-09-17T02:24:30.689266+0000","last_clean":"2024-09-17T02:24:30.689266+0000","last_became_active":"2024-09-17T02:20:16.580797+0000","last_became_peered":"2024-09-17T02:20:16.580797+0000","last_unstale":"2024-09-17T02:24:30.689266+0000","last_undegraded":"2024-09-17T02:24:30.689266+0000","last_fullsized":"2024-09-17T02:24:30.689266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:47.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":149,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.711082+0000","last_change":"2024-09-17T02:24:30.699853+0000","last_active":"2024-09-17T02:24:32.711082+0000","last_peered":"2024-09-17T02:24:32.711082+0000","last_clean":"2024-09-17T02:24:32.711082+0000","last_became_active":"2024-09-17T02:24:30.697837+0000","last_became_peered":"2024-09-17T02:24:30.697837+0000","last_unstale":"2024-09-17T02:24:32.711082+0000","last_undegraded":"2024-09-17T02:24:32.711082+0000","last_fullsized":"2024-09-17T02:24:32.711082+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:09.331675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.348405+0000","last_change":"2024-09-17T02:24:30.329180+0000","last_active":"2024-09-17T02:24:33.348405+0000","last_peered":"2024-09-17T02:24:33.348405+0000","last_clean":"2024-09-17T02:24:33.348405+0000","last_became_active":"2024-09-17T02:24:30.328962+0000","last_became_peered":"2024-09-17T02:24:30.328962+0000","last_unstale":"2024-09-17T02:24:33.348405+0000","last_undegraded":"2024-09-17T02:24:33.348405+0000","last_fullsized":"2024-09-17T02:24:33.348405+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:21.425064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.349334+0000","last_change":"2024-09-17T02:24:30.336021+0000","last_active":"2024-09-17T02:24:33.349334+0000","last_peered":"2024-09-17T02:24:33.349334+0000","last_clean":"2024-09-17T02:24:33.349334+0000","last_became_active":"2024-09-17T02:24:30.335245+0000","last_became_peered":"2024-09-17T02:24:30.335245+0000","last_unstale":"2024-09-17T02:24:33.349334+0000","last_undegraded":"2024-09-17T02:24:33.349334+0000","last_fullsized":"2024-09-17T02:24:33.349334+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:12.509297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":120,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.688847+0000","last_change":"2024-09-17T02:20:37.709476+0000","last_active":"2024-09-17T02:24:30.688847+0000","last_peered":"2024-09-17T02:24:30.688847+0000","last_clean":"2024-09-17T02:24:30.688847+0000","last_became_active":"2024-09-17T02:20:37.708730+0000","last_became_peered":"2024-09-17T02:20:37.708730+0000","last_unstale":"2024-09-17T02:24:30.688847+0000","last_undegraded":"2024-09-17T02:24:30.688847+0000","last_fullsized":"2024-09-17T02:24:30.688847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:54.725651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.345178+0000","last_change":"2024-09-17T02:24:30.337132+0000","last_active":"2024-09-17T02:24:33.345178+0000","last_peered":"2024-09-17T02:24:33.345178+0000","last_clean":"2024-09-17T02:24:33.345178+0000","last_became_active":"2024-09-17T02:24:30.335871+0000","last_became_peered":"2024-09-17T02:24:30.335871+0000","last_unstale":"2024-09-17T02:24:33.345178+0000","last_undegraded":"2024-09-17T02:24:33.345178+0000","last_fullsized":"2024-09-17T02:24:33.345178+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:21.006777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.342161+0000","last_change":"2024-09-17T02:24:30.335635+0000","last_active":"2024-09-17T02:24:33.342161+0000","last_peered":"2024-09-17T02:24:33.342161+0000","last_clean":"2024-09-17T02:24:33.342161+0000","last_became_active":"2024-09-17T02:24:30.335086+0000","last_became_peered":"2024-09-17T02:24:30.335086+0000","last_unstale":"2024-09-17T02:24:33.342161+0000","last_undegraded":"2024-09-17T02:24:33.342161+0000","last_fullsized":"2024-09-17T02:24:33.342161+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:01.913411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.343734+0000","last_change":"2024-09-17T02:24:30.325322+0000","last_active":"2024-09-17T02:24:33.343734+0000","last_peered":"2024-09-17T02:24:33.343734+0000","last_clean":"2024-09-17T02:24:33.343734+0000","last_became_active":"2024-09-17T02:24:30.325002+0000","last_became_peered":"2024-09-17T02:24:30.325002+0000","last_unstale":"2024-09-17T02:24:33.343734+0000","last_undegraded":"2024-09-17T02:24:33.343734+0000","last_fullsized":"2024-09-17T02:24:33.343734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:16.238014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.690369+0000","last_change":"2024-09-17T02:20:16.563482+0000","last_active":"2024-09-17T02:24:30.690369+0000","last_peered":"2024-09-17T02:24:30.690369+0000","last_clean":"2024-09-17T02:24:30.690369+0000","last_became_active":"2024-09-17T02:20:16.562735+0000","last_became_peered":"2024-09-17T02:20:16.562735+0000","last_unstale":"2024-09-17T02:24:30.690369+0000","last_undegraded":"2024-09-17T02:24:30.690369+0000","last_fullsized":"2024-09-17T02:24:30.690369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:10.315951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":120,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.689767+0000","last_change":"2024-09-17T02:20:37.706162+0000","last_active":"2024-09-17T02:24:30.689767+0000","last_peered":"2024-09-17T02:24:30.689767+0000","last_clean":"2024-09-17T02:24:30.689767+0000","last_became_active":"2024-09-17T02:20:37.705497+0000","last_became_peered":"2024-09-17T02:20:37.705497+0000","last_unstale":"2024-09-17T02:24:30.689767+0000","last_undegraded":"2024-09-17T02:24:30.689767+0000","last_fullsized":"2024-09-17T02:24:30.689767+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:43.467659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.689421+0000","last_change":"2024-09-17T02:20:16.586950+0000","last_active":"2024-09-17T02:24:30.689421+0000","last_peered":"2024-09-17T02:24:30.689421+0000","last_clean":"2024-09-17T02:24:30.689421+0000","last_became_active":"2024-09-17T02:20:16.586281+0000","last_became_peered":"2024-09-17T02:20:16.586281+0000","last_unstale":"2024-09-17T02:24:30.689421+0000","last_undegraded":"2024-09-17T02:24:30.689421+0000","last_fullsized":"2024-09-17T02:24:30.689421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:22.801598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.349235+0000","last_change":"2024-09-17T02:24:30.330312+0000","last_active":"2024-09-17T02:24:33.349235+0000","last_peered":"2024-09-17T02:24:33.349235+0000","last_clean":"2024-09-17T02:24:33.349235+0000","last_became_active":"2024-09-17T02:24:30.329980+0000","last_became_peered":"2024-09-17T02:24:30.329980+0000","last_unstale":"2024-09-17T02:24:33.349235+0000","last_undegraded":"2024-09-17T02:24:33.349235+0000","last_fullsized":"2024-09-17T02:24:33.349235+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:53.422140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"peering","last_fresh":"2024-09-17T02:24:32.832054+0000","last_change":"2024-09-17T02:24:33.343284+0000","last_active":"2024-09-17T02:24:33.343284+0000","last_peered":"2024-09-17T02:24:32.832054+0000","last_clean":"2024-09-17T02:24:32.832054+0000","last_became_active":"2024-09-17T02:24:30.326057+0000","last_became_peered":"2024-09-17T02:24:30.326057+0000","last_unstale":"2024-09-17T02:24:32.832054+0000","last_undegraded":"2024-09-17T02:24:32.832054+0000","last_fullsized":"2024-09-17T02:24:32.832054+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":144,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.710157+0000","last_change":"2024-09-17T02:24:30.702500+0000","last_active":"2024-09-17T02:24:32.710157+0000","last_peered":"2024-09-17T02:24:32.710157+0000","last_clean":"2024-09-17T02:24:32.710157+0000","last_became_active":"2024-09-17T02:24:30.700674+0000","last_became_peered":"2024-09-17T02:24:30.700674+0000","last_unstale":"2024-09-17T02:24:32.710157+0000","last_undegraded":"2024-09-17T02:24:32.710157+0000","last_fullsized":"2024-09-17T02:24:32.710157+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:47.554275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.700096+0000","last_change":"2024-09-17T02:24:30.700096+0000","last_active":"2024-09-17T02:24:30.700096+0000","last_peered":"2024-09-17T02:24:30.700096+0000","last_clean":"2024-09-17T02:24:30.700096+0000","last_became_active":"2024-09-17T02:24:30.698022+0000","last_became_peered":"2024-09-17T02:24:30.698022+0000","last_unstale":"2024-09-17T02:24:30.700096+0000","last_undegraded":"2024-09-17T02:24:30.700096+0000","last_fullsized":"2024-09-17T02:24:30.700096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:53.002528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":120,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.689320+0000","last_change":"2024-09-17T02:20:37.710222+0000","last_active":"2024-09-17T02:24:30.689320+0000","last_peered":"2024-09-17T02:24:30.689320+0000","last_clean":"2024-09-17T02:24:30.689320+0000","last_became_active":"2024-09-17T02:20:37.709227+0000","last_became_peered":"2024-09-17T02:20:37.709227+0000","last_unstale":"2024-09-17T02:24:30.689320+0000","last_undegraded":"2024-09-17T02:24:30.689320+0000","last_fullsized":"2024-09-17T02:24:30.689320+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:01:44.250550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":144,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.711682+0000","last_change":"2024-09-17T02:24:30.704846+0000","last_active":"2024-09-17T02:24:32.711682+0000","last_peered":"2024-09-17T02:24:32.711682+0000","last_clean":"2024-09-17T02:24:32.711682+0000","last_became_active":"2024-09-17T02:24:30.703377+0000","last_became_peered":"2024-09-17T02:24:30.703377+0000","last_unstale":"2024-09-17T02:24:32.711682+0000","last_undegraded":"2024-09-17T02:24:32.711682+0000","last_fullsized":"2024-09-17T02:24:32.711682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:21.642002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.696851+0000","last_change":"2024-09-17T02:24:30.696851+0000","last_active":"2024-09-17T02:24:30.696851+0000","last_peered":"2024-09-17T02:24:30.696851+0000","last_clean":"2024-09-17T02:24:30.696851+0000","last_became_active":"2024-09-17T02:24:30.694853+0000","last_became_peered":"2024-09-17T02:24:30.694853+0000","last_unstale":"2024-09-17T02:24:30.696851+0000","last_undegraded":"2024-09-17T02:24:30.696851+0000","last_fullsized":"2024-09-17T02:24:30.696851+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:39.353246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.348102+0000","last_change":"2024-09-17T02:24:30.339430+0000","last_active":"2024-09-17T02:24:33.348102+0000","last_peered":"2024-09-17T02:24:33.348102+0000","last_clean":"2024-09-17T02:24:33.348102+0000","last_became_active":"2024-09-17T02:24:30.338488+0000","last_became_peered":"2024-09-17T02:24:30.338488+0000","last_unstale":"2024-09-17T02:24:33.348102+0000","last_undegraded":"2024-09-17T02:24:33.348102+0000","last_fullsized":"2024-09-17T02:24:33.348102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:26.554742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.345943+0000","last_change":"2024-09-17T02:24:30.335659+0000","last_active":"2024-09-17T02:24:33.345943+0000","last_peered":"2024-09-17T02:24:33.345943+0000","last_clean":"2024-09-17T02:24:33.345943+0000","last_became_active":"2024-09-17T02:24:30.335243+0000","last_became_peered":"2024-09-17T02:24:30.335243+0000","last_unstale":"2024-09-17T02:24:33.345943+0000","last_undegraded":"2024-09-17T02:24:33.345943+0000","last_fullsized":"2024-09-17T02:24:33.345943+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:59.178360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":63,"reported_epoch":78,"state":"active+undersized","last_fresh":"2024-09-17T02:22:39.955770+0000","last_change":"2024-09-17T02:21:35.504429+0000","last_active":"2024-09-17T02:22:39.955770+0000","last_peered":"2024-09-17T02:22:39.955770+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"2024-09-17T02:21:35.504429+0000","last_became_peered":"2024-09-17T02:21:35.504429+0000","last_unstale":"2024-09-17T02:22:39.955770+0000","last_undegraded":"2024-09-17T02:22:39.955770+0000","last_fullsized":"2024-09-17T02:21:35.495718+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:35.227137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":145,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.710875+0000","last_change":"2024-09-17T02:24:30.700893+0000","last_active":"2024-09-17T02:24:32.710875+0000","last_peered":"2024-09-17T02:24:32.710875+0000","last_clean":"2024-09-17T02:24:32.710875+0000","last_became_active":"2024-09-17T02:24:30.699410+0000","last_became_peered":"2024-09-17T02:24:30.699410+0000","last_unstale":"2024-09-17T02:24:32.710875+0000","last_undegraded":"2024-09-17T02:24:32.710875+0000","last_fullsized":"2024-09-17T02:24:32.710875+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:29.137738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":62,"reported_epoch":78,"state":"active+undersized","last_fresh":"2024-09-17T02:22:39.951873+0000","last_change":"2024-09-17T02:21:35.515641+0000","last_active":"2024-09-17T02:22:39.951873+0000","last_peered":"2024-09-17T02:22:39.951873+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"2024-09-17T02:21:35.515641+0000","last_became_peered":"2024-09-17T02:21:35.515641+0000","last_unstale":"2024-09-17T02:22:39.951873+0000","last_undegraded":"2024-09-17T02:22:39.951873+0000","last_fullsized":"2024-09-17T02:21:35.493982+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:19.243921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"peering","last_fresh":"2024-09-17T02:24:32.831104+0000","last_change":"2024-09-17T02:24:33.342836+0000","last_active":"2024-09-17T02:24:33.342836+0000","last_peered":"2024-09-17T02:24:32.831104+0000","last_clean":"2024-09-17T02:24:32.831104+0000","last_became_active":"2024-09-17T02:24:30.337401+0000","last_became_peered":"2024-09-17T02:24:30.337401+0000","last_unstale":"2024-09-17T02:24:32.831104+0000","last_undegraded":"2024-09-17T02:24:32.831104+0000","last_fullsized":"2024-09-17T02:24:32.831104+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":81,"reported_epoch":78,"state":"active+undersized","last_fresh":"2024-09-17T02:22:39.953144+0000","last_change":"2024-09-17T02:21:35.515253+0000","last_active":"2024-09-17T02:22:39.953144+0000","last_peered":"2024-09-17T02:22:39.953144+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"2024-09-17T02:21:35.515253+0000","last_became_peered":"2024-09-17T02:21:35.515253+0000","last_unstale":"2024-09-17T02:22:39.953144+0000","last_undegraded":"2024-09-17T02:22:39.953144+0000","last_fullsized":"2024-09-17T02:21:35.501233+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:44.804845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.346005+0000","last_change":"2024-09-17T02:24:30.329201+0000","last_active":"2024-09-17T02:24:33.346005+0000","last_peered":"2024-09-17T02:24:33.346005+0000","last_clean":"2024-09-17T02:24:33.346005+0000","last_became_active":"2024-09-17T02:24:30.328907+0000","last_became_peered":"2024-09-17T02:24:30.328907+0000","last_unstale":"2024-09-17T02:24:33.346005+0000","last_undegraded":"2024-09-17T02:24:33.346005+0000","last_fullsized":"2024-09-17T02:24:33.346005+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:31.463647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":149,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.711710+0000","last_change":"2024-09-17T02:24:30.701022+0000","last_active":"2024-09-17T02:24:32.711710+0000","last_peered":"2024-09-17T02:24:32.711710+0000","last_clean":"2024-09-17T02:24:32.711710+0000","last_became_active":"2024-09-17T02:24:30.697260+0000","last_became_peered":"2024-09-17T02:24:30.697260+0000","last_unstale":"2024-09-17T02:24:32.711710+0000","last_undegraded":"2024-09-17T02:24:32.711710+0000","last_fullsized":"2024-09-17T02:24:32.711710+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:33.937384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":64,"reported_epoch":78,"state":"active+undersized","last_fresh":"2024-09-17T02:22:39.952048+0000","last_change":"2024-09-17T02:21:35.502703+0000","last_active":"2024-09-17T02:22:39.952048+0000","last_peered":"2024-09-17T02:22:39.952048+0000","last_clean":"2024-09-17T02:20:14.516708+0000","last_became_active":"2024-09-17T02:21:35.502703+0000","last_became_peered":"2024-09-17T02:21:35.502703+0000","last_unstale":"2024-09-17T02:22:39.952048+0000","last_undegraded":"2024-09-17T02:22:39.952048+0000","last_fullsized":"2024-09-17T02:21:35.493481+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:06:14.731289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":64,"reported_epoch":78,"state":"active+undersized","last_fresh":"2024-09-17T02:22:39.953444+0000","last_change":"2024-09-17T02:21:35.502713+0000","last_active":"2024-09-17T02:22:39.953444+0000","last_peered":"2024-09-17T02:22:39.953444+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"2024-09-17T02:21:35.502713+0000","last_became_peered":"2024-09-17T02:21:35.502713+0000","last_unstale":"2024-09-17T02:22:39.953444+0000","last_undegraded":"2024-09-17T02:22:39.953444+0000","last_fullsized":"2024-09-17T02:21:35.494355+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:13.449935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":146,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.709973+0000","last_change":"2024-09-17T02:24:30.702653+0000","last_active":"2024-09-17T02:24:32.709973+0000","last_peered":"2024-09-17T02:24:32.709973+0000","last_clean":"2024-09-17T02:24:32.709973+0000","last_became_active":"2024-09-17T02:24:30.701047+0000","last_became_peered":"2024-09-17T02:24:30.701047+0000","last_unstale":"2024-09-17T02:24:32.709973+0000","last_undegraded":"2024-09-17T02:24:32.709973+0000","last_fullsized":"2024-09-17T02:24:32.709973+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:26.569439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.698841+0000","last_change":"2024-09-17T02:24:30.698841+0000","last_active":"2024-09-17T02:24:30.698841+0000","last_peered":"2024-09-17T02:24:30.698841+0000","last_clean":"2024-09-17T02:24:30.698841+0000","last_became_active":"2024-09-17T02:24:30.697606+0000","last_became_peered":"2024-09-17T02:24:30.697606+0000","last_unstale":"2024-09-17T02:24:30.698841+0000","last_undegraded":"2024-09-17T02:24:30.698841+0000","last_fullsized":"2024-09-17T02:24:30.698841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:20.038861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.339904+0000","last_change":"2024-09-17T02:24:30.336630+0000","last_active":"2024-09-17T02:24:33.339904+0000","last_peered":"2024-09-17T02:24:33.339904+0000","last_clean":"2024-09-17T02:24:33.339904+0000","last_became_active":"2024-09-17T02:24:30.336326+0000","last_became_peered":"2024-09-17T02:24:30.336326+0000","last_unstale":"2024-09-17T02:24:33.339904+0000","last_undegraded":"2024-09-17T02:24:33.339904+0000","last_fullsized":"2024-09-17T02:24:33.339904+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:30.072709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.348135+0000","last_change":"2024-09-17T02:24:30.336771+0000","last_active":"2024-09-17T02:24:33.348135+0000","last_peered":"2024-09-17T02:24:33.348135+0000","last_clean":"2024-09-17T02:24:33.348135+0000","last_became_active":"2024-09-17T02:24:30.336494+0000","last_became_peered":"2024-09-17T02:24:30.336494+0000","last_unstale":"2024-09-17T02:24:33.348135+0000","last_undegraded":"2024-09-17T02:24:33.348135+0000","last_fullsized":"2024-09-17T02:24:33.348135+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:17.852502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.344647+0000","last_change":"2024-09-17T02:24:30.338523+0000","last_active":"2024-09-17T02:24:33.344647+0000","last_peered":"2024-09-17T02:24:33.344647+0000","last_clean":"2024-09-17T02:24:33.344647+0000","last_became_active":"2024-09-17T02:24:30.337726+0000","last_became_peered":"2024-09-17T02:24:30.337726+0000","last_unstale":"2024-09-17T02:24:33.344647+0000","last_undegraded":"2024-09-17T02:24:33.344647+0000","last_fullsized":"2024-09-17T02:24:33.344647+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:33.124995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":148,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.711685+0000","last_change":"2024-09-17T02:24:30.697584+0000","last_active":"2024-09-17T02:24:32.711685+0000","last_peered":"2024-09-17T02:24:32.711685+0000","last_clean":"2024-09-17T02:24:32.711685+0000","last_became_active":"2024-09-17T02:24:30.695140+0000","last_became_peered":"2024-09-17T02:24:30.695140+0000","last_unstale":"2024-09-17T02:24:32.711685+0000","last_undegraded":"2024-09-17T02:24:32.711685+0000","last_fullsized":"2024-09-17T02:24:32.711685+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:07.386102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":120,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.690726+0000","last_change":"2024-09-17T02:20:37.705585+0000","last_active":"2024-09-17T02:24:30.690726+0000","last_peered":"2024-09-17T02:24:30.690726+0000","last_clean":"2024-09-17T02:24:30.690726+0000","last_became_active":"2024-09-17T02:20:37.705266+0000","last_became_peered":"2024-09-17T02:20:37.705266+0000","last_unstale":"2024-09-17T02:24:30.690726+0000","last_undegraded":"2024-09-17T02:24:30.690726+0000","last_fullsized":"2024-09-17T02:24:30.690726+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:10:51.092163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.345869+0000","last_change":"2024-09-17T02:24:30.338939+0000","last_active":"2024-09-17T02:24:33.345869+0000","last_peered":"2024-09-17T02:24:33.345869+0000","last_clean":"2024-09-17T02:24:33.345869+0000","last_became_active":"2024-09-17T02:24:30.337650+0000","last_became_peered":"2024-09-17T02:24:30.337650+0000","last_unstale":"2024-09-17T02:24:33.345869+0000","last_undegraded":"2024-09-17T02:24:33.345869+0000","last_fullsized":"2024-09-17T02:24:33.345869+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:00.927950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.345686+0000","last_change":"2024-09-17T02:24:30.322785+0000","last_active":"2024-09-17T02:24:33.345686+0000","last_peered":"2024-09-17T02:24:33.345686+0000","last_clean":"2024-09-17T02:24:33.345686+0000","last_became_active":"2024-09-17T02:24:30.322509+0000","last_became_peered":"2024-09-17T02:24:30.322509+0000","last_unstale":"2024-09-17T02:24:33.345686+0000","last_undegraded":"2024-09-17T02:24:33.345686+0000","last_fullsized":"2024-09-17T02:24:33.345686+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:06.381434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.345666+0000","last_change":"2024-09-17T02:24:30.329944+0000","last_active":"2024-09-17T02:24:33.345666+0000","last_peered":"2024-09-17T02:24:33.345666+0000","last_clean":"2024-09-17T02:24:33.345666+0000","last_became_active":"2024-09-17T02:24:30.329642+0000","last_became_peered":"2024-09-17T02:24:30.329642+0000","last_unstale":"2024-09-17T02:24:33.345666+0000","last_undegraded":"2024-09-17T02:24:33.345666+0000","last_fullsized":"2024-09-17T02:24:33.345666+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:39.135831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.699239+0000","last_change":"2024-09-17T02:24:30.699239+0000","last_active":"2024-09-17T02:24:30.699239+0000","last_peered":"2024-09-17T02:24:30.699239+0000","last_clean":"2024-09-17T02:24:30.699239+0000","last_became_active":"2024-09-17T02:24:30.697800+0000","last_became_peered":"2024-09-17T02:24:30.697800+0000","last_unstale":"2024-09-17T02:24:30.699239+0000","last_undegraded":"2024-09-17T02:24:30.699239+0000","last_fullsized":"2024-09-17T02:24:30.699239+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:42.056577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.697486+0000","last_change":"2024-09-17T02:24:30.697486+0000","last_active":"2024-09-17T02:24:30.697486+0000","last_peered":"2024-09-17T02:24:30.697486+0000","last_clean":"2024-09-17T02:24:30.697486+0000","last_became_active":"2024-09-17T02:24:30.696079+0000","last_became_peered":"2024-09-17T02:24:30.696079+0000","last_unstale":"2024-09-17T02:24:30.697486+0000","last_undegraded":"2024-09-17T02:24:30.697486+0000","last_fullsized":"2024-09-17T02:24:30.697486+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:07.222731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.346188+0000","last_change":"2024-09-17T02:24:30.330194+0000","last_active":"2024-09-17T02:24:33.346188+0000","last_peered":"2024-09-17T02:24:33.346188+0000","last_clean":"2024-09-17T02:24:33.346188+0000","last_became_active":"2024-09-17T02:24:30.329676+0000","last_became_peered":"2024-09-17T02:24:30.329676+0000","last_unstale":"2024-09-17T02:24:33.346188+0000","last_undegraded":"2024-09-17T02:24:33.346188+0000","last_fullsized":"2024-09-17T02:24:33.346188+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:50:41.161871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"peering","last_fresh":"2024-09-17T02:24:32.831321+0000","last_change":"2024-09-17T02:24:33.341698+0000","last_active":"2024-09-17T02:24:33.341698+0000","last_peered":"2024-09-17T02:24:32.831321+0000","last_clean":"2024-09-17T02:24:32.831321+0000","last_became_active":"2024-09-17T02:24:30.336497+0000","last_became_peered":"2024-09-17T02:24:30.336497+0000","last_unstale":"2024-09-17T02:24:32.831321+0000","last_undegraded":"2024-09-17T02:24:32.831321+0000","last_fullsized":"2024-09-17T02:24:32.831321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.345583+0000","last_change":"2024-09-17T02:24:30.338531+0000","last_active":"2024-09-17T02:24:33.345583+0000","last_peered":"2024-09-17T02:24:33.345583+0000","last_clean":"2024-09-17T02:24:33.345583+0000","last_became_active":"2024-09-17T02:24:30.336902+0000","last_became_peered":"2024-09-17T02:24:30.336902+0000","last_unstale":"2024-09-17T02:24:33.345583+0000","last_undegraded":"2024-09-17T02:24:33.345583+0000","last_fullsized":"2024-09-17T02:24:33.345583+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:49.660896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.340328+0000","last_change":"2024-09-17T02:24:30.322953+0000","last_active":"2024-09-17T02:24:33.340328+0000","last_peered":"2024-09-17T02:24:33.340328+0000","last_clean":"2024-09-17T02:24:33.340328+0000","last_became_active":"2024-09-17T02:24:30.322780+0000","last_became_peered":"2024-09-17T02:24:30.322780+0000","last_unstale":"2024-09-17T02:24:33.340328+0000","last_undegraded":"2024-09-17T02:24:33.340328+0000","last_fullsized":"2024-09-17T02:24:33.340328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:59:33.087791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.348973+0000","last_change":"2024-09-17T02:24:30.326828+0000","last_active":"2024-09-17T02:24:33.348973+0000","last_peered":"2024-09-17T02:24:33.348973+0000","last_clean":"2024-09-17T02:24:33.348973+0000","last_became_active":"2024-09-17T02:24:30.326227+0000","last_became_peered":"2024-09-17T02:24:30.326227+0000","last_unstale":"2024-09-17T02:24:33.348973+0000","last_undegraded":"2024-09-17T02:24:33.348973+0000","last_fullsized":"2024-09-17T02:24:33.348973+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:53.135460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":120,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.689725+0000","last_change":"2024-09-17T02:20:37.709979+0000","last_active":"2024-09-17T02:24:30.689725+0000","last_peered":"2024-09-17T02:24:30.689725+0000","last_clean":"2024-09-17T02:24:30.689725+0000","last_became_active":"2024-09-17T02:20:37.708736+0000","last_became_peered":"2024-09-17T02:20:37.708736+0000","last_unstale":"2024-09-17T02:24:30.689725+0000","last_undegraded":"2024-09-17T02:24:30.689725+0000","last_fullsized":"2024-09-17T02:24:30.689725+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:03.481029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.690041+0000","last_change":"2024-09-17T02:20:16.583084+0000","last_active":"2024-09-17T02:24:30.690041+0000","last_peered":"2024-09-17T02:24:30.690041+0000","last_clean":"2024-09-17T02:24:30.690041+0000","last_became_active":"2024-09-17T02:20:16.582326+0000","last_became_peered":"2024-09-17T02:20:16.582326+0000","last_unstale":"2024-09-17T02:24:30.690041+0000","last_undegraded":"2024-09-17T02:24:30.690041+0000","last_fullsized":"2024-09-17T02:24:30.690041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:05.049317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":223,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.340149+0000","last_change":"2024-09-17T02:24:30.338760+0000","last_active":"2024-09-17T02:24:33.340149+0000","last_peered":"2024-09-17T02:24:33.340149+0000","last_clean":"2024-09-17T02:24:33.340149+0000","last_became_active":"2024-09-17T02:24:30.338214+0000","last_became_peered":"2024-09-17T02:24:30.338214+0000","last_unstale":"2024-09-17T02:24:33.340149+0000","last_undegraded":"2024-09-17T02:24:33.340149+0000","last_fullsized":"2024-09-17T02:24:33.340149+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_clean_scrub_stamp":"2024-09-17T02:20:03.432050+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:27:29.124652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":47,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.340692+0000","last_change":"2024-09-17T02:24:30.325326+0000","last_active":"2024-09-17T02:24:33.340692+0000","last_peered":"2024-09-17T02:24:33.340692+0000","last_clean":"2024-09-17T02:24:33.340692+0000","last_became_active":"2024-09-17T02:24:30.324910+0000","last_became_peered":"2024-09-17T02:24:30.324910+0000","last_unstale":"2024-09-17T02:24:33.340692+0000","last_undegraded":"2024-09-17T02:24:33.340692+0000","last_fullsized":"2024-09-17T02:24:33.340692+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:52:27.682190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.689869+0000","last_change":"2024-09-17T02:20:15.560646+0000","last_active":"2024-09-17T02:24:30.689869+0000","last_peered":"2024-09-17T02:24:30.689869+0000","last_clean":"2024-09-17T02:24:30.689869+0000","last_became_active":"2024-09-17T02:20:15.559104+0000","last_became_peered":"2024-09-17T02:20:15.559104+0000","last_unstale":"2024-09-17T02:24:30.689869+0000","last_undegraded":"2024-09-17T02:24:30.689869+0000","last_fullsized":"2024-09-17T02:24:30.689869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:44.299986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.346155+0000","last_change":"2024-09-17T02:24:30.339100+0000","last_active":"2024-09-17T02:24:33.346155+0000","last_peered":"2024-09-17T02:24:33.346155+0000","last_clean":"2024-09-17T02:24:33.346155+0000","last_became_active":"2024-09-17T02:24:30.337415+0000","last_became_peered":"2024-09-17T02:24:30.337415+0000","last_unstale":"2024-09-17T02:24:33.346155+0000","last_undegraded":"2024-09-17T02:24:33.346155+0000","last_fullsized":"2024-09-17T02:24:33.346155+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:27.682975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.342403+0000","last_change":"2024-09-17T02:24:30.338621+0000","last_active":"2024-09-17T02:24:33.342403+0000","last_peered":"2024-09-17T02:24:33.342403+0000","last_clean":"2024-09-17T02:24:33.342403+0000","last_became_active":"2024-09-17T02:24:30.338024+0000","last_became_peered":"2024-09-17T02:24:30.338024+0000","last_unstale":"2024-09-17T02:24:33.342403+0000","last_undegraded":"2024-09-17T02:24:33.342403+0000","last_fullsized":"2024-09-17T02:24:33.342403+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:49.985865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.694491+0000","last_change":"2024-09-17T02:24:30.694491+0000","last_active":"2024-09-17T02:24:30.694491+0000","last_peered":"2024-09-17T02:24:30.694491+0000","last_clean":"2024-09-17T02:24:30.694491+0000","last_became_active":"2024-09-17T02:24:30.693653+0000","last_became_peered":"2024-09-17T02:24:30.693653+0000","last_unstale":"2024-09-17T02:24:30.694491+0000","last_undegraded":"2024-09-17T02:24:30.694491+0000","last_fullsized":"2024-09-17T02:24:30.694491+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:12.740030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":137,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.711376+0000","last_change":"2024-09-17T02:20:16.571568+0000","last_active":"2024-09-17T02:24:32.711376+0000","last_peered":"2024-09-17T02:24:32.711376+0000","last_clean":"2024-09-17T02:24:32.711376+0000","last_became_active":"2024-09-17T02:20:16.570622+0000","last_became_peered":"2024-09-17T02:20:16.570622+0000","last_unstale":"2024-09-17T02:24:32.711376+0000","last_undegraded":"2024-09-17T02:24:32.711376+0000","last_fullsized":"2024-09-17T02:24:32.711376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:57.083446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.691232+0000","last_change":"2024-09-17T02:20:12.511823+0000","last_active":"2024-09-17T02:24:30.691232+0000","last_peered":"2024-09-17T02:24:30.691232+0000","last_clean":"2024-09-17T02:24:30.691232+0000","last_became_active":"2024-09-17T02:20:10.497164+0000","last_became_peered":"2024-09-17T02:20:10.497164+0000","last_unstale":"2024-09-17T02:24:30.691232+0000","last_undegraded":"2024-09-17T02:24:30.691232+0000","last_fullsized":"2024-09-17T02:24:30.691232+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:21.242753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081052700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.339863+0000","last_change":"2024-09-17T02:24:30.336354+0000","last_active":"2024-09-17T02:24:33.339863+0000","last_peered":"2024-09-17T02:24:33.339863+0000","last_clean":"2024-09-17T02:24:33.339863+0000","last_became_active":"2024-09-17T02:24:30.336078+0000","last_became_peered":"2024-09-17T02:24:30.336078+0000","last_unstale":"2024-09-17T02:24:33.339863+0000","last_undegraded":"2024-09-17T02:24:33.339863+0000","last_fullsized":"2024-09-17T02:24:33.339863+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:49.027706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":62,"reported_epoch":78,"state":"active+undersized","last_fresh":"2024-09-17T02:22:39.955793+0000","last_change":"2024-09-17T02:21:35.505826+0000","last_active":"2024-09-17T02:22:39.955793+0000","last_peered":"2024-09-17T02:22:39.955793+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"2024-09-17T02:21:35.505826+0000","last_became_peered":"2024-09-17T02:21:35.505826+0000","last_unstale":"2024-09-17T02:22:39.955793+0000","last_undegraded":"2024-09-17T02:22:39.955793+0000","last_fullsized":"2024-09-17T02:21:35.495427+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:45:14.500678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":48,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.340246+0000","last_change":"2024-09-17T02:24:30.333204+0000","last_active":"2024-09-17T02:24:33.340246+0000","last_peered":"2024-09-17T02:24:33.340246+0000","last_clean":"2024-09-17T02:24:33.340246+0000","last_became_active":"2024-09-17T02:24:30.333005+0000","last_became_peered":"2024-09-17T02:24:30.333005+0000","last_unstale":"2024-09-17T02:24:33.340246+0000","last_undegraded":"2024-09-17T02:24:33.340246+0000","last_fullsized":"2024-09-17T02:24:33.340246+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:17.620422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078085399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.346307+0000","last_change":"2024-09-17T02:24:30.329442+0000","last_active":"2024-09-17T02:24:33.346307+0000","last_peered":"2024-09-17T02:24:33.346307+0000","last_clean":"2024-09-17T02:24:33.346307+0000","last_became_active":"2024-09-17T02:24:30.329213+0000","last_became_peered":"2024-09-17T02:24:30.329213+0000","last_unstale":"2024-09-17T02:24:33.346307+0000","last_undegraded":"2024-09-17T02:24:33.346307+0000","last_fullsized":"2024-09-17T02:24:33.346307+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:25.034116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.691532+0000","last_change":"2024-09-17T02:20:16.580184+0000","last_active":"2024-09-17T02:24:30.691532+0000","last_peered":"2024-09-17T02:24:30.691532+0000","last_clean":"2024-09-17T02:24:30.691532+0000","last_became_active":"2024-09-17T02:20:16.578343+0000","last_became_peered":"2024-09-17T02:20:16.578343+0000","last_unstale":"2024-09-17T02:24:30.691532+0000","last_undegraded":"2024-09-17T02:24:30.691532+0000","last_fullsized":"2024-09-17T02:24:30.691532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:42.123535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"peering","last_fresh":"2024-09-17T02:24:32.832397+0000","last_change":"2024-09-17T02:24:33.349018+0000","last_active":"2024-09-17T02:24:33.349018+0000","last_peered":"2024-09-17T02:24:32.832397+0000","last_clean":"2024-09-17T02:24:32.832397+0000","last_became_active":"2024-09-17T02:24:30.336380+0000","last_became_peered":"2024-09-17T02:24:30.336380+0000","last_unstale":"2024-09-17T02:24:32.832397+0000","last_undegraded":"2024-09-17T02:24:32.832397+0000","last_fullsized":"2024-09-17T02:24:32.832397+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.691910+0000","last_change":"2024-09-17T02:20:12.511838+0000","last_active":"2024-09-17T02:24:30.691910+0000","last_peered":"2024-09-17T02:24:30.691910+0000","last_clean":"2024-09-17T02:24:30.691910+0000","last_became_active":"2024-09-17T02:20:10.497049+0000","last_became_peered":"2024-09-17T02:20:10.497049+0000","last_unstale":"2024-09-17T02:24:30.691910+0000","last_undegraded":"2024-09-17T02:24:30.691910+0000","last_fullsized":"2024-09-17T02:24:30.691910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:54.446484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079701100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":145,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.710208+0000","last_change":"2024-09-17T02:24:30.698392+0000","last_active":"2024-09-17T02:24:32.710208+0000","last_peered":"2024-09-17T02:24:32.710208+0000","last_clean":"2024-09-17T02:24:32.710208+0000","last_became_active":"2024-09-17T02:24:30.694944+0000","last_became_peered":"2024-09-17T02:24:30.694944+0000","last_unstale":"2024-09-17T02:24:32.710208+0000","last_undegraded":"2024-09-17T02:24:32.710208+0000","last_fullsized":"2024-09-17T02:24:32.710208+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:06.407404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.691716+0000","last_change":"2024-09-17T02:20:15.559252+0000","last_active":"2024-09-17T02:24:30.691716+0000","last_peered":"2024-09-17T02:24:30.691716+0000","last_clean":"2024-09-17T02:24:30.691716+0000","last_became_active":"2024-09-17T02:20:15.557667+0000","last_became_peered":"2024-09-17T02:20:15.557667+0000","last_unstale":"2024-09-17T02:24:30.691716+0000","last_undegraded":"2024-09-17T02:24:30.691716+0000","last_fullsized":"2024-09-17T02:24:30.691716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:01.292626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":153,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.712148+0000","last_change":"2024-09-17T02:20:12.661034+0000","last_active":"2024-09-17T02:24:32.712148+0000","last_peered":"2024-09-17T02:24:32.712148+0000","last_clean":"2024-09-17T02:24:32.712148+0000","last_became_active":"2024-09-17T02:20:10.497829+0000","last_became_peered":"2024-09-17T02:20:10.497829+0000","last_unstale":"2024-09-17T02:24:32.712148+0000","last_undegraded":"2024-09-17T02:24:32.712148+0000","last_fullsized":"2024-09-17T02:24:32.712148+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:46:27.427685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096944700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.341107+0000","last_change":"2024-09-17T02:24:30.322910+0000","last_active":"2024-09-17T02:24:33.341107+0000","last_peered":"2024-09-17T02:24:33.341107+0000","last_clean":"2024-09-17T02:24:33.341107+0000","last_became_active":"2024-09-17T02:24:30.322632+0000","last_became_peered":"2024-09-17T02:24:30.322632+0000","last_unstale":"2024-09-17T02:24:33.341107+0000","last_undegraded":"2024-09-17T02:24:33.341107+0000","last_fullsized":"2024-09-17T02:24:33.341107+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:03.155286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.690335+0000","last_change":"2024-09-17T02:20:15.558961+0000","last_active":"2024-09-17T02:24:30.690335+0000","last_peered":"2024-09-17T02:24:30.690335+0000","last_clean":"2024-09-17T02:24:30.690335+0000","last_became_active":"2024-09-17T02:20:15.558299+0000","last_became_peered":"2024-09-17T02:20:15.558299+0000","last_unstale":"2024-09-17T02:24:30.690335+0000","last_undegraded":"2024-09-17T02:24:30.690335+0000","last_fullsized":"2024-09-17T02:24:30.690335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:39.709524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.690261+0000","last_change":"2024-09-17T02:20:12.512481+0000","last_active":"2024-09-17T02:24:30.690261+0000","last_peered":"2024-09-17T02:24:30.690261+0000","last_clean":"2024-09-17T02:24:30.690261+0000","last_became_active":"2024-09-17T02:20:10.497021+0000","last_became_peered":"2024-09-17T02:20:10.497021+0000","last_unstale":"2024-09-17T02:24:30.690261+0000","last_undegraded":"2024-09-17T02:24:30.690261+0000","last_fullsized":"2024-09-17T02:24:30.690261+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:41.167283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001400079,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.693811+0000","last_change":"2024-09-17T02:24:30.693811+0000","last_active":"2024-09-17T02:24:30.693811+0000","last_peered":"2024-09-17T02:24:30.693811+0000","last_clean":"2024-09-17T02:24:30.693811+0000","last_became_active":"2024-09-17T02:24:30.691331+0000","last_became_peered":"2024-09-17T02:24:30.691331+0000","last_unstale":"2024-09-17T02:24:30.693811+0000","last_undegraded":"2024-09-17T02:24:30.693811+0000","last_fullsized":"2024-09-17T02:24:30.693811+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:39.446085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.694492+0000","last_change":"2024-09-17T02:24:30.694492+0000","last_active":"2024-09-17T02:24:30.694492+0000","last_peered":"2024-09-17T02:24:30.694492+0000","last_clean":"2024-09-17T02:24:30.694492+0000","last_became_active":"2024-09-17T02:24:30.691770+0000","last_became_peered":"2024-09-17T02:24:30.691770+0000","last_unstale":"2024-09-17T02:24:30.694492+0000","last_undegraded":"2024-09-17T02:24:30.694492+0000","last_fullsized":"2024-09-17T02:24:30.694492+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:01.597617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.341743+0000","last_change":"2024-09-17T02:24:30.336636+0000","last_active":"2024-09-17T02:24:33.341743+0000","last_peered":"2024-09-17T02:24:33.341743+0000","last_clean":"2024-09-17T02:24:33.341743+0000","last_became_active":"2024-09-17T02:24:30.336110+0000","last_became_peered":"2024-09-17T02:24:30.336110+0000","last_unstale":"2024-09-17T02:24:33.341743+0000","last_undegraded":"2024-09-17T02:24:33.341743+0000","last_fullsized":"2024-09-17T02:24:33.341743+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:44.699884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":145,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.709814+0000","last_change":"2024-09-17T02:24:30.700777+0000","last_active":"2024-09-17T02:24:32.709814+0000","last_peered":"2024-09-17T02:24:32.709814+0000","last_clean":"2024-09-17T02:24:32.709814+0000","last_became_active":"2024-09-17T02:24:30.696731+0000","last_became_peered":"2024-09-17T02:24:30.696731+0000","last_unstale":"2024-09-17T02:24:32.709814+0000","last_undegraded":"2024-09-17T02:24:32.709814+0000","last_fullsized":"2024-09-17T02:24:32.709814+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:58.629953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.342788+0000","last_change":"2024-09-17T02:24:30.326364+0000","last_active":"2024-09-17T02:24:33.342788+0000","last_peered":"2024-09-17T02:24:33.342788+0000","last_clean":"2024-09-17T02:24:33.342788+0000","last_became_active":"2024-09-17T02:24:30.325752+0000","last_became_peered":"2024-09-17T02:24:30.325752+0000","last_unstale":"2024-09-17T02:24:33.342788+0000","last_undegraded":"2024-09-17T02:24:33.342788+0000","last_fullsized":"2024-09-17T02:24:33.342788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:33.800584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.340776+0000","last_change":"2024-09-17T02:24:30.325924+0000","last_active":"2024-09-17T02:24:33.340776+0000","last_peered":"2024-09-17T02:24:33.340776+0000","last_clean":"2024-09-17T02:24:33.340776+0000","last_became_active":"2024-09-17T02:24:30.325688+0000","last_became_peered":"2024-09-17T02:24:30.325688+0000","last_unstale":"2024-09-17T02:24:33.340776+0000","last_undegraded":"2024-09-17T02:24:33.340776+0000","last_fullsized":"2024-09-17T02:24:33.340776+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:25.290483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":62,"reported_epoch":78,"state":"active+undersized","last_fresh":"2024-09-17T02:22:39.952732+0000","last_change":"2024-09-17T02:21:35.503507+0000","last_active":"2024-09-17T02:22:39.952732+0000","last_peered":"2024-09-17T02:22:39.952732+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"2024-09-17T02:21:35.503507+0000","last_became_peered":"2024-09-17T02:21:35.503507+0000","last_unstale":"2024-09-17T02:22:39.952732+0000","last_undegraded":"2024-09-17T02:22:39.952732+0000","last_fullsized":"2024-09-17T02:21:35.494741+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:51.679215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.345260+0000","last_change":"2024-09-17T02:24:30.338759+0000","last_active":"2024-09-17T02:24:33.345260+0000","last_peered":"2024-09-17T02:24:33.345260+0000","last_clean":"2024-09-17T02:24:33.345260+0000","last_became_active":"2024-09-17T02:24:30.336906+0000","last_became_peered":"2024-09-17T02:24:30.336906+0000","last_unstale":"2024-09-17T02:24:33.345260+0000","last_undegraded":"2024-09-17T02:24:33.345260+0000","last_fullsized":"2024-09-17T02:24:33.345260+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:09.728346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.343611+0000","last_change":"2024-09-17T02:24:30.325492+0000","last_active":"2024-09-17T02:24:33.343611+0000","last_peered":"2024-09-17T02:24:33.343611+0000","last_clean":"2024-09-17T02:24:33.343611+0000","last_became_active":"2024-09-17T02:24:30.325175+0000","last_became_peered":"2024-09-17T02:24:30.325175+0000","last_unstale":"2024-09-17T02:24:33.343611+0000","last_undegraded":"2024-09-17T02:24:33.343611+0000","last_fullsized":"2024-09-17T02:24:33.343611+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:04.443085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.699551+0000","last_change":"2024-09-17T02:24:30.699551+0000","last_active":"2024-09-17T02:24:30.699551+0000","last_peered":"2024-09-17T02:24:30.699551+0000","last_clean":"2024-09-17T02:24:30.699551+0000","last_became_active":"2024-09-17T02:24:30.697986+0000","last_became_peered":"2024-09-17T02:24:30.697986+0000","last_unstale":"2024-09-17T02:24:30.699551+0000","last_undegraded":"2024-09-17T02:24:30.699551+0000","last_fullsized":"2024-09-17T02:24:30.699551+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:44.939985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.697249+0000","last_change":"2024-09-17T02:24:30.697249+0000","last_active":"2024-09-17T02:24:30.697249+0000","last_peered":"2024-09-17T02:24:30.697249+0000","last_clean":"2024-09-17T02:24:30.697249+0000","last_became_active":"2024-09-17T02:24:30.696215+0000","last_became_peered":"2024-09-17T02:24:30.696215+0000","last_unstale":"2024-09-17T02:24:30.697249+0000","last_undegraded":"2024-09-17T02:24:30.697249+0000","last_fullsized":"2024-09-17T02:24:30.697249+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:07.507822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.690011+0000","last_change":"2024-09-17T02:20:16.577803+0000","last_active":"2024-09-17T02:24:30.690011+0000","last_peered":"2024-09-17T02:24:30.690011+0000","last_clean":"2024-09-17T02:24:30.690011+0000","last_became_active":"2024-09-17T02:20:16.576640+0000","last_became_peered":"2024-09-17T02:20:16.576640+0000","last_unstale":"2024-09-17T02:24:30.690011+0000","last_undegraded":"2024-09-17T02:24:30.690011+0000","last_fullsized":"2024-09-17T02:24:30.690011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:07.190169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":145,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.711800+0000","last_change":"2024-09-17T02:24:30.706739+0000","last_active":"2024-09-17T02:24:32.711800+0000","last_peered":"2024-09-17T02:24:32.711800+0000","last_clean":"2024-09-17T02:24:32.711800+0000","last_became_active":"2024-09-17T02:24:30.706195+0000","last_became_peered":"2024-09-17T02:24:30.706195+0000","last_unstale":"2024-09-17T02:24:32.711800+0000","last_undegraded":"2024-09-17T02:24:32.711800+0000","last_fullsized":"2024-09-17T02:24:32.711800+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:38.782264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":111,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.709938+0000","last_change":"2024-09-17T02:24:30.702619+0000","last_active":"2024-09-17T02:24:32.709938+0000","last_peered":"2024-09-17T02:24:32.709938+0000","last_clean":"2024-09-17T02:24:32.709938+0000","last_became_active":"2024-09-17T02:24:30.700405+0000","last_became_peered":"2024-09-17T02:24:30.700405+0000","last_unstale":"2024-09-17T02:24:32.709938+0000","last_undegraded":"2024-09-17T02:24:32.709938+0000","last_fullsized":"2024-09-17T02:24:32.709938+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:57.681847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.696267+0000","last_change":"2024-09-17T02:24:30.696267+0000","last_active":"2024-09-17T02:24:30.696267+0000","last_peered":"2024-09-17T02:24:30.696267+0000","last_clean":"2024-09-17T02:24:30.696267+0000","last_became_active":"2024-09-17T02:24:30.694027+0000","last_became_peered":"2024-09-17T02:24:30.694027+0000","last_unstale":"2024-09-17T02:24:30.696267+0000","last_undegraded":"2024-09-17T02:24:30.696267+0000","last_fullsized":"2024-09-17T02:24:30.696267+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:56.160158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.697568+0000","last_change":"2024-09-17T02:24:30.697568+0000","last_active":"2024-09-17T02:24:30.697568+0000","last_peered":"2024-09-17T02:24:30.697568+0000","last_clean":"2024-09-17T02:24:30.697568+0000","last_became_active":"2024-09-17T02:24:30.693991+0000","last_became_peered":"2024-09-17T02:24:30.693991+0000","last_unstale":"2024-09-17T02:24:30.697568+0000","last_undegraded":"2024-09-17T02:24:30.697568+0000","last_fullsized":"2024-09-17T02:24:30.697568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:45.636130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":142,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.710845+0000","last_change":"2024-09-17T02:21:10.505967+0000","last_active":"2024-09-17T02:24:32.710845+0000","last_peered":"2024-09-17T02:24:32.710845+0000","last_clean":"2024-09-17T02:24:32.710845+0000","last_became_active":"2024-09-17T02:21:10.505594+0000","last_became_peered":"2024-09-17T02:21:10.505594+0000","last_unstale":"2024-09-17T02:24:32.710845+0000","last_undegraded":"2024-09-17T02:24:32.710845+0000","last_fullsized":"2024-09-17T02:24:32.710845+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:15.782752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":120,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.689352+0000","last_change":"2024-09-17T02:20:37.706393+0000","last_active":"2024-09-17T02:24:30.689352+0000","last_peered":"2024-09-17T02:24:30.689352+0000","last_clean":"2024-09-17T02:24:30.689352+0000","last_became_active":"2024-09-17T02:20:37.705739+0000","last_became_peered":"2024-09-17T02:20:37.705739+0000","last_unstale":"2024-09-17T02:24:30.689352+0000","last_undegraded":"2024-09-17T02:24:30.689352+0000","last_fullsized":"2024-09-17T02:24:30.689352+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:57.361673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":120,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.690797+0000","last_change":"2024-09-17T02:20:37.706175+0000","last_active":"2024-09-17T02:24:30.690797+0000","last_peered":"2024-09-17T02:24:30.690797+0000","last_clean":"2024-09-17T02:24:30.690797+0000","last_became_active":"2024-09-17T02:20:37.705742+0000","last_became_peered":"2024-09-17T02:20:37.705742+0000","last_unstale":"2024-09-17T02:24:30.690797+0000","last_undegraded":"2024-09-17T02:24:30.690797+0000","last_fullsized":"2024-09-17T02:24:30.690797+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:09.959092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":147,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.711303+0000","last_change":"2024-09-17T02:24:30.698237+0000","last_active":"2024-09-17T02:24:32.711303+0000","last_peered":"2024-09-17T02:24:32.711303+0000","last_clean":"2024-09-17T02:24:32.711303+0000","last_became_active":"2024-09-17T02:24:30.697194+0000","last_became_peered":"2024-09-17T02:24:30.697194+0000","last_unstale":"2024-09-17T02:24:32.711303+0000","last_undegraded":"2024-09-17T02:24:32.711303+0000","last_fullsized":"2024-09-17T02:24:32.711303+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:36.697224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"peering","last_fresh":"2024-09-17T02:24:32.832817+0000","last_change":"2024-09-17T02:24:33.348245+0000","last_active":"2024-09-17T02:24:33.348245+0000","last_peered":"2024-09-17T02:24:32.832817+0000","last_clean":"2024-09-17T02:24:32.832817+0000","last_became_active":"2024-09-17T02:24:30.334825+0000","last_became_peered":"2024-09-17T02:24:30.334825+0000","last_unstale":"2024-09-17T02:24:32.832817+0000","last_undegraded":"2024-09-17T02:24:32.832817+0000","last_fullsized":"2024-09-17T02:24:32.832817+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.341050+0000","last_change":"2024-09-17T02:24:30.327080+0000","last_active":"2024-09-17T02:24:33.341050+0000","last_peered":"2024-09-17T02:24:33.341050+0000","last_clean":"2024-09-17T02:24:33.341050+0000","last_became_active":"2024-09-17T02:24:30.326800+0000","last_became_peered":"2024-09-17T02:24:30.326800+0000","last_unstale":"2024-09-17T02:24:33.341050+0000","last_undegraded":"2024-09-17T02:24:33.341050+0000","last_fullsized":"2024-09-17T02:24:33.341050+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:06.072812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.344493+0000","last_change":"2024-09-17T02:24:30.322448+0000","last_active":"2024-09-17T02:24:33.344493+0000","last_peered":"2024-09-17T02:24:33.344493+0000","last_clean":"2024-09-17T02:24:33.344493+0000","last_became_active":"2024-09-17T02:24:30.322156+0000","last_became_peered":"2024-09-17T02:24:30.322156+0000","last_unstale":"2024-09-17T02:24:33.344493+0000","last_undegraded":"2024-09-17T02:24:33.344493+0000","last_fullsized":"2024-09-17T02:24:33.344493+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:46.435146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.340997+0000","last_change":"2024-09-17T02:24:30.336467+0000","last_active":"2024-09-17T02:24:33.340997+0000","last_peered":"2024-09-17T02:24:33.340997+0000","last_clean":"2024-09-17T02:24:33.340997+0000","last_became_active":"2024-09-17T02:24:30.336042+0000","last_became_peered":"2024-09-17T02:24:30.336042+0000","last_unstale":"2024-09-17T02:24:33.340997+0000","last_undegraded":"2024-09-17T02:24:33.340997+0000","last_fullsized":"2024-09-17T02:24:33.340997+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:59.645621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":137,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.710287+0000","last_change":"2024-09-17T02:20:16.570456+0000","last_active":"2024-09-17T02:24:32.710287+0000","last_peered":"2024-09-17T02:24:32.710287+0000","last_clean":"2024-09-17T02:24:32.710287+0000","last_became_active":"2024-09-17T02:20:16.568095+0000","last_became_peered":"2024-09-17T02:20:16.568095+0000","last_unstale":"2024-09-17T02:24:32.710287+0000","last_undegraded":"2024-09-17T02:24:32.710287+0000","last_fullsized":"2024-09-17T02:24:32.710287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:58.329169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.690370+0000","last_change":"2024-09-17T02:20:15.560293+0000","last_active":"2024-09-17T02:24:30.690370+0000","last_peered":"2024-09-17T02:24:30.690370+0000","last_clean":"2024-09-17T02:24:30.690370+0000","last_became_active":"2024-09-17T02:20:15.559074+0000","last_became_peered":"2024-09-17T02:20:15.559074+0000","last_unstale":"2024-09-17T02:24:30.690370+0000","last_undegraded":"2024-09-17T02:24:30.690370+0000","last_fullsized":"2024-09-17T02:24:30.690370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:55.639841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.343294+0000","last_change":"2024-09-17T02:24:30.319629+0000","last_active":"2024-09-17T02:24:33.343294+0000","last_peered":"2024-09-17T02:24:33.343294+0000","last_clean":"2024-09-17T02:24:33.343294+0000","last_became_active":"2024-09-17T02:24:30.319441+0000","last_became_peered":"2024-09-17T02:24:30.319441+0000","last_unstale":"2024-09-17T02:24:33.343294+0000","last_undegraded":"2024-09-17T02:24:33.343294+0000","last_fullsized":"2024-09-17T02:24:33.343294+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:58.379141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":149,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.699964+0000","last_change":"2024-09-17T02:24:30.699964+0000","last_active":"2024-09-17T02:24:30.699964+0000","last_peered":"2024-09-17T02:24:30.699964+0000","last_clean":"2024-09-17T02:24:30.699964+0000","last_became_active":"2024-09-17T02:24:30.699102+0000","last_became_peered":"2024-09-17T02:24:30.699102+0000","last_unstale":"2024-09-17T02:24:30.699964+0000","last_undegraded":"2024-09-17T02:24:30.699964+0000","last_fullsized":"2024-09-17T02:24:30.699964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:19.193516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":121,"acting":121,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5558,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":63,"acting":63,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705722,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361176,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":360190,"kb_avail":94010664,"statfs":{"total":96636764160,"available":96266919936,"internally_reserved":0,"allocated":987136,"data_stored":948729,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":368835013},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":80,"seq":343597383682,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56420,"kb_used_data":976,"kb_used_omap":6,"kb_used_meta":55417,"kb_avail":94315420,"statfs":{"total":96636764160,"available":96578990080,"internally_reserved":0,"allocated":999424,"data_stored":949364,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":7153,"internal_metadata":56747023},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738425,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329168,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94042672,"statfs":{"total":96636764160,"available":96299696128,"internally_reserved":0,"allocated":909312,"data_stored":352941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5558,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T02:24:35.073 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:24:35.423 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:24:35.425 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-17T02:24:35.442 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":218,"stamp":"2024-09-17T02:24:34.711367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":202,"acting":202,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":746764,"kb_used_data":2828,"kb_used_omap":10,"kb_used_meta":743861,"kb_avail":282368756,"statfs":{"total":289910292480,"available":289145606144,"internally_reserved":0,"allocated":2895872,"data_stored":2251034,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10343,"internal_metadata":761714585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-25,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.033875"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":150,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.711545+0000","last_change":"2024-09-17T02:24:30.707199+0000","last_active":"2024-09-17T02:24:32.711545+0000","last_peered":"2024-09-17T02:24:32.711545+0000","last_clean":"2024-09-17T02:24:32.711545+0000","last_became_active":"2024-09-17T02:24:30.706528+0000","last_became_peered":"2024-09-17T02:24:30.706528+0000","last_unstale":"2024-09-17T02:24:32.711545+0000","last_undegraded":"2024-09-17T02:24:32.711545+0000","last_fullsized":"2024-09-17T02:24:32.711545+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:19.531357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":120,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.689233+0000","last_change":"2024-09-17T02:20:37.709698+0000","last_active":"2024-09-17T02:24:30.689233+0000","last_peered":"2024-09-17T02:24:30.689233+0000","last_clean":"2024-09-17T02:24:30.689233+0000","last_became_active":"2024-09-17T02:20:37.708951+0000","last_became_peered":"2024-09-17T02:20:37.708951+0000","last_unstale":"2024-09-17T02:24:30.689233+0000","last_undegraded":"2024-09-17T02:24:30.689233+0000","last_fullsized":"2024-09-17T02:24:30.689233+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:30.839358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.348689+0000","last_change":"2024-09-17T02:24:30.339249+0000","last_active":"2024-09-17T02:24:33.348689+0000","last_peered":"2024-09-17T02:24:33.348689+0000","last_clean":"2024-09-17T02:24:33.348689+0000","last_became_active":"2024-09-17T02:24:30.338199+0000","last_became_peered":"2024-09-17T02:24:30.338199+0000","last_unstale":"2024-09-17T02:24:33.348689+0000","last_undegraded":"2024-09-17T02:24:33.348689+0000","last_fullsized":"2024-09-17T02:24:33.348689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:51.734408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":68,"reported_epoch":82,"state":"peering","last_fresh":"2024-09-17T02:24:32.832321+0000","last_change":"2024-09-17T02:24:33.345198+0000","last_active":"2024-09-17T02:24:33.345198+0000","last_peered":"2024-09-17T02:24:32.832321+0000","last_clean":"2024-09-17T02:24:32.832321+0000","last_became_active":"2024-09-17T02:24:30.334825+0000","last_became_peered":"2024-09-17T02:24:30.334825+0000","last_unstale":"2024-09-17T02:24:32.832321+0000","last_undegraded":"2024-09-17T02:24:32.832321+0000","last_fullsized":"2024-09-17T02:24:32.832321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":81,"reported_epoch":78,"state":"active+undersized","last_fresh":"2024-09-17T02:22:39.957929+0000","last_change":"2024-09-17T02:21:35.525199+0000","last_active":"2024-09-17T02:22:39.957929+0000","last_peered":"2024-09-17T02:22:39.957929+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"2024-09-17T02:21:35.525199+0000","last_became_peered":"2024-09-17T02:21:35.525199+0000","last_unstale":"2024-09-17T02:22:39.957929+0000","last_undegraded":"2024-09-17T02:22:39.957929+0000","last_fullsized":"2024-09-17T02:21:35.499010+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:33.632506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.345428+0000","last_change":"2024-09-17T02:24:30.322619+0000","last_active":"2024-09-17T02:24:33.345428+0000","last_peered":"2024-09-17T02:24:33.345428+0000","last_clean":"2024-09-17T02:24:33.345428+0000","last_became_active":"2024-09-17T02:24:30.322191+0000","last_became_peered":"2024-09-17T02:24:30.322191+0000","last_unstale":"2024-09-17T02:24:33.345428+0000","last_undegraded":"2024-09-17T02:24:33.345428+0000","last_fullsized":"2024-09-17T02:24:33.345428+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:26.120304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.342568+0000","last_change":"2024-09-17T02:24:30.330077+0000","last_active":"2024-09-17T02:24:33.342568+0000","last_peered":"2024-09-17T02:24:33.342568+0000","last_clean":"2024-09-17T02:24:33.342568+0000","last_became_active":"2024-09-17T02:24:30.329814+0000","last_became_peered":"2024-09-17T02:24:30.329814+0000","last_unstale":"2024-09-17T02:24:33.342568+0000","last_undegraded":"2024-09-17T02:24:33.342568+0000","last_fullsized":"2024-09-17T02:24:33.342568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:09.933024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.341786+0000","last_change":"2024-09-17T02:24:30.319625+0000","last_active":"2024-09-17T02:24:33.341786+0000","last_peered":"2024-09-17T02:24:33.341786+0000","last_clean":"2024-09-17T02:24:33.341786+0000","last_became_active":"2024-09-17T02:24:30.319316+0000","last_became_peered":"2024-09-17T02:24:30.319316+0000","last_unstale":"2024-09-17T02:24:33.341786+0000","last_undegraded":"2024-09-17T02:24:33.341786+0000","last_fullsized":"2024-09-17T02:24:33.341786+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:30.753462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.689266+0000","last_change":"2024-09-17T02:20:16.584665+0000","last_active":"2024-09-17T02:24:30.689266+0000","last_peered":"2024-09-17T02:24:30.689266+0000","last_clean":"2024-09-17T02:24:30.689266+0000","last_became_active":"2024-09-17T02:20:16.580797+0000","last_became_peered":"2024-09-17T02:20:16.580797+0000","last_unstale":"2024-09-17T02:24:30.689266+0000","last_undegraded":"2024-09-17T02:24:30.689266+0000","last_fullsized":"2024-09-17T02:24:30.689266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:47.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":149,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.711082+0000","last_change":"2024-09-17T02:24:30.699853+0000","last_active":"2024-09-17T02:24:32.711082+0000","last_peered":"2024-09-17T02:24:32.711082+0000","last_clean":"2024-09-17T02:24:32.711082+0000","last_became_active":"2024-09-17T02:24:30.697837+0000","last_became_peered":"2024-09-17T02:24:30.697837+0000","last_unstale":"2024-09-17T02:24:32.711082+0000","last_undegraded":"2024-09-17T02:24:32.711082+0000","last_fullsized":"2024-09-17T02:24:32.711082+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:09.331675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.348405+0000","last_change":"2024-09-17T02:24:30.329180+0000","last_active":"2024-09-17T02:24:33.348405+0000","last_peered":"2024-09-17T02:24:33.348405+0000","last_clean":"2024-09-17T02:24:33.348405+0000","last_became_active":"2024-09-17T02:24:30.328962+0000","last_became_peered":"2024-09-17T02:24:30.328962+0000","last_unstale":"2024-09-17T02:24:33.348405+0000","last_undegraded":"2024-09-17T02:24:33.348405+0000","last_fullsized":"2024-09-17T02:24:33.348405+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:21.425064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.349334+0000","last_change":"2024-09-17T02:24:30.336021+0000","last_active":"2024-09-17T02:24:33.349334+0000","last_peered":"2024-09-17T02:24:33.349334+0000","last_clean":"2024-09-17T02:24:33.349334+0000","last_became_active":"2024-09-17T02:24:30.335245+0000","last_became_peered":"2024-09-17T02:24:30.335245+0000","last_unstale":"2024-09-17T02:24:33.349334+0000","last_undegraded":"2024-09-17T02:24:33.349334+0000","last_fullsized":"2024-09-17T02:24:33.349334+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:12.509297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":120,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.688847+0000","last_change":"2024-09-17T02:20:37.709476+0000","last_active":"2024-09-17T02:24:30.688847+0000","last_peered":"2024-09-17T02:24:30.688847+0000","last_clean":"2024-09-17T02:24:30.688847+0000","last_became_active":"2024-09-17T02:20:37.708730+0000","last_became_peered":"2024-09-17T02:20:37.708730+0000","last_unstale":"2024-09-17T02:24:30.688847+0000","last_undegraded":"2024-09-17T02:24:30.688847+0000","last_fullsized":"2024-09-17T02:24:30.688847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:54.725651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.345178+0000","last_change":"2024-09-17T02:24:30.337132+0000","last_active":"2024-09-17T02:24:33.345178+0000","last_peered":"2024-09-17T02:24:33.345178+0000","last_clean":"2024-09-17T02:24:33.345178+0000","last_became_active":"2024-09-17T02:24:30.335871+0000","last_became_peered":"2024-09-17T02:24:30.335871+0000","last_unstale":"2024-09-17T02:24:33.345178+0000","last_undegraded":"2024-09-17T02:24:33.345178+0000","last_fullsized":"2024-09-17T02:24:33.345178+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:21.006777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.342161+0000","last_change":"2024-09-17T02:24:30.335635+0000","last_active":"2024-09-17T02:24:33.342161+0000","last_peered":"2024-09-17T02:24:33.342161+0000","last_clean":"2024-09-17T02:24:33.342161+0000","last_became_active":"2024-09-17T02:24:30.335086+0000","last_became_peered":"2024-09-17T02:24:30.335086+0000","last_unstale":"2024-09-17T02:24:33.342161+0000","last_undegraded":"2024-09-17T02:24:33.342161+0000","last_fullsized":"2024-09-17T02:24:33.342161+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:01.913411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.343734+0000","last_change":"2024-09-17T02:24:30.325322+0000","last_active":"2024-09-17T02:24:33.343734+0000","last_peered":"2024-09-17T02:24:33.343734+0000","last_clean":"2024-09-17T02:24:33.343734+0000","last_became_active":"2024-09-17T02:24:30.325002+0000","last_became_peered":"2024-09-17T02:24:30.325002+0000","last_unstale":"2024-09-17T02:24:33.343734+0000","last_undegraded":"2024-09-17T02:24:33.343734+0000","last_fullsized":"2024-09-17T02:24:33.343734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:16.238014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.690369+0000","last_change":"2024-09-17T02:20:16.563482+0000","last_active":"2024-09-17T02:24:30.690369+0000","last_peered":"2024-09-17T02:24:30.690369+0000","last_clean":"2024-09-17T02:24:30.690369+0000","last_became_active":"2024-09-17T02:20:16.562735+0000","last_became_peered":"2024-09-17T02:20:16.562735+0000","last_unstale":"2024-09-17T02:24:30.690369+0000","last_undegraded":"2024-09-17T02:24:30.690369+0000","last_fullsized":"2024-09-17T02:24:30.690369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:10.315951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":120,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.689767+0000","last_change":"2024-09-17T02:20:37.706162+0000","last_active":"2024-09-17T02:24:30.689767+0000","last_peered":"2024-09-17T02:24:30.689767+0000","last_clean":"2024-09-17T02:24:30.689767+0000","last_became_active":"2024-09-17T02:20:37.705497+0000","last_became_peered":"2024-09-17T02:20:37.705497+0000","last_unstale":"2024-09-17T02:24:30.689767+0000","last_undegraded":"2024-09-17T02:24:30.689767+0000","last_fullsized":"2024-09-17T02:24:30.689767+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:43.467659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.689421+0000","last_change":"2024-09-17T02:20:16.586950+0000","last_active":"2024-09-17T02:24:30.689421+0000","last_peered":"2024-09-17T02:24:30.689421+0000","last_clean":"2024-09-17T02:24:30.689421+0000","last_became_active":"2024-09-17T02:20:16.586281+0000","last_became_peered":"2024-09-17T02:20:16.586281+0000","last_unstale":"2024-09-17T02:24:30.689421+0000","last_undegraded":"2024-09-17T02:24:30.689421+0000","last_fullsized":"2024-09-17T02:24:30.689421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:22.801598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.349235+0000","last_change":"2024-09-17T02:24:30.330312+0000","last_active":"2024-09-17T02:24:33.349235+0000","last_peered":"2024-09-17T02:24:33.349235+0000","last_clean":"2024-09-17T02:24:33.349235+0000","last_became_active":"2024-09-17T02:24:30.329980+0000","last_became_peered":"2024-09-17T02:24:30.329980+0000","last_unstale":"2024-09-17T02:24:33.349235+0000","last_undegraded":"2024-09-17T02:24:33.349235+0000","last_fullsized":"2024-09-17T02:24:33.349235+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:53.422140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"peering","last_fresh":"2024-09-17T02:24:32.832054+0000","last_change":"2024-09-17T02:24:33.343284+0000","last_active":"2024-09-17T02:24:33.343284+0000","last_peered":"2024-09-17T02:24:32.832054+0000","last_clean":"2024-09-17T02:24:32.832054+0000","last_became_active":"2024-09-17T02:24:30.326057+0000","last_became_peered":"2024-09-17T02:24:30.326057+0000","last_unstale":"2024-09-17T02:24:32.832054+0000","last_undegraded":"2024-09-17T02:24:32.832054+0000","last_fullsized":"2024-09-17T02:24:32.832054+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":144,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.710157+0000","last_change":"2024-09-17T02:24:30.702500+0000","last_active":"2024-09-17T02:24:32.710157+0000","last_peered":"2024-09-17T02:24:32.710157+0000","last_clean":"2024-09-17T02:24:32.710157+0000","last_became_active":"2024-09-17T02:24:30.700674+0000","last_became_peered":"2024-09-17T02:24:30.700674+0000","last_unstale":"2024-09-17T02:24:32.710157+0000","last_undegraded":"2024-09-17T02:24:32.710157+0000","last_fullsized":"2024-09-17T02:24:32.710157+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:47.554275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.700096+0000","last_change":"2024-09-17T02:24:30.700096+0000","last_active":"2024-09-17T02:24:30.700096+0000","last_peered":"2024-09-17T02:24:30.700096+0000","last_clean":"2024-09-17T02:24:30.700096+0000","last_became_active":"2024-09-17T02:24:30.698022+0000","last_became_peered":"2024-09-17T02:24:30.698022+0000","last_unstale":"2024-09-17T02:24:30.700096+0000","last_undegraded":"2024-09-17T02:24:30.700096+0000","last_fullsized":"2024-09-17T02:24:30.700096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:53.002528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":120,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.689320+0000","last_change":"2024-09-17T02:20:37.710222+0000","last_active":"2024-09-17T02:24:30.689320+0000","last_peered":"2024-09-17T02:24:30.689320+0000","last_clean":"2024-09-17T02:24:30.689320+0000","last_became_active":"2024-09-17T02:20:37.709227+0000","last_became_peered":"2024-09-17T02:20:37.709227+0000","last_unstale":"2024-09-17T02:24:30.689320+0000","last_undegraded":"2024-09-17T02:24:30.689320+0000","last_fullsized":"2024-09-17T02:24:30.689320+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:01:44.250550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":144,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.711682+0000","last_change":"2024-09-17T02:24:30.704846+0000","last_active":"2024-09-17T02:24:32.711682+0000","last_peered":"2024-09-17T02:24:32.711682+0000","last_clean":"2024-09-17T02:24:32.711682+0000","last_became_active":"2024-09-17T02:24:30.703377+0000","last_became_peered":"2024-09-17T02:24:30.703377+0000","last_unstale":"2024-09-17T02:24:32.711682+0000","last_undegraded":"2024-09-17T02:24:32.711682+0000","last_fullsized":"2024-09-17T02:24:32.711682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:21.642002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.696851+0000","last_change":"2024-09-17T02:24:30.696851+0000","last_active":"2024-09-17T02:24:30.696851+0000","last_peered":"2024-09-17T02:24:30.696851+0000","last_clean":"2024-09-17T02:24:30.696851+0000","last_became_active":"2024-09-17T02:24:30.694853+0000","last_became_peered":"2024-09-17T02:24:30.694853+0000","last_unstale":"2024-09-17T02:24:30.696851+0000","last_undegraded":"2024-09-17T02:24:30.696851+0000","last_fullsized":"2024-09-17T02:24:30.696851+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:39.353246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.348102+0000","last_change":"2024-09-17T02:24:30.339430+0000","last_active":"2024-09-17T02:24:33.348102+0000","last_peered":"2024-09-17T02:24:33.348102+0000","last_clean":"2024-09-17T02:24:33.348102+0000","last_became_active":"2024-09-17T02:24:30.338488+0000","last_became_peered":"2024-09-17T02:24:30.338488+0000","last_unstale":"2024-09-17T02:24:33.348102+0000","last_undegraded":"2024-09-17T02:24:33.348102+0000","last_fullsized":"2024-09-17T02:24:33.348102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:26.554742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.345943+0000","last_change":"2024-09-17T02:24:30.335659+0000","last_active":"2024-09-17T02:24:33.345943+0000","last_peered":"2024-09-17T02:24:33.345943+0000","last_clean":"2024-09-17T02:24:33.345943+0000","last_became_active":"2024-09-17T02:24:30.335243+0000","last_became_peered":"2024-09-17T02:24:30.335243+0000","last_unstale":"2024-09-17T02:24:33.345943+0000","last_undegraded":"2024-09-17T02:24:33.345943+0000","last_fullsized":"2024-09-17T02:24:33.345943+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:59.178360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":63,"reported_epoch":78,"state":"active+undersized","last_fresh":"2024-09-17T02:22:39.955770+0000","last_change":"2024-09-17T02:21:35.504429+0000","last_active":"2024-09-17T02:22:39.955770+0000","last_peered":"2024-09-17T02:22:39.955770+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"2024-09-17T02:21:35.504429+0000","last_became_peered":"2024-09-17T02:21:35.504429+0000","last_unstale":"2024-09-17T02:22:39.955770+0000","last_undegraded":"2024-09-17T02:22:39.955770+0000","last_fullsized":"2024-09-17T02:21:35.495718+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:35.227137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":145,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.710875+0000","last_change":"2024-09-17T02:24:30.700893+0000","last_active":"2024-09-17T02:24:32.710875+0000","last_peered":"2024-09-17T02:24:32.710875+0000","last_clean":"2024-09-17T02:24:32.710875+0000","last_became_active":"2024-09-17T02:24:30.699410+0000","last_became_peered":"2024-09-17T02:24:30.699410+0000","last_unstale":"2024-09-17T02:24:32.710875+0000","last_undegraded":"2024-09-17T02:24:32.710875+0000","last_fullsized":"2024-09-17T02:24:32.710875+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:29.137738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":62,"reported_epoch":78,"state":"active+undersized","last_fresh":"2024-09-17T02:22:39.951873+0000","last_change":"2024-09-17T02:21:35.515641+0000","last_active":"2024-09-17T02:22:39.951873+0000","last_peered":"2024-09-17T02:22:39.951873+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"2024-09-17T02:21:35.515641+0000","last_became_peered":"2024-09-17T02:21:35.515641+0000","last_unstale":"2024-09-17T02:22:39.951873+0000","last_undegraded":"2024-09-17T02:22:39.951873+0000","last_fullsized":"2024-09-17T02:21:35.493982+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:19.243921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"peering","last_fresh":"2024-09-17T02:24:32.831104+0000","last_change":"2024-09-17T02:24:33.342836+0000","last_active":"2024-09-17T02:24:33.342836+0000","last_peered":"2024-09-17T02:24:32.831104+0000","last_clean":"2024-09-17T02:24:32.831104+0000","last_became_active":"2024-09-17T02:24:30.337401+0000","last_became_peered":"2024-09-17T02:24:30.337401+0000","last_unstale":"2024-09-17T02:24:32.831104+0000","last_undegraded":"2024-09-17T02:24:32.831104+0000","last_fullsized":"2024-09-17T02:24:32.831104+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":81,"reported_epoch":78,"state":"active+undersized","last_fresh":"2024-09-17T02:22:39.953144+0000","last_change":"2024-09-17T02:21:35.515253+0000","last_active":"2024-09-17T02:22:39.953144+0000","last_peered":"2024-09-17T02:22:39.953144+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"2024-09-17T02:21:35.515253+0000","last_became_peered":"2024-09-17T02:21:35.515253+0000","last_unstale":"2024-09-17T02:22:39.953144+0000","last_undegraded":"2024-09-17T02:22:39.953144+0000","last_fullsized":"2024-09-17T02:21:35.501233+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:44.804845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.346005+0000","last_change":"2024-09-17T02:24:30.329201+0000","last_active":"2024-09-17T02:24:33.346005+0000","last_peered":"2024-09-17T02:24:33.346005+0000","last_clean":"2024-09-17T02:24:33.346005+0000","last_became_active":"2024-09-17T02:24:30.328907+0000","last_became_peered":"2024-09-17T02:24:30.328907+0000","last_unstale":"2024-09-17T02:24:33.346005+0000","last_undegraded":"2024-09-17T02:24:33.346005+0000","last_fullsized":"2024-09-17T02:24:33.346005+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:31.463647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":149,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.711710+0000","last_change":"2024-09-17T02:24:30.701022+0000","last_active":"2024-09-17T02:24:32.711710+0000","last_peered":"2024-09-17T02:24:32.711710+0000","last_clean":"2024-09-17T02:24:32.711710+0000","last_became_active":"2024-09-17T02:24:30.697260+0000","last_became_peered":"2024-09-17T02:24:30.697260+0000","last_unstale":"2024-09-17T02:24:32.711710+0000","last_undegraded":"2024-09-17T02:24:32.711710+0000","last_fullsized":"2024-09-17T02:24:32.711710+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:33.937384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":64,"reported_epoch":78,"state":"active+undersized","last_fresh":"2024-09-17T02:22:39.952048+0000","last_change":"2024-09-17T02:21:35.502703+0000","last_active":"2024-09-17T02:22:39.952048+0000","last_peered":"2024-09-17T02:22:39.952048+0000","last_clean":"2024-09-17T02:20:14.516708+0000","last_became_active":"2024-09-17T02:21:35.502703+0000","last_became_peered":"2024-09-17T02:21:35.502703+0000","last_unstale":"2024-09-17T02:22:39.952048+0000","last_undegraded":"2024-09-17T02:22:39.952048+0000","last_fullsized":"2024-09-17T02:21:35.493481+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:06:14.731289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":64,"reported_epoch":78,"state":"active+undersized","last_fresh":"2024-09-17T02:22:39.953444+0000","last_change":"2024-09-17T02:21:35.502713+0000","last_active":"2024-09-17T02:22:39.953444+0000","last_peered":"2024-09-17T02:22:39.953444+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"2024-09-17T02:21:35.502713+0000","last_became_peered":"2024-09-17T02:21:35.502713+0000","last_unstale":"2024-09-17T02:22:39.953444+0000","last_undegraded":"2024-09-17T02:22:39.953444+0000","last_fullsized":"2024-09-17T02:21:35.494355+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:13.449935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":146,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.709973+0000","last_change":"2024-09-17T02:24:30.702653+0000","last_active":"2024-09-17T02:24:32.709973+0000","last_peered":"2024-09-17T02:24:32.709973+0000","last_clean":"2024-09-17T02:24:32.709973+0000","last_became_active":"2024-09-17T02:24:30.701047+0000","last_became_peered":"2024-09-17T02:24:30.701047+0000","last_unstale":"2024-09-17T02:24:32.709973+0000","last_undegraded":"2024-09-17T02:24:32.709973+0000","last_fullsized":"2024-09-17T02:24:32.709973+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:26.569439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.698841+0000","last_change":"2024-09-17T02:24:30.698841+0000","last_active":"2024-09-17T02:24:30.698841+0000","last_peered":"2024-09-17T02:24:30.698841+0000","last_clean":"2024-09-17T02:24:30.698841+0000","last_became_active":"2024-09-17T02:24:30.697606+0000","last_became_peered":"2024-09-17T02:24:30.697606+0000","last_unstale":"2024-09-17T02:24:30.698841+0000","last_undegraded":"2024-09-17T02:24:30.698841+0000","last_fullsized":"2024-09-17T02:24:30.698841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:20.038861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.339904+0000","last_change":"2024-09-17T02:24:30.336630+0000","last_active":"2024-09-17T02:24:33.339904+0000","last_peered":"2024-09-17T02:24:33.339904+0000","last_clean":"2024-09-17T02:24:33.339904+0000","last_became_active":"2024-09-17T02:24:30.336326+0000","last_became_peered":"2024-09-17T02:24:30.336326+0000","last_unstale":"2024-09-17T02:24:33.339904+0000","last_undegraded":"2024-09-17T02:24:33.339904+0000","last_fullsized":"2024-09-17T02:24:33.339904+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:30.072709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.348135+0000","last_change":"2024-09-17T02:24:30.336771+0000","last_active":"2024-09-17T02:24:33.348135+0000","last_peered":"2024-09-17T02:24:33.348135+0000","last_clean":"2024-09-17T02:24:33.348135+0000","last_became_active":"2024-09-17T02:24:30.336494+0000","last_became_peered":"2024-09-17T02:24:30.336494+0000","last_unstale":"2024-09-17T02:24:33.348135+0000","last_undegraded":"2024-09-17T02:24:33.348135+0000","last_fullsized":"2024-09-17T02:24:33.348135+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:17.852502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.344647+0000","last_change":"2024-09-17T02:24:30.338523+0000","last_active":"2024-09-17T02:24:33.344647+0000","last_peered":"2024-09-17T02:24:33.344647+0000","last_clean":"2024-09-17T02:24:33.344647+0000","last_became_active":"2024-09-17T02:24:30.337726+0000","last_became_peered":"2024-09-17T02:24:30.337726+0000","last_unstale":"2024-09-17T02:24:33.344647+0000","last_undegraded":"2024-09-17T02:24:33.344647+0000","last_fullsized":"2024-09-17T02:24:33.344647+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:33.124995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":148,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.711685+0000","last_change":"2024-09-17T02:24:30.697584+0000","last_active":"2024-09-17T02:24:32.711685+0000","last_peered":"2024-09-17T02:24:32.711685+0000","last_clean":"2024-09-17T02:24:32.711685+0000","last_became_active":"2024-09-17T02:24:30.695140+0000","last_became_peered":"2024-09-17T02:24:30.695140+0000","last_unstale":"2024-09-17T02:24:32.711685+0000","last_undegraded":"2024-09-17T02:24:32.711685+0000","last_fullsized":"2024-09-17T02:24:32.711685+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:07.386102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":120,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.690726+0000","last_change":"2024-09-17T02:20:37.705585+0000","last_active":"2024-09-17T02:24:30.690726+0000","last_peered":"2024-09-17T02:24:30.690726+0000","last_clean":"2024-09-17T02:24:30.690726+0000","last_became_active":"2024-09-17T02:20:37.705266+0000","last_became_peered":"2024-09-17T02:20:37.705266+0000","last_unstale":"2024-09-17T02:24:30.690726+0000","last_undegraded":"2024-09-17T02:24:30.690726+0000","last_fullsized":"2024-09-17T02:24:30.690726+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:10:51.092163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.345869+0000","last_change":"2024-09-17T02:24:30.338939+0000","last_active":"2024-09-17T02:24:33.345869+0000","last_peered":"2024-09-17T02:24:33.345869+0000","last_clean":"2024-09-17T02:24:33.345869+0000","last_became_active":"2024-09-17T02:24:30.337650+0000","last_became_peered":"2024-09-17T02:24:30.337650+0000","last_unstale":"2024-09-17T02:24:33.345869+0000","last_undegraded":"2024-09-17T02:24:33.345869+0000","last_fullsized":"2024-09-17T02:24:33.345869+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:00.927950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.345686+0000","last_change":"2024-09-17T02:24:30.322785+0000","last_active":"2024-09-17T02:24:33.345686+0000","last_peered":"2024-09-17T02:24:33.345686+0000","last_clean":"2024-09-17T02:24:33.345686+0000","last_became_active":"2024-09-17T02:24:30.322509+0000","last_became_peered":"2024-09-17T02:24:30.322509+0000","last_unstale":"2024-09-17T02:24:33.345686+0000","last_undegraded":"2024-09-17T02:24:33.345686+0000","last_fullsized":"2024-09-17T02:24:33.345686+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:06.381434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.345666+0000","last_change":"2024-09-17T02:24:30.329944+0000","last_active":"2024-09-17T02:24:33.345666+0000","last_peered":"2024-09-17T02:24:33.345666+0000","last_clean":"2024-09-17T02:24:33.345666+0000","last_became_active":"2024-09-17T02:24:30.329642+0000","last_became_peered":"2024-09-17T02:24:30.329642+0000","last_unstale":"2024-09-17T02:24:33.345666+0000","last_undegraded":"2024-09-17T02:24:33.345666+0000","last_fullsized":"2024-09-17T02:24:33.345666+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:39.135831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.699239+0000","last_change":"2024-09-17T02:24:30.699239+0000","last_active":"2024-09-17T02:24:30.699239+0000","last_peered":"2024-09-17T02:24:30.699239+0000","last_clean":"2024-09-17T02:24:30.699239+0000","last_became_active":"2024-09-17T02:24:30.697800+0000","last_became_peered":"2024-09-17T02:24:30.697800+0000","last_unstale":"2024-09-17T02:24:30.699239+0000","last_undegraded":"2024-09-17T02:24:30.699239+0000","last_fullsized":"2024-09-17T02:24:30.699239+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:42.056577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.697486+0000","last_change":"2024-09-17T02:24:30.697486+0000","last_active":"2024-09-17T02:24:30.697486+0000","last_peered":"2024-09-17T02:24:30.697486+0000","last_clean":"2024-09-17T02:24:30.697486+0000","last_became_active":"2024-09-17T02:24:30.696079+0000","last_became_peered":"2024-09-17T02:24:30.696079+0000","last_unstale":"2024-09-17T02:24:30.697486+0000","last_undegraded":"2024-09-17T02:24:30.697486+0000","last_fullsized":"2024-09-17T02:24:30.697486+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:07.222731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.346188+0000","last_change":"2024-09-17T02:24:30.330194+0000","last_active":"2024-09-17T02:24:33.346188+0000","last_peered":"2024-09-17T02:24:33.346188+0000","last_clean":"2024-09-17T02:24:33.346188+0000","last_became_active":"2024-09-17T02:24:30.329676+0000","last_became_peered":"2024-09-17T02:24:30.329676+0000","last_unstale":"2024-09-17T02:24:33.346188+0000","last_undegraded":"2024-09-17T02:24:33.346188+0000","last_fullsized":"2024-09-17T02:24:33.346188+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:50:41.161871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"peering","last_fresh":"2024-09-17T02:24:32.831321+0000","last_change":"2024-09-17T02:24:33.341698+0000","last_active":"2024-09-17T02:24:33.341698+0000","last_peered":"2024-09-17T02:24:32.831321+0000","last_clean":"2024-09-17T02:24:32.831321+0000","last_became_active":"2024-09-17T02:24:30.336497+0000","last_became_peered":"2024-09-17T02:24:30.336497+0000","last_unstale":"2024-09-17T02:24:32.831321+0000","last_undegraded":"2024-09-17T02:24:32.831321+0000","last_fullsized":"2024-09-17T02:24:32.831321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.345583+0000","last_change":"2024-09-17T02:24:30.338531+0000","last_active":"2024-09-17T02:24:33.345583+0000","last_peered":"2024-09-17T02:24:33.345583+0000","last_clean":"2024-09-17T02:24:33.345583+0000","last_became_active":"2024-09-17T02:24:30.336902+0000","last_became_peered":"2024-09-17T02:24:30.336902+0000","last_unstale":"2024-09-17T02:24:33.345583+0000","last_undegraded":"2024-09-17T02:24:33.345583+0000","last_fullsized":"2024-09-17T02:24:33.345583+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:49.660896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.340328+0000","last_change":"2024-09-17T02:24:30.322953+0000","last_active":"2024-09-17T02:24:33.340328+0000","last_peered":"2024-09-17T02:24:33.340328+0000","last_clean":"2024-09-17T02:24:33.340328+0000","last_became_active":"2024-09-17T02:24:30.322780+0000","last_became_peered":"2024-09-17T02:24:30.322780+0000","last_unstale":"2024-09-17T02:24:33.340328+0000","last_undegraded":"2024-09-17T02:24:33.340328+0000","last_fullsized":"2024-09-17T02:24:33.340328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:59:33.087791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.348973+0000","last_change":"2024-09-17T02:24:30.326828+0000","last_active":"2024-09-17T02:24:33.348973+0000","last_peered":"2024-09-17T02:24:33.348973+0000","last_clean":"2024-09-17T02:24:33.348973+0000","last_became_active":"2024-09-17T02:24:30.326227+0000","last_became_peered":"2024-09-17T02:24:30.326227+0000","last_unstale":"2024-09-17T02:24:33.348973+0000","last_undegraded":"2024-09-17T02:24:33.348973+0000","last_fullsized":"2024-09-17T02:24:33.348973+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:53.135460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":120,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.689725+0000","last_change":"2024-09-17T02:20:37.709979+0000","last_active":"2024-09-17T02:24:30.689725+0000","last_peered":"2024-09-17T02:24:30.689725+0000","last_clean":"2024-09-17T02:24:30.689725+0000","last_became_active":"2024-09-17T02:20:37.708736+0000","last_became_peered":"2024-09-17T02:20:37.708736+0000","last_unstale":"2024-09-17T02:24:30.689725+0000","last_undegraded":"2024-09-17T02:24:30.689725+0000","last_fullsized":"2024-09-17T02:24:30.689725+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:03.481029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.690041+0000","last_change":"2024-09-17T02:20:16.583084+0000","last_active":"2024-09-17T02:24:30.690041+0000","last_peered":"2024-09-17T02:24:30.690041+0000","last_clean":"2024-09-17T02:24:30.690041+0000","last_became_active":"2024-09-17T02:20:16.582326+0000","last_became_peered":"2024-09-17T02:20:16.582326+0000","last_unstale":"2024-09-17T02:24:30.690041+0000","last_undegraded":"2024-09-17T02:24:30.690041+0000","last_fullsized":"2024-09-17T02:24:30.690041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:05.049317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":223,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.340149+0000","last_change":"2024-09-17T02:24:30.338760+0000","last_active":"2024-09-17T02:24:33.340149+0000","last_peered":"2024-09-17T02:24:33.340149+0000","last_clean":"2024-09-17T02:24:33.340149+0000","last_became_active":"2024-09-17T02:24:30.338214+0000","last_became_peered":"2024-09-17T02:24:30.338214+0000","last_unstale":"2024-09-17T02:24:33.340149+0000","last_undegraded":"2024-09-17T02:24:33.340149+0000","last_fullsized":"2024-09-17T02:24:33.340149+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_clean_scrub_stamp":"2024-09-17T02:20:03.432050+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:27:29.124652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":47,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.340692+0000","last_change":"2024-09-17T02:24:30.325326+0000","last_active":"2024-09-17T02:24:33.340692+0000","last_peered":"2024-09-17T02:24:33.340692+0000","last_clean":"2024-09-17T02:24:33.340692+0000","last_became_active":"2024-09-17T02:24:30.324910+0000","last_became_peered":"2024-09-17T02:24:30.324910+0000","last_unstale":"2024-09-17T02:24:33.340692+0000","last_undegraded":"2024-09-17T02:24:33.340692+0000","last_fullsized":"2024-09-17T02:24:33.340692+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:52:27.682190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.689869+0000","last_change":"2024-09-17T02:20:15.560646+0000","last_active":"2024-09-17T02:24:30.689869+0000","last_peered":"2024-09-17T02:24:30.689869+0000","last_clean":"2024-09-17T02:24:30.689869+0000","last_became_active":"2024-09-17T02:20:15.559104+0000","last_became_peered":"2024-09-17T02:20:15.559104+0000","last_unstale":"2024-09-17T02:24:30.689869+0000","last_undegraded":"2024-09-17T02:24:30.689869+0000","last_fullsized":"2024-09-17T02:24:30.689869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:44.299986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.346155+0000","last_change":"2024-09-17T02:24:30.339100+0000","last_active":"2024-09-17T02:24:33.346155+0000","last_peered":"2024-09-17T02:24:33.346155+0000","last_clean":"2024-09-17T02:24:33.346155+0000","last_became_active":"2024-09-17T02:24:30.337415+0000","last_became_peered":"2024-09-17T02:24:30.337415+0000","last_unstale":"2024-09-17T02:24:33.346155+0000","last_undegraded":"2024-09-17T02:24:33.346155+0000","last_fullsized":"2024-09-17T02:24:33.346155+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:27.682975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.342403+0000","last_change":"2024-09-17T02:24:30.338621+0000","last_active":"2024-09-17T02:24:33.342403+0000","last_peered":"2024-09-17T02:24:33.342403+0000","last_clean":"2024-09-17T02:24:33.342403+0000","last_became_active":"2024-09-17T02:24:30.338024+0000","last_became_peered":"2024-09-17T02:24:30.338024+0000","last_unstale":"2024-09-17T02:24:33.342403+0000","last_undegraded":"2024-09-17T02:24:33.342403+0000","last_fullsized":"2024-09-17T02:24:33.342403+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:49.985865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.694491+0000","last_change":"2024-09-17T02:24:30.694491+0000","last_active":"2024-09-17T02:24:30.694491+0000","last_peered":"2024-09-17T02:24:30.694491+0000","last_clean":"2024-09-17T02:24:30.694491+0000","last_became_active":"2024-09-17T02:24:30.693653+0000","last_became_peered":"2024-09-17T02:24:30.693653+0000","last_unstale":"2024-09-17T02:24:30.694491+0000","last_undegraded":"2024-09-17T02:24:30.694491+0000","last_fullsized":"2024-09-17T02:24:30.694491+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:12.740030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":137,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.711376+0000","last_change":"2024-09-17T02:20:16.571568+0000","last_active":"2024-09-17T02:24:32.711376+0000","last_peered":"2024-09-17T02:24:32.711376+0000","last_clean":"2024-09-17T02:24:32.711376+0000","last_became_active":"2024-09-17T02:20:16.570622+0000","last_became_peered":"2024-09-17T02:20:16.570622+0000","last_unstale":"2024-09-17T02:24:32.711376+0000","last_undegraded":"2024-09-17T02:24:32.711376+0000","last_fullsized":"2024-09-17T02:24:32.711376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:57.083446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.691232+0000","last_change":"2024-09-17T02:20:12.511823+0000","last_active":"2024-09-17T02:24:30.691232+0000","last_peered":"2024-09-17T02:24:30.691232+0000","last_clean":"2024-09-17T02:24:30.691232+0000","last_became_active":"2024-09-17T02:20:10.497164+0000","last_became_peered":"2024-09-17T02:20:10.497164+0000","last_unstale":"2024-09-17T02:24:30.691232+0000","last_undegraded":"2024-09-17T02:24:30.691232+0000","last_fullsized":"2024-09-17T02:24:30.691232+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:21.242753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081052700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.339863+0000","last_change":"2024-09-17T02:24:30.336354+0000","last_active":"2024-09-17T02:24:33.339863+0000","last_peered":"2024-09-17T02:24:33.339863+0000","last_clean":"2024-09-17T02:24:33.339863+0000","last_became_active":"2024-09-17T02:24:30.336078+0000","last_became_peered":"2024-09-17T02:24:30.336078+0000","last_unstale":"2024-09-17T02:24:33.339863+0000","last_undegraded":"2024-09-17T02:24:33.339863+0000","last_fullsized":"2024-09-17T02:24:33.339863+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:49.027706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":62,"reported_epoch":78,"state":"active+undersized","last_fresh":"2024-09-17T02:22:39.955793+0000","last_change":"2024-09-17T02:21:35.505826+0000","last_active":"2024-09-17T02:22:39.955793+0000","last_peered":"2024-09-17T02:22:39.955793+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"2024-09-17T02:21:35.505826+0000","last_became_peered":"2024-09-17T02:21:35.505826+0000","last_unstale":"2024-09-17T02:22:39.955793+0000","last_undegraded":"2024-09-17T02:22:39.955793+0000","last_fullsized":"2024-09-17T02:21:35.495427+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:45:14.500678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":48,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.340246+0000","last_change":"2024-09-17T02:24:30.333204+0000","last_active":"2024-09-17T02:24:33.340246+0000","last_peered":"2024-09-17T02:24:33.340246+0000","last_clean":"2024-09-17T02:24:33.340246+0000","last_became_active":"2024-09-17T02:24:30.333005+0000","last_became_peered":"2024-09-17T02:24:30.333005+0000","last_unstale":"2024-09-17T02:24:33.340246+0000","last_undegraded":"2024-09-17T02:24:33.340246+0000","last_fullsized":"2024-09-17T02:24:33.340246+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:17.620422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078085399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.346307+0000","last_change":"2024-09-17T02:24:30.329442+0000","last_active":"2024-09-17T02:24:33.346307+0000","last_peered":"2024-09-17T02:24:33.346307+0000","last_clean":"2024-09-17T02:24:33.346307+0000","last_became_active":"2024-09-17T02:24:30.329213+0000","last_became_peered":"2024-09-17T02:24:30.329213+0000","last_unstale":"2024-09-17T02:24:33.346307+0000","last_undegraded":"2024-09-17T02:24:33.346307+0000","last_fullsized":"2024-09-17T02:24:33.346307+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:25.034116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.691532+0000","last_change":"2024-09-17T02:20:16.580184+0000","last_active":"2024-09-17T02:24:30.691532+0000","last_peered":"2024-09-17T02:24:30.691532+0000","last_clean":"2024-09-17T02:24:30.691532+0000","last_became_active":"2024-09-17T02:20:16.578343+0000","last_became_peered":"2024-09-17T02:20:16.578343+0000","last_unstale":"2024-09-17T02:24:30.691532+0000","last_undegraded":"2024-09-17T02:24:30.691532+0000","last_fullsized":"2024-09-17T02:24:30.691532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:42.123535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"peering","last_fresh":"2024-09-17T02:24:32.832397+0000","last_change":"2024-09-17T02:24:33.349018+0000","last_active":"2024-09-17T02:24:33.349018+0000","last_peered":"2024-09-17T02:24:32.832397+0000","last_clean":"2024-09-17T02:24:32.832397+0000","last_became_active":"2024-09-17T02:24:30.336380+0000","last_became_peered":"2024-09-17T02:24:30.336380+0000","last_unstale":"2024-09-17T02:24:32.832397+0000","last_undegraded":"2024-09-17T02:24:32.832397+0000","last_fullsized":"2024-09-17T02:24:32.832397+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.691910+0000","last_change":"2024-09-17T02:20:12.511838+0000","last_active":"2024-09-17T02:24:30.691910+0000","last_peered":"2024-09-17T02:24:30.691910+0000","last_clean":"2024-09-17T02:24:30.691910+0000","last_became_active":"2024-09-17T02:20:10.497049+0000","last_became_peered":"2024-09-17T02:20:10.497049+0000","last_unstale":"2024-09-17T02:24:30.691910+0000","last_undegraded":"2024-09-17T02:24:30.691910+0000","last_fullsized":"2024-09-17T02:24:30.691910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:54.446484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079701100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":145,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.710208+0000","last_change":"2024-09-17T02:24:30.698392+0000","last_active":"2024-09-17T02:24:32.710208+0000","last_peered":"2024-09-17T02:24:32.710208+0000","last_clean":"2024-09-17T02:24:32.710208+0000","last_became_active":"2024-09-17T02:24:30.694944+0000","last_became_peered":"2024-09-17T02:24:30.694944+0000","last_unstale":"2024-09-17T02:24:32.710208+0000","last_undegraded":"2024-09-17T02:24:32.710208+0000","last_fullsized":"2024-09-17T02:24:32.710208+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:06.407404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.691716+0000","last_change":"2024-09-17T02:20:15.559252+0000","last_active":"2024-09-17T02:24:30.691716+0000","last_peered":"2024-09-17T02:24:30.691716+0000","last_clean":"2024-09-17T02:24:30.691716+0000","last_became_active":"2024-09-17T02:20:15.557667+0000","last_became_peered":"2024-09-17T02:20:15.557667+0000","last_unstale":"2024-09-17T02:24:30.691716+0000","last_undegraded":"2024-09-17T02:24:30.691716+0000","last_fullsized":"2024-09-17T02:24:30.691716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:01.292626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":153,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.712148+0000","last_change":"2024-09-17T02:20:12.661034+0000","last_active":"2024-09-17T02:24:32.712148+0000","last_peered":"2024-09-17T02:24:32.712148+0000","last_clean":"2024-09-17T02:24:32.712148+0000","last_became_active":"2024-09-17T02:20:10.497829+0000","last_became_peered":"2024-09-17T02:20:10.497829+0000","last_unstale":"2024-09-17T02:24:32.712148+0000","last_undegraded":"2024-09-17T02:24:32.712148+0000","last_fullsized":"2024-09-17T02:24:32.712148+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:46:27.427685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096944700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.341107+0000","last_change":"2024-09-17T02:24:30.322910+0000","last_active":"2024-09-17T02:24:33.341107+0000","last_peered":"2024-09-17T02:24:33.341107+0000","last_clean":"2024-09-17T02:24:33.341107+0000","last_became_active":"2024-09-17T02:24:30.322632+0000","last_became_peered":"2024-09-17T02:24:30.322632+0000","last_unstale":"2024-09-17T02:24:33.341107+0000","last_undegraded":"2024-09-17T02:24:33.341107+0000","last_fullsized":"2024-09-17T02:24:33.341107+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:03.155286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.690335+0000","last_change":"2024-09-17T02:20:15.558961+0000","last_active":"2024-09-17T02:24:30.690335+0000","last_peered":"2024-09-17T02:24:30.690335+0000","last_clean":"2024-09-17T02:24:30.690335+0000","last_became_active":"2024-09-17T02:20:15.558299+0000","last_became_peered":"2024-09-17T02:20:15.558299+0000","last_unstale":"2024-09-17T02:24:30.690335+0000","last_undegraded":"2024-09-17T02:24:30.690335+0000","last_fullsized":"2024-09-17T02:24:30.690335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:39.709524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.690261+0000","last_change":"2024-09-17T02:20:12.512481+0000","last_active":"2024-09-17T02:24:30.690261+0000","last_peered":"2024-09-17T02:24:30.690261+0000","last_clean":"2024-09-17T02:24:30.690261+0000","last_became_active":"2024-09-17T02:20:10.497021+0000","last_became_peered":"2024-09-17T02:20:10.497021+0000","last_unstale":"2024-09-17T02:24:30.690261+0000","last_undegraded":"2024-09-17T02:24:30.690261+0000","last_fullsized":"2024-09-17T02:24:30.690261+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:41.167283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001400079,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.693811+0000","last_change":"2024-09-17T02:24:30.693811+0000","last_active":"2024-09-17T02:24:30.693811+0000","last_peered":"2024-09-17T02:24:30.693811+0000","last_clean":"2024-09-17T02:24:30.693811+0000","last_became_active":"2024-09-17T02:24:30.691331+0000","last_became_peered":"2024-09-17T02:24:30.691331+0000","last_unstale":"2024-09-17T02:24:30.693811+0000","last_undegraded":"2024-09-17T02:24:30.693811+0000","last_fullsized":"2024-09-17T02:24:30.693811+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:39.446085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.694492+0000","last_change":"2024-09-17T02:24:30.694492+0000","last_active":"2024-09-17T02:24:30.694492+0000","last_peered":"2024-09-17T02:24:30.694492+0000","last_clean":"2024-09-17T02:24:30.694492+0000","last_became_active":"2024-09-17T02:24:30.691770+0000","last_became_peered":"2024-09-17T02:24:30.691770+0000","last_unstale":"2024-09-17T02:24:30.694492+0000","last_undegraded":"2024-09-17T02:24:30.694492+0000","last_fullsized":"2024-09-17T02:24:30.694492+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:01.597617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.341743+0000","last_change":"2024-09-17T02:24:30.336636+0000","last_active":"2024-09-17T02:24:33.341743+0000","last_peered":"2024-09-17T02:24:33.341743+0000","last_clean":"2024-09-17T02:24:33.341743+0000","last_became_active":"2024-09-17T02:24:30.336110+0000","last_became_peered":"2024-09-17T02:24:30.336110+0000","last_unstale":"2024-09-17T02:24:33.341743+0000","last_undegraded":"2024-09-17T02:24:33.341743+0000","last_fullsized":"2024-09-17T02:24:33.341743+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:44.699884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":145,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.709814+0000","last_change":"2024-09-17T02:24:30.700777+0000","last_active":"2024-09-17T02:24:32.709814+0000","last_peered":"2024-09-17T02:24:32.709814+0000","last_clean":"2024-09-17T02:24:32.709814+0000","last_became_active":"2024-09-17T02:24:30.696731+0000","last_became_peered":"2024-09-17T02:24:30.696731+0000","last_unstale":"2024-09-17T02:24:32.709814+0000","last_undegraded":"2024-09-17T02:24:32.709814+0000","last_fullsized":"2024-09-17T02:24:32.709814+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:58.629953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.342788+0000","last_change":"2024-09-17T02:24:30.326364+0000","last_active":"2024-09-17T02:24:33.342788+0000","last_peered":"2024-09-17T02:24:33.342788+0000","last_clean":"2024-09-17T02:24:33.342788+0000","last_became_active":"2024-09-17T02:24:30.325752+0000","last_became_peered":"2024-09-17T02:24:30.325752+0000","last_unstale":"2024-09-17T02:24:33.342788+0000","last_undegraded":"2024-09-17T02:24:33.342788+0000","last_fullsized":"2024-09-17T02:24:33.342788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:33.800584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.340776+0000","last_change":"2024-09-17T02:24:30.325924+0000","last_active":"2024-09-17T02:24:33.340776+0000","last_peered":"2024-09-17T02:24:33.340776+0000","last_clean":"2024-09-17T02:24:33.340776+0000","last_became_active":"2024-09-17T02:24:30.325688+0000","last_became_peered":"2024-09-17T02:24:30.325688+0000","last_unstale":"2024-09-17T02:24:33.340776+0000","last_undegraded":"2024-09-17T02:24:33.340776+0000","last_fullsized":"2024-09-17T02:24:33.340776+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:25.290483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":62,"reported_epoch":78,"state":"active+undersized","last_fresh":"2024-09-17T02:22:39.952732+0000","last_change":"2024-09-17T02:21:35.503507+0000","last_active":"2024-09-17T02:22:39.952732+0000","last_peered":"2024-09-17T02:22:39.952732+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"2024-09-17T02:21:35.503507+0000","last_became_peered":"2024-09-17T02:21:35.503507+0000","last_unstale":"2024-09-17T02:22:39.952732+0000","last_undegraded":"2024-09-17T02:22:39.952732+0000","last_fullsized":"2024-09-17T02:21:35.494741+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:51.679215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.345260+0000","last_change":"2024-09-17T02:24:30.338759+0000","last_active":"2024-09-17T02:24:33.345260+0000","last_peered":"2024-09-17T02:24:33.345260+0000","last_clean":"2024-09-17T02:24:33.345260+0000","last_became_active":"2024-09-17T02:24:30.336906+0000","last_became_peered":"2024-09-17T02:24:30.336906+0000","last_unstale":"2024-09-17T02:24:33.345260+0000","last_undegraded":"2024-09-17T02:24:33.345260+0000","last_fullsized":"2024-09-17T02:24:33.345260+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:09.728346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.343611+0000","last_change":"2024-09-17T02:24:30.325492+0000","last_active":"2024-09-17T02:24:33.343611+0000","last_peered":"2024-09-17T02:24:33.343611+0000","last_clean":"2024-09-17T02:24:33.343611+0000","last_became_active":"2024-09-17T02:24:30.325175+0000","last_became_peered":"2024-09-17T02:24:30.325175+0000","last_unstale":"2024-09-17T02:24:33.343611+0000","last_undegraded":"2024-09-17T02:24:33.343611+0000","last_fullsized":"2024-09-17T02:24:33.343611+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:04.443085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.699551+0000","last_change":"2024-09-17T02:24:30.699551+0000","last_active":"2024-09-17T02:24:30.699551+0000","last_peered":"2024-09-17T02:24:30.699551+0000","last_clean":"2024-09-17T02:24:30.699551+0000","last_became_active":"2024-09-17T02:24:30.697986+0000","last_became_peered":"2024-09-17T02:24:30.697986+0000","last_unstale":"2024-09-17T02:24:30.699551+0000","last_undegraded":"2024-09-17T02:24:30.699551+0000","last_fullsized":"2024-09-17T02:24:30.699551+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:44.939985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.697249+0000","last_change":"2024-09-17T02:24:30.697249+0000","last_active":"2024-09-17T02:24:30.697249+0000","last_peered":"2024-09-17T02:24:30.697249+0000","last_clean":"2024-09-17T02:24:30.697249+0000","last_became_active":"2024-09-17T02:24:30.696215+0000","last_became_peered":"2024-09-17T02:24:30.696215+0000","last_unstale":"2024-09-17T02:24:30.697249+0000","last_undegraded":"2024-09-17T02:24:30.697249+0000","last_fullsized":"2024-09-17T02:24:30.697249+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:07.507822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.690011+0000","last_change":"2024-09-17T02:20:16.577803+0000","last_active":"2024-09-17T02:24:30.690011+0000","last_peered":"2024-09-17T02:24:30.690011+0000","last_clean":"2024-09-17T02:24:30.690011+0000","last_became_active":"2024-09-17T02:20:16.576640+0000","last_became_peered":"2024-09-17T02:20:16.576640+0000","last_unstale":"2024-09-17T02:24:30.690011+0000","last_undegraded":"2024-09-17T02:24:30.690011+0000","last_fullsized":"2024-09-17T02:24:30.690011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:07.190169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":145,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.711800+0000","last_change":"2024-09-17T02:24:30.706739+0000","last_active":"2024-09-17T02:24:32.711800+0000","last_peered":"2024-09-17T02:24:32.711800+0000","last_clean":"2024-09-17T02:24:32.711800+0000","last_became_active":"2024-09-17T02:24:30.706195+0000","last_became_peered":"2024-09-17T02:24:30.706195+0000","last_unstale":"2024-09-17T02:24:32.711800+0000","last_undegraded":"2024-09-17T02:24:32.711800+0000","last_fullsized":"2024-09-17T02:24:32.711800+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:38.782264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":111,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.709938+0000","last_change":"2024-09-17T02:24:30.702619+0000","last_active":"2024-09-17T02:24:32.709938+0000","last_peered":"2024-09-17T02:24:32.709938+0000","last_clean":"2024-09-17T02:24:32.709938+0000","last_became_active":"2024-09-17T02:24:30.700405+0000","last_became_peered":"2024-09-17T02:24:30.700405+0000","last_unstale":"2024-09-17T02:24:32.709938+0000","last_undegraded":"2024-09-17T02:24:32.709938+0000","last_fullsized":"2024-09-17T02:24:32.709938+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:57.681847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.696267+0000","last_change":"2024-09-17T02:24:30.696267+0000","last_active":"2024-09-17T02:24:30.696267+0000","last_peered":"2024-09-17T02:24:30.696267+0000","last_clean":"2024-09-17T02:24:30.696267+0000","last_became_active":"2024-09-17T02:24:30.694027+0000","last_became_peered":"2024-09-17T02:24:30.694027+0000","last_unstale":"2024-09-17T02:24:30.696267+0000","last_undegraded":"2024-09-17T02:24:30.696267+0000","last_fullsized":"2024-09-17T02:24:30.696267+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:56.160158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.697568+0000","last_change":"2024-09-17T02:24:30.697568+0000","last_active":"2024-09-17T02:24:30.697568+0000","last_peered":"2024-09-17T02:24:30.697568+0000","last_clean":"2024-09-17T02:24:30.697568+0000","last_became_active":"2024-09-17T02:24:30.693991+0000","last_became_peered":"2024-09-17T02:24:30.693991+0000","last_unstale":"2024-09-17T02:24:30.697568+0000","last_undegraded":"2024-09-17T02:24:30.697568+0000","last_fullsized":"2024-09-17T02:24:30.697568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:45.636130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":142,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.710845+0000","last_change":"2024-09-17T02:21:10.505967+0000","last_active":"2024-09-17T02:24:32.710845+0000","last_peered":"2024-09-17T02:24:32.710845+0000","last_clean":"2024-09-17T02:24:32.710845+0000","last_became_active":"2024-09-17T02:21:10.505594+0000","last_became_peered":"2024-09-17T02:21:10.505594+0000","last_unstale":"2024-09-17T02:24:32.710845+0000","last_undegraded":"2024-09-17T02:24:32.710845+0000","last_fullsized":"2024-09-17T02:24:32.710845+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:15.782752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":120,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.689352+0000","last_change":"2024-09-17T02:20:37.706393+0000","last_active":"2024-09-17T02:24:30.689352+0000","last_peered":"2024-09-17T02:24:30.689352+0000","last_clean":"2024-09-17T02:24:30.689352+0000","last_became_active":"2024-09-17T02:20:37.705739+0000","last_became_peered":"2024-09-17T02:20:37.705739+0000","last_unstale":"2024-09-17T02:24:30.689352+0000","last_undegraded":"2024-09-17T02:24:30.689352+0000","last_fullsized":"2024-09-17T02:24:30.689352+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:57.361673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":120,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.690797+0000","last_change":"2024-09-17T02:20:37.706175+0000","last_active":"2024-09-17T02:24:30.690797+0000","last_peered":"2024-09-17T02:24:30.690797+0000","last_clean":"2024-09-17T02:24:30.690797+0000","last_became_active":"2024-09-17T02:20:37.705742+0000","last_became_peered":"2024-09-17T02:20:37.705742+0000","last_unstale":"2024-09-17T02:24:30.690797+0000","last_undegraded":"2024-09-17T02:24:30.690797+0000","last_fullsized":"2024-09-17T02:24:30.690797+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:09.959092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":147,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.711303+0000","last_change":"2024-09-17T02:24:30.698237+0000","last_active":"2024-09-17T02:24:32.711303+0000","last_peered":"2024-09-17T02:24:32.711303+0000","last_clean":"2024-09-17T02:24:32.711303+0000","last_became_active":"2024-09-17T02:24:30.697194+0000","last_became_peered":"2024-09-17T02:24:30.697194+0000","last_unstale":"2024-09-17T02:24:32.711303+0000","last_undegraded":"2024-09-17T02:24:32.711303+0000","last_fullsized":"2024-09-17T02:24:32.711303+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:36.697224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"peering","last_fresh":"2024-09-17T02:24:32.832817+0000","last_change":"2024-09-17T02:24:33.348245+0000","last_active":"2024-09-17T02:24:33.348245+0000","last_peered":"2024-09-17T02:24:32.832817+0000","last_clean":"2024-09-17T02:24:32.832817+0000","last_became_active":"2024-09-17T02:24:30.334825+0000","last_became_peered":"2024-09-17T02:24:30.334825+0000","last_unstale":"2024-09-17T02:24:32.832817+0000","last_undegraded":"2024-09-17T02:24:32.832817+0000","last_fullsized":"2024-09-17T02:24:32.832817+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.341050+0000","last_change":"2024-09-17T02:24:30.327080+0000","last_active":"2024-09-17T02:24:33.341050+0000","last_peered":"2024-09-17T02:24:33.341050+0000","last_clean":"2024-09-17T02:24:33.341050+0000","last_became_active":"2024-09-17T02:24:30.326800+0000","last_became_peered":"2024-09-17T02:24:30.326800+0000","last_unstale":"2024-09-17T02:24:33.341050+0000","last_undegraded":"2024-09-17T02:24:33.341050+0000","last_fullsized":"2024-09-17T02:24:33.341050+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:06.072812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.344493+0000","last_change":"2024-09-17T02:24:30.322448+0000","last_active":"2024-09-17T02:24:33.344493+0000","last_peered":"2024-09-17T02:24:33.344493+0000","last_clean":"2024-09-17T02:24:33.344493+0000","last_became_active":"2024-09-17T02:24:30.322156+0000","last_became_peered":"2024-09-17T02:24:30.322156+0000","last_unstale":"2024-09-17T02:24:33.344493+0000","last_undegraded":"2024-09-17T02:24:33.344493+0000","last_fullsized":"2024-09-17T02:24:33.344493+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:46.435146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.340997+0000","last_change":"2024-09-17T02:24:30.336467+0000","last_active":"2024-09-17T02:24:33.340997+0000","last_peered":"2024-09-17T02:24:33.340997+0000","last_clean":"2024-09-17T02:24:33.340997+0000","last_became_active":"2024-09-17T02:24:30.336042+0000","last_became_peered":"2024-09-17T02:24:30.336042+0000","last_unstale":"2024-09-17T02:24:33.340997+0000","last_undegraded":"2024-09-17T02:24:33.340997+0000","last_fullsized":"2024-09-17T02:24:33.340997+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:59.645621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":137,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.710287+0000","last_change":"2024-09-17T02:20:16.570456+0000","last_active":"2024-09-17T02:24:32.710287+0000","last_peered":"2024-09-17T02:24:32.710287+0000","last_clean":"2024-09-17T02:24:32.710287+0000","last_became_active":"2024-09-17T02:20:16.568095+0000","last_became_peered":"2024-09-17T02:20:16.568095+0000","last_unstale":"2024-09-17T02:24:32.710287+0000","last_undegraded":"2024-09-17T02:24:32.710287+0000","last_fullsized":"2024-09-17T02:24:32.710287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:58.329169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.690370+0000","last_change":"2024-09-17T02:20:15.560293+0000","last_active":"2024-09-17T02:24:30.690370+0000","last_peered":"2024-09-17T02:24:30.690370+0000","last_clean":"2024-09-17T02:24:30.690370+0000","last_became_active":"2024-09-17T02:20:15.559074+0000","last_became_peered":"2024-09-17T02:20:15.559074+0000","last_unstale":"2024-09-17T02:24:30.690370+0000","last_undegraded":"2024-09-17T02:24:30.690370+0000","last_fullsized":"2024-09-17T02:24:30.690370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:55.639841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.343294+0000","last_change":"2024-09-17T02:24:30.319629+0000","last_active":"2024-09-17T02:24:33.343294+0000","last_peered":"2024-09-17T02:24:33.343294+0000","last_clean":"2024-09-17T02:24:33.343294+0000","last_became_active":"2024-09-17T02:24:30.319441+0000","last_became_peered":"2024-09-17T02:24:30.319441+0000","last_unstale":"2024-09-17T02:24:33.343294+0000","last_undegraded":"2024-09-17T02:24:33.343294+0000","last_fullsized":"2024-09-17T02:24:33.343294+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:58.379141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":149,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.699964+0000","last_change":"2024-09-17T02:24:30.699964+0000","last_active":"2024-09-17T02:24:30.699964+0000","last_peered":"2024-09-17T02:24:30.699964+0000","last_clean":"2024-09-17T02:24:30.699964+0000","last_became_active":"2024-09-17T02:24:30.699102+0000","last_became_peered":"2024-09-17T02:24:30.699102+0000","last_unstale":"2024-09-17T02:24:30.699964+0000","last_undegraded":"2024-09-17T02:24:30.699964+0000","last_fullsized":"2024-09-17T02:24:30.699964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:19.193516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":121,"acting":121,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5558,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":63,"acting":63,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705722,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361176,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":360190,"kb_avail":94010664,"statfs":{"total":96636764160,"available":96266919936,"internally_reserved":0,"allocated":987136,"data_stored":948729,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":368835013},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":80,"seq":343597383682,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56420,"kb_used_data":976,"kb_used_omap":6,"kb_used_meta":55417,"kb_avail":94315420,"statfs":{"total":96636764160,"available":96578990080,"internally_reserved":0,"allocated":999424,"data_stored":949364,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":7153,"internal_metadata":56747023},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738425,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329168,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94042672,"statfs":{"total":96636764160,"available":96299696128,"internally_reserved":0,"allocated":909312,"data_stored":352941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5558,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T02:24:35.446 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T02:24:35.849 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:24:35.849 INFO:teuthology.orchestra.run.smithi001.stdout:{"fsid":"37cd4495-4915-41f4-bad2-2394cbe235f3","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":283,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":84,"num_osds":3,"num_up_osds":3,"osd_up_since":1726539869,"num_in_osds":3,"osd_in_since":1726539594,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":91},{"state_name":"active+undersized","count":8},{"state_name":"peering","count":6}],"num_pgs":105,"num_pools":4,"num_objects":26,"data_bytes":592797,"bytes_used":764686336,"bytes_avail":289145606144,"bytes_total":289910292480,"inactive_pgs_ratio":0.05714285746216774},"fsmap":{"epoch":6,"btime":"2024-09-17T02:20:19:554662+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4207}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-09-17T02:21:23.365440+0000","services":{}},"progress_events":{}} 2024-09-17T02:24:35.867 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T02:24:35.868 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:24:36.155 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:24:36.157 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-17T02:24:36.172 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2024-09-17T02:24:35.466187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":202,"acting":202,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":746764,"kb_used_data":2828,"kb_used_omap":10,"kb_used_meta":743861,"kb_avail":282368756,"statfs":{"total":289910292480,"available":289145606144,"internally_reserved":0,"allocated":2895872,"data_stored":2251034,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10343,"internal_metadata":761714585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-25,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.786796"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":150,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.711545+0000","last_change":"2024-09-17T02:24:30.707199+0000","last_active":"2024-09-17T02:24:32.711545+0000","last_peered":"2024-09-17T02:24:32.711545+0000","last_clean":"2024-09-17T02:24:32.711545+0000","last_became_active":"2024-09-17T02:24:30.706528+0000","last_became_peered":"2024-09-17T02:24:30.706528+0000","last_unstale":"2024-09-17T02:24:32.711545+0000","last_undegraded":"2024-09-17T02:24:32.711545+0000","last_fullsized":"2024-09-17T02:24:32.711545+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:19.531357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":120,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.689233+0000","last_change":"2024-09-17T02:20:37.709698+0000","last_active":"2024-09-17T02:24:30.689233+0000","last_peered":"2024-09-17T02:24:30.689233+0000","last_clean":"2024-09-17T02:24:30.689233+0000","last_became_active":"2024-09-17T02:20:37.708951+0000","last_became_peered":"2024-09-17T02:20:37.708951+0000","last_unstale":"2024-09-17T02:24:30.689233+0000","last_undegraded":"2024-09-17T02:24:30.689233+0000","last_fullsized":"2024-09-17T02:24:30.689233+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:30.839358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.348689+0000","last_change":"2024-09-17T02:24:30.339249+0000","last_active":"2024-09-17T02:24:33.348689+0000","last_peered":"2024-09-17T02:24:33.348689+0000","last_clean":"2024-09-17T02:24:33.348689+0000","last_became_active":"2024-09-17T02:24:30.338199+0000","last_became_peered":"2024-09-17T02:24:30.338199+0000","last_unstale":"2024-09-17T02:24:33.348689+0000","last_undegraded":"2024-09-17T02:24:33.348689+0000","last_fullsized":"2024-09-17T02:24:33.348689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:51.734408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":68,"reported_epoch":82,"state":"peering","last_fresh":"2024-09-17T02:24:32.832321+0000","last_change":"2024-09-17T02:24:33.345198+0000","last_active":"2024-09-17T02:24:33.345198+0000","last_peered":"2024-09-17T02:24:32.832321+0000","last_clean":"2024-09-17T02:24:32.832321+0000","last_became_active":"2024-09-17T02:24:30.334825+0000","last_became_peered":"2024-09-17T02:24:30.334825+0000","last_unstale":"2024-09-17T02:24:32.832321+0000","last_undegraded":"2024-09-17T02:24:32.832321+0000","last_fullsized":"2024-09-17T02:24:32.832321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":81,"reported_epoch":78,"state":"active+undersized","last_fresh":"2024-09-17T02:22:39.957929+0000","last_change":"2024-09-17T02:21:35.525199+0000","last_active":"2024-09-17T02:22:39.957929+0000","last_peered":"2024-09-17T02:22:39.957929+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"2024-09-17T02:21:35.525199+0000","last_became_peered":"2024-09-17T02:21:35.525199+0000","last_unstale":"2024-09-17T02:22:39.957929+0000","last_undegraded":"2024-09-17T02:22:39.957929+0000","last_fullsized":"2024-09-17T02:21:35.499010+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:33.632506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.345428+0000","last_change":"2024-09-17T02:24:30.322619+0000","last_active":"2024-09-17T02:24:33.345428+0000","last_peered":"2024-09-17T02:24:33.345428+0000","last_clean":"2024-09-17T02:24:33.345428+0000","last_became_active":"2024-09-17T02:24:30.322191+0000","last_became_peered":"2024-09-17T02:24:30.322191+0000","last_unstale":"2024-09-17T02:24:33.345428+0000","last_undegraded":"2024-09-17T02:24:33.345428+0000","last_fullsized":"2024-09-17T02:24:33.345428+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:26.120304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.342568+0000","last_change":"2024-09-17T02:24:30.330077+0000","last_active":"2024-09-17T02:24:33.342568+0000","last_peered":"2024-09-17T02:24:33.342568+0000","last_clean":"2024-09-17T02:24:33.342568+0000","last_became_active":"2024-09-17T02:24:30.329814+0000","last_became_peered":"2024-09-17T02:24:30.329814+0000","last_unstale":"2024-09-17T02:24:33.342568+0000","last_undegraded":"2024-09-17T02:24:33.342568+0000","last_fullsized":"2024-09-17T02:24:33.342568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:09.933024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.341786+0000","last_change":"2024-09-17T02:24:30.319625+0000","last_active":"2024-09-17T02:24:33.341786+0000","last_peered":"2024-09-17T02:24:33.341786+0000","last_clean":"2024-09-17T02:24:33.341786+0000","last_became_active":"2024-09-17T02:24:30.319316+0000","last_became_peered":"2024-09-17T02:24:30.319316+0000","last_unstale":"2024-09-17T02:24:33.341786+0000","last_undegraded":"2024-09-17T02:24:33.341786+0000","last_fullsized":"2024-09-17T02:24:33.341786+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:30.753462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.689266+0000","last_change":"2024-09-17T02:20:16.584665+0000","last_active":"2024-09-17T02:24:30.689266+0000","last_peered":"2024-09-17T02:24:30.689266+0000","last_clean":"2024-09-17T02:24:30.689266+0000","last_became_active":"2024-09-17T02:20:16.580797+0000","last_became_peered":"2024-09-17T02:20:16.580797+0000","last_unstale":"2024-09-17T02:24:30.689266+0000","last_undegraded":"2024-09-17T02:24:30.689266+0000","last_fullsized":"2024-09-17T02:24:30.689266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:47.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":149,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.711082+0000","last_change":"2024-09-17T02:24:30.699853+0000","last_active":"2024-09-17T02:24:32.711082+0000","last_peered":"2024-09-17T02:24:32.711082+0000","last_clean":"2024-09-17T02:24:32.711082+0000","last_became_active":"2024-09-17T02:24:30.697837+0000","last_became_peered":"2024-09-17T02:24:30.697837+0000","last_unstale":"2024-09-17T02:24:32.711082+0000","last_undegraded":"2024-09-17T02:24:32.711082+0000","last_fullsized":"2024-09-17T02:24:32.711082+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:09.331675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.348405+0000","last_change":"2024-09-17T02:24:30.329180+0000","last_active":"2024-09-17T02:24:33.348405+0000","last_peered":"2024-09-17T02:24:33.348405+0000","last_clean":"2024-09-17T02:24:33.348405+0000","last_became_active":"2024-09-17T02:24:30.328962+0000","last_became_peered":"2024-09-17T02:24:30.328962+0000","last_unstale":"2024-09-17T02:24:33.348405+0000","last_undegraded":"2024-09-17T02:24:33.348405+0000","last_fullsized":"2024-09-17T02:24:33.348405+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:21.425064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.349334+0000","last_change":"2024-09-17T02:24:30.336021+0000","last_active":"2024-09-17T02:24:33.349334+0000","last_peered":"2024-09-17T02:24:33.349334+0000","last_clean":"2024-09-17T02:24:33.349334+0000","last_became_active":"2024-09-17T02:24:30.335245+0000","last_became_peered":"2024-09-17T02:24:30.335245+0000","last_unstale":"2024-09-17T02:24:33.349334+0000","last_undegraded":"2024-09-17T02:24:33.349334+0000","last_fullsized":"2024-09-17T02:24:33.349334+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:12.509297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":120,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.688847+0000","last_change":"2024-09-17T02:20:37.709476+0000","last_active":"2024-09-17T02:24:30.688847+0000","last_peered":"2024-09-17T02:24:30.688847+0000","last_clean":"2024-09-17T02:24:30.688847+0000","last_became_active":"2024-09-17T02:20:37.708730+0000","last_became_peered":"2024-09-17T02:20:37.708730+0000","last_unstale":"2024-09-17T02:24:30.688847+0000","last_undegraded":"2024-09-17T02:24:30.688847+0000","last_fullsized":"2024-09-17T02:24:30.688847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:54.725651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.345178+0000","last_change":"2024-09-17T02:24:30.337132+0000","last_active":"2024-09-17T02:24:33.345178+0000","last_peered":"2024-09-17T02:24:33.345178+0000","last_clean":"2024-09-17T02:24:33.345178+0000","last_became_active":"2024-09-17T02:24:30.335871+0000","last_became_peered":"2024-09-17T02:24:30.335871+0000","last_unstale":"2024-09-17T02:24:33.345178+0000","last_undegraded":"2024-09-17T02:24:33.345178+0000","last_fullsized":"2024-09-17T02:24:33.345178+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:21.006777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.342161+0000","last_change":"2024-09-17T02:24:30.335635+0000","last_active":"2024-09-17T02:24:33.342161+0000","last_peered":"2024-09-17T02:24:33.342161+0000","last_clean":"2024-09-17T02:24:33.342161+0000","last_became_active":"2024-09-17T02:24:30.335086+0000","last_became_peered":"2024-09-17T02:24:30.335086+0000","last_unstale":"2024-09-17T02:24:33.342161+0000","last_undegraded":"2024-09-17T02:24:33.342161+0000","last_fullsized":"2024-09-17T02:24:33.342161+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:01.913411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.343734+0000","last_change":"2024-09-17T02:24:30.325322+0000","last_active":"2024-09-17T02:24:33.343734+0000","last_peered":"2024-09-17T02:24:33.343734+0000","last_clean":"2024-09-17T02:24:33.343734+0000","last_became_active":"2024-09-17T02:24:30.325002+0000","last_became_peered":"2024-09-17T02:24:30.325002+0000","last_unstale":"2024-09-17T02:24:33.343734+0000","last_undegraded":"2024-09-17T02:24:33.343734+0000","last_fullsized":"2024-09-17T02:24:33.343734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:16.238014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.690369+0000","last_change":"2024-09-17T02:20:16.563482+0000","last_active":"2024-09-17T02:24:30.690369+0000","last_peered":"2024-09-17T02:24:30.690369+0000","last_clean":"2024-09-17T02:24:30.690369+0000","last_became_active":"2024-09-17T02:20:16.562735+0000","last_became_peered":"2024-09-17T02:20:16.562735+0000","last_unstale":"2024-09-17T02:24:30.690369+0000","last_undegraded":"2024-09-17T02:24:30.690369+0000","last_fullsized":"2024-09-17T02:24:30.690369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:10.315951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":120,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.689767+0000","last_change":"2024-09-17T02:20:37.706162+0000","last_active":"2024-09-17T02:24:30.689767+0000","last_peered":"2024-09-17T02:24:30.689767+0000","last_clean":"2024-09-17T02:24:30.689767+0000","last_became_active":"2024-09-17T02:20:37.705497+0000","last_became_peered":"2024-09-17T02:20:37.705497+0000","last_unstale":"2024-09-17T02:24:30.689767+0000","last_undegraded":"2024-09-17T02:24:30.689767+0000","last_fullsized":"2024-09-17T02:24:30.689767+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:43.467659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.689421+0000","last_change":"2024-09-17T02:20:16.586950+0000","last_active":"2024-09-17T02:24:30.689421+0000","last_peered":"2024-09-17T02:24:30.689421+0000","last_clean":"2024-09-17T02:24:30.689421+0000","last_became_active":"2024-09-17T02:20:16.586281+0000","last_became_peered":"2024-09-17T02:20:16.586281+0000","last_unstale":"2024-09-17T02:24:30.689421+0000","last_undegraded":"2024-09-17T02:24:30.689421+0000","last_fullsized":"2024-09-17T02:24:30.689421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:22.801598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.349235+0000","last_change":"2024-09-17T02:24:30.330312+0000","last_active":"2024-09-17T02:24:33.349235+0000","last_peered":"2024-09-17T02:24:33.349235+0000","last_clean":"2024-09-17T02:24:33.349235+0000","last_became_active":"2024-09-17T02:24:30.329980+0000","last_became_peered":"2024-09-17T02:24:30.329980+0000","last_unstale":"2024-09-17T02:24:33.349235+0000","last_undegraded":"2024-09-17T02:24:33.349235+0000","last_fullsized":"2024-09-17T02:24:33.349235+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:53.422140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"peering","last_fresh":"2024-09-17T02:24:32.832054+0000","last_change":"2024-09-17T02:24:33.343284+0000","last_active":"2024-09-17T02:24:33.343284+0000","last_peered":"2024-09-17T02:24:32.832054+0000","last_clean":"2024-09-17T02:24:32.832054+0000","last_became_active":"2024-09-17T02:24:30.326057+0000","last_became_peered":"2024-09-17T02:24:30.326057+0000","last_unstale":"2024-09-17T02:24:32.832054+0000","last_undegraded":"2024-09-17T02:24:32.832054+0000","last_fullsized":"2024-09-17T02:24:32.832054+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":144,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.710157+0000","last_change":"2024-09-17T02:24:30.702500+0000","last_active":"2024-09-17T02:24:32.710157+0000","last_peered":"2024-09-17T02:24:32.710157+0000","last_clean":"2024-09-17T02:24:32.710157+0000","last_became_active":"2024-09-17T02:24:30.700674+0000","last_became_peered":"2024-09-17T02:24:30.700674+0000","last_unstale":"2024-09-17T02:24:32.710157+0000","last_undegraded":"2024-09-17T02:24:32.710157+0000","last_fullsized":"2024-09-17T02:24:32.710157+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:47.554275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.700096+0000","last_change":"2024-09-17T02:24:30.700096+0000","last_active":"2024-09-17T02:24:30.700096+0000","last_peered":"2024-09-17T02:24:30.700096+0000","last_clean":"2024-09-17T02:24:30.700096+0000","last_became_active":"2024-09-17T02:24:30.698022+0000","last_became_peered":"2024-09-17T02:24:30.698022+0000","last_unstale":"2024-09-17T02:24:30.700096+0000","last_undegraded":"2024-09-17T02:24:30.700096+0000","last_fullsized":"2024-09-17T02:24:30.700096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:53.002528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":120,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.689320+0000","last_change":"2024-09-17T02:20:37.710222+0000","last_active":"2024-09-17T02:24:30.689320+0000","last_peered":"2024-09-17T02:24:30.689320+0000","last_clean":"2024-09-17T02:24:30.689320+0000","last_became_active":"2024-09-17T02:20:37.709227+0000","last_became_peered":"2024-09-17T02:20:37.709227+0000","last_unstale":"2024-09-17T02:24:30.689320+0000","last_undegraded":"2024-09-17T02:24:30.689320+0000","last_fullsized":"2024-09-17T02:24:30.689320+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:01:44.250550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":144,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.711682+0000","last_change":"2024-09-17T02:24:30.704846+0000","last_active":"2024-09-17T02:24:32.711682+0000","last_peered":"2024-09-17T02:24:32.711682+0000","last_clean":"2024-09-17T02:24:32.711682+0000","last_became_active":"2024-09-17T02:24:30.703377+0000","last_became_peered":"2024-09-17T02:24:30.703377+0000","last_unstale":"2024-09-17T02:24:32.711682+0000","last_undegraded":"2024-09-17T02:24:32.711682+0000","last_fullsized":"2024-09-17T02:24:32.711682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:21.642002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.696851+0000","last_change":"2024-09-17T02:24:30.696851+0000","last_active":"2024-09-17T02:24:30.696851+0000","last_peered":"2024-09-17T02:24:30.696851+0000","last_clean":"2024-09-17T02:24:30.696851+0000","last_became_active":"2024-09-17T02:24:30.694853+0000","last_became_peered":"2024-09-17T02:24:30.694853+0000","last_unstale":"2024-09-17T02:24:30.696851+0000","last_undegraded":"2024-09-17T02:24:30.696851+0000","last_fullsized":"2024-09-17T02:24:30.696851+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:39.353246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.348102+0000","last_change":"2024-09-17T02:24:30.339430+0000","last_active":"2024-09-17T02:24:33.348102+0000","last_peered":"2024-09-17T02:24:33.348102+0000","last_clean":"2024-09-17T02:24:33.348102+0000","last_became_active":"2024-09-17T02:24:30.338488+0000","last_became_peered":"2024-09-17T02:24:30.338488+0000","last_unstale":"2024-09-17T02:24:33.348102+0000","last_undegraded":"2024-09-17T02:24:33.348102+0000","last_fullsized":"2024-09-17T02:24:33.348102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:26.554742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.345943+0000","last_change":"2024-09-17T02:24:30.335659+0000","last_active":"2024-09-17T02:24:33.345943+0000","last_peered":"2024-09-17T02:24:33.345943+0000","last_clean":"2024-09-17T02:24:33.345943+0000","last_became_active":"2024-09-17T02:24:30.335243+0000","last_became_peered":"2024-09-17T02:24:30.335243+0000","last_unstale":"2024-09-17T02:24:33.345943+0000","last_undegraded":"2024-09-17T02:24:33.345943+0000","last_fullsized":"2024-09-17T02:24:33.345943+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:59.178360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":63,"reported_epoch":78,"state":"active+undersized","last_fresh":"2024-09-17T02:22:39.955770+0000","last_change":"2024-09-17T02:21:35.504429+0000","last_active":"2024-09-17T02:22:39.955770+0000","last_peered":"2024-09-17T02:22:39.955770+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"2024-09-17T02:21:35.504429+0000","last_became_peered":"2024-09-17T02:21:35.504429+0000","last_unstale":"2024-09-17T02:22:39.955770+0000","last_undegraded":"2024-09-17T02:22:39.955770+0000","last_fullsized":"2024-09-17T02:21:35.495718+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:35.227137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":145,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.710875+0000","last_change":"2024-09-17T02:24:30.700893+0000","last_active":"2024-09-17T02:24:32.710875+0000","last_peered":"2024-09-17T02:24:32.710875+0000","last_clean":"2024-09-17T02:24:32.710875+0000","last_became_active":"2024-09-17T02:24:30.699410+0000","last_became_peered":"2024-09-17T02:24:30.699410+0000","last_unstale":"2024-09-17T02:24:32.710875+0000","last_undegraded":"2024-09-17T02:24:32.710875+0000","last_fullsized":"2024-09-17T02:24:32.710875+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:29.137738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":62,"reported_epoch":78,"state":"active+undersized","last_fresh":"2024-09-17T02:22:39.951873+0000","last_change":"2024-09-17T02:21:35.515641+0000","last_active":"2024-09-17T02:22:39.951873+0000","last_peered":"2024-09-17T02:22:39.951873+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"2024-09-17T02:21:35.515641+0000","last_became_peered":"2024-09-17T02:21:35.515641+0000","last_unstale":"2024-09-17T02:22:39.951873+0000","last_undegraded":"2024-09-17T02:22:39.951873+0000","last_fullsized":"2024-09-17T02:21:35.493982+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:19.243921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"peering","last_fresh":"2024-09-17T02:24:32.831104+0000","last_change":"2024-09-17T02:24:33.342836+0000","last_active":"2024-09-17T02:24:33.342836+0000","last_peered":"2024-09-17T02:24:32.831104+0000","last_clean":"2024-09-17T02:24:32.831104+0000","last_became_active":"2024-09-17T02:24:30.337401+0000","last_became_peered":"2024-09-17T02:24:30.337401+0000","last_unstale":"2024-09-17T02:24:32.831104+0000","last_undegraded":"2024-09-17T02:24:32.831104+0000","last_fullsized":"2024-09-17T02:24:32.831104+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":81,"reported_epoch":78,"state":"active+undersized","last_fresh":"2024-09-17T02:22:39.953144+0000","last_change":"2024-09-17T02:21:35.515253+0000","last_active":"2024-09-17T02:22:39.953144+0000","last_peered":"2024-09-17T02:22:39.953144+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"2024-09-17T02:21:35.515253+0000","last_became_peered":"2024-09-17T02:21:35.515253+0000","last_unstale":"2024-09-17T02:22:39.953144+0000","last_undegraded":"2024-09-17T02:22:39.953144+0000","last_fullsized":"2024-09-17T02:21:35.501233+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:44.804845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.346005+0000","last_change":"2024-09-17T02:24:30.329201+0000","last_active":"2024-09-17T02:24:33.346005+0000","last_peered":"2024-09-17T02:24:33.346005+0000","last_clean":"2024-09-17T02:24:33.346005+0000","last_became_active":"2024-09-17T02:24:30.328907+0000","last_became_peered":"2024-09-17T02:24:30.328907+0000","last_unstale":"2024-09-17T02:24:33.346005+0000","last_undegraded":"2024-09-17T02:24:33.346005+0000","last_fullsized":"2024-09-17T02:24:33.346005+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:31.463647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":149,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.711710+0000","last_change":"2024-09-17T02:24:30.701022+0000","last_active":"2024-09-17T02:24:32.711710+0000","last_peered":"2024-09-17T02:24:32.711710+0000","last_clean":"2024-09-17T02:24:32.711710+0000","last_became_active":"2024-09-17T02:24:30.697260+0000","last_became_peered":"2024-09-17T02:24:30.697260+0000","last_unstale":"2024-09-17T02:24:32.711710+0000","last_undegraded":"2024-09-17T02:24:32.711710+0000","last_fullsized":"2024-09-17T02:24:32.711710+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:33.937384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":64,"reported_epoch":78,"state":"active+undersized","last_fresh":"2024-09-17T02:22:39.952048+0000","last_change":"2024-09-17T02:21:35.502703+0000","last_active":"2024-09-17T02:22:39.952048+0000","last_peered":"2024-09-17T02:22:39.952048+0000","last_clean":"2024-09-17T02:20:14.516708+0000","last_became_active":"2024-09-17T02:21:35.502703+0000","last_became_peered":"2024-09-17T02:21:35.502703+0000","last_unstale":"2024-09-17T02:22:39.952048+0000","last_undegraded":"2024-09-17T02:22:39.952048+0000","last_fullsized":"2024-09-17T02:21:35.493481+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:06:14.731289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":64,"reported_epoch":78,"state":"active+undersized","last_fresh":"2024-09-17T02:22:39.953444+0000","last_change":"2024-09-17T02:21:35.502713+0000","last_active":"2024-09-17T02:22:39.953444+0000","last_peered":"2024-09-17T02:22:39.953444+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"2024-09-17T02:21:35.502713+0000","last_became_peered":"2024-09-17T02:21:35.502713+0000","last_unstale":"2024-09-17T02:22:39.953444+0000","last_undegraded":"2024-09-17T02:22:39.953444+0000","last_fullsized":"2024-09-17T02:21:35.494355+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:13.449935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":146,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.709973+0000","last_change":"2024-09-17T02:24:30.702653+0000","last_active":"2024-09-17T02:24:32.709973+0000","last_peered":"2024-09-17T02:24:32.709973+0000","last_clean":"2024-09-17T02:24:32.709973+0000","last_became_active":"2024-09-17T02:24:30.701047+0000","last_became_peered":"2024-09-17T02:24:30.701047+0000","last_unstale":"2024-09-17T02:24:32.709973+0000","last_undegraded":"2024-09-17T02:24:32.709973+0000","last_fullsized":"2024-09-17T02:24:32.709973+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:26.569439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.698841+0000","last_change":"2024-09-17T02:24:30.698841+0000","last_active":"2024-09-17T02:24:30.698841+0000","last_peered":"2024-09-17T02:24:30.698841+0000","last_clean":"2024-09-17T02:24:30.698841+0000","last_became_active":"2024-09-17T02:24:30.697606+0000","last_became_peered":"2024-09-17T02:24:30.697606+0000","last_unstale":"2024-09-17T02:24:30.698841+0000","last_undegraded":"2024-09-17T02:24:30.698841+0000","last_fullsized":"2024-09-17T02:24:30.698841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:20.038861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.339904+0000","last_change":"2024-09-17T02:24:30.336630+0000","last_active":"2024-09-17T02:24:33.339904+0000","last_peered":"2024-09-17T02:24:33.339904+0000","last_clean":"2024-09-17T02:24:33.339904+0000","last_became_active":"2024-09-17T02:24:30.336326+0000","last_became_peered":"2024-09-17T02:24:30.336326+0000","last_unstale":"2024-09-17T02:24:33.339904+0000","last_undegraded":"2024-09-17T02:24:33.339904+0000","last_fullsized":"2024-09-17T02:24:33.339904+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:30.072709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.348135+0000","last_change":"2024-09-17T02:24:30.336771+0000","last_active":"2024-09-17T02:24:33.348135+0000","last_peered":"2024-09-17T02:24:33.348135+0000","last_clean":"2024-09-17T02:24:33.348135+0000","last_became_active":"2024-09-17T02:24:30.336494+0000","last_became_peered":"2024-09-17T02:24:30.336494+0000","last_unstale":"2024-09-17T02:24:33.348135+0000","last_undegraded":"2024-09-17T02:24:33.348135+0000","last_fullsized":"2024-09-17T02:24:33.348135+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:17.852502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.344647+0000","last_change":"2024-09-17T02:24:30.338523+0000","last_active":"2024-09-17T02:24:33.344647+0000","last_peered":"2024-09-17T02:24:33.344647+0000","last_clean":"2024-09-17T02:24:33.344647+0000","last_became_active":"2024-09-17T02:24:30.337726+0000","last_became_peered":"2024-09-17T02:24:30.337726+0000","last_unstale":"2024-09-17T02:24:33.344647+0000","last_undegraded":"2024-09-17T02:24:33.344647+0000","last_fullsized":"2024-09-17T02:24:33.344647+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:33.124995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":148,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.711685+0000","last_change":"2024-09-17T02:24:30.697584+0000","last_active":"2024-09-17T02:24:32.711685+0000","last_peered":"2024-09-17T02:24:32.711685+0000","last_clean":"2024-09-17T02:24:32.711685+0000","last_became_active":"2024-09-17T02:24:30.695140+0000","last_became_peered":"2024-09-17T02:24:30.695140+0000","last_unstale":"2024-09-17T02:24:32.711685+0000","last_undegraded":"2024-09-17T02:24:32.711685+0000","last_fullsized":"2024-09-17T02:24:32.711685+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:07.386102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":120,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.690726+0000","last_change":"2024-09-17T02:20:37.705585+0000","last_active":"2024-09-17T02:24:30.690726+0000","last_peered":"2024-09-17T02:24:30.690726+0000","last_clean":"2024-09-17T02:24:30.690726+0000","last_became_active":"2024-09-17T02:20:37.705266+0000","last_became_peered":"2024-09-17T02:20:37.705266+0000","last_unstale":"2024-09-17T02:24:30.690726+0000","last_undegraded":"2024-09-17T02:24:30.690726+0000","last_fullsized":"2024-09-17T02:24:30.690726+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:10:51.092163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.345869+0000","last_change":"2024-09-17T02:24:30.338939+0000","last_active":"2024-09-17T02:24:33.345869+0000","last_peered":"2024-09-17T02:24:33.345869+0000","last_clean":"2024-09-17T02:24:33.345869+0000","last_became_active":"2024-09-17T02:24:30.337650+0000","last_became_peered":"2024-09-17T02:24:30.337650+0000","last_unstale":"2024-09-17T02:24:33.345869+0000","last_undegraded":"2024-09-17T02:24:33.345869+0000","last_fullsized":"2024-09-17T02:24:33.345869+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:00.927950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.345686+0000","last_change":"2024-09-17T02:24:30.322785+0000","last_active":"2024-09-17T02:24:33.345686+0000","last_peered":"2024-09-17T02:24:33.345686+0000","last_clean":"2024-09-17T02:24:33.345686+0000","last_became_active":"2024-09-17T02:24:30.322509+0000","last_became_peered":"2024-09-17T02:24:30.322509+0000","last_unstale":"2024-09-17T02:24:33.345686+0000","last_undegraded":"2024-09-17T02:24:33.345686+0000","last_fullsized":"2024-09-17T02:24:33.345686+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:06.381434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.345666+0000","last_change":"2024-09-17T02:24:30.329944+0000","last_active":"2024-09-17T02:24:33.345666+0000","last_peered":"2024-09-17T02:24:33.345666+0000","last_clean":"2024-09-17T02:24:33.345666+0000","last_became_active":"2024-09-17T02:24:30.329642+0000","last_became_peered":"2024-09-17T02:24:30.329642+0000","last_unstale":"2024-09-17T02:24:33.345666+0000","last_undegraded":"2024-09-17T02:24:33.345666+0000","last_fullsized":"2024-09-17T02:24:33.345666+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:39.135831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.699239+0000","last_change":"2024-09-17T02:24:30.699239+0000","last_active":"2024-09-17T02:24:30.699239+0000","last_peered":"2024-09-17T02:24:30.699239+0000","last_clean":"2024-09-17T02:24:30.699239+0000","last_became_active":"2024-09-17T02:24:30.697800+0000","last_became_peered":"2024-09-17T02:24:30.697800+0000","last_unstale":"2024-09-17T02:24:30.699239+0000","last_undegraded":"2024-09-17T02:24:30.699239+0000","last_fullsized":"2024-09-17T02:24:30.699239+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:42.056577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.697486+0000","last_change":"2024-09-17T02:24:30.697486+0000","last_active":"2024-09-17T02:24:30.697486+0000","last_peered":"2024-09-17T02:24:30.697486+0000","last_clean":"2024-09-17T02:24:30.697486+0000","last_became_active":"2024-09-17T02:24:30.696079+0000","last_became_peered":"2024-09-17T02:24:30.696079+0000","last_unstale":"2024-09-17T02:24:30.697486+0000","last_undegraded":"2024-09-17T02:24:30.697486+0000","last_fullsized":"2024-09-17T02:24:30.697486+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:07.222731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.346188+0000","last_change":"2024-09-17T02:24:30.330194+0000","last_active":"2024-09-17T02:24:33.346188+0000","last_peered":"2024-09-17T02:24:33.346188+0000","last_clean":"2024-09-17T02:24:33.346188+0000","last_became_active":"2024-09-17T02:24:30.329676+0000","last_became_peered":"2024-09-17T02:24:30.329676+0000","last_unstale":"2024-09-17T02:24:33.346188+0000","last_undegraded":"2024-09-17T02:24:33.346188+0000","last_fullsized":"2024-09-17T02:24:33.346188+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:50:41.161871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"peering","last_fresh":"2024-09-17T02:24:32.831321+0000","last_change":"2024-09-17T02:24:33.341698+0000","last_active":"2024-09-17T02:24:33.341698+0000","last_peered":"2024-09-17T02:24:32.831321+0000","last_clean":"2024-09-17T02:24:32.831321+0000","last_became_active":"2024-09-17T02:24:30.336497+0000","last_became_peered":"2024-09-17T02:24:30.336497+0000","last_unstale":"2024-09-17T02:24:32.831321+0000","last_undegraded":"2024-09-17T02:24:32.831321+0000","last_fullsized":"2024-09-17T02:24:32.831321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.345583+0000","last_change":"2024-09-17T02:24:30.338531+0000","last_active":"2024-09-17T02:24:33.345583+0000","last_peered":"2024-09-17T02:24:33.345583+0000","last_clean":"2024-09-17T02:24:33.345583+0000","last_became_active":"2024-09-17T02:24:30.336902+0000","last_became_peered":"2024-09-17T02:24:30.336902+0000","last_unstale":"2024-09-17T02:24:33.345583+0000","last_undegraded":"2024-09-17T02:24:33.345583+0000","last_fullsized":"2024-09-17T02:24:33.345583+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:49.660896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.340328+0000","last_change":"2024-09-17T02:24:30.322953+0000","last_active":"2024-09-17T02:24:33.340328+0000","last_peered":"2024-09-17T02:24:33.340328+0000","last_clean":"2024-09-17T02:24:33.340328+0000","last_became_active":"2024-09-17T02:24:30.322780+0000","last_became_peered":"2024-09-17T02:24:30.322780+0000","last_unstale":"2024-09-17T02:24:33.340328+0000","last_undegraded":"2024-09-17T02:24:33.340328+0000","last_fullsized":"2024-09-17T02:24:33.340328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:59:33.087791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.348973+0000","last_change":"2024-09-17T02:24:30.326828+0000","last_active":"2024-09-17T02:24:33.348973+0000","last_peered":"2024-09-17T02:24:33.348973+0000","last_clean":"2024-09-17T02:24:33.348973+0000","last_became_active":"2024-09-17T02:24:30.326227+0000","last_became_peered":"2024-09-17T02:24:30.326227+0000","last_unstale":"2024-09-17T02:24:33.348973+0000","last_undegraded":"2024-09-17T02:24:33.348973+0000","last_fullsized":"2024-09-17T02:24:33.348973+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:53.135460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":120,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.689725+0000","last_change":"2024-09-17T02:20:37.709979+0000","last_active":"2024-09-17T02:24:30.689725+0000","last_peered":"2024-09-17T02:24:30.689725+0000","last_clean":"2024-09-17T02:24:30.689725+0000","last_became_active":"2024-09-17T02:20:37.708736+0000","last_became_peered":"2024-09-17T02:20:37.708736+0000","last_unstale":"2024-09-17T02:24:30.689725+0000","last_undegraded":"2024-09-17T02:24:30.689725+0000","last_fullsized":"2024-09-17T02:24:30.689725+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:03.481029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.690041+0000","last_change":"2024-09-17T02:20:16.583084+0000","last_active":"2024-09-17T02:24:30.690041+0000","last_peered":"2024-09-17T02:24:30.690041+0000","last_clean":"2024-09-17T02:24:30.690041+0000","last_became_active":"2024-09-17T02:20:16.582326+0000","last_became_peered":"2024-09-17T02:20:16.582326+0000","last_unstale":"2024-09-17T02:24:30.690041+0000","last_undegraded":"2024-09-17T02:24:30.690041+0000","last_fullsized":"2024-09-17T02:24:30.690041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:05.049317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":223,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.340149+0000","last_change":"2024-09-17T02:24:30.338760+0000","last_active":"2024-09-17T02:24:33.340149+0000","last_peered":"2024-09-17T02:24:33.340149+0000","last_clean":"2024-09-17T02:24:33.340149+0000","last_became_active":"2024-09-17T02:24:30.338214+0000","last_became_peered":"2024-09-17T02:24:30.338214+0000","last_unstale":"2024-09-17T02:24:33.340149+0000","last_undegraded":"2024-09-17T02:24:33.340149+0000","last_fullsized":"2024-09-17T02:24:33.340149+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_clean_scrub_stamp":"2024-09-17T02:20:03.432050+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:27:29.124652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":47,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.340692+0000","last_change":"2024-09-17T02:24:30.325326+0000","last_active":"2024-09-17T02:24:33.340692+0000","last_peered":"2024-09-17T02:24:33.340692+0000","last_clean":"2024-09-17T02:24:33.340692+0000","last_became_active":"2024-09-17T02:24:30.324910+0000","last_became_peered":"2024-09-17T02:24:30.324910+0000","last_unstale":"2024-09-17T02:24:33.340692+0000","last_undegraded":"2024-09-17T02:24:33.340692+0000","last_fullsized":"2024-09-17T02:24:33.340692+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:52:27.682190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.689869+0000","last_change":"2024-09-17T02:20:15.560646+0000","last_active":"2024-09-17T02:24:30.689869+0000","last_peered":"2024-09-17T02:24:30.689869+0000","last_clean":"2024-09-17T02:24:30.689869+0000","last_became_active":"2024-09-17T02:20:15.559104+0000","last_became_peered":"2024-09-17T02:20:15.559104+0000","last_unstale":"2024-09-17T02:24:30.689869+0000","last_undegraded":"2024-09-17T02:24:30.689869+0000","last_fullsized":"2024-09-17T02:24:30.689869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:44.299986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.346155+0000","last_change":"2024-09-17T02:24:30.339100+0000","last_active":"2024-09-17T02:24:33.346155+0000","last_peered":"2024-09-17T02:24:33.346155+0000","last_clean":"2024-09-17T02:24:33.346155+0000","last_became_active":"2024-09-17T02:24:30.337415+0000","last_became_peered":"2024-09-17T02:24:30.337415+0000","last_unstale":"2024-09-17T02:24:33.346155+0000","last_undegraded":"2024-09-17T02:24:33.346155+0000","last_fullsized":"2024-09-17T02:24:33.346155+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:27.682975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.342403+0000","last_change":"2024-09-17T02:24:30.338621+0000","last_active":"2024-09-17T02:24:33.342403+0000","last_peered":"2024-09-17T02:24:33.342403+0000","last_clean":"2024-09-17T02:24:33.342403+0000","last_became_active":"2024-09-17T02:24:30.338024+0000","last_became_peered":"2024-09-17T02:24:30.338024+0000","last_unstale":"2024-09-17T02:24:33.342403+0000","last_undegraded":"2024-09-17T02:24:33.342403+0000","last_fullsized":"2024-09-17T02:24:33.342403+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:49.985865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.694491+0000","last_change":"2024-09-17T02:24:30.694491+0000","last_active":"2024-09-17T02:24:30.694491+0000","last_peered":"2024-09-17T02:24:30.694491+0000","last_clean":"2024-09-17T02:24:30.694491+0000","last_became_active":"2024-09-17T02:24:30.693653+0000","last_became_peered":"2024-09-17T02:24:30.693653+0000","last_unstale":"2024-09-17T02:24:30.694491+0000","last_undegraded":"2024-09-17T02:24:30.694491+0000","last_fullsized":"2024-09-17T02:24:30.694491+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:12.740030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":137,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.711376+0000","last_change":"2024-09-17T02:20:16.571568+0000","last_active":"2024-09-17T02:24:32.711376+0000","last_peered":"2024-09-17T02:24:32.711376+0000","last_clean":"2024-09-17T02:24:32.711376+0000","last_became_active":"2024-09-17T02:20:16.570622+0000","last_became_peered":"2024-09-17T02:20:16.570622+0000","last_unstale":"2024-09-17T02:24:32.711376+0000","last_undegraded":"2024-09-17T02:24:32.711376+0000","last_fullsized":"2024-09-17T02:24:32.711376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:57.083446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.691232+0000","last_change":"2024-09-17T02:20:12.511823+0000","last_active":"2024-09-17T02:24:30.691232+0000","last_peered":"2024-09-17T02:24:30.691232+0000","last_clean":"2024-09-17T02:24:30.691232+0000","last_became_active":"2024-09-17T02:20:10.497164+0000","last_became_peered":"2024-09-17T02:20:10.497164+0000","last_unstale":"2024-09-17T02:24:30.691232+0000","last_undegraded":"2024-09-17T02:24:30.691232+0000","last_fullsized":"2024-09-17T02:24:30.691232+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:21.242753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081052700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.339863+0000","last_change":"2024-09-17T02:24:30.336354+0000","last_active":"2024-09-17T02:24:33.339863+0000","last_peered":"2024-09-17T02:24:33.339863+0000","last_clean":"2024-09-17T02:24:33.339863+0000","last_became_active":"2024-09-17T02:24:30.336078+0000","last_became_peered":"2024-09-17T02:24:30.336078+0000","last_unstale":"2024-09-17T02:24:33.339863+0000","last_undegraded":"2024-09-17T02:24:33.339863+0000","last_fullsized":"2024-09-17T02:24:33.339863+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:49.027706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":62,"reported_epoch":78,"state":"active+undersized","last_fresh":"2024-09-17T02:22:39.955793+0000","last_change":"2024-09-17T02:21:35.505826+0000","last_active":"2024-09-17T02:22:39.955793+0000","last_peered":"2024-09-17T02:22:39.955793+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"2024-09-17T02:21:35.505826+0000","last_became_peered":"2024-09-17T02:21:35.505826+0000","last_unstale":"2024-09-17T02:22:39.955793+0000","last_undegraded":"2024-09-17T02:22:39.955793+0000","last_fullsized":"2024-09-17T02:21:35.495427+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:45:14.500678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":48,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.340246+0000","last_change":"2024-09-17T02:24:30.333204+0000","last_active":"2024-09-17T02:24:33.340246+0000","last_peered":"2024-09-17T02:24:33.340246+0000","last_clean":"2024-09-17T02:24:33.340246+0000","last_became_active":"2024-09-17T02:24:30.333005+0000","last_became_peered":"2024-09-17T02:24:30.333005+0000","last_unstale":"2024-09-17T02:24:33.340246+0000","last_undegraded":"2024-09-17T02:24:33.340246+0000","last_fullsized":"2024-09-17T02:24:33.340246+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:17.620422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078085399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.346307+0000","last_change":"2024-09-17T02:24:30.329442+0000","last_active":"2024-09-17T02:24:33.346307+0000","last_peered":"2024-09-17T02:24:33.346307+0000","last_clean":"2024-09-17T02:24:33.346307+0000","last_became_active":"2024-09-17T02:24:30.329213+0000","last_became_peered":"2024-09-17T02:24:30.329213+0000","last_unstale":"2024-09-17T02:24:33.346307+0000","last_undegraded":"2024-09-17T02:24:33.346307+0000","last_fullsized":"2024-09-17T02:24:33.346307+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:25.034116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.691532+0000","last_change":"2024-09-17T02:20:16.580184+0000","last_active":"2024-09-17T02:24:30.691532+0000","last_peered":"2024-09-17T02:24:30.691532+0000","last_clean":"2024-09-17T02:24:30.691532+0000","last_became_active":"2024-09-17T02:20:16.578343+0000","last_became_peered":"2024-09-17T02:20:16.578343+0000","last_unstale":"2024-09-17T02:24:30.691532+0000","last_undegraded":"2024-09-17T02:24:30.691532+0000","last_fullsized":"2024-09-17T02:24:30.691532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:42.123535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"peering","last_fresh":"2024-09-17T02:24:32.832397+0000","last_change":"2024-09-17T02:24:33.349018+0000","last_active":"2024-09-17T02:24:33.349018+0000","last_peered":"2024-09-17T02:24:32.832397+0000","last_clean":"2024-09-17T02:24:32.832397+0000","last_became_active":"2024-09-17T02:24:30.336380+0000","last_became_peered":"2024-09-17T02:24:30.336380+0000","last_unstale":"2024-09-17T02:24:32.832397+0000","last_undegraded":"2024-09-17T02:24:32.832397+0000","last_fullsized":"2024-09-17T02:24:32.832397+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.691910+0000","last_change":"2024-09-17T02:20:12.511838+0000","last_active":"2024-09-17T02:24:30.691910+0000","last_peered":"2024-09-17T02:24:30.691910+0000","last_clean":"2024-09-17T02:24:30.691910+0000","last_became_active":"2024-09-17T02:20:10.497049+0000","last_became_peered":"2024-09-17T02:20:10.497049+0000","last_unstale":"2024-09-17T02:24:30.691910+0000","last_undegraded":"2024-09-17T02:24:30.691910+0000","last_fullsized":"2024-09-17T02:24:30.691910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:54.446484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079701100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":145,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.710208+0000","last_change":"2024-09-17T02:24:30.698392+0000","last_active":"2024-09-17T02:24:32.710208+0000","last_peered":"2024-09-17T02:24:32.710208+0000","last_clean":"2024-09-17T02:24:32.710208+0000","last_became_active":"2024-09-17T02:24:30.694944+0000","last_became_peered":"2024-09-17T02:24:30.694944+0000","last_unstale":"2024-09-17T02:24:32.710208+0000","last_undegraded":"2024-09-17T02:24:32.710208+0000","last_fullsized":"2024-09-17T02:24:32.710208+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:06.407404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.691716+0000","last_change":"2024-09-17T02:20:15.559252+0000","last_active":"2024-09-17T02:24:30.691716+0000","last_peered":"2024-09-17T02:24:30.691716+0000","last_clean":"2024-09-17T02:24:30.691716+0000","last_became_active":"2024-09-17T02:20:15.557667+0000","last_became_peered":"2024-09-17T02:20:15.557667+0000","last_unstale":"2024-09-17T02:24:30.691716+0000","last_undegraded":"2024-09-17T02:24:30.691716+0000","last_fullsized":"2024-09-17T02:24:30.691716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:01.292626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":153,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.712148+0000","last_change":"2024-09-17T02:20:12.661034+0000","last_active":"2024-09-17T02:24:32.712148+0000","last_peered":"2024-09-17T02:24:32.712148+0000","last_clean":"2024-09-17T02:24:32.712148+0000","last_became_active":"2024-09-17T02:20:10.497829+0000","last_became_peered":"2024-09-17T02:20:10.497829+0000","last_unstale":"2024-09-17T02:24:32.712148+0000","last_undegraded":"2024-09-17T02:24:32.712148+0000","last_fullsized":"2024-09-17T02:24:32.712148+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:46:27.427685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096944700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.341107+0000","last_change":"2024-09-17T02:24:30.322910+0000","last_active":"2024-09-17T02:24:33.341107+0000","last_peered":"2024-09-17T02:24:33.341107+0000","last_clean":"2024-09-17T02:24:33.341107+0000","last_became_active":"2024-09-17T02:24:30.322632+0000","last_became_peered":"2024-09-17T02:24:30.322632+0000","last_unstale":"2024-09-17T02:24:33.341107+0000","last_undegraded":"2024-09-17T02:24:33.341107+0000","last_fullsized":"2024-09-17T02:24:33.341107+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:03.155286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.690335+0000","last_change":"2024-09-17T02:20:15.558961+0000","last_active":"2024-09-17T02:24:30.690335+0000","last_peered":"2024-09-17T02:24:30.690335+0000","last_clean":"2024-09-17T02:24:30.690335+0000","last_became_active":"2024-09-17T02:20:15.558299+0000","last_became_peered":"2024-09-17T02:20:15.558299+0000","last_unstale":"2024-09-17T02:24:30.690335+0000","last_undegraded":"2024-09-17T02:24:30.690335+0000","last_fullsized":"2024-09-17T02:24:30.690335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:39.709524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.690261+0000","last_change":"2024-09-17T02:20:12.512481+0000","last_active":"2024-09-17T02:24:30.690261+0000","last_peered":"2024-09-17T02:24:30.690261+0000","last_clean":"2024-09-17T02:24:30.690261+0000","last_became_active":"2024-09-17T02:20:10.497021+0000","last_became_peered":"2024-09-17T02:20:10.497021+0000","last_unstale":"2024-09-17T02:24:30.690261+0000","last_undegraded":"2024-09-17T02:24:30.690261+0000","last_fullsized":"2024-09-17T02:24:30.690261+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:41.167283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001400079,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.693811+0000","last_change":"2024-09-17T02:24:30.693811+0000","last_active":"2024-09-17T02:24:30.693811+0000","last_peered":"2024-09-17T02:24:30.693811+0000","last_clean":"2024-09-17T02:24:30.693811+0000","last_became_active":"2024-09-17T02:24:30.691331+0000","last_became_peered":"2024-09-17T02:24:30.691331+0000","last_unstale":"2024-09-17T02:24:30.693811+0000","last_undegraded":"2024-09-17T02:24:30.693811+0000","last_fullsized":"2024-09-17T02:24:30.693811+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:39.446085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.694492+0000","last_change":"2024-09-17T02:24:30.694492+0000","last_active":"2024-09-17T02:24:30.694492+0000","last_peered":"2024-09-17T02:24:30.694492+0000","last_clean":"2024-09-17T02:24:30.694492+0000","last_became_active":"2024-09-17T02:24:30.691770+0000","last_became_peered":"2024-09-17T02:24:30.691770+0000","last_unstale":"2024-09-17T02:24:30.694492+0000","last_undegraded":"2024-09-17T02:24:30.694492+0000","last_fullsized":"2024-09-17T02:24:30.694492+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:01.597617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.341743+0000","last_change":"2024-09-17T02:24:30.336636+0000","last_active":"2024-09-17T02:24:33.341743+0000","last_peered":"2024-09-17T02:24:33.341743+0000","last_clean":"2024-09-17T02:24:33.341743+0000","last_became_active":"2024-09-17T02:24:30.336110+0000","last_became_peered":"2024-09-17T02:24:30.336110+0000","last_unstale":"2024-09-17T02:24:33.341743+0000","last_undegraded":"2024-09-17T02:24:33.341743+0000","last_fullsized":"2024-09-17T02:24:33.341743+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:44.699884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":145,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.709814+0000","last_change":"2024-09-17T02:24:30.700777+0000","last_active":"2024-09-17T02:24:32.709814+0000","last_peered":"2024-09-17T02:24:32.709814+0000","last_clean":"2024-09-17T02:24:32.709814+0000","last_became_active":"2024-09-17T02:24:30.696731+0000","last_became_peered":"2024-09-17T02:24:30.696731+0000","last_unstale":"2024-09-17T02:24:32.709814+0000","last_undegraded":"2024-09-17T02:24:32.709814+0000","last_fullsized":"2024-09-17T02:24:32.709814+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:58.629953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.342788+0000","last_change":"2024-09-17T02:24:30.326364+0000","last_active":"2024-09-17T02:24:33.342788+0000","last_peered":"2024-09-17T02:24:33.342788+0000","last_clean":"2024-09-17T02:24:33.342788+0000","last_became_active":"2024-09-17T02:24:30.325752+0000","last_became_peered":"2024-09-17T02:24:30.325752+0000","last_unstale":"2024-09-17T02:24:33.342788+0000","last_undegraded":"2024-09-17T02:24:33.342788+0000","last_fullsized":"2024-09-17T02:24:33.342788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:33.800584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.340776+0000","last_change":"2024-09-17T02:24:30.325924+0000","last_active":"2024-09-17T02:24:33.340776+0000","last_peered":"2024-09-17T02:24:33.340776+0000","last_clean":"2024-09-17T02:24:33.340776+0000","last_became_active":"2024-09-17T02:24:30.325688+0000","last_became_peered":"2024-09-17T02:24:30.325688+0000","last_unstale":"2024-09-17T02:24:33.340776+0000","last_undegraded":"2024-09-17T02:24:33.340776+0000","last_fullsized":"2024-09-17T02:24:33.340776+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:25.290483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":62,"reported_epoch":78,"state":"active+undersized","last_fresh":"2024-09-17T02:22:39.952732+0000","last_change":"2024-09-17T02:21:35.503507+0000","last_active":"2024-09-17T02:22:39.952732+0000","last_peered":"2024-09-17T02:22:39.952732+0000","last_clean":"2024-09-17T02:20:15.524398+0000","last_became_active":"2024-09-17T02:21:35.503507+0000","last_became_peered":"2024-09-17T02:21:35.503507+0000","last_unstale":"2024-09-17T02:22:39.952732+0000","last_undegraded":"2024-09-17T02:22:39.952732+0000","last_fullsized":"2024-09-17T02:21:35.494741+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:51.679215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.345260+0000","last_change":"2024-09-17T02:24:30.338759+0000","last_active":"2024-09-17T02:24:33.345260+0000","last_peered":"2024-09-17T02:24:33.345260+0000","last_clean":"2024-09-17T02:24:33.345260+0000","last_became_active":"2024-09-17T02:24:30.336906+0000","last_became_peered":"2024-09-17T02:24:30.336906+0000","last_unstale":"2024-09-17T02:24:33.345260+0000","last_undegraded":"2024-09-17T02:24:33.345260+0000","last_fullsized":"2024-09-17T02:24:33.345260+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:09.728346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.343611+0000","last_change":"2024-09-17T02:24:30.325492+0000","last_active":"2024-09-17T02:24:33.343611+0000","last_peered":"2024-09-17T02:24:33.343611+0000","last_clean":"2024-09-17T02:24:33.343611+0000","last_became_active":"2024-09-17T02:24:30.325175+0000","last_became_peered":"2024-09-17T02:24:30.325175+0000","last_unstale":"2024-09-17T02:24:33.343611+0000","last_undegraded":"2024-09-17T02:24:33.343611+0000","last_fullsized":"2024-09-17T02:24:33.343611+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:04.443085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.699551+0000","last_change":"2024-09-17T02:24:30.699551+0000","last_active":"2024-09-17T02:24:30.699551+0000","last_peered":"2024-09-17T02:24:30.699551+0000","last_clean":"2024-09-17T02:24:30.699551+0000","last_became_active":"2024-09-17T02:24:30.697986+0000","last_became_peered":"2024-09-17T02:24:30.697986+0000","last_unstale":"2024-09-17T02:24:30.699551+0000","last_undegraded":"2024-09-17T02:24:30.699551+0000","last_fullsized":"2024-09-17T02:24:30.699551+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:44.939985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.697249+0000","last_change":"2024-09-17T02:24:30.697249+0000","last_active":"2024-09-17T02:24:30.697249+0000","last_peered":"2024-09-17T02:24:30.697249+0000","last_clean":"2024-09-17T02:24:30.697249+0000","last_became_active":"2024-09-17T02:24:30.696215+0000","last_became_peered":"2024-09-17T02:24:30.696215+0000","last_unstale":"2024-09-17T02:24:30.697249+0000","last_undegraded":"2024-09-17T02:24:30.697249+0000","last_fullsized":"2024-09-17T02:24:30.697249+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:07.507822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.690011+0000","last_change":"2024-09-17T02:20:16.577803+0000","last_active":"2024-09-17T02:24:30.690011+0000","last_peered":"2024-09-17T02:24:30.690011+0000","last_clean":"2024-09-17T02:24:30.690011+0000","last_became_active":"2024-09-17T02:20:16.576640+0000","last_became_peered":"2024-09-17T02:20:16.576640+0000","last_unstale":"2024-09-17T02:24:30.690011+0000","last_undegraded":"2024-09-17T02:24:30.690011+0000","last_fullsized":"2024-09-17T02:24:30.690011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:07.190169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":145,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.711800+0000","last_change":"2024-09-17T02:24:30.706739+0000","last_active":"2024-09-17T02:24:32.711800+0000","last_peered":"2024-09-17T02:24:32.711800+0000","last_clean":"2024-09-17T02:24:32.711800+0000","last_became_active":"2024-09-17T02:24:30.706195+0000","last_became_peered":"2024-09-17T02:24:30.706195+0000","last_unstale":"2024-09-17T02:24:32.711800+0000","last_undegraded":"2024-09-17T02:24:32.711800+0000","last_fullsized":"2024-09-17T02:24:32.711800+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:38.782264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":111,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.709938+0000","last_change":"2024-09-17T02:24:30.702619+0000","last_active":"2024-09-17T02:24:32.709938+0000","last_peered":"2024-09-17T02:24:32.709938+0000","last_clean":"2024-09-17T02:24:32.709938+0000","last_became_active":"2024-09-17T02:24:30.700405+0000","last_became_peered":"2024-09-17T02:24:30.700405+0000","last_unstale":"2024-09-17T02:24:32.709938+0000","last_undegraded":"2024-09-17T02:24:32.709938+0000","last_fullsized":"2024-09-17T02:24:32.709938+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:57.681847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.696267+0000","last_change":"2024-09-17T02:24:30.696267+0000","last_active":"2024-09-17T02:24:30.696267+0000","last_peered":"2024-09-17T02:24:30.696267+0000","last_clean":"2024-09-17T02:24:30.696267+0000","last_became_active":"2024-09-17T02:24:30.694027+0000","last_became_peered":"2024-09-17T02:24:30.694027+0000","last_unstale":"2024-09-17T02:24:30.696267+0000","last_undegraded":"2024-09-17T02:24:30.696267+0000","last_fullsized":"2024-09-17T02:24:30.696267+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:56.160158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.697568+0000","last_change":"2024-09-17T02:24:30.697568+0000","last_active":"2024-09-17T02:24:30.697568+0000","last_peered":"2024-09-17T02:24:30.697568+0000","last_clean":"2024-09-17T02:24:30.697568+0000","last_became_active":"2024-09-17T02:24:30.693991+0000","last_became_peered":"2024-09-17T02:24:30.693991+0000","last_unstale":"2024-09-17T02:24:30.697568+0000","last_undegraded":"2024-09-17T02:24:30.697568+0000","last_fullsized":"2024-09-17T02:24:30.697568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:45.636130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":142,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.710845+0000","last_change":"2024-09-17T02:21:10.505967+0000","last_active":"2024-09-17T02:24:32.710845+0000","last_peered":"2024-09-17T02:24:32.710845+0000","last_clean":"2024-09-17T02:24:32.710845+0000","last_became_active":"2024-09-17T02:21:10.505594+0000","last_became_peered":"2024-09-17T02:21:10.505594+0000","last_unstale":"2024-09-17T02:24:32.710845+0000","last_undegraded":"2024-09-17T02:24:32.710845+0000","last_fullsized":"2024-09-17T02:24:32.710845+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:15.782752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":120,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.689352+0000","last_change":"2024-09-17T02:20:37.706393+0000","last_active":"2024-09-17T02:24:30.689352+0000","last_peered":"2024-09-17T02:24:30.689352+0000","last_clean":"2024-09-17T02:24:30.689352+0000","last_became_active":"2024-09-17T02:20:37.705739+0000","last_became_peered":"2024-09-17T02:20:37.705739+0000","last_unstale":"2024-09-17T02:24:30.689352+0000","last_undegraded":"2024-09-17T02:24:30.689352+0000","last_fullsized":"2024-09-17T02:24:30.689352+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:57.361673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":120,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.690797+0000","last_change":"2024-09-17T02:20:37.706175+0000","last_active":"2024-09-17T02:24:30.690797+0000","last_peered":"2024-09-17T02:24:30.690797+0000","last_clean":"2024-09-17T02:24:30.690797+0000","last_became_active":"2024-09-17T02:20:37.705742+0000","last_became_peered":"2024-09-17T02:20:37.705742+0000","last_unstale":"2024-09-17T02:24:30.690797+0000","last_undegraded":"2024-09-17T02:24:30.690797+0000","last_fullsized":"2024-09-17T02:24:30.690797+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:09.959092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":147,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.711303+0000","last_change":"2024-09-17T02:24:30.698237+0000","last_active":"2024-09-17T02:24:32.711303+0000","last_peered":"2024-09-17T02:24:32.711303+0000","last_clean":"2024-09-17T02:24:32.711303+0000","last_became_active":"2024-09-17T02:24:30.697194+0000","last_became_peered":"2024-09-17T02:24:30.697194+0000","last_unstale":"2024-09-17T02:24:32.711303+0000","last_undegraded":"2024-09-17T02:24:32.711303+0000","last_fullsized":"2024-09-17T02:24:32.711303+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:36.697224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"peering","last_fresh":"2024-09-17T02:24:32.832817+0000","last_change":"2024-09-17T02:24:33.348245+0000","last_active":"2024-09-17T02:24:33.348245+0000","last_peered":"2024-09-17T02:24:32.832817+0000","last_clean":"2024-09-17T02:24:32.832817+0000","last_became_active":"2024-09-17T02:24:30.334825+0000","last_became_peered":"2024-09-17T02:24:30.334825+0000","last_unstale":"2024-09-17T02:24:32.832817+0000","last_undegraded":"2024-09-17T02:24:32.832817+0000","last_fullsized":"2024-09-17T02:24:32.832817+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.341050+0000","last_change":"2024-09-17T02:24:30.327080+0000","last_active":"2024-09-17T02:24:33.341050+0000","last_peered":"2024-09-17T02:24:33.341050+0000","last_clean":"2024-09-17T02:24:33.341050+0000","last_became_active":"2024-09-17T02:24:30.326800+0000","last_became_peered":"2024-09-17T02:24:30.326800+0000","last_unstale":"2024-09-17T02:24:33.341050+0000","last_undegraded":"2024-09-17T02:24:33.341050+0000","last_fullsized":"2024-09-17T02:24:33.341050+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:06.072812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.344493+0000","last_change":"2024-09-17T02:24:30.322448+0000","last_active":"2024-09-17T02:24:33.344493+0000","last_peered":"2024-09-17T02:24:33.344493+0000","last_clean":"2024-09-17T02:24:33.344493+0000","last_became_active":"2024-09-17T02:24:30.322156+0000","last_became_peered":"2024-09-17T02:24:30.322156+0000","last_unstale":"2024-09-17T02:24:33.344493+0000","last_undegraded":"2024-09-17T02:24:33.344493+0000","last_fullsized":"2024-09-17T02:24:33.344493+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:46.435146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.340997+0000","last_change":"2024-09-17T02:24:30.336467+0000","last_active":"2024-09-17T02:24:33.340997+0000","last_peered":"2024-09-17T02:24:33.340997+0000","last_clean":"2024-09-17T02:24:33.340997+0000","last_became_active":"2024-09-17T02:24:30.336042+0000","last_became_peered":"2024-09-17T02:24:30.336042+0000","last_unstale":"2024-09-17T02:24:33.340997+0000","last_undegraded":"2024-09-17T02:24:33.340997+0000","last_fullsized":"2024-09-17T02:24:33.340997+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:59.645621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":137,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T02:24:32.710287+0000","last_change":"2024-09-17T02:20:16.570456+0000","last_active":"2024-09-17T02:24:32.710287+0000","last_peered":"2024-09-17T02:24:32.710287+0000","last_clean":"2024-09-17T02:24:32.710287+0000","last_became_active":"2024-09-17T02:20:16.568095+0000","last_became_peered":"2024-09-17T02:20:16.568095+0000","last_unstale":"2024-09-17T02:24:32.710287+0000","last_undegraded":"2024-09-17T02:24:32.710287+0000","last_fullsized":"2024-09-17T02:24:32.710287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:58.329169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.690370+0000","last_change":"2024-09-17T02:20:15.560293+0000","last_active":"2024-09-17T02:24:30.690370+0000","last_peered":"2024-09-17T02:24:30.690370+0000","last_clean":"2024-09-17T02:24:30.690370+0000","last_became_active":"2024-09-17T02:20:15.559074+0000","last_became_peered":"2024-09-17T02:20:15.559074+0000","last_unstale":"2024-09-17T02:24:30.690370+0000","last_undegraded":"2024-09-17T02:24:30.690370+0000","last_fullsized":"2024-09-17T02:24:30.690370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:55.639841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:24:33.343294+0000","last_change":"2024-09-17T02:24:30.319629+0000","last_active":"2024-09-17T02:24:33.343294+0000","last_peered":"2024-09-17T02:24:33.343294+0000","last_clean":"2024-09-17T02:24:33.343294+0000","last_became_active":"2024-09-17T02:24:30.319441+0000","last_became_peered":"2024-09-17T02:24:30.319441+0000","last_unstale":"2024-09-17T02:24:33.343294+0000","last_undegraded":"2024-09-17T02:24:33.343294+0000","last_fullsized":"2024-09-17T02:24:33.343294+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:58.379141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":149,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:24:30.699964+0000","last_change":"2024-09-17T02:24:30.699964+0000","last_active":"2024-09-17T02:24:30.699964+0000","last_peered":"2024-09-17T02:24:30.699964+0000","last_clean":"2024-09-17T02:24:30.699964+0000","last_became_active":"2024-09-17T02:24:30.699102+0000","last_became_peered":"2024-09-17T02:24:30.699102+0000","last_unstale":"2024-09-17T02:24:30.699964+0000","last_undegraded":"2024-09-17T02:24:30.699964+0000","last_fullsized":"2024-09-17T02:24:30.699964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:19.193516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":121,"acting":121,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5558,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":63,"acting":63,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705722,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361176,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":360190,"kb_avail":94010664,"statfs":{"total":96636764160,"available":96266919936,"internally_reserved":0,"allocated":987136,"data_stored":948729,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":368835013},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":80,"seq":343597383682,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56420,"kb_used_data":976,"kb_used_omap":6,"kb_used_meta":55417,"kb_avail":94315420,"statfs":{"total":96636764160,"available":96578990080,"internally_reserved":0,"allocated":999424,"data_stored":949364,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":7153,"internal_metadata":56747023},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738425,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329168,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94042672,"statfs":{"total":96636764160,"available":96299696128,"internally_reserved":0,"allocated":909312,"data_stored":352941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5558,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T02:24:39.178 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:24:39.495 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:24:39.497 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-17T02:24:39.512 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2024-09-17T02:24:39.467390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":746824,"kb_used_data":2884,"kb_used_omap":10,"kb_used_meta":743861,"kb_avail":282368696,"statfs":{"total":289910292480,"available":289145544704,"internally_reserved":0,"allocated":2953216,"data_stored":2282067,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10343,"internal_metadata":761714585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-21,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.761337"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":159,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.733681+0000","last_change":"2024-09-17T02:24:34.733681+0000","last_active":"2024-09-17T02:24:34.733681+0000","last_peered":"2024-09-17T02:24:34.733681+0000","last_clean":"2024-09-17T02:24:34.733681+0000","last_became_active":"2024-09-17T02:24:34.732728+0000","last_became_peered":"2024-09-17T02:24:34.732728+0000","last_unstale":"2024-09-17T02:24:34.733681+0000","last_undegraded":"2024-09-17T02:24:34.733681+0000","last_fullsized":"2024-09-17T02:24:34.733681+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:21.613592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":126,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.726320+0000","last_change":"2024-09-17T02:20:37.709698+0000","last_active":"2024-09-17T02:24:34.726320+0000","last_peered":"2024-09-17T02:24:34.726320+0000","last_clean":"2024-09-17T02:24:34.726320+0000","last_became_active":"2024-09-17T02:20:37.708951+0000","last_became_peered":"2024-09-17T02:20:37.708951+0000","last_unstale":"2024-09-17T02:24:34.726320+0000","last_undegraded":"2024-09-17T02:24:34.726320+0000","last_fullsized":"2024-09-17T02:24:34.726320+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:30.839358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.346563+0000","last_change":"2024-09-17T02:24:30.339249+0000","last_active":"2024-09-17T02:24:34.346563+0000","last_peered":"2024-09-17T02:24:34.346563+0000","last_clean":"2024-09-17T02:24:34.346563+0000","last_became_active":"2024-09-17T02:24:30.338199+0000","last_became_peered":"2024-09-17T02:24:30.338199+0000","last_unstale":"2024-09-17T02:24:34.346563+0000","last_undegraded":"2024-09-17T02:24:34.346563+0000","last_fullsized":"2024-09-17T02:24:34.346563+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:51.734408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":76,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.360587+0000","last_change":"2024-09-17T02:24:34.360587+0000","last_active":"2024-09-17T02:24:34.360587+0000","last_peered":"2024-09-17T02:24:34.360587+0000","last_clean":"2024-09-17T02:24:34.360587+0000","last_became_active":"2024-09-17T02:24:34.359912+0000","last_became_peered":"2024-09-17T02:24:34.359912+0000","last_unstale":"2024-09-17T02:24:34.360587+0000","last_undegraded":"2024-09-17T02:24:34.360587+0000","last_fullsized":"2024-09-17T02:24:34.360587+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:35.054937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.734103+0000","last_change":"2024-09-17T02:24:34.729589+0000","last_active":"2024-09-17T02:24:34.734103+0000","last_peered":"2024-09-17T02:24:34.734103+0000","last_clean":"2024-09-17T02:24:34.734103+0000","last_became_active":"2024-09-17T02:24:34.726967+0000","last_became_peered":"2024-09-17T02:24:34.726967+0000","last_unstale":"2024-09-17T02:24:34.734103+0000","last_undegraded":"2024-09-17T02:24:34.734103+0000","last_fullsized":"2024-09-17T02:24:34.734103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:24.266960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.345546+0000","last_change":"2024-09-17T02:24:30.322619+0000","last_active":"2024-09-17T02:24:34.345546+0000","last_peered":"2024-09-17T02:24:34.345546+0000","last_clean":"2024-09-17T02:24:34.345546+0000","last_became_active":"2024-09-17T02:24:30.322191+0000","last_became_peered":"2024-09-17T02:24:30.322191+0000","last_unstale":"2024-09-17T02:24:34.345546+0000","last_undegraded":"2024-09-17T02:24:34.345546+0000","last_fullsized":"2024-09-17T02:24:34.345546+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:26.120304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.343480+0000","last_change":"2024-09-17T02:24:30.330077+0000","last_active":"2024-09-17T02:24:34.343480+0000","last_peered":"2024-09-17T02:24:34.343480+0000","last_clean":"2024-09-17T02:24:34.343480+0000","last_became_active":"2024-09-17T02:24:30.329814+0000","last_became_peered":"2024-09-17T02:24:30.329814+0000","last_unstale":"2024-09-17T02:24:34.343480+0000","last_undegraded":"2024-09-17T02:24:34.343480+0000","last_fullsized":"2024-09-17T02:24:34.343480+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:09.933024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.343204+0000","last_change":"2024-09-17T02:24:30.319625+0000","last_active":"2024-09-17T02:24:34.343204+0000","last_peered":"2024-09-17T02:24:34.343204+0000","last_clean":"2024-09-17T02:24:34.343204+0000","last_became_active":"2024-09-17T02:24:30.319316+0000","last_became_peered":"2024-09-17T02:24:30.319316+0000","last_unstale":"2024-09-17T02:24:34.343204+0000","last_undegraded":"2024-09-17T02:24:34.343204+0000","last_fullsized":"2024-09-17T02:24:34.343204+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:30.753462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":141,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.726271+0000","last_change":"2024-09-17T02:20:16.584665+0000","last_active":"2024-09-17T02:24:34.726271+0000","last_peered":"2024-09-17T02:24:34.726271+0000","last_clean":"2024-09-17T02:24:34.726271+0000","last_became_active":"2024-09-17T02:20:16.580797+0000","last_became_peered":"2024-09-17T02:20:16.580797+0000","last_unstale":"2024-09-17T02:24:34.726271+0000","last_undegraded":"2024-09-17T02:24:34.726271+0000","last_fullsized":"2024-09-17T02:24:34.726271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:47.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":158,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.733394+0000","last_change":"2024-09-17T02:24:34.733394+0000","last_active":"2024-09-17T02:24:34.733394+0000","last_peered":"2024-09-17T02:24:34.733394+0000","last_clean":"2024-09-17T02:24:34.733394+0000","last_became_active":"2024-09-17T02:24:34.732480+0000","last_became_peered":"2024-09-17T02:24:34.732480+0000","last_unstale":"2024-09-17T02:24:34.733394+0000","last_undegraded":"2024-09-17T02:24:34.733394+0000","last_fullsized":"2024-09-17T02:24:34.733394+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:37.005990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.346402+0000","last_change":"2024-09-17T02:24:30.329180+0000","last_active":"2024-09-17T02:24:34.346402+0000","last_peered":"2024-09-17T02:24:34.346402+0000","last_clean":"2024-09-17T02:24:34.346402+0000","last_became_active":"2024-09-17T02:24:30.328962+0000","last_became_peered":"2024-09-17T02:24:30.328962+0000","last_unstale":"2024-09-17T02:24:34.346402+0000","last_undegraded":"2024-09-17T02:24:34.346402+0000","last_fullsized":"2024-09-17T02:24:34.346402+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:21.425064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.345246+0000","last_change":"2024-09-17T02:24:30.336021+0000","last_active":"2024-09-17T02:24:34.345246+0000","last_peered":"2024-09-17T02:24:34.345246+0000","last_clean":"2024-09-17T02:24:34.345246+0000","last_became_active":"2024-09-17T02:24:30.335245+0000","last_became_peered":"2024-09-17T02:24:30.335245+0000","last_unstale":"2024-09-17T02:24:34.345246+0000","last_undegraded":"2024-09-17T02:24:34.345246+0000","last_fullsized":"2024-09-17T02:24:34.345246+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:12.509297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":126,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.723346+0000","last_change":"2024-09-17T02:20:37.709476+0000","last_active":"2024-09-17T02:24:34.723346+0000","last_peered":"2024-09-17T02:24:34.723346+0000","last_clean":"2024-09-17T02:24:34.723346+0000","last_became_active":"2024-09-17T02:20:37.708730+0000","last_became_peered":"2024-09-17T02:20:37.708730+0000","last_unstale":"2024-09-17T02:24:34.723346+0000","last_undegraded":"2024-09-17T02:24:34.723346+0000","last_fullsized":"2024-09-17T02:24:34.723346+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:54.725651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.344539+0000","last_change":"2024-09-17T02:24:30.337132+0000","last_active":"2024-09-17T02:24:34.344539+0000","last_peered":"2024-09-17T02:24:34.344539+0000","last_clean":"2024-09-17T02:24:34.344539+0000","last_became_active":"2024-09-17T02:24:30.335871+0000","last_became_peered":"2024-09-17T02:24:30.335871+0000","last_unstale":"2024-09-17T02:24:34.344539+0000","last_undegraded":"2024-09-17T02:24:34.344539+0000","last_fullsized":"2024-09-17T02:24:34.344539+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:21.006777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.343257+0000","last_change":"2024-09-17T02:24:30.335635+0000","last_active":"2024-09-17T02:24:34.343257+0000","last_peered":"2024-09-17T02:24:34.343257+0000","last_clean":"2024-09-17T02:24:34.343257+0000","last_became_active":"2024-09-17T02:24:30.335086+0000","last_became_peered":"2024-09-17T02:24:30.335086+0000","last_unstale":"2024-09-17T02:24:34.343257+0000","last_undegraded":"2024-09-17T02:24:34.343257+0000","last_fullsized":"2024-09-17T02:24:34.343257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:01.913411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.344388+0000","last_change":"2024-09-17T02:24:30.325322+0000","last_active":"2024-09-17T02:24:34.344388+0000","last_peered":"2024-09-17T02:24:34.344388+0000","last_clean":"2024-09-17T02:24:34.344388+0000","last_became_active":"2024-09-17T02:24:30.325002+0000","last_became_peered":"2024-09-17T02:24:30.325002+0000","last_unstale":"2024-09-17T02:24:34.344388+0000","last_undegraded":"2024-09-17T02:24:34.344388+0000","last_fullsized":"2024-09-17T02:24:34.344388+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:16.238014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":141,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.726997+0000","last_change":"2024-09-17T02:20:16.563482+0000","last_active":"2024-09-17T02:24:34.726997+0000","last_peered":"2024-09-17T02:24:34.726997+0000","last_clean":"2024-09-17T02:24:34.726997+0000","last_became_active":"2024-09-17T02:20:16.562735+0000","last_became_peered":"2024-09-17T02:20:16.562735+0000","last_unstale":"2024-09-17T02:24:34.726997+0000","last_undegraded":"2024-09-17T02:24:34.726997+0000","last_fullsized":"2024-09-17T02:24:34.726997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:10.315951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":126,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.729536+0000","last_change":"2024-09-17T02:20:37.706162+0000","last_active":"2024-09-17T02:24:34.729536+0000","last_peered":"2024-09-17T02:24:34.729536+0000","last_clean":"2024-09-17T02:24:34.729536+0000","last_became_active":"2024-09-17T02:20:37.705497+0000","last_became_peered":"2024-09-17T02:20:37.705497+0000","last_unstale":"2024-09-17T02:24:34.729536+0000","last_undegraded":"2024-09-17T02:24:34.729536+0000","last_fullsized":"2024-09-17T02:24:34.729536+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:43.467659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":141,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.722379+0000","last_change":"2024-09-17T02:20:16.586950+0000","last_active":"2024-09-17T02:24:34.722379+0000","last_peered":"2024-09-17T02:24:34.722379+0000","last_clean":"2024-09-17T02:24:34.722379+0000","last_became_active":"2024-09-17T02:20:16.586281+0000","last_became_peered":"2024-09-17T02:20:16.586281+0000","last_unstale":"2024-09-17T02:24:34.722379+0000","last_undegraded":"2024-09-17T02:24:34.722379+0000","last_fullsized":"2024-09-17T02:24:34.722379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:22.801598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.345061+0000","last_change":"2024-09-17T02:24:30.330312+0000","last_active":"2024-09-17T02:24:34.345061+0000","last_peered":"2024-09-17T02:24:34.345061+0000","last_clean":"2024-09-17T02:24:34.345061+0000","last_became_active":"2024-09-17T02:24:30.329980+0000","last_became_peered":"2024-09-17T02:24:30.329980+0000","last_unstale":"2024-09-17T02:24:34.345061+0000","last_undegraded":"2024-09-17T02:24:34.345061+0000","last_fullsized":"2024-09-17T02:24:34.345061+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:53.422140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":72,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.361003+0000","last_change":"2024-09-17T02:24:34.361003+0000","last_active":"2024-09-17T02:24:34.361003+0000","last_peered":"2024-09-17T02:24:34.361003+0000","last_clean":"2024-09-17T02:24:34.361003+0000","last_became_active":"2024-09-17T02:24:34.360259+0000","last_became_peered":"2024-09-17T02:24:34.360259+0000","last_unstale":"2024-09-17T02:24:34.361003+0000","last_undegraded":"2024-09-17T02:24:34.361003+0000","last_fullsized":"2024-09-17T02:24:34.361003+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:01.642214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":148,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.720527+0000","last_change":"2024-09-17T02:24:30.702500+0000","last_active":"2024-09-17T02:24:34.720527+0000","last_peered":"2024-09-17T02:24:34.720527+0000","last_clean":"2024-09-17T02:24:34.720527+0000","last_became_active":"2024-09-17T02:24:30.700674+0000","last_became_peered":"2024-09-17T02:24:30.700674+0000","last_unstale":"2024-09-17T02:24:34.720527+0000","last_undegraded":"2024-09-17T02:24:34.720527+0000","last_fullsized":"2024-09-17T02:24:34.720527+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:47.554275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":148,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.721341+0000","last_change":"2024-09-17T02:24:30.700096+0000","last_active":"2024-09-17T02:24:34.721341+0000","last_peered":"2024-09-17T02:24:34.721341+0000","last_clean":"2024-09-17T02:24:34.721341+0000","last_became_active":"2024-09-17T02:24:30.698022+0000","last_became_peered":"2024-09-17T02:24:30.698022+0000","last_unstale":"2024-09-17T02:24:34.721341+0000","last_undegraded":"2024-09-17T02:24:34.721341+0000","last_fullsized":"2024-09-17T02:24:34.721341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:53.002528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":126,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.723723+0000","last_change":"2024-09-17T02:20:37.710222+0000","last_active":"2024-09-17T02:24:34.723723+0000","last_peered":"2024-09-17T02:24:34.723723+0000","last_clean":"2024-09-17T02:24:34.723723+0000","last_became_active":"2024-09-17T02:20:37.709227+0000","last_became_peered":"2024-09-17T02:20:37.709227+0000","last_unstale":"2024-09-17T02:24:34.723723+0000","last_undegraded":"2024-09-17T02:24:34.723723+0000","last_fullsized":"2024-09-17T02:24:34.723723+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:01:44.250550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.721189+0000","last_change":"2024-09-17T02:24:30.704846+0000","last_active":"2024-09-17T02:24:34.721189+0000","last_peered":"2024-09-17T02:24:34.721189+0000","last_clean":"2024-09-17T02:24:34.721189+0000","last_became_active":"2024-09-17T02:24:30.703377+0000","last_became_peered":"2024-09-17T02:24:30.703377+0000","last_unstale":"2024-09-17T02:24:34.721189+0000","last_undegraded":"2024-09-17T02:24:34.721189+0000","last_fullsized":"2024-09-17T02:24:34.721189+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:21.642002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.727667+0000","last_change":"2024-09-17T02:24:30.696851+0000","last_active":"2024-09-17T02:24:34.727667+0000","last_peered":"2024-09-17T02:24:34.727667+0000","last_clean":"2024-09-17T02:24:34.727667+0000","last_became_active":"2024-09-17T02:24:30.694853+0000","last_became_peered":"2024-09-17T02:24:30.694853+0000","last_unstale":"2024-09-17T02:24:34.727667+0000","last_undegraded":"2024-09-17T02:24:34.727667+0000","last_fullsized":"2024-09-17T02:24:34.727667+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:39.353246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.346306+0000","last_change":"2024-09-17T02:24:30.339430+0000","last_active":"2024-09-17T02:24:34.346306+0000","last_peered":"2024-09-17T02:24:34.346306+0000","last_clean":"2024-09-17T02:24:34.346306+0000","last_became_active":"2024-09-17T02:24:30.338488+0000","last_became_peered":"2024-09-17T02:24:30.338488+0000","last_unstale":"2024-09-17T02:24:34.346306+0000","last_undegraded":"2024-09-17T02:24:34.346306+0000","last_fullsized":"2024-09-17T02:24:34.346306+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:26.554742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.344589+0000","last_change":"2024-09-17T02:24:30.335659+0000","last_active":"2024-09-17T02:24:34.344589+0000","last_peered":"2024-09-17T02:24:34.344589+0000","last_clean":"2024-09-17T02:24:34.344589+0000","last_became_active":"2024-09-17T02:24:30.335243+0000","last_became_peered":"2024-09-17T02:24:30.335243+0000","last_unstale":"2024-09-17T02:24:34.344589+0000","last_undegraded":"2024-09-17T02:24:34.344589+0000","last_fullsized":"2024-09-17T02:24:34.344589+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:59.178360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.737021+0000","last_change":"2024-09-17T02:24:34.734388+0000","last_active":"2024-09-17T02:24:34.737021+0000","last_peered":"2024-09-17T02:24:34.737021+0000","last_clean":"2024-09-17T02:24:34.737021+0000","last_became_active":"2024-09-17T02:24:34.733451+0000","last_became_peered":"2024-09-17T02:24:34.733451+0000","last_unstale":"2024-09-17T02:24:34.737021+0000","last_undegraded":"2024-09-17T02:24:34.737021+0000","last_fullsized":"2024-09-17T02:24:34.737021+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:22.488478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.722012+0000","last_change":"2024-09-17T02:24:30.700893+0000","last_active":"2024-09-17T02:24:34.722012+0000","last_peered":"2024-09-17T02:24:34.722012+0000","last_clean":"2024-09-17T02:24:34.722012+0000","last_became_active":"2024-09-17T02:24:30.699410+0000","last_became_peered":"2024-09-17T02:24:30.699410+0000","last_unstale":"2024-09-17T02:24:34.722012+0000","last_undegraded":"2024-09-17T02:24:34.722012+0000","last_fullsized":"2024-09-17T02:24:34.722012+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:29.137738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.733242+0000","last_change":"2024-09-17T02:24:34.727144+0000","last_active":"2024-09-17T02:24:34.733242+0000","last_peered":"2024-09-17T02:24:34.733242+0000","last_clean":"2024-09-17T02:24:34.733242+0000","last_became_active":"2024-09-17T02:24:34.725109+0000","last_became_peered":"2024-09-17T02:24:34.725109+0000","last_unstale":"2024-09-17T02:24:34.733242+0000","last_undegraded":"2024-09-17T02:24:34.733242+0000","last_fullsized":"2024-09-17T02:24:34.733242+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:59.629654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":72,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.357265+0000","last_change":"2024-09-17T02:24:34.357265+0000","last_active":"2024-09-17T02:24:34.357265+0000","last_peered":"2024-09-17T02:24:34.357265+0000","last_clean":"2024-09-17T02:24:34.357265+0000","last_became_active":"2024-09-17T02:24:34.356639+0000","last_became_peered":"2024-09-17T02:24:34.356639+0000","last_unstale":"2024-09-17T02:24:34.357265+0000","last_undegraded":"2024-09-17T02:24:34.357265+0000","last_fullsized":"2024-09-17T02:24:34.357265+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:30.236713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.733088+0000","last_change":"2024-09-17T02:24:34.727784+0000","last_active":"2024-09-17T02:24:34.733088+0000","last_peered":"2024-09-17T02:24:34.733088+0000","last_clean":"2024-09-17T02:24:34.733088+0000","last_became_active":"2024-09-17T02:24:34.726588+0000","last_became_peered":"2024-09-17T02:24:34.726588+0000","last_unstale":"2024-09-17T02:24:34.733088+0000","last_undegraded":"2024-09-17T02:24:34.733088+0000","last_fullsized":"2024-09-17T02:24:34.733088+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:39.591275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.345772+0000","last_change":"2024-09-17T02:24:30.329201+0000","last_active":"2024-09-17T02:24:34.345772+0000","last_peered":"2024-09-17T02:24:34.345772+0000","last_clean":"2024-09-17T02:24:34.345772+0000","last_became_active":"2024-09-17T02:24:30.328907+0000","last_became_peered":"2024-09-17T02:24:30.328907+0000","last_unstale":"2024-09-17T02:24:34.345772+0000","last_undegraded":"2024-09-17T02:24:34.345772+0000","last_fullsized":"2024-09-17T02:24:34.345772+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:31.463647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":158,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.732466+0000","last_change":"2024-09-17T02:24:34.732466+0000","last_active":"2024-09-17T02:24:34.732466+0000","last_peered":"2024-09-17T02:24:34.732466+0000","last_clean":"2024-09-17T02:24:34.732466+0000","last_became_active":"2024-09-17T02:24:34.731598+0000","last_became_peered":"2024-09-17T02:24:34.731598+0000","last_unstale":"2024-09-17T02:24:34.732466+0000","last_undegraded":"2024-09-17T02:24:34.732466+0000","last_fullsized":"2024-09-17T02:24:34.732466+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:33.350084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.733359+0000","last_change":"2024-09-17T02:24:34.730124+0000","last_active":"2024-09-17T02:24:34.733359+0000","last_peered":"2024-09-17T02:24:34.733359+0000","last_clean":"2024-09-17T02:24:34.733359+0000","last_became_active":"2024-09-17T02:24:34.727345+0000","last_became_peered":"2024-09-17T02:24:34.727345+0000","last_unstale":"2024-09-17T02:24:34.733359+0000","last_undegraded":"2024-09-17T02:24:34.733359+0000","last_fullsized":"2024-09-17T02:24:34.733359+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:20.739364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.734560+0000","last_change":"2024-09-17T02:24:34.731057+0000","last_active":"2024-09-17T02:24:34.734560+0000","last_peered":"2024-09-17T02:24:34.734560+0000","last_clean":"2024-09-17T02:24:34.734560+0000","last_became_active":"2024-09-17T02:24:34.730285+0000","last_became_peered":"2024-09-17T02:24:34.730285+0000","last_unstale":"2024-09-17T02:24:34.734560+0000","last_undegraded":"2024-09-17T02:24:34.734560+0000","last_fullsized":"2024-09-17T02:24:34.734560+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:28.085866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":150,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.716124+0000","last_change":"2024-09-17T02:24:30.702653+0000","last_active":"2024-09-17T02:24:34.716124+0000","last_peered":"2024-09-17T02:24:34.716124+0000","last_clean":"2024-09-17T02:24:34.716124+0000","last_became_active":"2024-09-17T02:24:30.701047+0000","last_became_peered":"2024-09-17T02:24:30.701047+0000","last_unstale":"2024-09-17T02:24:34.716124+0000","last_undegraded":"2024-09-17T02:24:34.716124+0000","last_fullsized":"2024-09-17T02:24:34.716124+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:26.569439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":148,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.726414+0000","last_change":"2024-09-17T02:24:30.698841+0000","last_active":"2024-09-17T02:24:34.726414+0000","last_peered":"2024-09-17T02:24:34.726414+0000","last_clean":"2024-09-17T02:24:34.726414+0000","last_became_active":"2024-09-17T02:24:30.697606+0000","last_became_peered":"2024-09-17T02:24:30.697606+0000","last_unstale":"2024-09-17T02:24:34.726414+0000","last_undegraded":"2024-09-17T02:24:34.726414+0000","last_fullsized":"2024-09-17T02:24:34.726414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:20.038861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.342339+0000","last_change":"2024-09-17T02:24:30.336630+0000","last_active":"2024-09-17T02:24:34.342339+0000","last_peered":"2024-09-17T02:24:34.342339+0000","last_clean":"2024-09-17T02:24:34.342339+0000","last_became_active":"2024-09-17T02:24:30.336326+0000","last_became_peered":"2024-09-17T02:24:30.336326+0000","last_unstale":"2024-09-17T02:24:34.342339+0000","last_undegraded":"2024-09-17T02:24:34.342339+0000","last_fullsized":"2024-09-17T02:24:34.342339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:30.072709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.347001+0000","last_change":"2024-09-17T02:24:30.336771+0000","last_active":"2024-09-17T02:24:34.347001+0000","last_peered":"2024-09-17T02:24:34.347001+0000","last_clean":"2024-09-17T02:24:34.347001+0000","last_became_active":"2024-09-17T02:24:30.336494+0000","last_became_peered":"2024-09-17T02:24:30.336494+0000","last_unstale":"2024-09-17T02:24:34.347001+0000","last_undegraded":"2024-09-17T02:24:34.347001+0000","last_fullsized":"2024-09-17T02:24:34.347001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:17.852502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.344034+0000","last_change":"2024-09-17T02:24:30.338523+0000","last_active":"2024-09-17T02:24:34.344034+0000","last_peered":"2024-09-17T02:24:34.344034+0000","last_clean":"2024-09-17T02:24:34.344034+0000","last_became_active":"2024-09-17T02:24:30.337726+0000","last_became_peered":"2024-09-17T02:24:30.337726+0000","last_unstale":"2024-09-17T02:24:34.344034+0000","last_undegraded":"2024-09-17T02:24:34.344034+0000","last_fullsized":"2024-09-17T02:24:34.344034+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:33.124995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":152,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.721436+0000","last_change":"2024-09-17T02:24:30.697584+0000","last_active":"2024-09-17T02:24:34.721436+0000","last_peered":"2024-09-17T02:24:34.721436+0000","last_clean":"2024-09-17T02:24:34.721436+0000","last_became_active":"2024-09-17T02:24:30.695140+0000","last_became_peered":"2024-09-17T02:24:30.695140+0000","last_unstale":"2024-09-17T02:24:34.721436+0000","last_undegraded":"2024-09-17T02:24:34.721436+0000","last_fullsized":"2024-09-17T02:24:34.721436+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:07.386102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":126,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.721825+0000","last_change":"2024-09-17T02:20:37.705585+0000","last_active":"2024-09-17T02:24:34.721825+0000","last_peered":"2024-09-17T02:24:34.721825+0000","last_clean":"2024-09-17T02:24:34.721825+0000","last_became_active":"2024-09-17T02:20:37.705266+0000","last_became_peered":"2024-09-17T02:20:37.705266+0000","last_unstale":"2024-09-17T02:24:34.721825+0000","last_undegraded":"2024-09-17T02:24:34.721825+0000","last_fullsized":"2024-09-17T02:24:34.721825+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:10:51.092163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.346062+0000","last_change":"2024-09-17T02:24:30.338939+0000","last_active":"2024-09-17T02:24:34.346062+0000","last_peered":"2024-09-17T02:24:34.346062+0000","last_clean":"2024-09-17T02:24:34.346062+0000","last_became_active":"2024-09-17T02:24:30.337650+0000","last_became_peered":"2024-09-17T02:24:30.337650+0000","last_unstale":"2024-09-17T02:24:34.346062+0000","last_undegraded":"2024-09-17T02:24:34.346062+0000","last_fullsized":"2024-09-17T02:24:34.346062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:00.927950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.345861+0000","last_change":"2024-09-17T02:24:30.322785+0000","last_active":"2024-09-17T02:24:34.345861+0000","last_peered":"2024-09-17T02:24:34.345861+0000","last_clean":"2024-09-17T02:24:34.345861+0000","last_became_active":"2024-09-17T02:24:30.322509+0000","last_became_peered":"2024-09-17T02:24:30.322509+0000","last_unstale":"2024-09-17T02:24:34.345861+0000","last_undegraded":"2024-09-17T02:24:34.345861+0000","last_fullsized":"2024-09-17T02:24:34.345861+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:06.381434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.344313+0000","last_change":"2024-09-17T02:24:30.329944+0000","last_active":"2024-09-17T02:24:34.344313+0000","last_peered":"2024-09-17T02:24:34.344313+0000","last_clean":"2024-09-17T02:24:34.344313+0000","last_became_active":"2024-09-17T02:24:30.329642+0000","last_became_peered":"2024-09-17T02:24:30.329642+0000","last_unstale":"2024-09-17T02:24:34.344313+0000","last_undegraded":"2024-09-17T02:24:34.344313+0000","last_fullsized":"2024-09-17T02:24:34.344313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:39.135831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":148,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.724178+0000","last_change":"2024-09-17T02:24:30.699239+0000","last_active":"2024-09-17T02:24:34.724178+0000","last_peered":"2024-09-17T02:24:34.724178+0000","last_clean":"2024-09-17T02:24:34.724178+0000","last_became_active":"2024-09-17T02:24:30.697800+0000","last_became_peered":"2024-09-17T02:24:30.697800+0000","last_unstale":"2024-09-17T02:24:34.724178+0000","last_undegraded":"2024-09-17T02:24:34.724178+0000","last_fullsized":"2024-09-17T02:24:34.724178+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:42.056577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":152,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.724423+0000","last_change":"2024-09-17T02:24:30.697486+0000","last_active":"2024-09-17T02:24:34.724423+0000","last_peered":"2024-09-17T02:24:34.724423+0000","last_clean":"2024-09-17T02:24:34.724423+0000","last_became_active":"2024-09-17T02:24:30.696079+0000","last_became_peered":"2024-09-17T02:24:30.696079+0000","last_unstale":"2024-09-17T02:24:34.724423+0000","last_undegraded":"2024-09-17T02:24:34.724423+0000","last_fullsized":"2024-09-17T02:24:34.724423+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:07.222731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.344825+0000","last_change":"2024-09-17T02:24:30.330194+0000","last_active":"2024-09-17T02:24:34.344825+0000","last_peered":"2024-09-17T02:24:34.344825+0000","last_clean":"2024-09-17T02:24:34.344825+0000","last_became_active":"2024-09-17T02:24:30.329676+0000","last_became_peered":"2024-09-17T02:24:30.329676+0000","last_unstale":"2024-09-17T02:24:34.344825+0000","last_undegraded":"2024-09-17T02:24:34.344825+0000","last_fullsized":"2024-09-17T02:24:34.344825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:50:41.161871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":74,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.360950+0000","last_change":"2024-09-17T02:24:34.360950+0000","last_active":"2024-09-17T02:24:34.360950+0000","last_peered":"2024-09-17T02:24:34.360950+0000","last_clean":"2024-09-17T02:24:34.360950+0000","last_became_active":"2024-09-17T02:24:34.360020+0000","last_became_peered":"2024-09-17T02:24:34.360020+0000","last_unstale":"2024-09-17T02:24:34.360950+0000","last_undegraded":"2024-09-17T02:24:34.360950+0000","last_fullsized":"2024-09-17T02:24:34.360950+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:57.653961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.345742+0000","last_change":"2024-09-17T02:24:30.338531+0000","last_active":"2024-09-17T02:24:34.345742+0000","last_peered":"2024-09-17T02:24:34.345742+0000","last_clean":"2024-09-17T02:24:34.345742+0000","last_became_active":"2024-09-17T02:24:30.336902+0000","last_became_peered":"2024-09-17T02:24:30.336902+0000","last_unstale":"2024-09-17T02:24:34.345742+0000","last_undegraded":"2024-09-17T02:24:34.345742+0000","last_fullsized":"2024-09-17T02:24:34.345742+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:49.660896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.342851+0000","last_change":"2024-09-17T02:24:30.322953+0000","last_active":"2024-09-17T02:24:34.342851+0000","last_peered":"2024-09-17T02:24:34.342851+0000","last_clean":"2024-09-17T02:24:34.342851+0000","last_became_active":"2024-09-17T02:24:30.322780+0000","last_became_peered":"2024-09-17T02:24:30.322780+0000","last_unstale":"2024-09-17T02:24:34.342851+0000","last_undegraded":"2024-09-17T02:24:34.342851+0000","last_fullsized":"2024-09-17T02:24:34.342851+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:59:33.087791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.346736+0000","last_change":"2024-09-17T02:24:30.326828+0000","last_active":"2024-09-17T02:24:34.346736+0000","last_peered":"2024-09-17T02:24:34.346736+0000","last_clean":"2024-09-17T02:24:34.346736+0000","last_became_active":"2024-09-17T02:24:30.326227+0000","last_became_peered":"2024-09-17T02:24:30.326227+0000","last_unstale":"2024-09-17T02:24:34.346736+0000","last_undegraded":"2024-09-17T02:24:34.346736+0000","last_fullsized":"2024-09-17T02:24:34.346736+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:53.135460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":126,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.724075+0000","last_change":"2024-09-17T02:20:37.709979+0000","last_active":"2024-09-17T02:24:34.724075+0000","last_peered":"2024-09-17T02:24:34.724075+0000","last_clean":"2024-09-17T02:24:34.724075+0000","last_became_active":"2024-09-17T02:20:37.708736+0000","last_became_peered":"2024-09-17T02:20:37.708736+0000","last_unstale":"2024-09-17T02:24:34.724075+0000","last_undegraded":"2024-09-17T02:24:34.724075+0000","last_fullsized":"2024-09-17T02:24:34.724075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:03.481029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":141,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.726560+0000","last_change":"2024-09-17T02:20:16.583084+0000","last_active":"2024-09-17T02:24:34.726560+0000","last_peered":"2024-09-17T02:24:34.726560+0000","last_clean":"2024-09-17T02:24:34.726560+0000","last_became_active":"2024-09-17T02:20:16.582326+0000","last_became_peered":"2024-09-17T02:20:16.582326+0000","last_unstale":"2024-09-17T02:24:34.726560+0000","last_undegraded":"2024-09-17T02:24:34.726560+0000","last_fullsized":"2024-09-17T02:24:34.726560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:05.049317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":225,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.342654+0000","last_change":"2024-09-17T02:24:30.338760+0000","last_active":"2024-09-17T02:24:34.342654+0000","last_peered":"2024-09-17T02:24:34.342654+0000","last_clean":"2024-09-17T02:24:34.342654+0000","last_became_active":"2024-09-17T02:24:30.338214+0000","last_became_peered":"2024-09-17T02:24:30.338214+0000","last_unstale":"2024-09-17T02:24:34.342654+0000","last_undegraded":"2024-09-17T02:24:34.342654+0000","last_fullsized":"2024-09-17T02:24:34.342654+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_clean_scrub_stamp":"2024-09-17T02:20:03.432050+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:27:29.124652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.343338+0000","last_change":"2024-09-17T02:24:30.325326+0000","last_active":"2024-09-17T02:24:34.343338+0000","last_peered":"2024-09-17T02:24:34.343338+0000","last_clean":"2024-09-17T02:24:34.343338+0000","last_became_active":"2024-09-17T02:24:30.324910+0000","last_became_peered":"2024-09-17T02:24:30.324910+0000","last_unstale":"2024-09-17T02:24:34.343338+0000","last_undegraded":"2024-09-17T02:24:34.343338+0000","last_fullsized":"2024-09-17T02:24:34.343338+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:52:27.682190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":144,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.722272+0000","last_change":"2024-09-17T02:20:15.560646+0000","last_active":"2024-09-17T02:24:34.722272+0000","last_peered":"2024-09-17T02:24:34.722272+0000","last_clean":"2024-09-17T02:24:34.722272+0000","last_became_active":"2024-09-17T02:20:15.559104+0000","last_became_peered":"2024-09-17T02:20:15.559104+0000","last_unstale":"2024-09-17T02:24:34.722272+0000","last_undegraded":"2024-09-17T02:24:34.722272+0000","last_fullsized":"2024-09-17T02:24:34.722272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:44.299986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.346049+0000","last_change":"2024-09-17T02:24:30.339100+0000","last_active":"2024-09-17T02:24:34.346049+0000","last_peered":"2024-09-17T02:24:34.346049+0000","last_clean":"2024-09-17T02:24:34.346049+0000","last_became_active":"2024-09-17T02:24:30.337415+0000","last_became_peered":"2024-09-17T02:24:30.337415+0000","last_unstale":"2024-09-17T02:24:34.346049+0000","last_undegraded":"2024-09-17T02:24:34.346049+0000","last_fullsized":"2024-09-17T02:24:34.346049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:27.682975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.343463+0000","last_change":"2024-09-17T02:24:30.338621+0000","last_active":"2024-09-17T02:24:34.343463+0000","last_peered":"2024-09-17T02:24:34.343463+0000","last_clean":"2024-09-17T02:24:34.343463+0000","last_became_active":"2024-09-17T02:24:30.338024+0000","last_became_peered":"2024-09-17T02:24:30.338024+0000","last_unstale":"2024-09-17T02:24:34.343463+0000","last_undegraded":"2024-09-17T02:24:34.343463+0000","last_fullsized":"2024-09-17T02:24:34.343463+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:49.985865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":151,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.722425+0000","last_change":"2024-09-17T02:24:30.694491+0000","last_active":"2024-09-17T02:24:34.722425+0000","last_peered":"2024-09-17T02:24:34.722425+0000","last_clean":"2024-09-17T02:24:34.722425+0000","last_became_active":"2024-09-17T02:24:30.693653+0000","last_became_peered":"2024-09-17T02:24:30.693653+0000","last_unstale":"2024-09-17T02:24:34.722425+0000","last_undegraded":"2024-09-17T02:24:34.722425+0000","last_fullsized":"2024-09-17T02:24:34.722425+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:12.740030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":142,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.721082+0000","last_change":"2024-09-17T02:20:16.571568+0000","last_active":"2024-09-17T02:24:34.721082+0000","last_peered":"2024-09-17T02:24:34.721082+0000","last_clean":"2024-09-17T02:24:34.721082+0000","last_became_active":"2024-09-17T02:20:16.570622+0000","last_became_peered":"2024-09-17T02:20:16.570622+0000","last_unstale":"2024-09-17T02:24:34.721082+0000","last_undegraded":"2024-09-17T02:24:34.721082+0000","last_fullsized":"2024-09-17T02:24:34.721082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:57.083446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.723550+0000","last_change":"2024-09-17T02:20:12.511823+0000","last_active":"2024-09-17T02:24:34.723550+0000","last_peered":"2024-09-17T02:24:34.723550+0000","last_clean":"2024-09-17T02:24:34.723550+0000","last_became_active":"2024-09-17T02:20:10.497164+0000","last_became_peered":"2024-09-17T02:20:10.497164+0000","last_unstale":"2024-09-17T02:24:34.723550+0000","last_undegraded":"2024-09-17T02:24:34.723550+0000","last_fullsized":"2024-09-17T02:24:34.723550+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:21.242753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081052700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.342332+0000","last_change":"2024-09-17T02:24:30.336354+0000","last_active":"2024-09-17T02:24:34.342332+0000","last_peered":"2024-09-17T02:24:34.342332+0000","last_clean":"2024-09-17T02:24:34.342332+0000","last_became_active":"2024-09-17T02:24:30.336078+0000","last_became_peered":"2024-09-17T02:24:30.336078+0000","last_unstale":"2024-09-17T02:24:34.342332+0000","last_undegraded":"2024-09-17T02:24:34.342332+0000","last_fullsized":"2024-09-17T02:24:34.342332+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:49.027706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.735602+0000","last_change":"2024-09-17T02:24:34.730636+0000","last_active":"2024-09-17T02:24:34.735602+0000","last_peered":"2024-09-17T02:24:34.735602+0000","last_clean":"2024-09-17T02:24:34.735602+0000","last_became_active":"2024-09-17T02:24:34.729890+0000","last_became_peered":"2024-09-17T02:24:34.729890+0000","last_unstale":"2024-09-17T02:24:34.735602+0000","last_undegraded":"2024-09-17T02:24:34.735602+0000","last_fullsized":"2024-09-17T02:24:34.735602+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:07.679985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.342901+0000","last_change":"2024-09-17T02:24:30.333204+0000","last_active":"2024-09-17T02:24:34.342901+0000","last_peered":"2024-09-17T02:24:34.342901+0000","last_clean":"2024-09-17T02:24:34.342901+0000","last_became_active":"2024-09-17T02:24:30.333005+0000","last_became_peered":"2024-09-17T02:24:30.333005+0000","last_unstale":"2024-09-17T02:24:34.342901+0000","last_undegraded":"2024-09-17T02:24:34.342901+0000","last_fullsized":"2024-09-17T02:24:34.342901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:17.620422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078085399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.346066+0000","last_change":"2024-09-17T02:24:30.329442+0000","last_active":"2024-09-17T02:24:34.346066+0000","last_peered":"2024-09-17T02:24:34.346066+0000","last_clean":"2024-09-17T02:24:34.346066+0000","last_became_active":"2024-09-17T02:24:30.329213+0000","last_became_peered":"2024-09-17T02:24:30.329213+0000","last_unstale":"2024-09-17T02:24:34.346066+0000","last_undegraded":"2024-09-17T02:24:34.346066+0000","last_fullsized":"2024-09-17T02:24:34.346066+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:25.034116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":142,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.724312+0000","last_change":"2024-09-17T02:20:16.580184+0000","last_active":"2024-09-17T02:24:34.724312+0000","last_peered":"2024-09-17T02:24:34.724312+0000","last_clean":"2024-09-17T02:24:34.724312+0000","last_became_active":"2024-09-17T02:20:16.578343+0000","last_became_peered":"2024-09-17T02:20:16.578343+0000","last_unstale":"2024-09-17T02:24:34.724312+0000","last_undegraded":"2024-09-17T02:24:34.724312+0000","last_fullsized":"2024-09-17T02:24:34.724312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:42.123535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":74,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.354157+0000","last_change":"2024-09-17T02:24:34.354157+0000","last_active":"2024-09-17T02:24:34.354157+0000","last_peered":"2024-09-17T02:24:34.354157+0000","last_clean":"2024-09-17T02:24:34.354157+0000","last_became_active":"2024-09-17T02:24:34.353619+0000","last_became_peered":"2024-09-17T02:24:34.353619+0000","last_unstale":"2024-09-17T02:24:34.354157+0000","last_undegraded":"2024-09-17T02:24:34.354157+0000","last_fullsized":"2024-09-17T02:24:34.354157+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:53:03.444794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.724596+0000","last_change":"2024-09-17T02:20:12.511838+0000","last_active":"2024-09-17T02:24:34.724596+0000","last_peered":"2024-09-17T02:24:34.724596+0000","last_clean":"2024-09-17T02:24:34.724596+0000","last_became_active":"2024-09-17T02:20:10.497049+0000","last_became_peered":"2024-09-17T02:20:10.497049+0000","last_unstale":"2024-09-17T02:24:34.724596+0000","last_undegraded":"2024-09-17T02:24:34.724596+0000","last_fullsized":"2024-09-17T02:24:34.724596+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:54.446484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079701100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.721383+0000","last_change":"2024-09-17T02:24:30.698392+0000","last_active":"2024-09-17T02:24:34.721383+0000","last_peered":"2024-09-17T02:24:34.721383+0000","last_clean":"2024-09-17T02:24:34.721383+0000","last_became_active":"2024-09-17T02:24:30.694944+0000","last_became_peered":"2024-09-17T02:24:30.694944+0000","last_unstale":"2024-09-17T02:24:34.721383+0000","last_undegraded":"2024-09-17T02:24:34.721383+0000","last_fullsized":"2024-09-17T02:24:34.721383+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:06.407404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":144,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.724427+0000","last_change":"2024-09-17T02:20:15.559252+0000","last_active":"2024-09-17T02:24:34.724427+0000","last_peered":"2024-09-17T02:24:34.724427+0000","last_clean":"2024-09-17T02:24:34.724427+0000","last_became_active":"2024-09-17T02:20:15.557667+0000","last_became_peered":"2024-09-17T02:20:15.557667+0000","last_unstale":"2024-09-17T02:24:34.724427+0000","last_undegraded":"2024-09-17T02:24:34.724427+0000","last_fullsized":"2024-09-17T02:24:34.724427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:01.292626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.719590+0000","last_change":"2024-09-17T02:20:12.661034+0000","last_active":"2024-09-17T02:24:34.719590+0000","last_peered":"2024-09-17T02:24:34.719590+0000","last_clean":"2024-09-17T02:24:34.719590+0000","last_became_active":"2024-09-17T02:20:10.497829+0000","last_became_peered":"2024-09-17T02:20:10.497829+0000","last_unstale":"2024-09-17T02:24:34.719590+0000","last_undegraded":"2024-09-17T02:24:34.719590+0000","last_fullsized":"2024-09-17T02:24:34.719590+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:46:27.427685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096944700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.343650+0000","last_change":"2024-09-17T02:24:30.322910+0000","last_active":"2024-09-17T02:24:34.343650+0000","last_peered":"2024-09-17T02:24:34.343650+0000","last_clean":"2024-09-17T02:24:34.343650+0000","last_became_active":"2024-09-17T02:24:30.322632+0000","last_became_peered":"2024-09-17T02:24:30.322632+0000","last_unstale":"2024-09-17T02:24:34.343650+0000","last_undegraded":"2024-09-17T02:24:34.343650+0000","last_fullsized":"2024-09-17T02:24:34.343650+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:03.155286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":146,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.727257+0000","last_change":"2024-09-17T02:20:15.558961+0000","last_active":"2024-09-17T02:24:34.727257+0000","last_peered":"2024-09-17T02:24:34.727257+0000","last_clean":"2024-09-17T02:24:34.727257+0000","last_became_active":"2024-09-17T02:20:15.558299+0000","last_became_peered":"2024-09-17T02:20:15.558299+0000","last_unstale":"2024-09-17T02:24:34.727257+0000","last_undegraded":"2024-09-17T02:24:34.727257+0000","last_fullsized":"2024-09-17T02:24:34.727257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:39.709524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.729761+0000","last_change":"2024-09-17T02:20:12.512481+0000","last_active":"2024-09-17T02:24:34.729761+0000","last_peered":"2024-09-17T02:24:34.729761+0000","last_clean":"2024-09-17T02:24:34.729761+0000","last_became_active":"2024-09-17T02:20:10.497021+0000","last_became_peered":"2024-09-17T02:20:10.497021+0000","last_unstale":"2024-09-17T02:24:34.729761+0000","last_undegraded":"2024-09-17T02:24:34.729761+0000","last_fullsized":"2024-09-17T02:24:34.729761+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:41.167283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001400079,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.724579+0000","last_change":"2024-09-17T02:24:30.693811+0000","last_active":"2024-09-17T02:24:34.724579+0000","last_peered":"2024-09-17T02:24:34.724579+0000","last_clean":"2024-09-17T02:24:34.724579+0000","last_became_active":"2024-09-17T02:24:30.691331+0000","last_became_peered":"2024-09-17T02:24:30.691331+0000","last_unstale":"2024-09-17T02:24:34.724579+0000","last_undegraded":"2024-09-17T02:24:34.724579+0000","last_fullsized":"2024-09-17T02:24:34.724579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:39.446085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":152,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.729900+0000","last_change":"2024-09-17T02:24:30.694492+0000","last_active":"2024-09-17T02:24:34.729900+0000","last_peered":"2024-09-17T02:24:34.729900+0000","last_clean":"2024-09-17T02:24:34.729900+0000","last_became_active":"2024-09-17T02:24:30.691770+0000","last_became_peered":"2024-09-17T02:24:30.691770+0000","last_unstale":"2024-09-17T02:24:34.729900+0000","last_undegraded":"2024-09-17T02:24:34.729900+0000","last_fullsized":"2024-09-17T02:24:34.729900+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:01.597617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.346747+0000","last_change":"2024-09-17T02:24:30.336636+0000","last_active":"2024-09-17T02:24:34.346747+0000","last_peered":"2024-09-17T02:24:34.346747+0000","last_clean":"2024-09-17T02:24:34.346747+0000","last_became_active":"2024-09-17T02:24:30.336110+0000","last_became_peered":"2024-09-17T02:24:30.336110+0000","last_unstale":"2024-09-17T02:24:34.346747+0000","last_undegraded":"2024-09-17T02:24:34.346747+0000","last_fullsized":"2024-09-17T02:24:34.346747+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:44.699884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.716043+0000","last_change":"2024-09-17T02:24:30.700777+0000","last_active":"2024-09-17T02:24:34.716043+0000","last_peered":"2024-09-17T02:24:34.716043+0000","last_clean":"2024-09-17T02:24:34.716043+0000","last_became_active":"2024-09-17T02:24:30.696731+0000","last_became_peered":"2024-09-17T02:24:30.696731+0000","last_unstale":"2024-09-17T02:24:34.716043+0000","last_undegraded":"2024-09-17T02:24:34.716043+0000","last_fullsized":"2024-09-17T02:24:34.716043+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:58.629953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.344065+0000","last_change":"2024-09-17T02:24:30.326364+0000","last_active":"2024-09-17T02:24:34.344065+0000","last_peered":"2024-09-17T02:24:34.344065+0000","last_clean":"2024-09-17T02:24:34.344065+0000","last_became_active":"2024-09-17T02:24:30.325752+0000","last_became_peered":"2024-09-17T02:24:30.325752+0000","last_unstale":"2024-09-17T02:24:34.344065+0000","last_undegraded":"2024-09-17T02:24:34.344065+0000","last_fullsized":"2024-09-17T02:24:34.344065+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:33.800584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.343738+0000","last_change":"2024-09-17T02:24:30.325924+0000","last_active":"2024-09-17T02:24:34.343738+0000","last_peered":"2024-09-17T02:24:34.343738+0000","last_clean":"2024-09-17T02:24:34.343738+0000","last_became_active":"2024-09-17T02:24:30.325688+0000","last_became_peered":"2024-09-17T02:24:30.325688+0000","last_unstale":"2024-09-17T02:24:34.343738+0000","last_undegraded":"2024-09-17T02:24:34.343738+0000","last_fullsized":"2024-09-17T02:24:34.343738+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:25.290483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.735725+0000","last_change":"2024-09-17T02:24:34.731288+0000","last_active":"2024-09-17T02:24:34.735725+0000","last_peered":"2024-09-17T02:24:34.735725+0000","last_clean":"2024-09-17T02:24:34.735725+0000","last_became_active":"2024-09-17T02:24:34.730386+0000","last_became_peered":"2024-09-17T02:24:34.730386+0000","last_unstale":"2024-09-17T02:24:34.735725+0000","last_undegraded":"2024-09-17T02:24:34.735725+0000","last_fullsized":"2024-09-17T02:24:34.735725+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:45.808940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.345695+0000","last_change":"2024-09-17T02:24:30.338759+0000","last_active":"2024-09-17T02:24:34.345695+0000","last_peered":"2024-09-17T02:24:34.345695+0000","last_clean":"2024-09-17T02:24:34.345695+0000","last_became_active":"2024-09-17T02:24:30.336906+0000","last_became_peered":"2024-09-17T02:24:30.336906+0000","last_unstale":"2024-09-17T02:24:34.345695+0000","last_undegraded":"2024-09-17T02:24:34.345695+0000","last_fullsized":"2024-09-17T02:24:34.345695+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:09.728346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.345064+0000","last_change":"2024-09-17T02:24:30.325492+0000","last_active":"2024-09-17T02:24:34.345064+0000","last_peered":"2024-09-17T02:24:34.345064+0000","last_clean":"2024-09-17T02:24:34.345064+0000","last_became_active":"2024-09-17T02:24:30.325175+0000","last_became_peered":"2024-09-17T02:24:30.325175+0000","last_unstale":"2024-09-17T02:24:34.345064+0000","last_undegraded":"2024-09-17T02:24:34.345064+0000","last_fullsized":"2024-09-17T02:24:34.345064+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:04.443085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":148,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.721627+0000","last_change":"2024-09-17T02:24:30.699551+0000","last_active":"2024-09-17T02:24:34.721627+0000","last_peered":"2024-09-17T02:24:34.721627+0000","last_clean":"2024-09-17T02:24:34.721627+0000","last_became_active":"2024-09-17T02:24:30.697986+0000","last_became_peered":"2024-09-17T02:24:30.697986+0000","last_unstale":"2024-09-17T02:24:34.721627+0000","last_undegraded":"2024-09-17T02:24:34.721627+0000","last_fullsized":"2024-09-17T02:24:34.721627+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:44.939985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":150,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.726839+0000","last_change":"2024-09-17T02:24:30.697249+0000","last_active":"2024-09-17T02:24:34.726839+0000","last_peered":"2024-09-17T02:24:34.726839+0000","last_clean":"2024-09-17T02:24:34.726839+0000","last_became_active":"2024-09-17T02:24:30.696215+0000","last_became_peered":"2024-09-17T02:24:30.696215+0000","last_unstale":"2024-09-17T02:24:34.726839+0000","last_undegraded":"2024-09-17T02:24:34.726839+0000","last_fullsized":"2024-09-17T02:24:34.726839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:07.507822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":141,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.724332+0000","last_change":"2024-09-17T02:20:16.577803+0000","last_active":"2024-09-17T02:24:34.724332+0000","last_peered":"2024-09-17T02:24:34.724332+0000","last_clean":"2024-09-17T02:24:34.724332+0000","last_became_active":"2024-09-17T02:20:16.576640+0000","last_became_peered":"2024-09-17T02:20:16.576640+0000","last_unstale":"2024-09-17T02:24:34.724332+0000","last_undegraded":"2024-09-17T02:24:34.724332+0000","last_fullsized":"2024-09-17T02:24:34.724332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:07.190169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.721327+0000","last_change":"2024-09-17T02:24:30.706739+0000","last_active":"2024-09-17T02:24:34.721327+0000","last_peered":"2024-09-17T02:24:34.721327+0000","last_clean":"2024-09-17T02:24:34.721327+0000","last_became_active":"2024-09-17T02:24:30.706195+0000","last_became_peered":"2024-09-17T02:24:30.706195+0000","last_unstale":"2024-09-17T02:24:34.721327+0000","last_undegraded":"2024-09-17T02:24:34.721327+0000","last_fullsized":"2024-09-17T02:24:34.721327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:38.782264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.736300+0000","last_change":"2024-09-17T02:24:34.733762+0000","last_active":"2024-09-17T02:24:34.736300+0000","last_peered":"2024-09-17T02:24:34.736300+0000","last_clean":"2024-09-17T02:24:34.736300+0000","last_became_active":"2024-09-17T02:24:34.731592+0000","last_became_peered":"2024-09-17T02:24:34.731592+0000","last_unstale":"2024-09-17T02:24:34.736300+0000","last_undegraded":"2024-09-17T02:24:34.736300+0000","last_fullsized":"2024-09-17T02:24:34.736300+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:41.921908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.727352+0000","last_change":"2024-09-17T02:24:30.696267+0000","last_active":"2024-09-17T02:24:34.727352+0000","last_peered":"2024-09-17T02:24:34.727352+0000","last_clean":"2024-09-17T02:24:34.727352+0000","last_became_active":"2024-09-17T02:24:30.694027+0000","last_became_peered":"2024-09-17T02:24:30.694027+0000","last_unstale":"2024-09-17T02:24:34.727352+0000","last_undegraded":"2024-09-17T02:24:34.727352+0000","last_fullsized":"2024-09-17T02:24:34.727352+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:56.160158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":150,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.722141+0000","last_change":"2024-09-17T02:24:30.697568+0000","last_active":"2024-09-17T02:24:34.722141+0000","last_peered":"2024-09-17T02:24:34.722141+0000","last_clean":"2024-09-17T02:24:34.722141+0000","last_became_active":"2024-09-17T02:24:30.693991+0000","last_became_peered":"2024-09-17T02:24:30.693991+0000","last_unstale":"2024-09-17T02:24:34.722141+0000","last_undegraded":"2024-09-17T02:24:34.722141+0000","last_fullsized":"2024-09-17T02:24:34.722141+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:45.636130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":146,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.717462+0000","last_change":"2024-09-17T02:21:10.505967+0000","last_active":"2024-09-17T02:24:34.717462+0000","last_peered":"2024-09-17T02:24:34.717462+0000","last_clean":"2024-09-17T02:24:34.717462+0000","last_became_active":"2024-09-17T02:21:10.505594+0000","last_became_peered":"2024-09-17T02:21:10.505594+0000","last_unstale":"2024-09-17T02:24:34.717462+0000","last_undegraded":"2024-09-17T02:24:34.717462+0000","last_fullsized":"2024-09-17T02:24:34.717462+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:15.782752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":126,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.721341+0000","last_change":"2024-09-17T02:20:37.706393+0000","last_active":"2024-09-17T02:24:34.721341+0000","last_peered":"2024-09-17T02:24:34.721341+0000","last_clean":"2024-09-17T02:24:34.721341+0000","last_became_active":"2024-09-17T02:20:37.705739+0000","last_became_peered":"2024-09-17T02:20:37.705739+0000","last_unstale":"2024-09-17T02:24:34.721341+0000","last_undegraded":"2024-09-17T02:24:34.721341+0000","last_fullsized":"2024-09-17T02:24:34.721341+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:57.361673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":126,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.721819+0000","last_change":"2024-09-17T02:20:37.706175+0000","last_active":"2024-09-17T02:24:34.721819+0000","last_peered":"2024-09-17T02:24:34.721819+0000","last_clean":"2024-09-17T02:24:34.721819+0000","last_became_active":"2024-09-17T02:20:37.705742+0000","last_became_peered":"2024-09-17T02:20:37.705742+0000","last_unstale":"2024-09-17T02:24:34.721819+0000","last_undegraded":"2024-09-17T02:24:34.721819+0000","last_fullsized":"2024-09-17T02:24:34.721819+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:09.959092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":151,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.720524+0000","last_change":"2024-09-17T02:24:30.698237+0000","last_active":"2024-09-17T02:24:34.720524+0000","last_peered":"2024-09-17T02:24:34.720524+0000","last_clean":"2024-09-17T02:24:34.720524+0000","last_became_active":"2024-09-17T02:24:30.697194+0000","last_became_peered":"2024-09-17T02:24:30.697194+0000","last_unstale":"2024-09-17T02:24:34.720524+0000","last_undegraded":"2024-09-17T02:24:34.720524+0000","last_fullsized":"2024-09-17T02:24:34.720524+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:36.697224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":72,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.360811+0000","last_change":"2024-09-17T02:24:34.360811+0000","last_active":"2024-09-17T02:24:34.360811+0000","last_peered":"2024-09-17T02:24:34.360811+0000","last_clean":"2024-09-17T02:24:34.360811+0000","last_became_active":"2024-09-17T02:24:34.359944+0000","last_became_peered":"2024-09-17T02:24:34.359944+0000","last_unstale":"2024-09-17T02:24:34.360811+0000","last_undegraded":"2024-09-17T02:24:34.360811+0000","last_fullsized":"2024-09-17T02:24:34.360811+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:07.986774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.343807+0000","last_change":"2024-09-17T02:24:30.327080+0000","last_active":"2024-09-17T02:24:34.343807+0000","last_peered":"2024-09-17T02:24:34.343807+0000","last_clean":"2024-09-17T02:24:34.343807+0000","last_became_active":"2024-09-17T02:24:30.326800+0000","last_became_peered":"2024-09-17T02:24:30.326800+0000","last_unstale":"2024-09-17T02:24:34.343807+0000","last_undegraded":"2024-09-17T02:24:34.343807+0000","last_fullsized":"2024-09-17T02:24:34.343807+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:06.072812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.343980+0000","last_change":"2024-09-17T02:24:30.322448+0000","last_active":"2024-09-17T02:24:34.343980+0000","last_peered":"2024-09-17T02:24:34.343980+0000","last_clean":"2024-09-17T02:24:34.343980+0000","last_became_active":"2024-09-17T02:24:30.322156+0000","last_became_peered":"2024-09-17T02:24:30.322156+0000","last_unstale":"2024-09-17T02:24:34.343980+0000","last_undegraded":"2024-09-17T02:24:34.343980+0000","last_fullsized":"2024-09-17T02:24:34.343980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:46.435146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.344488+0000","last_change":"2024-09-17T02:24:30.336467+0000","last_active":"2024-09-17T02:24:34.344488+0000","last_peered":"2024-09-17T02:24:34.344488+0000","last_clean":"2024-09-17T02:24:34.344488+0000","last_became_active":"2024-09-17T02:24:30.336042+0000","last_became_peered":"2024-09-17T02:24:30.336042+0000","last_unstale":"2024-09-17T02:24:34.344488+0000","last_undegraded":"2024-09-17T02:24:34.344488+0000","last_fullsized":"2024-09-17T02:24:34.344488+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:59.645621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":141,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.716492+0000","last_change":"2024-09-17T02:20:16.570456+0000","last_active":"2024-09-17T02:24:34.716492+0000","last_peered":"2024-09-17T02:24:34.716492+0000","last_clean":"2024-09-17T02:24:34.716492+0000","last_became_active":"2024-09-17T02:20:16.568095+0000","last_became_peered":"2024-09-17T02:20:16.568095+0000","last_unstale":"2024-09-17T02:24:34.716492+0000","last_undegraded":"2024-09-17T02:24:34.716492+0000","last_fullsized":"2024-09-17T02:24:34.716492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:58.329169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":145,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.729356+0000","last_change":"2024-09-17T02:20:15.560293+0000","last_active":"2024-09-17T02:24:34.729356+0000","last_peered":"2024-09-17T02:24:34.729356+0000","last_clean":"2024-09-17T02:24:34.729356+0000","last_became_active":"2024-09-17T02:20:15.559074+0000","last_became_peered":"2024-09-17T02:20:15.559074+0000","last_unstale":"2024-09-17T02:24:34.729356+0000","last_undegraded":"2024-09-17T02:24:34.729356+0000","last_fullsized":"2024-09-17T02:24:34.729356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:55.639841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.343762+0000","last_change":"2024-09-17T02:24:30.319629+0000","last_active":"2024-09-17T02:24:34.343762+0000","last_peered":"2024-09-17T02:24:34.343762+0000","last_clean":"2024-09-17T02:24:34.343762+0000","last_became_active":"2024-09-17T02:24:30.319441+0000","last_became_peered":"2024-09-17T02:24:30.319441+0000","last_unstale":"2024-09-17T02:24:34.343762+0000","last_undegraded":"2024-09-17T02:24:34.343762+0000","last_fullsized":"2024-09-17T02:24:34.343762+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:58.379141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":155,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.726719+0000","last_change":"2024-09-17T02:24:30.699964+0000","last_active":"2024-09-17T02:24:34.726719+0000","last_peered":"2024-09-17T02:24:34.726719+0000","last_clean":"2024-09-17T02:24:34.726719+0000","last_became_active":"2024-09-17T02:24:30.699102+0000","last_became_peered":"2024-09-17T02:24:30.699102+0000","last_unstale":"2024-09-17T02:24:34.726719+0000","last_undegraded":"2024-09-17T02:24:34.726719+0000","last_fullsized":"2024-09-17T02:24:34.726719+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:19.193516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5558,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361192,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":360190,"kb_avail":94010648,"statfs":{"total":96636764160,"available":96266903552,"internally_reserved":0,"allocated":1003520,"data_stored":957653,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":368835013},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":80,"seq":343597383683,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56436,"kb_used_data":992,"kb_used_omap":6,"kb_used_meta":55417,"kb_avail":94315404,"statfs":{"total":96636764160,"available":96578973696,"internally_reserved":0,"allocated":1015808,"data_stored":958288,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":7153,"internal_metadata":56747023},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738426,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329196,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94042644,"statfs":{"total":96636764160,"available":96299667456,"internally_reserved":0,"allocated":933888,"data_stored":366126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5558,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T02:24:39.517 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-17T02:24:39.517 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T02:24:39.517 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-17T02:24:39.518 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-17T02:24:39.851 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:24:39.851 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-17T02:24:39.851 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 84, 2024-09-17T02:24:39.851 INFO:teuthology.orchestra.run.smithi001.stdout: "fsid": "37cd4495-4915-41f4-bad2-2394cbe235f3", 2024-09-17T02:24:39.851 INFO:teuthology.orchestra.run.smithi001.stdout: "created": "2024-09-17T02:19:52.516342+0000", 2024-09-17T02:24:39.851 INFO:teuthology.orchestra.run.smithi001.stdout: "modified": "2024-09-17T02:24:34.707768+0000", 2024-09-17T02:24:39.851 INFO:teuthology.orchestra.run.smithi001.stdout: "last_up_change": "2024-09-17T02:24:29.673066+0000", 2024-09-17T02:24:39.851 INFO:teuthology.orchestra.run.smithi001.stdout: "last_in_change": "2024-09-17T02:19:54.329423+0000", 2024-09-17T02:24:39.851 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T02:24:39.852 INFO:teuthology.orchestra.run.smithi001.stdout: "flags_num": 5799936, 2024-09-17T02:24:39.852 INFO:teuthology.orchestra.run.smithi001.stdout: "flags_set": [ 2024-09-17T02:24:39.852 INFO:teuthology.orchestra.run.smithi001.stdout: "pglog_hardlimit", 2024-09-17T02:24:39.852 INFO:teuthology.orchestra.run.smithi001.stdout: "purged_snapdirs", 2024-09-17T02:24:39.852 INFO:teuthology.orchestra.run.smithi001.stdout: "recovery_deletes", 2024-09-17T02:24:39.852 INFO:teuthology.orchestra.run.smithi001.stdout: "sortbitwise" 2024-09-17T02:24:39.852 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-17T02:24:39.852 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_version": 6, 2024-09-17T02:24:39.852 INFO:teuthology.orchestra.run.smithi001.stdout: "full_ratio": 0.94999998807907104, 2024-09-17T02:24:39.852 INFO:teuthology.orchestra.run.smithi001.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-17T02:24:39.852 INFO:teuthology.orchestra.run.smithi001.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-17T02:24:39.852 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_snapshot": "", 2024-09-17T02:24:39.852 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_max": 5, 2024-09-17T02:24:39.853 INFO:teuthology.orchestra.run.smithi001.stdout: "max_osd": 3, 2024-09-17T02:24:39.853 INFO:teuthology.orchestra.run.smithi001.stdout: "require_min_compat_client": "luminous", 2024-09-17T02:24:39.853 INFO:teuthology.orchestra.run.smithi001.stdout: "min_compat_client": "luminous", 2024-09-17T02:24:39.853 INFO:teuthology.orchestra.run.smithi001.stdout: "require_osd_release": "squid", 2024-09-17T02:24:39.853 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_crimson": false, 2024-09-17T02:24:39.853 INFO:teuthology.orchestra.run.smithi001.stdout: "pools": [ 2024-09-17T02:24:39.853 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.853 INFO:teuthology.orchestra.run.smithi001.stdout: "pool": 1, 2024-09-17T02:24:39.853 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": ".mgr", 2024-09-17T02:24:39.853 INFO:teuthology.orchestra.run.smithi001.stdout: "create_time": "2024-09-17T02:20:03.416336+0000", 2024-09-17T02:24:39.853 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-17T02:24:39.853 INFO:teuthology.orchestra.run.smithi001.stdout: "flags_names": "hashpspool", 2024-09-17T02:24:39.853 INFO:teuthology.orchestra.run.smithi001.stdout: "type": 1, 2024-09-17T02:24:39.854 INFO:teuthology.orchestra.run.smithi001.stdout: "size": 2, 2024-09-17T02:24:39.854 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": 1, 2024-09-17T02:24:39.854 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_rule": 0, 2024-09-17T02:24:39.854 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:24:39.854 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:24:39.854 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:24:39.854 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:24:39.854 INFO:teuthology.orchestra.run.smithi001.stdout: "is_stretch_pool": false, 2024-09-17T02:24:39.854 INFO:teuthology.orchestra.run.smithi001.stdout: "object_hash": 2, 2024-09-17T02:24:39.854 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:24:39.854 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": 1, 2024-09-17T02:24:39.854 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num": 1, 2024-09-17T02:24:39.854 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num_target": 1, 2024-09-17T02:24:39.854 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_target": 1, 2024-09-17T02:24:39.855 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_pending": 1, 2024-09-17T02:24:39.855 INFO:teuthology.orchestra.run.smithi001.stdout: "last_pg_merge_meta": { 2024-09-17T02:24:39.855 INFO:teuthology.orchestra.run.smithi001.stdout: "source_pgid": "0.0", 2024-09-17T02:24:39.855 INFO:teuthology.orchestra.run.smithi001.stdout: "ready_epoch": 0, 2024-09-17T02:24:39.855 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_started": 0, 2024-09-17T02:24:39.855 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_clean": 0, 2024-09-17T02:24:39.855 INFO:teuthology.orchestra.run.smithi001.stdout: "source_version": "0'0", 2024-09-17T02:24:39.855 INFO:teuthology.orchestra.run.smithi001.stdout: "target_version": "0'0" 2024-09-17T02:24:39.855 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.855 INFO:teuthology.orchestra.run.smithi001.stdout: "last_change": "12", 2024-09-17T02:24:39.855 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend": "0", 2024-09-17T02:24:39.855 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:24:39.855 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:24:39.856 INFO:teuthology.orchestra.run.smithi001.stdout: "auid": 0, 2024-09-17T02:24:39.856 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:24:39.856 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_seq": 0, 2024-09-17T02:24:39.856 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_epoch": 0, 2024-09-17T02:24:39.856 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_snaps": [], 2024-09-17T02:24:39.856 INFO:teuthology.orchestra.run.smithi001.stdout: "removed_snaps": "[]", 2024-09-17T02:24:39.856 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_bytes": 0, 2024-09-17T02:24:39.856 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_objects": 0, 2024-09-17T02:24:39.856 INFO:teuthology.orchestra.run.smithi001.stdout: "tiers": [], 2024-09-17T02:24:39.856 INFO:teuthology.orchestra.run.smithi001.stdout: "tier_of": -1, 2024-09-17T02:24:39.856 INFO:teuthology.orchestra.run.smithi001.stdout: "read_tier": -1, 2024-09-17T02:24:39.856 INFO:teuthology.orchestra.run.smithi001.stdout: "write_tier": -1, 2024-09-17T02:24:39.856 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_mode": "none", 2024-09-17T02:24:39.857 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_bytes": 0, 2024-09-17T02:24:39.857 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_objects": 0, 2024-09-17T02:24:39.857 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:24:39.857 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:24:39.857 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:24:39.857 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_flush_age": 0, 2024-09-17T02:24:39.857 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_evict_age": 0, 2024-09-17T02:24:39.857 INFO:teuthology.orchestra.run.smithi001.stdout: "erasure_code_profile": "", 2024-09-17T02:24:39.857 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_params": { 2024-09-17T02:24:39.857 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "none" 2024-09-17T02:24:39.857 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.857 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_period": 0, 2024-09-17T02:24:39.857 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_count": 0, 2024-09-17T02:24:39.858 INFO:teuthology.orchestra.run.smithi001.stdout: "use_gmt_hitset": true, 2024-09-17T02:24:39.858 INFO:teuthology.orchestra.run.smithi001.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:24:39.858 INFO:teuthology.orchestra.run.smithi001.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:24:39.858 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:24:39.858 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:24:39.858 INFO:teuthology.orchestra.run.smithi001.stdout: "grade_table": [], 2024-09-17T02:24:39.858 INFO:teuthology.orchestra.run.smithi001.stdout: "stripe_width": 0, 2024-09-17T02:24:39.858 INFO:teuthology.orchestra.run.smithi001.stdout: "expected_num_objects": 0, 2024-09-17T02:24:39.858 INFO:teuthology.orchestra.run.smithi001.stdout: "fast_read": false, 2024-09-17T02:24:39.858 INFO:teuthology.orchestra.run.smithi001.stdout: "options": { 2024-09-17T02:24:39.858 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_max": 32, 2024-09-17T02:24:39.858 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_min": 1 2024-09-17T02:24:39.858 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.859 INFO:teuthology.orchestra.run.smithi001.stdout: "application_metadata": { 2024-09-17T02:24:39.859 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": {} 2024-09-17T02:24:39.859 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.859 INFO:teuthology.orchestra.run.smithi001.stdout: "read_balance": { 2024-09-17T02:24:39.859 INFO:teuthology.orchestra.run.smithi001.stdout: "score_type": "Fair distribution", 2024-09-17T02:24:39.859 INFO:teuthology.orchestra.run.smithi001.stdout: "score_acting": 2.9900000095367432, 2024-09-17T02:24:39.859 INFO:teuthology.orchestra.run.smithi001.stdout: "score_stable": 2.9900000095367432, 2024-09-17T02:24:39.859 INFO:teuthology.orchestra.run.smithi001.stdout: "optimal_score": 0.67000001668930054, 2024-09-17T02:24:39.859 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_acting": 2, 2024-09-17T02:24:39.859 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_stable": 2, 2024-09-17T02:24:39.859 INFO:teuthology.orchestra.run.smithi001.stdout: "primary_affinity_weighted": 0.79247540235519409, 2024-09-17T02:24:39.859 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity": 0.79000002145767212, 2024-09-17T02:24:39.859 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity_weighted": 0.79000002145767212 2024-09-17T02:24:39.859 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:24:39.860 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.860 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.860 INFO:teuthology.orchestra.run.smithi001.stdout: "pool": 2, 2024-09-17T02:24:39.860 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": "rbd", 2024-09-17T02:24:39.860 INFO:teuthology.orchestra.run.smithi001.stdout: "create_time": "2024-09-17T02:20:08.718296+0000", 2024-09-17T02:24:39.860 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 8193, 2024-09-17T02:24:39.860 INFO:teuthology.orchestra.run.smithi001.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-17T02:24:39.860 INFO:teuthology.orchestra.run.smithi001.stdout: "type": 1, 2024-09-17T02:24:39.860 INFO:teuthology.orchestra.run.smithi001.stdout: "size": 2, 2024-09-17T02:24:39.860 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": 1, 2024-09-17T02:24:39.860 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_rule": 0, 2024-09-17T02:24:39.860 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:24:39.860 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:24:39.861 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:24:39.861 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:24:39.862 INFO:teuthology.orchestra.run.smithi001.stdout: "is_stretch_pool": false, 2024-09-17T02:24:39.862 INFO:teuthology.orchestra.run.smithi001.stdout: "object_hash": 2, 2024-09-17T02:24:39.862 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:24:39.862 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": 8, 2024-09-17T02:24:39.862 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num": 8, 2024-09-17T02:24:39.862 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num_target": 8, 2024-09-17T02:24:39.862 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_target": 8, 2024-09-17T02:24:39.862 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_pending": 8, 2024-09-17T02:24:39.862 INFO:teuthology.orchestra.run.smithi001.stdout: "last_pg_merge_meta": { 2024-09-17T02:24:39.862 INFO:teuthology.orchestra.run.smithi001.stdout: "source_pgid": "0.0", 2024-09-17T02:24:39.862 INFO:teuthology.orchestra.run.smithi001.stdout: "ready_epoch": 0, 2024-09-17T02:24:39.862 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_started": 0, 2024-09-17T02:24:39.863 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_clean": 0, 2024-09-17T02:24:39.863 INFO:teuthology.orchestra.run.smithi001.stdout: "source_version": "0'0", 2024-09-17T02:24:39.863 INFO:teuthology.orchestra.run.smithi001.stdout: "target_version": "0'0" 2024-09-17T02:24:39.863 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.863 INFO:teuthology.orchestra.run.smithi001.stdout: "last_change": "16", 2024-09-17T02:24:39.863 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend": "0", 2024-09-17T02:24:39.863 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:24:39.863 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:24:39.863 INFO:teuthology.orchestra.run.smithi001.stdout: "auid": 0, 2024-09-17T02:24:39.863 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:24:39.863 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_seq": 2, 2024-09-17T02:24:39.863 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_epoch": 16, 2024-09-17T02:24:39.863 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_snaps": [], 2024-09-17T02:24:39.863 INFO:teuthology.orchestra.run.smithi001.stdout: "removed_snaps": "[]", 2024-09-17T02:24:39.864 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_bytes": 0, 2024-09-17T02:24:39.864 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_objects": 0, 2024-09-17T02:24:39.864 INFO:teuthology.orchestra.run.smithi001.stdout: "tiers": [], 2024-09-17T02:24:39.864 INFO:teuthology.orchestra.run.smithi001.stdout: "tier_of": -1, 2024-09-17T02:24:39.864 INFO:teuthology.orchestra.run.smithi001.stdout: "read_tier": -1, 2024-09-17T02:24:39.864 INFO:teuthology.orchestra.run.smithi001.stdout: "write_tier": -1, 2024-09-17T02:24:39.864 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_mode": "none", 2024-09-17T02:24:39.864 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_bytes": 0, 2024-09-17T02:24:39.864 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_objects": 0, 2024-09-17T02:24:39.864 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:24:39.864 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:24:39.864 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:24:39.864 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_flush_age": 0, 2024-09-17T02:24:39.865 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_evict_age": 0, 2024-09-17T02:24:39.865 INFO:teuthology.orchestra.run.smithi001.stdout: "erasure_code_profile": "", 2024-09-17T02:24:39.865 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_params": { 2024-09-17T02:24:39.865 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "none" 2024-09-17T02:24:39.865 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.865 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_period": 0, 2024-09-17T02:24:39.865 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_count": 0, 2024-09-17T02:24:39.865 INFO:teuthology.orchestra.run.smithi001.stdout: "use_gmt_hitset": true, 2024-09-17T02:24:39.865 INFO:teuthology.orchestra.run.smithi001.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:24:39.865 INFO:teuthology.orchestra.run.smithi001.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:24:39.865 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:24:39.865 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:24:39.865 INFO:teuthology.orchestra.run.smithi001.stdout: "grade_table": [], 2024-09-17T02:24:39.866 INFO:teuthology.orchestra.run.smithi001.stdout: "stripe_width": 0, 2024-09-17T02:24:39.866 INFO:teuthology.orchestra.run.smithi001.stdout: "expected_num_objects": 0, 2024-09-17T02:24:39.866 INFO:teuthology.orchestra.run.smithi001.stdout: "fast_read": false, 2024-09-17T02:24:39.866 INFO:teuthology.orchestra.run.smithi001.stdout: "options": {}, 2024-09-17T02:24:39.866 INFO:teuthology.orchestra.run.smithi001.stdout: "application_metadata": { 2024-09-17T02:24:39.866 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd": {} 2024-09-17T02:24:39.866 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.866 INFO:teuthology.orchestra.run.smithi001.stdout: "read_balance": { 2024-09-17T02:24:39.866 INFO:teuthology.orchestra.run.smithi001.stdout: "score_type": "Fair distribution", 2024-09-17T02:24:39.866 INFO:teuthology.orchestra.run.smithi001.stdout: "score_acting": 1.5, 2024-09-17T02:24:39.866 INFO:teuthology.orchestra.run.smithi001.stdout: "score_stable": 1.5, 2024-09-17T02:24:39.866 INFO:teuthology.orchestra.run.smithi001.stdout: "optimal_score": 1, 2024-09-17T02:24:39.866 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_acting": 1.5, 2024-09-17T02:24:39.867 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_stable": 1.5, 2024-09-17T02:24:39.867 INFO:teuthology.orchestra.run.smithi001.stdout: "primary_affinity_weighted": 0.79247540235519409, 2024-09-17T02:24:39.867 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity": 0.79000002145767212, 2024-09-17T02:24:39.867 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity_weighted": 0.79000002145767212 2024-09-17T02:24:39.867 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:24:39.867 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.867 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.867 INFO:teuthology.orchestra.run.smithi001.stdout: "pool": 3, 2024-09-17T02:24:39.867 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": "cephfs_metadata", 2024-09-17T02:24:39.867 INFO:teuthology.orchestra.run.smithi001.stdout: "create_time": "2024-09-17T02:20:13.566396+0000", 2024-09-17T02:24:39.867 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-17T02:24:39.867 INFO:teuthology.orchestra.run.smithi001.stdout: "flags_names": "hashpspool", 2024-09-17T02:24:39.867 INFO:teuthology.orchestra.run.smithi001.stdout: "type": 1, 2024-09-17T02:24:39.867 INFO:teuthology.orchestra.run.smithi001.stdout: "size": 2, 2024-09-17T02:24:39.868 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": 1, 2024-09-17T02:24:39.868 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_rule": 0, 2024-09-17T02:24:39.868 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:24:39.868 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:24:39.868 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:24:39.868 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:24:39.868 INFO:teuthology.orchestra.run.smithi001.stdout: "is_stretch_pool": false, 2024-09-17T02:24:39.868 INFO:teuthology.orchestra.run.smithi001.stdout: "object_hash": 2, 2024-09-17T02:24:39.868 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:24:39.868 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": 32, 2024-09-17T02:24:39.868 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num": 32, 2024-09-17T02:24:39.868 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num_target": 32, 2024-09-17T02:24:39.868 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_target": 32, 2024-09-17T02:24:39.868 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_pending": 32, 2024-09-17T02:24:39.869 INFO:teuthology.orchestra.run.smithi001.stdout: "last_pg_merge_meta": { 2024-09-17T02:24:39.869 INFO:teuthology.orchestra.run.smithi001.stdout: "source_pgid": "0.0", 2024-09-17T02:24:39.869 INFO:teuthology.orchestra.run.smithi001.stdout: "ready_epoch": 0, 2024-09-17T02:24:39.869 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_started": 0, 2024-09-17T02:24:39.869 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_clean": 0, 2024-09-17T02:24:39.869 INFO:teuthology.orchestra.run.smithi001.stdout: "source_version": "0'0", 2024-09-17T02:24:39.869 INFO:teuthology.orchestra.run.smithi001.stdout: "target_version": "0'0" 2024-09-17T02:24:39.869 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.869 INFO:teuthology.orchestra.run.smithi001.stdout: "last_change": "19", 2024-09-17T02:24:39.869 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend": "0", 2024-09-17T02:24:39.869 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:24:39.869 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:24:39.870 INFO:teuthology.orchestra.run.smithi001.stdout: "auid": 0, 2024-09-17T02:24:39.870 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:24:39.870 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_seq": 0, 2024-09-17T02:24:39.870 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_epoch": 0, 2024-09-17T02:24:39.870 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_snaps": [], 2024-09-17T02:24:39.870 INFO:teuthology.orchestra.run.smithi001.stdout: "removed_snaps": "[]", 2024-09-17T02:24:39.870 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_bytes": 0, 2024-09-17T02:24:39.870 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_objects": 0, 2024-09-17T02:24:39.870 INFO:teuthology.orchestra.run.smithi001.stdout: "tiers": [], 2024-09-17T02:24:39.870 INFO:teuthology.orchestra.run.smithi001.stdout: "tier_of": -1, 2024-09-17T02:24:39.870 INFO:teuthology.orchestra.run.smithi001.stdout: "read_tier": -1, 2024-09-17T02:24:39.870 INFO:teuthology.orchestra.run.smithi001.stdout: "write_tier": -1, 2024-09-17T02:24:39.870 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_mode": "none", 2024-09-17T02:24:39.871 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_bytes": 0, 2024-09-17T02:24:39.871 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_objects": 0, 2024-09-17T02:24:39.871 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:24:39.871 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:24:39.871 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:24:39.871 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_flush_age": 0, 2024-09-17T02:24:39.871 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_evict_age": 0, 2024-09-17T02:24:39.871 INFO:teuthology.orchestra.run.smithi001.stdout: "erasure_code_profile": "", 2024-09-17T02:24:39.871 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_params": { 2024-09-17T02:24:39.871 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "none" 2024-09-17T02:24:39.871 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.871 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_period": 0, 2024-09-17T02:24:39.872 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_count": 0, 2024-09-17T02:24:39.872 INFO:teuthology.orchestra.run.smithi001.stdout: "use_gmt_hitset": true, 2024-09-17T02:24:39.872 INFO:teuthology.orchestra.run.smithi001.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:24:39.872 INFO:teuthology.orchestra.run.smithi001.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:24:39.872 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:24:39.872 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:24:39.872 INFO:teuthology.orchestra.run.smithi001.stdout: "grade_table": [], 2024-09-17T02:24:39.872 INFO:teuthology.orchestra.run.smithi001.stdout: "stripe_width": 0, 2024-09-17T02:24:39.872 INFO:teuthology.orchestra.run.smithi001.stdout: "expected_num_objects": 0, 2024-09-17T02:24:39.872 INFO:teuthology.orchestra.run.smithi001.stdout: "fast_read": false, 2024-09-17T02:24:39.872 INFO:teuthology.orchestra.run.smithi001.stdout: "options": { 2024-09-17T02:24:39.872 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscale_bias": 4, 2024-09-17T02:24:39.872 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_min": 16, 2024-09-17T02:24:39.873 INFO:teuthology.orchestra.run.smithi001.stdout: "recovery_priority": 5 2024-09-17T02:24:39.873 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.873 INFO:teuthology.orchestra.run.smithi001.stdout: "application_metadata": { 2024-09-17T02:24:39.873 INFO:teuthology.orchestra.run.smithi001.stdout: "cephfs": { 2024-09-17T02:24:39.873 INFO:teuthology.orchestra.run.smithi001.stdout: "metadata": "cephfs" 2024-09-17T02:24:39.873 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:24:39.873 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.873 INFO:teuthology.orchestra.run.smithi001.stdout: "read_balance": { 2024-09-17T02:24:39.873 INFO:teuthology.orchestra.run.smithi001.stdout: "score_type": "Fair distribution", 2024-09-17T02:24:39.873 INFO:teuthology.orchestra.run.smithi001.stdout: "score_acting": 1.4099999666213989, 2024-09-17T02:24:39.873 INFO:teuthology.orchestra.run.smithi001.stdout: "score_stable": 1.4099999666213989, 2024-09-17T02:24:39.873 INFO:teuthology.orchestra.run.smithi001.stdout: "optimal_score": 1, 2024-09-17T02:24:39.873 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_acting": 1.4099999666213989, 2024-09-17T02:24:39.874 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_stable": 1.4099999666213989, 2024-09-17T02:24:39.874 INFO:teuthology.orchestra.run.smithi001.stdout: "primary_affinity_weighted": 0.79247540235519409, 2024-09-17T02:24:39.874 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity": 0.79000002145767212, 2024-09-17T02:24:39.874 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity_weighted": 0.79000002145767212 2024-09-17T02:24:39.874 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:24:39.874 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.874 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.874 INFO:teuthology.orchestra.run.smithi001.stdout: "pool": 4, 2024-09-17T02:24:39.874 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": "cephfs_data", 2024-09-17T02:24:39.874 INFO:teuthology.orchestra.run.smithi001.stdout: "create_time": "2024-09-17T02:20:14.902662+0000", 2024-09-17T02:24:39.874 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-17T02:24:39.874 INFO:teuthology.orchestra.run.smithi001.stdout: "flags_names": "hashpspool", 2024-09-17T02:24:39.874 INFO:teuthology.orchestra.run.smithi001.stdout: "type": 1, 2024-09-17T02:24:39.875 INFO:teuthology.orchestra.run.smithi001.stdout: "size": 2, 2024-09-17T02:24:39.875 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": 1, 2024-09-17T02:24:39.875 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_rule": 0, 2024-09-17T02:24:39.875 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:24:39.875 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:24:39.875 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:24:39.875 INFO:teuthology.orchestra.run.smithi001.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:24:39.875 INFO:teuthology.orchestra.run.smithi001.stdout: "is_stretch_pool": false, 2024-09-17T02:24:39.875 INFO:teuthology.orchestra.run.smithi001.stdout: "object_hash": 2, 2024-09-17T02:24:39.875 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:24:39.875 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": 64, 2024-09-17T02:24:39.875 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num": 64, 2024-09-17T02:24:39.875 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_placement_num_target": 64, 2024-09-17T02:24:39.875 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_target": 64, 2024-09-17T02:24:39.876 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_pending": 64, 2024-09-17T02:24:39.876 INFO:teuthology.orchestra.run.smithi001.stdout: "last_pg_merge_meta": { 2024-09-17T02:24:39.876 INFO:teuthology.orchestra.run.smithi001.stdout: "source_pgid": "0.0", 2024-09-17T02:24:39.876 INFO:teuthology.orchestra.run.smithi001.stdout: "ready_epoch": 0, 2024-09-17T02:24:39.876 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_started": 0, 2024-09-17T02:24:39.876 INFO:teuthology.orchestra.run.smithi001.stdout: "last_epoch_clean": 0, 2024-09-17T02:24:39.876 INFO:teuthology.orchestra.run.smithi001.stdout: "source_version": "0'0", 2024-09-17T02:24:39.876 INFO:teuthology.orchestra.run.smithi001.stdout: "target_version": "0'0" 2024-09-17T02:24:39.876 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.876 INFO:teuthology.orchestra.run.smithi001.stdout: "last_change": "20", 2024-09-17T02:24:39.876 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend": "0", 2024-09-17T02:24:39.876 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:24:39.876 INFO:teuthology.orchestra.run.smithi001.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:24:39.877 INFO:teuthology.orchestra.run.smithi001.stdout: "auid": 0, 2024-09-17T02:24:39.877 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:24:39.877 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_seq": 0, 2024-09-17T02:24:39.877 INFO:teuthology.orchestra.run.smithi001.stdout: "snap_epoch": 0, 2024-09-17T02:24:39.877 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_snaps": [], 2024-09-17T02:24:39.877 INFO:teuthology.orchestra.run.smithi001.stdout: "removed_snaps": "[]", 2024-09-17T02:24:39.877 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_bytes": 0, 2024-09-17T02:24:39.877 INFO:teuthology.orchestra.run.smithi001.stdout: "quota_max_objects": 0, 2024-09-17T02:24:39.877 INFO:teuthology.orchestra.run.smithi001.stdout: "tiers": [], 2024-09-17T02:24:39.877 INFO:teuthology.orchestra.run.smithi001.stdout: "tier_of": -1, 2024-09-17T02:24:39.877 INFO:teuthology.orchestra.run.smithi001.stdout: "read_tier": -1, 2024-09-17T02:24:39.877 INFO:teuthology.orchestra.run.smithi001.stdout: "write_tier": -1, 2024-09-17T02:24:39.877 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_mode": "none", 2024-09-17T02:24:39.878 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_bytes": 0, 2024-09-17T02:24:39.878 INFO:teuthology.orchestra.run.smithi001.stdout: "target_max_objects": 0, 2024-09-17T02:24:39.878 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:24:39.878 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:24:39.878 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:24:39.878 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_flush_age": 0, 2024-09-17T02:24:39.878 INFO:teuthology.orchestra.run.smithi001.stdout: "cache_min_evict_age": 0, 2024-09-17T02:24:39.878 INFO:teuthology.orchestra.run.smithi001.stdout: "erasure_code_profile": "", 2024-09-17T02:24:39.878 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_params": { 2024-09-17T02:24:39.878 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "none" 2024-09-17T02:24:39.878 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.878 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_period": 0, 2024-09-17T02:24:39.878 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_count": 0, 2024-09-17T02:24:39.879 INFO:teuthology.orchestra.run.smithi001.stdout: "use_gmt_hitset": true, 2024-09-17T02:24:39.879 INFO:teuthology.orchestra.run.smithi001.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:24:39.879 INFO:teuthology.orchestra.run.smithi001.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:24:39.879 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:24:39.879 INFO:teuthology.orchestra.run.smithi001.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:24:39.879 INFO:teuthology.orchestra.run.smithi001.stdout: "grade_table": [], 2024-09-17T02:24:39.879 INFO:teuthology.orchestra.run.smithi001.stdout: "stripe_width": 0, 2024-09-17T02:24:39.879 INFO:teuthology.orchestra.run.smithi001.stdout: "expected_num_objects": 0, 2024-09-17T02:24:39.879 INFO:teuthology.orchestra.run.smithi001.stdout: "fast_read": false, 2024-09-17T02:24:39.879 INFO:teuthology.orchestra.run.smithi001.stdout: "options": { 2024-09-17T02:24:39.879 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num_min": 64, 2024-09-17T02:24:39.879 INFO:teuthology.orchestra.run.smithi001.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T02:24:39.880 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.880 INFO:teuthology.orchestra.run.smithi001.stdout: "application_metadata": { 2024-09-17T02:24:39.880 INFO:teuthology.orchestra.run.smithi001.stdout: "cephfs": { 2024-09-17T02:24:39.880 INFO:teuthology.orchestra.run.smithi001.stdout: "data": "cephfs" 2024-09-17T02:24:39.880 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:24:39.880 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.880 INFO:teuthology.orchestra.run.smithi001.stdout: "read_balance": { 2024-09-17T02:24:39.880 INFO:teuthology.orchestra.run.smithi001.stdout: "score_type": "Fair distribution", 2024-09-17T02:24:39.880 INFO:teuthology.orchestra.run.smithi001.stdout: "score_acting": 1.2200000286102295, 2024-09-17T02:24:39.880 INFO:teuthology.orchestra.run.smithi001.stdout: "score_stable": 1.2200000286102295, 2024-09-17T02:24:39.880 INFO:teuthology.orchestra.run.smithi001.stdout: "optimal_score": 1, 2024-09-17T02:24:39.880 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_acting": 1.2200000286102295, 2024-09-17T02:24:39.880 INFO:teuthology.orchestra.run.smithi001.stdout: "raw_score_stable": 1.2200000286102295, 2024-09-17T02:24:39.881 INFO:teuthology.orchestra.run.smithi001.stdout: "primary_affinity_weighted": 0.79247540235519409, 2024-09-17T02:24:39.881 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity": 0.79000002145767212, 2024-09-17T02:24:39.881 INFO:teuthology.orchestra.run.smithi001.stdout: "average_primary_affinity_weighted": 0.79000002145767212 2024-09-17T02:24:39.881 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:24:39.881 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:24:39.881 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-17T02:24:39.881 INFO:teuthology.orchestra.run.smithi001.stdout: "osds": [ 2024-09-17T02:24:39.881 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.881 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 0, 2024-09-17T02:24:39.881 INFO:teuthology.orchestra.run.smithi001.stdout: "uuid": "fae746a8-754d-4e52-9819-004ebb0d6886", 2024-09-17T02:24:39.881 INFO:teuthology.orchestra.run.smithi001.stdout: "up": 1, 2024-09-17T02:24:39.881 INFO:teuthology.orchestra.run.smithi001.stdout: "in": 1, 2024-09-17T02:24:39.881 INFO:teuthology.orchestra.run.smithi001.stdout: "weight": 1, 2024-09-17T02:24:39.881 INFO:teuthology.orchestra.run.smithi001.stdout: "primary_affinity": 0.3774261474609375, 2024-09-17T02:24:39.882 INFO:teuthology.orchestra.run.smithi001.stdout: "last_clean_begin": 0, 2024-09-17T02:24:39.882 INFO:teuthology.orchestra.run.smithi001.stdout: "last_clean_end": 0, 2024-09-17T02:24:39.882 INFO:teuthology.orchestra.run.smithi001.stdout: "up_from": 9, 2024-09-17T02:24:39.882 INFO:teuthology.orchestra.run.smithi001.stdout: "up_thru": 83, 2024-09-17T02:24:39.882 INFO:teuthology.orchestra.run.smithi001.stdout: "down_at": 0, 2024-09-17T02:24:39.882 INFO:teuthology.orchestra.run.smithi001.stdout: "lost_at": 0, 2024-09-17T02:24:39.882 INFO:teuthology.orchestra.run.smithi001.stdout: "public_addrs": { 2024-09-17T02:24:39.882 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:24:39.882 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.882 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:24:39.882 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.32:6800", 2024-09-17T02:24:39.882 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2347677104 2024-09-17T02:24:39.882 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.883 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.883 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:24:39.883 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.32:6801", 2024-09-17T02:24:39.883 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2347677104 2024-09-17T02:24:39.883 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:24:39.883 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:24:39.883 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.883 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_addrs": { 2024-09-17T02:24:39.883 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:24:39.883 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.883 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:24:39.883 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.32:6802", 2024-09-17T02:24:39.883 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2347677104 2024-09-17T02:24:39.883 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.884 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.884 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:24:39.884 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.32:6803", 2024-09-17T02:24:39.884 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2347677104 2024-09-17T02:24:39.884 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:24:39.884 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:24:39.884 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.884 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_back_addrs": { 2024-09-17T02:24:39.884 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:24:39.884 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.884 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:24:39.884 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.32:6806", 2024-09-17T02:24:39.885 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2347677104 2024-09-17T02:24:39.885 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.885 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.885 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:24:39.885 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.32:6807", 2024-09-17T02:24:39.885 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2347677104 2024-09-17T02:24:39.885 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:24:39.885 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:24:39.885 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.885 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_front_addrs": { 2024-09-17T02:24:39.885 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:24:39.886 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.886 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:24:39.886 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.32:6804", 2024-09-17T02:24:39.886 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2347677104 2024-09-17T02:24:39.886 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.886 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.886 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:24:39.886 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.32:6805", 2024-09-17T02:24:39.886 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2347677104 2024-09-17T02:24:39.886 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:24:39.886 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:24:39.886 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.886 INFO:teuthology.orchestra.run.smithi001.stdout: "public_addr": "172.21.15.32:6801/2347677104", 2024-09-17T02:24:39.886 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_addr": "172.21.15.32:6803/2347677104", 2024-09-17T02:24:39.887 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_back_addr": "172.21.15.32:6807/2347677104", 2024-09-17T02:24:39.887 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_front_addr": "172.21.15.32:6805/2347677104", 2024-09-17T02:24:39.887 INFO:teuthology.orchestra.run.smithi001.stdout: "state": [ 2024-09-17T02:24:39.887 INFO:teuthology.orchestra.run.smithi001.stdout: "exists", 2024-09-17T02:24:39.887 INFO:teuthology.orchestra.run.smithi001.stdout: "up" 2024-09-17T02:24:39.887 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:24:39.887 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.887 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.887 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 1, 2024-09-17T02:24:39.887 INFO:teuthology.orchestra.run.smithi001.stdout: "uuid": "c9397688-80ca-4c21-b80d-1740194c389d", 2024-09-17T02:24:39.887 INFO:teuthology.orchestra.run.smithi001.stdout: "up": 1, 2024-09-17T02:24:39.887 INFO:teuthology.orchestra.run.smithi001.stdout: "in": 1, 2024-09-17T02:24:39.887 INFO:teuthology.orchestra.run.smithi001.stdout: "weight": 1, 2024-09-17T02:24:39.888 INFO:teuthology.orchestra.run.smithi001.stdout: "primary_affinity": 1, 2024-09-17T02:24:39.888 INFO:teuthology.orchestra.run.smithi001.stdout: "last_clean_begin": 0, 2024-09-17T02:24:39.888 INFO:teuthology.orchestra.run.smithi001.stdout: "last_clean_end": 0, 2024-09-17T02:24:39.888 INFO:teuthology.orchestra.run.smithi001.stdout: "up_from": 8, 2024-09-17T02:24:39.888 INFO:teuthology.orchestra.run.smithi001.stdout: "up_thru": 83, 2024-09-17T02:24:39.888 INFO:teuthology.orchestra.run.smithi001.stdout: "down_at": 0, 2024-09-17T02:24:39.888 INFO:teuthology.orchestra.run.smithi001.stdout: "lost_at": 0, 2024-09-17T02:24:39.888 INFO:teuthology.orchestra.run.smithi001.stdout: "public_addrs": { 2024-09-17T02:24:39.888 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:24:39.888 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.888 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:24:39.888 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.153:6800", 2024-09-17T02:24:39.888 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1905904204 2024-09-17T02:24:39.889 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.889 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.889 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:24:39.889 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.153:6801", 2024-09-17T02:24:39.889 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1905904204 2024-09-17T02:24:39.889 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:24:39.889 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:24:39.889 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.889 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_addrs": { 2024-09-17T02:24:39.889 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:24:39.889 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.889 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:24:39.889 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.153:6802", 2024-09-17T02:24:39.890 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1905904204 2024-09-17T02:24:39.890 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.890 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.890 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:24:39.890 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.153:6803", 2024-09-17T02:24:39.890 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1905904204 2024-09-17T02:24:39.890 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:24:39.890 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:24:39.890 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.890 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_back_addrs": { 2024-09-17T02:24:39.890 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:24:39.890 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.890 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:24:39.890 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.153:6806", 2024-09-17T02:24:39.891 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1905904204 2024-09-17T02:24:39.891 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.891 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.891 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:24:39.891 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.153:6807", 2024-09-17T02:24:39.891 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1905904204 2024-09-17T02:24:39.891 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:24:39.891 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:24:39.891 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.891 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_front_addrs": { 2024-09-17T02:24:39.891 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:24:39.891 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.891 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:24:39.892 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.153:6804", 2024-09-17T02:24:39.892 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1905904204 2024-09-17T02:24:39.892 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.892 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.892 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:24:39.892 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.153:6805", 2024-09-17T02:24:39.892 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1905904204 2024-09-17T02:24:39.892 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:24:39.892 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:24:39.892 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.892 INFO:teuthology.orchestra.run.smithi001.stdout: "public_addr": "172.21.15.153:6801/1905904204", 2024-09-17T02:24:39.892 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_addr": "172.21.15.153:6803/1905904204", 2024-09-17T02:24:39.892 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_back_addr": "172.21.15.153:6807/1905904204", 2024-09-17T02:24:39.892 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_front_addr": "172.21.15.153:6805/1905904204", 2024-09-17T02:24:39.893 INFO:teuthology.orchestra.run.smithi001.stdout: "state": [ 2024-09-17T02:24:39.893 INFO:teuthology.orchestra.run.smithi001.stdout: "exists", 2024-09-17T02:24:39.893 INFO:teuthology.orchestra.run.smithi001.stdout: "up" 2024-09-17T02:24:39.893 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:24:39.893 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.893 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.893 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 2, 2024-09-17T02:24:39.893 INFO:teuthology.orchestra.run.smithi001.stdout: "uuid": "6d8c01a8-b657-4abc-a624-2b35ef0512ea", 2024-09-17T02:24:39.893 INFO:teuthology.orchestra.run.smithi001.stdout: "up": 1, 2024-09-17T02:24:39.893 INFO:teuthology.orchestra.run.smithi001.stdout: "in": 1, 2024-09-17T02:24:39.893 INFO:teuthology.orchestra.run.smithi001.stdout: "weight": 1, 2024-09-17T02:24:39.893 INFO:teuthology.orchestra.run.smithi001.stdout: "primary_affinity": 1, 2024-09-17T02:24:39.893 INFO:teuthology.orchestra.run.smithi001.stdout: "last_clean_begin": 8, 2024-09-17T02:24:39.894 INFO:teuthology.orchestra.run.smithi001.stdout: "last_clean_end": 50, 2024-09-17T02:24:39.894 INFO:teuthology.orchestra.run.smithi001.stdout: "up_from": 80, 2024-09-17T02:24:39.894 INFO:teuthology.orchestra.run.smithi001.stdout: "up_thru": 83, 2024-09-17T02:24:39.894 INFO:teuthology.orchestra.run.smithi001.stdout: "down_at": 51, 2024-09-17T02:24:39.894 INFO:teuthology.orchestra.run.smithi001.stdout: "lost_at": 0, 2024-09-17T02:24:39.894 INFO:teuthology.orchestra.run.smithi001.stdout: "public_addrs": { 2024-09-17T02:24:39.894 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:24:39.894 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.894 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:24:39.894 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.164:6800", 2024-09-17T02:24:39.894 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2045876213 2024-09-17T02:24:39.894 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.894 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.894 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:24:39.895 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.164:6801", 2024-09-17T02:24:39.895 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2045876213 2024-09-17T02:24:39.895 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:24:39.895 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:24:39.895 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.895 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_addrs": { 2024-09-17T02:24:39.895 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:24:39.895 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.895 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:24:39.895 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.164:6802", 2024-09-17T02:24:39.895 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2045876213 2024-09-17T02:24:39.895 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.895 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.896 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:24:39.896 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.164:6803", 2024-09-17T02:24:39.896 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2045876213 2024-09-17T02:24:39.896 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:24:39.896 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:24:39.896 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.896 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_back_addrs": { 2024-09-17T02:24:39.896 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:24:39.896 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.896 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:24:39.896 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.164:6806", 2024-09-17T02:24:39.896 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2045876213 2024-09-17T02:24:39.896 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.896 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.897 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:24:39.897 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.164:6807", 2024-09-17T02:24:39.897 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2045876213 2024-09-17T02:24:39.897 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:24:39.897 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:24:39.897 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.897 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_front_addrs": { 2024-09-17T02:24:39.897 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-17T02:24:39.897 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.897 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-17T02:24:39.897 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.164:6804", 2024-09-17T02:24:39.897 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2045876213 2024-09-17T02:24:39.897 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.898 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.898 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-17T02:24:39.898 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.164:6805", 2024-09-17T02:24:39.898 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2045876213 2024-09-17T02:24:39.898 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:24:39.898 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:24:39.898 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.898 INFO:teuthology.orchestra.run.smithi001.stdout: "public_addr": "172.21.15.164:6801/2045876213", 2024-09-17T02:24:39.898 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_addr": "172.21.15.164:6803/2045876213", 2024-09-17T02:24:39.898 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2045876213", 2024-09-17T02:24:39.898 INFO:teuthology.orchestra.run.smithi001.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2045876213", 2024-09-17T02:24:39.898 INFO:teuthology.orchestra.run.smithi001.stdout: "state": [ 2024-09-17T02:24:39.898 INFO:teuthology.orchestra.run.smithi001.stdout: "exists", 2024-09-17T02:24:39.898 INFO:teuthology.orchestra.run.smithi001.stdout: "up" 2024-09-17T02:24:39.899 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:24:39.899 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:24:39.899 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-17T02:24:39.899 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_xinfo": [ 2024-09-17T02:24:39.899 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.899 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 0, 2024-09-17T02:24:39.899 INFO:teuthology.orchestra.run.smithi001.stdout: "down_stamp": "0.000000", 2024-09-17T02:24:39.899 INFO:teuthology.orchestra.run.smithi001.stdout: "laggy_probability": 0, 2024-09-17T02:24:39.899 INFO:teuthology.orchestra.run.smithi001.stdout: "laggy_interval": 0, 2024-09-17T02:24:39.899 INFO:teuthology.orchestra.run.smithi001.stdout: "features": 4540701547738038271, 2024-09-17T02:24:39.899 INFO:teuthology.orchestra.run.smithi001.stdout: "old_weight": 0, 2024-09-17T02:24:39.899 INFO:teuthology.orchestra.run.smithi001.stdout: "last_purged_snaps_scrub": "2024-09-17T02:20:00.476482+0000", 2024-09-17T02:24:39.899 INFO:teuthology.orchestra.run.smithi001.stdout: "dead_epoch": 0 2024-09-17T02:24:39.900 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.900 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.900 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 1, 2024-09-17T02:24:39.900 INFO:teuthology.orchestra.run.smithi001.stdout: "down_stamp": "0.000000", 2024-09-17T02:24:39.900 INFO:teuthology.orchestra.run.smithi001.stdout: "laggy_probability": 0, 2024-09-17T02:24:39.900 INFO:teuthology.orchestra.run.smithi001.stdout: "laggy_interval": 0, 2024-09-17T02:24:39.900 INFO:teuthology.orchestra.run.smithi001.stdout: "features": 4540701547738038271, 2024-09-17T02:24:39.900 INFO:teuthology.orchestra.run.smithi001.stdout: "old_weight": 0, 2024-09-17T02:24:39.900 INFO:teuthology.orchestra.run.smithi001.stdout: "last_purged_snaps_scrub": "2024-09-17T02:20:00.250903+0000", 2024-09-17T02:24:39.900 INFO:teuthology.orchestra.run.smithi001.stdout: "dead_epoch": 0 2024-09-17T02:24:39.900 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.900 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.900 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": 2, 2024-09-17T02:24:39.901 INFO:teuthology.orchestra.run.smithi001.stdout: "down_stamp": "0.000000", 2024-09-17T02:24:39.901 INFO:teuthology.orchestra.run.smithi001.stdout: "laggy_probability": 0, 2024-09-17T02:24:39.901 INFO:teuthology.orchestra.run.smithi001.stdout: "laggy_interval": 0, 2024-09-17T02:24:39.901 INFO:teuthology.orchestra.run.smithi001.stdout: "features": 4540701547738038271, 2024-09-17T02:24:39.901 INFO:teuthology.orchestra.run.smithi001.stdout: "old_weight": 0, 2024-09-17T02:24:39.901 INFO:teuthology.orchestra.run.smithi001.stdout: "last_purged_snaps_scrub": "2024-09-17T02:20:00.326430+0000", 2024-09-17T02:24:39.901 INFO:teuthology.orchestra.run.smithi001.stdout: "dead_epoch": 50 2024-09-17T02:24:39.901 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:24:39.901 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-17T02:24:39.901 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_upmap": [ 2024-09-17T02:24:39.901 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-17T02:24:39.901 INFO:teuthology.orchestra.run.smithi001.stdout: "pgid": "4.1d", 2024-09-17T02:24:39.901 INFO:teuthology.orchestra.run.smithi001.stdout: "osds": [ 2024-09-17T02:24:39.902 INFO:teuthology.orchestra.run.smithi001.stdout: 0, 2024-09-17T02:24:39.902 INFO:teuthology.orchestra.run.smithi001.stdout: 1 2024-09-17T02:24:39.902 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-17T02:24:39.902 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:24:39.902 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-17T02:24:39.902 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_upmap_items": [], 2024-09-17T02:24:39.902 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_upmap_primaries": [], 2024-09-17T02:24:39.902 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_temp": [], 2024-09-17T02:24:39.902 INFO:teuthology.orchestra.run.smithi001.stdout: "primary_temp": [], 2024-09-17T02:24:39.902 INFO:teuthology.orchestra.run.smithi001.stdout: "blocklist": {}, 2024-09-17T02:24:39.902 INFO:teuthology.orchestra.run.smithi001.stdout: "range_blocklist": {}, 2024-09-17T02:24:39.902 INFO:teuthology.orchestra.run.smithi001.stdout: "erasure_code_profiles": { 2024-09-17T02:24:39.902 INFO:teuthology.orchestra.run.smithi001.stdout: "default": { 2024-09-17T02:24:39.903 INFO:teuthology.orchestra.run.smithi001.stdout: "crush-failure-domain": "osd", 2024-09-17T02:24:39.903 INFO:teuthology.orchestra.run.smithi001.stdout: "k": "2", 2024-09-17T02:24:39.903 INFO:teuthology.orchestra.run.smithi001.stdout: "m": "1", 2024-09-17T02:24:39.903 INFO:teuthology.orchestra.run.smithi001.stdout: "plugin": "jerasure", 2024-09-17T02:24:39.903 INFO:teuthology.orchestra.run.smithi001.stdout: "technique": "reed_sol_van" 2024-09-17T02:24:39.903 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:24:39.903 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-17T02:24:39.903 INFO:teuthology.orchestra.run.smithi001.stdout: "removed_snaps_queue": [], 2024-09-17T02:24:39.903 INFO:teuthology.orchestra.run.smithi001.stdout: "new_removed_snaps": [], 2024-09-17T02:24:39.903 INFO:teuthology.orchestra.run.smithi001.stdout: "new_purged_snaps": [], 2024-09-17T02:24:39.903 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_node_flags": {}, 2024-09-17T02:24:39.903 INFO:teuthology.orchestra.run.smithi001.stdout: "device_class_flags": {}, 2024-09-17T02:24:39.903 INFO:teuthology.orchestra.run.smithi001.stdout: "stretch_mode": { 2024-09-17T02:24:39.903 INFO:teuthology.orchestra.run.smithi001.stdout: "stretch_mode_enabled": false, 2024-09-17T02:24:39.904 INFO:teuthology.orchestra.run.smithi001.stdout: "stretch_bucket_count": 0, 2024-09-17T02:24:39.904 INFO:teuthology.orchestra.run.smithi001.stdout: "degraded_stretch_mode": 0, 2024-09-17T02:24:39.904 INFO:teuthology.orchestra.run.smithi001.stdout: "recovering_stretch_mode": 0, 2024-09-17T02:24:39.904 INFO:teuthology.orchestra.run.smithi001.stdout: "stretch_mode_bucket": 0 2024-09-17T02:24:39.904 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-17T02:24:39.904 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-17T02:24:39.908 INFO:tasks.thrashosds.thrasher:j is {'epoch': 84, 'fsid': '37cd4495-4915-41f4-bad2-2394cbe235f3', 'created': '2024-09-17T02:19:52.516342+0000', 'modified': '2024-09-17T02:24:34.707768+0000', 'last_up_change': '2024-09-17T02:24:29.673066+0000', 'last_in_change': '2024-09-17T02:19:54.329423+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T02:20:03.416336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.7924754023551941, 'average_primary_affinity': 0.7900000214576721, 'average_primary_affinity_weighted': 0.7900000214576721}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-17T02:20:08.718296+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 16, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.7924754023551941, 'average_primary_affinity': 0.7900000214576721, 'average_primary_affinity_weighted': 0.7900000214576721}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-17T02:20:13.566396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.409999966621399, 'score_stable': 1.409999966621399, 'optimal_score': 1, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 0.7924754023551941, 'average_primary_affinity': 0.7900000214576721, 'average_primary_affinity_weighted': 0.7900000214576721}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-17T02:20:14.902662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.2200000286102295, 'score_stable': 1.2200000286102295, 'optimal_score': 1, 'raw_score_acting': 1.2200000286102295, 'raw_score_stable': 1.2200000286102295, 'primary_affinity_weighted': 0.7924754023551941, 'average_primary_affinity': 0.7900000214576721, 'average_primary_affinity_weighted': 0.7900000214576721}}], 'osds': [{'osd': 0, 'uuid': 'fae746a8-754d-4e52-9819-004ebb0d6886', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.3774261474609375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 83, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6800', 'nonce': 2347677104}, {'type': 'v1', 'addr': '172.21.15.32:6801', 'nonce': 2347677104}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6802', 'nonce': 2347677104}, {'type': 'v1', 'addr': '172.21.15.32:6803', 'nonce': 2347677104}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6806', 'nonce': 2347677104}, {'type': 'v1', 'addr': '172.21.15.32:6807', 'nonce': 2347677104}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6804', 'nonce': 2347677104}, {'type': 'v1', 'addr': '172.21.15.32:6805', 'nonce': 2347677104}]}, 'public_addr': '172.21.15.32:6801/2347677104', 'cluster_addr': '172.21.15.32:6803/2347677104', 'heartbeat_back_addr': '172.21.15.32:6807/2347677104', 'heartbeat_front_addr': '172.21.15.32:6805/2347677104', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'c9397688-80ca-4c21-b80d-1740194c389d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 83, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6800', 'nonce': 1905904204}, {'type': 'v1', 'addr': '172.21.15.153:6801', 'nonce': 1905904204}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6802', 'nonce': 1905904204}, {'type': 'v1', 'addr': '172.21.15.153:6803', 'nonce': 1905904204}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6806', 'nonce': 1905904204}, {'type': 'v1', 'addr': '172.21.15.153:6807', 'nonce': 1905904204}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6804', 'nonce': 1905904204}, {'type': 'v1', 'addr': '172.21.15.153:6805', 'nonce': 1905904204}]}, 'public_addr': '172.21.15.153:6801/1905904204', 'cluster_addr': '172.21.15.153:6803/1905904204', 'heartbeat_back_addr': '172.21.15.153:6807/1905904204', 'heartbeat_front_addr': '172.21.15.153:6805/1905904204', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '6d8c01a8-b657-4abc-a624-2b35ef0512ea', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 8, 'last_clean_end': 50, 'up_from': 80, 'up_thru': 83, 'down_at': 51, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6800', 'nonce': 2045876213}, {'type': 'v1', 'addr': '172.21.15.164:6801', 'nonce': 2045876213}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6802', 'nonce': 2045876213}, {'type': 'v1', 'addr': '172.21.15.164:6803', 'nonce': 2045876213}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6806', 'nonce': 2045876213}, {'type': 'v1', 'addr': '172.21.15.164:6807', 'nonce': 2045876213}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6804', 'nonce': 2045876213}, {'type': 'v1', 'addr': '172.21.15.164:6805', 'nonce': 2045876213}]}, 'public_addr': '172.21.15.164:6801/2045876213', 'cluster_addr': '172.21.15.164:6803/2045876213', 'heartbeat_back_addr': '172.21.15.164:6807/2045876213', 'heartbeat_front_addr': '172.21.15.164:6805/2045876213', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T02:20:00.476482+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T02:20:00.250903+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T02:20:00.326430+0000', 'dead_epoch': 50}], 'pg_upmap': [{'pgid': '4.1d', 'osds': [0, 1]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-17T02:24:39.909 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:24:40.219 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:24:40.220 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-17T02:24:40.236 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2024-09-17T02:24:39.467390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":746824,"kb_used_data":2884,"kb_used_omap":10,"kb_used_meta":743861,"kb_avail":282368696,"statfs":{"total":289910292480,"available":289145544704,"internally_reserved":0,"allocated":2953216,"data_stored":2282067,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10343,"internal_metadata":761714585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-21,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.761337"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":159,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.733681+0000","last_change":"2024-09-17T02:24:34.733681+0000","last_active":"2024-09-17T02:24:34.733681+0000","last_peered":"2024-09-17T02:24:34.733681+0000","last_clean":"2024-09-17T02:24:34.733681+0000","last_became_active":"2024-09-17T02:24:34.732728+0000","last_became_peered":"2024-09-17T02:24:34.732728+0000","last_unstale":"2024-09-17T02:24:34.733681+0000","last_undegraded":"2024-09-17T02:24:34.733681+0000","last_fullsized":"2024-09-17T02:24:34.733681+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:21.613592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":126,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.726320+0000","last_change":"2024-09-17T02:20:37.709698+0000","last_active":"2024-09-17T02:24:34.726320+0000","last_peered":"2024-09-17T02:24:34.726320+0000","last_clean":"2024-09-17T02:24:34.726320+0000","last_became_active":"2024-09-17T02:20:37.708951+0000","last_became_peered":"2024-09-17T02:20:37.708951+0000","last_unstale":"2024-09-17T02:24:34.726320+0000","last_undegraded":"2024-09-17T02:24:34.726320+0000","last_fullsized":"2024-09-17T02:24:34.726320+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:30.839358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.346563+0000","last_change":"2024-09-17T02:24:30.339249+0000","last_active":"2024-09-17T02:24:34.346563+0000","last_peered":"2024-09-17T02:24:34.346563+0000","last_clean":"2024-09-17T02:24:34.346563+0000","last_became_active":"2024-09-17T02:24:30.338199+0000","last_became_peered":"2024-09-17T02:24:30.338199+0000","last_unstale":"2024-09-17T02:24:34.346563+0000","last_undegraded":"2024-09-17T02:24:34.346563+0000","last_fullsized":"2024-09-17T02:24:34.346563+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:51.734408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":76,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.360587+0000","last_change":"2024-09-17T02:24:34.360587+0000","last_active":"2024-09-17T02:24:34.360587+0000","last_peered":"2024-09-17T02:24:34.360587+0000","last_clean":"2024-09-17T02:24:34.360587+0000","last_became_active":"2024-09-17T02:24:34.359912+0000","last_became_peered":"2024-09-17T02:24:34.359912+0000","last_unstale":"2024-09-17T02:24:34.360587+0000","last_undegraded":"2024-09-17T02:24:34.360587+0000","last_fullsized":"2024-09-17T02:24:34.360587+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:35.054937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.734103+0000","last_change":"2024-09-17T02:24:34.729589+0000","last_active":"2024-09-17T02:24:34.734103+0000","last_peered":"2024-09-17T02:24:34.734103+0000","last_clean":"2024-09-17T02:24:34.734103+0000","last_became_active":"2024-09-17T02:24:34.726967+0000","last_became_peered":"2024-09-17T02:24:34.726967+0000","last_unstale":"2024-09-17T02:24:34.734103+0000","last_undegraded":"2024-09-17T02:24:34.734103+0000","last_fullsized":"2024-09-17T02:24:34.734103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:24.266960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.345546+0000","last_change":"2024-09-17T02:24:30.322619+0000","last_active":"2024-09-17T02:24:34.345546+0000","last_peered":"2024-09-17T02:24:34.345546+0000","last_clean":"2024-09-17T02:24:34.345546+0000","last_became_active":"2024-09-17T02:24:30.322191+0000","last_became_peered":"2024-09-17T02:24:30.322191+0000","last_unstale":"2024-09-17T02:24:34.345546+0000","last_undegraded":"2024-09-17T02:24:34.345546+0000","last_fullsized":"2024-09-17T02:24:34.345546+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:26.120304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.343480+0000","last_change":"2024-09-17T02:24:30.330077+0000","last_active":"2024-09-17T02:24:34.343480+0000","last_peered":"2024-09-17T02:24:34.343480+0000","last_clean":"2024-09-17T02:24:34.343480+0000","last_became_active":"2024-09-17T02:24:30.329814+0000","last_became_peered":"2024-09-17T02:24:30.329814+0000","last_unstale":"2024-09-17T02:24:34.343480+0000","last_undegraded":"2024-09-17T02:24:34.343480+0000","last_fullsized":"2024-09-17T02:24:34.343480+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:09.933024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.343204+0000","last_change":"2024-09-17T02:24:30.319625+0000","last_active":"2024-09-17T02:24:34.343204+0000","last_peered":"2024-09-17T02:24:34.343204+0000","last_clean":"2024-09-17T02:24:34.343204+0000","last_became_active":"2024-09-17T02:24:30.319316+0000","last_became_peered":"2024-09-17T02:24:30.319316+0000","last_unstale":"2024-09-17T02:24:34.343204+0000","last_undegraded":"2024-09-17T02:24:34.343204+0000","last_fullsized":"2024-09-17T02:24:34.343204+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:30.753462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":141,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.726271+0000","last_change":"2024-09-17T02:20:16.584665+0000","last_active":"2024-09-17T02:24:34.726271+0000","last_peered":"2024-09-17T02:24:34.726271+0000","last_clean":"2024-09-17T02:24:34.726271+0000","last_became_active":"2024-09-17T02:20:16.580797+0000","last_became_peered":"2024-09-17T02:20:16.580797+0000","last_unstale":"2024-09-17T02:24:34.726271+0000","last_undegraded":"2024-09-17T02:24:34.726271+0000","last_fullsized":"2024-09-17T02:24:34.726271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:47.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":158,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.733394+0000","last_change":"2024-09-17T02:24:34.733394+0000","last_active":"2024-09-17T02:24:34.733394+0000","last_peered":"2024-09-17T02:24:34.733394+0000","last_clean":"2024-09-17T02:24:34.733394+0000","last_became_active":"2024-09-17T02:24:34.732480+0000","last_became_peered":"2024-09-17T02:24:34.732480+0000","last_unstale":"2024-09-17T02:24:34.733394+0000","last_undegraded":"2024-09-17T02:24:34.733394+0000","last_fullsized":"2024-09-17T02:24:34.733394+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:37.005990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.346402+0000","last_change":"2024-09-17T02:24:30.329180+0000","last_active":"2024-09-17T02:24:34.346402+0000","last_peered":"2024-09-17T02:24:34.346402+0000","last_clean":"2024-09-17T02:24:34.346402+0000","last_became_active":"2024-09-17T02:24:30.328962+0000","last_became_peered":"2024-09-17T02:24:30.328962+0000","last_unstale":"2024-09-17T02:24:34.346402+0000","last_undegraded":"2024-09-17T02:24:34.346402+0000","last_fullsized":"2024-09-17T02:24:34.346402+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:21.425064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.345246+0000","last_change":"2024-09-17T02:24:30.336021+0000","last_active":"2024-09-17T02:24:34.345246+0000","last_peered":"2024-09-17T02:24:34.345246+0000","last_clean":"2024-09-17T02:24:34.345246+0000","last_became_active":"2024-09-17T02:24:30.335245+0000","last_became_peered":"2024-09-17T02:24:30.335245+0000","last_unstale":"2024-09-17T02:24:34.345246+0000","last_undegraded":"2024-09-17T02:24:34.345246+0000","last_fullsized":"2024-09-17T02:24:34.345246+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:12.509297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":126,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.723346+0000","last_change":"2024-09-17T02:20:37.709476+0000","last_active":"2024-09-17T02:24:34.723346+0000","last_peered":"2024-09-17T02:24:34.723346+0000","last_clean":"2024-09-17T02:24:34.723346+0000","last_became_active":"2024-09-17T02:20:37.708730+0000","last_became_peered":"2024-09-17T02:20:37.708730+0000","last_unstale":"2024-09-17T02:24:34.723346+0000","last_undegraded":"2024-09-17T02:24:34.723346+0000","last_fullsized":"2024-09-17T02:24:34.723346+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:54.725651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.344539+0000","last_change":"2024-09-17T02:24:30.337132+0000","last_active":"2024-09-17T02:24:34.344539+0000","last_peered":"2024-09-17T02:24:34.344539+0000","last_clean":"2024-09-17T02:24:34.344539+0000","last_became_active":"2024-09-17T02:24:30.335871+0000","last_became_peered":"2024-09-17T02:24:30.335871+0000","last_unstale":"2024-09-17T02:24:34.344539+0000","last_undegraded":"2024-09-17T02:24:34.344539+0000","last_fullsized":"2024-09-17T02:24:34.344539+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:21.006777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.343257+0000","last_change":"2024-09-17T02:24:30.335635+0000","last_active":"2024-09-17T02:24:34.343257+0000","last_peered":"2024-09-17T02:24:34.343257+0000","last_clean":"2024-09-17T02:24:34.343257+0000","last_became_active":"2024-09-17T02:24:30.335086+0000","last_became_peered":"2024-09-17T02:24:30.335086+0000","last_unstale":"2024-09-17T02:24:34.343257+0000","last_undegraded":"2024-09-17T02:24:34.343257+0000","last_fullsized":"2024-09-17T02:24:34.343257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:01.913411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.344388+0000","last_change":"2024-09-17T02:24:30.325322+0000","last_active":"2024-09-17T02:24:34.344388+0000","last_peered":"2024-09-17T02:24:34.344388+0000","last_clean":"2024-09-17T02:24:34.344388+0000","last_became_active":"2024-09-17T02:24:30.325002+0000","last_became_peered":"2024-09-17T02:24:30.325002+0000","last_unstale":"2024-09-17T02:24:34.344388+0000","last_undegraded":"2024-09-17T02:24:34.344388+0000","last_fullsized":"2024-09-17T02:24:34.344388+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:16.238014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":141,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.726997+0000","last_change":"2024-09-17T02:20:16.563482+0000","last_active":"2024-09-17T02:24:34.726997+0000","last_peered":"2024-09-17T02:24:34.726997+0000","last_clean":"2024-09-17T02:24:34.726997+0000","last_became_active":"2024-09-17T02:20:16.562735+0000","last_became_peered":"2024-09-17T02:20:16.562735+0000","last_unstale":"2024-09-17T02:24:34.726997+0000","last_undegraded":"2024-09-17T02:24:34.726997+0000","last_fullsized":"2024-09-17T02:24:34.726997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:10.315951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":126,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.729536+0000","last_change":"2024-09-17T02:20:37.706162+0000","last_active":"2024-09-17T02:24:34.729536+0000","last_peered":"2024-09-17T02:24:34.729536+0000","last_clean":"2024-09-17T02:24:34.729536+0000","last_became_active":"2024-09-17T02:20:37.705497+0000","last_became_peered":"2024-09-17T02:20:37.705497+0000","last_unstale":"2024-09-17T02:24:34.729536+0000","last_undegraded":"2024-09-17T02:24:34.729536+0000","last_fullsized":"2024-09-17T02:24:34.729536+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:43.467659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":141,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.722379+0000","last_change":"2024-09-17T02:20:16.586950+0000","last_active":"2024-09-17T02:24:34.722379+0000","last_peered":"2024-09-17T02:24:34.722379+0000","last_clean":"2024-09-17T02:24:34.722379+0000","last_became_active":"2024-09-17T02:20:16.586281+0000","last_became_peered":"2024-09-17T02:20:16.586281+0000","last_unstale":"2024-09-17T02:24:34.722379+0000","last_undegraded":"2024-09-17T02:24:34.722379+0000","last_fullsized":"2024-09-17T02:24:34.722379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:22.801598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.345061+0000","last_change":"2024-09-17T02:24:30.330312+0000","last_active":"2024-09-17T02:24:34.345061+0000","last_peered":"2024-09-17T02:24:34.345061+0000","last_clean":"2024-09-17T02:24:34.345061+0000","last_became_active":"2024-09-17T02:24:30.329980+0000","last_became_peered":"2024-09-17T02:24:30.329980+0000","last_unstale":"2024-09-17T02:24:34.345061+0000","last_undegraded":"2024-09-17T02:24:34.345061+0000","last_fullsized":"2024-09-17T02:24:34.345061+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:53.422140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":72,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.361003+0000","last_change":"2024-09-17T02:24:34.361003+0000","last_active":"2024-09-17T02:24:34.361003+0000","last_peered":"2024-09-17T02:24:34.361003+0000","last_clean":"2024-09-17T02:24:34.361003+0000","last_became_active":"2024-09-17T02:24:34.360259+0000","last_became_peered":"2024-09-17T02:24:34.360259+0000","last_unstale":"2024-09-17T02:24:34.361003+0000","last_undegraded":"2024-09-17T02:24:34.361003+0000","last_fullsized":"2024-09-17T02:24:34.361003+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:01.642214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":148,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.720527+0000","last_change":"2024-09-17T02:24:30.702500+0000","last_active":"2024-09-17T02:24:34.720527+0000","last_peered":"2024-09-17T02:24:34.720527+0000","last_clean":"2024-09-17T02:24:34.720527+0000","last_became_active":"2024-09-17T02:24:30.700674+0000","last_became_peered":"2024-09-17T02:24:30.700674+0000","last_unstale":"2024-09-17T02:24:34.720527+0000","last_undegraded":"2024-09-17T02:24:34.720527+0000","last_fullsized":"2024-09-17T02:24:34.720527+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:47.554275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":148,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.721341+0000","last_change":"2024-09-17T02:24:30.700096+0000","last_active":"2024-09-17T02:24:34.721341+0000","last_peered":"2024-09-17T02:24:34.721341+0000","last_clean":"2024-09-17T02:24:34.721341+0000","last_became_active":"2024-09-17T02:24:30.698022+0000","last_became_peered":"2024-09-17T02:24:30.698022+0000","last_unstale":"2024-09-17T02:24:34.721341+0000","last_undegraded":"2024-09-17T02:24:34.721341+0000","last_fullsized":"2024-09-17T02:24:34.721341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:53.002528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":126,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.723723+0000","last_change":"2024-09-17T02:20:37.710222+0000","last_active":"2024-09-17T02:24:34.723723+0000","last_peered":"2024-09-17T02:24:34.723723+0000","last_clean":"2024-09-17T02:24:34.723723+0000","last_became_active":"2024-09-17T02:20:37.709227+0000","last_became_peered":"2024-09-17T02:20:37.709227+0000","last_unstale":"2024-09-17T02:24:34.723723+0000","last_undegraded":"2024-09-17T02:24:34.723723+0000","last_fullsized":"2024-09-17T02:24:34.723723+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:01:44.250550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.721189+0000","last_change":"2024-09-17T02:24:30.704846+0000","last_active":"2024-09-17T02:24:34.721189+0000","last_peered":"2024-09-17T02:24:34.721189+0000","last_clean":"2024-09-17T02:24:34.721189+0000","last_became_active":"2024-09-17T02:24:30.703377+0000","last_became_peered":"2024-09-17T02:24:30.703377+0000","last_unstale":"2024-09-17T02:24:34.721189+0000","last_undegraded":"2024-09-17T02:24:34.721189+0000","last_fullsized":"2024-09-17T02:24:34.721189+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:21.642002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.727667+0000","last_change":"2024-09-17T02:24:30.696851+0000","last_active":"2024-09-17T02:24:34.727667+0000","last_peered":"2024-09-17T02:24:34.727667+0000","last_clean":"2024-09-17T02:24:34.727667+0000","last_became_active":"2024-09-17T02:24:30.694853+0000","last_became_peered":"2024-09-17T02:24:30.694853+0000","last_unstale":"2024-09-17T02:24:34.727667+0000","last_undegraded":"2024-09-17T02:24:34.727667+0000","last_fullsized":"2024-09-17T02:24:34.727667+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:39.353246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.346306+0000","last_change":"2024-09-17T02:24:30.339430+0000","last_active":"2024-09-17T02:24:34.346306+0000","last_peered":"2024-09-17T02:24:34.346306+0000","last_clean":"2024-09-17T02:24:34.346306+0000","last_became_active":"2024-09-17T02:24:30.338488+0000","last_became_peered":"2024-09-17T02:24:30.338488+0000","last_unstale":"2024-09-17T02:24:34.346306+0000","last_undegraded":"2024-09-17T02:24:34.346306+0000","last_fullsized":"2024-09-17T02:24:34.346306+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:26.554742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.344589+0000","last_change":"2024-09-17T02:24:30.335659+0000","last_active":"2024-09-17T02:24:34.344589+0000","last_peered":"2024-09-17T02:24:34.344589+0000","last_clean":"2024-09-17T02:24:34.344589+0000","last_became_active":"2024-09-17T02:24:30.335243+0000","last_became_peered":"2024-09-17T02:24:30.335243+0000","last_unstale":"2024-09-17T02:24:34.344589+0000","last_undegraded":"2024-09-17T02:24:34.344589+0000","last_fullsized":"2024-09-17T02:24:34.344589+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:59.178360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.737021+0000","last_change":"2024-09-17T02:24:34.734388+0000","last_active":"2024-09-17T02:24:34.737021+0000","last_peered":"2024-09-17T02:24:34.737021+0000","last_clean":"2024-09-17T02:24:34.737021+0000","last_became_active":"2024-09-17T02:24:34.733451+0000","last_became_peered":"2024-09-17T02:24:34.733451+0000","last_unstale":"2024-09-17T02:24:34.737021+0000","last_undegraded":"2024-09-17T02:24:34.737021+0000","last_fullsized":"2024-09-17T02:24:34.737021+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:22.488478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.722012+0000","last_change":"2024-09-17T02:24:30.700893+0000","last_active":"2024-09-17T02:24:34.722012+0000","last_peered":"2024-09-17T02:24:34.722012+0000","last_clean":"2024-09-17T02:24:34.722012+0000","last_became_active":"2024-09-17T02:24:30.699410+0000","last_became_peered":"2024-09-17T02:24:30.699410+0000","last_unstale":"2024-09-17T02:24:34.722012+0000","last_undegraded":"2024-09-17T02:24:34.722012+0000","last_fullsized":"2024-09-17T02:24:34.722012+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:29.137738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.733242+0000","last_change":"2024-09-17T02:24:34.727144+0000","last_active":"2024-09-17T02:24:34.733242+0000","last_peered":"2024-09-17T02:24:34.733242+0000","last_clean":"2024-09-17T02:24:34.733242+0000","last_became_active":"2024-09-17T02:24:34.725109+0000","last_became_peered":"2024-09-17T02:24:34.725109+0000","last_unstale":"2024-09-17T02:24:34.733242+0000","last_undegraded":"2024-09-17T02:24:34.733242+0000","last_fullsized":"2024-09-17T02:24:34.733242+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:59.629654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":72,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.357265+0000","last_change":"2024-09-17T02:24:34.357265+0000","last_active":"2024-09-17T02:24:34.357265+0000","last_peered":"2024-09-17T02:24:34.357265+0000","last_clean":"2024-09-17T02:24:34.357265+0000","last_became_active":"2024-09-17T02:24:34.356639+0000","last_became_peered":"2024-09-17T02:24:34.356639+0000","last_unstale":"2024-09-17T02:24:34.357265+0000","last_undegraded":"2024-09-17T02:24:34.357265+0000","last_fullsized":"2024-09-17T02:24:34.357265+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:30.236713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.733088+0000","last_change":"2024-09-17T02:24:34.727784+0000","last_active":"2024-09-17T02:24:34.733088+0000","last_peered":"2024-09-17T02:24:34.733088+0000","last_clean":"2024-09-17T02:24:34.733088+0000","last_became_active":"2024-09-17T02:24:34.726588+0000","last_became_peered":"2024-09-17T02:24:34.726588+0000","last_unstale":"2024-09-17T02:24:34.733088+0000","last_undegraded":"2024-09-17T02:24:34.733088+0000","last_fullsized":"2024-09-17T02:24:34.733088+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:39.591275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.345772+0000","last_change":"2024-09-17T02:24:30.329201+0000","last_active":"2024-09-17T02:24:34.345772+0000","last_peered":"2024-09-17T02:24:34.345772+0000","last_clean":"2024-09-17T02:24:34.345772+0000","last_became_active":"2024-09-17T02:24:30.328907+0000","last_became_peered":"2024-09-17T02:24:30.328907+0000","last_unstale":"2024-09-17T02:24:34.345772+0000","last_undegraded":"2024-09-17T02:24:34.345772+0000","last_fullsized":"2024-09-17T02:24:34.345772+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:31.463647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":158,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.732466+0000","last_change":"2024-09-17T02:24:34.732466+0000","last_active":"2024-09-17T02:24:34.732466+0000","last_peered":"2024-09-17T02:24:34.732466+0000","last_clean":"2024-09-17T02:24:34.732466+0000","last_became_active":"2024-09-17T02:24:34.731598+0000","last_became_peered":"2024-09-17T02:24:34.731598+0000","last_unstale":"2024-09-17T02:24:34.732466+0000","last_undegraded":"2024-09-17T02:24:34.732466+0000","last_fullsized":"2024-09-17T02:24:34.732466+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:33.350084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.733359+0000","last_change":"2024-09-17T02:24:34.730124+0000","last_active":"2024-09-17T02:24:34.733359+0000","last_peered":"2024-09-17T02:24:34.733359+0000","last_clean":"2024-09-17T02:24:34.733359+0000","last_became_active":"2024-09-17T02:24:34.727345+0000","last_became_peered":"2024-09-17T02:24:34.727345+0000","last_unstale":"2024-09-17T02:24:34.733359+0000","last_undegraded":"2024-09-17T02:24:34.733359+0000","last_fullsized":"2024-09-17T02:24:34.733359+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:20.739364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.734560+0000","last_change":"2024-09-17T02:24:34.731057+0000","last_active":"2024-09-17T02:24:34.734560+0000","last_peered":"2024-09-17T02:24:34.734560+0000","last_clean":"2024-09-17T02:24:34.734560+0000","last_became_active":"2024-09-17T02:24:34.730285+0000","last_became_peered":"2024-09-17T02:24:34.730285+0000","last_unstale":"2024-09-17T02:24:34.734560+0000","last_undegraded":"2024-09-17T02:24:34.734560+0000","last_fullsized":"2024-09-17T02:24:34.734560+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:28.085866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":150,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.716124+0000","last_change":"2024-09-17T02:24:30.702653+0000","last_active":"2024-09-17T02:24:34.716124+0000","last_peered":"2024-09-17T02:24:34.716124+0000","last_clean":"2024-09-17T02:24:34.716124+0000","last_became_active":"2024-09-17T02:24:30.701047+0000","last_became_peered":"2024-09-17T02:24:30.701047+0000","last_unstale":"2024-09-17T02:24:34.716124+0000","last_undegraded":"2024-09-17T02:24:34.716124+0000","last_fullsized":"2024-09-17T02:24:34.716124+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:26.569439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":148,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.726414+0000","last_change":"2024-09-17T02:24:30.698841+0000","last_active":"2024-09-17T02:24:34.726414+0000","last_peered":"2024-09-17T02:24:34.726414+0000","last_clean":"2024-09-17T02:24:34.726414+0000","last_became_active":"2024-09-17T02:24:30.697606+0000","last_became_peered":"2024-09-17T02:24:30.697606+0000","last_unstale":"2024-09-17T02:24:34.726414+0000","last_undegraded":"2024-09-17T02:24:34.726414+0000","last_fullsized":"2024-09-17T02:24:34.726414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:20.038861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.342339+0000","last_change":"2024-09-17T02:24:30.336630+0000","last_active":"2024-09-17T02:24:34.342339+0000","last_peered":"2024-09-17T02:24:34.342339+0000","last_clean":"2024-09-17T02:24:34.342339+0000","last_became_active":"2024-09-17T02:24:30.336326+0000","last_became_peered":"2024-09-17T02:24:30.336326+0000","last_unstale":"2024-09-17T02:24:34.342339+0000","last_undegraded":"2024-09-17T02:24:34.342339+0000","last_fullsized":"2024-09-17T02:24:34.342339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:30.072709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.347001+0000","last_change":"2024-09-17T02:24:30.336771+0000","last_active":"2024-09-17T02:24:34.347001+0000","last_peered":"2024-09-17T02:24:34.347001+0000","last_clean":"2024-09-17T02:24:34.347001+0000","last_became_active":"2024-09-17T02:24:30.336494+0000","last_became_peered":"2024-09-17T02:24:30.336494+0000","last_unstale":"2024-09-17T02:24:34.347001+0000","last_undegraded":"2024-09-17T02:24:34.347001+0000","last_fullsized":"2024-09-17T02:24:34.347001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:17.852502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.344034+0000","last_change":"2024-09-17T02:24:30.338523+0000","last_active":"2024-09-17T02:24:34.344034+0000","last_peered":"2024-09-17T02:24:34.344034+0000","last_clean":"2024-09-17T02:24:34.344034+0000","last_became_active":"2024-09-17T02:24:30.337726+0000","last_became_peered":"2024-09-17T02:24:30.337726+0000","last_unstale":"2024-09-17T02:24:34.344034+0000","last_undegraded":"2024-09-17T02:24:34.344034+0000","last_fullsized":"2024-09-17T02:24:34.344034+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:33.124995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":152,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.721436+0000","last_change":"2024-09-17T02:24:30.697584+0000","last_active":"2024-09-17T02:24:34.721436+0000","last_peered":"2024-09-17T02:24:34.721436+0000","last_clean":"2024-09-17T02:24:34.721436+0000","last_became_active":"2024-09-17T02:24:30.695140+0000","last_became_peered":"2024-09-17T02:24:30.695140+0000","last_unstale":"2024-09-17T02:24:34.721436+0000","last_undegraded":"2024-09-17T02:24:34.721436+0000","last_fullsized":"2024-09-17T02:24:34.721436+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:07.386102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":126,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.721825+0000","last_change":"2024-09-17T02:20:37.705585+0000","last_active":"2024-09-17T02:24:34.721825+0000","last_peered":"2024-09-17T02:24:34.721825+0000","last_clean":"2024-09-17T02:24:34.721825+0000","last_became_active":"2024-09-17T02:20:37.705266+0000","last_became_peered":"2024-09-17T02:20:37.705266+0000","last_unstale":"2024-09-17T02:24:34.721825+0000","last_undegraded":"2024-09-17T02:24:34.721825+0000","last_fullsized":"2024-09-17T02:24:34.721825+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:10:51.092163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.346062+0000","last_change":"2024-09-17T02:24:30.338939+0000","last_active":"2024-09-17T02:24:34.346062+0000","last_peered":"2024-09-17T02:24:34.346062+0000","last_clean":"2024-09-17T02:24:34.346062+0000","last_became_active":"2024-09-17T02:24:30.337650+0000","last_became_peered":"2024-09-17T02:24:30.337650+0000","last_unstale":"2024-09-17T02:24:34.346062+0000","last_undegraded":"2024-09-17T02:24:34.346062+0000","last_fullsized":"2024-09-17T02:24:34.346062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:00.927950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.345861+0000","last_change":"2024-09-17T02:24:30.322785+0000","last_active":"2024-09-17T02:24:34.345861+0000","last_peered":"2024-09-17T02:24:34.345861+0000","last_clean":"2024-09-17T02:24:34.345861+0000","last_became_active":"2024-09-17T02:24:30.322509+0000","last_became_peered":"2024-09-17T02:24:30.322509+0000","last_unstale":"2024-09-17T02:24:34.345861+0000","last_undegraded":"2024-09-17T02:24:34.345861+0000","last_fullsized":"2024-09-17T02:24:34.345861+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:06.381434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.344313+0000","last_change":"2024-09-17T02:24:30.329944+0000","last_active":"2024-09-17T02:24:34.344313+0000","last_peered":"2024-09-17T02:24:34.344313+0000","last_clean":"2024-09-17T02:24:34.344313+0000","last_became_active":"2024-09-17T02:24:30.329642+0000","last_became_peered":"2024-09-17T02:24:30.329642+0000","last_unstale":"2024-09-17T02:24:34.344313+0000","last_undegraded":"2024-09-17T02:24:34.344313+0000","last_fullsized":"2024-09-17T02:24:34.344313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:39.135831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":148,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.724178+0000","last_change":"2024-09-17T02:24:30.699239+0000","last_active":"2024-09-17T02:24:34.724178+0000","last_peered":"2024-09-17T02:24:34.724178+0000","last_clean":"2024-09-17T02:24:34.724178+0000","last_became_active":"2024-09-17T02:24:30.697800+0000","last_became_peered":"2024-09-17T02:24:30.697800+0000","last_unstale":"2024-09-17T02:24:34.724178+0000","last_undegraded":"2024-09-17T02:24:34.724178+0000","last_fullsized":"2024-09-17T02:24:34.724178+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:42.056577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":152,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.724423+0000","last_change":"2024-09-17T02:24:30.697486+0000","last_active":"2024-09-17T02:24:34.724423+0000","last_peered":"2024-09-17T02:24:34.724423+0000","last_clean":"2024-09-17T02:24:34.724423+0000","last_became_active":"2024-09-17T02:24:30.696079+0000","last_became_peered":"2024-09-17T02:24:30.696079+0000","last_unstale":"2024-09-17T02:24:34.724423+0000","last_undegraded":"2024-09-17T02:24:34.724423+0000","last_fullsized":"2024-09-17T02:24:34.724423+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:07.222731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.344825+0000","last_change":"2024-09-17T02:24:30.330194+0000","last_active":"2024-09-17T02:24:34.344825+0000","last_peered":"2024-09-17T02:24:34.344825+0000","last_clean":"2024-09-17T02:24:34.344825+0000","last_became_active":"2024-09-17T02:24:30.329676+0000","last_became_peered":"2024-09-17T02:24:30.329676+0000","last_unstale":"2024-09-17T02:24:34.344825+0000","last_undegraded":"2024-09-17T02:24:34.344825+0000","last_fullsized":"2024-09-17T02:24:34.344825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:50:41.161871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":74,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.360950+0000","last_change":"2024-09-17T02:24:34.360950+0000","last_active":"2024-09-17T02:24:34.360950+0000","last_peered":"2024-09-17T02:24:34.360950+0000","last_clean":"2024-09-17T02:24:34.360950+0000","last_became_active":"2024-09-17T02:24:34.360020+0000","last_became_peered":"2024-09-17T02:24:34.360020+0000","last_unstale":"2024-09-17T02:24:34.360950+0000","last_undegraded":"2024-09-17T02:24:34.360950+0000","last_fullsized":"2024-09-17T02:24:34.360950+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:57.653961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.345742+0000","last_change":"2024-09-17T02:24:30.338531+0000","last_active":"2024-09-17T02:24:34.345742+0000","last_peered":"2024-09-17T02:24:34.345742+0000","last_clean":"2024-09-17T02:24:34.345742+0000","last_became_active":"2024-09-17T02:24:30.336902+0000","last_became_peered":"2024-09-17T02:24:30.336902+0000","last_unstale":"2024-09-17T02:24:34.345742+0000","last_undegraded":"2024-09-17T02:24:34.345742+0000","last_fullsized":"2024-09-17T02:24:34.345742+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:49.660896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.342851+0000","last_change":"2024-09-17T02:24:30.322953+0000","last_active":"2024-09-17T02:24:34.342851+0000","last_peered":"2024-09-17T02:24:34.342851+0000","last_clean":"2024-09-17T02:24:34.342851+0000","last_became_active":"2024-09-17T02:24:30.322780+0000","last_became_peered":"2024-09-17T02:24:30.322780+0000","last_unstale":"2024-09-17T02:24:34.342851+0000","last_undegraded":"2024-09-17T02:24:34.342851+0000","last_fullsized":"2024-09-17T02:24:34.342851+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:59:33.087791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.346736+0000","last_change":"2024-09-17T02:24:30.326828+0000","last_active":"2024-09-17T02:24:34.346736+0000","last_peered":"2024-09-17T02:24:34.346736+0000","last_clean":"2024-09-17T02:24:34.346736+0000","last_became_active":"2024-09-17T02:24:30.326227+0000","last_became_peered":"2024-09-17T02:24:30.326227+0000","last_unstale":"2024-09-17T02:24:34.346736+0000","last_undegraded":"2024-09-17T02:24:34.346736+0000","last_fullsized":"2024-09-17T02:24:34.346736+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:53.135460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":126,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.724075+0000","last_change":"2024-09-17T02:20:37.709979+0000","last_active":"2024-09-17T02:24:34.724075+0000","last_peered":"2024-09-17T02:24:34.724075+0000","last_clean":"2024-09-17T02:24:34.724075+0000","last_became_active":"2024-09-17T02:20:37.708736+0000","last_became_peered":"2024-09-17T02:20:37.708736+0000","last_unstale":"2024-09-17T02:24:34.724075+0000","last_undegraded":"2024-09-17T02:24:34.724075+0000","last_fullsized":"2024-09-17T02:24:34.724075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:03.481029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":141,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.726560+0000","last_change":"2024-09-17T02:20:16.583084+0000","last_active":"2024-09-17T02:24:34.726560+0000","last_peered":"2024-09-17T02:24:34.726560+0000","last_clean":"2024-09-17T02:24:34.726560+0000","last_became_active":"2024-09-17T02:20:16.582326+0000","last_became_peered":"2024-09-17T02:20:16.582326+0000","last_unstale":"2024-09-17T02:24:34.726560+0000","last_undegraded":"2024-09-17T02:24:34.726560+0000","last_fullsized":"2024-09-17T02:24:34.726560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:05.049317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":225,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.342654+0000","last_change":"2024-09-17T02:24:30.338760+0000","last_active":"2024-09-17T02:24:34.342654+0000","last_peered":"2024-09-17T02:24:34.342654+0000","last_clean":"2024-09-17T02:24:34.342654+0000","last_became_active":"2024-09-17T02:24:30.338214+0000","last_became_peered":"2024-09-17T02:24:30.338214+0000","last_unstale":"2024-09-17T02:24:34.342654+0000","last_undegraded":"2024-09-17T02:24:34.342654+0000","last_fullsized":"2024-09-17T02:24:34.342654+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_clean_scrub_stamp":"2024-09-17T02:20:03.432050+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:27:29.124652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.343338+0000","last_change":"2024-09-17T02:24:30.325326+0000","last_active":"2024-09-17T02:24:34.343338+0000","last_peered":"2024-09-17T02:24:34.343338+0000","last_clean":"2024-09-17T02:24:34.343338+0000","last_became_active":"2024-09-17T02:24:30.324910+0000","last_became_peered":"2024-09-17T02:24:30.324910+0000","last_unstale":"2024-09-17T02:24:34.343338+0000","last_undegraded":"2024-09-17T02:24:34.343338+0000","last_fullsized":"2024-09-17T02:24:34.343338+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:52:27.682190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":144,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.722272+0000","last_change":"2024-09-17T02:20:15.560646+0000","last_active":"2024-09-17T02:24:34.722272+0000","last_peered":"2024-09-17T02:24:34.722272+0000","last_clean":"2024-09-17T02:24:34.722272+0000","last_became_active":"2024-09-17T02:20:15.559104+0000","last_became_peered":"2024-09-17T02:20:15.559104+0000","last_unstale":"2024-09-17T02:24:34.722272+0000","last_undegraded":"2024-09-17T02:24:34.722272+0000","last_fullsized":"2024-09-17T02:24:34.722272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:44.299986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.346049+0000","last_change":"2024-09-17T02:24:30.339100+0000","last_active":"2024-09-17T02:24:34.346049+0000","last_peered":"2024-09-17T02:24:34.346049+0000","last_clean":"2024-09-17T02:24:34.346049+0000","last_became_active":"2024-09-17T02:24:30.337415+0000","last_became_peered":"2024-09-17T02:24:30.337415+0000","last_unstale":"2024-09-17T02:24:34.346049+0000","last_undegraded":"2024-09-17T02:24:34.346049+0000","last_fullsized":"2024-09-17T02:24:34.346049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:27.682975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.343463+0000","last_change":"2024-09-17T02:24:30.338621+0000","last_active":"2024-09-17T02:24:34.343463+0000","last_peered":"2024-09-17T02:24:34.343463+0000","last_clean":"2024-09-17T02:24:34.343463+0000","last_became_active":"2024-09-17T02:24:30.338024+0000","last_became_peered":"2024-09-17T02:24:30.338024+0000","last_unstale":"2024-09-17T02:24:34.343463+0000","last_undegraded":"2024-09-17T02:24:34.343463+0000","last_fullsized":"2024-09-17T02:24:34.343463+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:49.985865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":151,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.722425+0000","last_change":"2024-09-17T02:24:30.694491+0000","last_active":"2024-09-17T02:24:34.722425+0000","last_peered":"2024-09-17T02:24:34.722425+0000","last_clean":"2024-09-17T02:24:34.722425+0000","last_became_active":"2024-09-17T02:24:30.693653+0000","last_became_peered":"2024-09-17T02:24:30.693653+0000","last_unstale":"2024-09-17T02:24:34.722425+0000","last_undegraded":"2024-09-17T02:24:34.722425+0000","last_fullsized":"2024-09-17T02:24:34.722425+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:12.740030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":142,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.721082+0000","last_change":"2024-09-17T02:20:16.571568+0000","last_active":"2024-09-17T02:24:34.721082+0000","last_peered":"2024-09-17T02:24:34.721082+0000","last_clean":"2024-09-17T02:24:34.721082+0000","last_became_active":"2024-09-17T02:20:16.570622+0000","last_became_peered":"2024-09-17T02:20:16.570622+0000","last_unstale":"2024-09-17T02:24:34.721082+0000","last_undegraded":"2024-09-17T02:24:34.721082+0000","last_fullsized":"2024-09-17T02:24:34.721082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:57.083446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.723550+0000","last_change":"2024-09-17T02:20:12.511823+0000","last_active":"2024-09-17T02:24:34.723550+0000","last_peered":"2024-09-17T02:24:34.723550+0000","last_clean":"2024-09-17T02:24:34.723550+0000","last_became_active":"2024-09-17T02:20:10.497164+0000","last_became_peered":"2024-09-17T02:20:10.497164+0000","last_unstale":"2024-09-17T02:24:34.723550+0000","last_undegraded":"2024-09-17T02:24:34.723550+0000","last_fullsized":"2024-09-17T02:24:34.723550+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:21.242753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081052700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.342332+0000","last_change":"2024-09-17T02:24:30.336354+0000","last_active":"2024-09-17T02:24:34.342332+0000","last_peered":"2024-09-17T02:24:34.342332+0000","last_clean":"2024-09-17T02:24:34.342332+0000","last_became_active":"2024-09-17T02:24:30.336078+0000","last_became_peered":"2024-09-17T02:24:30.336078+0000","last_unstale":"2024-09-17T02:24:34.342332+0000","last_undegraded":"2024-09-17T02:24:34.342332+0000","last_fullsized":"2024-09-17T02:24:34.342332+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:49.027706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.735602+0000","last_change":"2024-09-17T02:24:34.730636+0000","last_active":"2024-09-17T02:24:34.735602+0000","last_peered":"2024-09-17T02:24:34.735602+0000","last_clean":"2024-09-17T02:24:34.735602+0000","last_became_active":"2024-09-17T02:24:34.729890+0000","last_became_peered":"2024-09-17T02:24:34.729890+0000","last_unstale":"2024-09-17T02:24:34.735602+0000","last_undegraded":"2024-09-17T02:24:34.735602+0000","last_fullsized":"2024-09-17T02:24:34.735602+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:07.679985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.342901+0000","last_change":"2024-09-17T02:24:30.333204+0000","last_active":"2024-09-17T02:24:34.342901+0000","last_peered":"2024-09-17T02:24:34.342901+0000","last_clean":"2024-09-17T02:24:34.342901+0000","last_became_active":"2024-09-17T02:24:30.333005+0000","last_became_peered":"2024-09-17T02:24:30.333005+0000","last_unstale":"2024-09-17T02:24:34.342901+0000","last_undegraded":"2024-09-17T02:24:34.342901+0000","last_fullsized":"2024-09-17T02:24:34.342901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:17.620422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078085399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.346066+0000","last_change":"2024-09-17T02:24:30.329442+0000","last_active":"2024-09-17T02:24:34.346066+0000","last_peered":"2024-09-17T02:24:34.346066+0000","last_clean":"2024-09-17T02:24:34.346066+0000","last_became_active":"2024-09-17T02:24:30.329213+0000","last_became_peered":"2024-09-17T02:24:30.329213+0000","last_unstale":"2024-09-17T02:24:34.346066+0000","last_undegraded":"2024-09-17T02:24:34.346066+0000","last_fullsized":"2024-09-17T02:24:34.346066+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:25.034116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":142,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.724312+0000","last_change":"2024-09-17T02:20:16.580184+0000","last_active":"2024-09-17T02:24:34.724312+0000","last_peered":"2024-09-17T02:24:34.724312+0000","last_clean":"2024-09-17T02:24:34.724312+0000","last_became_active":"2024-09-17T02:20:16.578343+0000","last_became_peered":"2024-09-17T02:20:16.578343+0000","last_unstale":"2024-09-17T02:24:34.724312+0000","last_undegraded":"2024-09-17T02:24:34.724312+0000","last_fullsized":"2024-09-17T02:24:34.724312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:42.123535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":74,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.354157+0000","last_change":"2024-09-17T02:24:34.354157+0000","last_active":"2024-09-17T02:24:34.354157+0000","last_peered":"2024-09-17T02:24:34.354157+0000","last_clean":"2024-09-17T02:24:34.354157+0000","last_became_active":"2024-09-17T02:24:34.353619+0000","last_became_peered":"2024-09-17T02:24:34.353619+0000","last_unstale":"2024-09-17T02:24:34.354157+0000","last_undegraded":"2024-09-17T02:24:34.354157+0000","last_fullsized":"2024-09-17T02:24:34.354157+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:53:03.444794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.724596+0000","last_change":"2024-09-17T02:20:12.511838+0000","last_active":"2024-09-17T02:24:34.724596+0000","last_peered":"2024-09-17T02:24:34.724596+0000","last_clean":"2024-09-17T02:24:34.724596+0000","last_became_active":"2024-09-17T02:20:10.497049+0000","last_became_peered":"2024-09-17T02:20:10.497049+0000","last_unstale":"2024-09-17T02:24:34.724596+0000","last_undegraded":"2024-09-17T02:24:34.724596+0000","last_fullsized":"2024-09-17T02:24:34.724596+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:54.446484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079701100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.721383+0000","last_change":"2024-09-17T02:24:30.698392+0000","last_active":"2024-09-17T02:24:34.721383+0000","last_peered":"2024-09-17T02:24:34.721383+0000","last_clean":"2024-09-17T02:24:34.721383+0000","last_became_active":"2024-09-17T02:24:30.694944+0000","last_became_peered":"2024-09-17T02:24:30.694944+0000","last_unstale":"2024-09-17T02:24:34.721383+0000","last_undegraded":"2024-09-17T02:24:34.721383+0000","last_fullsized":"2024-09-17T02:24:34.721383+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:06.407404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":144,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.724427+0000","last_change":"2024-09-17T02:20:15.559252+0000","last_active":"2024-09-17T02:24:34.724427+0000","last_peered":"2024-09-17T02:24:34.724427+0000","last_clean":"2024-09-17T02:24:34.724427+0000","last_became_active":"2024-09-17T02:20:15.557667+0000","last_became_peered":"2024-09-17T02:20:15.557667+0000","last_unstale":"2024-09-17T02:24:34.724427+0000","last_undegraded":"2024-09-17T02:24:34.724427+0000","last_fullsized":"2024-09-17T02:24:34.724427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:01.292626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.719590+0000","last_change":"2024-09-17T02:20:12.661034+0000","last_active":"2024-09-17T02:24:34.719590+0000","last_peered":"2024-09-17T02:24:34.719590+0000","last_clean":"2024-09-17T02:24:34.719590+0000","last_became_active":"2024-09-17T02:20:10.497829+0000","last_became_peered":"2024-09-17T02:20:10.497829+0000","last_unstale":"2024-09-17T02:24:34.719590+0000","last_undegraded":"2024-09-17T02:24:34.719590+0000","last_fullsized":"2024-09-17T02:24:34.719590+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:46:27.427685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096944700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.343650+0000","last_change":"2024-09-17T02:24:30.322910+0000","last_active":"2024-09-17T02:24:34.343650+0000","last_peered":"2024-09-17T02:24:34.343650+0000","last_clean":"2024-09-17T02:24:34.343650+0000","last_became_active":"2024-09-17T02:24:30.322632+0000","last_became_peered":"2024-09-17T02:24:30.322632+0000","last_unstale":"2024-09-17T02:24:34.343650+0000","last_undegraded":"2024-09-17T02:24:34.343650+0000","last_fullsized":"2024-09-17T02:24:34.343650+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:03.155286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":146,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.727257+0000","last_change":"2024-09-17T02:20:15.558961+0000","last_active":"2024-09-17T02:24:34.727257+0000","last_peered":"2024-09-17T02:24:34.727257+0000","last_clean":"2024-09-17T02:24:34.727257+0000","last_became_active":"2024-09-17T02:20:15.558299+0000","last_became_peered":"2024-09-17T02:20:15.558299+0000","last_unstale":"2024-09-17T02:24:34.727257+0000","last_undegraded":"2024-09-17T02:24:34.727257+0000","last_fullsized":"2024-09-17T02:24:34.727257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:39.709524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.729761+0000","last_change":"2024-09-17T02:20:12.512481+0000","last_active":"2024-09-17T02:24:34.729761+0000","last_peered":"2024-09-17T02:24:34.729761+0000","last_clean":"2024-09-17T02:24:34.729761+0000","last_became_active":"2024-09-17T02:20:10.497021+0000","last_became_peered":"2024-09-17T02:20:10.497021+0000","last_unstale":"2024-09-17T02:24:34.729761+0000","last_undegraded":"2024-09-17T02:24:34.729761+0000","last_fullsized":"2024-09-17T02:24:34.729761+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:41.167283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001400079,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.724579+0000","last_change":"2024-09-17T02:24:30.693811+0000","last_active":"2024-09-17T02:24:34.724579+0000","last_peered":"2024-09-17T02:24:34.724579+0000","last_clean":"2024-09-17T02:24:34.724579+0000","last_became_active":"2024-09-17T02:24:30.691331+0000","last_became_peered":"2024-09-17T02:24:30.691331+0000","last_unstale":"2024-09-17T02:24:34.724579+0000","last_undegraded":"2024-09-17T02:24:34.724579+0000","last_fullsized":"2024-09-17T02:24:34.724579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:39.446085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":152,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.729900+0000","last_change":"2024-09-17T02:24:30.694492+0000","last_active":"2024-09-17T02:24:34.729900+0000","last_peered":"2024-09-17T02:24:34.729900+0000","last_clean":"2024-09-17T02:24:34.729900+0000","last_became_active":"2024-09-17T02:24:30.691770+0000","last_became_peered":"2024-09-17T02:24:30.691770+0000","last_unstale":"2024-09-17T02:24:34.729900+0000","last_undegraded":"2024-09-17T02:24:34.729900+0000","last_fullsized":"2024-09-17T02:24:34.729900+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:01.597617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.346747+0000","last_change":"2024-09-17T02:24:30.336636+0000","last_active":"2024-09-17T02:24:34.346747+0000","last_peered":"2024-09-17T02:24:34.346747+0000","last_clean":"2024-09-17T02:24:34.346747+0000","last_became_active":"2024-09-17T02:24:30.336110+0000","last_became_peered":"2024-09-17T02:24:30.336110+0000","last_unstale":"2024-09-17T02:24:34.346747+0000","last_undegraded":"2024-09-17T02:24:34.346747+0000","last_fullsized":"2024-09-17T02:24:34.346747+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:44.699884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.716043+0000","last_change":"2024-09-17T02:24:30.700777+0000","last_active":"2024-09-17T02:24:34.716043+0000","last_peered":"2024-09-17T02:24:34.716043+0000","last_clean":"2024-09-17T02:24:34.716043+0000","last_became_active":"2024-09-17T02:24:30.696731+0000","last_became_peered":"2024-09-17T02:24:30.696731+0000","last_unstale":"2024-09-17T02:24:34.716043+0000","last_undegraded":"2024-09-17T02:24:34.716043+0000","last_fullsized":"2024-09-17T02:24:34.716043+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:58.629953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.344065+0000","last_change":"2024-09-17T02:24:30.326364+0000","last_active":"2024-09-17T02:24:34.344065+0000","last_peered":"2024-09-17T02:24:34.344065+0000","last_clean":"2024-09-17T02:24:34.344065+0000","last_became_active":"2024-09-17T02:24:30.325752+0000","last_became_peered":"2024-09-17T02:24:30.325752+0000","last_unstale":"2024-09-17T02:24:34.344065+0000","last_undegraded":"2024-09-17T02:24:34.344065+0000","last_fullsized":"2024-09-17T02:24:34.344065+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:33.800584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.343738+0000","last_change":"2024-09-17T02:24:30.325924+0000","last_active":"2024-09-17T02:24:34.343738+0000","last_peered":"2024-09-17T02:24:34.343738+0000","last_clean":"2024-09-17T02:24:34.343738+0000","last_became_active":"2024-09-17T02:24:30.325688+0000","last_became_peered":"2024-09-17T02:24:30.325688+0000","last_unstale":"2024-09-17T02:24:34.343738+0000","last_undegraded":"2024-09-17T02:24:34.343738+0000","last_fullsized":"2024-09-17T02:24:34.343738+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:25.290483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.735725+0000","last_change":"2024-09-17T02:24:34.731288+0000","last_active":"2024-09-17T02:24:34.735725+0000","last_peered":"2024-09-17T02:24:34.735725+0000","last_clean":"2024-09-17T02:24:34.735725+0000","last_became_active":"2024-09-17T02:24:34.730386+0000","last_became_peered":"2024-09-17T02:24:34.730386+0000","last_unstale":"2024-09-17T02:24:34.735725+0000","last_undegraded":"2024-09-17T02:24:34.735725+0000","last_fullsized":"2024-09-17T02:24:34.735725+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:45.808940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.345695+0000","last_change":"2024-09-17T02:24:30.338759+0000","last_active":"2024-09-17T02:24:34.345695+0000","last_peered":"2024-09-17T02:24:34.345695+0000","last_clean":"2024-09-17T02:24:34.345695+0000","last_became_active":"2024-09-17T02:24:30.336906+0000","last_became_peered":"2024-09-17T02:24:30.336906+0000","last_unstale":"2024-09-17T02:24:34.345695+0000","last_undegraded":"2024-09-17T02:24:34.345695+0000","last_fullsized":"2024-09-17T02:24:34.345695+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:09.728346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.345064+0000","last_change":"2024-09-17T02:24:30.325492+0000","last_active":"2024-09-17T02:24:34.345064+0000","last_peered":"2024-09-17T02:24:34.345064+0000","last_clean":"2024-09-17T02:24:34.345064+0000","last_became_active":"2024-09-17T02:24:30.325175+0000","last_became_peered":"2024-09-17T02:24:30.325175+0000","last_unstale":"2024-09-17T02:24:34.345064+0000","last_undegraded":"2024-09-17T02:24:34.345064+0000","last_fullsized":"2024-09-17T02:24:34.345064+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:04.443085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":148,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.721627+0000","last_change":"2024-09-17T02:24:30.699551+0000","last_active":"2024-09-17T02:24:34.721627+0000","last_peered":"2024-09-17T02:24:34.721627+0000","last_clean":"2024-09-17T02:24:34.721627+0000","last_became_active":"2024-09-17T02:24:30.697986+0000","last_became_peered":"2024-09-17T02:24:30.697986+0000","last_unstale":"2024-09-17T02:24:34.721627+0000","last_undegraded":"2024-09-17T02:24:34.721627+0000","last_fullsized":"2024-09-17T02:24:34.721627+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:44.939985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":150,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.726839+0000","last_change":"2024-09-17T02:24:30.697249+0000","last_active":"2024-09-17T02:24:34.726839+0000","last_peered":"2024-09-17T02:24:34.726839+0000","last_clean":"2024-09-17T02:24:34.726839+0000","last_became_active":"2024-09-17T02:24:30.696215+0000","last_became_peered":"2024-09-17T02:24:30.696215+0000","last_unstale":"2024-09-17T02:24:34.726839+0000","last_undegraded":"2024-09-17T02:24:34.726839+0000","last_fullsized":"2024-09-17T02:24:34.726839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:07.507822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":141,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.724332+0000","last_change":"2024-09-17T02:20:16.577803+0000","last_active":"2024-09-17T02:24:34.724332+0000","last_peered":"2024-09-17T02:24:34.724332+0000","last_clean":"2024-09-17T02:24:34.724332+0000","last_became_active":"2024-09-17T02:20:16.576640+0000","last_became_peered":"2024-09-17T02:20:16.576640+0000","last_unstale":"2024-09-17T02:24:34.724332+0000","last_undegraded":"2024-09-17T02:24:34.724332+0000","last_fullsized":"2024-09-17T02:24:34.724332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:07.190169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.721327+0000","last_change":"2024-09-17T02:24:30.706739+0000","last_active":"2024-09-17T02:24:34.721327+0000","last_peered":"2024-09-17T02:24:34.721327+0000","last_clean":"2024-09-17T02:24:34.721327+0000","last_became_active":"2024-09-17T02:24:30.706195+0000","last_became_peered":"2024-09-17T02:24:30.706195+0000","last_unstale":"2024-09-17T02:24:34.721327+0000","last_undegraded":"2024-09-17T02:24:34.721327+0000","last_fullsized":"2024-09-17T02:24:34.721327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:38.782264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.736300+0000","last_change":"2024-09-17T02:24:34.733762+0000","last_active":"2024-09-17T02:24:34.736300+0000","last_peered":"2024-09-17T02:24:34.736300+0000","last_clean":"2024-09-17T02:24:34.736300+0000","last_became_active":"2024-09-17T02:24:34.731592+0000","last_became_peered":"2024-09-17T02:24:34.731592+0000","last_unstale":"2024-09-17T02:24:34.736300+0000","last_undegraded":"2024-09-17T02:24:34.736300+0000","last_fullsized":"2024-09-17T02:24:34.736300+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:41.921908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.727352+0000","last_change":"2024-09-17T02:24:30.696267+0000","last_active":"2024-09-17T02:24:34.727352+0000","last_peered":"2024-09-17T02:24:34.727352+0000","last_clean":"2024-09-17T02:24:34.727352+0000","last_became_active":"2024-09-17T02:24:30.694027+0000","last_became_peered":"2024-09-17T02:24:30.694027+0000","last_unstale":"2024-09-17T02:24:34.727352+0000","last_undegraded":"2024-09-17T02:24:34.727352+0000","last_fullsized":"2024-09-17T02:24:34.727352+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:56.160158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":150,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.722141+0000","last_change":"2024-09-17T02:24:30.697568+0000","last_active":"2024-09-17T02:24:34.722141+0000","last_peered":"2024-09-17T02:24:34.722141+0000","last_clean":"2024-09-17T02:24:34.722141+0000","last_became_active":"2024-09-17T02:24:30.693991+0000","last_became_peered":"2024-09-17T02:24:30.693991+0000","last_unstale":"2024-09-17T02:24:34.722141+0000","last_undegraded":"2024-09-17T02:24:34.722141+0000","last_fullsized":"2024-09-17T02:24:34.722141+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:45.636130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":146,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.717462+0000","last_change":"2024-09-17T02:21:10.505967+0000","last_active":"2024-09-17T02:24:34.717462+0000","last_peered":"2024-09-17T02:24:34.717462+0000","last_clean":"2024-09-17T02:24:34.717462+0000","last_became_active":"2024-09-17T02:21:10.505594+0000","last_became_peered":"2024-09-17T02:21:10.505594+0000","last_unstale":"2024-09-17T02:24:34.717462+0000","last_undegraded":"2024-09-17T02:24:34.717462+0000","last_fullsized":"2024-09-17T02:24:34.717462+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:15.782752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":126,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.721341+0000","last_change":"2024-09-17T02:20:37.706393+0000","last_active":"2024-09-17T02:24:34.721341+0000","last_peered":"2024-09-17T02:24:34.721341+0000","last_clean":"2024-09-17T02:24:34.721341+0000","last_became_active":"2024-09-17T02:20:37.705739+0000","last_became_peered":"2024-09-17T02:20:37.705739+0000","last_unstale":"2024-09-17T02:24:34.721341+0000","last_undegraded":"2024-09-17T02:24:34.721341+0000","last_fullsized":"2024-09-17T02:24:34.721341+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:57.361673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":126,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.721819+0000","last_change":"2024-09-17T02:20:37.706175+0000","last_active":"2024-09-17T02:24:34.721819+0000","last_peered":"2024-09-17T02:24:34.721819+0000","last_clean":"2024-09-17T02:24:34.721819+0000","last_became_active":"2024-09-17T02:20:37.705742+0000","last_became_peered":"2024-09-17T02:20:37.705742+0000","last_unstale":"2024-09-17T02:24:34.721819+0000","last_undegraded":"2024-09-17T02:24:34.721819+0000","last_fullsized":"2024-09-17T02:24:34.721819+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:09.959092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":151,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.720524+0000","last_change":"2024-09-17T02:24:30.698237+0000","last_active":"2024-09-17T02:24:34.720524+0000","last_peered":"2024-09-17T02:24:34.720524+0000","last_clean":"2024-09-17T02:24:34.720524+0000","last_became_active":"2024-09-17T02:24:30.697194+0000","last_became_peered":"2024-09-17T02:24:30.697194+0000","last_unstale":"2024-09-17T02:24:34.720524+0000","last_undegraded":"2024-09-17T02:24:34.720524+0000","last_fullsized":"2024-09-17T02:24:34.720524+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:36.697224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":72,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.360811+0000","last_change":"2024-09-17T02:24:34.360811+0000","last_active":"2024-09-17T02:24:34.360811+0000","last_peered":"2024-09-17T02:24:34.360811+0000","last_clean":"2024-09-17T02:24:34.360811+0000","last_became_active":"2024-09-17T02:24:34.359944+0000","last_became_peered":"2024-09-17T02:24:34.359944+0000","last_unstale":"2024-09-17T02:24:34.360811+0000","last_undegraded":"2024-09-17T02:24:34.360811+0000","last_fullsized":"2024-09-17T02:24:34.360811+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:07.986774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.343807+0000","last_change":"2024-09-17T02:24:30.327080+0000","last_active":"2024-09-17T02:24:34.343807+0000","last_peered":"2024-09-17T02:24:34.343807+0000","last_clean":"2024-09-17T02:24:34.343807+0000","last_became_active":"2024-09-17T02:24:30.326800+0000","last_became_peered":"2024-09-17T02:24:30.326800+0000","last_unstale":"2024-09-17T02:24:34.343807+0000","last_undegraded":"2024-09-17T02:24:34.343807+0000","last_fullsized":"2024-09-17T02:24:34.343807+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:06.072812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.343980+0000","last_change":"2024-09-17T02:24:30.322448+0000","last_active":"2024-09-17T02:24:34.343980+0000","last_peered":"2024-09-17T02:24:34.343980+0000","last_clean":"2024-09-17T02:24:34.343980+0000","last_became_active":"2024-09-17T02:24:30.322156+0000","last_became_peered":"2024-09-17T02:24:30.322156+0000","last_unstale":"2024-09-17T02:24:34.343980+0000","last_undegraded":"2024-09-17T02:24:34.343980+0000","last_fullsized":"2024-09-17T02:24:34.343980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:46.435146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.344488+0000","last_change":"2024-09-17T02:24:30.336467+0000","last_active":"2024-09-17T02:24:34.344488+0000","last_peered":"2024-09-17T02:24:34.344488+0000","last_clean":"2024-09-17T02:24:34.344488+0000","last_became_active":"2024-09-17T02:24:30.336042+0000","last_became_peered":"2024-09-17T02:24:30.336042+0000","last_unstale":"2024-09-17T02:24:34.344488+0000","last_undegraded":"2024-09-17T02:24:34.344488+0000","last_fullsized":"2024-09-17T02:24:34.344488+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:59.645621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":141,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.716492+0000","last_change":"2024-09-17T02:20:16.570456+0000","last_active":"2024-09-17T02:24:34.716492+0000","last_peered":"2024-09-17T02:24:34.716492+0000","last_clean":"2024-09-17T02:24:34.716492+0000","last_became_active":"2024-09-17T02:20:16.568095+0000","last_became_peered":"2024-09-17T02:20:16.568095+0000","last_unstale":"2024-09-17T02:24:34.716492+0000","last_undegraded":"2024-09-17T02:24:34.716492+0000","last_fullsized":"2024-09-17T02:24:34.716492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:58.329169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":145,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.729356+0000","last_change":"2024-09-17T02:20:15.560293+0000","last_active":"2024-09-17T02:24:34.729356+0000","last_peered":"2024-09-17T02:24:34.729356+0000","last_clean":"2024-09-17T02:24:34.729356+0000","last_became_active":"2024-09-17T02:20:15.559074+0000","last_became_peered":"2024-09-17T02:20:15.559074+0000","last_unstale":"2024-09-17T02:24:34.729356+0000","last_undegraded":"2024-09-17T02:24:34.729356+0000","last_fullsized":"2024-09-17T02:24:34.729356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:55.639841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.343762+0000","last_change":"2024-09-17T02:24:30.319629+0000","last_active":"2024-09-17T02:24:34.343762+0000","last_peered":"2024-09-17T02:24:34.343762+0000","last_clean":"2024-09-17T02:24:34.343762+0000","last_became_active":"2024-09-17T02:24:30.319441+0000","last_became_peered":"2024-09-17T02:24:30.319441+0000","last_unstale":"2024-09-17T02:24:34.343762+0000","last_undegraded":"2024-09-17T02:24:34.343762+0000","last_fullsized":"2024-09-17T02:24:34.343762+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:58.379141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":155,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-17T02:24:34.726719+0000","last_change":"2024-09-17T02:24:30.699964+0000","last_active":"2024-09-17T02:24:34.726719+0000","last_peered":"2024-09-17T02:24:34.726719+0000","last_clean":"2024-09-17T02:24:34.726719+0000","last_became_active":"2024-09-17T02:24:30.699102+0000","last_became_peered":"2024-09-17T02:24:30.699102+0000","last_unstale":"2024-09-17T02:24:34.726719+0000","last_undegraded":"2024-09-17T02:24:34.726719+0000","last_fullsized":"2024-09-17T02:24:34.726719+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:19.193516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5558,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361192,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":360190,"kb_avail":94010648,"statfs":{"total":96636764160,"available":96266903552,"internally_reserved":0,"allocated":1003520,"data_stored":957653,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":368835013},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":80,"seq":343597383683,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56436,"kb_used_data":992,"kb_used_omap":6,"kb_used_meta":55417,"kb_avail":94315404,"statfs":{"total":96636764160,"available":96578973696,"internally_reserved":0,"allocated":1015808,"data_stored":958288,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":7153,"internal_metadata":56747023},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738426,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329196,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94042644,"statfs":{"total":96636764160,"available":96299667456,"internally_reserved":0,"allocated":933888,"data_stored":366126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5558,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T02:24:40.240 INFO:tasks.thrashosds.thrasher:Setting 4.3f to [2, 1, 0] 2024-09-17T02:24:40.240 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.3f', '2', '1', '0'] 2024-09-17T02:24:40.240 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.3f 2 1 0 2024-09-17T02:24:40.607 INFO:teuthology.orchestra.run.smithi001.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-09-17T02:24:40.613 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T02:24:40.613 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-09-17T02:24:45.614 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-17T02:24:45.762 INFO:teuthology.orchestra.run.smithi001.stdout:mon.a: {} 2024-09-17T02:24:45.762 INFO:teuthology.orchestra.run.smithi001.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T02:24:45.770 INFO:teuthology.orchestra.run.smithi001.stdout:mon.b: {} 2024-09-17T02:24:45.771 INFO:teuthology.orchestra.run.smithi001.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T02:24:45.780 INFO:teuthology.orchestra.run.smithi001.stdout:mon.c: {} 2024-09-17T02:24:45.780 INFO:teuthology.orchestra.run.smithi001.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T02:24:45.797 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-17T02:24:46.561 INFO:teuthology.orchestra.run.smithi001.stderr:reweighted osd.0 to 1 (10000) 2024-09-17T02:24:46.583 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-17T02:24:47.562 INFO:teuthology.orchestra.run.smithi001.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-17T02:24:47.585 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-17T02:24:48.559 INFO:teuthology.orchestra.run.smithi001.stderr:reweighted osd.1 to 1 (10000) 2024-09-17T02:24:48.587 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-17T02:24:49.574 INFO:teuthology.orchestra.run.smithi001.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-17T02:24:49.597 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-17T02:24:50.585 INFO:teuthology.orchestra.run.smithi001.stderr:reweighted osd.2 to 1 (10000) 2024-09-17T02:24:50.616 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-17T02:24:51.604 INFO:teuthology.orchestra.run.smithi001.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-17T02:24:51.627 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-17T02:24:51.627 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-17T02:24:51.628 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-17T02:24:51.628 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-17T02:24:51.628 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T02:24:51.628 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:24:51.935 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:24:51.935 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":90,"fsid":"37cd4495-4915-41f4-bad2-2394cbe235f3","created":"2024-09-17T02:19:52.516342+0000","modified":"2024-09-17T02:24:51.590364+0000","last_up_change":"2024-09-17T02:24:29.673066+0000","last_in_change":"2024-09-17T02:19:54.329423+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:20:03.416336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T02:20:08.718296+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:20:13.566396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-17T02:20:14.902662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fae746a8-754d-4e52-9819-004ebb0d6886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6801","nonce":2347677104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6803","nonce":2347677104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6807","nonce":2347677104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6805","nonce":2347677104}]},"public_addr":"172.21.15.32:6801/2347677104","cluster_addr":"172.21.15.32:6803/2347677104","heartbeat_back_addr":"172.21.15.32:6807/2347677104","heartbeat_front_addr":"172.21.15.32:6805/2347677104","state":["exists","up"]},{"osd":1,"uuid":"c9397688-80ca-4c21-b80d-1740194c389d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6801","nonce":1905904204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6803","nonce":1905904204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6807","nonce":1905904204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6805","nonce":1905904204}]},"public_addr":"172.21.15.153:6801/1905904204","cluster_addr":"172.21.15.153:6803/1905904204","heartbeat_back_addr":"172.21.15.153:6807/1905904204","heartbeat_front_addr":"172.21.15.153:6805/1905904204","state":["exists","up"]},{"osd":2,"uuid":"6d8c01a8-b657-4abc-a624-2b35ef0512ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":50,"up_from":80,"up_thru":83,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2045876213},{"type":"v1","addr":"172.21.15.164:6801","nonce":2045876213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2045876213},{"type":"v1","addr":"172.21.15.164:6803","nonce":2045876213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2045876213},{"type":"v1","addr":"172.21.15.164:6807","nonce":2045876213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2045876213},{"type":"v1","addr":"172.21.15.164:6805","nonce":2045876213}]},"public_addr":"172.21.15.164:6801/2045876213","cluster_addr":"172.21.15.164:6803/2045876213","heartbeat_back_addr":"172.21.15.164:6807/2045876213","heartbeat_front_addr":"172.21.15.164:6805/2045876213","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.476482+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.250903+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.326430+0000","dead_epoch":50}],"pg_upmap":[{"pgid":"4.1d","osds":[0,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:24:51.954 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T02:24:51.954 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:24:52.261 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:24:52.261 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":90,"fsid":"37cd4495-4915-41f4-bad2-2394cbe235f3","created":"2024-09-17T02:19:52.516342+0000","modified":"2024-09-17T02:24:51.590364+0000","last_up_change":"2024-09-17T02:24:29.673066+0000","last_in_change":"2024-09-17T02:19:54.329423+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:20:03.416336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T02:20:08.718296+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:20:13.566396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-17T02:20:14.902662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fae746a8-754d-4e52-9819-004ebb0d6886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6801","nonce":2347677104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6803","nonce":2347677104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6807","nonce":2347677104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6805","nonce":2347677104}]},"public_addr":"172.21.15.32:6801/2347677104","cluster_addr":"172.21.15.32:6803/2347677104","heartbeat_back_addr":"172.21.15.32:6807/2347677104","heartbeat_front_addr":"172.21.15.32:6805/2347677104","state":["exists","up"]},{"osd":1,"uuid":"c9397688-80ca-4c21-b80d-1740194c389d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6801","nonce":1905904204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6803","nonce":1905904204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6807","nonce":1905904204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6805","nonce":1905904204}]},"public_addr":"172.21.15.153:6801/1905904204","cluster_addr":"172.21.15.153:6803/1905904204","heartbeat_back_addr":"172.21.15.153:6807/1905904204","heartbeat_front_addr":"172.21.15.153:6805/1905904204","state":["exists","up"]},{"osd":2,"uuid":"6d8c01a8-b657-4abc-a624-2b35ef0512ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":50,"up_from":80,"up_thru":83,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2045876213},{"type":"v1","addr":"172.21.15.164:6801","nonce":2045876213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2045876213},{"type":"v1","addr":"172.21.15.164:6803","nonce":2045876213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2045876213},{"type":"v1","addr":"172.21.15.164:6807","nonce":2045876213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2045876213},{"type":"v1","addr":"172.21.15.164:6805","nonce":2045876213}]},"public_addr":"172.21.15.164:6801/2045876213","cluster_addr":"172.21.15.164:6803/2045876213","heartbeat_back_addr":"172.21.15.164:6807/2045876213","heartbeat_front_addr":"172.21.15.164:6805/2045876213","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.476482+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.250903+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.326430+0000","dead_epoch":50}],"pg_upmap":[{"pgid":"4.1d","osds":[0,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:24:52.281 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T02:24:52.281 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T02:24:52.282 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T02:24:52.439 INFO:teuthology.orchestra.run.smithi001.stdout:34359738429 2024-09-17T02:24:52.440 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T02:24:52.441 INFO:teuthology.orchestra.run.smithi001.stdout:343597383686 2024-09-17T02:24:52.441 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T02:24:52.442 INFO:teuthology.orchestra.run.smithi001.stdout:38654705726 2024-09-17T02:24:52.442 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T02:24:52.775 INFO:teuthology.orchestra.run.smithi001.stdout:343597383685 2024-09-17T02:24:52.784 INFO:teuthology.orchestra.run.smithi001.stdout:34359738428 2024-09-17T02:24:52.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 343597383686 got 343597383685 for osd.2 2024-09-17T02:24:52.796 INFO:teuthology.orchestra.run.smithi001.stdout:38654705725 2024-09-17T02:24:52.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738428 for osd.1 2024-09-17T02:24:52.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705726 got 38654705725 for osd.0 2024-09-17T02:24:53.794 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T02:24:53.804 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T02:24:53.815 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T02:24:54.112 INFO:teuthology.orchestra.run.smithi001.stdout:343597383686 2024-09-17T02:24:54.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 343597383686 got 343597383686 for osd.2 2024-09-17T02:24:54.129 DEBUG:teuthology.parallel:result is None 2024-09-17T02:24:54.130 INFO:teuthology.orchestra.run.smithi001.stdout:38654705726 2024-09-17T02:24:54.138 INFO:teuthology.orchestra.run.smithi001.stdout:34359738430 2024-09-17T02:24:54.148 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705726 got 38654705726 for osd.0 2024-09-17T02:24:54.149 DEBUG:teuthology.parallel:result is None 2024-09-17T02:24:54.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738430 for osd.1 2024-09-17T02:24:54.156 DEBUG:teuthology.parallel:result is None 2024-09-17T02:24:54.156 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-17T02:24:54.157 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:24:54.498 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:24:54.500 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-17T02:24:54.514 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2024-09-17T02:24:53.472419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":746964,"kb_used_data":3020,"kb_used_omap":10,"kb_used_meta":743861,"kb_avail":282368556,"statfs":{"total":289910292480,"available":289145401344,"internally_reserved":0,"allocated":3092480,"data_stored":2354528,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10343,"internal_metadata":761714585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.908866"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605682+0000","last_change":"2024-09-17T02:24:34.733681+0000","last_active":"2024-09-17T02:24:51.605682+0000","last_peered":"2024-09-17T02:24:51.605682+0000","last_clean":"2024-09-17T02:24:51.605682+0000","last_became_active":"2024-09-17T02:24:34.732728+0000","last_became_peered":"2024-09-17T02:24:34.732728+0000","last_unstale":"2024-09-17T02:24:51.605682+0000","last_undegraded":"2024-09-17T02:24:51.605682+0000","last_fullsized":"2024-09-17T02:24:51.605682+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:21.613592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605214+0000","last_change":"2024-09-17T02:24:48.579919+0000","last_active":"2024-09-17T02:24:51.605214+0000","last_peered":"2024-09-17T02:24:51.605214+0000","last_clean":"2024-09-17T02:24:51.605214+0000","last_became_active":"2024-09-17T02:24:48.578274+0000","last_became_peered":"2024-09-17T02:24:48.578274+0000","last_unstale":"2024-09-17T02:24:51.605214+0000","last_undegraded":"2024-09-17T02:24:51.605214+0000","last_fullsized":"2024-09-17T02:24:51.605214+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:50.597846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.236296+0000","last_change":"2024-09-17T02:24:30.339249+0000","last_active":"2024-09-17T02:24:51.236296+0000","last_peered":"2024-09-17T02:24:51.236296+0000","last_clean":"2024-09-17T02:24:51.236296+0000","last_became_active":"2024-09-17T02:24:30.338199+0000","last_became_peered":"2024-09-17T02:24:30.338199+0000","last_unstale":"2024-09-17T02:24:51.236296+0000","last_undegraded":"2024-09-17T02:24:51.236296+0000","last_fullsized":"2024-09-17T02:24:51.236296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:51.734408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":87,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232438+0000","last_change":"2024-09-17T02:24:34.360587+0000","last_active":"2024-09-17T02:24:51.232438+0000","last_peered":"2024-09-17T02:24:51.232438+0000","last_clean":"2024-09-17T02:24:51.232438+0000","last_became_active":"2024-09-17T02:24:34.359912+0000","last_became_peered":"2024-09-17T02:24:34.359912+0000","last_unstale":"2024-09-17T02:24:51.232438+0000","last_undegraded":"2024-09-17T02:24:51.232438+0000","last_fullsized":"2024-09-17T02:24:51.232438+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:35.054937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605500+0000","last_change":"2024-09-17T02:24:48.579715+0000","last_active":"2024-09-17T02:24:51.605500+0000","last_peered":"2024-09-17T02:24:51.605500+0000","last_clean":"2024-09-17T02:24:51.605500+0000","last_became_active":"2024-09-17T02:24:48.578841+0000","last_became_peered":"2024-09-17T02:24:48.578841+0000","last_unstale":"2024-09-17T02:24:51.605500+0000","last_undegraded":"2024-09-17T02:24:51.605500+0000","last_fullsized":"2024-09-17T02:24:51.605500+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:23.197781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233991+0000","last_change":"2024-09-17T02:24:30.322619+0000","last_active":"2024-09-17T02:24:51.233991+0000","last_peered":"2024-09-17T02:24:51.233991+0000","last_clean":"2024-09-17T02:24:51.233991+0000","last_became_active":"2024-09-17T02:24:30.322191+0000","last_became_peered":"2024-09-17T02:24:30.322191+0000","last_unstale":"2024-09-17T02:24:51.233991+0000","last_undegraded":"2024-09-17T02:24:51.233991+0000","last_fullsized":"2024-09-17T02:24:51.233991+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:26.120304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233779+0000","last_change":"2024-09-17T02:24:30.330077+0000","last_active":"2024-09-17T02:24:51.233779+0000","last_peered":"2024-09-17T02:24:51.233779+0000","last_clean":"2024-09-17T02:24:51.233779+0000","last_became_active":"2024-09-17T02:24:30.329814+0000","last_became_peered":"2024-09-17T02:24:30.329814+0000","last_unstale":"2024-09-17T02:24:51.233779+0000","last_undegraded":"2024-09-17T02:24:51.233779+0000","last_fullsized":"2024-09-17T02:24:51.233779+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:09.933024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233077+0000","last_change":"2024-09-17T02:24:30.319625+0000","last_active":"2024-09-17T02:24:51.233077+0000","last_peered":"2024-09-17T02:24:51.233077+0000","last_clean":"2024-09-17T02:24:51.233077+0000","last_became_active":"2024-09-17T02:24:30.319316+0000","last_became_peered":"2024-09-17T02:24:30.319316+0000","last_unstale":"2024-09-17T02:24:51.233077+0000","last_undegraded":"2024-09-17T02:24:51.233077+0000","last_fullsized":"2024-09-17T02:24:51.233077+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:30.753462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277651+0000","last_change":"2024-09-17T02:20:16.584665+0000","last_active":"2024-09-17T02:24:52.277651+0000","last_peered":"2024-09-17T02:24:52.277651+0000","last_clean":"2024-09-17T02:24:52.277651+0000","last_became_active":"2024-09-17T02:20:16.580797+0000","last_became_peered":"2024-09-17T02:20:16.580797+0000","last_unstale":"2024-09-17T02:24:52.277651+0000","last_undegraded":"2024-09-17T02:24:52.277651+0000","last_fullsized":"2024-09-17T02:24:52.277651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:47.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605486+0000","last_change":"2024-09-17T02:24:34.733394+0000","last_active":"2024-09-17T02:24:51.605486+0000","last_peered":"2024-09-17T02:24:51.605486+0000","last_clean":"2024-09-17T02:24:51.605486+0000","last_became_active":"2024-09-17T02:24:34.732480+0000","last_became_peered":"2024-09-17T02:24:34.732480+0000","last_unstale":"2024-09-17T02:24:51.605486+0000","last_undegraded":"2024-09-17T02:24:51.605486+0000","last_fullsized":"2024-09-17T02:24:51.605486+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:37.005990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235423+0000","last_change":"2024-09-17T02:24:30.329180+0000","last_active":"2024-09-17T02:24:51.235423+0000","last_peered":"2024-09-17T02:24:51.235423+0000","last_clean":"2024-09-17T02:24:51.235423+0000","last_became_active":"2024-09-17T02:24:30.328962+0000","last_became_peered":"2024-09-17T02:24:30.328962+0000","last_unstale":"2024-09-17T02:24:51.235423+0000","last_undegraded":"2024-09-17T02:24:51.235423+0000","last_fullsized":"2024-09-17T02:24:51.235423+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:21.425064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605228+0000","last_change":"2024-09-17T02:24:48.583870+0000","last_active":"2024-09-17T02:24:51.605228+0000","last_peered":"2024-09-17T02:24:51.605228+0000","last_clean":"2024-09-17T02:24:51.605228+0000","last_became_active":"2024-09-17T02:24:48.581418+0000","last_became_peered":"2024-09-17T02:24:48.581418+0000","last_unstale":"2024-09-17T02:24:51.605228+0000","last_undegraded":"2024-09-17T02:24:51.605228+0000","last_fullsized":"2024-09-17T02:24:51.605228+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:52:52.425417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604958+0000","last_change":"2024-09-17T02:24:48.583016+0000","last_active":"2024-09-17T02:24:51.604958+0000","last_peered":"2024-09-17T02:24:51.604958+0000","last_clean":"2024-09-17T02:24:51.604958+0000","last_became_active":"2024-09-17T02:24:48.579221+0000","last_became_peered":"2024-09-17T02:24:48.579221+0000","last_unstale":"2024-09-17T02:24:51.604958+0000","last_undegraded":"2024-09-17T02:24:51.604958+0000","last_fullsized":"2024-09-17T02:24:51.604958+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:46.150529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233659+0000","last_change":"2024-09-17T02:24:30.337132+0000","last_active":"2024-09-17T02:24:51.233659+0000","last_peered":"2024-09-17T02:24:51.233659+0000","last_clean":"2024-09-17T02:24:51.233659+0000","last_became_active":"2024-09-17T02:24:30.335871+0000","last_became_peered":"2024-09-17T02:24:30.335871+0000","last_unstale":"2024-09-17T02:24:51.233659+0000","last_undegraded":"2024-09-17T02:24:51.233659+0000","last_fullsized":"2024-09-17T02:24:51.233659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:21.006777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233508+0000","last_change":"2024-09-17T02:24:30.335635+0000","last_active":"2024-09-17T02:24:51.233508+0000","last_peered":"2024-09-17T02:24:51.233508+0000","last_clean":"2024-09-17T02:24:51.233508+0000","last_became_active":"2024-09-17T02:24:30.335086+0000","last_became_peered":"2024-09-17T02:24:30.335086+0000","last_unstale":"2024-09-17T02:24:51.233508+0000","last_undegraded":"2024-09-17T02:24:51.233508+0000","last_fullsized":"2024-09-17T02:24:51.233508+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:01.913411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233514+0000","last_change":"2024-09-17T02:24:30.325322+0000","last_active":"2024-09-17T02:24:51.233514+0000","last_peered":"2024-09-17T02:24:51.233514+0000","last_clean":"2024-09-17T02:24:51.233514+0000","last_became_active":"2024-09-17T02:24:30.325002+0000","last_became_peered":"2024-09-17T02:24:30.325002+0000","last_unstale":"2024-09-17T02:24:51.233514+0000","last_undegraded":"2024-09-17T02:24:51.233514+0000","last_fullsized":"2024-09-17T02:24:51.233514+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:16.238014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278363+0000","last_change":"2024-09-17T02:20:16.563482+0000","last_active":"2024-09-17T02:24:52.278363+0000","last_peered":"2024-09-17T02:24:52.278363+0000","last_clean":"2024-09-17T02:24:52.278363+0000","last_became_active":"2024-09-17T02:20:16.562735+0000","last_became_peered":"2024-09-17T02:20:16.562735+0000","last_unstale":"2024-09-17T02:24:52.278363+0000","last_undegraded":"2024-09-17T02:24:52.278363+0000","last_fullsized":"2024-09-17T02:24:52.278363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:10.315951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605780+0000","last_change":"2024-09-17T02:24:48.583997+0000","last_active":"2024-09-17T02:24:51.605780+0000","last_peered":"2024-09-17T02:24:51.605780+0000","last_clean":"2024-09-17T02:24:51.605780+0000","last_became_active":"2024-09-17T02:24:48.580510+0000","last_became_peered":"2024-09-17T02:24:48.580510+0000","last_unstale":"2024-09-17T02:24:51.605780+0000","last_undegraded":"2024-09-17T02:24:51.605780+0000","last_fullsized":"2024-09-17T02:24:51.605780+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:21:58.370793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277220+0000","last_change":"2024-09-17T02:20:16.586950+0000","last_active":"2024-09-17T02:24:52.277220+0000","last_peered":"2024-09-17T02:24:52.277220+0000","last_clean":"2024-09-17T02:24:52.277220+0000","last_became_active":"2024-09-17T02:20:16.586281+0000","last_became_peered":"2024-09-17T02:20:16.586281+0000","last_unstale":"2024-09-17T02:24:52.277220+0000","last_undegraded":"2024-09-17T02:24:52.277220+0000","last_fullsized":"2024-09-17T02:24:52.277220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:22.801598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234871+0000","last_change":"2024-09-17T02:24:30.330312+0000","last_active":"2024-09-17T02:24:51.234871+0000","last_peered":"2024-09-17T02:24:51.234871+0000","last_clean":"2024-09-17T02:24:51.234871+0000","last_became_active":"2024-09-17T02:24:30.329980+0000","last_became_peered":"2024-09-17T02:24:30.329980+0000","last_unstale":"2024-09-17T02:24:51.234871+0000","last_undegraded":"2024-09-17T02:24:51.234871+0000","last_fullsized":"2024-09-17T02:24:51.234871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:53.422140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232041+0000","last_change":"2024-09-17T02:24:34.361003+0000","last_active":"2024-09-17T02:24:51.232041+0000","last_peered":"2024-09-17T02:24:51.232041+0000","last_clean":"2024-09-17T02:24:51.232041+0000","last_became_active":"2024-09-17T02:24:34.360259+0000","last_became_peered":"2024-09-17T02:24:34.360259+0000","last_unstale":"2024-09-17T02:24:51.232041+0000","last_undegraded":"2024-09-17T02:24:51.232041+0000","last_fullsized":"2024-09-17T02:24:51.232041+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:01.642214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605644+0000","last_change":"2024-09-17T02:24:30.702500+0000","last_active":"2024-09-17T02:24:51.605644+0000","last_peered":"2024-09-17T02:24:51.605644+0000","last_clean":"2024-09-17T02:24:51.605644+0000","last_became_active":"2024-09-17T02:24:30.700674+0000","last_became_peered":"2024-09-17T02:24:30.700674+0000","last_unstale":"2024-09-17T02:24:51.605644+0000","last_undegraded":"2024-09-17T02:24:51.605644+0000","last_fullsized":"2024-09-17T02:24:51.605644+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:47.554275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275778+0000","last_change":"2024-09-17T02:24:30.700096+0000","last_active":"2024-09-17T02:24:52.275778+0000","last_peered":"2024-09-17T02:24:52.275778+0000","last_clean":"2024-09-17T02:24:52.275778+0000","last_became_active":"2024-09-17T02:24:30.698022+0000","last_became_peered":"2024-09-17T02:24:30.698022+0000","last_unstale":"2024-09-17T02:24:52.275778+0000","last_undegraded":"2024-09-17T02:24:52.275778+0000","last_fullsized":"2024-09-17T02:24:52.275778+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:53.002528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604171+0000","last_change":"2024-09-17T02:24:48.577229+0000","last_active":"2024-09-17T02:24:51.604171+0000","last_peered":"2024-09-17T02:24:51.604171+0000","last_clean":"2024-09-17T02:24:51.604171+0000","last_became_active":"2024-09-17T02:24:48.576615+0000","last_became_peered":"2024-09-17T02:24:48.576615+0000","last_unstale":"2024-09-17T02:24:51.604171+0000","last_undegraded":"2024-09-17T02:24:51.604171+0000","last_fullsized":"2024-09-17T02:24:51.604171+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:23.827785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606021+0000","last_change":"2024-09-17T02:24:30.704846+0000","last_active":"2024-09-17T02:24:51.606021+0000","last_peered":"2024-09-17T02:24:51.606021+0000","last_clean":"2024-09-17T02:24:51.606021+0000","last_became_active":"2024-09-17T02:24:30.703377+0000","last_became_peered":"2024-09-17T02:24:30.703377+0000","last_unstale":"2024-09-17T02:24:51.606021+0000","last_undegraded":"2024-09-17T02:24:51.606021+0000","last_fullsized":"2024-09-17T02:24:51.606021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:21.642002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277663+0000","last_change":"2024-09-17T02:24:30.696851+0000","last_active":"2024-09-17T02:24:52.277663+0000","last_peered":"2024-09-17T02:24:52.277663+0000","last_clean":"2024-09-17T02:24:52.277663+0000","last_became_active":"2024-09-17T02:24:30.694853+0000","last_became_peered":"2024-09-17T02:24:30.694853+0000","last_unstale":"2024-09-17T02:24:52.277663+0000","last_undegraded":"2024-09-17T02:24:52.277663+0000","last_fullsized":"2024-09-17T02:24:52.277663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:39.353246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235268+0000","last_change":"2024-09-17T02:24:30.339430+0000","last_active":"2024-09-17T02:24:51.235268+0000","last_peered":"2024-09-17T02:24:51.235268+0000","last_clean":"2024-09-17T02:24:51.235268+0000","last_became_active":"2024-09-17T02:24:30.338488+0000","last_became_peered":"2024-09-17T02:24:30.338488+0000","last_unstale":"2024-09-17T02:24:51.235268+0000","last_undegraded":"2024-09-17T02:24:51.235268+0000","last_fullsized":"2024-09-17T02:24:51.235268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:26.554742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606211+0000","last_change":"2024-09-17T02:24:48.584148+0000","last_active":"2024-09-17T02:24:51.606211+0000","last_peered":"2024-09-17T02:24:51.606211+0000","last_clean":"2024-09-17T02:24:51.606211+0000","last_became_active":"2024-09-17T02:24:48.582959+0000","last_became_peered":"2024-09-17T02:24:48.582959+0000","last_unstale":"2024-09-17T02:24:51.606211+0000","last_undegraded":"2024-09-17T02:24:51.606211+0000","last_fullsized":"2024-09-17T02:24:51.606211+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:24.455294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276722+0000","last_change":"2024-09-17T02:24:34.734388+0000","last_active":"2024-09-17T02:24:52.276722+0000","last_peered":"2024-09-17T02:24:52.276722+0000","last_clean":"2024-09-17T02:24:52.276722+0000","last_became_active":"2024-09-17T02:24:34.733451+0000","last_became_peered":"2024-09-17T02:24:34.733451+0000","last_unstale":"2024-09-17T02:24:52.276722+0000","last_undegraded":"2024-09-17T02:24:52.276722+0000","last_fullsized":"2024-09-17T02:24:52.276722+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:22.488478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605030+0000","last_change":"2024-09-17T02:24:30.700893+0000","last_active":"2024-09-17T02:24:51.605030+0000","last_peered":"2024-09-17T02:24:51.605030+0000","last_clean":"2024-09-17T02:24:51.605030+0000","last_became_active":"2024-09-17T02:24:30.699410+0000","last_became_peered":"2024-09-17T02:24:30.699410+0000","last_unstale":"2024-09-17T02:24:51.605030+0000","last_undegraded":"2024-09-17T02:24:51.605030+0000","last_fullsized":"2024-09-17T02:24:51.605030+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:29.137738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275593+0000","last_change":"2024-09-17T02:24:34.727144+0000","last_active":"2024-09-17T02:24:52.275593+0000","last_peered":"2024-09-17T02:24:52.275593+0000","last_clean":"2024-09-17T02:24:52.275593+0000","last_became_active":"2024-09-17T02:24:34.725109+0000","last_became_peered":"2024-09-17T02:24:34.725109+0000","last_unstale":"2024-09-17T02:24:52.275593+0000","last_undegraded":"2024-09-17T02:24:52.275593+0000","last_fullsized":"2024-09-17T02:24:52.275593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:59.629654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.231948+0000","last_change":"2024-09-17T02:24:34.357265+0000","last_active":"2024-09-17T02:24:51.231948+0000","last_peered":"2024-09-17T02:24:51.231948+0000","last_clean":"2024-09-17T02:24:51.231948+0000","last_became_active":"2024-09-17T02:24:34.356639+0000","last_became_peered":"2024-09-17T02:24:34.356639+0000","last_unstale":"2024-09-17T02:24:51.231948+0000","last_undegraded":"2024-09-17T02:24:51.231948+0000","last_fullsized":"2024-09-17T02:24:51.231948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:30.236713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605501+0000","last_change":"2024-09-17T02:24:48.583278+0000","last_active":"2024-09-17T02:24:51.605501+0000","last_peered":"2024-09-17T02:24:51.605501+0000","last_clean":"2024-09-17T02:24:51.605501+0000","last_became_active":"2024-09-17T02:24:48.581121+0000","last_became_peered":"2024-09-17T02:24:48.581121+0000","last_unstale":"2024-09-17T02:24:51.605501+0000","last_undegraded":"2024-09-17T02:24:51.605501+0000","last_fullsized":"2024-09-17T02:24:51.605501+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:39.957807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234860+0000","last_change":"2024-09-17T02:24:30.329201+0000","last_active":"2024-09-17T02:24:51.234860+0000","last_peered":"2024-09-17T02:24:51.234860+0000","last_clean":"2024-09-17T02:24:51.234860+0000","last_became_active":"2024-09-17T02:24:30.328907+0000","last_became_peered":"2024-09-17T02:24:30.328907+0000","last_unstale":"2024-09-17T02:24:51.234860+0000","last_undegraded":"2024-09-17T02:24:51.234860+0000","last_fullsized":"2024-09-17T02:24:51.234860+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:31.463647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606423+0000","last_change":"2024-09-17T02:24:34.732466+0000","last_active":"2024-09-17T02:24:51.606423+0000","last_peered":"2024-09-17T02:24:51.606423+0000","last_clean":"2024-09-17T02:24:51.606423+0000","last_became_active":"2024-09-17T02:24:34.731598+0000","last_became_peered":"2024-09-17T02:24:34.731598+0000","last_unstale":"2024-09-17T02:24:51.606423+0000","last_undegraded":"2024-09-17T02:24:51.606423+0000","last_fullsized":"2024-09-17T02:24:51.606423+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:33.350084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275176+0000","last_change":"2024-09-17T02:24:34.730124+0000","last_active":"2024-09-17T02:24:52.275176+0000","last_peered":"2024-09-17T02:24:52.275176+0000","last_clean":"2024-09-17T02:24:52.275176+0000","last_became_active":"2024-09-17T02:24:34.727345+0000","last_became_peered":"2024-09-17T02:24:34.727345+0000","last_unstale":"2024-09-17T02:24:52.275176+0000","last_undegraded":"2024-09-17T02:24:52.275176+0000","last_fullsized":"2024-09-17T02:24:52.275176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:20.739364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275221+0000","last_change":"2024-09-17T02:24:34.731057+0000","last_active":"2024-09-17T02:24:52.275221+0000","last_peered":"2024-09-17T02:24:52.275221+0000","last_clean":"2024-09-17T02:24:52.275221+0000","last_became_active":"2024-09-17T02:24:34.730285+0000","last_became_peered":"2024-09-17T02:24:34.730285+0000","last_unstale":"2024-09-17T02:24:52.275221+0000","last_undegraded":"2024-09-17T02:24:52.275221+0000","last_fullsized":"2024-09-17T02:24:52.275221+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:28.085866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604612+0000","last_change":"2024-09-17T02:24:30.702653+0000","last_active":"2024-09-17T02:24:51.604612+0000","last_peered":"2024-09-17T02:24:51.604612+0000","last_clean":"2024-09-17T02:24:51.604612+0000","last_became_active":"2024-09-17T02:24:30.701047+0000","last_became_peered":"2024-09-17T02:24:30.701047+0000","last_unstale":"2024-09-17T02:24:51.604612+0000","last_undegraded":"2024-09-17T02:24:51.604612+0000","last_fullsized":"2024-09-17T02:24:51.604612+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:26.569439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277891+0000","last_change":"2024-09-17T02:24:30.698841+0000","last_active":"2024-09-17T02:24:52.277891+0000","last_peered":"2024-09-17T02:24:52.277891+0000","last_clean":"2024-09-17T02:24:52.277891+0000","last_became_active":"2024-09-17T02:24:30.697606+0000","last_became_peered":"2024-09-17T02:24:30.697606+0000","last_unstale":"2024-09-17T02:24:52.277891+0000","last_undegraded":"2024-09-17T02:24:52.277891+0000","last_fullsized":"2024-09-17T02:24:52.277891+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:20.038861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232570+0000","last_change":"2024-09-17T02:24:30.336630+0000","last_active":"2024-09-17T02:24:51.232570+0000","last_peered":"2024-09-17T02:24:51.232570+0000","last_clean":"2024-09-17T02:24:51.232570+0000","last_became_active":"2024-09-17T02:24:30.336326+0000","last_became_peered":"2024-09-17T02:24:30.336326+0000","last_unstale":"2024-09-17T02:24:51.232570+0000","last_undegraded":"2024-09-17T02:24:51.232570+0000","last_fullsized":"2024-09-17T02:24:51.232570+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:30.072709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.236283+0000","last_change":"2024-09-17T02:24:30.336771+0000","last_active":"2024-09-17T02:24:51.236283+0000","last_peered":"2024-09-17T02:24:51.236283+0000","last_clean":"2024-09-17T02:24:51.236283+0000","last_became_active":"2024-09-17T02:24:30.336494+0000","last_became_peered":"2024-09-17T02:24:30.336494+0000","last_unstale":"2024-09-17T02:24:51.236283+0000","last_undegraded":"2024-09-17T02:24:51.236283+0000","last_fullsized":"2024-09-17T02:24:51.236283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:17.852502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604224+0000","last_change":"2024-09-17T02:24:48.583894+0000","last_active":"2024-09-17T02:24:51.604224+0000","last_peered":"2024-09-17T02:24:51.604224+0000","last_clean":"2024-09-17T02:24:51.604224+0000","last_became_active":"2024-09-17T02:24:48.580644+0000","last_became_peered":"2024-09-17T02:24:48.580644+0000","last_unstale":"2024-09-17T02:24:51.604224+0000","last_undegraded":"2024-09-17T02:24:51.604224+0000","last_fullsized":"2024-09-17T02:24:51.604224+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:15.855050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":165,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606071+0000","last_change":"2024-09-17T02:24:30.697584+0000","last_active":"2024-09-17T02:24:51.606071+0000","last_peered":"2024-09-17T02:24:51.606071+0000","last_clean":"2024-09-17T02:24:51.606071+0000","last_became_active":"2024-09-17T02:24:30.695140+0000","last_became_peered":"2024-09-17T02:24:30.695140+0000","last_unstale":"2024-09-17T02:24:51.606071+0000","last_undegraded":"2024-09-17T02:24:51.606071+0000","last_fullsized":"2024-09-17T02:24:51.606071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:07.386102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604282+0000","last_change":"2024-09-17T02:24:48.577640+0000","last_active":"2024-09-17T02:24:51.604282+0000","last_peered":"2024-09-17T02:24:51.604282+0000","last_clean":"2024-09-17T02:24:51.604282+0000","last_became_active":"2024-09-17T02:24:48.576802+0000","last_became_peered":"2024-09-17T02:24:48.576802+0000","last_unstale":"2024-09-17T02:24:51.604282+0000","last_undegraded":"2024-09-17T02:24:51.604282+0000","last_fullsized":"2024-09-17T02:24:51.604282+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:11.030891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234885+0000","last_change":"2024-09-17T02:24:30.338939+0000","last_active":"2024-09-17T02:24:51.234885+0000","last_peered":"2024-09-17T02:24:51.234885+0000","last_clean":"2024-09-17T02:24:51.234885+0000","last_became_active":"2024-09-17T02:24:30.337650+0000","last_became_peered":"2024-09-17T02:24:30.337650+0000","last_unstale":"2024-09-17T02:24:51.234885+0000","last_undegraded":"2024-09-17T02:24:51.234885+0000","last_fullsized":"2024-09-17T02:24:51.234885+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:00.927950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234077+0000","last_change":"2024-09-17T02:24:30.322785+0000","last_active":"2024-09-17T02:24:51.234077+0000","last_peered":"2024-09-17T02:24:51.234077+0000","last_clean":"2024-09-17T02:24:51.234077+0000","last_became_active":"2024-09-17T02:24:30.322509+0000","last_became_peered":"2024-09-17T02:24:30.322509+0000","last_unstale":"2024-09-17T02:24:51.234077+0000","last_undegraded":"2024-09-17T02:24:51.234077+0000","last_fullsized":"2024-09-17T02:24:51.234077+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:06.381434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234190+0000","last_change":"2024-09-17T02:24:30.329944+0000","last_active":"2024-09-17T02:24:51.234190+0000","last_peered":"2024-09-17T02:24:51.234190+0000","last_clean":"2024-09-17T02:24:51.234190+0000","last_became_active":"2024-09-17T02:24:30.329642+0000","last_became_peered":"2024-09-17T02:24:30.329642+0000","last_unstale":"2024-09-17T02:24:51.234190+0000","last_undegraded":"2024-09-17T02:24:51.234190+0000","last_fullsized":"2024-09-17T02:24:51.234190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:39.135831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277004+0000","last_change":"2024-09-17T02:24:30.699239+0000","last_active":"2024-09-17T02:24:52.277004+0000","last_peered":"2024-09-17T02:24:52.277004+0000","last_clean":"2024-09-17T02:24:52.277004+0000","last_became_active":"2024-09-17T02:24:30.697800+0000","last_became_peered":"2024-09-17T02:24:30.697800+0000","last_unstale":"2024-09-17T02:24:52.277004+0000","last_undegraded":"2024-09-17T02:24:52.277004+0000","last_fullsized":"2024-09-17T02:24:52.277004+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:42.056577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":165,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277720+0000","last_change":"2024-09-17T02:24:30.697486+0000","last_active":"2024-09-17T02:24:52.277720+0000","last_peered":"2024-09-17T02:24:52.277720+0000","last_clean":"2024-09-17T02:24:52.277720+0000","last_became_active":"2024-09-17T02:24:30.696079+0000","last_became_peered":"2024-09-17T02:24:30.696079+0000","last_unstale":"2024-09-17T02:24:52.277720+0000","last_undegraded":"2024-09-17T02:24:52.277720+0000","last_fullsized":"2024-09-17T02:24:52.277720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:07.222731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234635+0000","last_change":"2024-09-17T02:24:30.330194+0000","last_active":"2024-09-17T02:24:51.234635+0000","last_peered":"2024-09-17T02:24:51.234635+0000","last_clean":"2024-09-17T02:24:51.234635+0000","last_became_active":"2024-09-17T02:24:30.329676+0000","last_became_peered":"2024-09-17T02:24:30.329676+0000","last_unstale":"2024-09-17T02:24:51.234635+0000","last_undegraded":"2024-09-17T02:24:51.234635+0000","last_fullsized":"2024-09-17T02:24:51.234635+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:50:41.161871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232120+0000","last_change":"2024-09-17T02:24:34.360950+0000","last_active":"2024-09-17T02:24:51.232120+0000","last_peered":"2024-09-17T02:24:51.232120+0000","last_clean":"2024-09-17T02:24:51.232120+0000","last_became_active":"2024-09-17T02:24:34.360020+0000","last_became_peered":"2024-09-17T02:24:34.360020+0000","last_unstale":"2024-09-17T02:24:51.232120+0000","last_undegraded":"2024-09-17T02:24:51.232120+0000","last_fullsized":"2024-09-17T02:24:51.232120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:57.653961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234818+0000","last_change":"2024-09-17T02:24:30.338531+0000","last_active":"2024-09-17T02:24:51.234818+0000","last_peered":"2024-09-17T02:24:51.234818+0000","last_clean":"2024-09-17T02:24:51.234818+0000","last_became_active":"2024-09-17T02:24:30.336902+0000","last_became_peered":"2024-09-17T02:24:30.336902+0000","last_unstale":"2024-09-17T02:24:51.234818+0000","last_undegraded":"2024-09-17T02:24:51.234818+0000","last_fullsized":"2024-09-17T02:24:51.234818+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:49.660896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":101,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604622+0000","last_change":"2024-09-17T02:24:48.579411+0000","last_active":"2024-09-17T02:24:51.604622+0000","last_peered":"2024-09-17T02:24:51.604622+0000","last_clean":"2024-09-17T02:24:51.604622+0000","last_became_active":"2024-09-17T02:24:48.578461+0000","last_became_peered":"2024-09-17T02:24:48.578461+0000","last_unstale":"2024-09-17T02:24:51.604622+0000","last_undegraded":"2024-09-17T02:24:51.604622+0000","last_fullsized":"2024-09-17T02:24:51.604622+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:09:43.054480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.236338+0000","last_change":"2024-09-17T02:24:30.326828+0000","last_active":"2024-09-17T02:24:51.236338+0000","last_peered":"2024-09-17T02:24:51.236338+0000","last_clean":"2024-09-17T02:24:51.236338+0000","last_became_active":"2024-09-17T02:24:30.326227+0000","last_became_peered":"2024-09-17T02:24:30.326227+0000","last_unstale":"2024-09-17T02:24:51.236338+0000","last_undegraded":"2024-09-17T02:24:51.236338+0000","last_fullsized":"2024-09-17T02:24:51.236338+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:53.135460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604435+0000","last_change":"2024-09-17T02:24:48.580927+0000","last_active":"2024-09-17T02:24:51.604435+0000","last_peered":"2024-09-17T02:24:51.604435+0000","last_clean":"2024-09-17T02:24:51.604435+0000","last_became_active":"2024-09-17T02:24:48.578678+0000","last_became_peered":"2024-09-17T02:24:48.578678+0000","last_unstale":"2024-09-17T02:24:51.604435+0000","last_undegraded":"2024-09-17T02:24:51.604435+0000","last_fullsized":"2024-09-17T02:24:51.604435+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:46.131656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277923+0000","last_change":"2024-09-17T02:20:16.583084+0000","last_active":"2024-09-17T02:24:52.277923+0000","last_peered":"2024-09-17T02:24:52.277923+0000","last_clean":"2024-09-17T02:24:52.277923+0000","last_became_active":"2024-09-17T02:20:16.582326+0000","last_became_peered":"2024-09-17T02:20:16.582326+0000","last_unstale":"2024-09-17T02:24:52.277923+0000","last_undegraded":"2024-09-17T02:24:52.277923+0000","last_fullsized":"2024-09-17T02:24:52.277923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:05.049317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":236,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232539+0000","last_change":"2024-09-17T02:24:30.338760+0000","last_active":"2024-09-17T02:24:51.232539+0000","last_peered":"2024-09-17T02:24:51.232539+0000","last_clean":"2024-09-17T02:24:51.232539+0000","last_became_active":"2024-09-17T02:24:30.338214+0000","last_became_peered":"2024-09-17T02:24:30.338214+0000","last_unstale":"2024-09-17T02:24:51.232539+0000","last_undegraded":"2024-09-17T02:24:51.232539+0000","last_fullsized":"2024-09-17T02:24:51.232539+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_clean_scrub_stamp":"2024-09-17T02:20:03.432050+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:27:29.124652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":60,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233731+0000","last_change":"2024-09-17T02:24:30.325326+0000","last_active":"2024-09-17T02:24:51.233731+0000","last_peered":"2024-09-17T02:24:51.233731+0000","last_clean":"2024-09-17T02:24:51.233731+0000","last_became_active":"2024-09-17T02:24:30.324910+0000","last_became_peered":"2024-09-17T02:24:30.324910+0000","last_unstale":"2024-09-17T02:24:51.233731+0000","last_undegraded":"2024-09-17T02:24:51.233731+0000","last_fullsized":"2024-09-17T02:24:51.233731+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:52:27.682190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276836+0000","last_change":"2024-09-17T02:20:15.560646+0000","last_active":"2024-09-17T02:24:52.276836+0000","last_peered":"2024-09-17T02:24:52.276836+0000","last_clean":"2024-09-17T02:24:52.276836+0000","last_became_active":"2024-09-17T02:20:15.559104+0000","last_became_peered":"2024-09-17T02:20:15.559104+0000","last_unstale":"2024-09-17T02:24:52.276836+0000","last_undegraded":"2024-09-17T02:24:52.276836+0000","last_fullsized":"2024-09-17T02:24:52.276836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:44.299986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235150+0000","last_change":"2024-09-17T02:24:30.339100+0000","last_active":"2024-09-17T02:24:51.235150+0000","last_peered":"2024-09-17T02:24:51.235150+0000","last_clean":"2024-09-17T02:24:51.235150+0000","last_became_active":"2024-09-17T02:24:30.337415+0000","last_became_peered":"2024-09-17T02:24:30.337415+0000","last_unstale":"2024-09-17T02:24:51.235150+0000","last_undegraded":"2024-09-17T02:24:51.235150+0000","last_fullsized":"2024-09-17T02:24:51.235150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:27.682975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233159+0000","last_change":"2024-09-17T02:24:30.338621+0000","last_active":"2024-09-17T02:24:51.233159+0000","last_peered":"2024-09-17T02:24:51.233159+0000","last_clean":"2024-09-17T02:24:51.233159+0000","last_became_active":"2024-09-17T02:24:30.338024+0000","last_became_peered":"2024-09-17T02:24:30.338024+0000","last_unstale":"2024-09-17T02:24:51.233159+0000","last_undegraded":"2024-09-17T02:24:51.233159+0000","last_fullsized":"2024-09-17T02:24:51.233159+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:49.985865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276198+0000","last_change":"2024-09-17T02:24:30.694491+0000","last_active":"2024-09-17T02:24:52.276198+0000","last_peered":"2024-09-17T02:24:52.276198+0000","last_clean":"2024-09-17T02:24:52.276198+0000","last_became_active":"2024-09-17T02:24:30.693653+0000","last_became_peered":"2024-09-17T02:24:30.693653+0000","last_unstale":"2024-09-17T02:24:52.276198+0000","last_undegraded":"2024-09-17T02:24:52.276198+0000","last_fullsized":"2024-09-17T02:24:52.276198+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:12.740030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605591+0000","last_change":"2024-09-17T02:20:16.571568+0000","last_active":"2024-09-17T02:24:51.605591+0000","last_peered":"2024-09-17T02:24:51.605591+0000","last_clean":"2024-09-17T02:24:51.605591+0000","last_became_active":"2024-09-17T02:20:16.570622+0000","last_became_peered":"2024-09-17T02:20:16.570622+0000","last_unstale":"2024-09-17T02:24:51.605591+0000","last_undegraded":"2024-09-17T02:24:51.605591+0000","last_fullsized":"2024-09-17T02:24:51.605591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:57.083446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276496+0000","last_change":"2024-09-17T02:20:12.511823+0000","last_active":"2024-09-17T02:24:52.276496+0000","last_peered":"2024-09-17T02:24:52.276496+0000","last_clean":"2024-09-17T02:24:52.276496+0000","last_became_active":"2024-09-17T02:20:10.497164+0000","last_became_peered":"2024-09-17T02:20:10.497164+0000","last_unstale":"2024-09-17T02:24:52.276496+0000","last_undegraded":"2024-09-17T02:24:52.276496+0000","last_fullsized":"2024-09-17T02:24:52.276496+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:21.242753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081052700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":101,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604499+0000","last_change":"2024-09-17T02:24:48.585305+0000","last_active":"2024-09-17T02:24:51.604499+0000","last_peered":"2024-09-17T02:24:51.604499+0000","last_clean":"2024-09-17T02:24:51.604499+0000","last_became_active":"2024-09-17T02:24:48.582729+0000","last_became_peered":"2024-09-17T02:24:48.582729+0000","last_unstale":"2024-09-17T02:24:51.604499+0000","last_undegraded":"2024-09-17T02:24:51.604499+0000","last_fullsized":"2024-09-17T02:24:51.604499+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:58.012479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277630+0000","last_change":"2024-09-17T02:24:34.730636+0000","last_active":"2024-09-17T02:24:52.277630+0000","last_peered":"2024-09-17T02:24:52.277630+0000","last_clean":"2024-09-17T02:24:52.277630+0000","last_became_active":"2024-09-17T02:24:34.729890+0000","last_became_peered":"2024-09-17T02:24:34.729890+0000","last_unstale":"2024-09-17T02:24:52.277630+0000","last_undegraded":"2024-09-17T02:24:52.277630+0000","last_fullsized":"2024-09-17T02:24:52.277630+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:07.679985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232887+0000","last_change":"2024-09-17T02:24:30.333204+0000","last_active":"2024-09-17T02:24:51.232887+0000","last_peered":"2024-09-17T02:24:51.232887+0000","last_clean":"2024-09-17T02:24:51.232887+0000","last_became_active":"2024-09-17T02:24:30.333005+0000","last_became_peered":"2024-09-17T02:24:30.333005+0000","last_unstale":"2024-09-17T02:24:51.232887+0000","last_undegraded":"2024-09-17T02:24:51.232887+0000","last_fullsized":"2024-09-17T02:24:51.232887+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:17.620422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078085399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234838+0000","last_change":"2024-09-17T02:24:30.329442+0000","last_active":"2024-09-17T02:24:51.234838+0000","last_peered":"2024-09-17T02:24:51.234838+0000","last_clean":"2024-09-17T02:24:51.234838+0000","last_became_active":"2024-09-17T02:24:30.329213+0000","last_became_peered":"2024-09-17T02:24:30.329213+0000","last_unstale":"2024-09-17T02:24:51.234838+0000","last_undegraded":"2024-09-17T02:24:51.234838+0000","last_fullsized":"2024-09-17T02:24:51.234838+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:25.034116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277315+0000","last_change":"2024-09-17T02:20:16.580184+0000","last_active":"2024-09-17T02:24:52.277315+0000","last_peered":"2024-09-17T02:24:52.277315+0000","last_clean":"2024-09-17T02:24:52.277315+0000","last_became_active":"2024-09-17T02:20:16.578343+0000","last_became_peered":"2024-09-17T02:20:16.578343+0000","last_unstale":"2024-09-17T02:24:52.277315+0000","last_undegraded":"2024-09-17T02:24:52.277315+0000","last_fullsized":"2024-09-17T02:24:52.277315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:42.123535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232100+0000","last_change":"2024-09-17T02:24:34.354157+0000","last_active":"2024-09-17T02:24:51.232100+0000","last_peered":"2024-09-17T02:24:51.232100+0000","last_clean":"2024-09-17T02:24:51.232100+0000","last_became_active":"2024-09-17T02:24:34.353619+0000","last_became_peered":"2024-09-17T02:24:34.353619+0000","last_unstale":"2024-09-17T02:24:51.232100+0000","last_undegraded":"2024-09-17T02:24:51.232100+0000","last_fullsized":"2024-09-17T02:24:51.232100+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:53:03.444794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277559+0000","last_change":"2024-09-17T02:20:12.511838+0000","last_active":"2024-09-17T02:24:52.277559+0000","last_peered":"2024-09-17T02:24:52.277559+0000","last_clean":"2024-09-17T02:24:52.277559+0000","last_became_active":"2024-09-17T02:20:10.497049+0000","last_became_peered":"2024-09-17T02:20:10.497049+0000","last_unstale":"2024-09-17T02:24:52.277559+0000","last_undegraded":"2024-09-17T02:24:52.277559+0000","last_fullsized":"2024-09-17T02:24:52.277559+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:54.446484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079701100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604586+0000","last_change":"2024-09-17T02:24:30.698392+0000","last_active":"2024-09-17T02:24:51.604586+0000","last_peered":"2024-09-17T02:24:51.604586+0000","last_clean":"2024-09-17T02:24:51.604586+0000","last_became_active":"2024-09-17T02:24:30.694944+0000","last_became_peered":"2024-09-17T02:24:30.694944+0000","last_unstale":"2024-09-17T02:24:51.604586+0000","last_undegraded":"2024-09-17T02:24:51.604586+0000","last_fullsized":"2024-09-17T02:24:51.604586+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:06.407404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277487+0000","last_change":"2024-09-17T02:20:15.559252+0000","last_active":"2024-09-17T02:24:52.277487+0000","last_peered":"2024-09-17T02:24:52.277487+0000","last_clean":"2024-09-17T02:24:52.277487+0000","last_became_active":"2024-09-17T02:20:15.557667+0000","last_became_peered":"2024-09-17T02:20:15.557667+0000","last_unstale":"2024-09-17T02:24:52.277487+0000","last_undegraded":"2024-09-17T02:24:52.277487+0000","last_fullsized":"2024-09-17T02:24:52.277487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:01.292626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606815+0000","last_change":"2024-09-17T02:20:12.661034+0000","last_active":"2024-09-17T02:24:51.606815+0000","last_peered":"2024-09-17T02:24:51.606815+0000","last_clean":"2024-09-17T02:24:51.606815+0000","last_became_active":"2024-09-17T02:20:10.497829+0000","last_became_peered":"2024-09-17T02:20:10.497829+0000","last_unstale":"2024-09-17T02:24:51.606815+0000","last_undegraded":"2024-09-17T02:24:51.606815+0000","last_fullsized":"2024-09-17T02:24:51.606815+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:46:27.427685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096944700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605391+0000","last_change":"2024-09-17T02:24:48.581467+0000","last_active":"2024-09-17T02:24:51.605391+0000","last_peered":"2024-09-17T02:24:51.605391+0000","last_clean":"2024-09-17T02:24:51.605391+0000","last_became_active":"2024-09-17T02:24:48.580388+0000","last_became_peered":"2024-09-17T02:24:48.580388+0000","last_unstale":"2024-09-17T02:24:51.605391+0000","last_undegraded":"2024-09-17T02:24:51.605391+0000","last_fullsized":"2024-09-17T02:24:51.605391+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:21:11.358704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278338+0000","last_change":"2024-09-17T02:20:15.558961+0000","last_active":"2024-09-17T02:24:52.278338+0000","last_peered":"2024-09-17T02:24:52.278338+0000","last_clean":"2024-09-17T02:24:52.278338+0000","last_became_active":"2024-09-17T02:20:15.558299+0000","last_became_peered":"2024-09-17T02:20:15.558299+0000","last_unstale":"2024-09-17T02:24:52.278338+0000","last_undegraded":"2024-09-17T02:24:52.278338+0000","last_fullsized":"2024-09-17T02:24:52.278338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:39.709524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278295+0000","last_change":"2024-09-17T02:20:12.512481+0000","last_active":"2024-09-17T02:24:52.278295+0000","last_peered":"2024-09-17T02:24:52.278295+0000","last_clean":"2024-09-17T02:24:52.278295+0000","last_became_active":"2024-09-17T02:20:10.497021+0000","last_became_peered":"2024-09-17T02:20:10.497021+0000","last_unstale":"2024-09-17T02:24:52.278295+0000","last_undegraded":"2024-09-17T02:24:52.278295+0000","last_fullsized":"2024-09-17T02:24:52.278295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:41.167283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001400079,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276096+0000","last_change":"2024-09-17T02:24:30.693811+0000","last_active":"2024-09-17T02:24:52.276096+0000","last_peered":"2024-09-17T02:24:52.276096+0000","last_clean":"2024-09-17T02:24:52.276096+0000","last_became_active":"2024-09-17T02:24:30.691331+0000","last_became_peered":"2024-09-17T02:24:30.691331+0000","last_unstale":"2024-09-17T02:24:52.276096+0000","last_undegraded":"2024-09-17T02:24:52.276096+0000","last_fullsized":"2024-09-17T02:24:52.276096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:39.446085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":164,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278098+0000","last_change":"2024-09-17T02:24:30.694492+0000","last_active":"2024-09-17T02:24:52.278098+0000","last_peered":"2024-09-17T02:24:52.278098+0000","last_clean":"2024-09-17T02:24:52.278098+0000","last_became_active":"2024-09-17T02:24:30.691770+0000","last_became_peered":"2024-09-17T02:24:30.691770+0000","last_unstale":"2024-09-17T02:24:52.278098+0000","last_undegraded":"2024-09-17T02:24:52.278098+0000","last_fullsized":"2024-09-17T02:24:52.278098+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:01.597617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235468+0000","last_change":"2024-09-17T02:24:30.336636+0000","last_active":"2024-09-17T02:24:51.235468+0000","last_peered":"2024-09-17T02:24:51.235468+0000","last_clean":"2024-09-17T02:24:51.235468+0000","last_became_active":"2024-09-17T02:24:30.336110+0000","last_became_peered":"2024-09-17T02:24:30.336110+0000","last_unstale":"2024-09-17T02:24:51.235468+0000","last_undegraded":"2024-09-17T02:24:51.235468+0000","last_fullsized":"2024-09-17T02:24:51.235468+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:44.699884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604333+0000","last_change":"2024-09-17T02:24:30.700777+0000","last_active":"2024-09-17T02:24:51.604333+0000","last_peered":"2024-09-17T02:24:51.604333+0000","last_clean":"2024-09-17T02:24:51.604333+0000","last_became_active":"2024-09-17T02:24:30.696731+0000","last_became_peered":"2024-09-17T02:24:30.696731+0000","last_unstale":"2024-09-17T02:24:51.604333+0000","last_undegraded":"2024-09-17T02:24:51.604333+0000","last_fullsized":"2024-09-17T02:24:51.604333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:58.629953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234416+0000","last_change":"2024-09-17T02:24:30.326364+0000","last_active":"2024-09-17T02:24:51.234416+0000","last_peered":"2024-09-17T02:24:51.234416+0000","last_clean":"2024-09-17T02:24:51.234416+0000","last_became_active":"2024-09-17T02:24:30.325752+0000","last_became_peered":"2024-09-17T02:24:30.325752+0000","last_unstale":"2024-09-17T02:24:51.234416+0000","last_undegraded":"2024-09-17T02:24:51.234416+0000","last_fullsized":"2024-09-17T02:24:51.234416+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:33.800584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233479+0000","last_change":"2024-09-17T02:24:30.325924+0000","last_active":"2024-09-17T02:24:51.233479+0000","last_peered":"2024-09-17T02:24:51.233479+0000","last_clean":"2024-09-17T02:24:51.233479+0000","last_became_active":"2024-09-17T02:24:30.325688+0000","last_became_peered":"2024-09-17T02:24:30.325688+0000","last_unstale":"2024-09-17T02:24:51.233479+0000","last_undegraded":"2024-09-17T02:24:51.233479+0000","last_fullsized":"2024-09-17T02:24:51.233479+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:25.290483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276040+0000","last_change":"2024-09-17T02:24:34.731288+0000","last_active":"2024-09-17T02:24:52.276040+0000","last_peered":"2024-09-17T02:24:52.276040+0000","last_clean":"2024-09-17T02:24:52.276040+0000","last_became_active":"2024-09-17T02:24:34.730386+0000","last_became_peered":"2024-09-17T02:24:34.730386+0000","last_unstale":"2024-09-17T02:24:52.276040+0000","last_undegraded":"2024-09-17T02:24:52.276040+0000","last_fullsized":"2024-09-17T02:24:52.276040+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:45.808940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":103,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606673+0000","last_change":"2024-09-17T02:24:48.583147+0000","last_active":"2024-09-17T02:24:51.606673+0000","last_peered":"2024-09-17T02:24:51.606673+0000","last_clean":"2024-09-17T02:24:51.606673+0000","last_became_active":"2024-09-17T02:24:48.581390+0000","last_became_peered":"2024-09-17T02:24:48.581390+0000","last_unstale":"2024-09-17T02:24:51.606673+0000","last_undegraded":"2024-09-17T02:24:51.606673+0000","last_fullsized":"2024-09-17T02:24:51.606673+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:08.312173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235572+0000","last_change":"2024-09-17T02:24:30.325492+0000","last_active":"2024-09-17T02:24:51.235572+0000","last_peered":"2024-09-17T02:24:51.235572+0000","last_clean":"2024-09-17T02:24:51.235572+0000","last_became_active":"2024-09-17T02:24:30.325175+0000","last_became_peered":"2024-09-17T02:24:30.325175+0000","last_unstale":"2024-09-17T02:24:51.235572+0000","last_undegraded":"2024-09-17T02:24:51.235572+0000","last_fullsized":"2024-09-17T02:24:51.235572+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:04.443085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275866+0000","last_change":"2024-09-17T02:24:30.699551+0000","last_active":"2024-09-17T02:24:52.275866+0000","last_peered":"2024-09-17T02:24:52.275866+0000","last_clean":"2024-09-17T02:24:52.275866+0000","last_became_active":"2024-09-17T02:24:30.697986+0000","last_became_peered":"2024-09-17T02:24:30.697986+0000","last_unstale":"2024-09-17T02:24:52.275866+0000","last_undegraded":"2024-09-17T02:24:52.275866+0000","last_fullsized":"2024-09-17T02:24:52.275866+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:44.939985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278191+0000","last_change":"2024-09-17T02:24:30.697249+0000","last_active":"2024-09-17T02:24:52.278191+0000","last_peered":"2024-09-17T02:24:52.278191+0000","last_clean":"2024-09-17T02:24:52.278191+0000","last_became_active":"2024-09-17T02:24:30.696215+0000","last_became_peered":"2024-09-17T02:24:30.696215+0000","last_unstale":"2024-09-17T02:24:52.278191+0000","last_undegraded":"2024-09-17T02:24:52.278191+0000","last_fullsized":"2024-09-17T02:24:52.278191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:07.507822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276041+0000","last_change":"2024-09-17T02:20:16.577803+0000","last_active":"2024-09-17T02:24:52.276041+0000","last_peered":"2024-09-17T02:24:52.276041+0000","last_clean":"2024-09-17T02:24:52.276041+0000","last_became_active":"2024-09-17T02:20:16.576640+0000","last_became_peered":"2024-09-17T02:20:16.576640+0000","last_unstale":"2024-09-17T02:24:52.276041+0000","last_undegraded":"2024-09-17T02:24:52.276041+0000","last_fullsized":"2024-09-17T02:24:52.276041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:07.190169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606196+0000","last_change":"2024-09-17T02:24:30.706739+0000","last_active":"2024-09-17T02:24:51.606196+0000","last_peered":"2024-09-17T02:24:51.606196+0000","last_clean":"2024-09-17T02:24:51.606196+0000","last_became_active":"2024-09-17T02:24:30.706195+0000","last_became_peered":"2024-09-17T02:24:30.706195+0000","last_unstale":"2024-09-17T02:24:51.606196+0000","last_undegraded":"2024-09-17T02:24:51.606196+0000","last_fullsized":"2024-09-17T02:24:51.606196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:38.782264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275411+0000","last_change":"2024-09-17T02:24:34.733762+0000","last_active":"2024-09-17T02:24:52.275411+0000","last_peered":"2024-09-17T02:24:52.275411+0000","last_clean":"2024-09-17T02:24:52.275411+0000","last_became_active":"2024-09-17T02:24:34.731592+0000","last_became_peered":"2024-09-17T02:24:34.731592+0000","last_unstale":"2024-09-17T02:24:52.275411+0000","last_undegraded":"2024-09-17T02:24:52.275411+0000","last_fullsized":"2024-09-17T02:24:52.275411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:41.921908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277777+0000","last_change":"2024-09-17T02:24:30.696267+0000","last_active":"2024-09-17T02:24:52.277777+0000","last_peered":"2024-09-17T02:24:52.277777+0000","last_clean":"2024-09-17T02:24:52.277777+0000","last_became_active":"2024-09-17T02:24:30.694027+0000","last_became_peered":"2024-09-17T02:24:30.694027+0000","last_unstale":"2024-09-17T02:24:52.277777+0000","last_undegraded":"2024-09-17T02:24:52.277777+0000","last_fullsized":"2024-09-17T02:24:52.277777+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:56.160158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276145+0000","last_change":"2024-09-17T02:24:30.697568+0000","last_active":"2024-09-17T02:24:52.276145+0000","last_peered":"2024-09-17T02:24:52.276145+0000","last_clean":"2024-09-17T02:24:52.276145+0000","last_became_active":"2024-09-17T02:24:30.693991+0000","last_became_peered":"2024-09-17T02:24:30.693991+0000","last_unstale":"2024-09-17T02:24:52.276145+0000","last_undegraded":"2024-09-17T02:24:52.276145+0000","last_fullsized":"2024-09-17T02:24:52.276145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:45.636130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606140+0000","last_change":"2024-09-17T02:21:10.505967+0000","last_active":"2024-09-17T02:24:51.606140+0000","last_peered":"2024-09-17T02:24:51.606140+0000","last_clean":"2024-09-17T02:24:51.606140+0000","last_became_active":"2024-09-17T02:21:10.505594+0000","last_became_peered":"2024-09-17T02:21:10.505594+0000","last_unstale":"2024-09-17T02:24:51.606140+0000","last_undegraded":"2024-09-17T02:24:51.606140+0000","last_fullsized":"2024-09-17T02:24:51.606140+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:15.782752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605310+0000","last_change":"2024-09-17T02:24:48.579594+0000","last_active":"2024-09-17T02:24:51.605310+0000","last_peered":"2024-09-17T02:24:51.605310+0000","last_clean":"2024-09-17T02:24:51.605310+0000","last_became_active":"2024-09-17T02:24:48.578539+0000","last_became_peered":"2024-09-17T02:24:48.578539+0000","last_unstale":"2024-09-17T02:24:51.605310+0000","last_undegraded":"2024-09-17T02:24:51.605310+0000","last_fullsized":"2024-09-17T02:24:51.605310+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:11.515508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605322+0000","last_change":"2024-09-17T02:24:48.580567+0000","last_active":"2024-09-17T02:24:51.605322+0000","last_peered":"2024-09-17T02:24:51.605322+0000","last_clean":"2024-09-17T02:24:51.605322+0000","last_became_active":"2024-09-17T02:24:48.579612+0000","last_became_peered":"2024-09-17T02:24:48.579612+0000","last_unstale":"2024-09-17T02:24:51.605322+0000","last_undegraded":"2024-09-17T02:24:51.605322+0000","last_fullsized":"2024-09-17T02:24:51.605322+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:28:53.281135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605697+0000","last_change":"2024-09-17T02:24:30.698237+0000","last_active":"2024-09-17T02:24:51.605697+0000","last_peered":"2024-09-17T02:24:51.605697+0000","last_clean":"2024-09-17T02:24:51.605697+0000","last_became_active":"2024-09-17T02:24:30.697194+0000","last_became_peered":"2024-09-17T02:24:30.697194+0000","last_unstale":"2024-09-17T02:24:51.605697+0000","last_undegraded":"2024-09-17T02:24:51.605697+0000","last_fullsized":"2024-09-17T02:24:51.605697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:36.697224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232314+0000","last_change":"2024-09-17T02:24:34.360811+0000","last_active":"2024-09-17T02:24:51.232314+0000","last_peered":"2024-09-17T02:24:51.232314+0000","last_clean":"2024-09-17T02:24:51.232314+0000","last_became_active":"2024-09-17T02:24:34.359944+0000","last_became_peered":"2024-09-17T02:24:34.359944+0000","last_unstale":"2024-09-17T02:24:51.232314+0000","last_undegraded":"2024-09-17T02:24:51.232314+0000","last_fullsized":"2024-09-17T02:24:51.232314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:07.986774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234185+0000","last_change":"2024-09-17T02:24:30.327080+0000","last_active":"2024-09-17T02:24:51.234185+0000","last_peered":"2024-09-17T02:24:51.234185+0000","last_clean":"2024-09-17T02:24:51.234185+0000","last_became_active":"2024-09-17T02:24:30.326800+0000","last_became_peered":"2024-09-17T02:24:30.326800+0000","last_unstale":"2024-09-17T02:24:51.234185+0000","last_undegraded":"2024-09-17T02:24:51.234185+0000","last_fullsized":"2024-09-17T02:24:51.234185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:06.072812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233254+0000","last_change":"2024-09-17T02:24:30.322448+0000","last_active":"2024-09-17T02:24:51.233254+0000","last_peered":"2024-09-17T02:24:51.233254+0000","last_clean":"2024-09-17T02:24:51.233254+0000","last_became_active":"2024-09-17T02:24:30.322156+0000","last_became_peered":"2024-09-17T02:24:30.322156+0000","last_unstale":"2024-09-17T02:24:51.233254+0000","last_undegraded":"2024-09-17T02:24:51.233254+0000","last_fullsized":"2024-09-17T02:24:51.233254+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:46.435146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":102,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606560+0000","last_change":"2024-09-17T02:24:48.583271+0000","last_active":"2024-09-17T02:24:51.606560+0000","last_peered":"2024-09-17T02:24:51.606560+0000","last_clean":"2024-09-17T02:24:51.606560+0000","last_became_active":"2024-09-17T02:24:48.581355+0000","last_became_peered":"2024-09-17T02:24:48.581355+0000","last_unstale":"2024-09-17T02:24:51.606560+0000","last_undegraded":"2024-09-17T02:24:51.606560+0000","last_fullsized":"2024-09-17T02:24:51.606560+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:01.234040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604953+0000","last_change":"2024-09-17T02:20:16.570456+0000","last_active":"2024-09-17T02:24:51.604953+0000","last_peered":"2024-09-17T02:24:51.604953+0000","last_clean":"2024-09-17T02:24:51.604953+0000","last_became_active":"2024-09-17T02:20:16.568095+0000","last_became_peered":"2024-09-17T02:20:16.568095+0000","last_unstale":"2024-09-17T02:24:51.604953+0000","last_undegraded":"2024-09-17T02:24:51.604953+0000","last_fullsized":"2024-09-17T02:24:51.604953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:58.329169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":157,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278020+0000","last_change":"2024-09-17T02:20:15.560293+0000","last_active":"2024-09-17T02:24:52.278020+0000","last_peered":"2024-09-17T02:24:52.278020+0000","last_clean":"2024-09-17T02:24:52.278020+0000","last_became_active":"2024-09-17T02:20:15.559074+0000","last_became_peered":"2024-09-17T02:20:15.559074+0000","last_unstale":"2024-09-17T02:24:52.278020+0000","last_undegraded":"2024-09-17T02:24:52.278020+0000","last_fullsized":"2024-09-17T02:24:52.278020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:55.639841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233448+0000","last_change":"2024-09-17T02:24:30.319629+0000","last_active":"2024-09-17T02:24:51.233448+0000","last_peered":"2024-09-17T02:24:51.233448+0000","last_clean":"2024-09-17T02:24:51.233448+0000","last_became_active":"2024-09-17T02:24:30.319441+0000","last_became_peered":"2024-09-17T02:24:30.319441+0000","last_unstale":"2024-09-17T02:24:51.233448+0000","last_undegraded":"2024-09-17T02:24:51.233448+0000","last_fullsized":"2024-09-17T02:24:51.233448+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:58.379141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":167,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278026+0000","last_change":"2024-09-17T02:24:30.699964+0000","last_active":"2024-09-17T02:24:52.278026+0000","last_peered":"2024-09-17T02:24:52.278026+0000","last_clean":"2024-09-17T02:24:52.278026+0000","last_became_active":"2024-09-17T02:24:30.699102+0000","last_became_peered":"2024-09-17T02:24:30.699102+0000","last_unstale":"2024-09-17T02:24:52.278026+0000","last_undegraded":"2024-09-17T02:24:52.278026+0000","last_fullsized":"2024-09-17T02:24:52.278026+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:19.193516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5558,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705726,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361248,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":360190,"kb_avail":94010592,"statfs":{"total":96636764160,"available":96266846208,"internally_reserved":0,"allocated":1052672,"data_stored":983227,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":368835013},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":80,"seq":343597383686,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56488,"kb_used_data":1040,"kb_used_omap":6,"kb_used_meta":55417,"kb_avail":94315352,"statfs":{"total":96636764160,"available":96578920448,"internally_reserved":0,"allocated":1064960,"data_stored":983862,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":7153,"internal_metadata":56747023},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738430,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329228,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94042612,"statfs":{"total":96636764160,"available":96299634688,"internally_reserved":0,"allocated":974848,"data_stored":387439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5558,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T02:24:54.519 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:24:54.864 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:24:54.866 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-17T02:24:54.884 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2024-09-17T02:24:53.472419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":746964,"kb_used_data":3020,"kb_used_omap":10,"kb_used_meta":743861,"kb_avail":282368556,"statfs":{"total":289910292480,"available":289145401344,"internally_reserved":0,"allocated":3092480,"data_stored":2354528,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10343,"internal_metadata":761714585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.908866"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605682+0000","last_change":"2024-09-17T02:24:34.733681+0000","last_active":"2024-09-17T02:24:51.605682+0000","last_peered":"2024-09-17T02:24:51.605682+0000","last_clean":"2024-09-17T02:24:51.605682+0000","last_became_active":"2024-09-17T02:24:34.732728+0000","last_became_peered":"2024-09-17T02:24:34.732728+0000","last_unstale":"2024-09-17T02:24:51.605682+0000","last_undegraded":"2024-09-17T02:24:51.605682+0000","last_fullsized":"2024-09-17T02:24:51.605682+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:21.613592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605214+0000","last_change":"2024-09-17T02:24:48.579919+0000","last_active":"2024-09-17T02:24:51.605214+0000","last_peered":"2024-09-17T02:24:51.605214+0000","last_clean":"2024-09-17T02:24:51.605214+0000","last_became_active":"2024-09-17T02:24:48.578274+0000","last_became_peered":"2024-09-17T02:24:48.578274+0000","last_unstale":"2024-09-17T02:24:51.605214+0000","last_undegraded":"2024-09-17T02:24:51.605214+0000","last_fullsized":"2024-09-17T02:24:51.605214+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:50.597846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.236296+0000","last_change":"2024-09-17T02:24:30.339249+0000","last_active":"2024-09-17T02:24:51.236296+0000","last_peered":"2024-09-17T02:24:51.236296+0000","last_clean":"2024-09-17T02:24:51.236296+0000","last_became_active":"2024-09-17T02:24:30.338199+0000","last_became_peered":"2024-09-17T02:24:30.338199+0000","last_unstale":"2024-09-17T02:24:51.236296+0000","last_undegraded":"2024-09-17T02:24:51.236296+0000","last_fullsized":"2024-09-17T02:24:51.236296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:51.734408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":87,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232438+0000","last_change":"2024-09-17T02:24:34.360587+0000","last_active":"2024-09-17T02:24:51.232438+0000","last_peered":"2024-09-17T02:24:51.232438+0000","last_clean":"2024-09-17T02:24:51.232438+0000","last_became_active":"2024-09-17T02:24:34.359912+0000","last_became_peered":"2024-09-17T02:24:34.359912+0000","last_unstale":"2024-09-17T02:24:51.232438+0000","last_undegraded":"2024-09-17T02:24:51.232438+0000","last_fullsized":"2024-09-17T02:24:51.232438+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:35.054937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605500+0000","last_change":"2024-09-17T02:24:48.579715+0000","last_active":"2024-09-17T02:24:51.605500+0000","last_peered":"2024-09-17T02:24:51.605500+0000","last_clean":"2024-09-17T02:24:51.605500+0000","last_became_active":"2024-09-17T02:24:48.578841+0000","last_became_peered":"2024-09-17T02:24:48.578841+0000","last_unstale":"2024-09-17T02:24:51.605500+0000","last_undegraded":"2024-09-17T02:24:51.605500+0000","last_fullsized":"2024-09-17T02:24:51.605500+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:23.197781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233991+0000","last_change":"2024-09-17T02:24:30.322619+0000","last_active":"2024-09-17T02:24:51.233991+0000","last_peered":"2024-09-17T02:24:51.233991+0000","last_clean":"2024-09-17T02:24:51.233991+0000","last_became_active":"2024-09-17T02:24:30.322191+0000","last_became_peered":"2024-09-17T02:24:30.322191+0000","last_unstale":"2024-09-17T02:24:51.233991+0000","last_undegraded":"2024-09-17T02:24:51.233991+0000","last_fullsized":"2024-09-17T02:24:51.233991+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:26.120304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233779+0000","last_change":"2024-09-17T02:24:30.330077+0000","last_active":"2024-09-17T02:24:51.233779+0000","last_peered":"2024-09-17T02:24:51.233779+0000","last_clean":"2024-09-17T02:24:51.233779+0000","last_became_active":"2024-09-17T02:24:30.329814+0000","last_became_peered":"2024-09-17T02:24:30.329814+0000","last_unstale":"2024-09-17T02:24:51.233779+0000","last_undegraded":"2024-09-17T02:24:51.233779+0000","last_fullsized":"2024-09-17T02:24:51.233779+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:09.933024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233077+0000","last_change":"2024-09-17T02:24:30.319625+0000","last_active":"2024-09-17T02:24:51.233077+0000","last_peered":"2024-09-17T02:24:51.233077+0000","last_clean":"2024-09-17T02:24:51.233077+0000","last_became_active":"2024-09-17T02:24:30.319316+0000","last_became_peered":"2024-09-17T02:24:30.319316+0000","last_unstale":"2024-09-17T02:24:51.233077+0000","last_undegraded":"2024-09-17T02:24:51.233077+0000","last_fullsized":"2024-09-17T02:24:51.233077+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:30.753462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277651+0000","last_change":"2024-09-17T02:20:16.584665+0000","last_active":"2024-09-17T02:24:52.277651+0000","last_peered":"2024-09-17T02:24:52.277651+0000","last_clean":"2024-09-17T02:24:52.277651+0000","last_became_active":"2024-09-17T02:20:16.580797+0000","last_became_peered":"2024-09-17T02:20:16.580797+0000","last_unstale":"2024-09-17T02:24:52.277651+0000","last_undegraded":"2024-09-17T02:24:52.277651+0000","last_fullsized":"2024-09-17T02:24:52.277651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:47.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605486+0000","last_change":"2024-09-17T02:24:34.733394+0000","last_active":"2024-09-17T02:24:51.605486+0000","last_peered":"2024-09-17T02:24:51.605486+0000","last_clean":"2024-09-17T02:24:51.605486+0000","last_became_active":"2024-09-17T02:24:34.732480+0000","last_became_peered":"2024-09-17T02:24:34.732480+0000","last_unstale":"2024-09-17T02:24:51.605486+0000","last_undegraded":"2024-09-17T02:24:51.605486+0000","last_fullsized":"2024-09-17T02:24:51.605486+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:37.005990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235423+0000","last_change":"2024-09-17T02:24:30.329180+0000","last_active":"2024-09-17T02:24:51.235423+0000","last_peered":"2024-09-17T02:24:51.235423+0000","last_clean":"2024-09-17T02:24:51.235423+0000","last_became_active":"2024-09-17T02:24:30.328962+0000","last_became_peered":"2024-09-17T02:24:30.328962+0000","last_unstale":"2024-09-17T02:24:51.235423+0000","last_undegraded":"2024-09-17T02:24:51.235423+0000","last_fullsized":"2024-09-17T02:24:51.235423+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:21.425064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605228+0000","last_change":"2024-09-17T02:24:48.583870+0000","last_active":"2024-09-17T02:24:51.605228+0000","last_peered":"2024-09-17T02:24:51.605228+0000","last_clean":"2024-09-17T02:24:51.605228+0000","last_became_active":"2024-09-17T02:24:48.581418+0000","last_became_peered":"2024-09-17T02:24:48.581418+0000","last_unstale":"2024-09-17T02:24:51.605228+0000","last_undegraded":"2024-09-17T02:24:51.605228+0000","last_fullsized":"2024-09-17T02:24:51.605228+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:52:52.425417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604958+0000","last_change":"2024-09-17T02:24:48.583016+0000","last_active":"2024-09-17T02:24:51.604958+0000","last_peered":"2024-09-17T02:24:51.604958+0000","last_clean":"2024-09-17T02:24:51.604958+0000","last_became_active":"2024-09-17T02:24:48.579221+0000","last_became_peered":"2024-09-17T02:24:48.579221+0000","last_unstale":"2024-09-17T02:24:51.604958+0000","last_undegraded":"2024-09-17T02:24:51.604958+0000","last_fullsized":"2024-09-17T02:24:51.604958+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:46.150529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233659+0000","last_change":"2024-09-17T02:24:30.337132+0000","last_active":"2024-09-17T02:24:51.233659+0000","last_peered":"2024-09-17T02:24:51.233659+0000","last_clean":"2024-09-17T02:24:51.233659+0000","last_became_active":"2024-09-17T02:24:30.335871+0000","last_became_peered":"2024-09-17T02:24:30.335871+0000","last_unstale":"2024-09-17T02:24:51.233659+0000","last_undegraded":"2024-09-17T02:24:51.233659+0000","last_fullsized":"2024-09-17T02:24:51.233659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:21.006777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233508+0000","last_change":"2024-09-17T02:24:30.335635+0000","last_active":"2024-09-17T02:24:51.233508+0000","last_peered":"2024-09-17T02:24:51.233508+0000","last_clean":"2024-09-17T02:24:51.233508+0000","last_became_active":"2024-09-17T02:24:30.335086+0000","last_became_peered":"2024-09-17T02:24:30.335086+0000","last_unstale":"2024-09-17T02:24:51.233508+0000","last_undegraded":"2024-09-17T02:24:51.233508+0000","last_fullsized":"2024-09-17T02:24:51.233508+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:01.913411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233514+0000","last_change":"2024-09-17T02:24:30.325322+0000","last_active":"2024-09-17T02:24:51.233514+0000","last_peered":"2024-09-17T02:24:51.233514+0000","last_clean":"2024-09-17T02:24:51.233514+0000","last_became_active":"2024-09-17T02:24:30.325002+0000","last_became_peered":"2024-09-17T02:24:30.325002+0000","last_unstale":"2024-09-17T02:24:51.233514+0000","last_undegraded":"2024-09-17T02:24:51.233514+0000","last_fullsized":"2024-09-17T02:24:51.233514+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:16.238014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278363+0000","last_change":"2024-09-17T02:20:16.563482+0000","last_active":"2024-09-17T02:24:52.278363+0000","last_peered":"2024-09-17T02:24:52.278363+0000","last_clean":"2024-09-17T02:24:52.278363+0000","last_became_active":"2024-09-17T02:20:16.562735+0000","last_became_peered":"2024-09-17T02:20:16.562735+0000","last_unstale":"2024-09-17T02:24:52.278363+0000","last_undegraded":"2024-09-17T02:24:52.278363+0000","last_fullsized":"2024-09-17T02:24:52.278363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:10.315951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605780+0000","last_change":"2024-09-17T02:24:48.583997+0000","last_active":"2024-09-17T02:24:51.605780+0000","last_peered":"2024-09-17T02:24:51.605780+0000","last_clean":"2024-09-17T02:24:51.605780+0000","last_became_active":"2024-09-17T02:24:48.580510+0000","last_became_peered":"2024-09-17T02:24:48.580510+0000","last_unstale":"2024-09-17T02:24:51.605780+0000","last_undegraded":"2024-09-17T02:24:51.605780+0000","last_fullsized":"2024-09-17T02:24:51.605780+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:21:58.370793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277220+0000","last_change":"2024-09-17T02:20:16.586950+0000","last_active":"2024-09-17T02:24:52.277220+0000","last_peered":"2024-09-17T02:24:52.277220+0000","last_clean":"2024-09-17T02:24:52.277220+0000","last_became_active":"2024-09-17T02:20:16.586281+0000","last_became_peered":"2024-09-17T02:20:16.586281+0000","last_unstale":"2024-09-17T02:24:52.277220+0000","last_undegraded":"2024-09-17T02:24:52.277220+0000","last_fullsized":"2024-09-17T02:24:52.277220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:22.801598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234871+0000","last_change":"2024-09-17T02:24:30.330312+0000","last_active":"2024-09-17T02:24:51.234871+0000","last_peered":"2024-09-17T02:24:51.234871+0000","last_clean":"2024-09-17T02:24:51.234871+0000","last_became_active":"2024-09-17T02:24:30.329980+0000","last_became_peered":"2024-09-17T02:24:30.329980+0000","last_unstale":"2024-09-17T02:24:51.234871+0000","last_undegraded":"2024-09-17T02:24:51.234871+0000","last_fullsized":"2024-09-17T02:24:51.234871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:53.422140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232041+0000","last_change":"2024-09-17T02:24:34.361003+0000","last_active":"2024-09-17T02:24:51.232041+0000","last_peered":"2024-09-17T02:24:51.232041+0000","last_clean":"2024-09-17T02:24:51.232041+0000","last_became_active":"2024-09-17T02:24:34.360259+0000","last_became_peered":"2024-09-17T02:24:34.360259+0000","last_unstale":"2024-09-17T02:24:51.232041+0000","last_undegraded":"2024-09-17T02:24:51.232041+0000","last_fullsized":"2024-09-17T02:24:51.232041+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:01.642214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605644+0000","last_change":"2024-09-17T02:24:30.702500+0000","last_active":"2024-09-17T02:24:51.605644+0000","last_peered":"2024-09-17T02:24:51.605644+0000","last_clean":"2024-09-17T02:24:51.605644+0000","last_became_active":"2024-09-17T02:24:30.700674+0000","last_became_peered":"2024-09-17T02:24:30.700674+0000","last_unstale":"2024-09-17T02:24:51.605644+0000","last_undegraded":"2024-09-17T02:24:51.605644+0000","last_fullsized":"2024-09-17T02:24:51.605644+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:47.554275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275778+0000","last_change":"2024-09-17T02:24:30.700096+0000","last_active":"2024-09-17T02:24:52.275778+0000","last_peered":"2024-09-17T02:24:52.275778+0000","last_clean":"2024-09-17T02:24:52.275778+0000","last_became_active":"2024-09-17T02:24:30.698022+0000","last_became_peered":"2024-09-17T02:24:30.698022+0000","last_unstale":"2024-09-17T02:24:52.275778+0000","last_undegraded":"2024-09-17T02:24:52.275778+0000","last_fullsized":"2024-09-17T02:24:52.275778+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:53.002528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604171+0000","last_change":"2024-09-17T02:24:48.577229+0000","last_active":"2024-09-17T02:24:51.604171+0000","last_peered":"2024-09-17T02:24:51.604171+0000","last_clean":"2024-09-17T02:24:51.604171+0000","last_became_active":"2024-09-17T02:24:48.576615+0000","last_became_peered":"2024-09-17T02:24:48.576615+0000","last_unstale":"2024-09-17T02:24:51.604171+0000","last_undegraded":"2024-09-17T02:24:51.604171+0000","last_fullsized":"2024-09-17T02:24:51.604171+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:23.827785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606021+0000","last_change":"2024-09-17T02:24:30.704846+0000","last_active":"2024-09-17T02:24:51.606021+0000","last_peered":"2024-09-17T02:24:51.606021+0000","last_clean":"2024-09-17T02:24:51.606021+0000","last_became_active":"2024-09-17T02:24:30.703377+0000","last_became_peered":"2024-09-17T02:24:30.703377+0000","last_unstale":"2024-09-17T02:24:51.606021+0000","last_undegraded":"2024-09-17T02:24:51.606021+0000","last_fullsized":"2024-09-17T02:24:51.606021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:21.642002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277663+0000","last_change":"2024-09-17T02:24:30.696851+0000","last_active":"2024-09-17T02:24:52.277663+0000","last_peered":"2024-09-17T02:24:52.277663+0000","last_clean":"2024-09-17T02:24:52.277663+0000","last_became_active":"2024-09-17T02:24:30.694853+0000","last_became_peered":"2024-09-17T02:24:30.694853+0000","last_unstale":"2024-09-17T02:24:52.277663+0000","last_undegraded":"2024-09-17T02:24:52.277663+0000","last_fullsized":"2024-09-17T02:24:52.277663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:39.353246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235268+0000","last_change":"2024-09-17T02:24:30.339430+0000","last_active":"2024-09-17T02:24:51.235268+0000","last_peered":"2024-09-17T02:24:51.235268+0000","last_clean":"2024-09-17T02:24:51.235268+0000","last_became_active":"2024-09-17T02:24:30.338488+0000","last_became_peered":"2024-09-17T02:24:30.338488+0000","last_unstale":"2024-09-17T02:24:51.235268+0000","last_undegraded":"2024-09-17T02:24:51.235268+0000","last_fullsized":"2024-09-17T02:24:51.235268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:26.554742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606211+0000","last_change":"2024-09-17T02:24:48.584148+0000","last_active":"2024-09-17T02:24:51.606211+0000","last_peered":"2024-09-17T02:24:51.606211+0000","last_clean":"2024-09-17T02:24:51.606211+0000","last_became_active":"2024-09-17T02:24:48.582959+0000","last_became_peered":"2024-09-17T02:24:48.582959+0000","last_unstale":"2024-09-17T02:24:51.606211+0000","last_undegraded":"2024-09-17T02:24:51.606211+0000","last_fullsized":"2024-09-17T02:24:51.606211+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:24.455294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276722+0000","last_change":"2024-09-17T02:24:34.734388+0000","last_active":"2024-09-17T02:24:52.276722+0000","last_peered":"2024-09-17T02:24:52.276722+0000","last_clean":"2024-09-17T02:24:52.276722+0000","last_became_active":"2024-09-17T02:24:34.733451+0000","last_became_peered":"2024-09-17T02:24:34.733451+0000","last_unstale":"2024-09-17T02:24:52.276722+0000","last_undegraded":"2024-09-17T02:24:52.276722+0000","last_fullsized":"2024-09-17T02:24:52.276722+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:22.488478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605030+0000","last_change":"2024-09-17T02:24:30.700893+0000","last_active":"2024-09-17T02:24:51.605030+0000","last_peered":"2024-09-17T02:24:51.605030+0000","last_clean":"2024-09-17T02:24:51.605030+0000","last_became_active":"2024-09-17T02:24:30.699410+0000","last_became_peered":"2024-09-17T02:24:30.699410+0000","last_unstale":"2024-09-17T02:24:51.605030+0000","last_undegraded":"2024-09-17T02:24:51.605030+0000","last_fullsized":"2024-09-17T02:24:51.605030+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:29.137738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275593+0000","last_change":"2024-09-17T02:24:34.727144+0000","last_active":"2024-09-17T02:24:52.275593+0000","last_peered":"2024-09-17T02:24:52.275593+0000","last_clean":"2024-09-17T02:24:52.275593+0000","last_became_active":"2024-09-17T02:24:34.725109+0000","last_became_peered":"2024-09-17T02:24:34.725109+0000","last_unstale":"2024-09-17T02:24:52.275593+0000","last_undegraded":"2024-09-17T02:24:52.275593+0000","last_fullsized":"2024-09-17T02:24:52.275593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:59.629654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.231948+0000","last_change":"2024-09-17T02:24:34.357265+0000","last_active":"2024-09-17T02:24:51.231948+0000","last_peered":"2024-09-17T02:24:51.231948+0000","last_clean":"2024-09-17T02:24:51.231948+0000","last_became_active":"2024-09-17T02:24:34.356639+0000","last_became_peered":"2024-09-17T02:24:34.356639+0000","last_unstale":"2024-09-17T02:24:51.231948+0000","last_undegraded":"2024-09-17T02:24:51.231948+0000","last_fullsized":"2024-09-17T02:24:51.231948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:30.236713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605501+0000","last_change":"2024-09-17T02:24:48.583278+0000","last_active":"2024-09-17T02:24:51.605501+0000","last_peered":"2024-09-17T02:24:51.605501+0000","last_clean":"2024-09-17T02:24:51.605501+0000","last_became_active":"2024-09-17T02:24:48.581121+0000","last_became_peered":"2024-09-17T02:24:48.581121+0000","last_unstale":"2024-09-17T02:24:51.605501+0000","last_undegraded":"2024-09-17T02:24:51.605501+0000","last_fullsized":"2024-09-17T02:24:51.605501+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:39.957807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234860+0000","last_change":"2024-09-17T02:24:30.329201+0000","last_active":"2024-09-17T02:24:51.234860+0000","last_peered":"2024-09-17T02:24:51.234860+0000","last_clean":"2024-09-17T02:24:51.234860+0000","last_became_active":"2024-09-17T02:24:30.328907+0000","last_became_peered":"2024-09-17T02:24:30.328907+0000","last_unstale":"2024-09-17T02:24:51.234860+0000","last_undegraded":"2024-09-17T02:24:51.234860+0000","last_fullsized":"2024-09-17T02:24:51.234860+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:31.463647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606423+0000","last_change":"2024-09-17T02:24:34.732466+0000","last_active":"2024-09-17T02:24:51.606423+0000","last_peered":"2024-09-17T02:24:51.606423+0000","last_clean":"2024-09-17T02:24:51.606423+0000","last_became_active":"2024-09-17T02:24:34.731598+0000","last_became_peered":"2024-09-17T02:24:34.731598+0000","last_unstale":"2024-09-17T02:24:51.606423+0000","last_undegraded":"2024-09-17T02:24:51.606423+0000","last_fullsized":"2024-09-17T02:24:51.606423+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:33.350084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275176+0000","last_change":"2024-09-17T02:24:34.730124+0000","last_active":"2024-09-17T02:24:52.275176+0000","last_peered":"2024-09-17T02:24:52.275176+0000","last_clean":"2024-09-17T02:24:52.275176+0000","last_became_active":"2024-09-17T02:24:34.727345+0000","last_became_peered":"2024-09-17T02:24:34.727345+0000","last_unstale":"2024-09-17T02:24:52.275176+0000","last_undegraded":"2024-09-17T02:24:52.275176+0000","last_fullsized":"2024-09-17T02:24:52.275176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:20.739364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275221+0000","last_change":"2024-09-17T02:24:34.731057+0000","last_active":"2024-09-17T02:24:52.275221+0000","last_peered":"2024-09-17T02:24:52.275221+0000","last_clean":"2024-09-17T02:24:52.275221+0000","last_became_active":"2024-09-17T02:24:34.730285+0000","last_became_peered":"2024-09-17T02:24:34.730285+0000","last_unstale":"2024-09-17T02:24:52.275221+0000","last_undegraded":"2024-09-17T02:24:52.275221+0000","last_fullsized":"2024-09-17T02:24:52.275221+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:28.085866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604612+0000","last_change":"2024-09-17T02:24:30.702653+0000","last_active":"2024-09-17T02:24:51.604612+0000","last_peered":"2024-09-17T02:24:51.604612+0000","last_clean":"2024-09-17T02:24:51.604612+0000","last_became_active":"2024-09-17T02:24:30.701047+0000","last_became_peered":"2024-09-17T02:24:30.701047+0000","last_unstale":"2024-09-17T02:24:51.604612+0000","last_undegraded":"2024-09-17T02:24:51.604612+0000","last_fullsized":"2024-09-17T02:24:51.604612+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:26.569439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277891+0000","last_change":"2024-09-17T02:24:30.698841+0000","last_active":"2024-09-17T02:24:52.277891+0000","last_peered":"2024-09-17T02:24:52.277891+0000","last_clean":"2024-09-17T02:24:52.277891+0000","last_became_active":"2024-09-17T02:24:30.697606+0000","last_became_peered":"2024-09-17T02:24:30.697606+0000","last_unstale":"2024-09-17T02:24:52.277891+0000","last_undegraded":"2024-09-17T02:24:52.277891+0000","last_fullsized":"2024-09-17T02:24:52.277891+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:20.038861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232570+0000","last_change":"2024-09-17T02:24:30.336630+0000","last_active":"2024-09-17T02:24:51.232570+0000","last_peered":"2024-09-17T02:24:51.232570+0000","last_clean":"2024-09-17T02:24:51.232570+0000","last_became_active":"2024-09-17T02:24:30.336326+0000","last_became_peered":"2024-09-17T02:24:30.336326+0000","last_unstale":"2024-09-17T02:24:51.232570+0000","last_undegraded":"2024-09-17T02:24:51.232570+0000","last_fullsized":"2024-09-17T02:24:51.232570+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:30.072709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.236283+0000","last_change":"2024-09-17T02:24:30.336771+0000","last_active":"2024-09-17T02:24:51.236283+0000","last_peered":"2024-09-17T02:24:51.236283+0000","last_clean":"2024-09-17T02:24:51.236283+0000","last_became_active":"2024-09-17T02:24:30.336494+0000","last_became_peered":"2024-09-17T02:24:30.336494+0000","last_unstale":"2024-09-17T02:24:51.236283+0000","last_undegraded":"2024-09-17T02:24:51.236283+0000","last_fullsized":"2024-09-17T02:24:51.236283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:17.852502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604224+0000","last_change":"2024-09-17T02:24:48.583894+0000","last_active":"2024-09-17T02:24:51.604224+0000","last_peered":"2024-09-17T02:24:51.604224+0000","last_clean":"2024-09-17T02:24:51.604224+0000","last_became_active":"2024-09-17T02:24:48.580644+0000","last_became_peered":"2024-09-17T02:24:48.580644+0000","last_unstale":"2024-09-17T02:24:51.604224+0000","last_undegraded":"2024-09-17T02:24:51.604224+0000","last_fullsized":"2024-09-17T02:24:51.604224+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:15.855050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":165,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606071+0000","last_change":"2024-09-17T02:24:30.697584+0000","last_active":"2024-09-17T02:24:51.606071+0000","last_peered":"2024-09-17T02:24:51.606071+0000","last_clean":"2024-09-17T02:24:51.606071+0000","last_became_active":"2024-09-17T02:24:30.695140+0000","last_became_peered":"2024-09-17T02:24:30.695140+0000","last_unstale":"2024-09-17T02:24:51.606071+0000","last_undegraded":"2024-09-17T02:24:51.606071+0000","last_fullsized":"2024-09-17T02:24:51.606071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:07.386102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604282+0000","last_change":"2024-09-17T02:24:48.577640+0000","last_active":"2024-09-17T02:24:51.604282+0000","last_peered":"2024-09-17T02:24:51.604282+0000","last_clean":"2024-09-17T02:24:51.604282+0000","last_became_active":"2024-09-17T02:24:48.576802+0000","last_became_peered":"2024-09-17T02:24:48.576802+0000","last_unstale":"2024-09-17T02:24:51.604282+0000","last_undegraded":"2024-09-17T02:24:51.604282+0000","last_fullsized":"2024-09-17T02:24:51.604282+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:11.030891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234885+0000","last_change":"2024-09-17T02:24:30.338939+0000","last_active":"2024-09-17T02:24:51.234885+0000","last_peered":"2024-09-17T02:24:51.234885+0000","last_clean":"2024-09-17T02:24:51.234885+0000","last_became_active":"2024-09-17T02:24:30.337650+0000","last_became_peered":"2024-09-17T02:24:30.337650+0000","last_unstale":"2024-09-17T02:24:51.234885+0000","last_undegraded":"2024-09-17T02:24:51.234885+0000","last_fullsized":"2024-09-17T02:24:51.234885+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:00.927950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234077+0000","last_change":"2024-09-17T02:24:30.322785+0000","last_active":"2024-09-17T02:24:51.234077+0000","last_peered":"2024-09-17T02:24:51.234077+0000","last_clean":"2024-09-17T02:24:51.234077+0000","last_became_active":"2024-09-17T02:24:30.322509+0000","last_became_peered":"2024-09-17T02:24:30.322509+0000","last_unstale":"2024-09-17T02:24:51.234077+0000","last_undegraded":"2024-09-17T02:24:51.234077+0000","last_fullsized":"2024-09-17T02:24:51.234077+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:06.381434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234190+0000","last_change":"2024-09-17T02:24:30.329944+0000","last_active":"2024-09-17T02:24:51.234190+0000","last_peered":"2024-09-17T02:24:51.234190+0000","last_clean":"2024-09-17T02:24:51.234190+0000","last_became_active":"2024-09-17T02:24:30.329642+0000","last_became_peered":"2024-09-17T02:24:30.329642+0000","last_unstale":"2024-09-17T02:24:51.234190+0000","last_undegraded":"2024-09-17T02:24:51.234190+0000","last_fullsized":"2024-09-17T02:24:51.234190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:39.135831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277004+0000","last_change":"2024-09-17T02:24:30.699239+0000","last_active":"2024-09-17T02:24:52.277004+0000","last_peered":"2024-09-17T02:24:52.277004+0000","last_clean":"2024-09-17T02:24:52.277004+0000","last_became_active":"2024-09-17T02:24:30.697800+0000","last_became_peered":"2024-09-17T02:24:30.697800+0000","last_unstale":"2024-09-17T02:24:52.277004+0000","last_undegraded":"2024-09-17T02:24:52.277004+0000","last_fullsized":"2024-09-17T02:24:52.277004+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:42.056577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":165,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277720+0000","last_change":"2024-09-17T02:24:30.697486+0000","last_active":"2024-09-17T02:24:52.277720+0000","last_peered":"2024-09-17T02:24:52.277720+0000","last_clean":"2024-09-17T02:24:52.277720+0000","last_became_active":"2024-09-17T02:24:30.696079+0000","last_became_peered":"2024-09-17T02:24:30.696079+0000","last_unstale":"2024-09-17T02:24:52.277720+0000","last_undegraded":"2024-09-17T02:24:52.277720+0000","last_fullsized":"2024-09-17T02:24:52.277720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:07.222731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234635+0000","last_change":"2024-09-17T02:24:30.330194+0000","last_active":"2024-09-17T02:24:51.234635+0000","last_peered":"2024-09-17T02:24:51.234635+0000","last_clean":"2024-09-17T02:24:51.234635+0000","last_became_active":"2024-09-17T02:24:30.329676+0000","last_became_peered":"2024-09-17T02:24:30.329676+0000","last_unstale":"2024-09-17T02:24:51.234635+0000","last_undegraded":"2024-09-17T02:24:51.234635+0000","last_fullsized":"2024-09-17T02:24:51.234635+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:50:41.161871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232120+0000","last_change":"2024-09-17T02:24:34.360950+0000","last_active":"2024-09-17T02:24:51.232120+0000","last_peered":"2024-09-17T02:24:51.232120+0000","last_clean":"2024-09-17T02:24:51.232120+0000","last_became_active":"2024-09-17T02:24:34.360020+0000","last_became_peered":"2024-09-17T02:24:34.360020+0000","last_unstale":"2024-09-17T02:24:51.232120+0000","last_undegraded":"2024-09-17T02:24:51.232120+0000","last_fullsized":"2024-09-17T02:24:51.232120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:57.653961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234818+0000","last_change":"2024-09-17T02:24:30.338531+0000","last_active":"2024-09-17T02:24:51.234818+0000","last_peered":"2024-09-17T02:24:51.234818+0000","last_clean":"2024-09-17T02:24:51.234818+0000","last_became_active":"2024-09-17T02:24:30.336902+0000","last_became_peered":"2024-09-17T02:24:30.336902+0000","last_unstale":"2024-09-17T02:24:51.234818+0000","last_undegraded":"2024-09-17T02:24:51.234818+0000","last_fullsized":"2024-09-17T02:24:51.234818+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:49.660896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":101,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604622+0000","last_change":"2024-09-17T02:24:48.579411+0000","last_active":"2024-09-17T02:24:51.604622+0000","last_peered":"2024-09-17T02:24:51.604622+0000","last_clean":"2024-09-17T02:24:51.604622+0000","last_became_active":"2024-09-17T02:24:48.578461+0000","last_became_peered":"2024-09-17T02:24:48.578461+0000","last_unstale":"2024-09-17T02:24:51.604622+0000","last_undegraded":"2024-09-17T02:24:51.604622+0000","last_fullsized":"2024-09-17T02:24:51.604622+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:09:43.054480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.236338+0000","last_change":"2024-09-17T02:24:30.326828+0000","last_active":"2024-09-17T02:24:51.236338+0000","last_peered":"2024-09-17T02:24:51.236338+0000","last_clean":"2024-09-17T02:24:51.236338+0000","last_became_active":"2024-09-17T02:24:30.326227+0000","last_became_peered":"2024-09-17T02:24:30.326227+0000","last_unstale":"2024-09-17T02:24:51.236338+0000","last_undegraded":"2024-09-17T02:24:51.236338+0000","last_fullsized":"2024-09-17T02:24:51.236338+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:53.135460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604435+0000","last_change":"2024-09-17T02:24:48.580927+0000","last_active":"2024-09-17T02:24:51.604435+0000","last_peered":"2024-09-17T02:24:51.604435+0000","last_clean":"2024-09-17T02:24:51.604435+0000","last_became_active":"2024-09-17T02:24:48.578678+0000","last_became_peered":"2024-09-17T02:24:48.578678+0000","last_unstale":"2024-09-17T02:24:51.604435+0000","last_undegraded":"2024-09-17T02:24:51.604435+0000","last_fullsized":"2024-09-17T02:24:51.604435+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:46.131656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277923+0000","last_change":"2024-09-17T02:20:16.583084+0000","last_active":"2024-09-17T02:24:52.277923+0000","last_peered":"2024-09-17T02:24:52.277923+0000","last_clean":"2024-09-17T02:24:52.277923+0000","last_became_active":"2024-09-17T02:20:16.582326+0000","last_became_peered":"2024-09-17T02:20:16.582326+0000","last_unstale":"2024-09-17T02:24:52.277923+0000","last_undegraded":"2024-09-17T02:24:52.277923+0000","last_fullsized":"2024-09-17T02:24:52.277923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:05.049317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":236,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232539+0000","last_change":"2024-09-17T02:24:30.338760+0000","last_active":"2024-09-17T02:24:51.232539+0000","last_peered":"2024-09-17T02:24:51.232539+0000","last_clean":"2024-09-17T02:24:51.232539+0000","last_became_active":"2024-09-17T02:24:30.338214+0000","last_became_peered":"2024-09-17T02:24:30.338214+0000","last_unstale":"2024-09-17T02:24:51.232539+0000","last_undegraded":"2024-09-17T02:24:51.232539+0000","last_fullsized":"2024-09-17T02:24:51.232539+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_clean_scrub_stamp":"2024-09-17T02:20:03.432050+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:27:29.124652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":60,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233731+0000","last_change":"2024-09-17T02:24:30.325326+0000","last_active":"2024-09-17T02:24:51.233731+0000","last_peered":"2024-09-17T02:24:51.233731+0000","last_clean":"2024-09-17T02:24:51.233731+0000","last_became_active":"2024-09-17T02:24:30.324910+0000","last_became_peered":"2024-09-17T02:24:30.324910+0000","last_unstale":"2024-09-17T02:24:51.233731+0000","last_undegraded":"2024-09-17T02:24:51.233731+0000","last_fullsized":"2024-09-17T02:24:51.233731+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:52:27.682190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276836+0000","last_change":"2024-09-17T02:20:15.560646+0000","last_active":"2024-09-17T02:24:52.276836+0000","last_peered":"2024-09-17T02:24:52.276836+0000","last_clean":"2024-09-17T02:24:52.276836+0000","last_became_active":"2024-09-17T02:20:15.559104+0000","last_became_peered":"2024-09-17T02:20:15.559104+0000","last_unstale":"2024-09-17T02:24:52.276836+0000","last_undegraded":"2024-09-17T02:24:52.276836+0000","last_fullsized":"2024-09-17T02:24:52.276836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:44.299986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235150+0000","last_change":"2024-09-17T02:24:30.339100+0000","last_active":"2024-09-17T02:24:51.235150+0000","last_peered":"2024-09-17T02:24:51.235150+0000","last_clean":"2024-09-17T02:24:51.235150+0000","last_became_active":"2024-09-17T02:24:30.337415+0000","last_became_peered":"2024-09-17T02:24:30.337415+0000","last_unstale":"2024-09-17T02:24:51.235150+0000","last_undegraded":"2024-09-17T02:24:51.235150+0000","last_fullsized":"2024-09-17T02:24:51.235150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:27.682975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233159+0000","last_change":"2024-09-17T02:24:30.338621+0000","last_active":"2024-09-17T02:24:51.233159+0000","last_peered":"2024-09-17T02:24:51.233159+0000","last_clean":"2024-09-17T02:24:51.233159+0000","last_became_active":"2024-09-17T02:24:30.338024+0000","last_became_peered":"2024-09-17T02:24:30.338024+0000","last_unstale":"2024-09-17T02:24:51.233159+0000","last_undegraded":"2024-09-17T02:24:51.233159+0000","last_fullsized":"2024-09-17T02:24:51.233159+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:49.985865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276198+0000","last_change":"2024-09-17T02:24:30.694491+0000","last_active":"2024-09-17T02:24:52.276198+0000","last_peered":"2024-09-17T02:24:52.276198+0000","last_clean":"2024-09-17T02:24:52.276198+0000","last_became_active":"2024-09-17T02:24:30.693653+0000","last_became_peered":"2024-09-17T02:24:30.693653+0000","last_unstale":"2024-09-17T02:24:52.276198+0000","last_undegraded":"2024-09-17T02:24:52.276198+0000","last_fullsized":"2024-09-17T02:24:52.276198+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:12.740030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605591+0000","last_change":"2024-09-17T02:20:16.571568+0000","last_active":"2024-09-17T02:24:51.605591+0000","last_peered":"2024-09-17T02:24:51.605591+0000","last_clean":"2024-09-17T02:24:51.605591+0000","last_became_active":"2024-09-17T02:20:16.570622+0000","last_became_peered":"2024-09-17T02:20:16.570622+0000","last_unstale":"2024-09-17T02:24:51.605591+0000","last_undegraded":"2024-09-17T02:24:51.605591+0000","last_fullsized":"2024-09-17T02:24:51.605591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:57.083446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276496+0000","last_change":"2024-09-17T02:20:12.511823+0000","last_active":"2024-09-17T02:24:52.276496+0000","last_peered":"2024-09-17T02:24:52.276496+0000","last_clean":"2024-09-17T02:24:52.276496+0000","last_became_active":"2024-09-17T02:20:10.497164+0000","last_became_peered":"2024-09-17T02:20:10.497164+0000","last_unstale":"2024-09-17T02:24:52.276496+0000","last_undegraded":"2024-09-17T02:24:52.276496+0000","last_fullsized":"2024-09-17T02:24:52.276496+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:21.242753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081052700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":101,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604499+0000","last_change":"2024-09-17T02:24:48.585305+0000","last_active":"2024-09-17T02:24:51.604499+0000","last_peered":"2024-09-17T02:24:51.604499+0000","last_clean":"2024-09-17T02:24:51.604499+0000","last_became_active":"2024-09-17T02:24:48.582729+0000","last_became_peered":"2024-09-17T02:24:48.582729+0000","last_unstale":"2024-09-17T02:24:51.604499+0000","last_undegraded":"2024-09-17T02:24:51.604499+0000","last_fullsized":"2024-09-17T02:24:51.604499+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:58.012479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277630+0000","last_change":"2024-09-17T02:24:34.730636+0000","last_active":"2024-09-17T02:24:52.277630+0000","last_peered":"2024-09-17T02:24:52.277630+0000","last_clean":"2024-09-17T02:24:52.277630+0000","last_became_active":"2024-09-17T02:24:34.729890+0000","last_became_peered":"2024-09-17T02:24:34.729890+0000","last_unstale":"2024-09-17T02:24:52.277630+0000","last_undegraded":"2024-09-17T02:24:52.277630+0000","last_fullsized":"2024-09-17T02:24:52.277630+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:07.679985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232887+0000","last_change":"2024-09-17T02:24:30.333204+0000","last_active":"2024-09-17T02:24:51.232887+0000","last_peered":"2024-09-17T02:24:51.232887+0000","last_clean":"2024-09-17T02:24:51.232887+0000","last_became_active":"2024-09-17T02:24:30.333005+0000","last_became_peered":"2024-09-17T02:24:30.333005+0000","last_unstale":"2024-09-17T02:24:51.232887+0000","last_undegraded":"2024-09-17T02:24:51.232887+0000","last_fullsized":"2024-09-17T02:24:51.232887+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:17.620422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078085399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234838+0000","last_change":"2024-09-17T02:24:30.329442+0000","last_active":"2024-09-17T02:24:51.234838+0000","last_peered":"2024-09-17T02:24:51.234838+0000","last_clean":"2024-09-17T02:24:51.234838+0000","last_became_active":"2024-09-17T02:24:30.329213+0000","last_became_peered":"2024-09-17T02:24:30.329213+0000","last_unstale":"2024-09-17T02:24:51.234838+0000","last_undegraded":"2024-09-17T02:24:51.234838+0000","last_fullsized":"2024-09-17T02:24:51.234838+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:25.034116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277315+0000","last_change":"2024-09-17T02:20:16.580184+0000","last_active":"2024-09-17T02:24:52.277315+0000","last_peered":"2024-09-17T02:24:52.277315+0000","last_clean":"2024-09-17T02:24:52.277315+0000","last_became_active":"2024-09-17T02:20:16.578343+0000","last_became_peered":"2024-09-17T02:20:16.578343+0000","last_unstale":"2024-09-17T02:24:52.277315+0000","last_undegraded":"2024-09-17T02:24:52.277315+0000","last_fullsized":"2024-09-17T02:24:52.277315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:42.123535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232100+0000","last_change":"2024-09-17T02:24:34.354157+0000","last_active":"2024-09-17T02:24:51.232100+0000","last_peered":"2024-09-17T02:24:51.232100+0000","last_clean":"2024-09-17T02:24:51.232100+0000","last_became_active":"2024-09-17T02:24:34.353619+0000","last_became_peered":"2024-09-17T02:24:34.353619+0000","last_unstale":"2024-09-17T02:24:51.232100+0000","last_undegraded":"2024-09-17T02:24:51.232100+0000","last_fullsized":"2024-09-17T02:24:51.232100+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:53:03.444794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277559+0000","last_change":"2024-09-17T02:20:12.511838+0000","last_active":"2024-09-17T02:24:52.277559+0000","last_peered":"2024-09-17T02:24:52.277559+0000","last_clean":"2024-09-17T02:24:52.277559+0000","last_became_active":"2024-09-17T02:20:10.497049+0000","last_became_peered":"2024-09-17T02:20:10.497049+0000","last_unstale":"2024-09-17T02:24:52.277559+0000","last_undegraded":"2024-09-17T02:24:52.277559+0000","last_fullsized":"2024-09-17T02:24:52.277559+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:54.446484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079701100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604586+0000","last_change":"2024-09-17T02:24:30.698392+0000","last_active":"2024-09-17T02:24:51.604586+0000","last_peered":"2024-09-17T02:24:51.604586+0000","last_clean":"2024-09-17T02:24:51.604586+0000","last_became_active":"2024-09-17T02:24:30.694944+0000","last_became_peered":"2024-09-17T02:24:30.694944+0000","last_unstale":"2024-09-17T02:24:51.604586+0000","last_undegraded":"2024-09-17T02:24:51.604586+0000","last_fullsized":"2024-09-17T02:24:51.604586+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:06.407404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277487+0000","last_change":"2024-09-17T02:20:15.559252+0000","last_active":"2024-09-17T02:24:52.277487+0000","last_peered":"2024-09-17T02:24:52.277487+0000","last_clean":"2024-09-17T02:24:52.277487+0000","last_became_active":"2024-09-17T02:20:15.557667+0000","last_became_peered":"2024-09-17T02:20:15.557667+0000","last_unstale":"2024-09-17T02:24:52.277487+0000","last_undegraded":"2024-09-17T02:24:52.277487+0000","last_fullsized":"2024-09-17T02:24:52.277487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:01.292626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606815+0000","last_change":"2024-09-17T02:20:12.661034+0000","last_active":"2024-09-17T02:24:51.606815+0000","last_peered":"2024-09-17T02:24:51.606815+0000","last_clean":"2024-09-17T02:24:51.606815+0000","last_became_active":"2024-09-17T02:20:10.497829+0000","last_became_peered":"2024-09-17T02:20:10.497829+0000","last_unstale":"2024-09-17T02:24:51.606815+0000","last_undegraded":"2024-09-17T02:24:51.606815+0000","last_fullsized":"2024-09-17T02:24:51.606815+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:46:27.427685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096944700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605391+0000","last_change":"2024-09-17T02:24:48.581467+0000","last_active":"2024-09-17T02:24:51.605391+0000","last_peered":"2024-09-17T02:24:51.605391+0000","last_clean":"2024-09-17T02:24:51.605391+0000","last_became_active":"2024-09-17T02:24:48.580388+0000","last_became_peered":"2024-09-17T02:24:48.580388+0000","last_unstale":"2024-09-17T02:24:51.605391+0000","last_undegraded":"2024-09-17T02:24:51.605391+0000","last_fullsized":"2024-09-17T02:24:51.605391+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:21:11.358704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278338+0000","last_change":"2024-09-17T02:20:15.558961+0000","last_active":"2024-09-17T02:24:52.278338+0000","last_peered":"2024-09-17T02:24:52.278338+0000","last_clean":"2024-09-17T02:24:52.278338+0000","last_became_active":"2024-09-17T02:20:15.558299+0000","last_became_peered":"2024-09-17T02:20:15.558299+0000","last_unstale":"2024-09-17T02:24:52.278338+0000","last_undegraded":"2024-09-17T02:24:52.278338+0000","last_fullsized":"2024-09-17T02:24:52.278338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:39.709524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278295+0000","last_change":"2024-09-17T02:20:12.512481+0000","last_active":"2024-09-17T02:24:52.278295+0000","last_peered":"2024-09-17T02:24:52.278295+0000","last_clean":"2024-09-17T02:24:52.278295+0000","last_became_active":"2024-09-17T02:20:10.497021+0000","last_became_peered":"2024-09-17T02:20:10.497021+0000","last_unstale":"2024-09-17T02:24:52.278295+0000","last_undegraded":"2024-09-17T02:24:52.278295+0000","last_fullsized":"2024-09-17T02:24:52.278295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:41.167283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001400079,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276096+0000","last_change":"2024-09-17T02:24:30.693811+0000","last_active":"2024-09-17T02:24:52.276096+0000","last_peered":"2024-09-17T02:24:52.276096+0000","last_clean":"2024-09-17T02:24:52.276096+0000","last_became_active":"2024-09-17T02:24:30.691331+0000","last_became_peered":"2024-09-17T02:24:30.691331+0000","last_unstale":"2024-09-17T02:24:52.276096+0000","last_undegraded":"2024-09-17T02:24:52.276096+0000","last_fullsized":"2024-09-17T02:24:52.276096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:39.446085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":164,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278098+0000","last_change":"2024-09-17T02:24:30.694492+0000","last_active":"2024-09-17T02:24:52.278098+0000","last_peered":"2024-09-17T02:24:52.278098+0000","last_clean":"2024-09-17T02:24:52.278098+0000","last_became_active":"2024-09-17T02:24:30.691770+0000","last_became_peered":"2024-09-17T02:24:30.691770+0000","last_unstale":"2024-09-17T02:24:52.278098+0000","last_undegraded":"2024-09-17T02:24:52.278098+0000","last_fullsized":"2024-09-17T02:24:52.278098+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:01.597617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235468+0000","last_change":"2024-09-17T02:24:30.336636+0000","last_active":"2024-09-17T02:24:51.235468+0000","last_peered":"2024-09-17T02:24:51.235468+0000","last_clean":"2024-09-17T02:24:51.235468+0000","last_became_active":"2024-09-17T02:24:30.336110+0000","last_became_peered":"2024-09-17T02:24:30.336110+0000","last_unstale":"2024-09-17T02:24:51.235468+0000","last_undegraded":"2024-09-17T02:24:51.235468+0000","last_fullsized":"2024-09-17T02:24:51.235468+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:44.699884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604333+0000","last_change":"2024-09-17T02:24:30.700777+0000","last_active":"2024-09-17T02:24:51.604333+0000","last_peered":"2024-09-17T02:24:51.604333+0000","last_clean":"2024-09-17T02:24:51.604333+0000","last_became_active":"2024-09-17T02:24:30.696731+0000","last_became_peered":"2024-09-17T02:24:30.696731+0000","last_unstale":"2024-09-17T02:24:51.604333+0000","last_undegraded":"2024-09-17T02:24:51.604333+0000","last_fullsized":"2024-09-17T02:24:51.604333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:58.629953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234416+0000","last_change":"2024-09-17T02:24:30.326364+0000","last_active":"2024-09-17T02:24:51.234416+0000","last_peered":"2024-09-17T02:24:51.234416+0000","last_clean":"2024-09-17T02:24:51.234416+0000","last_became_active":"2024-09-17T02:24:30.325752+0000","last_became_peered":"2024-09-17T02:24:30.325752+0000","last_unstale":"2024-09-17T02:24:51.234416+0000","last_undegraded":"2024-09-17T02:24:51.234416+0000","last_fullsized":"2024-09-17T02:24:51.234416+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:33.800584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233479+0000","last_change":"2024-09-17T02:24:30.325924+0000","last_active":"2024-09-17T02:24:51.233479+0000","last_peered":"2024-09-17T02:24:51.233479+0000","last_clean":"2024-09-17T02:24:51.233479+0000","last_became_active":"2024-09-17T02:24:30.325688+0000","last_became_peered":"2024-09-17T02:24:30.325688+0000","last_unstale":"2024-09-17T02:24:51.233479+0000","last_undegraded":"2024-09-17T02:24:51.233479+0000","last_fullsized":"2024-09-17T02:24:51.233479+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:25.290483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276040+0000","last_change":"2024-09-17T02:24:34.731288+0000","last_active":"2024-09-17T02:24:52.276040+0000","last_peered":"2024-09-17T02:24:52.276040+0000","last_clean":"2024-09-17T02:24:52.276040+0000","last_became_active":"2024-09-17T02:24:34.730386+0000","last_became_peered":"2024-09-17T02:24:34.730386+0000","last_unstale":"2024-09-17T02:24:52.276040+0000","last_undegraded":"2024-09-17T02:24:52.276040+0000","last_fullsized":"2024-09-17T02:24:52.276040+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:45.808940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":103,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606673+0000","last_change":"2024-09-17T02:24:48.583147+0000","last_active":"2024-09-17T02:24:51.606673+0000","last_peered":"2024-09-17T02:24:51.606673+0000","last_clean":"2024-09-17T02:24:51.606673+0000","last_became_active":"2024-09-17T02:24:48.581390+0000","last_became_peered":"2024-09-17T02:24:48.581390+0000","last_unstale":"2024-09-17T02:24:51.606673+0000","last_undegraded":"2024-09-17T02:24:51.606673+0000","last_fullsized":"2024-09-17T02:24:51.606673+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:08.312173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235572+0000","last_change":"2024-09-17T02:24:30.325492+0000","last_active":"2024-09-17T02:24:51.235572+0000","last_peered":"2024-09-17T02:24:51.235572+0000","last_clean":"2024-09-17T02:24:51.235572+0000","last_became_active":"2024-09-17T02:24:30.325175+0000","last_became_peered":"2024-09-17T02:24:30.325175+0000","last_unstale":"2024-09-17T02:24:51.235572+0000","last_undegraded":"2024-09-17T02:24:51.235572+0000","last_fullsized":"2024-09-17T02:24:51.235572+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:04.443085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275866+0000","last_change":"2024-09-17T02:24:30.699551+0000","last_active":"2024-09-17T02:24:52.275866+0000","last_peered":"2024-09-17T02:24:52.275866+0000","last_clean":"2024-09-17T02:24:52.275866+0000","last_became_active":"2024-09-17T02:24:30.697986+0000","last_became_peered":"2024-09-17T02:24:30.697986+0000","last_unstale":"2024-09-17T02:24:52.275866+0000","last_undegraded":"2024-09-17T02:24:52.275866+0000","last_fullsized":"2024-09-17T02:24:52.275866+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:44.939985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278191+0000","last_change":"2024-09-17T02:24:30.697249+0000","last_active":"2024-09-17T02:24:52.278191+0000","last_peered":"2024-09-17T02:24:52.278191+0000","last_clean":"2024-09-17T02:24:52.278191+0000","last_became_active":"2024-09-17T02:24:30.696215+0000","last_became_peered":"2024-09-17T02:24:30.696215+0000","last_unstale":"2024-09-17T02:24:52.278191+0000","last_undegraded":"2024-09-17T02:24:52.278191+0000","last_fullsized":"2024-09-17T02:24:52.278191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:07.507822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276041+0000","last_change":"2024-09-17T02:20:16.577803+0000","last_active":"2024-09-17T02:24:52.276041+0000","last_peered":"2024-09-17T02:24:52.276041+0000","last_clean":"2024-09-17T02:24:52.276041+0000","last_became_active":"2024-09-17T02:20:16.576640+0000","last_became_peered":"2024-09-17T02:20:16.576640+0000","last_unstale":"2024-09-17T02:24:52.276041+0000","last_undegraded":"2024-09-17T02:24:52.276041+0000","last_fullsized":"2024-09-17T02:24:52.276041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:07.190169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606196+0000","last_change":"2024-09-17T02:24:30.706739+0000","last_active":"2024-09-17T02:24:51.606196+0000","last_peered":"2024-09-17T02:24:51.606196+0000","last_clean":"2024-09-17T02:24:51.606196+0000","last_became_active":"2024-09-17T02:24:30.706195+0000","last_became_peered":"2024-09-17T02:24:30.706195+0000","last_unstale":"2024-09-17T02:24:51.606196+0000","last_undegraded":"2024-09-17T02:24:51.606196+0000","last_fullsized":"2024-09-17T02:24:51.606196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:38.782264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275411+0000","last_change":"2024-09-17T02:24:34.733762+0000","last_active":"2024-09-17T02:24:52.275411+0000","last_peered":"2024-09-17T02:24:52.275411+0000","last_clean":"2024-09-17T02:24:52.275411+0000","last_became_active":"2024-09-17T02:24:34.731592+0000","last_became_peered":"2024-09-17T02:24:34.731592+0000","last_unstale":"2024-09-17T02:24:52.275411+0000","last_undegraded":"2024-09-17T02:24:52.275411+0000","last_fullsized":"2024-09-17T02:24:52.275411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:41.921908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277777+0000","last_change":"2024-09-17T02:24:30.696267+0000","last_active":"2024-09-17T02:24:52.277777+0000","last_peered":"2024-09-17T02:24:52.277777+0000","last_clean":"2024-09-17T02:24:52.277777+0000","last_became_active":"2024-09-17T02:24:30.694027+0000","last_became_peered":"2024-09-17T02:24:30.694027+0000","last_unstale":"2024-09-17T02:24:52.277777+0000","last_undegraded":"2024-09-17T02:24:52.277777+0000","last_fullsized":"2024-09-17T02:24:52.277777+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:56.160158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276145+0000","last_change":"2024-09-17T02:24:30.697568+0000","last_active":"2024-09-17T02:24:52.276145+0000","last_peered":"2024-09-17T02:24:52.276145+0000","last_clean":"2024-09-17T02:24:52.276145+0000","last_became_active":"2024-09-17T02:24:30.693991+0000","last_became_peered":"2024-09-17T02:24:30.693991+0000","last_unstale":"2024-09-17T02:24:52.276145+0000","last_undegraded":"2024-09-17T02:24:52.276145+0000","last_fullsized":"2024-09-17T02:24:52.276145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:45.636130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606140+0000","last_change":"2024-09-17T02:21:10.505967+0000","last_active":"2024-09-17T02:24:51.606140+0000","last_peered":"2024-09-17T02:24:51.606140+0000","last_clean":"2024-09-17T02:24:51.606140+0000","last_became_active":"2024-09-17T02:21:10.505594+0000","last_became_peered":"2024-09-17T02:21:10.505594+0000","last_unstale":"2024-09-17T02:24:51.606140+0000","last_undegraded":"2024-09-17T02:24:51.606140+0000","last_fullsized":"2024-09-17T02:24:51.606140+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:15.782752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605310+0000","last_change":"2024-09-17T02:24:48.579594+0000","last_active":"2024-09-17T02:24:51.605310+0000","last_peered":"2024-09-17T02:24:51.605310+0000","last_clean":"2024-09-17T02:24:51.605310+0000","last_became_active":"2024-09-17T02:24:48.578539+0000","last_became_peered":"2024-09-17T02:24:48.578539+0000","last_unstale":"2024-09-17T02:24:51.605310+0000","last_undegraded":"2024-09-17T02:24:51.605310+0000","last_fullsized":"2024-09-17T02:24:51.605310+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:11.515508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605322+0000","last_change":"2024-09-17T02:24:48.580567+0000","last_active":"2024-09-17T02:24:51.605322+0000","last_peered":"2024-09-17T02:24:51.605322+0000","last_clean":"2024-09-17T02:24:51.605322+0000","last_became_active":"2024-09-17T02:24:48.579612+0000","last_became_peered":"2024-09-17T02:24:48.579612+0000","last_unstale":"2024-09-17T02:24:51.605322+0000","last_undegraded":"2024-09-17T02:24:51.605322+0000","last_fullsized":"2024-09-17T02:24:51.605322+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:28:53.281135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605697+0000","last_change":"2024-09-17T02:24:30.698237+0000","last_active":"2024-09-17T02:24:51.605697+0000","last_peered":"2024-09-17T02:24:51.605697+0000","last_clean":"2024-09-17T02:24:51.605697+0000","last_became_active":"2024-09-17T02:24:30.697194+0000","last_became_peered":"2024-09-17T02:24:30.697194+0000","last_unstale":"2024-09-17T02:24:51.605697+0000","last_undegraded":"2024-09-17T02:24:51.605697+0000","last_fullsized":"2024-09-17T02:24:51.605697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:36.697224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232314+0000","last_change":"2024-09-17T02:24:34.360811+0000","last_active":"2024-09-17T02:24:51.232314+0000","last_peered":"2024-09-17T02:24:51.232314+0000","last_clean":"2024-09-17T02:24:51.232314+0000","last_became_active":"2024-09-17T02:24:34.359944+0000","last_became_peered":"2024-09-17T02:24:34.359944+0000","last_unstale":"2024-09-17T02:24:51.232314+0000","last_undegraded":"2024-09-17T02:24:51.232314+0000","last_fullsized":"2024-09-17T02:24:51.232314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:07.986774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234185+0000","last_change":"2024-09-17T02:24:30.327080+0000","last_active":"2024-09-17T02:24:51.234185+0000","last_peered":"2024-09-17T02:24:51.234185+0000","last_clean":"2024-09-17T02:24:51.234185+0000","last_became_active":"2024-09-17T02:24:30.326800+0000","last_became_peered":"2024-09-17T02:24:30.326800+0000","last_unstale":"2024-09-17T02:24:51.234185+0000","last_undegraded":"2024-09-17T02:24:51.234185+0000","last_fullsized":"2024-09-17T02:24:51.234185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:06.072812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233254+0000","last_change":"2024-09-17T02:24:30.322448+0000","last_active":"2024-09-17T02:24:51.233254+0000","last_peered":"2024-09-17T02:24:51.233254+0000","last_clean":"2024-09-17T02:24:51.233254+0000","last_became_active":"2024-09-17T02:24:30.322156+0000","last_became_peered":"2024-09-17T02:24:30.322156+0000","last_unstale":"2024-09-17T02:24:51.233254+0000","last_undegraded":"2024-09-17T02:24:51.233254+0000","last_fullsized":"2024-09-17T02:24:51.233254+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:46.435146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":102,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606560+0000","last_change":"2024-09-17T02:24:48.583271+0000","last_active":"2024-09-17T02:24:51.606560+0000","last_peered":"2024-09-17T02:24:51.606560+0000","last_clean":"2024-09-17T02:24:51.606560+0000","last_became_active":"2024-09-17T02:24:48.581355+0000","last_became_peered":"2024-09-17T02:24:48.581355+0000","last_unstale":"2024-09-17T02:24:51.606560+0000","last_undegraded":"2024-09-17T02:24:51.606560+0000","last_fullsized":"2024-09-17T02:24:51.606560+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:01.234040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604953+0000","last_change":"2024-09-17T02:20:16.570456+0000","last_active":"2024-09-17T02:24:51.604953+0000","last_peered":"2024-09-17T02:24:51.604953+0000","last_clean":"2024-09-17T02:24:51.604953+0000","last_became_active":"2024-09-17T02:20:16.568095+0000","last_became_peered":"2024-09-17T02:20:16.568095+0000","last_unstale":"2024-09-17T02:24:51.604953+0000","last_undegraded":"2024-09-17T02:24:51.604953+0000","last_fullsized":"2024-09-17T02:24:51.604953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:58.329169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":157,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278020+0000","last_change":"2024-09-17T02:20:15.560293+0000","last_active":"2024-09-17T02:24:52.278020+0000","last_peered":"2024-09-17T02:24:52.278020+0000","last_clean":"2024-09-17T02:24:52.278020+0000","last_became_active":"2024-09-17T02:20:15.559074+0000","last_became_peered":"2024-09-17T02:20:15.559074+0000","last_unstale":"2024-09-17T02:24:52.278020+0000","last_undegraded":"2024-09-17T02:24:52.278020+0000","last_fullsized":"2024-09-17T02:24:52.278020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:55.639841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233448+0000","last_change":"2024-09-17T02:24:30.319629+0000","last_active":"2024-09-17T02:24:51.233448+0000","last_peered":"2024-09-17T02:24:51.233448+0000","last_clean":"2024-09-17T02:24:51.233448+0000","last_became_active":"2024-09-17T02:24:30.319441+0000","last_became_peered":"2024-09-17T02:24:30.319441+0000","last_unstale":"2024-09-17T02:24:51.233448+0000","last_undegraded":"2024-09-17T02:24:51.233448+0000","last_fullsized":"2024-09-17T02:24:51.233448+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:58.379141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":167,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278026+0000","last_change":"2024-09-17T02:24:30.699964+0000","last_active":"2024-09-17T02:24:52.278026+0000","last_peered":"2024-09-17T02:24:52.278026+0000","last_clean":"2024-09-17T02:24:52.278026+0000","last_became_active":"2024-09-17T02:24:30.699102+0000","last_became_peered":"2024-09-17T02:24:30.699102+0000","last_unstale":"2024-09-17T02:24:52.278026+0000","last_undegraded":"2024-09-17T02:24:52.278026+0000","last_fullsized":"2024-09-17T02:24:52.278026+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:19.193516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5558,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705726,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361248,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":360190,"kb_avail":94010592,"statfs":{"total":96636764160,"available":96266846208,"internally_reserved":0,"allocated":1052672,"data_stored":983227,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":368835013},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":80,"seq":343597383686,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56488,"kb_used_data":1040,"kb_used_omap":6,"kb_used_meta":55417,"kb_avail":94315352,"statfs":{"total":96636764160,"available":96578920448,"internally_reserved":0,"allocated":1064960,"data_stored":983862,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":7153,"internal_metadata":56747023},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738430,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329228,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94042612,"statfs":{"total":96636764160,"available":96299634688,"internally_reserved":0,"allocated":974848,"data_stored":387439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5558,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T02:24:54.888 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-17T02:24:54.888 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-17T02:24:55.256 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-17T02:24:55.269 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T02:24:55.269 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:24:55.578 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:24:55.580 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-17T02:24:55.597 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2024-09-17T02:24:55.473375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":746964,"kb_used_data":3020,"kb_used_omap":10,"kb_used_meta":743861,"kb_avail":282368556,"statfs":{"total":289910292480,"available":289145401344,"internally_reserved":0,"allocated":3092480,"data_stored":2354528,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10343,"internal_metadata":761714585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002742"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605682+0000","last_change":"2024-09-17T02:24:34.733681+0000","last_active":"2024-09-17T02:24:51.605682+0000","last_peered":"2024-09-17T02:24:51.605682+0000","last_clean":"2024-09-17T02:24:51.605682+0000","last_became_active":"2024-09-17T02:24:34.732728+0000","last_became_peered":"2024-09-17T02:24:34.732728+0000","last_unstale":"2024-09-17T02:24:51.605682+0000","last_undegraded":"2024-09-17T02:24:51.605682+0000","last_fullsized":"2024-09-17T02:24:51.605682+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:21.613592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605214+0000","last_change":"2024-09-17T02:24:48.579919+0000","last_active":"2024-09-17T02:24:51.605214+0000","last_peered":"2024-09-17T02:24:51.605214+0000","last_clean":"2024-09-17T02:24:51.605214+0000","last_became_active":"2024-09-17T02:24:48.578274+0000","last_became_peered":"2024-09-17T02:24:48.578274+0000","last_unstale":"2024-09-17T02:24:51.605214+0000","last_undegraded":"2024-09-17T02:24:51.605214+0000","last_fullsized":"2024-09-17T02:24:51.605214+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:50.597846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.236296+0000","last_change":"2024-09-17T02:24:30.339249+0000","last_active":"2024-09-17T02:24:51.236296+0000","last_peered":"2024-09-17T02:24:51.236296+0000","last_clean":"2024-09-17T02:24:51.236296+0000","last_became_active":"2024-09-17T02:24:30.338199+0000","last_became_peered":"2024-09-17T02:24:30.338199+0000","last_unstale":"2024-09-17T02:24:51.236296+0000","last_undegraded":"2024-09-17T02:24:51.236296+0000","last_fullsized":"2024-09-17T02:24:51.236296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:51.734408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":87,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232438+0000","last_change":"2024-09-17T02:24:34.360587+0000","last_active":"2024-09-17T02:24:51.232438+0000","last_peered":"2024-09-17T02:24:51.232438+0000","last_clean":"2024-09-17T02:24:51.232438+0000","last_became_active":"2024-09-17T02:24:34.359912+0000","last_became_peered":"2024-09-17T02:24:34.359912+0000","last_unstale":"2024-09-17T02:24:51.232438+0000","last_undegraded":"2024-09-17T02:24:51.232438+0000","last_fullsized":"2024-09-17T02:24:51.232438+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:35.054937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605500+0000","last_change":"2024-09-17T02:24:48.579715+0000","last_active":"2024-09-17T02:24:51.605500+0000","last_peered":"2024-09-17T02:24:51.605500+0000","last_clean":"2024-09-17T02:24:51.605500+0000","last_became_active":"2024-09-17T02:24:48.578841+0000","last_became_peered":"2024-09-17T02:24:48.578841+0000","last_unstale":"2024-09-17T02:24:51.605500+0000","last_undegraded":"2024-09-17T02:24:51.605500+0000","last_fullsized":"2024-09-17T02:24:51.605500+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:23.197781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233991+0000","last_change":"2024-09-17T02:24:30.322619+0000","last_active":"2024-09-17T02:24:51.233991+0000","last_peered":"2024-09-17T02:24:51.233991+0000","last_clean":"2024-09-17T02:24:51.233991+0000","last_became_active":"2024-09-17T02:24:30.322191+0000","last_became_peered":"2024-09-17T02:24:30.322191+0000","last_unstale":"2024-09-17T02:24:51.233991+0000","last_undegraded":"2024-09-17T02:24:51.233991+0000","last_fullsized":"2024-09-17T02:24:51.233991+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:26.120304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233779+0000","last_change":"2024-09-17T02:24:30.330077+0000","last_active":"2024-09-17T02:24:51.233779+0000","last_peered":"2024-09-17T02:24:51.233779+0000","last_clean":"2024-09-17T02:24:51.233779+0000","last_became_active":"2024-09-17T02:24:30.329814+0000","last_became_peered":"2024-09-17T02:24:30.329814+0000","last_unstale":"2024-09-17T02:24:51.233779+0000","last_undegraded":"2024-09-17T02:24:51.233779+0000","last_fullsized":"2024-09-17T02:24:51.233779+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:09.933024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233077+0000","last_change":"2024-09-17T02:24:30.319625+0000","last_active":"2024-09-17T02:24:51.233077+0000","last_peered":"2024-09-17T02:24:51.233077+0000","last_clean":"2024-09-17T02:24:51.233077+0000","last_became_active":"2024-09-17T02:24:30.319316+0000","last_became_peered":"2024-09-17T02:24:30.319316+0000","last_unstale":"2024-09-17T02:24:51.233077+0000","last_undegraded":"2024-09-17T02:24:51.233077+0000","last_fullsized":"2024-09-17T02:24:51.233077+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:30.753462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277651+0000","last_change":"2024-09-17T02:20:16.584665+0000","last_active":"2024-09-17T02:24:52.277651+0000","last_peered":"2024-09-17T02:24:52.277651+0000","last_clean":"2024-09-17T02:24:52.277651+0000","last_became_active":"2024-09-17T02:20:16.580797+0000","last_became_peered":"2024-09-17T02:20:16.580797+0000","last_unstale":"2024-09-17T02:24:52.277651+0000","last_undegraded":"2024-09-17T02:24:52.277651+0000","last_fullsized":"2024-09-17T02:24:52.277651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:47.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605486+0000","last_change":"2024-09-17T02:24:34.733394+0000","last_active":"2024-09-17T02:24:51.605486+0000","last_peered":"2024-09-17T02:24:51.605486+0000","last_clean":"2024-09-17T02:24:51.605486+0000","last_became_active":"2024-09-17T02:24:34.732480+0000","last_became_peered":"2024-09-17T02:24:34.732480+0000","last_unstale":"2024-09-17T02:24:51.605486+0000","last_undegraded":"2024-09-17T02:24:51.605486+0000","last_fullsized":"2024-09-17T02:24:51.605486+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:37.005990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235423+0000","last_change":"2024-09-17T02:24:30.329180+0000","last_active":"2024-09-17T02:24:51.235423+0000","last_peered":"2024-09-17T02:24:51.235423+0000","last_clean":"2024-09-17T02:24:51.235423+0000","last_became_active":"2024-09-17T02:24:30.328962+0000","last_became_peered":"2024-09-17T02:24:30.328962+0000","last_unstale":"2024-09-17T02:24:51.235423+0000","last_undegraded":"2024-09-17T02:24:51.235423+0000","last_fullsized":"2024-09-17T02:24:51.235423+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:21.425064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605228+0000","last_change":"2024-09-17T02:24:48.583870+0000","last_active":"2024-09-17T02:24:51.605228+0000","last_peered":"2024-09-17T02:24:51.605228+0000","last_clean":"2024-09-17T02:24:51.605228+0000","last_became_active":"2024-09-17T02:24:48.581418+0000","last_became_peered":"2024-09-17T02:24:48.581418+0000","last_unstale":"2024-09-17T02:24:51.605228+0000","last_undegraded":"2024-09-17T02:24:51.605228+0000","last_fullsized":"2024-09-17T02:24:51.605228+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:52:52.425417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604958+0000","last_change":"2024-09-17T02:24:48.583016+0000","last_active":"2024-09-17T02:24:51.604958+0000","last_peered":"2024-09-17T02:24:51.604958+0000","last_clean":"2024-09-17T02:24:51.604958+0000","last_became_active":"2024-09-17T02:24:48.579221+0000","last_became_peered":"2024-09-17T02:24:48.579221+0000","last_unstale":"2024-09-17T02:24:51.604958+0000","last_undegraded":"2024-09-17T02:24:51.604958+0000","last_fullsized":"2024-09-17T02:24:51.604958+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:46.150529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233659+0000","last_change":"2024-09-17T02:24:30.337132+0000","last_active":"2024-09-17T02:24:51.233659+0000","last_peered":"2024-09-17T02:24:51.233659+0000","last_clean":"2024-09-17T02:24:51.233659+0000","last_became_active":"2024-09-17T02:24:30.335871+0000","last_became_peered":"2024-09-17T02:24:30.335871+0000","last_unstale":"2024-09-17T02:24:51.233659+0000","last_undegraded":"2024-09-17T02:24:51.233659+0000","last_fullsized":"2024-09-17T02:24:51.233659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:21.006777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233508+0000","last_change":"2024-09-17T02:24:30.335635+0000","last_active":"2024-09-17T02:24:51.233508+0000","last_peered":"2024-09-17T02:24:51.233508+0000","last_clean":"2024-09-17T02:24:51.233508+0000","last_became_active":"2024-09-17T02:24:30.335086+0000","last_became_peered":"2024-09-17T02:24:30.335086+0000","last_unstale":"2024-09-17T02:24:51.233508+0000","last_undegraded":"2024-09-17T02:24:51.233508+0000","last_fullsized":"2024-09-17T02:24:51.233508+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:01.913411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233514+0000","last_change":"2024-09-17T02:24:30.325322+0000","last_active":"2024-09-17T02:24:51.233514+0000","last_peered":"2024-09-17T02:24:51.233514+0000","last_clean":"2024-09-17T02:24:51.233514+0000","last_became_active":"2024-09-17T02:24:30.325002+0000","last_became_peered":"2024-09-17T02:24:30.325002+0000","last_unstale":"2024-09-17T02:24:51.233514+0000","last_undegraded":"2024-09-17T02:24:51.233514+0000","last_fullsized":"2024-09-17T02:24:51.233514+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:16.238014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278363+0000","last_change":"2024-09-17T02:20:16.563482+0000","last_active":"2024-09-17T02:24:52.278363+0000","last_peered":"2024-09-17T02:24:52.278363+0000","last_clean":"2024-09-17T02:24:52.278363+0000","last_became_active":"2024-09-17T02:20:16.562735+0000","last_became_peered":"2024-09-17T02:20:16.562735+0000","last_unstale":"2024-09-17T02:24:52.278363+0000","last_undegraded":"2024-09-17T02:24:52.278363+0000","last_fullsized":"2024-09-17T02:24:52.278363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:10.315951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605780+0000","last_change":"2024-09-17T02:24:48.583997+0000","last_active":"2024-09-17T02:24:51.605780+0000","last_peered":"2024-09-17T02:24:51.605780+0000","last_clean":"2024-09-17T02:24:51.605780+0000","last_became_active":"2024-09-17T02:24:48.580510+0000","last_became_peered":"2024-09-17T02:24:48.580510+0000","last_unstale":"2024-09-17T02:24:51.605780+0000","last_undegraded":"2024-09-17T02:24:51.605780+0000","last_fullsized":"2024-09-17T02:24:51.605780+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:21:58.370793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277220+0000","last_change":"2024-09-17T02:20:16.586950+0000","last_active":"2024-09-17T02:24:52.277220+0000","last_peered":"2024-09-17T02:24:52.277220+0000","last_clean":"2024-09-17T02:24:52.277220+0000","last_became_active":"2024-09-17T02:20:16.586281+0000","last_became_peered":"2024-09-17T02:20:16.586281+0000","last_unstale":"2024-09-17T02:24:52.277220+0000","last_undegraded":"2024-09-17T02:24:52.277220+0000","last_fullsized":"2024-09-17T02:24:52.277220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:22.801598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234871+0000","last_change":"2024-09-17T02:24:30.330312+0000","last_active":"2024-09-17T02:24:51.234871+0000","last_peered":"2024-09-17T02:24:51.234871+0000","last_clean":"2024-09-17T02:24:51.234871+0000","last_became_active":"2024-09-17T02:24:30.329980+0000","last_became_peered":"2024-09-17T02:24:30.329980+0000","last_unstale":"2024-09-17T02:24:51.234871+0000","last_undegraded":"2024-09-17T02:24:51.234871+0000","last_fullsized":"2024-09-17T02:24:51.234871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:53.422140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232041+0000","last_change":"2024-09-17T02:24:34.361003+0000","last_active":"2024-09-17T02:24:51.232041+0000","last_peered":"2024-09-17T02:24:51.232041+0000","last_clean":"2024-09-17T02:24:51.232041+0000","last_became_active":"2024-09-17T02:24:34.360259+0000","last_became_peered":"2024-09-17T02:24:34.360259+0000","last_unstale":"2024-09-17T02:24:51.232041+0000","last_undegraded":"2024-09-17T02:24:51.232041+0000","last_fullsized":"2024-09-17T02:24:51.232041+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:01.642214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605644+0000","last_change":"2024-09-17T02:24:30.702500+0000","last_active":"2024-09-17T02:24:51.605644+0000","last_peered":"2024-09-17T02:24:51.605644+0000","last_clean":"2024-09-17T02:24:51.605644+0000","last_became_active":"2024-09-17T02:24:30.700674+0000","last_became_peered":"2024-09-17T02:24:30.700674+0000","last_unstale":"2024-09-17T02:24:51.605644+0000","last_undegraded":"2024-09-17T02:24:51.605644+0000","last_fullsized":"2024-09-17T02:24:51.605644+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:47.554275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275778+0000","last_change":"2024-09-17T02:24:30.700096+0000","last_active":"2024-09-17T02:24:52.275778+0000","last_peered":"2024-09-17T02:24:52.275778+0000","last_clean":"2024-09-17T02:24:52.275778+0000","last_became_active":"2024-09-17T02:24:30.698022+0000","last_became_peered":"2024-09-17T02:24:30.698022+0000","last_unstale":"2024-09-17T02:24:52.275778+0000","last_undegraded":"2024-09-17T02:24:52.275778+0000","last_fullsized":"2024-09-17T02:24:52.275778+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:53.002528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604171+0000","last_change":"2024-09-17T02:24:48.577229+0000","last_active":"2024-09-17T02:24:51.604171+0000","last_peered":"2024-09-17T02:24:51.604171+0000","last_clean":"2024-09-17T02:24:51.604171+0000","last_became_active":"2024-09-17T02:24:48.576615+0000","last_became_peered":"2024-09-17T02:24:48.576615+0000","last_unstale":"2024-09-17T02:24:51.604171+0000","last_undegraded":"2024-09-17T02:24:51.604171+0000","last_fullsized":"2024-09-17T02:24:51.604171+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:23.827785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606021+0000","last_change":"2024-09-17T02:24:30.704846+0000","last_active":"2024-09-17T02:24:51.606021+0000","last_peered":"2024-09-17T02:24:51.606021+0000","last_clean":"2024-09-17T02:24:51.606021+0000","last_became_active":"2024-09-17T02:24:30.703377+0000","last_became_peered":"2024-09-17T02:24:30.703377+0000","last_unstale":"2024-09-17T02:24:51.606021+0000","last_undegraded":"2024-09-17T02:24:51.606021+0000","last_fullsized":"2024-09-17T02:24:51.606021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:21.642002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277663+0000","last_change":"2024-09-17T02:24:30.696851+0000","last_active":"2024-09-17T02:24:52.277663+0000","last_peered":"2024-09-17T02:24:52.277663+0000","last_clean":"2024-09-17T02:24:52.277663+0000","last_became_active":"2024-09-17T02:24:30.694853+0000","last_became_peered":"2024-09-17T02:24:30.694853+0000","last_unstale":"2024-09-17T02:24:52.277663+0000","last_undegraded":"2024-09-17T02:24:52.277663+0000","last_fullsized":"2024-09-17T02:24:52.277663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:39.353246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235268+0000","last_change":"2024-09-17T02:24:30.339430+0000","last_active":"2024-09-17T02:24:51.235268+0000","last_peered":"2024-09-17T02:24:51.235268+0000","last_clean":"2024-09-17T02:24:51.235268+0000","last_became_active":"2024-09-17T02:24:30.338488+0000","last_became_peered":"2024-09-17T02:24:30.338488+0000","last_unstale":"2024-09-17T02:24:51.235268+0000","last_undegraded":"2024-09-17T02:24:51.235268+0000","last_fullsized":"2024-09-17T02:24:51.235268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:26.554742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606211+0000","last_change":"2024-09-17T02:24:48.584148+0000","last_active":"2024-09-17T02:24:51.606211+0000","last_peered":"2024-09-17T02:24:51.606211+0000","last_clean":"2024-09-17T02:24:51.606211+0000","last_became_active":"2024-09-17T02:24:48.582959+0000","last_became_peered":"2024-09-17T02:24:48.582959+0000","last_unstale":"2024-09-17T02:24:51.606211+0000","last_undegraded":"2024-09-17T02:24:51.606211+0000","last_fullsized":"2024-09-17T02:24:51.606211+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:24.455294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276722+0000","last_change":"2024-09-17T02:24:34.734388+0000","last_active":"2024-09-17T02:24:52.276722+0000","last_peered":"2024-09-17T02:24:52.276722+0000","last_clean":"2024-09-17T02:24:52.276722+0000","last_became_active":"2024-09-17T02:24:34.733451+0000","last_became_peered":"2024-09-17T02:24:34.733451+0000","last_unstale":"2024-09-17T02:24:52.276722+0000","last_undegraded":"2024-09-17T02:24:52.276722+0000","last_fullsized":"2024-09-17T02:24:52.276722+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:22.488478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605030+0000","last_change":"2024-09-17T02:24:30.700893+0000","last_active":"2024-09-17T02:24:51.605030+0000","last_peered":"2024-09-17T02:24:51.605030+0000","last_clean":"2024-09-17T02:24:51.605030+0000","last_became_active":"2024-09-17T02:24:30.699410+0000","last_became_peered":"2024-09-17T02:24:30.699410+0000","last_unstale":"2024-09-17T02:24:51.605030+0000","last_undegraded":"2024-09-17T02:24:51.605030+0000","last_fullsized":"2024-09-17T02:24:51.605030+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:29.137738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275593+0000","last_change":"2024-09-17T02:24:34.727144+0000","last_active":"2024-09-17T02:24:52.275593+0000","last_peered":"2024-09-17T02:24:52.275593+0000","last_clean":"2024-09-17T02:24:52.275593+0000","last_became_active":"2024-09-17T02:24:34.725109+0000","last_became_peered":"2024-09-17T02:24:34.725109+0000","last_unstale":"2024-09-17T02:24:52.275593+0000","last_undegraded":"2024-09-17T02:24:52.275593+0000","last_fullsized":"2024-09-17T02:24:52.275593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:59.629654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.231948+0000","last_change":"2024-09-17T02:24:34.357265+0000","last_active":"2024-09-17T02:24:51.231948+0000","last_peered":"2024-09-17T02:24:51.231948+0000","last_clean":"2024-09-17T02:24:51.231948+0000","last_became_active":"2024-09-17T02:24:34.356639+0000","last_became_peered":"2024-09-17T02:24:34.356639+0000","last_unstale":"2024-09-17T02:24:51.231948+0000","last_undegraded":"2024-09-17T02:24:51.231948+0000","last_fullsized":"2024-09-17T02:24:51.231948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:30.236713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605501+0000","last_change":"2024-09-17T02:24:48.583278+0000","last_active":"2024-09-17T02:24:51.605501+0000","last_peered":"2024-09-17T02:24:51.605501+0000","last_clean":"2024-09-17T02:24:51.605501+0000","last_became_active":"2024-09-17T02:24:48.581121+0000","last_became_peered":"2024-09-17T02:24:48.581121+0000","last_unstale":"2024-09-17T02:24:51.605501+0000","last_undegraded":"2024-09-17T02:24:51.605501+0000","last_fullsized":"2024-09-17T02:24:51.605501+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:39.957807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234860+0000","last_change":"2024-09-17T02:24:30.329201+0000","last_active":"2024-09-17T02:24:51.234860+0000","last_peered":"2024-09-17T02:24:51.234860+0000","last_clean":"2024-09-17T02:24:51.234860+0000","last_became_active":"2024-09-17T02:24:30.328907+0000","last_became_peered":"2024-09-17T02:24:30.328907+0000","last_unstale":"2024-09-17T02:24:51.234860+0000","last_undegraded":"2024-09-17T02:24:51.234860+0000","last_fullsized":"2024-09-17T02:24:51.234860+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:31.463647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606423+0000","last_change":"2024-09-17T02:24:34.732466+0000","last_active":"2024-09-17T02:24:51.606423+0000","last_peered":"2024-09-17T02:24:51.606423+0000","last_clean":"2024-09-17T02:24:51.606423+0000","last_became_active":"2024-09-17T02:24:34.731598+0000","last_became_peered":"2024-09-17T02:24:34.731598+0000","last_unstale":"2024-09-17T02:24:51.606423+0000","last_undegraded":"2024-09-17T02:24:51.606423+0000","last_fullsized":"2024-09-17T02:24:51.606423+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:33.350084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275176+0000","last_change":"2024-09-17T02:24:34.730124+0000","last_active":"2024-09-17T02:24:52.275176+0000","last_peered":"2024-09-17T02:24:52.275176+0000","last_clean":"2024-09-17T02:24:52.275176+0000","last_became_active":"2024-09-17T02:24:34.727345+0000","last_became_peered":"2024-09-17T02:24:34.727345+0000","last_unstale":"2024-09-17T02:24:52.275176+0000","last_undegraded":"2024-09-17T02:24:52.275176+0000","last_fullsized":"2024-09-17T02:24:52.275176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:20.739364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275221+0000","last_change":"2024-09-17T02:24:34.731057+0000","last_active":"2024-09-17T02:24:52.275221+0000","last_peered":"2024-09-17T02:24:52.275221+0000","last_clean":"2024-09-17T02:24:52.275221+0000","last_became_active":"2024-09-17T02:24:34.730285+0000","last_became_peered":"2024-09-17T02:24:34.730285+0000","last_unstale":"2024-09-17T02:24:52.275221+0000","last_undegraded":"2024-09-17T02:24:52.275221+0000","last_fullsized":"2024-09-17T02:24:52.275221+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:28.085866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604612+0000","last_change":"2024-09-17T02:24:30.702653+0000","last_active":"2024-09-17T02:24:51.604612+0000","last_peered":"2024-09-17T02:24:51.604612+0000","last_clean":"2024-09-17T02:24:51.604612+0000","last_became_active":"2024-09-17T02:24:30.701047+0000","last_became_peered":"2024-09-17T02:24:30.701047+0000","last_unstale":"2024-09-17T02:24:51.604612+0000","last_undegraded":"2024-09-17T02:24:51.604612+0000","last_fullsized":"2024-09-17T02:24:51.604612+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:26.569439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277891+0000","last_change":"2024-09-17T02:24:30.698841+0000","last_active":"2024-09-17T02:24:52.277891+0000","last_peered":"2024-09-17T02:24:52.277891+0000","last_clean":"2024-09-17T02:24:52.277891+0000","last_became_active":"2024-09-17T02:24:30.697606+0000","last_became_peered":"2024-09-17T02:24:30.697606+0000","last_unstale":"2024-09-17T02:24:52.277891+0000","last_undegraded":"2024-09-17T02:24:52.277891+0000","last_fullsized":"2024-09-17T02:24:52.277891+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:20.038861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232570+0000","last_change":"2024-09-17T02:24:30.336630+0000","last_active":"2024-09-17T02:24:51.232570+0000","last_peered":"2024-09-17T02:24:51.232570+0000","last_clean":"2024-09-17T02:24:51.232570+0000","last_became_active":"2024-09-17T02:24:30.336326+0000","last_became_peered":"2024-09-17T02:24:30.336326+0000","last_unstale":"2024-09-17T02:24:51.232570+0000","last_undegraded":"2024-09-17T02:24:51.232570+0000","last_fullsized":"2024-09-17T02:24:51.232570+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:30.072709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.236283+0000","last_change":"2024-09-17T02:24:30.336771+0000","last_active":"2024-09-17T02:24:51.236283+0000","last_peered":"2024-09-17T02:24:51.236283+0000","last_clean":"2024-09-17T02:24:51.236283+0000","last_became_active":"2024-09-17T02:24:30.336494+0000","last_became_peered":"2024-09-17T02:24:30.336494+0000","last_unstale":"2024-09-17T02:24:51.236283+0000","last_undegraded":"2024-09-17T02:24:51.236283+0000","last_fullsized":"2024-09-17T02:24:51.236283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:17.852502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604224+0000","last_change":"2024-09-17T02:24:48.583894+0000","last_active":"2024-09-17T02:24:51.604224+0000","last_peered":"2024-09-17T02:24:51.604224+0000","last_clean":"2024-09-17T02:24:51.604224+0000","last_became_active":"2024-09-17T02:24:48.580644+0000","last_became_peered":"2024-09-17T02:24:48.580644+0000","last_unstale":"2024-09-17T02:24:51.604224+0000","last_undegraded":"2024-09-17T02:24:51.604224+0000","last_fullsized":"2024-09-17T02:24:51.604224+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:15.855050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":165,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606071+0000","last_change":"2024-09-17T02:24:30.697584+0000","last_active":"2024-09-17T02:24:51.606071+0000","last_peered":"2024-09-17T02:24:51.606071+0000","last_clean":"2024-09-17T02:24:51.606071+0000","last_became_active":"2024-09-17T02:24:30.695140+0000","last_became_peered":"2024-09-17T02:24:30.695140+0000","last_unstale":"2024-09-17T02:24:51.606071+0000","last_undegraded":"2024-09-17T02:24:51.606071+0000","last_fullsized":"2024-09-17T02:24:51.606071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:07.386102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604282+0000","last_change":"2024-09-17T02:24:48.577640+0000","last_active":"2024-09-17T02:24:51.604282+0000","last_peered":"2024-09-17T02:24:51.604282+0000","last_clean":"2024-09-17T02:24:51.604282+0000","last_became_active":"2024-09-17T02:24:48.576802+0000","last_became_peered":"2024-09-17T02:24:48.576802+0000","last_unstale":"2024-09-17T02:24:51.604282+0000","last_undegraded":"2024-09-17T02:24:51.604282+0000","last_fullsized":"2024-09-17T02:24:51.604282+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:11.030891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234885+0000","last_change":"2024-09-17T02:24:30.338939+0000","last_active":"2024-09-17T02:24:51.234885+0000","last_peered":"2024-09-17T02:24:51.234885+0000","last_clean":"2024-09-17T02:24:51.234885+0000","last_became_active":"2024-09-17T02:24:30.337650+0000","last_became_peered":"2024-09-17T02:24:30.337650+0000","last_unstale":"2024-09-17T02:24:51.234885+0000","last_undegraded":"2024-09-17T02:24:51.234885+0000","last_fullsized":"2024-09-17T02:24:51.234885+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:00.927950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234077+0000","last_change":"2024-09-17T02:24:30.322785+0000","last_active":"2024-09-17T02:24:51.234077+0000","last_peered":"2024-09-17T02:24:51.234077+0000","last_clean":"2024-09-17T02:24:51.234077+0000","last_became_active":"2024-09-17T02:24:30.322509+0000","last_became_peered":"2024-09-17T02:24:30.322509+0000","last_unstale":"2024-09-17T02:24:51.234077+0000","last_undegraded":"2024-09-17T02:24:51.234077+0000","last_fullsized":"2024-09-17T02:24:51.234077+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:06.381434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234190+0000","last_change":"2024-09-17T02:24:30.329944+0000","last_active":"2024-09-17T02:24:51.234190+0000","last_peered":"2024-09-17T02:24:51.234190+0000","last_clean":"2024-09-17T02:24:51.234190+0000","last_became_active":"2024-09-17T02:24:30.329642+0000","last_became_peered":"2024-09-17T02:24:30.329642+0000","last_unstale":"2024-09-17T02:24:51.234190+0000","last_undegraded":"2024-09-17T02:24:51.234190+0000","last_fullsized":"2024-09-17T02:24:51.234190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:39.135831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277004+0000","last_change":"2024-09-17T02:24:30.699239+0000","last_active":"2024-09-17T02:24:52.277004+0000","last_peered":"2024-09-17T02:24:52.277004+0000","last_clean":"2024-09-17T02:24:52.277004+0000","last_became_active":"2024-09-17T02:24:30.697800+0000","last_became_peered":"2024-09-17T02:24:30.697800+0000","last_unstale":"2024-09-17T02:24:52.277004+0000","last_undegraded":"2024-09-17T02:24:52.277004+0000","last_fullsized":"2024-09-17T02:24:52.277004+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:42.056577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":165,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277720+0000","last_change":"2024-09-17T02:24:30.697486+0000","last_active":"2024-09-17T02:24:52.277720+0000","last_peered":"2024-09-17T02:24:52.277720+0000","last_clean":"2024-09-17T02:24:52.277720+0000","last_became_active":"2024-09-17T02:24:30.696079+0000","last_became_peered":"2024-09-17T02:24:30.696079+0000","last_unstale":"2024-09-17T02:24:52.277720+0000","last_undegraded":"2024-09-17T02:24:52.277720+0000","last_fullsized":"2024-09-17T02:24:52.277720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:07.222731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234635+0000","last_change":"2024-09-17T02:24:30.330194+0000","last_active":"2024-09-17T02:24:51.234635+0000","last_peered":"2024-09-17T02:24:51.234635+0000","last_clean":"2024-09-17T02:24:51.234635+0000","last_became_active":"2024-09-17T02:24:30.329676+0000","last_became_peered":"2024-09-17T02:24:30.329676+0000","last_unstale":"2024-09-17T02:24:51.234635+0000","last_undegraded":"2024-09-17T02:24:51.234635+0000","last_fullsized":"2024-09-17T02:24:51.234635+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:50:41.161871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232120+0000","last_change":"2024-09-17T02:24:34.360950+0000","last_active":"2024-09-17T02:24:51.232120+0000","last_peered":"2024-09-17T02:24:51.232120+0000","last_clean":"2024-09-17T02:24:51.232120+0000","last_became_active":"2024-09-17T02:24:34.360020+0000","last_became_peered":"2024-09-17T02:24:34.360020+0000","last_unstale":"2024-09-17T02:24:51.232120+0000","last_undegraded":"2024-09-17T02:24:51.232120+0000","last_fullsized":"2024-09-17T02:24:51.232120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:57.653961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234818+0000","last_change":"2024-09-17T02:24:30.338531+0000","last_active":"2024-09-17T02:24:51.234818+0000","last_peered":"2024-09-17T02:24:51.234818+0000","last_clean":"2024-09-17T02:24:51.234818+0000","last_became_active":"2024-09-17T02:24:30.336902+0000","last_became_peered":"2024-09-17T02:24:30.336902+0000","last_unstale":"2024-09-17T02:24:51.234818+0000","last_undegraded":"2024-09-17T02:24:51.234818+0000","last_fullsized":"2024-09-17T02:24:51.234818+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:49.660896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":101,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604622+0000","last_change":"2024-09-17T02:24:48.579411+0000","last_active":"2024-09-17T02:24:51.604622+0000","last_peered":"2024-09-17T02:24:51.604622+0000","last_clean":"2024-09-17T02:24:51.604622+0000","last_became_active":"2024-09-17T02:24:48.578461+0000","last_became_peered":"2024-09-17T02:24:48.578461+0000","last_unstale":"2024-09-17T02:24:51.604622+0000","last_undegraded":"2024-09-17T02:24:51.604622+0000","last_fullsized":"2024-09-17T02:24:51.604622+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:09:43.054480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.236338+0000","last_change":"2024-09-17T02:24:30.326828+0000","last_active":"2024-09-17T02:24:51.236338+0000","last_peered":"2024-09-17T02:24:51.236338+0000","last_clean":"2024-09-17T02:24:51.236338+0000","last_became_active":"2024-09-17T02:24:30.326227+0000","last_became_peered":"2024-09-17T02:24:30.326227+0000","last_unstale":"2024-09-17T02:24:51.236338+0000","last_undegraded":"2024-09-17T02:24:51.236338+0000","last_fullsized":"2024-09-17T02:24:51.236338+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:53.135460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604435+0000","last_change":"2024-09-17T02:24:48.580927+0000","last_active":"2024-09-17T02:24:51.604435+0000","last_peered":"2024-09-17T02:24:51.604435+0000","last_clean":"2024-09-17T02:24:51.604435+0000","last_became_active":"2024-09-17T02:24:48.578678+0000","last_became_peered":"2024-09-17T02:24:48.578678+0000","last_unstale":"2024-09-17T02:24:51.604435+0000","last_undegraded":"2024-09-17T02:24:51.604435+0000","last_fullsized":"2024-09-17T02:24:51.604435+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:46.131656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277923+0000","last_change":"2024-09-17T02:20:16.583084+0000","last_active":"2024-09-17T02:24:52.277923+0000","last_peered":"2024-09-17T02:24:52.277923+0000","last_clean":"2024-09-17T02:24:52.277923+0000","last_became_active":"2024-09-17T02:20:16.582326+0000","last_became_peered":"2024-09-17T02:20:16.582326+0000","last_unstale":"2024-09-17T02:24:52.277923+0000","last_undegraded":"2024-09-17T02:24:52.277923+0000","last_fullsized":"2024-09-17T02:24:52.277923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:05.049317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":236,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232539+0000","last_change":"2024-09-17T02:24:30.338760+0000","last_active":"2024-09-17T02:24:51.232539+0000","last_peered":"2024-09-17T02:24:51.232539+0000","last_clean":"2024-09-17T02:24:51.232539+0000","last_became_active":"2024-09-17T02:24:30.338214+0000","last_became_peered":"2024-09-17T02:24:30.338214+0000","last_unstale":"2024-09-17T02:24:51.232539+0000","last_undegraded":"2024-09-17T02:24:51.232539+0000","last_fullsized":"2024-09-17T02:24:51.232539+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_clean_scrub_stamp":"2024-09-17T02:20:03.432050+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:27:29.124652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":60,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233731+0000","last_change":"2024-09-17T02:24:30.325326+0000","last_active":"2024-09-17T02:24:51.233731+0000","last_peered":"2024-09-17T02:24:51.233731+0000","last_clean":"2024-09-17T02:24:51.233731+0000","last_became_active":"2024-09-17T02:24:30.324910+0000","last_became_peered":"2024-09-17T02:24:30.324910+0000","last_unstale":"2024-09-17T02:24:51.233731+0000","last_undegraded":"2024-09-17T02:24:51.233731+0000","last_fullsized":"2024-09-17T02:24:51.233731+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:52:27.682190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276836+0000","last_change":"2024-09-17T02:20:15.560646+0000","last_active":"2024-09-17T02:24:52.276836+0000","last_peered":"2024-09-17T02:24:52.276836+0000","last_clean":"2024-09-17T02:24:52.276836+0000","last_became_active":"2024-09-17T02:20:15.559104+0000","last_became_peered":"2024-09-17T02:20:15.559104+0000","last_unstale":"2024-09-17T02:24:52.276836+0000","last_undegraded":"2024-09-17T02:24:52.276836+0000","last_fullsized":"2024-09-17T02:24:52.276836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:44.299986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235150+0000","last_change":"2024-09-17T02:24:30.339100+0000","last_active":"2024-09-17T02:24:51.235150+0000","last_peered":"2024-09-17T02:24:51.235150+0000","last_clean":"2024-09-17T02:24:51.235150+0000","last_became_active":"2024-09-17T02:24:30.337415+0000","last_became_peered":"2024-09-17T02:24:30.337415+0000","last_unstale":"2024-09-17T02:24:51.235150+0000","last_undegraded":"2024-09-17T02:24:51.235150+0000","last_fullsized":"2024-09-17T02:24:51.235150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:27.682975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233159+0000","last_change":"2024-09-17T02:24:30.338621+0000","last_active":"2024-09-17T02:24:51.233159+0000","last_peered":"2024-09-17T02:24:51.233159+0000","last_clean":"2024-09-17T02:24:51.233159+0000","last_became_active":"2024-09-17T02:24:30.338024+0000","last_became_peered":"2024-09-17T02:24:30.338024+0000","last_unstale":"2024-09-17T02:24:51.233159+0000","last_undegraded":"2024-09-17T02:24:51.233159+0000","last_fullsized":"2024-09-17T02:24:51.233159+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:49.985865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276198+0000","last_change":"2024-09-17T02:24:30.694491+0000","last_active":"2024-09-17T02:24:52.276198+0000","last_peered":"2024-09-17T02:24:52.276198+0000","last_clean":"2024-09-17T02:24:52.276198+0000","last_became_active":"2024-09-17T02:24:30.693653+0000","last_became_peered":"2024-09-17T02:24:30.693653+0000","last_unstale":"2024-09-17T02:24:52.276198+0000","last_undegraded":"2024-09-17T02:24:52.276198+0000","last_fullsized":"2024-09-17T02:24:52.276198+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:12.740030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605591+0000","last_change":"2024-09-17T02:20:16.571568+0000","last_active":"2024-09-17T02:24:51.605591+0000","last_peered":"2024-09-17T02:24:51.605591+0000","last_clean":"2024-09-17T02:24:51.605591+0000","last_became_active":"2024-09-17T02:20:16.570622+0000","last_became_peered":"2024-09-17T02:20:16.570622+0000","last_unstale":"2024-09-17T02:24:51.605591+0000","last_undegraded":"2024-09-17T02:24:51.605591+0000","last_fullsized":"2024-09-17T02:24:51.605591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:57.083446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276496+0000","last_change":"2024-09-17T02:20:12.511823+0000","last_active":"2024-09-17T02:24:52.276496+0000","last_peered":"2024-09-17T02:24:52.276496+0000","last_clean":"2024-09-17T02:24:52.276496+0000","last_became_active":"2024-09-17T02:20:10.497164+0000","last_became_peered":"2024-09-17T02:20:10.497164+0000","last_unstale":"2024-09-17T02:24:52.276496+0000","last_undegraded":"2024-09-17T02:24:52.276496+0000","last_fullsized":"2024-09-17T02:24:52.276496+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:21.242753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081052700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":101,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604499+0000","last_change":"2024-09-17T02:24:48.585305+0000","last_active":"2024-09-17T02:24:51.604499+0000","last_peered":"2024-09-17T02:24:51.604499+0000","last_clean":"2024-09-17T02:24:51.604499+0000","last_became_active":"2024-09-17T02:24:48.582729+0000","last_became_peered":"2024-09-17T02:24:48.582729+0000","last_unstale":"2024-09-17T02:24:51.604499+0000","last_undegraded":"2024-09-17T02:24:51.604499+0000","last_fullsized":"2024-09-17T02:24:51.604499+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:58.012479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277630+0000","last_change":"2024-09-17T02:24:34.730636+0000","last_active":"2024-09-17T02:24:52.277630+0000","last_peered":"2024-09-17T02:24:52.277630+0000","last_clean":"2024-09-17T02:24:52.277630+0000","last_became_active":"2024-09-17T02:24:34.729890+0000","last_became_peered":"2024-09-17T02:24:34.729890+0000","last_unstale":"2024-09-17T02:24:52.277630+0000","last_undegraded":"2024-09-17T02:24:52.277630+0000","last_fullsized":"2024-09-17T02:24:52.277630+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:07.679985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232887+0000","last_change":"2024-09-17T02:24:30.333204+0000","last_active":"2024-09-17T02:24:51.232887+0000","last_peered":"2024-09-17T02:24:51.232887+0000","last_clean":"2024-09-17T02:24:51.232887+0000","last_became_active":"2024-09-17T02:24:30.333005+0000","last_became_peered":"2024-09-17T02:24:30.333005+0000","last_unstale":"2024-09-17T02:24:51.232887+0000","last_undegraded":"2024-09-17T02:24:51.232887+0000","last_fullsized":"2024-09-17T02:24:51.232887+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:17.620422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078085399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234838+0000","last_change":"2024-09-17T02:24:30.329442+0000","last_active":"2024-09-17T02:24:51.234838+0000","last_peered":"2024-09-17T02:24:51.234838+0000","last_clean":"2024-09-17T02:24:51.234838+0000","last_became_active":"2024-09-17T02:24:30.329213+0000","last_became_peered":"2024-09-17T02:24:30.329213+0000","last_unstale":"2024-09-17T02:24:51.234838+0000","last_undegraded":"2024-09-17T02:24:51.234838+0000","last_fullsized":"2024-09-17T02:24:51.234838+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:25.034116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277315+0000","last_change":"2024-09-17T02:20:16.580184+0000","last_active":"2024-09-17T02:24:52.277315+0000","last_peered":"2024-09-17T02:24:52.277315+0000","last_clean":"2024-09-17T02:24:52.277315+0000","last_became_active":"2024-09-17T02:20:16.578343+0000","last_became_peered":"2024-09-17T02:20:16.578343+0000","last_unstale":"2024-09-17T02:24:52.277315+0000","last_undegraded":"2024-09-17T02:24:52.277315+0000","last_fullsized":"2024-09-17T02:24:52.277315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:42.123535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232100+0000","last_change":"2024-09-17T02:24:34.354157+0000","last_active":"2024-09-17T02:24:51.232100+0000","last_peered":"2024-09-17T02:24:51.232100+0000","last_clean":"2024-09-17T02:24:51.232100+0000","last_became_active":"2024-09-17T02:24:34.353619+0000","last_became_peered":"2024-09-17T02:24:34.353619+0000","last_unstale":"2024-09-17T02:24:51.232100+0000","last_undegraded":"2024-09-17T02:24:51.232100+0000","last_fullsized":"2024-09-17T02:24:51.232100+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:53:03.444794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277559+0000","last_change":"2024-09-17T02:20:12.511838+0000","last_active":"2024-09-17T02:24:52.277559+0000","last_peered":"2024-09-17T02:24:52.277559+0000","last_clean":"2024-09-17T02:24:52.277559+0000","last_became_active":"2024-09-17T02:20:10.497049+0000","last_became_peered":"2024-09-17T02:20:10.497049+0000","last_unstale":"2024-09-17T02:24:52.277559+0000","last_undegraded":"2024-09-17T02:24:52.277559+0000","last_fullsized":"2024-09-17T02:24:52.277559+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:54.446484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079701100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604586+0000","last_change":"2024-09-17T02:24:30.698392+0000","last_active":"2024-09-17T02:24:51.604586+0000","last_peered":"2024-09-17T02:24:51.604586+0000","last_clean":"2024-09-17T02:24:51.604586+0000","last_became_active":"2024-09-17T02:24:30.694944+0000","last_became_peered":"2024-09-17T02:24:30.694944+0000","last_unstale":"2024-09-17T02:24:51.604586+0000","last_undegraded":"2024-09-17T02:24:51.604586+0000","last_fullsized":"2024-09-17T02:24:51.604586+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:06.407404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277487+0000","last_change":"2024-09-17T02:20:15.559252+0000","last_active":"2024-09-17T02:24:52.277487+0000","last_peered":"2024-09-17T02:24:52.277487+0000","last_clean":"2024-09-17T02:24:52.277487+0000","last_became_active":"2024-09-17T02:20:15.557667+0000","last_became_peered":"2024-09-17T02:20:15.557667+0000","last_unstale":"2024-09-17T02:24:52.277487+0000","last_undegraded":"2024-09-17T02:24:52.277487+0000","last_fullsized":"2024-09-17T02:24:52.277487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:01.292626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606815+0000","last_change":"2024-09-17T02:20:12.661034+0000","last_active":"2024-09-17T02:24:51.606815+0000","last_peered":"2024-09-17T02:24:51.606815+0000","last_clean":"2024-09-17T02:24:51.606815+0000","last_became_active":"2024-09-17T02:20:10.497829+0000","last_became_peered":"2024-09-17T02:20:10.497829+0000","last_unstale":"2024-09-17T02:24:51.606815+0000","last_undegraded":"2024-09-17T02:24:51.606815+0000","last_fullsized":"2024-09-17T02:24:51.606815+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:46:27.427685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096944700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605391+0000","last_change":"2024-09-17T02:24:48.581467+0000","last_active":"2024-09-17T02:24:51.605391+0000","last_peered":"2024-09-17T02:24:51.605391+0000","last_clean":"2024-09-17T02:24:51.605391+0000","last_became_active":"2024-09-17T02:24:48.580388+0000","last_became_peered":"2024-09-17T02:24:48.580388+0000","last_unstale":"2024-09-17T02:24:51.605391+0000","last_undegraded":"2024-09-17T02:24:51.605391+0000","last_fullsized":"2024-09-17T02:24:51.605391+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:21:11.358704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278338+0000","last_change":"2024-09-17T02:20:15.558961+0000","last_active":"2024-09-17T02:24:52.278338+0000","last_peered":"2024-09-17T02:24:52.278338+0000","last_clean":"2024-09-17T02:24:52.278338+0000","last_became_active":"2024-09-17T02:20:15.558299+0000","last_became_peered":"2024-09-17T02:20:15.558299+0000","last_unstale":"2024-09-17T02:24:52.278338+0000","last_undegraded":"2024-09-17T02:24:52.278338+0000","last_fullsized":"2024-09-17T02:24:52.278338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:39.709524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278295+0000","last_change":"2024-09-17T02:20:12.512481+0000","last_active":"2024-09-17T02:24:52.278295+0000","last_peered":"2024-09-17T02:24:52.278295+0000","last_clean":"2024-09-17T02:24:52.278295+0000","last_became_active":"2024-09-17T02:20:10.497021+0000","last_became_peered":"2024-09-17T02:20:10.497021+0000","last_unstale":"2024-09-17T02:24:52.278295+0000","last_undegraded":"2024-09-17T02:24:52.278295+0000","last_fullsized":"2024-09-17T02:24:52.278295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:41.167283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001400079,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276096+0000","last_change":"2024-09-17T02:24:30.693811+0000","last_active":"2024-09-17T02:24:52.276096+0000","last_peered":"2024-09-17T02:24:52.276096+0000","last_clean":"2024-09-17T02:24:52.276096+0000","last_became_active":"2024-09-17T02:24:30.691331+0000","last_became_peered":"2024-09-17T02:24:30.691331+0000","last_unstale":"2024-09-17T02:24:52.276096+0000","last_undegraded":"2024-09-17T02:24:52.276096+0000","last_fullsized":"2024-09-17T02:24:52.276096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:39.446085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":164,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278098+0000","last_change":"2024-09-17T02:24:30.694492+0000","last_active":"2024-09-17T02:24:52.278098+0000","last_peered":"2024-09-17T02:24:52.278098+0000","last_clean":"2024-09-17T02:24:52.278098+0000","last_became_active":"2024-09-17T02:24:30.691770+0000","last_became_peered":"2024-09-17T02:24:30.691770+0000","last_unstale":"2024-09-17T02:24:52.278098+0000","last_undegraded":"2024-09-17T02:24:52.278098+0000","last_fullsized":"2024-09-17T02:24:52.278098+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:01.597617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235468+0000","last_change":"2024-09-17T02:24:30.336636+0000","last_active":"2024-09-17T02:24:51.235468+0000","last_peered":"2024-09-17T02:24:51.235468+0000","last_clean":"2024-09-17T02:24:51.235468+0000","last_became_active":"2024-09-17T02:24:30.336110+0000","last_became_peered":"2024-09-17T02:24:30.336110+0000","last_unstale":"2024-09-17T02:24:51.235468+0000","last_undegraded":"2024-09-17T02:24:51.235468+0000","last_fullsized":"2024-09-17T02:24:51.235468+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:44.699884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604333+0000","last_change":"2024-09-17T02:24:30.700777+0000","last_active":"2024-09-17T02:24:51.604333+0000","last_peered":"2024-09-17T02:24:51.604333+0000","last_clean":"2024-09-17T02:24:51.604333+0000","last_became_active":"2024-09-17T02:24:30.696731+0000","last_became_peered":"2024-09-17T02:24:30.696731+0000","last_unstale":"2024-09-17T02:24:51.604333+0000","last_undegraded":"2024-09-17T02:24:51.604333+0000","last_fullsized":"2024-09-17T02:24:51.604333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:58.629953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234416+0000","last_change":"2024-09-17T02:24:30.326364+0000","last_active":"2024-09-17T02:24:51.234416+0000","last_peered":"2024-09-17T02:24:51.234416+0000","last_clean":"2024-09-17T02:24:51.234416+0000","last_became_active":"2024-09-17T02:24:30.325752+0000","last_became_peered":"2024-09-17T02:24:30.325752+0000","last_unstale":"2024-09-17T02:24:51.234416+0000","last_undegraded":"2024-09-17T02:24:51.234416+0000","last_fullsized":"2024-09-17T02:24:51.234416+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:33.800584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233479+0000","last_change":"2024-09-17T02:24:30.325924+0000","last_active":"2024-09-17T02:24:51.233479+0000","last_peered":"2024-09-17T02:24:51.233479+0000","last_clean":"2024-09-17T02:24:51.233479+0000","last_became_active":"2024-09-17T02:24:30.325688+0000","last_became_peered":"2024-09-17T02:24:30.325688+0000","last_unstale":"2024-09-17T02:24:51.233479+0000","last_undegraded":"2024-09-17T02:24:51.233479+0000","last_fullsized":"2024-09-17T02:24:51.233479+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:25.290483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276040+0000","last_change":"2024-09-17T02:24:34.731288+0000","last_active":"2024-09-17T02:24:52.276040+0000","last_peered":"2024-09-17T02:24:52.276040+0000","last_clean":"2024-09-17T02:24:52.276040+0000","last_became_active":"2024-09-17T02:24:34.730386+0000","last_became_peered":"2024-09-17T02:24:34.730386+0000","last_unstale":"2024-09-17T02:24:52.276040+0000","last_undegraded":"2024-09-17T02:24:52.276040+0000","last_fullsized":"2024-09-17T02:24:52.276040+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:45.808940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":103,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606673+0000","last_change":"2024-09-17T02:24:48.583147+0000","last_active":"2024-09-17T02:24:51.606673+0000","last_peered":"2024-09-17T02:24:51.606673+0000","last_clean":"2024-09-17T02:24:51.606673+0000","last_became_active":"2024-09-17T02:24:48.581390+0000","last_became_peered":"2024-09-17T02:24:48.581390+0000","last_unstale":"2024-09-17T02:24:51.606673+0000","last_undegraded":"2024-09-17T02:24:51.606673+0000","last_fullsized":"2024-09-17T02:24:51.606673+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:08.312173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235572+0000","last_change":"2024-09-17T02:24:30.325492+0000","last_active":"2024-09-17T02:24:51.235572+0000","last_peered":"2024-09-17T02:24:51.235572+0000","last_clean":"2024-09-17T02:24:51.235572+0000","last_became_active":"2024-09-17T02:24:30.325175+0000","last_became_peered":"2024-09-17T02:24:30.325175+0000","last_unstale":"2024-09-17T02:24:51.235572+0000","last_undegraded":"2024-09-17T02:24:51.235572+0000","last_fullsized":"2024-09-17T02:24:51.235572+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:04.443085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275866+0000","last_change":"2024-09-17T02:24:30.699551+0000","last_active":"2024-09-17T02:24:52.275866+0000","last_peered":"2024-09-17T02:24:52.275866+0000","last_clean":"2024-09-17T02:24:52.275866+0000","last_became_active":"2024-09-17T02:24:30.697986+0000","last_became_peered":"2024-09-17T02:24:30.697986+0000","last_unstale":"2024-09-17T02:24:52.275866+0000","last_undegraded":"2024-09-17T02:24:52.275866+0000","last_fullsized":"2024-09-17T02:24:52.275866+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:44.939985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278191+0000","last_change":"2024-09-17T02:24:30.697249+0000","last_active":"2024-09-17T02:24:52.278191+0000","last_peered":"2024-09-17T02:24:52.278191+0000","last_clean":"2024-09-17T02:24:52.278191+0000","last_became_active":"2024-09-17T02:24:30.696215+0000","last_became_peered":"2024-09-17T02:24:30.696215+0000","last_unstale":"2024-09-17T02:24:52.278191+0000","last_undegraded":"2024-09-17T02:24:52.278191+0000","last_fullsized":"2024-09-17T02:24:52.278191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:07.507822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276041+0000","last_change":"2024-09-17T02:20:16.577803+0000","last_active":"2024-09-17T02:24:52.276041+0000","last_peered":"2024-09-17T02:24:52.276041+0000","last_clean":"2024-09-17T02:24:52.276041+0000","last_became_active":"2024-09-17T02:20:16.576640+0000","last_became_peered":"2024-09-17T02:20:16.576640+0000","last_unstale":"2024-09-17T02:24:52.276041+0000","last_undegraded":"2024-09-17T02:24:52.276041+0000","last_fullsized":"2024-09-17T02:24:52.276041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:07.190169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606196+0000","last_change":"2024-09-17T02:24:30.706739+0000","last_active":"2024-09-17T02:24:51.606196+0000","last_peered":"2024-09-17T02:24:51.606196+0000","last_clean":"2024-09-17T02:24:51.606196+0000","last_became_active":"2024-09-17T02:24:30.706195+0000","last_became_peered":"2024-09-17T02:24:30.706195+0000","last_unstale":"2024-09-17T02:24:51.606196+0000","last_undegraded":"2024-09-17T02:24:51.606196+0000","last_fullsized":"2024-09-17T02:24:51.606196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:38.782264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275411+0000","last_change":"2024-09-17T02:24:34.733762+0000","last_active":"2024-09-17T02:24:52.275411+0000","last_peered":"2024-09-17T02:24:52.275411+0000","last_clean":"2024-09-17T02:24:52.275411+0000","last_became_active":"2024-09-17T02:24:34.731592+0000","last_became_peered":"2024-09-17T02:24:34.731592+0000","last_unstale":"2024-09-17T02:24:52.275411+0000","last_undegraded":"2024-09-17T02:24:52.275411+0000","last_fullsized":"2024-09-17T02:24:52.275411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:41.921908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277777+0000","last_change":"2024-09-17T02:24:30.696267+0000","last_active":"2024-09-17T02:24:52.277777+0000","last_peered":"2024-09-17T02:24:52.277777+0000","last_clean":"2024-09-17T02:24:52.277777+0000","last_became_active":"2024-09-17T02:24:30.694027+0000","last_became_peered":"2024-09-17T02:24:30.694027+0000","last_unstale":"2024-09-17T02:24:52.277777+0000","last_undegraded":"2024-09-17T02:24:52.277777+0000","last_fullsized":"2024-09-17T02:24:52.277777+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:56.160158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276145+0000","last_change":"2024-09-17T02:24:30.697568+0000","last_active":"2024-09-17T02:24:52.276145+0000","last_peered":"2024-09-17T02:24:52.276145+0000","last_clean":"2024-09-17T02:24:52.276145+0000","last_became_active":"2024-09-17T02:24:30.693991+0000","last_became_peered":"2024-09-17T02:24:30.693991+0000","last_unstale":"2024-09-17T02:24:52.276145+0000","last_undegraded":"2024-09-17T02:24:52.276145+0000","last_fullsized":"2024-09-17T02:24:52.276145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:45.636130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606140+0000","last_change":"2024-09-17T02:21:10.505967+0000","last_active":"2024-09-17T02:24:51.606140+0000","last_peered":"2024-09-17T02:24:51.606140+0000","last_clean":"2024-09-17T02:24:51.606140+0000","last_became_active":"2024-09-17T02:21:10.505594+0000","last_became_peered":"2024-09-17T02:21:10.505594+0000","last_unstale":"2024-09-17T02:24:51.606140+0000","last_undegraded":"2024-09-17T02:24:51.606140+0000","last_fullsized":"2024-09-17T02:24:51.606140+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:15.782752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605310+0000","last_change":"2024-09-17T02:24:48.579594+0000","last_active":"2024-09-17T02:24:51.605310+0000","last_peered":"2024-09-17T02:24:51.605310+0000","last_clean":"2024-09-17T02:24:51.605310+0000","last_became_active":"2024-09-17T02:24:48.578539+0000","last_became_peered":"2024-09-17T02:24:48.578539+0000","last_unstale":"2024-09-17T02:24:51.605310+0000","last_undegraded":"2024-09-17T02:24:51.605310+0000","last_fullsized":"2024-09-17T02:24:51.605310+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:11.515508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605322+0000","last_change":"2024-09-17T02:24:48.580567+0000","last_active":"2024-09-17T02:24:51.605322+0000","last_peered":"2024-09-17T02:24:51.605322+0000","last_clean":"2024-09-17T02:24:51.605322+0000","last_became_active":"2024-09-17T02:24:48.579612+0000","last_became_peered":"2024-09-17T02:24:48.579612+0000","last_unstale":"2024-09-17T02:24:51.605322+0000","last_undegraded":"2024-09-17T02:24:51.605322+0000","last_fullsized":"2024-09-17T02:24:51.605322+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:28:53.281135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605697+0000","last_change":"2024-09-17T02:24:30.698237+0000","last_active":"2024-09-17T02:24:51.605697+0000","last_peered":"2024-09-17T02:24:51.605697+0000","last_clean":"2024-09-17T02:24:51.605697+0000","last_became_active":"2024-09-17T02:24:30.697194+0000","last_became_peered":"2024-09-17T02:24:30.697194+0000","last_unstale":"2024-09-17T02:24:51.605697+0000","last_undegraded":"2024-09-17T02:24:51.605697+0000","last_fullsized":"2024-09-17T02:24:51.605697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:36.697224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232314+0000","last_change":"2024-09-17T02:24:34.360811+0000","last_active":"2024-09-17T02:24:51.232314+0000","last_peered":"2024-09-17T02:24:51.232314+0000","last_clean":"2024-09-17T02:24:51.232314+0000","last_became_active":"2024-09-17T02:24:34.359944+0000","last_became_peered":"2024-09-17T02:24:34.359944+0000","last_unstale":"2024-09-17T02:24:51.232314+0000","last_undegraded":"2024-09-17T02:24:51.232314+0000","last_fullsized":"2024-09-17T02:24:51.232314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:07.986774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234185+0000","last_change":"2024-09-17T02:24:30.327080+0000","last_active":"2024-09-17T02:24:51.234185+0000","last_peered":"2024-09-17T02:24:51.234185+0000","last_clean":"2024-09-17T02:24:51.234185+0000","last_became_active":"2024-09-17T02:24:30.326800+0000","last_became_peered":"2024-09-17T02:24:30.326800+0000","last_unstale":"2024-09-17T02:24:51.234185+0000","last_undegraded":"2024-09-17T02:24:51.234185+0000","last_fullsized":"2024-09-17T02:24:51.234185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:06.072812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233254+0000","last_change":"2024-09-17T02:24:30.322448+0000","last_active":"2024-09-17T02:24:51.233254+0000","last_peered":"2024-09-17T02:24:51.233254+0000","last_clean":"2024-09-17T02:24:51.233254+0000","last_became_active":"2024-09-17T02:24:30.322156+0000","last_became_peered":"2024-09-17T02:24:30.322156+0000","last_unstale":"2024-09-17T02:24:51.233254+0000","last_undegraded":"2024-09-17T02:24:51.233254+0000","last_fullsized":"2024-09-17T02:24:51.233254+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:46.435146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":102,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606560+0000","last_change":"2024-09-17T02:24:48.583271+0000","last_active":"2024-09-17T02:24:51.606560+0000","last_peered":"2024-09-17T02:24:51.606560+0000","last_clean":"2024-09-17T02:24:51.606560+0000","last_became_active":"2024-09-17T02:24:48.581355+0000","last_became_peered":"2024-09-17T02:24:48.581355+0000","last_unstale":"2024-09-17T02:24:51.606560+0000","last_undegraded":"2024-09-17T02:24:51.606560+0000","last_fullsized":"2024-09-17T02:24:51.606560+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:01.234040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604953+0000","last_change":"2024-09-17T02:20:16.570456+0000","last_active":"2024-09-17T02:24:51.604953+0000","last_peered":"2024-09-17T02:24:51.604953+0000","last_clean":"2024-09-17T02:24:51.604953+0000","last_became_active":"2024-09-17T02:20:16.568095+0000","last_became_peered":"2024-09-17T02:20:16.568095+0000","last_unstale":"2024-09-17T02:24:51.604953+0000","last_undegraded":"2024-09-17T02:24:51.604953+0000","last_fullsized":"2024-09-17T02:24:51.604953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:58.329169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":157,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278020+0000","last_change":"2024-09-17T02:20:15.560293+0000","last_active":"2024-09-17T02:24:52.278020+0000","last_peered":"2024-09-17T02:24:52.278020+0000","last_clean":"2024-09-17T02:24:52.278020+0000","last_became_active":"2024-09-17T02:20:15.559074+0000","last_became_peered":"2024-09-17T02:20:15.559074+0000","last_unstale":"2024-09-17T02:24:52.278020+0000","last_undegraded":"2024-09-17T02:24:52.278020+0000","last_fullsized":"2024-09-17T02:24:52.278020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:55.639841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233448+0000","last_change":"2024-09-17T02:24:30.319629+0000","last_active":"2024-09-17T02:24:51.233448+0000","last_peered":"2024-09-17T02:24:51.233448+0000","last_clean":"2024-09-17T02:24:51.233448+0000","last_became_active":"2024-09-17T02:24:30.319441+0000","last_became_peered":"2024-09-17T02:24:30.319441+0000","last_unstale":"2024-09-17T02:24:51.233448+0000","last_undegraded":"2024-09-17T02:24:51.233448+0000","last_fullsized":"2024-09-17T02:24:51.233448+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:58.379141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":167,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278026+0000","last_change":"2024-09-17T02:24:30.699964+0000","last_active":"2024-09-17T02:24:52.278026+0000","last_peered":"2024-09-17T02:24:52.278026+0000","last_clean":"2024-09-17T02:24:52.278026+0000","last_became_active":"2024-09-17T02:24:30.699102+0000","last_became_peered":"2024-09-17T02:24:30.699102+0000","last_unstale":"2024-09-17T02:24:52.278026+0000","last_undegraded":"2024-09-17T02:24:52.278026+0000","last_fullsized":"2024-09-17T02:24:52.278026+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:19.193516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5558,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705727,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361248,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":360190,"kb_avail":94010592,"statfs":{"total":96636764160,"available":96266846208,"internally_reserved":0,"allocated":1052672,"data_stored":983227,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":368835013},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":80,"seq":343597383687,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56488,"kb_used_data":1040,"kb_used_omap":6,"kb_used_meta":55417,"kb_avail":94315352,"statfs":{"total":96636764160,"available":96578920448,"internally_reserved":0,"allocated":1064960,"data_stored":983862,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":7153,"internal_metadata":56747023},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738430,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329228,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94042612,"statfs":{"total":96636764160,"available":96299634688,"internally_reserved":0,"allocated":974848,"data_stored":387439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5558,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T02:24:55.601 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:24:55.953 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:24:55.955 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-17T02:24:55.971 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2024-09-17T02:24:55.473375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":746964,"kb_used_data":3020,"kb_used_omap":10,"kb_used_meta":743861,"kb_avail":282368556,"statfs":{"total":289910292480,"available":289145401344,"internally_reserved":0,"allocated":3092480,"data_stored":2354528,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10343,"internal_metadata":761714585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002742"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605682+0000","last_change":"2024-09-17T02:24:34.733681+0000","last_active":"2024-09-17T02:24:51.605682+0000","last_peered":"2024-09-17T02:24:51.605682+0000","last_clean":"2024-09-17T02:24:51.605682+0000","last_became_active":"2024-09-17T02:24:34.732728+0000","last_became_peered":"2024-09-17T02:24:34.732728+0000","last_unstale":"2024-09-17T02:24:51.605682+0000","last_undegraded":"2024-09-17T02:24:51.605682+0000","last_fullsized":"2024-09-17T02:24:51.605682+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:21.613592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605214+0000","last_change":"2024-09-17T02:24:48.579919+0000","last_active":"2024-09-17T02:24:51.605214+0000","last_peered":"2024-09-17T02:24:51.605214+0000","last_clean":"2024-09-17T02:24:51.605214+0000","last_became_active":"2024-09-17T02:24:48.578274+0000","last_became_peered":"2024-09-17T02:24:48.578274+0000","last_unstale":"2024-09-17T02:24:51.605214+0000","last_undegraded":"2024-09-17T02:24:51.605214+0000","last_fullsized":"2024-09-17T02:24:51.605214+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:50.597846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.236296+0000","last_change":"2024-09-17T02:24:30.339249+0000","last_active":"2024-09-17T02:24:51.236296+0000","last_peered":"2024-09-17T02:24:51.236296+0000","last_clean":"2024-09-17T02:24:51.236296+0000","last_became_active":"2024-09-17T02:24:30.338199+0000","last_became_peered":"2024-09-17T02:24:30.338199+0000","last_unstale":"2024-09-17T02:24:51.236296+0000","last_undegraded":"2024-09-17T02:24:51.236296+0000","last_fullsized":"2024-09-17T02:24:51.236296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:51.734408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":87,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232438+0000","last_change":"2024-09-17T02:24:34.360587+0000","last_active":"2024-09-17T02:24:51.232438+0000","last_peered":"2024-09-17T02:24:51.232438+0000","last_clean":"2024-09-17T02:24:51.232438+0000","last_became_active":"2024-09-17T02:24:34.359912+0000","last_became_peered":"2024-09-17T02:24:34.359912+0000","last_unstale":"2024-09-17T02:24:51.232438+0000","last_undegraded":"2024-09-17T02:24:51.232438+0000","last_fullsized":"2024-09-17T02:24:51.232438+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:35.054937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605500+0000","last_change":"2024-09-17T02:24:48.579715+0000","last_active":"2024-09-17T02:24:51.605500+0000","last_peered":"2024-09-17T02:24:51.605500+0000","last_clean":"2024-09-17T02:24:51.605500+0000","last_became_active":"2024-09-17T02:24:48.578841+0000","last_became_peered":"2024-09-17T02:24:48.578841+0000","last_unstale":"2024-09-17T02:24:51.605500+0000","last_undegraded":"2024-09-17T02:24:51.605500+0000","last_fullsized":"2024-09-17T02:24:51.605500+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:23.197781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233991+0000","last_change":"2024-09-17T02:24:30.322619+0000","last_active":"2024-09-17T02:24:51.233991+0000","last_peered":"2024-09-17T02:24:51.233991+0000","last_clean":"2024-09-17T02:24:51.233991+0000","last_became_active":"2024-09-17T02:24:30.322191+0000","last_became_peered":"2024-09-17T02:24:30.322191+0000","last_unstale":"2024-09-17T02:24:51.233991+0000","last_undegraded":"2024-09-17T02:24:51.233991+0000","last_fullsized":"2024-09-17T02:24:51.233991+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:26.120304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233779+0000","last_change":"2024-09-17T02:24:30.330077+0000","last_active":"2024-09-17T02:24:51.233779+0000","last_peered":"2024-09-17T02:24:51.233779+0000","last_clean":"2024-09-17T02:24:51.233779+0000","last_became_active":"2024-09-17T02:24:30.329814+0000","last_became_peered":"2024-09-17T02:24:30.329814+0000","last_unstale":"2024-09-17T02:24:51.233779+0000","last_undegraded":"2024-09-17T02:24:51.233779+0000","last_fullsized":"2024-09-17T02:24:51.233779+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:09.933024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233077+0000","last_change":"2024-09-17T02:24:30.319625+0000","last_active":"2024-09-17T02:24:51.233077+0000","last_peered":"2024-09-17T02:24:51.233077+0000","last_clean":"2024-09-17T02:24:51.233077+0000","last_became_active":"2024-09-17T02:24:30.319316+0000","last_became_peered":"2024-09-17T02:24:30.319316+0000","last_unstale":"2024-09-17T02:24:51.233077+0000","last_undegraded":"2024-09-17T02:24:51.233077+0000","last_fullsized":"2024-09-17T02:24:51.233077+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:30.753462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277651+0000","last_change":"2024-09-17T02:20:16.584665+0000","last_active":"2024-09-17T02:24:52.277651+0000","last_peered":"2024-09-17T02:24:52.277651+0000","last_clean":"2024-09-17T02:24:52.277651+0000","last_became_active":"2024-09-17T02:20:16.580797+0000","last_became_peered":"2024-09-17T02:20:16.580797+0000","last_unstale":"2024-09-17T02:24:52.277651+0000","last_undegraded":"2024-09-17T02:24:52.277651+0000","last_fullsized":"2024-09-17T02:24:52.277651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:47.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605486+0000","last_change":"2024-09-17T02:24:34.733394+0000","last_active":"2024-09-17T02:24:51.605486+0000","last_peered":"2024-09-17T02:24:51.605486+0000","last_clean":"2024-09-17T02:24:51.605486+0000","last_became_active":"2024-09-17T02:24:34.732480+0000","last_became_peered":"2024-09-17T02:24:34.732480+0000","last_unstale":"2024-09-17T02:24:51.605486+0000","last_undegraded":"2024-09-17T02:24:51.605486+0000","last_fullsized":"2024-09-17T02:24:51.605486+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:37.005990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235423+0000","last_change":"2024-09-17T02:24:30.329180+0000","last_active":"2024-09-17T02:24:51.235423+0000","last_peered":"2024-09-17T02:24:51.235423+0000","last_clean":"2024-09-17T02:24:51.235423+0000","last_became_active":"2024-09-17T02:24:30.328962+0000","last_became_peered":"2024-09-17T02:24:30.328962+0000","last_unstale":"2024-09-17T02:24:51.235423+0000","last_undegraded":"2024-09-17T02:24:51.235423+0000","last_fullsized":"2024-09-17T02:24:51.235423+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:21.425064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605228+0000","last_change":"2024-09-17T02:24:48.583870+0000","last_active":"2024-09-17T02:24:51.605228+0000","last_peered":"2024-09-17T02:24:51.605228+0000","last_clean":"2024-09-17T02:24:51.605228+0000","last_became_active":"2024-09-17T02:24:48.581418+0000","last_became_peered":"2024-09-17T02:24:48.581418+0000","last_unstale":"2024-09-17T02:24:51.605228+0000","last_undegraded":"2024-09-17T02:24:51.605228+0000","last_fullsized":"2024-09-17T02:24:51.605228+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:52:52.425417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604958+0000","last_change":"2024-09-17T02:24:48.583016+0000","last_active":"2024-09-17T02:24:51.604958+0000","last_peered":"2024-09-17T02:24:51.604958+0000","last_clean":"2024-09-17T02:24:51.604958+0000","last_became_active":"2024-09-17T02:24:48.579221+0000","last_became_peered":"2024-09-17T02:24:48.579221+0000","last_unstale":"2024-09-17T02:24:51.604958+0000","last_undegraded":"2024-09-17T02:24:51.604958+0000","last_fullsized":"2024-09-17T02:24:51.604958+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:46.150529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233659+0000","last_change":"2024-09-17T02:24:30.337132+0000","last_active":"2024-09-17T02:24:51.233659+0000","last_peered":"2024-09-17T02:24:51.233659+0000","last_clean":"2024-09-17T02:24:51.233659+0000","last_became_active":"2024-09-17T02:24:30.335871+0000","last_became_peered":"2024-09-17T02:24:30.335871+0000","last_unstale":"2024-09-17T02:24:51.233659+0000","last_undegraded":"2024-09-17T02:24:51.233659+0000","last_fullsized":"2024-09-17T02:24:51.233659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:21.006777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233508+0000","last_change":"2024-09-17T02:24:30.335635+0000","last_active":"2024-09-17T02:24:51.233508+0000","last_peered":"2024-09-17T02:24:51.233508+0000","last_clean":"2024-09-17T02:24:51.233508+0000","last_became_active":"2024-09-17T02:24:30.335086+0000","last_became_peered":"2024-09-17T02:24:30.335086+0000","last_unstale":"2024-09-17T02:24:51.233508+0000","last_undegraded":"2024-09-17T02:24:51.233508+0000","last_fullsized":"2024-09-17T02:24:51.233508+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:01.913411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233514+0000","last_change":"2024-09-17T02:24:30.325322+0000","last_active":"2024-09-17T02:24:51.233514+0000","last_peered":"2024-09-17T02:24:51.233514+0000","last_clean":"2024-09-17T02:24:51.233514+0000","last_became_active":"2024-09-17T02:24:30.325002+0000","last_became_peered":"2024-09-17T02:24:30.325002+0000","last_unstale":"2024-09-17T02:24:51.233514+0000","last_undegraded":"2024-09-17T02:24:51.233514+0000","last_fullsized":"2024-09-17T02:24:51.233514+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:16.238014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278363+0000","last_change":"2024-09-17T02:20:16.563482+0000","last_active":"2024-09-17T02:24:52.278363+0000","last_peered":"2024-09-17T02:24:52.278363+0000","last_clean":"2024-09-17T02:24:52.278363+0000","last_became_active":"2024-09-17T02:20:16.562735+0000","last_became_peered":"2024-09-17T02:20:16.562735+0000","last_unstale":"2024-09-17T02:24:52.278363+0000","last_undegraded":"2024-09-17T02:24:52.278363+0000","last_fullsized":"2024-09-17T02:24:52.278363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:10.315951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605780+0000","last_change":"2024-09-17T02:24:48.583997+0000","last_active":"2024-09-17T02:24:51.605780+0000","last_peered":"2024-09-17T02:24:51.605780+0000","last_clean":"2024-09-17T02:24:51.605780+0000","last_became_active":"2024-09-17T02:24:48.580510+0000","last_became_peered":"2024-09-17T02:24:48.580510+0000","last_unstale":"2024-09-17T02:24:51.605780+0000","last_undegraded":"2024-09-17T02:24:51.605780+0000","last_fullsized":"2024-09-17T02:24:51.605780+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:21:58.370793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277220+0000","last_change":"2024-09-17T02:20:16.586950+0000","last_active":"2024-09-17T02:24:52.277220+0000","last_peered":"2024-09-17T02:24:52.277220+0000","last_clean":"2024-09-17T02:24:52.277220+0000","last_became_active":"2024-09-17T02:20:16.586281+0000","last_became_peered":"2024-09-17T02:20:16.586281+0000","last_unstale":"2024-09-17T02:24:52.277220+0000","last_undegraded":"2024-09-17T02:24:52.277220+0000","last_fullsized":"2024-09-17T02:24:52.277220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:22.801598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234871+0000","last_change":"2024-09-17T02:24:30.330312+0000","last_active":"2024-09-17T02:24:51.234871+0000","last_peered":"2024-09-17T02:24:51.234871+0000","last_clean":"2024-09-17T02:24:51.234871+0000","last_became_active":"2024-09-17T02:24:30.329980+0000","last_became_peered":"2024-09-17T02:24:30.329980+0000","last_unstale":"2024-09-17T02:24:51.234871+0000","last_undegraded":"2024-09-17T02:24:51.234871+0000","last_fullsized":"2024-09-17T02:24:51.234871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:53.422140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232041+0000","last_change":"2024-09-17T02:24:34.361003+0000","last_active":"2024-09-17T02:24:51.232041+0000","last_peered":"2024-09-17T02:24:51.232041+0000","last_clean":"2024-09-17T02:24:51.232041+0000","last_became_active":"2024-09-17T02:24:34.360259+0000","last_became_peered":"2024-09-17T02:24:34.360259+0000","last_unstale":"2024-09-17T02:24:51.232041+0000","last_undegraded":"2024-09-17T02:24:51.232041+0000","last_fullsized":"2024-09-17T02:24:51.232041+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:01.642214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605644+0000","last_change":"2024-09-17T02:24:30.702500+0000","last_active":"2024-09-17T02:24:51.605644+0000","last_peered":"2024-09-17T02:24:51.605644+0000","last_clean":"2024-09-17T02:24:51.605644+0000","last_became_active":"2024-09-17T02:24:30.700674+0000","last_became_peered":"2024-09-17T02:24:30.700674+0000","last_unstale":"2024-09-17T02:24:51.605644+0000","last_undegraded":"2024-09-17T02:24:51.605644+0000","last_fullsized":"2024-09-17T02:24:51.605644+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:47.554275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275778+0000","last_change":"2024-09-17T02:24:30.700096+0000","last_active":"2024-09-17T02:24:52.275778+0000","last_peered":"2024-09-17T02:24:52.275778+0000","last_clean":"2024-09-17T02:24:52.275778+0000","last_became_active":"2024-09-17T02:24:30.698022+0000","last_became_peered":"2024-09-17T02:24:30.698022+0000","last_unstale":"2024-09-17T02:24:52.275778+0000","last_undegraded":"2024-09-17T02:24:52.275778+0000","last_fullsized":"2024-09-17T02:24:52.275778+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:53.002528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604171+0000","last_change":"2024-09-17T02:24:48.577229+0000","last_active":"2024-09-17T02:24:51.604171+0000","last_peered":"2024-09-17T02:24:51.604171+0000","last_clean":"2024-09-17T02:24:51.604171+0000","last_became_active":"2024-09-17T02:24:48.576615+0000","last_became_peered":"2024-09-17T02:24:48.576615+0000","last_unstale":"2024-09-17T02:24:51.604171+0000","last_undegraded":"2024-09-17T02:24:51.604171+0000","last_fullsized":"2024-09-17T02:24:51.604171+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:23.827785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606021+0000","last_change":"2024-09-17T02:24:30.704846+0000","last_active":"2024-09-17T02:24:51.606021+0000","last_peered":"2024-09-17T02:24:51.606021+0000","last_clean":"2024-09-17T02:24:51.606021+0000","last_became_active":"2024-09-17T02:24:30.703377+0000","last_became_peered":"2024-09-17T02:24:30.703377+0000","last_unstale":"2024-09-17T02:24:51.606021+0000","last_undegraded":"2024-09-17T02:24:51.606021+0000","last_fullsized":"2024-09-17T02:24:51.606021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:21.642002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277663+0000","last_change":"2024-09-17T02:24:30.696851+0000","last_active":"2024-09-17T02:24:52.277663+0000","last_peered":"2024-09-17T02:24:52.277663+0000","last_clean":"2024-09-17T02:24:52.277663+0000","last_became_active":"2024-09-17T02:24:30.694853+0000","last_became_peered":"2024-09-17T02:24:30.694853+0000","last_unstale":"2024-09-17T02:24:52.277663+0000","last_undegraded":"2024-09-17T02:24:52.277663+0000","last_fullsized":"2024-09-17T02:24:52.277663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:39.353246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235268+0000","last_change":"2024-09-17T02:24:30.339430+0000","last_active":"2024-09-17T02:24:51.235268+0000","last_peered":"2024-09-17T02:24:51.235268+0000","last_clean":"2024-09-17T02:24:51.235268+0000","last_became_active":"2024-09-17T02:24:30.338488+0000","last_became_peered":"2024-09-17T02:24:30.338488+0000","last_unstale":"2024-09-17T02:24:51.235268+0000","last_undegraded":"2024-09-17T02:24:51.235268+0000","last_fullsized":"2024-09-17T02:24:51.235268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:26.554742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606211+0000","last_change":"2024-09-17T02:24:48.584148+0000","last_active":"2024-09-17T02:24:51.606211+0000","last_peered":"2024-09-17T02:24:51.606211+0000","last_clean":"2024-09-17T02:24:51.606211+0000","last_became_active":"2024-09-17T02:24:48.582959+0000","last_became_peered":"2024-09-17T02:24:48.582959+0000","last_unstale":"2024-09-17T02:24:51.606211+0000","last_undegraded":"2024-09-17T02:24:51.606211+0000","last_fullsized":"2024-09-17T02:24:51.606211+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:24.455294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276722+0000","last_change":"2024-09-17T02:24:34.734388+0000","last_active":"2024-09-17T02:24:52.276722+0000","last_peered":"2024-09-17T02:24:52.276722+0000","last_clean":"2024-09-17T02:24:52.276722+0000","last_became_active":"2024-09-17T02:24:34.733451+0000","last_became_peered":"2024-09-17T02:24:34.733451+0000","last_unstale":"2024-09-17T02:24:52.276722+0000","last_undegraded":"2024-09-17T02:24:52.276722+0000","last_fullsized":"2024-09-17T02:24:52.276722+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:22.488478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605030+0000","last_change":"2024-09-17T02:24:30.700893+0000","last_active":"2024-09-17T02:24:51.605030+0000","last_peered":"2024-09-17T02:24:51.605030+0000","last_clean":"2024-09-17T02:24:51.605030+0000","last_became_active":"2024-09-17T02:24:30.699410+0000","last_became_peered":"2024-09-17T02:24:30.699410+0000","last_unstale":"2024-09-17T02:24:51.605030+0000","last_undegraded":"2024-09-17T02:24:51.605030+0000","last_fullsized":"2024-09-17T02:24:51.605030+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:29.137738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275593+0000","last_change":"2024-09-17T02:24:34.727144+0000","last_active":"2024-09-17T02:24:52.275593+0000","last_peered":"2024-09-17T02:24:52.275593+0000","last_clean":"2024-09-17T02:24:52.275593+0000","last_became_active":"2024-09-17T02:24:34.725109+0000","last_became_peered":"2024-09-17T02:24:34.725109+0000","last_unstale":"2024-09-17T02:24:52.275593+0000","last_undegraded":"2024-09-17T02:24:52.275593+0000","last_fullsized":"2024-09-17T02:24:52.275593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:59.629654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.231948+0000","last_change":"2024-09-17T02:24:34.357265+0000","last_active":"2024-09-17T02:24:51.231948+0000","last_peered":"2024-09-17T02:24:51.231948+0000","last_clean":"2024-09-17T02:24:51.231948+0000","last_became_active":"2024-09-17T02:24:34.356639+0000","last_became_peered":"2024-09-17T02:24:34.356639+0000","last_unstale":"2024-09-17T02:24:51.231948+0000","last_undegraded":"2024-09-17T02:24:51.231948+0000","last_fullsized":"2024-09-17T02:24:51.231948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:30.236713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605501+0000","last_change":"2024-09-17T02:24:48.583278+0000","last_active":"2024-09-17T02:24:51.605501+0000","last_peered":"2024-09-17T02:24:51.605501+0000","last_clean":"2024-09-17T02:24:51.605501+0000","last_became_active":"2024-09-17T02:24:48.581121+0000","last_became_peered":"2024-09-17T02:24:48.581121+0000","last_unstale":"2024-09-17T02:24:51.605501+0000","last_undegraded":"2024-09-17T02:24:51.605501+0000","last_fullsized":"2024-09-17T02:24:51.605501+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:39.957807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234860+0000","last_change":"2024-09-17T02:24:30.329201+0000","last_active":"2024-09-17T02:24:51.234860+0000","last_peered":"2024-09-17T02:24:51.234860+0000","last_clean":"2024-09-17T02:24:51.234860+0000","last_became_active":"2024-09-17T02:24:30.328907+0000","last_became_peered":"2024-09-17T02:24:30.328907+0000","last_unstale":"2024-09-17T02:24:51.234860+0000","last_undegraded":"2024-09-17T02:24:51.234860+0000","last_fullsized":"2024-09-17T02:24:51.234860+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:31.463647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606423+0000","last_change":"2024-09-17T02:24:34.732466+0000","last_active":"2024-09-17T02:24:51.606423+0000","last_peered":"2024-09-17T02:24:51.606423+0000","last_clean":"2024-09-17T02:24:51.606423+0000","last_became_active":"2024-09-17T02:24:34.731598+0000","last_became_peered":"2024-09-17T02:24:34.731598+0000","last_unstale":"2024-09-17T02:24:51.606423+0000","last_undegraded":"2024-09-17T02:24:51.606423+0000","last_fullsized":"2024-09-17T02:24:51.606423+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:33.350084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275176+0000","last_change":"2024-09-17T02:24:34.730124+0000","last_active":"2024-09-17T02:24:52.275176+0000","last_peered":"2024-09-17T02:24:52.275176+0000","last_clean":"2024-09-17T02:24:52.275176+0000","last_became_active":"2024-09-17T02:24:34.727345+0000","last_became_peered":"2024-09-17T02:24:34.727345+0000","last_unstale":"2024-09-17T02:24:52.275176+0000","last_undegraded":"2024-09-17T02:24:52.275176+0000","last_fullsized":"2024-09-17T02:24:52.275176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:20.739364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275221+0000","last_change":"2024-09-17T02:24:34.731057+0000","last_active":"2024-09-17T02:24:52.275221+0000","last_peered":"2024-09-17T02:24:52.275221+0000","last_clean":"2024-09-17T02:24:52.275221+0000","last_became_active":"2024-09-17T02:24:34.730285+0000","last_became_peered":"2024-09-17T02:24:34.730285+0000","last_unstale":"2024-09-17T02:24:52.275221+0000","last_undegraded":"2024-09-17T02:24:52.275221+0000","last_fullsized":"2024-09-17T02:24:52.275221+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:28.085866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604612+0000","last_change":"2024-09-17T02:24:30.702653+0000","last_active":"2024-09-17T02:24:51.604612+0000","last_peered":"2024-09-17T02:24:51.604612+0000","last_clean":"2024-09-17T02:24:51.604612+0000","last_became_active":"2024-09-17T02:24:30.701047+0000","last_became_peered":"2024-09-17T02:24:30.701047+0000","last_unstale":"2024-09-17T02:24:51.604612+0000","last_undegraded":"2024-09-17T02:24:51.604612+0000","last_fullsized":"2024-09-17T02:24:51.604612+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:26.569439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277891+0000","last_change":"2024-09-17T02:24:30.698841+0000","last_active":"2024-09-17T02:24:52.277891+0000","last_peered":"2024-09-17T02:24:52.277891+0000","last_clean":"2024-09-17T02:24:52.277891+0000","last_became_active":"2024-09-17T02:24:30.697606+0000","last_became_peered":"2024-09-17T02:24:30.697606+0000","last_unstale":"2024-09-17T02:24:52.277891+0000","last_undegraded":"2024-09-17T02:24:52.277891+0000","last_fullsized":"2024-09-17T02:24:52.277891+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:20.038861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232570+0000","last_change":"2024-09-17T02:24:30.336630+0000","last_active":"2024-09-17T02:24:51.232570+0000","last_peered":"2024-09-17T02:24:51.232570+0000","last_clean":"2024-09-17T02:24:51.232570+0000","last_became_active":"2024-09-17T02:24:30.336326+0000","last_became_peered":"2024-09-17T02:24:30.336326+0000","last_unstale":"2024-09-17T02:24:51.232570+0000","last_undegraded":"2024-09-17T02:24:51.232570+0000","last_fullsized":"2024-09-17T02:24:51.232570+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:30.072709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.236283+0000","last_change":"2024-09-17T02:24:30.336771+0000","last_active":"2024-09-17T02:24:51.236283+0000","last_peered":"2024-09-17T02:24:51.236283+0000","last_clean":"2024-09-17T02:24:51.236283+0000","last_became_active":"2024-09-17T02:24:30.336494+0000","last_became_peered":"2024-09-17T02:24:30.336494+0000","last_unstale":"2024-09-17T02:24:51.236283+0000","last_undegraded":"2024-09-17T02:24:51.236283+0000","last_fullsized":"2024-09-17T02:24:51.236283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:17.852502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604224+0000","last_change":"2024-09-17T02:24:48.583894+0000","last_active":"2024-09-17T02:24:51.604224+0000","last_peered":"2024-09-17T02:24:51.604224+0000","last_clean":"2024-09-17T02:24:51.604224+0000","last_became_active":"2024-09-17T02:24:48.580644+0000","last_became_peered":"2024-09-17T02:24:48.580644+0000","last_unstale":"2024-09-17T02:24:51.604224+0000","last_undegraded":"2024-09-17T02:24:51.604224+0000","last_fullsized":"2024-09-17T02:24:51.604224+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:15.855050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":165,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606071+0000","last_change":"2024-09-17T02:24:30.697584+0000","last_active":"2024-09-17T02:24:51.606071+0000","last_peered":"2024-09-17T02:24:51.606071+0000","last_clean":"2024-09-17T02:24:51.606071+0000","last_became_active":"2024-09-17T02:24:30.695140+0000","last_became_peered":"2024-09-17T02:24:30.695140+0000","last_unstale":"2024-09-17T02:24:51.606071+0000","last_undegraded":"2024-09-17T02:24:51.606071+0000","last_fullsized":"2024-09-17T02:24:51.606071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:07.386102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604282+0000","last_change":"2024-09-17T02:24:48.577640+0000","last_active":"2024-09-17T02:24:51.604282+0000","last_peered":"2024-09-17T02:24:51.604282+0000","last_clean":"2024-09-17T02:24:51.604282+0000","last_became_active":"2024-09-17T02:24:48.576802+0000","last_became_peered":"2024-09-17T02:24:48.576802+0000","last_unstale":"2024-09-17T02:24:51.604282+0000","last_undegraded":"2024-09-17T02:24:51.604282+0000","last_fullsized":"2024-09-17T02:24:51.604282+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:11.030891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234885+0000","last_change":"2024-09-17T02:24:30.338939+0000","last_active":"2024-09-17T02:24:51.234885+0000","last_peered":"2024-09-17T02:24:51.234885+0000","last_clean":"2024-09-17T02:24:51.234885+0000","last_became_active":"2024-09-17T02:24:30.337650+0000","last_became_peered":"2024-09-17T02:24:30.337650+0000","last_unstale":"2024-09-17T02:24:51.234885+0000","last_undegraded":"2024-09-17T02:24:51.234885+0000","last_fullsized":"2024-09-17T02:24:51.234885+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:00.927950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234077+0000","last_change":"2024-09-17T02:24:30.322785+0000","last_active":"2024-09-17T02:24:51.234077+0000","last_peered":"2024-09-17T02:24:51.234077+0000","last_clean":"2024-09-17T02:24:51.234077+0000","last_became_active":"2024-09-17T02:24:30.322509+0000","last_became_peered":"2024-09-17T02:24:30.322509+0000","last_unstale":"2024-09-17T02:24:51.234077+0000","last_undegraded":"2024-09-17T02:24:51.234077+0000","last_fullsized":"2024-09-17T02:24:51.234077+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:06.381434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234190+0000","last_change":"2024-09-17T02:24:30.329944+0000","last_active":"2024-09-17T02:24:51.234190+0000","last_peered":"2024-09-17T02:24:51.234190+0000","last_clean":"2024-09-17T02:24:51.234190+0000","last_became_active":"2024-09-17T02:24:30.329642+0000","last_became_peered":"2024-09-17T02:24:30.329642+0000","last_unstale":"2024-09-17T02:24:51.234190+0000","last_undegraded":"2024-09-17T02:24:51.234190+0000","last_fullsized":"2024-09-17T02:24:51.234190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:39.135831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277004+0000","last_change":"2024-09-17T02:24:30.699239+0000","last_active":"2024-09-17T02:24:52.277004+0000","last_peered":"2024-09-17T02:24:52.277004+0000","last_clean":"2024-09-17T02:24:52.277004+0000","last_became_active":"2024-09-17T02:24:30.697800+0000","last_became_peered":"2024-09-17T02:24:30.697800+0000","last_unstale":"2024-09-17T02:24:52.277004+0000","last_undegraded":"2024-09-17T02:24:52.277004+0000","last_fullsized":"2024-09-17T02:24:52.277004+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:42.056577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":165,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277720+0000","last_change":"2024-09-17T02:24:30.697486+0000","last_active":"2024-09-17T02:24:52.277720+0000","last_peered":"2024-09-17T02:24:52.277720+0000","last_clean":"2024-09-17T02:24:52.277720+0000","last_became_active":"2024-09-17T02:24:30.696079+0000","last_became_peered":"2024-09-17T02:24:30.696079+0000","last_unstale":"2024-09-17T02:24:52.277720+0000","last_undegraded":"2024-09-17T02:24:52.277720+0000","last_fullsized":"2024-09-17T02:24:52.277720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:07.222731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234635+0000","last_change":"2024-09-17T02:24:30.330194+0000","last_active":"2024-09-17T02:24:51.234635+0000","last_peered":"2024-09-17T02:24:51.234635+0000","last_clean":"2024-09-17T02:24:51.234635+0000","last_became_active":"2024-09-17T02:24:30.329676+0000","last_became_peered":"2024-09-17T02:24:30.329676+0000","last_unstale":"2024-09-17T02:24:51.234635+0000","last_undegraded":"2024-09-17T02:24:51.234635+0000","last_fullsized":"2024-09-17T02:24:51.234635+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:50:41.161871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232120+0000","last_change":"2024-09-17T02:24:34.360950+0000","last_active":"2024-09-17T02:24:51.232120+0000","last_peered":"2024-09-17T02:24:51.232120+0000","last_clean":"2024-09-17T02:24:51.232120+0000","last_became_active":"2024-09-17T02:24:34.360020+0000","last_became_peered":"2024-09-17T02:24:34.360020+0000","last_unstale":"2024-09-17T02:24:51.232120+0000","last_undegraded":"2024-09-17T02:24:51.232120+0000","last_fullsized":"2024-09-17T02:24:51.232120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:57.653961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234818+0000","last_change":"2024-09-17T02:24:30.338531+0000","last_active":"2024-09-17T02:24:51.234818+0000","last_peered":"2024-09-17T02:24:51.234818+0000","last_clean":"2024-09-17T02:24:51.234818+0000","last_became_active":"2024-09-17T02:24:30.336902+0000","last_became_peered":"2024-09-17T02:24:30.336902+0000","last_unstale":"2024-09-17T02:24:51.234818+0000","last_undegraded":"2024-09-17T02:24:51.234818+0000","last_fullsized":"2024-09-17T02:24:51.234818+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:49.660896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":101,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604622+0000","last_change":"2024-09-17T02:24:48.579411+0000","last_active":"2024-09-17T02:24:51.604622+0000","last_peered":"2024-09-17T02:24:51.604622+0000","last_clean":"2024-09-17T02:24:51.604622+0000","last_became_active":"2024-09-17T02:24:48.578461+0000","last_became_peered":"2024-09-17T02:24:48.578461+0000","last_unstale":"2024-09-17T02:24:51.604622+0000","last_undegraded":"2024-09-17T02:24:51.604622+0000","last_fullsized":"2024-09-17T02:24:51.604622+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:09:43.054480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.236338+0000","last_change":"2024-09-17T02:24:30.326828+0000","last_active":"2024-09-17T02:24:51.236338+0000","last_peered":"2024-09-17T02:24:51.236338+0000","last_clean":"2024-09-17T02:24:51.236338+0000","last_became_active":"2024-09-17T02:24:30.326227+0000","last_became_peered":"2024-09-17T02:24:30.326227+0000","last_unstale":"2024-09-17T02:24:51.236338+0000","last_undegraded":"2024-09-17T02:24:51.236338+0000","last_fullsized":"2024-09-17T02:24:51.236338+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:53.135460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604435+0000","last_change":"2024-09-17T02:24:48.580927+0000","last_active":"2024-09-17T02:24:51.604435+0000","last_peered":"2024-09-17T02:24:51.604435+0000","last_clean":"2024-09-17T02:24:51.604435+0000","last_became_active":"2024-09-17T02:24:48.578678+0000","last_became_peered":"2024-09-17T02:24:48.578678+0000","last_unstale":"2024-09-17T02:24:51.604435+0000","last_undegraded":"2024-09-17T02:24:51.604435+0000","last_fullsized":"2024-09-17T02:24:51.604435+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:46.131656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277923+0000","last_change":"2024-09-17T02:20:16.583084+0000","last_active":"2024-09-17T02:24:52.277923+0000","last_peered":"2024-09-17T02:24:52.277923+0000","last_clean":"2024-09-17T02:24:52.277923+0000","last_became_active":"2024-09-17T02:20:16.582326+0000","last_became_peered":"2024-09-17T02:20:16.582326+0000","last_unstale":"2024-09-17T02:24:52.277923+0000","last_undegraded":"2024-09-17T02:24:52.277923+0000","last_fullsized":"2024-09-17T02:24:52.277923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:05.049317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":236,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232539+0000","last_change":"2024-09-17T02:24:30.338760+0000","last_active":"2024-09-17T02:24:51.232539+0000","last_peered":"2024-09-17T02:24:51.232539+0000","last_clean":"2024-09-17T02:24:51.232539+0000","last_became_active":"2024-09-17T02:24:30.338214+0000","last_became_peered":"2024-09-17T02:24:30.338214+0000","last_unstale":"2024-09-17T02:24:51.232539+0000","last_undegraded":"2024-09-17T02:24:51.232539+0000","last_fullsized":"2024-09-17T02:24:51.232539+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_clean_scrub_stamp":"2024-09-17T02:20:03.432050+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:27:29.124652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":60,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233731+0000","last_change":"2024-09-17T02:24:30.325326+0000","last_active":"2024-09-17T02:24:51.233731+0000","last_peered":"2024-09-17T02:24:51.233731+0000","last_clean":"2024-09-17T02:24:51.233731+0000","last_became_active":"2024-09-17T02:24:30.324910+0000","last_became_peered":"2024-09-17T02:24:30.324910+0000","last_unstale":"2024-09-17T02:24:51.233731+0000","last_undegraded":"2024-09-17T02:24:51.233731+0000","last_fullsized":"2024-09-17T02:24:51.233731+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:52:27.682190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276836+0000","last_change":"2024-09-17T02:20:15.560646+0000","last_active":"2024-09-17T02:24:52.276836+0000","last_peered":"2024-09-17T02:24:52.276836+0000","last_clean":"2024-09-17T02:24:52.276836+0000","last_became_active":"2024-09-17T02:20:15.559104+0000","last_became_peered":"2024-09-17T02:20:15.559104+0000","last_unstale":"2024-09-17T02:24:52.276836+0000","last_undegraded":"2024-09-17T02:24:52.276836+0000","last_fullsized":"2024-09-17T02:24:52.276836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:44.299986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235150+0000","last_change":"2024-09-17T02:24:30.339100+0000","last_active":"2024-09-17T02:24:51.235150+0000","last_peered":"2024-09-17T02:24:51.235150+0000","last_clean":"2024-09-17T02:24:51.235150+0000","last_became_active":"2024-09-17T02:24:30.337415+0000","last_became_peered":"2024-09-17T02:24:30.337415+0000","last_unstale":"2024-09-17T02:24:51.235150+0000","last_undegraded":"2024-09-17T02:24:51.235150+0000","last_fullsized":"2024-09-17T02:24:51.235150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:27.682975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233159+0000","last_change":"2024-09-17T02:24:30.338621+0000","last_active":"2024-09-17T02:24:51.233159+0000","last_peered":"2024-09-17T02:24:51.233159+0000","last_clean":"2024-09-17T02:24:51.233159+0000","last_became_active":"2024-09-17T02:24:30.338024+0000","last_became_peered":"2024-09-17T02:24:30.338024+0000","last_unstale":"2024-09-17T02:24:51.233159+0000","last_undegraded":"2024-09-17T02:24:51.233159+0000","last_fullsized":"2024-09-17T02:24:51.233159+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:49.985865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276198+0000","last_change":"2024-09-17T02:24:30.694491+0000","last_active":"2024-09-17T02:24:52.276198+0000","last_peered":"2024-09-17T02:24:52.276198+0000","last_clean":"2024-09-17T02:24:52.276198+0000","last_became_active":"2024-09-17T02:24:30.693653+0000","last_became_peered":"2024-09-17T02:24:30.693653+0000","last_unstale":"2024-09-17T02:24:52.276198+0000","last_undegraded":"2024-09-17T02:24:52.276198+0000","last_fullsized":"2024-09-17T02:24:52.276198+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:12.740030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605591+0000","last_change":"2024-09-17T02:20:16.571568+0000","last_active":"2024-09-17T02:24:51.605591+0000","last_peered":"2024-09-17T02:24:51.605591+0000","last_clean":"2024-09-17T02:24:51.605591+0000","last_became_active":"2024-09-17T02:20:16.570622+0000","last_became_peered":"2024-09-17T02:20:16.570622+0000","last_unstale":"2024-09-17T02:24:51.605591+0000","last_undegraded":"2024-09-17T02:24:51.605591+0000","last_fullsized":"2024-09-17T02:24:51.605591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:57.083446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276496+0000","last_change":"2024-09-17T02:20:12.511823+0000","last_active":"2024-09-17T02:24:52.276496+0000","last_peered":"2024-09-17T02:24:52.276496+0000","last_clean":"2024-09-17T02:24:52.276496+0000","last_became_active":"2024-09-17T02:20:10.497164+0000","last_became_peered":"2024-09-17T02:20:10.497164+0000","last_unstale":"2024-09-17T02:24:52.276496+0000","last_undegraded":"2024-09-17T02:24:52.276496+0000","last_fullsized":"2024-09-17T02:24:52.276496+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:21.242753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081052700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":101,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604499+0000","last_change":"2024-09-17T02:24:48.585305+0000","last_active":"2024-09-17T02:24:51.604499+0000","last_peered":"2024-09-17T02:24:51.604499+0000","last_clean":"2024-09-17T02:24:51.604499+0000","last_became_active":"2024-09-17T02:24:48.582729+0000","last_became_peered":"2024-09-17T02:24:48.582729+0000","last_unstale":"2024-09-17T02:24:51.604499+0000","last_undegraded":"2024-09-17T02:24:51.604499+0000","last_fullsized":"2024-09-17T02:24:51.604499+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:58.012479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277630+0000","last_change":"2024-09-17T02:24:34.730636+0000","last_active":"2024-09-17T02:24:52.277630+0000","last_peered":"2024-09-17T02:24:52.277630+0000","last_clean":"2024-09-17T02:24:52.277630+0000","last_became_active":"2024-09-17T02:24:34.729890+0000","last_became_peered":"2024-09-17T02:24:34.729890+0000","last_unstale":"2024-09-17T02:24:52.277630+0000","last_undegraded":"2024-09-17T02:24:52.277630+0000","last_fullsized":"2024-09-17T02:24:52.277630+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:07.679985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232887+0000","last_change":"2024-09-17T02:24:30.333204+0000","last_active":"2024-09-17T02:24:51.232887+0000","last_peered":"2024-09-17T02:24:51.232887+0000","last_clean":"2024-09-17T02:24:51.232887+0000","last_became_active":"2024-09-17T02:24:30.333005+0000","last_became_peered":"2024-09-17T02:24:30.333005+0000","last_unstale":"2024-09-17T02:24:51.232887+0000","last_undegraded":"2024-09-17T02:24:51.232887+0000","last_fullsized":"2024-09-17T02:24:51.232887+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:17.620422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078085399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234838+0000","last_change":"2024-09-17T02:24:30.329442+0000","last_active":"2024-09-17T02:24:51.234838+0000","last_peered":"2024-09-17T02:24:51.234838+0000","last_clean":"2024-09-17T02:24:51.234838+0000","last_became_active":"2024-09-17T02:24:30.329213+0000","last_became_peered":"2024-09-17T02:24:30.329213+0000","last_unstale":"2024-09-17T02:24:51.234838+0000","last_undegraded":"2024-09-17T02:24:51.234838+0000","last_fullsized":"2024-09-17T02:24:51.234838+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:25.034116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277315+0000","last_change":"2024-09-17T02:20:16.580184+0000","last_active":"2024-09-17T02:24:52.277315+0000","last_peered":"2024-09-17T02:24:52.277315+0000","last_clean":"2024-09-17T02:24:52.277315+0000","last_became_active":"2024-09-17T02:20:16.578343+0000","last_became_peered":"2024-09-17T02:20:16.578343+0000","last_unstale":"2024-09-17T02:24:52.277315+0000","last_undegraded":"2024-09-17T02:24:52.277315+0000","last_fullsized":"2024-09-17T02:24:52.277315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:42.123535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232100+0000","last_change":"2024-09-17T02:24:34.354157+0000","last_active":"2024-09-17T02:24:51.232100+0000","last_peered":"2024-09-17T02:24:51.232100+0000","last_clean":"2024-09-17T02:24:51.232100+0000","last_became_active":"2024-09-17T02:24:34.353619+0000","last_became_peered":"2024-09-17T02:24:34.353619+0000","last_unstale":"2024-09-17T02:24:51.232100+0000","last_undegraded":"2024-09-17T02:24:51.232100+0000","last_fullsized":"2024-09-17T02:24:51.232100+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:53:03.444794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277559+0000","last_change":"2024-09-17T02:20:12.511838+0000","last_active":"2024-09-17T02:24:52.277559+0000","last_peered":"2024-09-17T02:24:52.277559+0000","last_clean":"2024-09-17T02:24:52.277559+0000","last_became_active":"2024-09-17T02:20:10.497049+0000","last_became_peered":"2024-09-17T02:20:10.497049+0000","last_unstale":"2024-09-17T02:24:52.277559+0000","last_undegraded":"2024-09-17T02:24:52.277559+0000","last_fullsized":"2024-09-17T02:24:52.277559+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:54.446484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079701100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604586+0000","last_change":"2024-09-17T02:24:30.698392+0000","last_active":"2024-09-17T02:24:51.604586+0000","last_peered":"2024-09-17T02:24:51.604586+0000","last_clean":"2024-09-17T02:24:51.604586+0000","last_became_active":"2024-09-17T02:24:30.694944+0000","last_became_peered":"2024-09-17T02:24:30.694944+0000","last_unstale":"2024-09-17T02:24:51.604586+0000","last_undegraded":"2024-09-17T02:24:51.604586+0000","last_fullsized":"2024-09-17T02:24:51.604586+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:06.407404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277487+0000","last_change":"2024-09-17T02:20:15.559252+0000","last_active":"2024-09-17T02:24:52.277487+0000","last_peered":"2024-09-17T02:24:52.277487+0000","last_clean":"2024-09-17T02:24:52.277487+0000","last_became_active":"2024-09-17T02:20:15.557667+0000","last_became_peered":"2024-09-17T02:20:15.557667+0000","last_unstale":"2024-09-17T02:24:52.277487+0000","last_undegraded":"2024-09-17T02:24:52.277487+0000","last_fullsized":"2024-09-17T02:24:52.277487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:01.292626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606815+0000","last_change":"2024-09-17T02:20:12.661034+0000","last_active":"2024-09-17T02:24:51.606815+0000","last_peered":"2024-09-17T02:24:51.606815+0000","last_clean":"2024-09-17T02:24:51.606815+0000","last_became_active":"2024-09-17T02:20:10.497829+0000","last_became_peered":"2024-09-17T02:20:10.497829+0000","last_unstale":"2024-09-17T02:24:51.606815+0000","last_undegraded":"2024-09-17T02:24:51.606815+0000","last_fullsized":"2024-09-17T02:24:51.606815+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:46:27.427685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096944700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605391+0000","last_change":"2024-09-17T02:24:48.581467+0000","last_active":"2024-09-17T02:24:51.605391+0000","last_peered":"2024-09-17T02:24:51.605391+0000","last_clean":"2024-09-17T02:24:51.605391+0000","last_became_active":"2024-09-17T02:24:48.580388+0000","last_became_peered":"2024-09-17T02:24:48.580388+0000","last_unstale":"2024-09-17T02:24:51.605391+0000","last_undegraded":"2024-09-17T02:24:51.605391+0000","last_fullsized":"2024-09-17T02:24:51.605391+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:21:11.358704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278338+0000","last_change":"2024-09-17T02:20:15.558961+0000","last_active":"2024-09-17T02:24:52.278338+0000","last_peered":"2024-09-17T02:24:52.278338+0000","last_clean":"2024-09-17T02:24:52.278338+0000","last_became_active":"2024-09-17T02:20:15.558299+0000","last_became_peered":"2024-09-17T02:20:15.558299+0000","last_unstale":"2024-09-17T02:24:52.278338+0000","last_undegraded":"2024-09-17T02:24:52.278338+0000","last_fullsized":"2024-09-17T02:24:52.278338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:39.709524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278295+0000","last_change":"2024-09-17T02:20:12.512481+0000","last_active":"2024-09-17T02:24:52.278295+0000","last_peered":"2024-09-17T02:24:52.278295+0000","last_clean":"2024-09-17T02:24:52.278295+0000","last_became_active":"2024-09-17T02:20:10.497021+0000","last_became_peered":"2024-09-17T02:20:10.497021+0000","last_unstale":"2024-09-17T02:24:52.278295+0000","last_undegraded":"2024-09-17T02:24:52.278295+0000","last_fullsized":"2024-09-17T02:24:52.278295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:41.167283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001400079,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276096+0000","last_change":"2024-09-17T02:24:30.693811+0000","last_active":"2024-09-17T02:24:52.276096+0000","last_peered":"2024-09-17T02:24:52.276096+0000","last_clean":"2024-09-17T02:24:52.276096+0000","last_became_active":"2024-09-17T02:24:30.691331+0000","last_became_peered":"2024-09-17T02:24:30.691331+0000","last_unstale":"2024-09-17T02:24:52.276096+0000","last_undegraded":"2024-09-17T02:24:52.276096+0000","last_fullsized":"2024-09-17T02:24:52.276096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:39.446085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":164,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278098+0000","last_change":"2024-09-17T02:24:30.694492+0000","last_active":"2024-09-17T02:24:52.278098+0000","last_peered":"2024-09-17T02:24:52.278098+0000","last_clean":"2024-09-17T02:24:52.278098+0000","last_became_active":"2024-09-17T02:24:30.691770+0000","last_became_peered":"2024-09-17T02:24:30.691770+0000","last_unstale":"2024-09-17T02:24:52.278098+0000","last_undegraded":"2024-09-17T02:24:52.278098+0000","last_fullsized":"2024-09-17T02:24:52.278098+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:01.597617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235468+0000","last_change":"2024-09-17T02:24:30.336636+0000","last_active":"2024-09-17T02:24:51.235468+0000","last_peered":"2024-09-17T02:24:51.235468+0000","last_clean":"2024-09-17T02:24:51.235468+0000","last_became_active":"2024-09-17T02:24:30.336110+0000","last_became_peered":"2024-09-17T02:24:30.336110+0000","last_unstale":"2024-09-17T02:24:51.235468+0000","last_undegraded":"2024-09-17T02:24:51.235468+0000","last_fullsized":"2024-09-17T02:24:51.235468+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:44.699884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604333+0000","last_change":"2024-09-17T02:24:30.700777+0000","last_active":"2024-09-17T02:24:51.604333+0000","last_peered":"2024-09-17T02:24:51.604333+0000","last_clean":"2024-09-17T02:24:51.604333+0000","last_became_active":"2024-09-17T02:24:30.696731+0000","last_became_peered":"2024-09-17T02:24:30.696731+0000","last_unstale":"2024-09-17T02:24:51.604333+0000","last_undegraded":"2024-09-17T02:24:51.604333+0000","last_fullsized":"2024-09-17T02:24:51.604333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:58.629953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234416+0000","last_change":"2024-09-17T02:24:30.326364+0000","last_active":"2024-09-17T02:24:51.234416+0000","last_peered":"2024-09-17T02:24:51.234416+0000","last_clean":"2024-09-17T02:24:51.234416+0000","last_became_active":"2024-09-17T02:24:30.325752+0000","last_became_peered":"2024-09-17T02:24:30.325752+0000","last_unstale":"2024-09-17T02:24:51.234416+0000","last_undegraded":"2024-09-17T02:24:51.234416+0000","last_fullsized":"2024-09-17T02:24:51.234416+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:33.800584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233479+0000","last_change":"2024-09-17T02:24:30.325924+0000","last_active":"2024-09-17T02:24:51.233479+0000","last_peered":"2024-09-17T02:24:51.233479+0000","last_clean":"2024-09-17T02:24:51.233479+0000","last_became_active":"2024-09-17T02:24:30.325688+0000","last_became_peered":"2024-09-17T02:24:30.325688+0000","last_unstale":"2024-09-17T02:24:51.233479+0000","last_undegraded":"2024-09-17T02:24:51.233479+0000","last_fullsized":"2024-09-17T02:24:51.233479+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:25.290483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276040+0000","last_change":"2024-09-17T02:24:34.731288+0000","last_active":"2024-09-17T02:24:52.276040+0000","last_peered":"2024-09-17T02:24:52.276040+0000","last_clean":"2024-09-17T02:24:52.276040+0000","last_became_active":"2024-09-17T02:24:34.730386+0000","last_became_peered":"2024-09-17T02:24:34.730386+0000","last_unstale":"2024-09-17T02:24:52.276040+0000","last_undegraded":"2024-09-17T02:24:52.276040+0000","last_fullsized":"2024-09-17T02:24:52.276040+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:45.808940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":103,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606673+0000","last_change":"2024-09-17T02:24:48.583147+0000","last_active":"2024-09-17T02:24:51.606673+0000","last_peered":"2024-09-17T02:24:51.606673+0000","last_clean":"2024-09-17T02:24:51.606673+0000","last_became_active":"2024-09-17T02:24:48.581390+0000","last_became_peered":"2024-09-17T02:24:48.581390+0000","last_unstale":"2024-09-17T02:24:51.606673+0000","last_undegraded":"2024-09-17T02:24:51.606673+0000","last_fullsized":"2024-09-17T02:24:51.606673+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:08.312173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235572+0000","last_change":"2024-09-17T02:24:30.325492+0000","last_active":"2024-09-17T02:24:51.235572+0000","last_peered":"2024-09-17T02:24:51.235572+0000","last_clean":"2024-09-17T02:24:51.235572+0000","last_became_active":"2024-09-17T02:24:30.325175+0000","last_became_peered":"2024-09-17T02:24:30.325175+0000","last_unstale":"2024-09-17T02:24:51.235572+0000","last_undegraded":"2024-09-17T02:24:51.235572+0000","last_fullsized":"2024-09-17T02:24:51.235572+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:04.443085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275866+0000","last_change":"2024-09-17T02:24:30.699551+0000","last_active":"2024-09-17T02:24:52.275866+0000","last_peered":"2024-09-17T02:24:52.275866+0000","last_clean":"2024-09-17T02:24:52.275866+0000","last_became_active":"2024-09-17T02:24:30.697986+0000","last_became_peered":"2024-09-17T02:24:30.697986+0000","last_unstale":"2024-09-17T02:24:52.275866+0000","last_undegraded":"2024-09-17T02:24:52.275866+0000","last_fullsized":"2024-09-17T02:24:52.275866+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:44.939985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278191+0000","last_change":"2024-09-17T02:24:30.697249+0000","last_active":"2024-09-17T02:24:52.278191+0000","last_peered":"2024-09-17T02:24:52.278191+0000","last_clean":"2024-09-17T02:24:52.278191+0000","last_became_active":"2024-09-17T02:24:30.696215+0000","last_became_peered":"2024-09-17T02:24:30.696215+0000","last_unstale":"2024-09-17T02:24:52.278191+0000","last_undegraded":"2024-09-17T02:24:52.278191+0000","last_fullsized":"2024-09-17T02:24:52.278191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:07.507822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276041+0000","last_change":"2024-09-17T02:20:16.577803+0000","last_active":"2024-09-17T02:24:52.276041+0000","last_peered":"2024-09-17T02:24:52.276041+0000","last_clean":"2024-09-17T02:24:52.276041+0000","last_became_active":"2024-09-17T02:20:16.576640+0000","last_became_peered":"2024-09-17T02:20:16.576640+0000","last_unstale":"2024-09-17T02:24:52.276041+0000","last_undegraded":"2024-09-17T02:24:52.276041+0000","last_fullsized":"2024-09-17T02:24:52.276041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:07.190169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606196+0000","last_change":"2024-09-17T02:24:30.706739+0000","last_active":"2024-09-17T02:24:51.606196+0000","last_peered":"2024-09-17T02:24:51.606196+0000","last_clean":"2024-09-17T02:24:51.606196+0000","last_became_active":"2024-09-17T02:24:30.706195+0000","last_became_peered":"2024-09-17T02:24:30.706195+0000","last_unstale":"2024-09-17T02:24:51.606196+0000","last_undegraded":"2024-09-17T02:24:51.606196+0000","last_fullsized":"2024-09-17T02:24:51.606196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:38.782264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275411+0000","last_change":"2024-09-17T02:24:34.733762+0000","last_active":"2024-09-17T02:24:52.275411+0000","last_peered":"2024-09-17T02:24:52.275411+0000","last_clean":"2024-09-17T02:24:52.275411+0000","last_became_active":"2024-09-17T02:24:34.731592+0000","last_became_peered":"2024-09-17T02:24:34.731592+0000","last_unstale":"2024-09-17T02:24:52.275411+0000","last_undegraded":"2024-09-17T02:24:52.275411+0000","last_fullsized":"2024-09-17T02:24:52.275411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:41.921908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277777+0000","last_change":"2024-09-17T02:24:30.696267+0000","last_active":"2024-09-17T02:24:52.277777+0000","last_peered":"2024-09-17T02:24:52.277777+0000","last_clean":"2024-09-17T02:24:52.277777+0000","last_became_active":"2024-09-17T02:24:30.694027+0000","last_became_peered":"2024-09-17T02:24:30.694027+0000","last_unstale":"2024-09-17T02:24:52.277777+0000","last_undegraded":"2024-09-17T02:24:52.277777+0000","last_fullsized":"2024-09-17T02:24:52.277777+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:56.160158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276145+0000","last_change":"2024-09-17T02:24:30.697568+0000","last_active":"2024-09-17T02:24:52.276145+0000","last_peered":"2024-09-17T02:24:52.276145+0000","last_clean":"2024-09-17T02:24:52.276145+0000","last_became_active":"2024-09-17T02:24:30.693991+0000","last_became_peered":"2024-09-17T02:24:30.693991+0000","last_unstale":"2024-09-17T02:24:52.276145+0000","last_undegraded":"2024-09-17T02:24:52.276145+0000","last_fullsized":"2024-09-17T02:24:52.276145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:45.636130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606140+0000","last_change":"2024-09-17T02:21:10.505967+0000","last_active":"2024-09-17T02:24:51.606140+0000","last_peered":"2024-09-17T02:24:51.606140+0000","last_clean":"2024-09-17T02:24:51.606140+0000","last_became_active":"2024-09-17T02:21:10.505594+0000","last_became_peered":"2024-09-17T02:21:10.505594+0000","last_unstale":"2024-09-17T02:24:51.606140+0000","last_undegraded":"2024-09-17T02:24:51.606140+0000","last_fullsized":"2024-09-17T02:24:51.606140+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:15.782752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605310+0000","last_change":"2024-09-17T02:24:48.579594+0000","last_active":"2024-09-17T02:24:51.605310+0000","last_peered":"2024-09-17T02:24:51.605310+0000","last_clean":"2024-09-17T02:24:51.605310+0000","last_became_active":"2024-09-17T02:24:48.578539+0000","last_became_peered":"2024-09-17T02:24:48.578539+0000","last_unstale":"2024-09-17T02:24:51.605310+0000","last_undegraded":"2024-09-17T02:24:51.605310+0000","last_fullsized":"2024-09-17T02:24:51.605310+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:11.515508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605322+0000","last_change":"2024-09-17T02:24:48.580567+0000","last_active":"2024-09-17T02:24:51.605322+0000","last_peered":"2024-09-17T02:24:51.605322+0000","last_clean":"2024-09-17T02:24:51.605322+0000","last_became_active":"2024-09-17T02:24:48.579612+0000","last_became_peered":"2024-09-17T02:24:48.579612+0000","last_unstale":"2024-09-17T02:24:51.605322+0000","last_undegraded":"2024-09-17T02:24:51.605322+0000","last_fullsized":"2024-09-17T02:24:51.605322+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:28:53.281135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605697+0000","last_change":"2024-09-17T02:24:30.698237+0000","last_active":"2024-09-17T02:24:51.605697+0000","last_peered":"2024-09-17T02:24:51.605697+0000","last_clean":"2024-09-17T02:24:51.605697+0000","last_became_active":"2024-09-17T02:24:30.697194+0000","last_became_peered":"2024-09-17T02:24:30.697194+0000","last_unstale":"2024-09-17T02:24:51.605697+0000","last_undegraded":"2024-09-17T02:24:51.605697+0000","last_fullsized":"2024-09-17T02:24:51.605697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:36.697224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232314+0000","last_change":"2024-09-17T02:24:34.360811+0000","last_active":"2024-09-17T02:24:51.232314+0000","last_peered":"2024-09-17T02:24:51.232314+0000","last_clean":"2024-09-17T02:24:51.232314+0000","last_became_active":"2024-09-17T02:24:34.359944+0000","last_became_peered":"2024-09-17T02:24:34.359944+0000","last_unstale":"2024-09-17T02:24:51.232314+0000","last_undegraded":"2024-09-17T02:24:51.232314+0000","last_fullsized":"2024-09-17T02:24:51.232314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:07.986774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234185+0000","last_change":"2024-09-17T02:24:30.327080+0000","last_active":"2024-09-17T02:24:51.234185+0000","last_peered":"2024-09-17T02:24:51.234185+0000","last_clean":"2024-09-17T02:24:51.234185+0000","last_became_active":"2024-09-17T02:24:30.326800+0000","last_became_peered":"2024-09-17T02:24:30.326800+0000","last_unstale":"2024-09-17T02:24:51.234185+0000","last_undegraded":"2024-09-17T02:24:51.234185+0000","last_fullsized":"2024-09-17T02:24:51.234185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:06.072812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233254+0000","last_change":"2024-09-17T02:24:30.322448+0000","last_active":"2024-09-17T02:24:51.233254+0000","last_peered":"2024-09-17T02:24:51.233254+0000","last_clean":"2024-09-17T02:24:51.233254+0000","last_became_active":"2024-09-17T02:24:30.322156+0000","last_became_peered":"2024-09-17T02:24:30.322156+0000","last_unstale":"2024-09-17T02:24:51.233254+0000","last_undegraded":"2024-09-17T02:24:51.233254+0000","last_fullsized":"2024-09-17T02:24:51.233254+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:46.435146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":102,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606560+0000","last_change":"2024-09-17T02:24:48.583271+0000","last_active":"2024-09-17T02:24:51.606560+0000","last_peered":"2024-09-17T02:24:51.606560+0000","last_clean":"2024-09-17T02:24:51.606560+0000","last_became_active":"2024-09-17T02:24:48.581355+0000","last_became_peered":"2024-09-17T02:24:48.581355+0000","last_unstale":"2024-09-17T02:24:51.606560+0000","last_undegraded":"2024-09-17T02:24:51.606560+0000","last_fullsized":"2024-09-17T02:24:51.606560+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:01.234040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604953+0000","last_change":"2024-09-17T02:20:16.570456+0000","last_active":"2024-09-17T02:24:51.604953+0000","last_peered":"2024-09-17T02:24:51.604953+0000","last_clean":"2024-09-17T02:24:51.604953+0000","last_became_active":"2024-09-17T02:20:16.568095+0000","last_became_peered":"2024-09-17T02:20:16.568095+0000","last_unstale":"2024-09-17T02:24:51.604953+0000","last_undegraded":"2024-09-17T02:24:51.604953+0000","last_fullsized":"2024-09-17T02:24:51.604953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:58.329169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":157,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278020+0000","last_change":"2024-09-17T02:20:15.560293+0000","last_active":"2024-09-17T02:24:52.278020+0000","last_peered":"2024-09-17T02:24:52.278020+0000","last_clean":"2024-09-17T02:24:52.278020+0000","last_became_active":"2024-09-17T02:20:15.559074+0000","last_became_peered":"2024-09-17T02:20:15.559074+0000","last_unstale":"2024-09-17T02:24:52.278020+0000","last_undegraded":"2024-09-17T02:24:52.278020+0000","last_fullsized":"2024-09-17T02:24:52.278020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:55.639841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233448+0000","last_change":"2024-09-17T02:24:30.319629+0000","last_active":"2024-09-17T02:24:51.233448+0000","last_peered":"2024-09-17T02:24:51.233448+0000","last_clean":"2024-09-17T02:24:51.233448+0000","last_became_active":"2024-09-17T02:24:30.319441+0000","last_became_peered":"2024-09-17T02:24:30.319441+0000","last_unstale":"2024-09-17T02:24:51.233448+0000","last_undegraded":"2024-09-17T02:24:51.233448+0000","last_fullsized":"2024-09-17T02:24:51.233448+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:58.379141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":167,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278026+0000","last_change":"2024-09-17T02:24:30.699964+0000","last_active":"2024-09-17T02:24:52.278026+0000","last_peered":"2024-09-17T02:24:52.278026+0000","last_clean":"2024-09-17T02:24:52.278026+0000","last_became_active":"2024-09-17T02:24:30.699102+0000","last_became_peered":"2024-09-17T02:24:30.699102+0000","last_unstale":"2024-09-17T02:24:52.278026+0000","last_undegraded":"2024-09-17T02:24:52.278026+0000","last_fullsized":"2024-09-17T02:24:52.278026+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:19.193516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5558,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705727,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361248,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":360190,"kb_avail":94010592,"statfs":{"total":96636764160,"available":96266846208,"internally_reserved":0,"allocated":1052672,"data_stored":983227,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":368835013},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":80,"seq":343597383687,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56488,"kb_used_data":1040,"kb_used_omap":6,"kb_used_meta":55417,"kb_avail":94315352,"statfs":{"total":96636764160,"available":96578920448,"internally_reserved":0,"allocated":1064960,"data_stored":983862,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":7153,"internal_metadata":56747023},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738430,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329228,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94042612,"statfs":{"total":96636764160,"available":96299634688,"internally_reserved":0,"allocated":974848,"data_stored":387439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5558,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T02:24:55.975 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T02:24:55.976 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:24:56.333 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:24:56.334 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-17T02:24:56.351 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2024-09-17T02:24:55.473375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":746964,"kb_used_data":3020,"kb_used_omap":10,"kb_used_meta":743861,"kb_avail":282368556,"statfs":{"total":289910292480,"available":289145401344,"internally_reserved":0,"allocated":3092480,"data_stored":2354528,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10343,"internal_metadata":761714585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002742"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605682+0000","last_change":"2024-09-17T02:24:34.733681+0000","last_active":"2024-09-17T02:24:51.605682+0000","last_peered":"2024-09-17T02:24:51.605682+0000","last_clean":"2024-09-17T02:24:51.605682+0000","last_became_active":"2024-09-17T02:24:34.732728+0000","last_became_peered":"2024-09-17T02:24:34.732728+0000","last_unstale":"2024-09-17T02:24:51.605682+0000","last_undegraded":"2024-09-17T02:24:51.605682+0000","last_fullsized":"2024-09-17T02:24:51.605682+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:21.613592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605214+0000","last_change":"2024-09-17T02:24:48.579919+0000","last_active":"2024-09-17T02:24:51.605214+0000","last_peered":"2024-09-17T02:24:51.605214+0000","last_clean":"2024-09-17T02:24:51.605214+0000","last_became_active":"2024-09-17T02:24:48.578274+0000","last_became_peered":"2024-09-17T02:24:48.578274+0000","last_unstale":"2024-09-17T02:24:51.605214+0000","last_undegraded":"2024-09-17T02:24:51.605214+0000","last_fullsized":"2024-09-17T02:24:51.605214+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:50.597846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.236296+0000","last_change":"2024-09-17T02:24:30.339249+0000","last_active":"2024-09-17T02:24:51.236296+0000","last_peered":"2024-09-17T02:24:51.236296+0000","last_clean":"2024-09-17T02:24:51.236296+0000","last_became_active":"2024-09-17T02:24:30.338199+0000","last_became_peered":"2024-09-17T02:24:30.338199+0000","last_unstale":"2024-09-17T02:24:51.236296+0000","last_undegraded":"2024-09-17T02:24:51.236296+0000","last_fullsized":"2024-09-17T02:24:51.236296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:51.734408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":87,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232438+0000","last_change":"2024-09-17T02:24:34.360587+0000","last_active":"2024-09-17T02:24:51.232438+0000","last_peered":"2024-09-17T02:24:51.232438+0000","last_clean":"2024-09-17T02:24:51.232438+0000","last_became_active":"2024-09-17T02:24:34.359912+0000","last_became_peered":"2024-09-17T02:24:34.359912+0000","last_unstale":"2024-09-17T02:24:51.232438+0000","last_undegraded":"2024-09-17T02:24:51.232438+0000","last_fullsized":"2024-09-17T02:24:51.232438+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:35.054937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605500+0000","last_change":"2024-09-17T02:24:48.579715+0000","last_active":"2024-09-17T02:24:51.605500+0000","last_peered":"2024-09-17T02:24:51.605500+0000","last_clean":"2024-09-17T02:24:51.605500+0000","last_became_active":"2024-09-17T02:24:48.578841+0000","last_became_peered":"2024-09-17T02:24:48.578841+0000","last_unstale":"2024-09-17T02:24:51.605500+0000","last_undegraded":"2024-09-17T02:24:51.605500+0000","last_fullsized":"2024-09-17T02:24:51.605500+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:23.197781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233991+0000","last_change":"2024-09-17T02:24:30.322619+0000","last_active":"2024-09-17T02:24:51.233991+0000","last_peered":"2024-09-17T02:24:51.233991+0000","last_clean":"2024-09-17T02:24:51.233991+0000","last_became_active":"2024-09-17T02:24:30.322191+0000","last_became_peered":"2024-09-17T02:24:30.322191+0000","last_unstale":"2024-09-17T02:24:51.233991+0000","last_undegraded":"2024-09-17T02:24:51.233991+0000","last_fullsized":"2024-09-17T02:24:51.233991+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:26.120304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233779+0000","last_change":"2024-09-17T02:24:30.330077+0000","last_active":"2024-09-17T02:24:51.233779+0000","last_peered":"2024-09-17T02:24:51.233779+0000","last_clean":"2024-09-17T02:24:51.233779+0000","last_became_active":"2024-09-17T02:24:30.329814+0000","last_became_peered":"2024-09-17T02:24:30.329814+0000","last_unstale":"2024-09-17T02:24:51.233779+0000","last_undegraded":"2024-09-17T02:24:51.233779+0000","last_fullsized":"2024-09-17T02:24:51.233779+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:09.933024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233077+0000","last_change":"2024-09-17T02:24:30.319625+0000","last_active":"2024-09-17T02:24:51.233077+0000","last_peered":"2024-09-17T02:24:51.233077+0000","last_clean":"2024-09-17T02:24:51.233077+0000","last_became_active":"2024-09-17T02:24:30.319316+0000","last_became_peered":"2024-09-17T02:24:30.319316+0000","last_unstale":"2024-09-17T02:24:51.233077+0000","last_undegraded":"2024-09-17T02:24:51.233077+0000","last_fullsized":"2024-09-17T02:24:51.233077+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:30.753462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277651+0000","last_change":"2024-09-17T02:20:16.584665+0000","last_active":"2024-09-17T02:24:52.277651+0000","last_peered":"2024-09-17T02:24:52.277651+0000","last_clean":"2024-09-17T02:24:52.277651+0000","last_became_active":"2024-09-17T02:20:16.580797+0000","last_became_peered":"2024-09-17T02:20:16.580797+0000","last_unstale":"2024-09-17T02:24:52.277651+0000","last_undegraded":"2024-09-17T02:24:52.277651+0000","last_fullsized":"2024-09-17T02:24:52.277651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:47.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605486+0000","last_change":"2024-09-17T02:24:34.733394+0000","last_active":"2024-09-17T02:24:51.605486+0000","last_peered":"2024-09-17T02:24:51.605486+0000","last_clean":"2024-09-17T02:24:51.605486+0000","last_became_active":"2024-09-17T02:24:34.732480+0000","last_became_peered":"2024-09-17T02:24:34.732480+0000","last_unstale":"2024-09-17T02:24:51.605486+0000","last_undegraded":"2024-09-17T02:24:51.605486+0000","last_fullsized":"2024-09-17T02:24:51.605486+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:37.005990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235423+0000","last_change":"2024-09-17T02:24:30.329180+0000","last_active":"2024-09-17T02:24:51.235423+0000","last_peered":"2024-09-17T02:24:51.235423+0000","last_clean":"2024-09-17T02:24:51.235423+0000","last_became_active":"2024-09-17T02:24:30.328962+0000","last_became_peered":"2024-09-17T02:24:30.328962+0000","last_unstale":"2024-09-17T02:24:51.235423+0000","last_undegraded":"2024-09-17T02:24:51.235423+0000","last_fullsized":"2024-09-17T02:24:51.235423+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:21.425064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605228+0000","last_change":"2024-09-17T02:24:48.583870+0000","last_active":"2024-09-17T02:24:51.605228+0000","last_peered":"2024-09-17T02:24:51.605228+0000","last_clean":"2024-09-17T02:24:51.605228+0000","last_became_active":"2024-09-17T02:24:48.581418+0000","last_became_peered":"2024-09-17T02:24:48.581418+0000","last_unstale":"2024-09-17T02:24:51.605228+0000","last_undegraded":"2024-09-17T02:24:51.605228+0000","last_fullsized":"2024-09-17T02:24:51.605228+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:52:52.425417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604958+0000","last_change":"2024-09-17T02:24:48.583016+0000","last_active":"2024-09-17T02:24:51.604958+0000","last_peered":"2024-09-17T02:24:51.604958+0000","last_clean":"2024-09-17T02:24:51.604958+0000","last_became_active":"2024-09-17T02:24:48.579221+0000","last_became_peered":"2024-09-17T02:24:48.579221+0000","last_unstale":"2024-09-17T02:24:51.604958+0000","last_undegraded":"2024-09-17T02:24:51.604958+0000","last_fullsized":"2024-09-17T02:24:51.604958+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:46.150529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233659+0000","last_change":"2024-09-17T02:24:30.337132+0000","last_active":"2024-09-17T02:24:51.233659+0000","last_peered":"2024-09-17T02:24:51.233659+0000","last_clean":"2024-09-17T02:24:51.233659+0000","last_became_active":"2024-09-17T02:24:30.335871+0000","last_became_peered":"2024-09-17T02:24:30.335871+0000","last_unstale":"2024-09-17T02:24:51.233659+0000","last_undegraded":"2024-09-17T02:24:51.233659+0000","last_fullsized":"2024-09-17T02:24:51.233659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:21.006777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233508+0000","last_change":"2024-09-17T02:24:30.335635+0000","last_active":"2024-09-17T02:24:51.233508+0000","last_peered":"2024-09-17T02:24:51.233508+0000","last_clean":"2024-09-17T02:24:51.233508+0000","last_became_active":"2024-09-17T02:24:30.335086+0000","last_became_peered":"2024-09-17T02:24:30.335086+0000","last_unstale":"2024-09-17T02:24:51.233508+0000","last_undegraded":"2024-09-17T02:24:51.233508+0000","last_fullsized":"2024-09-17T02:24:51.233508+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:01.913411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233514+0000","last_change":"2024-09-17T02:24:30.325322+0000","last_active":"2024-09-17T02:24:51.233514+0000","last_peered":"2024-09-17T02:24:51.233514+0000","last_clean":"2024-09-17T02:24:51.233514+0000","last_became_active":"2024-09-17T02:24:30.325002+0000","last_became_peered":"2024-09-17T02:24:30.325002+0000","last_unstale":"2024-09-17T02:24:51.233514+0000","last_undegraded":"2024-09-17T02:24:51.233514+0000","last_fullsized":"2024-09-17T02:24:51.233514+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:16.238014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278363+0000","last_change":"2024-09-17T02:20:16.563482+0000","last_active":"2024-09-17T02:24:52.278363+0000","last_peered":"2024-09-17T02:24:52.278363+0000","last_clean":"2024-09-17T02:24:52.278363+0000","last_became_active":"2024-09-17T02:20:16.562735+0000","last_became_peered":"2024-09-17T02:20:16.562735+0000","last_unstale":"2024-09-17T02:24:52.278363+0000","last_undegraded":"2024-09-17T02:24:52.278363+0000","last_fullsized":"2024-09-17T02:24:52.278363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:10.315951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605780+0000","last_change":"2024-09-17T02:24:48.583997+0000","last_active":"2024-09-17T02:24:51.605780+0000","last_peered":"2024-09-17T02:24:51.605780+0000","last_clean":"2024-09-17T02:24:51.605780+0000","last_became_active":"2024-09-17T02:24:48.580510+0000","last_became_peered":"2024-09-17T02:24:48.580510+0000","last_unstale":"2024-09-17T02:24:51.605780+0000","last_undegraded":"2024-09-17T02:24:51.605780+0000","last_fullsized":"2024-09-17T02:24:51.605780+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:21:58.370793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277220+0000","last_change":"2024-09-17T02:20:16.586950+0000","last_active":"2024-09-17T02:24:52.277220+0000","last_peered":"2024-09-17T02:24:52.277220+0000","last_clean":"2024-09-17T02:24:52.277220+0000","last_became_active":"2024-09-17T02:20:16.586281+0000","last_became_peered":"2024-09-17T02:20:16.586281+0000","last_unstale":"2024-09-17T02:24:52.277220+0000","last_undegraded":"2024-09-17T02:24:52.277220+0000","last_fullsized":"2024-09-17T02:24:52.277220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:22.801598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234871+0000","last_change":"2024-09-17T02:24:30.330312+0000","last_active":"2024-09-17T02:24:51.234871+0000","last_peered":"2024-09-17T02:24:51.234871+0000","last_clean":"2024-09-17T02:24:51.234871+0000","last_became_active":"2024-09-17T02:24:30.329980+0000","last_became_peered":"2024-09-17T02:24:30.329980+0000","last_unstale":"2024-09-17T02:24:51.234871+0000","last_undegraded":"2024-09-17T02:24:51.234871+0000","last_fullsized":"2024-09-17T02:24:51.234871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:53.422140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232041+0000","last_change":"2024-09-17T02:24:34.361003+0000","last_active":"2024-09-17T02:24:51.232041+0000","last_peered":"2024-09-17T02:24:51.232041+0000","last_clean":"2024-09-17T02:24:51.232041+0000","last_became_active":"2024-09-17T02:24:34.360259+0000","last_became_peered":"2024-09-17T02:24:34.360259+0000","last_unstale":"2024-09-17T02:24:51.232041+0000","last_undegraded":"2024-09-17T02:24:51.232041+0000","last_fullsized":"2024-09-17T02:24:51.232041+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:01.642214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605644+0000","last_change":"2024-09-17T02:24:30.702500+0000","last_active":"2024-09-17T02:24:51.605644+0000","last_peered":"2024-09-17T02:24:51.605644+0000","last_clean":"2024-09-17T02:24:51.605644+0000","last_became_active":"2024-09-17T02:24:30.700674+0000","last_became_peered":"2024-09-17T02:24:30.700674+0000","last_unstale":"2024-09-17T02:24:51.605644+0000","last_undegraded":"2024-09-17T02:24:51.605644+0000","last_fullsized":"2024-09-17T02:24:51.605644+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:47.554275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275778+0000","last_change":"2024-09-17T02:24:30.700096+0000","last_active":"2024-09-17T02:24:52.275778+0000","last_peered":"2024-09-17T02:24:52.275778+0000","last_clean":"2024-09-17T02:24:52.275778+0000","last_became_active":"2024-09-17T02:24:30.698022+0000","last_became_peered":"2024-09-17T02:24:30.698022+0000","last_unstale":"2024-09-17T02:24:52.275778+0000","last_undegraded":"2024-09-17T02:24:52.275778+0000","last_fullsized":"2024-09-17T02:24:52.275778+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:53.002528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604171+0000","last_change":"2024-09-17T02:24:48.577229+0000","last_active":"2024-09-17T02:24:51.604171+0000","last_peered":"2024-09-17T02:24:51.604171+0000","last_clean":"2024-09-17T02:24:51.604171+0000","last_became_active":"2024-09-17T02:24:48.576615+0000","last_became_peered":"2024-09-17T02:24:48.576615+0000","last_unstale":"2024-09-17T02:24:51.604171+0000","last_undegraded":"2024-09-17T02:24:51.604171+0000","last_fullsized":"2024-09-17T02:24:51.604171+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:23.827785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606021+0000","last_change":"2024-09-17T02:24:30.704846+0000","last_active":"2024-09-17T02:24:51.606021+0000","last_peered":"2024-09-17T02:24:51.606021+0000","last_clean":"2024-09-17T02:24:51.606021+0000","last_became_active":"2024-09-17T02:24:30.703377+0000","last_became_peered":"2024-09-17T02:24:30.703377+0000","last_unstale":"2024-09-17T02:24:51.606021+0000","last_undegraded":"2024-09-17T02:24:51.606021+0000","last_fullsized":"2024-09-17T02:24:51.606021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:21.642002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277663+0000","last_change":"2024-09-17T02:24:30.696851+0000","last_active":"2024-09-17T02:24:52.277663+0000","last_peered":"2024-09-17T02:24:52.277663+0000","last_clean":"2024-09-17T02:24:52.277663+0000","last_became_active":"2024-09-17T02:24:30.694853+0000","last_became_peered":"2024-09-17T02:24:30.694853+0000","last_unstale":"2024-09-17T02:24:52.277663+0000","last_undegraded":"2024-09-17T02:24:52.277663+0000","last_fullsized":"2024-09-17T02:24:52.277663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:39.353246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235268+0000","last_change":"2024-09-17T02:24:30.339430+0000","last_active":"2024-09-17T02:24:51.235268+0000","last_peered":"2024-09-17T02:24:51.235268+0000","last_clean":"2024-09-17T02:24:51.235268+0000","last_became_active":"2024-09-17T02:24:30.338488+0000","last_became_peered":"2024-09-17T02:24:30.338488+0000","last_unstale":"2024-09-17T02:24:51.235268+0000","last_undegraded":"2024-09-17T02:24:51.235268+0000","last_fullsized":"2024-09-17T02:24:51.235268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:26.554742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606211+0000","last_change":"2024-09-17T02:24:48.584148+0000","last_active":"2024-09-17T02:24:51.606211+0000","last_peered":"2024-09-17T02:24:51.606211+0000","last_clean":"2024-09-17T02:24:51.606211+0000","last_became_active":"2024-09-17T02:24:48.582959+0000","last_became_peered":"2024-09-17T02:24:48.582959+0000","last_unstale":"2024-09-17T02:24:51.606211+0000","last_undegraded":"2024-09-17T02:24:51.606211+0000","last_fullsized":"2024-09-17T02:24:51.606211+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:24.455294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276722+0000","last_change":"2024-09-17T02:24:34.734388+0000","last_active":"2024-09-17T02:24:52.276722+0000","last_peered":"2024-09-17T02:24:52.276722+0000","last_clean":"2024-09-17T02:24:52.276722+0000","last_became_active":"2024-09-17T02:24:34.733451+0000","last_became_peered":"2024-09-17T02:24:34.733451+0000","last_unstale":"2024-09-17T02:24:52.276722+0000","last_undegraded":"2024-09-17T02:24:52.276722+0000","last_fullsized":"2024-09-17T02:24:52.276722+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:22.488478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605030+0000","last_change":"2024-09-17T02:24:30.700893+0000","last_active":"2024-09-17T02:24:51.605030+0000","last_peered":"2024-09-17T02:24:51.605030+0000","last_clean":"2024-09-17T02:24:51.605030+0000","last_became_active":"2024-09-17T02:24:30.699410+0000","last_became_peered":"2024-09-17T02:24:30.699410+0000","last_unstale":"2024-09-17T02:24:51.605030+0000","last_undegraded":"2024-09-17T02:24:51.605030+0000","last_fullsized":"2024-09-17T02:24:51.605030+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:29.137738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275593+0000","last_change":"2024-09-17T02:24:34.727144+0000","last_active":"2024-09-17T02:24:52.275593+0000","last_peered":"2024-09-17T02:24:52.275593+0000","last_clean":"2024-09-17T02:24:52.275593+0000","last_became_active":"2024-09-17T02:24:34.725109+0000","last_became_peered":"2024-09-17T02:24:34.725109+0000","last_unstale":"2024-09-17T02:24:52.275593+0000","last_undegraded":"2024-09-17T02:24:52.275593+0000","last_fullsized":"2024-09-17T02:24:52.275593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:59.629654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.231948+0000","last_change":"2024-09-17T02:24:34.357265+0000","last_active":"2024-09-17T02:24:51.231948+0000","last_peered":"2024-09-17T02:24:51.231948+0000","last_clean":"2024-09-17T02:24:51.231948+0000","last_became_active":"2024-09-17T02:24:34.356639+0000","last_became_peered":"2024-09-17T02:24:34.356639+0000","last_unstale":"2024-09-17T02:24:51.231948+0000","last_undegraded":"2024-09-17T02:24:51.231948+0000","last_fullsized":"2024-09-17T02:24:51.231948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:30.236713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605501+0000","last_change":"2024-09-17T02:24:48.583278+0000","last_active":"2024-09-17T02:24:51.605501+0000","last_peered":"2024-09-17T02:24:51.605501+0000","last_clean":"2024-09-17T02:24:51.605501+0000","last_became_active":"2024-09-17T02:24:48.581121+0000","last_became_peered":"2024-09-17T02:24:48.581121+0000","last_unstale":"2024-09-17T02:24:51.605501+0000","last_undegraded":"2024-09-17T02:24:51.605501+0000","last_fullsized":"2024-09-17T02:24:51.605501+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:39.957807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234860+0000","last_change":"2024-09-17T02:24:30.329201+0000","last_active":"2024-09-17T02:24:51.234860+0000","last_peered":"2024-09-17T02:24:51.234860+0000","last_clean":"2024-09-17T02:24:51.234860+0000","last_became_active":"2024-09-17T02:24:30.328907+0000","last_became_peered":"2024-09-17T02:24:30.328907+0000","last_unstale":"2024-09-17T02:24:51.234860+0000","last_undegraded":"2024-09-17T02:24:51.234860+0000","last_fullsized":"2024-09-17T02:24:51.234860+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:31.463647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606423+0000","last_change":"2024-09-17T02:24:34.732466+0000","last_active":"2024-09-17T02:24:51.606423+0000","last_peered":"2024-09-17T02:24:51.606423+0000","last_clean":"2024-09-17T02:24:51.606423+0000","last_became_active":"2024-09-17T02:24:34.731598+0000","last_became_peered":"2024-09-17T02:24:34.731598+0000","last_unstale":"2024-09-17T02:24:51.606423+0000","last_undegraded":"2024-09-17T02:24:51.606423+0000","last_fullsized":"2024-09-17T02:24:51.606423+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:33.350084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275176+0000","last_change":"2024-09-17T02:24:34.730124+0000","last_active":"2024-09-17T02:24:52.275176+0000","last_peered":"2024-09-17T02:24:52.275176+0000","last_clean":"2024-09-17T02:24:52.275176+0000","last_became_active":"2024-09-17T02:24:34.727345+0000","last_became_peered":"2024-09-17T02:24:34.727345+0000","last_unstale":"2024-09-17T02:24:52.275176+0000","last_undegraded":"2024-09-17T02:24:52.275176+0000","last_fullsized":"2024-09-17T02:24:52.275176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:20.739364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275221+0000","last_change":"2024-09-17T02:24:34.731057+0000","last_active":"2024-09-17T02:24:52.275221+0000","last_peered":"2024-09-17T02:24:52.275221+0000","last_clean":"2024-09-17T02:24:52.275221+0000","last_became_active":"2024-09-17T02:24:34.730285+0000","last_became_peered":"2024-09-17T02:24:34.730285+0000","last_unstale":"2024-09-17T02:24:52.275221+0000","last_undegraded":"2024-09-17T02:24:52.275221+0000","last_fullsized":"2024-09-17T02:24:52.275221+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:28.085866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604612+0000","last_change":"2024-09-17T02:24:30.702653+0000","last_active":"2024-09-17T02:24:51.604612+0000","last_peered":"2024-09-17T02:24:51.604612+0000","last_clean":"2024-09-17T02:24:51.604612+0000","last_became_active":"2024-09-17T02:24:30.701047+0000","last_became_peered":"2024-09-17T02:24:30.701047+0000","last_unstale":"2024-09-17T02:24:51.604612+0000","last_undegraded":"2024-09-17T02:24:51.604612+0000","last_fullsized":"2024-09-17T02:24:51.604612+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:26.569439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277891+0000","last_change":"2024-09-17T02:24:30.698841+0000","last_active":"2024-09-17T02:24:52.277891+0000","last_peered":"2024-09-17T02:24:52.277891+0000","last_clean":"2024-09-17T02:24:52.277891+0000","last_became_active":"2024-09-17T02:24:30.697606+0000","last_became_peered":"2024-09-17T02:24:30.697606+0000","last_unstale":"2024-09-17T02:24:52.277891+0000","last_undegraded":"2024-09-17T02:24:52.277891+0000","last_fullsized":"2024-09-17T02:24:52.277891+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:20.038861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232570+0000","last_change":"2024-09-17T02:24:30.336630+0000","last_active":"2024-09-17T02:24:51.232570+0000","last_peered":"2024-09-17T02:24:51.232570+0000","last_clean":"2024-09-17T02:24:51.232570+0000","last_became_active":"2024-09-17T02:24:30.336326+0000","last_became_peered":"2024-09-17T02:24:30.336326+0000","last_unstale":"2024-09-17T02:24:51.232570+0000","last_undegraded":"2024-09-17T02:24:51.232570+0000","last_fullsized":"2024-09-17T02:24:51.232570+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:30.072709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.236283+0000","last_change":"2024-09-17T02:24:30.336771+0000","last_active":"2024-09-17T02:24:51.236283+0000","last_peered":"2024-09-17T02:24:51.236283+0000","last_clean":"2024-09-17T02:24:51.236283+0000","last_became_active":"2024-09-17T02:24:30.336494+0000","last_became_peered":"2024-09-17T02:24:30.336494+0000","last_unstale":"2024-09-17T02:24:51.236283+0000","last_undegraded":"2024-09-17T02:24:51.236283+0000","last_fullsized":"2024-09-17T02:24:51.236283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:17.852502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604224+0000","last_change":"2024-09-17T02:24:48.583894+0000","last_active":"2024-09-17T02:24:51.604224+0000","last_peered":"2024-09-17T02:24:51.604224+0000","last_clean":"2024-09-17T02:24:51.604224+0000","last_became_active":"2024-09-17T02:24:48.580644+0000","last_became_peered":"2024-09-17T02:24:48.580644+0000","last_unstale":"2024-09-17T02:24:51.604224+0000","last_undegraded":"2024-09-17T02:24:51.604224+0000","last_fullsized":"2024-09-17T02:24:51.604224+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:15.855050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":165,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606071+0000","last_change":"2024-09-17T02:24:30.697584+0000","last_active":"2024-09-17T02:24:51.606071+0000","last_peered":"2024-09-17T02:24:51.606071+0000","last_clean":"2024-09-17T02:24:51.606071+0000","last_became_active":"2024-09-17T02:24:30.695140+0000","last_became_peered":"2024-09-17T02:24:30.695140+0000","last_unstale":"2024-09-17T02:24:51.606071+0000","last_undegraded":"2024-09-17T02:24:51.606071+0000","last_fullsized":"2024-09-17T02:24:51.606071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:07.386102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604282+0000","last_change":"2024-09-17T02:24:48.577640+0000","last_active":"2024-09-17T02:24:51.604282+0000","last_peered":"2024-09-17T02:24:51.604282+0000","last_clean":"2024-09-17T02:24:51.604282+0000","last_became_active":"2024-09-17T02:24:48.576802+0000","last_became_peered":"2024-09-17T02:24:48.576802+0000","last_unstale":"2024-09-17T02:24:51.604282+0000","last_undegraded":"2024-09-17T02:24:51.604282+0000","last_fullsized":"2024-09-17T02:24:51.604282+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:11.030891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234885+0000","last_change":"2024-09-17T02:24:30.338939+0000","last_active":"2024-09-17T02:24:51.234885+0000","last_peered":"2024-09-17T02:24:51.234885+0000","last_clean":"2024-09-17T02:24:51.234885+0000","last_became_active":"2024-09-17T02:24:30.337650+0000","last_became_peered":"2024-09-17T02:24:30.337650+0000","last_unstale":"2024-09-17T02:24:51.234885+0000","last_undegraded":"2024-09-17T02:24:51.234885+0000","last_fullsized":"2024-09-17T02:24:51.234885+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:00.927950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234077+0000","last_change":"2024-09-17T02:24:30.322785+0000","last_active":"2024-09-17T02:24:51.234077+0000","last_peered":"2024-09-17T02:24:51.234077+0000","last_clean":"2024-09-17T02:24:51.234077+0000","last_became_active":"2024-09-17T02:24:30.322509+0000","last_became_peered":"2024-09-17T02:24:30.322509+0000","last_unstale":"2024-09-17T02:24:51.234077+0000","last_undegraded":"2024-09-17T02:24:51.234077+0000","last_fullsized":"2024-09-17T02:24:51.234077+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:06.381434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234190+0000","last_change":"2024-09-17T02:24:30.329944+0000","last_active":"2024-09-17T02:24:51.234190+0000","last_peered":"2024-09-17T02:24:51.234190+0000","last_clean":"2024-09-17T02:24:51.234190+0000","last_became_active":"2024-09-17T02:24:30.329642+0000","last_became_peered":"2024-09-17T02:24:30.329642+0000","last_unstale":"2024-09-17T02:24:51.234190+0000","last_undegraded":"2024-09-17T02:24:51.234190+0000","last_fullsized":"2024-09-17T02:24:51.234190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:39.135831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277004+0000","last_change":"2024-09-17T02:24:30.699239+0000","last_active":"2024-09-17T02:24:52.277004+0000","last_peered":"2024-09-17T02:24:52.277004+0000","last_clean":"2024-09-17T02:24:52.277004+0000","last_became_active":"2024-09-17T02:24:30.697800+0000","last_became_peered":"2024-09-17T02:24:30.697800+0000","last_unstale":"2024-09-17T02:24:52.277004+0000","last_undegraded":"2024-09-17T02:24:52.277004+0000","last_fullsized":"2024-09-17T02:24:52.277004+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:42.056577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":165,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277720+0000","last_change":"2024-09-17T02:24:30.697486+0000","last_active":"2024-09-17T02:24:52.277720+0000","last_peered":"2024-09-17T02:24:52.277720+0000","last_clean":"2024-09-17T02:24:52.277720+0000","last_became_active":"2024-09-17T02:24:30.696079+0000","last_became_peered":"2024-09-17T02:24:30.696079+0000","last_unstale":"2024-09-17T02:24:52.277720+0000","last_undegraded":"2024-09-17T02:24:52.277720+0000","last_fullsized":"2024-09-17T02:24:52.277720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:07.222731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234635+0000","last_change":"2024-09-17T02:24:30.330194+0000","last_active":"2024-09-17T02:24:51.234635+0000","last_peered":"2024-09-17T02:24:51.234635+0000","last_clean":"2024-09-17T02:24:51.234635+0000","last_became_active":"2024-09-17T02:24:30.329676+0000","last_became_peered":"2024-09-17T02:24:30.329676+0000","last_unstale":"2024-09-17T02:24:51.234635+0000","last_undegraded":"2024-09-17T02:24:51.234635+0000","last_fullsized":"2024-09-17T02:24:51.234635+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:50:41.161871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232120+0000","last_change":"2024-09-17T02:24:34.360950+0000","last_active":"2024-09-17T02:24:51.232120+0000","last_peered":"2024-09-17T02:24:51.232120+0000","last_clean":"2024-09-17T02:24:51.232120+0000","last_became_active":"2024-09-17T02:24:34.360020+0000","last_became_peered":"2024-09-17T02:24:34.360020+0000","last_unstale":"2024-09-17T02:24:51.232120+0000","last_undegraded":"2024-09-17T02:24:51.232120+0000","last_fullsized":"2024-09-17T02:24:51.232120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:57.653961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234818+0000","last_change":"2024-09-17T02:24:30.338531+0000","last_active":"2024-09-17T02:24:51.234818+0000","last_peered":"2024-09-17T02:24:51.234818+0000","last_clean":"2024-09-17T02:24:51.234818+0000","last_became_active":"2024-09-17T02:24:30.336902+0000","last_became_peered":"2024-09-17T02:24:30.336902+0000","last_unstale":"2024-09-17T02:24:51.234818+0000","last_undegraded":"2024-09-17T02:24:51.234818+0000","last_fullsized":"2024-09-17T02:24:51.234818+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:49.660896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":101,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604622+0000","last_change":"2024-09-17T02:24:48.579411+0000","last_active":"2024-09-17T02:24:51.604622+0000","last_peered":"2024-09-17T02:24:51.604622+0000","last_clean":"2024-09-17T02:24:51.604622+0000","last_became_active":"2024-09-17T02:24:48.578461+0000","last_became_peered":"2024-09-17T02:24:48.578461+0000","last_unstale":"2024-09-17T02:24:51.604622+0000","last_undegraded":"2024-09-17T02:24:51.604622+0000","last_fullsized":"2024-09-17T02:24:51.604622+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:09:43.054480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.236338+0000","last_change":"2024-09-17T02:24:30.326828+0000","last_active":"2024-09-17T02:24:51.236338+0000","last_peered":"2024-09-17T02:24:51.236338+0000","last_clean":"2024-09-17T02:24:51.236338+0000","last_became_active":"2024-09-17T02:24:30.326227+0000","last_became_peered":"2024-09-17T02:24:30.326227+0000","last_unstale":"2024-09-17T02:24:51.236338+0000","last_undegraded":"2024-09-17T02:24:51.236338+0000","last_fullsized":"2024-09-17T02:24:51.236338+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:53.135460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604435+0000","last_change":"2024-09-17T02:24:48.580927+0000","last_active":"2024-09-17T02:24:51.604435+0000","last_peered":"2024-09-17T02:24:51.604435+0000","last_clean":"2024-09-17T02:24:51.604435+0000","last_became_active":"2024-09-17T02:24:48.578678+0000","last_became_peered":"2024-09-17T02:24:48.578678+0000","last_unstale":"2024-09-17T02:24:51.604435+0000","last_undegraded":"2024-09-17T02:24:51.604435+0000","last_fullsized":"2024-09-17T02:24:51.604435+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:46.131656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277923+0000","last_change":"2024-09-17T02:20:16.583084+0000","last_active":"2024-09-17T02:24:52.277923+0000","last_peered":"2024-09-17T02:24:52.277923+0000","last_clean":"2024-09-17T02:24:52.277923+0000","last_became_active":"2024-09-17T02:20:16.582326+0000","last_became_peered":"2024-09-17T02:20:16.582326+0000","last_unstale":"2024-09-17T02:24:52.277923+0000","last_undegraded":"2024-09-17T02:24:52.277923+0000","last_fullsized":"2024-09-17T02:24:52.277923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:05.049317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":236,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232539+0000","last_change":"2024-09-17T02:24:30.338760+0000","last_active":"2024-09-17T02:24:51.232539+0000","last_peered":"2024-09-17T02:24:51.232539+0000","last_clean":"2024-09-17T02:24:51.232539+0000","last_became_active":"2024-09-17T02:24:30.338214+0000","last_became_peered":"2024-09-17T02:24:30.338214+0000","last_unstale":"2024-09-17T02:24:51.232539+0000","last_undegraded":"2024-09-17T02:24:51.232539+0000","last_fullsized":"2024-09-17T02:24:51.232539+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_clean_scrub_stamp":"2024-09-17T02:20:03.432050+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:27:29.124652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":60,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233731+0000","last_change":"2024-09-17T02:24:30.325326+0000","last_active":"2024-09-17T02:24:51.233731+0000","last_peered":"2024-09-17T02:24:51.233731+0000","last_clean":"2024-09-17T02:24:51.233731+0000","last_became_active":"2024-09-17T02:24:30.324910+0000","last_became_peered":"2024-09-17T02:24:30.324910+0000","last_unstale":"2024-09-17T02:24:51.233731+0000","last_undegraded":"2024-09-17T02:24:51.233731+0000","last_fullsized":"2024-09-17T02:24:51.233731+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:52:27.682190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276836+0000","last_change":"2024-09-17T02:20:15.560646+0000","last_active":"2024-09-17T02:24:52.276836+0000","last_peered":"2024-09-17T02:24:52.276836+0000","last_clean":"2024-09-17T02:24:52.276836+0000","last_became_active":"2024-09-17T02:20:15.559104+0000","last_became_peered":"2024-09-17T02:20:15.559104+0000","last_unstale":"2024-09-17T02:24:52.276836+0000","last_undegraded":"2024-09-17T02:24:52.276836+0000","last_fullsized":"2024-09-17T02:24:52.276836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:44.299986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235150+0000","last_change":"2024-09-17T02:24:30.339100+0000","last_active":"2024-09-17T02:24:51.235150+0000","last_peered":"2024-09-17T02:24:51.235150+0000","last_clean":"2024-09-17T02:24:51.235150+0000","last_became_active":"2024-09-17T02:24:30.337415+0000","last_became_peered":"2024-09-17T02:24:30.337415+0000","last_unstale":"2024-09-17T02:24:51.235150+0000","last_undegraded":"2024-09-17T02:24:51.235150+0000","last_fullsized":"2024-09-17T02:24:51.235150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:27.682975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233159+0000","last_change":"2024-09-17T02:24:30.338621+0000","last_active":"2024-09-17T02:24:51.233159+0000","last_peered":"2024-09-17T02:24:51.233159+0000","last_clean":"2024-09-17T02:24:51.233159+0000","last_became_active":"2024-09-17T02:24:30.338024+0000","last_became_peered":"2024-09-17T02:24:30.338024+0000","last_unstale":"2024-09-17T02:24:51.233159+0000","last_undegraded":"2024-09-17T02:24:51.233159+0000","last_fullsized":"2024-09-17T02:24:51.233159+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:49.985865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276198+0000","last_change":"2024-09-17T02:24:30.694491+0000","last_active":"2024-09-17T02:24:52.276198+0000","last_peered":"2024-09-17T02:24:52.276198+0000","last_clean":"2024-09-17T02:24:52.276198+0000","last_became_active":"2024-09-17T02:24:30.693653+0000","last_became_peered":"2024-09-17T02:24:30.693653+0000","last_unstale":"2024-09-17T02:24:52.276198+0000","last_undegraded":"2024-09-17T02:24:52.276198+0000","last_fullsized":"2024-09-17T02:24:52.276198+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:12.740030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605591+0000","last_change":"2024-09-17T02:20:16.571568+0000","last_active":"2024-09-17T02:24:51.605591+0000","last_peered":"2024-09-17T02:24:51.605591+0000","last_clean":"2024-09-17T02:24:51.605591+0000","last_became_active":"2024-09-17T02:20:16.570622+0000","last_became_peered":"2024-09-17T02:20:16.570622+0000","last_unstale":"2024-09-17T02:24:51.605591+0000","last_undegraded":"2024-09-17T02:24:51.605591+0000","last_fullsized":"2024-09-17T02:24:51.605591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:57.083446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276496+0000","last_change":"2024-09-17T02:20:12.511823+0000","last_active":"2024-09-17T02:24:52.276496+0000","last_peered":"2024-09-17T02:24:52.276496+0000","last_clean":"2024-09-17T02:24:52.276496+0000","last_became_active":"2024-09-17T02:20:10.497164+0000","last_became_peered":"2024-09-17T02:20:10.497164+0000","last_unstale":"2024-09-17T02:24:52.276496+0000","last_undegraded":"2024-09-17T02:24:52.276496+0000","last_fullsized":"2024-09-17T02:24:52.276496+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:21.242753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081052700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":101,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604499+0000","last_change":"2024-09-17T02:24:48.585305+0000","last_active":"2024-09-17T02:24:51.604499+0000","last_peered":"2024-09-17T02:24:51.604499+0000","last_clean":"2024-09-17T02:24:51.604499+0000","last_became_active":"2024-09-17T02:24:48.582729+0000","last_became_peered":"2024-09-17T02:24:48.582729+0000","last_unstale":"2024-09-17T02:24:51.604499+0000","last_undegraded":"2024-09-17T02:24:51.604499+0000","last_fullsized":"2024-09-17T02:24:51.604499+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:58.012479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277630+0000","last_change":"2024-09-17T02:24:34.730636+0000","last_active":"2024-09-17T02:24:52.277630+0000","last_peered":"2024-09-17T02:24:52.277630+0000","last_clean":"2024-09-17T02:24:52.277630+0000","last_became_active":"2024-09-17T02:24:34.729890+0000","last_became_peered":"2024-09-17T02:24:34.729890+0000","last_unstale":"2024-09-17T02:24:52.277630+0000","last_undegraded":"2024-09-17T02:24:52.277630+0000","last_fullsized":"2024-09-17T02:24:52.277630+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:07.679985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232887+0000","last_change":"2024-09-17T02:24:30.333204+0000","last_active":"2024-09-17T02:24:51.232887+0000","last_peered":"2024-09-17T02:24:51.232887+0000","last_clean":"2024-09-17T02:24:51.232887+0000","last_became_active":"2024-09-17T02:24:30.333005+0000","last_became_peered":"2024-09-17T02:24:30.333005+0000","last_unstale":"2024-09-17T02:24:51.232887+0000","last_undegraded":"2024-09-17T02:24:51.232887+0000","last_fullsized":"2024-09-17T02:24:51.232887+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:17.620422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078085399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234838+0000","last_change":"2024-09-17T02:24:30.329442+0000","last_active":"2024-09-17T02:24:51.234838+0000","last_peered":"2024-09-17T02:24:51.234838+0000","last_clean":"2024-09-17T02:24:51.234838+0000","last_became_active":"2024-09-17T02:24:30.329213+0000","last_became_peered":"2024-09-17T02:24:30.329213+0000","last_unstale":"2024-09-17T02:24:51.234838+0000","last_undegraded":"2024-09-17T02:24:51.234838+0000","last_fullsized":"2024-09-17T02:24:51.234838+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:25.034116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277315+0000","last_change":"2024-09-17T02:20:16.580184+0000","last_active":"2024-09-17T02:24:52.277315+0000","last_peered":"2024-09-17T02:24:52.277315+0000","last_clean":"2024-09-17T02:24:52.277315+0000","last_became_active":"2024-09-17T02:20:16.578343+0000","last_became_peered":"2024-09-17T02:20:16.578343+0000","last_unstale":"2024-09-17T02:24:52.277315+0000","last_undegraded":"2024-09-17T02:24:52.277315+0000","last_fullsized":"2024-09-17T02:24:52.277315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:42.123535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232100+0000","last_change":"2024-09-17T02:24:34.354157+0000","last_active":"2024-09-17T02:24:51.232100+0000","last_peered":"2024-09-17T02:24:51.232100+0000","last_clean":"2024-09-17T02:24:51.232100+0000","last_became_active":"2024-09-17T02:24:34.353619+0000","last_became_peered":"2024-09-17T02:24:34.353619+0000","last_unstale":"2024-09-17T02:24:51.232100+0000","last_undegraded":"2024-09-17T02:24:51.232100+0000","last_fullsized":"2024-09-17T02:24:51.232100+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:53:03.444794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277559+0000","last_change":"2024-09-17T02:20:12.511838+0000","last_active":"2024-09-17T02:24:52.277559+0000","last_peered":"2024-09-17T02:24:52.277559+0000","last_clean":"2024-09-17T02:24:52.277559+0000","last_became_active":"2024-09-17T02:20:10.497049+0000","last_became_peered":"2024-09-17T02:20:10.497049+0000","last_unstale":"2024-09-17T02:24:52.277559+0000","last_undegraded":"2024-09-17T02:24:52.277559+0000","last_fullsized":"2024-09-17T02:24:52.277559+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:54.446484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079701100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604586+0000","last_change":"2024-09-17T02:24:30.698392+0000","last_active":"2024-09-17T02:24:51.604586+0000","last_peered":"2024-09-17T02:24:51.604586+0000","last_clean":"2024-09-17T02:24:51.604586+0000","last_became_active":"2024-09-17T02:24:30.694944+0000","last_became_peered":"2024-09-17T02:24:30.694944+0000","last_unstale":"2024-09-17T02:24:51.604586+0000","last_undegraded":"2024-09-17T02:24:51.604586+0000","last_fullsized":"2024-09-17T02:24:51.604586+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:06.407404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277487+0000","last_change":"2024-09-17T02:20:15.559252+0000","last_active":"2024-09-17T02:24:52.277487+0000","last_peered":"2024-09-17T02:24:52.277487+0000","last_clean":"2024-09-17T02:24:52.277487+0000","last_became_active":"2024-09-17T02:20:15.557667+0000","last_became_peered":"2024-09-17T02:20:15.557667+0000","last_unstale":"2024-09-17T02:24:52.277487+0000","last_undegraded":"2024-09-17T02:24:52.277487+0000","last_fullsized":"2024-09-17T02:24:52.277487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:01.292626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606815+0000","last_change":"2024-09-17T02:20:12.661034+0000","last_active":"2024-09-17T02:24:51.606815+0000","last_peered":"2024-09-17T02:24:51.606815+0000","last_clean":"2024-09-17T02:24:51.606815+0000","last_became_active":"2024-09-17T02:20:10.497829+0000","last_became_peered":"2024-09-17T02:20:10.497829+0000","last_unstale":"2024-09-17T02:24:51.606815+0000","last_undegraded":"2024-09-17T02:24:51.606815+0000","last_fullsized":"2024-09-17T02:24:51.606815+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:46:27.427685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096944700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605391+0000","last_change":"2024-09-17T02:24:48.581467+0000","last_active":"2024-09-17T02:24:51.605391+0000","last_peered":"2024-09-17T02:24:51.605391+0000","last_clean":"2024-09-17T02:24:51.605391+0000","last_became_active":"2024-09-17T02:24:48.580388+0000","last_became_peered":"2024-09-17T02:24:48.580388+0000","last_unstale":"2024-09-17T02:24:51.605391+0000","last_undegraded":"2024-09-17T02:24:51.605391+0000","last_fullsized":"2024-09-17T02:24:51.605391+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:21:11.358704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278338+0000","last_change":"2024-09-17T02:20:15.558961+0000","last_active":"2024-09-17T02:24:52.278338+0000","last_peered":"2024-09-17T02:24:52.278338+0000","last_clean":"2024-09-17T02:24:52.278338+0000","last_became_active":"2024-09-17T02:20:15.558299+0000","last_became_peered":"2024-09-17T02:20:15.558299+0000","last_unstale":"2024-09-17T02:24:52.278338+0000","last_undegraded":"2024-09-17T02:24:52.278338+0000","last_fullsized":"2024-09-17T02:24:52.278338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:39.709524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278295+0000","last_change":"2024-09-17T02:20:12.512481+0000","last_active":"2024-09-17T02:24:52.278295+0000","last_peered":"2024-09-17T02:24:52.278295+0000","last_clean":"2024-09-17T02:24:52.278295+0000","last_became_active":"2024-09-17T02:20:10.497021+0000","last_became_peered":"2024-09-17T02:20:10.497021+0000","last_unstale":"2024-09-17T02:24:52.278295+0000","last_undegraded":"2024-09-17T02:24:52.278295+0000","last_fullsized":"2024-09-17T02:24:52.278295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:41.167283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001400079,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276096+0000","last_change":"2024-09-17T02:24:30.693811+0000","last_active":"2024-09-17T02:24:52.276096+0000","last_peered":"2024-09-17T02:24:52.276096+0000","last_clean":"2024-09-17T02:24:52.276096+0000","last_became_active":"2024-09-17T02:24:30.691331+0000","last_became_peered":"2024-09-17T02:24:30.691331+0000","last_unstale":"2024-09-17T02:24:52.276096+0000","last_undegraded":"2024-09-17T02:24:52.276096+0000","last_fullsized":"2024-09-17T02:24:52.276096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:39.446085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":164,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278098+0000","last_change":"2024-09-17T02:24:30.694492+0000","last_active":"2024-09-17T02:24:52.278098+0000","last_peered":"2024-09-17T02:24:52.278098+0000","last_clean":"2024-09-17T02:24:52.278098+0000","last_became_active":"2024-09-17T02:24:30.691770+0000","last_became_peered":"2024-09-17T02:24:30.691770+0000","last_unstale":"2024-09-17T02:24:52.278098+0000","last_undegraded":"2024-09-17T02:24:52.278098+0000","last_fullsized":"2024-09-17T02:24:52.278098+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:01.597617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235468+0000","last_change":"2024-09-17T02:24:30.336636+0000","last_active":"2024-09-17T02:24:51.235468+0000","last_peered":"2024-09-17T02:24:51.235468+0000","last_clean":"2024-09-17T02:24:51.235468+0000","last_became_active":"2024-09-17T02:24:30.336110+0000","last_became_peered":"2024-09-17T02:24:30.336110+0000","last_unstale":"2024-09-17T02:24:51.235468+0000","last_undegraded":"2024-09-17T02:24:51.235468+0000","last_fullsized":"2024-09-17T02:24:51.235468+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:44.699884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604333+0000","last_change":"2024-09-17T02:24:30.700777+0000","last_active":"2024-09-17T02:24:51.604333+0000","last_peered":"2024-09-17T02:24:51.604333+0000","last_clean":"2024-09-17T02:24:51.604333+0000","last_became_active":"2024-09-17T02:24:30.696731+0000","last_became_peered":"2024-09-17T02:24:30.696731+0000","last_unstale":"2024-09-17T02:24:51.604333+0000","last_undegraded":"2024-09-17T02:24:51.604333+0000","last_fullsized":"2024-09-17T02:24:51.604333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:58.629953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234416+0000","last_change":"2024-09-17T02:24:30.326364+0000","last_active":"2024-09-17T02:24:51.234416+0000","last_peered":"2024-09-17T02:24:51.234416+0000","last_clean":"2024-09-17T02:24:51.234416+0000","last_became_active":"2024-09-17T02:24:30.325752+0000","last_became_peered":"2024-09-17T02:24:30.325752+0000","last_unstale":"2024-09-17T02:24:51.234416+0000","last_undegraded":"2024-09-17T02:24:51.234416+0000","last_fullsized":"2024-09-17T02:24:51.234416+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:33.800584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233479+0000","last_change":"2024-09-17T02:24:30.325924+0000","last_active":"2024-09-17T02:24:51.233479+0000","last_peered":"2024-09-17T02:24:51.233479+0000","last_clean":"2024-09-17T02:24:51.233479+0000","last_became_active":"2024-09-17T02:24:30.325688+0000","last_became_peered":"2024-09-17T02:24:30.325688+0000","last_unstale":"2024-09-17T02:24:51.233479+0000","last_undegraded":"2024-09-17T02:24:51.233479+0000","last_fullsized":"2024-09-17T02:24:51.233479+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:25.290483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276040+0000","last_change":"2024-09-17T02:24:34.731288+0000","last_active":"2024-09-17T02:24:52.276040+0000","last_peered":"2024-09-17T02:24:52.276040+0000","last_clean":"2024-09-17T02:24:52.276040+0000","last_became_active":"2024-09-17T02:24:34.730386+0000","last_became_peered":"2024-09-17T02:24:34.730386+0000","last_unstale":"2024-09-17T02:24:52.276040+0000","last_undegraded":"2024-09-17T02:24:52.276040+0000","last_fullsized":"2024-09-17T02:24:52.276040+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:45.808940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":103,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606673+0000","last_change":"2024-09-17T02:24:48.583147+0000","last_active":"2024-09-17T02:24:51.606673+0000","last_peered":"2024-09-17T02:24:51.606673+0000","last_clean":"2024-09-17T02:24:51.606673+0000","last_became_active":"2024-09-17T02:24:48.581390+0000","last_became_peered":"2024-09-17T02:24:48.581390+0000","last_unstale":"2024-09-17T02:24:51.606673+0000","last_undegraded":"2024-09-17T02:24:51.606673+0000","last_fullsized":"2024-09-17T02:24:51.606673+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:08.312173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235572+0000","last_change":"2024-09-17T02:24:30.325492+0000","last_active":"2024-09-17T02:24:51.235572+0000","last_peered":"2024-09-17T02:24:51.235572+0000","last_clean":"2024-09-17T02:24:51.235572+0000","last_became_active":"2024-09-17T02:24:30.325175+0000","last_became_peered":"2024-09-17T02:24:30.325175+0000","last_unstale":"2024-09-17T02:24:51.235572+0000","last_undegraded":"2024-09-17T02:24:51.235572+0000","last_fullsized":"2024-09-17T02:24:51.235572+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:04.443085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275866+0000","last_change":"2024-09-17T02:24:30.699551+0000","last_active":"2024-09-17T02:24:52.275866+0000","last_peered":"2024-09-17T02:24:52.275866+0000","last_clean":"2024-09-17T02:24:52.275866+0000","last_became_active":"2024-09-17T02:24:30.697986+0000","last_became_peered":"2024-09-17T02:24:30.697986+0000","last_unstale":"2024-09-17T02:24:52.275866+0000","last_undegraded":"2024-09-17T02:24:52.275866+0000","last_fullsized":"2024-09-17T02:24:52.275866+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:44.939985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278191+0000","last_change":"2024-09-17T02:24:30.697249+0000","last_active":"2024-09-17T02:24:52.278191+0000","last_peered":"2024-09-17T02:24:52.278191+0000","last_clean":"2024-09-17T02:24:52.278191+0000","last_became_active":"2024-09-17T02:24:30.696215+0000","last_became_peered":"2024-09-17T02:24:30.696215+0000","last_unstale":"2024-09-17T02:24:52.278191+0000","last_undegraded":"2024-09-17T02:24:52.278191+0000","last_fullsized":"2024-09-17T02:24:52.278191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:07.507822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276041+0000","last_change":"2024-09-17T02:20:16.577803+0000","last_active":"2024-09-17T02:24:52.276041+0000","last_peered":"2024-09-17T02:24:52.276041+0000","last_clean":"2024-09-17T02:24:52.276041+0000","last_became_active":"2024-09-17T02:20:16.576640+0000","last_became_peered":"2024-09-17T02:20:16.576640+0000","last_unstale":"2024-09-17T02:24:52.276041+0000","last_undegraded":"2024-09-17T02:24:52.276041+0000","last_fullsized":"2024-09-17T02:24:52.276041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:07.190169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606196+0000","last_change":"2024-09-17T02:24:30.706739+0000","last_active":"2024-09-17T02:24:51.606196+0000","last_peered":"2024-09-17T02:24:51.606196+0000","last_clean":"2024-09-17T02:24:51.606196+0000","last_became_active":"2024-09-17T02:24:30.706195+0000","last_became_peered":"2024-09-17T02:24:30.706195+0000","last_unstale":"2024-09-17T02:24:51.606196+0000","last_undegraded":"2024-09-17T02:24:51.606196+0000","last_fullsized":"2024-09-17T02:24:51.606196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:38.782264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275411+0000","last_change":"2024-09-17T02:24:34.733762+0000","last_active":"2024-09-17T02:24:52.275411+0000","last_peered":"2024-09-17T02:24:52.275411+0000","last_clean":"2024-09-17T02:24:52.275411+0000","last_became_active":"2024-09-17T02:24:34.731592+0000","last_became_peered":"2024-09-17T02:24:34.731592+0000","last_unstale":"2024-09-17T02:24:52.275411+0000","last_undegraded":"2024-09-17T02:24:52.275411+0000","last_fullsized":"2024-09-17T02:24:52.275411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:41.921908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277777+0000","last_change":"2024-09-17T02:24:30.696267+0000","last_active":"2024-09-17T02:24:52.277777+0000","last_peered":"2024-09-17T02:24:52.277777+0000","last_clean":"2024-09-17T02:24:52.277777+0000","last_became_active":"2024-09-17T02:24:30.694027+0000","last_became_peered":"2024-09-17T02:24:30.694027+0000","last_unstale":"2024-09-17T02:24:52.277777+0000","last_undegraded":"2024-09-17T02:24:52.277777+0000","last_fullsized":"2024-09-17T02:24:52.277777+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:56.160158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276145+0000","last_change":"2024-09-17T02:24:30.697568+0000","last_active":"2024-09-17T02:24:52.276145+0000","last_peered":"2024-09-17T02:24:52.276145+0000","last_clean":"2024-09-17T02:24:52.276145+0000","last_became_active":"2024-09-17T02:24:30.693991+0000","last_became_peered":"2024-09-17T02:24:30.693991+0000","last_unstale":"2024-09-17T02:24:52.276145+0000","last_undegraded":"2024-09-17T02:24:52.276145+0000","last_fullsized":"2024-09-17T02:24:52.276145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:45.636130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606140+0000","last_change":"2024-09-17T02:21:10.505967+0000","last_active":"2024-09-17T02:24:51.606140+0000","last_peered":"2024-09-17T02:24:51.606140+0000","last_clean":"2024-09-17T02:24:51.606140+0000","last_became_active":"2024-09-17T02:21:10.505594+0000","last_became_peered":"2024-09-17T02:21:10.505594+0000","last_unstale":"2024-09-17T02:24:51.606140+0000","last_undegraded":"2024-09-17T02:24:51.606140+0000","last_fullsized":"2024-09-17T02:24:51.606140+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:15.782752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605310+0000","last_change":"2024-09-17T02:24:48.579594+0000","last_active":"2024-09-17T02:24:51.605310+0000","last_peered":"2024-09-17T02:24:51.605310+0000","last_clean":"2024-09-17T02:24:51.605310+0000","last_became_active":"2024-09-17T02:24:48.578539+0000","last_became_peered":"2024-09-17T02:24:48.578539+0000","last_unstale":"2024-09-17T02:24:51.605310+0000","last_undegraded":"2024-09-17T02:24:51.605310+0000","last_fullsized":"2024-09-17T02:24:51.605310+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:11.515508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605322+0000","last_change":"2024-09-17T02:24:48.580567+0000","last_active":"2024-09-17T02:24:51.605322+0000","last_peered":"2024-09-17T02:24:51.605322+0000","last_clean":"2024-09-17T02:24:51.605322+0000","last_became_active":"2024-09-17T02:24:48.579612+0000","last_became_peered":"2024-09-17T02:24:48.579612+0000","last_unstale":"2024-09-17T02:24:51.605322+0000","last_undegraded":"2024-09-17T02:24:51.605322+0000","last_fullsized":"2024-09-17T02:24:51.605322+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:28:53.281135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605697+0000","last_change":"2024-09-17T02:24:30.698237+0000","last_active":"2024-09-17T02:24:51.605697+0000","last_peered":"2024-09-17T02:24:51.605697+0000","last_clean":"2024-09-17T02:24:51.605697+0000","last_became_active":"2024-09-17T02:24:30.697194+0000","last_became_peered":"2024-09-17T02:24:30.697194+0000","last_unstale":"2024-09-17T02:24:51.605697+0000","last_undegraded":"2024-09-17T02:24:51.605697+0000","last_fullsized":"2024-09-17T02:24:51.605697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:36.697224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232314+0000","last_change":"2024-09-17T02:24:34.360811+0000","last_active":"2024-09-17T02:24:51.232314+0000","last_peered":"2024-09-17T02:24:51.232314+0000","last_clean":"2024-09-17T02:24:51.232314+0000","last_became_active":"2024-09-17T02:24:34.359944+0000","last_became_peered":"2024-09-17T02:24:34.359944+0000","last_unstale":"2024-09-17T02:24:51.232314+0000","last_undegraded":"2024-09-17T02:24:51.232314+0000","last_fullsized":"2024-09-17T02:24:51.232314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:07.986774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234185+0000","last_change":"2024-09-17T02:24:30.327080+0000","last_active":"2024-09-17T02:24:51.234185+0000","last_peered":"2024-09-17T02:24:51.234185+0000","last_clean":"2024-09-17T02:24:51.234185+0000","last_became_active":"2024-09-17T02:24:30.326800+0000","last_became_peered":"2024-09-17T02:24:30.326800+0000","last_unstale":"2024-09-17T02:24:51.234185+0000","last_undegraded":"2024-09-17T02:24:51.234185+0000","last_fullsized":"2024-09-17T02:24:51.234185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:06.072812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233254+0000","last_change":"2024-09-17T02:24:30.322448+0000","last_active":"2024-09-17T02:24:51.233254+0000","last_peered":"2024-09-17T02:24:51.233254+0000","last_clean":"2024-09-17T02:24:51.233254+0000","last_became_active":"2024-09-17T02:24:30.322156+0000","last_became_peered":"2024-09-17T02:24:30.322156+0000","last_unstale":"2024-09-17T02:24:51.233254+0000","last_undegraded":"2024-09-17T02:24:51.233254+0000","last_fullsized":"2024-09-17T02:24:51.233254+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:46.435146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":102,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606560+0000","last_change":"2024-09-17T02:24:48.583271+0000","last_active":"2024-09-17T02:24:51.606560+0000","last_peered":"2024-09-17T02:24:51.606560+0000","last_clean":"2024-09-17T02:24:51.606560+0000","last_became_active":"2024-09-17T02:24:48.581355+0000","last_became_peered":"2024-09-17T02:24:48.581355+0000","last_unstale":"2024-09-17T02:24:51.606560+0000","last_undegraded":"2024-09-17T02:24:51.606560+0000","last_fullsized":"2024-09-17T02:24:51.606560+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:01.234040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604953+0000","last_change":"2024-09-17T02:20:16.570456+0000","last_active":"2024-09-17T02:24:51.604953+0000","last_peered":"2024-09-17T02:24:51.604953+0000","last_clean":"2024-09-17T02:24:51.604953+0000","last_became_active":"2024-09-17T02:20:16.568095+0000","last_became_peered":"2024-09-17T02:20:16.568095+0000","last_unstale":"2024-09-17T02:24:51.604953+0000","last_undegraded":"2024-09-17T02:24:51.604953+0000","last_fullsized":"2024-09-17T02:24:51.604953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:58.329169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":157,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278020+0000","last_change":"2024-09-17T02:20:15.560293+0000","last_active":"2024-09-17T02:24:52.278020+0000","last_peered":"2024-09-17T02:24:52.278020+0000","last_clean":"2024-09-17T02:24:52.278020+0000","last_became_active":"2024-09-17T02:20:15.559074+0000","last_became_peered":"2024-09-17T02:20:15.559074+0000","last_unstale":"2024-09-17T02:24:52.278020+0000","last_undegraded":"2024-09-17T02:24:52.278020+0000","last_fullsized":"2024-09-17T02:24:52.278020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:55.639841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233448+0000","last_change":"2024-09-17T02:24:30.319629+0000","last_active":"2024-09-17T02:24:51.233448+0000","last_peered":"2024-09-17T02:24:51.233448+0000","last_clean":"2024-09-17T02:24:51.233448+0000","last_became_active":"2024-09-17T02:24:30.319441+0000","last_became_peered":"2024-09-17T02:24:30.319441+0000","last_unstale":"2024-09-17T02:24:51.233448+0000","last_undegraded":"2024-09-17T02:24:51.233448+0000","last_fullsized":"2024-09-17T02:24:51.233448+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:58.379141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":167,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278026+0000","last_change":"2024-09-17T02:24:30.699964+0000","last_active":"2024-09-17T02:24:52.278026+0000","last_peered":"2024-09-17T02:24:52.278026+0000","last_clean":"2024-09-17T02:24:52.278026+0000","last_became_active":"2024-09-17T02:24:30.699102+0000","last_became_peered":"2024-09-17T02:24:30.699102+0000","last_unstale":"2024-09-17T02:24:52.278026+0000","last_undegraded":"2024-09-17T02:24:52.278026+0000","last_fullsized":"2024-09-17T02:24:52.278026+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:19.193516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5558,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705727,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361248,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":360190,"kb_avail":94010592,"statfs":{"total":96636764160,"available":96266846208,"internally_reserved":0,"allocated":1052672,"data_stored":983227,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":368835013},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":80,"seq":343597383687,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56488,"kb_used_data":1040,"kb_used_omap":6,"kb_used_meta":55417,"kb_avail":94315352,"statfs":{"total":96636764160,"available":96578920448,"internally_reserved":0,"allocated":1064960,"data_stored":983862,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":7153,"internal_metadata":56747023},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738430,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329228,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94042612,"statfs":{"total":96636764160,"available":96299634688,"internally_reserved":0,"allocated":974848,"data_stored":387439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5558,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T02:24:56.355 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:24:56.702 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:24:56.702 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":90,"fsid":"37cd4495-4915-41f4-bad2-2394cbe235f3","created":"2024-09-17T02:19:52.516342+0000","modified":"2024-09-17T02:24:51.590364+0000","last_up_change":"2024-09-17T02:24:29.673066+0000","last_in_change":"2024-09-17T02:19:54.329423+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:20:03.416336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T02:20:08.718296+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:20:13.566396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-17T02:20:14.902662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fae746a8-754d-4e52-9819-004ebb0d6886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6801","nonce":2347677104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6803","nonce":2347677104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6807","nonce":2347677104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6805","nonce":2347677104}]},"public_addr":"172.21.15.32:6801/2347677104","cluster_addr":"172.21.15.32:6803/2347677104","heartbeat_back_addr":"172.21.15.32:6807/2347677104","heartbeat_front_addr":"172.21.15.32:6805/2347677104","state":["exists","up"]},{"osd":1,"uuid":"c9397688-80ca-4c21-b80d-1740194c389d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6801","nonce":1905904204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6803","nonce":1905904204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6807","nonce":1905904204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6805","nonce":1905904204}]},"public_addr":"172.21.15.153:6801/1905904204","cluster_addr":"172.21.15.153:6803/1905904204","heartbeat_back_addr":"172.21.15.153:6807/1905904204","heartbeat_front_addr":"172.21.15.153:6805/1905904204","state":["exists","up"]},{"osd":2,"uuid":"6d8c01a8-b657-4abc-a624-2b35ef0512ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":50,"up_from":80,"up_thru":83,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2045876213},{"type":"v1","addr":"172.21.15.164:6801","nonce":2045876213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2045876213},{"type":"v1","addr":"172.21.15.164:6803","nonce":2045876213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2045876213},{"type":"v1","addr":"172.21.15.164:6807","nonce":2045876213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2045876213},{"type":"v1","addr":"172.21.15.164:6805","nonce":2045876213}]},"public_addr":"172.21.15.164:6801/2045876213","cluster_addr":"172.21.15.164:6803/2045876213","heartbeat_back_addr":"172.21.15.164:6807/2045876213","heartbeat_front_addr":"172.21.15.164:6805/2045876213","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.476482+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.250903+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.326430+0000","dead_epoch":50}],"pg_upmap":[{"pgid":"4.1d","osds":[0,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:24:57.720 INFO:tasks.ceph:Scrubbing osd.0 2024-09-17T02:24:57.721 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-17T02:24:57.885 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-17T02:24:57.885 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T02:24:57.885 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-17T02:24:57.902 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-17T02:24:58.190 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 0 to deep-scrub 2024-09-17T02:24:58.208 INFO:tasks.ceph:Scrubbing osd.1 2024-09-17T02:24:58.209 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-17T02:24:58.361 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-17T02:24:58.361 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T02:24:58.361 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-17T02:24:58.377 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-17T02:24:58.663 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 1 to deep-scrub 2024-09-17T02:24:58.680 INFO:tasks.ceph:Scrubbing osd.2 2024-09-17T02:24:58.681 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-17T02:24:58.835 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-17T02:24:58.835 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-17T02:24:58.835 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-17T02:24:58.851 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-17T02:24:59.142 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 2 to deep-scrub 2024-09-17T02:24:59.162 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:24:59.486 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:24:59.487 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-17T02:24:59.503 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2024-09-17T02:24:57.474181+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":746964,"kb_used_data":3020,"kb_used_omap":10,"kb_used_meta":743861,"kb_avail":282368556,"statfs":{"total":289910292480,"available":289145401344,"internally_reserved":0,"allocated":3092480,"data_stored":2354528,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10343,"internal_metadata":761714585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.901402"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605682+0000","last_change":"2024-09-17T02:24:34.733681+0000","last_active":"2024-09-17T02:24:51.605682+0000","last_peered":"2024-09-17T02:24:51.605682+0000","last_clean":"2024-09-17T02:24:51.605682+0000","last_became_active":"2024-09-17T02:24:34.732728+0000","last_became_peered":"2024-09-17T02:24:34.732728+0000","last_unstale":"2024-09-17T02:24:51.605682+0000","last_undegraded":"2024-09-17T02:24:51.605682+0000","last_fullsized":"2024-09-17T02:24:51.605682+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:21.613592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605214+0000","last_change":"2024-09-17T02:24:48.579919+0000","last_active":"2024-09-17T02:24:51.605214+0000","last_peered":"2024-09-17T02:24:51.605214+0000","last_clean":"2024-09-17T02:24:51.605214+0000","last_became_active":"2024-09-17T02:24:48.578274+0000","last_became_peered":"2024-09-17T02:24:48.578274+0000","last_unstale":"2024-09-17T02:24:51.605214+0000","last_undegraded":"2024-09-17T02:24:51.605214+0000","last_fullsized":"2024-09-17T02:24:51.605214+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:50.597846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.236296+0000","last_change":"2024-09-17T02:24:30.339249+0000","last_active":"2024-09-17T02:24:51.236296+0000","last_peered":"2024-09-17T02:24:51.236296+0000","last_clean":"2024-09-17T02:24:51.236296+0000","last_became_active":"2024-09-17T02:24:30.338199+0000","last_became_peered":"2024-09-17T02:24:30.338199+0000","last_unstale":"2024-09-17T02:24:51.236296+0000","last_undegraded":"2024-09-17T02:24:51.236296+0000","last_fullsized":"2024-09-17T02:24:51.236296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:51.734408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":87,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232438+0000","last_change":"2024-09-17T02:24:34.360587+0000","last_active":"2024-09-17T02:24:51.232438+0000","last_peered":"2024-09-17T02:24:51.232438+0000","last_clean":"2024-09-17T02:24:51.232438+0000","last_became_active":"2024-09-17T02:24:34.359912+0000","last_became_peered":"2024-09-17T02:24:34.359912+0000","last_unstale":"2024-09-17T02:24:51.232438+0000","last_undegraded":"2024-09-17T02:24:51.232438+0000","last_fullsized":"2024-09-17T02:24:51.232438+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:35.054937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605500+0000","last_change":"2024-09-17T02:24:48.579715+0000","last_active":"2024-09-17T02:24:51.605500+0000","last_peered":"2024-09-17T02:24:51.605500+0000","last_clean":"2024-09-17T02:24:51.605500+0000","last_became_active":"2024-09-17T02:24:48.578841+0000","last_became_peered":"2024-09-17T02:24:48.578841+0000","last_unstale":"2024-09-17T02:24:51.605500+0000","last_undegraded":"2024-09-17T02:24:51.605500+0000","last_fullsized":"2024-09-17T02:24:51.605500+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:23.197781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233991+0000","last_change":"2024-09-17T02:24:30.322619+0000","last_active":"2024-09-17T02:24:51.233991+0000","last_peered":"2024-09-17T02:24:51.233991+0000","last_clean":"2024-09-17T02:24:51.233991+0000","last_became_active":"2024-09-17T02:24:30.322191+0000","last_became_peered":"2024-09-17T02:24:30.322191+0000","last_unstale":"2024-09-17T02:24:51.233991+0000","last_undegraded":"2024-09-17T02:24:51.233991+0000","last_fullsized":"2024-09-17T02:24:51.233991+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:26.120304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233779+0000","last_change":"2024-09-17T02:24:30.330077+0000","last_active":"2024-09-17T02:24:51.233779+0000","last_peered":"2024-09-17T02:24:51.233779+0000","last_clean":"2024-09-17T02:24:51.233779+0000","last_became_active":"2024-09-17T02:24:30.329814+0000","last_became_peered":"2024-09-17T02:24:30.329814+0000","last_unstale":"2024-09-17T02:24:51.233779+0000","last_undegraded":"2024-09-17T02:24:51.233779+0000","last_fullsized":"2024-09-17T02:24:51.233779+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:09.933024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233077+0000","last_change":"2024-09-17T02:24:30.319625+0000","last_active":"2024-09-17T02:24:51.233077+0000","last_peered":"2024-09-17T02:24:51.233077+0000","last_clean":"2024-09-17T02:24:51.233077+0000","last_became_active":"2024-09-17T02:24:30.319316+0000","last_became_peered":"2024-09-17T02:24:30.319316+0000","last_unstale":"2024-09-17T02:24:51.233077+0000","last_undegraded":"2024-09-17T02:24:51.233077+0000","last_fullsized":"2024-09-17T02:24:51.233077+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:30.753462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277651+0000","last_change":"2024-09-17T02:20:16.584665+0000","last_active":"2024-09-17T02:24:52.277651+0000","last_peered":"2024-09-17T02:24:52.277651+0000","last_clean":"2024-09-17T02:24:52.277651+0000","last_became_active":"2024-09-17T02:20:16.580797+0000","last_became_peered":"2024-09-17T02:20:16.580797+0000","last_unstale":"2024-09-17T02:24:52.277651+0000","last_undegraded":"2024-09-17T02:24:52.277651+0000","last_fullsized":"2024-09-17T02:24:52.277651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:47.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605486+0000","last_change":"2024-09-17T02:24:34.733394+0000","last_active":"2024-09-17T02:24:51.605486+0000","last_peered":"2024-09-17T02:24:51.605486+0000","last_clean":"2024-09-17T02:24:51.605486+0000","last_became_active":"2024-09-17T02:24:34.732480+0000","last_became_peered":"2024-09-17T02:24:34.732480+0000","last_unstale":"2024-09-17T02:24:51.605486+0000","last_undegraded":"2024-09-17T02:24:51.605486+0000","last_fullsized":"2024-09-17T02:24:51.605486+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:37.005990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235423+0000","last_change":"2024-09-17T02:24:30.329180+0000","last_active":"2024-09-17T02:24:51.235423+0000","last_peered":"2024-09-17T02:24:51.235423+0000","last_clean":"2024-09-17T02:24:51.235423+0000","last_became_active":"2024-09-17T02:24:30.328962+0000","last_became_peered":"2024-09-17T02:24:30.328962+0000","last_unstale":"2024-09-17T02:24:51.235423+0000","last_undegraded":"2024-09-17T02:24:51.235423+0000","last_fullsized":"2024-09-17T02:24:51.235423+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:21.425064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605228+0000","last_change":"2024-09-17T02:24:48.583870+0000","last_active":"2024-09-17T02:24:51.605228+0000","last_peered":"2024-09-17T02:24:51.605228+0000","last_clean":"2024-09-17T02:24:51.605228+0000","last_became_active":"2024-09-17T02:24:48.581418+0000","last_became_peered":"2024-09-17T02:24:48.581418+0000","last_unstale":"2024-09-17T02:24:51.605228+0000","last_undegraded":"2024-09-17T02:24:51.605228+0000","last_fullsized":"2024-09-17T02:24:51.605228+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:52:52.425417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604958+0000","last_change":"2024-09-17T02:24:48.583016+0000","last_active":"2024-09-17T02:24:51.604958+0000","last_peered":"2024-09-17T02:24:51.604958+0000","last_clean":"2024-09-17T02:24:51.604958+0000","last_became_active":"2024-09-17T02:24:48.579221+0000","last_became_peered":"2024-09-17T02:24:48.579221+0000","last_unstale":"2024-09-17T02:24:51.604958+0000","last_undegraded":"2024-09-17T02:24:51.604958+0000","last_fullsized":"2024-09-17T02:24:51.604958+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:46.150529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233659+0000","last_change":"2024-09-17T02:24:30.337132+0000","last_active":"2024-09-17T02:24:51.233659+0000","last_peered":"2024-09-17T02:24:51.233659+0000","last_clean":"2024-09-17T02:24:51.233659+0000","last_became_active":"2024-09-17T02:24:30.335871+0000","last_became_peered":"2024-09-17T02:24:30.335871+0000","last_unstale":"2024-09-17T02:24:51.233659+0000","last_undegraded":"2024-09-17T02:24:51.233659+0000","last_fullsized":"2024-09-17T02:24:51.233659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:21.006777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233508+0000","last_change":"2024-09-17T02:24:30.335635+0000","last_active":"2024-09-17T02:24:51.233508+0000","last_peered":"2024-09-17T02:24:51.233508+0000","last_clean":"2024-09-17T02:24:51.233508+0000","last_became_active":"2024-09-17T02:24:30.335086+0000","last_became_peered":"2024-09-17T02:24:30.335086+0000","last_unstale":"2024-09-17T02:24:51.233508+0000","last_undegraded":"2024-09-17T02:24:51.233508+0000","last_fullsized":"2024-09-17T02:24:51.233508+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:01.913411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233514+0000","last_change":"2024-09-17T02:24:30.325322+0000","last_active":"2024-09-17T02:24:51.233514+0000","last_peered":"2024-09-17T02:24:51.233514+0000","last_clean":"2024-09-17T02:24:51.233514+0000","last_became_active":"2024-09-17T02:24:30.325002+0000","last_became_peered":"2024-09-17T02:24:30.325002+0000","last_unstale":"2024-09-17T02:24:51.233514+0000","last_undegraded":"2024-09-17T02:24:51.233514+0000","last_fullsized":"2024-09-17T02:24:51.233514+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:16.238014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278363+0000","last_change":"2024-09-17T02:20:16.563482+0000","last_active":"2024-09-17T02:24:52.278363+0000","last_peered":"2024-09-17T02:24:52.278363+0000","last_clean":"2024-09-17T02:24:52.278363+0000","last_became_active":"2024-09-17T02:20:16.562735+0000","last_became_peered":"2024-09-17T02:20:16.562735+0000","last_unstale":"2024-09-17T02:24:52.278363+0000","last_undegraded":"2024-09-17T02:24:52.278363+0000","last_fullsized":"2024-09-17T02:24:52.278363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:10.315951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605780+0000","last_change":"2024-09-17T02:24:48.583997+0000","last_active":"2024-09-17T02:24:51.605780+0000","last_peered":"2024-09-17T02:24:51.605780+0000","last_clean":"2024-09-17T02:24:51.605780+0000","last_became_active":"2024-09-17T02:24:48.580510+0000","last_became_peered":"2024-09-17T02:24:48.580510+0000","last_unstale":"2024-09-17T02:24:51.605780+0000","last_undegraded":"2024-09-17T02:24:51.605780+0000","last_fullsized":"2024-09-17T02:24:51.605780+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:21:58.370793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277220+0000","last_change":"2024-09-17T02:20:16.586950+0000","last_active":"2024-09-17T02:24:52.277220+0000","last_peered":"2024-09-17T02:24:52.277220+0000","last_clean":"2024-09-17T02:24:52.277220+0000","last_became_active":"2024-09-17T02:20:16.586281+0000","last_became_peered":"2024-09-17T02:20:16.586281+0000","last_unstale":"2024-09-17T02:24:52.277220+0000","last_undegraded":"2024-09-17T02:24:52.277220+0000","last_fullsized":"2024-09-17T02:24:52.277220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:22.801598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234871+0000","last_change":"2024-09-17T02:24:30.330312+0000","last_active":"2024-09-17T02:24:51.234871+0000","last_peered":"2024-09-17T02:24:51.234871+0000","last_clean":"2024-09-17T02:24:51.234871+0000","last_became_active":"2024-09-17T02:24:30.329980+0000","last_became_peered":"2024-09-17T02:24:30.329980+0000","last_unstale":"2024-09-17T02:24:51.234871+0000","last_undegraded":"2024-09-17T02:24:51.234871+0000","last_fullsized":"2024-09-17T02:24:51.234871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:53.422140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232041+0000","last_change":"2024-09-17T02:24:34.361003+0000","last_active":"2024-09-17T02:24:51.232041+0000","last_peered":"2024-09-17T02:24:51.232041+0000","last_clean":"2024-09-17T02:24:51.232041+0000","last_became_active":"2024-09-17T02:24:34.360259+0000","last_became_peered":"2024-09-17T02:24:34.360259+0000","last_unstale":"2024-09-17T02:24:51.232041+0000","last_undegraded":"2024-09-17T02:24:51.232041+0000","last_fullsized":"2024-09-17T02:24:51.232041+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:01.642214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605644+0000","last_change":"2024-09-17T02:24:30.702500+0000","last_active":"2024-09-17T02:24:51.605644+0000","last_peered":"2024-09-17T02:24:51.605644+0000","last_clean":"2024-09-17T02:24:51.605644+0000","last_became_active":"2024-09-17T02:24:30.700674+0000","last_became_peered":"2024-09-17T02:24:30.700674+0000","last_unstale":"2024-09-17T02:24:51.605644+0000","last_undegraded":"2024-09-17T02:24:51.605644+0000","last_fullsized":"2024-09-17T02:24:51.605644+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:47.554275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275778+0000","last_change":"2024-09-17T02:24:30.700096+0000","last_active":"2024-09-17T02:24:52.275778+0000","last_peered":"2024-09-17T02:24:52.275778+0000","last_clean":"2024-09-17T02:24:52.275778+0000","last_became_active":"2024-09-17T02:24:30.698022+0000","last_became_peered":"2024-09-17T02:24:30.698022+0000","last_unstale":"2024-09-17T02:24:52.275778+0000","last_undegraded":"2024-09-17T02:24:52.275778+0000","last_fullsized":"2024-09-17T02:24:52.275778+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:53.002528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604171+0000","last_change":"2024-09-17T02:24:48.577229+0000","last_active":"2024-09-17T02:24:51.604171+0000","last_peered":"2024-09-17T02:24:51.604171+0000","last_clean":"2024-09-17T02:24:51.604171+0000","last_became_active":"2024-09-17T02:24:48.576615+0000","last_became_peered":"2024-09-17T02:24:48.576615+0000","last_unstale":"2024-09-17T02:24:51.604171+0000","last_undegraded":"2024-09-17T02:24:51.604171+0000","last_fullsized":"2024-09-17T02:24:51.604171+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:23.827785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606021+0000","last_change":"2024-09-17T02:24:30.704846+0000","last_active":"2024-09-17T02:24:51.606021+0000","last_peered":"2024-09-17T02:24:51.606021+0000","last_clean":"2024-09-17T02:24:51.606021+0000","last_became_active":"2024-09-17T02:24:30.703377+0000","last_became_peered":"2024-09-17T02:24:30.703377+0000","last_unstale":"2024-09-17T02:24:51.606021+0000","last_undegraded":"2024-09-17T02:24:51.606021+0000","last_fullsized":"2024-09-17T02:24:51.606021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:21.642002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277663+0000","last_change":"2024-09-17T02:24:30.696851+0000","last_active":"2024-09-17T02:24:52.277663+0000","last_peered":"2024-09-17T02:24:52.277663+0000","last_clean":"2024-09-17T02:24:52.277663+0000","last_became_active":"2024-09-17T02:24:30.694853+0000","last_became_peered":"2024-09-17T02:24:30.694853+0000","last_unstale":"2024-09-17T02:24:52.277663+0000","last_undegraded":"2024-09-17T02:24:52.277663+0000","last_fullsized":"2024-09-17T02:24:52.277663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:39.353246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235268+0000","last_change":"2024-09-17T02:24:30.339430+0000","last_active":"2024-09-17T02:24:51.235268+0000","last_peered":"2024-09-17T02:24:51.235268+0000","last_clean":"2024-09-17T02:24:51.235268+0000","last_became_active":"2024-09-17T02:24:30.338488+0000","last_became_peered":"2024-09-17T02:24:30.338488+0000","last_unstale":"2024-09-17T02:24:51.235268+0000","last_undegraded":"2024-09-17T02:24:51.235268+0000","last_fullsized":"2024-09-17T02:24:51.235268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:26.554742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606211+0000","last_change":"2024-09-17T02:24:48.584148+0000","last_active":"2024-09-17T02:24:51.606211+0000","last_peered":"2024-09-17T02:24:51.606211+0000","last_clean":"2024-09-17T02:24:51.606211+0000","last_became_active":"2024-09-17T02:24:48.582959+0000","last_became_peered":"2024-09-17T02:24:48.582959+0000","last_unstale":"2024-09-17T02:24:51.606211+0000","last_undegraded":"2024-09-17T02:24:51.606211+0000","last_fullsized":"2024-09-17T02:24:51.606211+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:24.455294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276722+0000","last_change":"2024-09-17T02:24:34.734388+0000","last_active":"2024-09-17T02:24:52.276722+0000","last_peered":"2024-09-17T02:24:52.276722+0000","last_clean":"2024-09-17T02:24:52.276722+0000","last_became_active":"2024-09-17T02:24:34.733451+0000","last_became_peered":"2024-09-17T02:24:34.733451+0000","last_unstale":"2024-09-17T02:24:52.276722+0000","last_undegraded":"2024-09-17T02:24:52.276722+0000","last_fullsized":"2024-09-17T02:24:52.276722+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:22.488478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605030+0000","last_change":"2024-09-17T02:24:30.700893+0000","last_active":"2024-09-17T02:24:51.605030+0000","last_peered":"2024-09-17T02:24:51.605030+0000","last_clean":"2024-09-17T02:24:51.605030+0000","last_became_active":"2024-09-17T02:24:30.699410+0000","last_became_peered":"2024-09-17T02:24:30.699410+0000","last_unstale":"2024-09-17T02:24:51.605030+0000","last_undegraded":"2024-09-17T02:24:51.605030+0000","last_fullsized":"2024-09-17T02:24:51.605030+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:29.137738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275593+0000","last_change":"2024-09-17T02:24:34.727144+0000","last_active":"2024-09-17T02:24:52.275593+0000","last_peered":"2024-09-17T02:24:52.275593+0000","last_clean":"2024-09-17T02:24:52.275593+0000","last_became_active":"2024-09-17T02:24:34.725109+0000","last_became_peered":"2024-09-17T02:24:34.725109+0000","last_unstale":"2024-09-17T02:24:52.275593+0000","last_undegraded":"2024-09-17T02:24:52.275593+0000","last_fullsized":"2024-09-17T02:24:52.275593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:59.629654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.231948+0000","last_change":"2024-09-17T02:24:34.357265+0000","last_active":"2024-09-17T02:24:51.231948+0000","last_peered":"2024-09-17T02:24:51.231948+0000","last_clean":"2024-09-17T02:24:51.231948+0000","last_became_active":"2024-09-17T02:24:34.356639+0000","last_became_peered":"2024-09-17T02:24:34.356639+0000","last_unstale":"2024-09-17T02:24:51.231948+0000","last_undegraded":"2024-09-17T02:24:51.231948+0000","last_fullsized":"2024-09-17T02:24:51.231948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:30.236713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605501+0000","last_change":"2024-09-17T02:24:48.583278+0000","last_active":"2024-09-17T02:24:51.605501+0000","last_peered":"2024-09-17T02:24:51.605501+0000","last_clean":"2024-09-17T02:24:51.605501+0000","last_became_active":"2024-09-17T02:24:48.581121+0000","last_became_peered":"2024-09-17T02:24:48.581121+0000","last_unstale":"2024-09-17T02:24:51.605501+0000","last_undegraded":"2024-09-17T02:24:51.605501+0000","last_fullsized":"2024-09-17T02:24:51.605501+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:39.957807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234860+0000","last_change":"2024-09-17T02:24:30.329201+0000","last_active":"2024-09-17T02:24:51.234860+0000","last_peered":"2024-09-17T02:24:51.234860+0000","last_clean":"2024-09-17T02:24:51.234860+0000","last_became_active":"2024-09-17T02:24:30.328907+0000","last_became_peered":"2024-09-17T02:24:30.328907+0000","last_unstale":"2024-09-17T02:24:51.234860+0000","last_undegraded":"2024-09-17T02:24:51.234860+0000","last_fullsized":"2024-09-17T02:24:51.234860+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:31.463647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606423+0000","last_change":"2024-09-17T02:24:34.732466+0000","last_active":"2024-09-17T02:24:51.606423+0000","last_peered":"2024-09-17T02:24:51.606423+0000","last_clean":"2024-09-17T02:24:51.606423+0000","last_became_active":"2024-09-17T02:24:34.731598+0000","last_became_peered":"2024-09-17T02:24:34.731598+0000","last_unstale":"2024-09-17T02:24:51.606423+0000","last_undegraded":"2024-09-17T02:24:51.606423+0000","last_fullsized":"2024-09-17T02:24:51.606423+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:33.350084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275176+0000","last_change":"2024-09-17T02:24:34.730124+0000","last_active":"2024-09-17T02:24:52.275176+0000","last_peered":"2024-09-17T02:24:52.275176+0000","last_clean":"2024-09-17T02:24:52.275176+0000","last_became_active":"2024-09-17T02:24:34.727345+0000","last_became_peered":"2024-09-17T02:24:34.727345+0000","last_unstale":"2024-09-17T02:24:52.275176+0000","last_undegraded":"2024-09-17T02:24:52.275176+0000","last_fullsized":"2024-09-17T02:24:52.275176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:20.739364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275221+0000","last_change":"2024-09-17T02:24:34.731057+0000","last_active":"2024-09-17T02:24:52.275221+0000","last_peered":"2024-09-17T02:24:52.275221+0000","last_clean":"2024-09-17T02:24:52.275221+0000","last_became_active":"2024-09-17T02:24:34.730285+0000","last_became_peered":"2024-09-17T02:24:34.730285+0000","last_unstale":"2024-09-17T02:24:52.275221+0000","last_undegraded":"2024-09-17T02:24:52.275221+0000","last_fullsized":"2024-09-17T02:24:52.275221+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:28.085866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604612+0000","last_change":"2024-09-17T02:24:30.702653+0000","last_active":"2024-09-17T02:24:51.604612+0000","last_peered":"2024-09-17T02:24:51.604612+0000","last_clean":"2024-09-17T02:24:51.604612+0000","last_became_active":"2024-09-17T02:24:30.701047+0000","last_became_peered":"2024-09-17T02:24:30.701047+0000","last_unstale":"2024-09-17T02:24:51.604612+0000","last_undegraded":"2024-09-17T02:24:51.604612+0000","last_fullsized":"2024-09-17T02:24:51.604612+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:26.569439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277891+0000","last_change":"2024-09-17T02:24:30.698841+0000","last_active":"2024-09-17T02:24:52.277891+0000","last_peered":"2024-09-17T02:24:52.277891+0000","last_clean":"2024-09-17T02:24:52.277891+0000","last_became_active":"2024-09-17T02:24:30.697606+0000","last_became_peered":"2024-09-17T02:24:30.697606+0000","last_unstale":"2024-09-17T02:24:52.277891+0000","last_undegraded":"2024-09-17T02:24:52.277891+0000","last_fullsized":"2024-09-17T02:24:52.277891+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:20.038861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232570+0000","last_change":"2024-09-17T02:24:30.336630+0000","last_active":"2024-09-17T02:24:51.232570+0000","last_peered":"2024-09-17T02:24:51.232570+0000","last_clean":"2024-09-17T02:24:51.232570+0000","last_became_active":"2024-09-17T02:24:30.336326+0000","last_became_peered":"2024-09-17T02:24:30.336326+0000","last_unstale":"2024-09-17T02:24:51.232570+0000","last_undegraded":"2024-09-17T02:24:51.232570+0000","last_fullsized":"2024-09-17T02:24:51.232570+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:30.072709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.236283+0000","last_change":"2024-09-17T02:24:30.336771+0000","last_active":"2024-09-17T02:24:51.236283+0000","last_peered":"2024-09-17T02:24:51.236283+0000","last_clean":"2024-09-17T02:24:51.236283+0000","last_became_active":"2024-09-17T02:24:30.336494+0000","last_became_peered":"2024-09-17T02:24:30.336494+0000","last_unstale":"2024-09-17T02:24:51.236283+0000","last_undegraded":"2024-09-17T02:24:51.236283+0000","last_fullsized":"2024-09-17T02:24:51.236283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:17.852502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604224+0000","last_change":"2024-09-17T02:24:48.583894+0000","last_active":"2024-09-17T02:24:51.604224+0000","last_peered":"2024-09-17T02:24:51.604224+0000","last_clean":"2024-09-17T02:24:51.604224+0000","last_became_active":"2024-09-17T02:24:48.580644+0000","last_became_peered":"2024-09-17T02:24:48.580644+0000","last_unstale":"2024-09-17T02:24:51.604224+0000","last_undegraded":"2024-09-17T02:24:51.604224+0000","last_fullsized":"2024-09-17T02:24:51.604224+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:15.855050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":165,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606071+0000","last_change":"2024-09-17T02:24:30.697584+0000","last_active":"2024-09-17T02:24:51.606071+0000","last_peered":"2024-09-17T02:24:51.606071+0000","last_clean":"2024-09-17T02:24:51.606071+0000","last_became_active":"2024-09-17T02:24:30.695140+0000","last_became_peered":"2024-09-17T02:24:30.695140+0000","last_unstale":"2024-09-17T02:24:51.606071+0000","last_undegraded":"2024-09-17T02:24:51.606071+0000","last_fullsized":"2024-09-17T02:24:51.606071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:07.386102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604282+0000","last_change":"2024-09-17T02:24:48.577640+0000","last_active":"2024-09-17T02:24:51.604282+0000","last_peered":"2024-09-17T02:24:51.604282+0000","last_clean":"2024-09-17T02:24:51.604282+0000","last_became_active":"2024-09-17T02:24:48.576802+0000","last_became_peered":"2024-09-17T02:24:48.576802+0000","last_unstale":"2024-09-17T02:24:51.604282+0000","last_undegraded":"2024-09-17T02:24:51.604282+0000","last_fullsized":"2024-09-17T02:24:51.604282+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:11.030891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234885+0000","last_change":"2024-09-17T02:24:30.338939+0000","last_active":"2024-09-17T02:24:51.234885+0000","last_peered":"2024-09-17T02:24:51.234885+0000","last_clean":"2024-09-17T02:24:51.234885+0000","last_became_active":"2024-09-17T02:24:30.337650+0000","last_became_peered":"2024-09-17T02:24:30.337650+0000","last_unstale":"2024-09-17T02:24:51.234885+0000","last_undegraded":"2024-09-17T02:24:51.234885+0000","last_fullsized":"2024-09-17T02:24:51.234885+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:00.927950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234077+0000","last_change":"2024-09-17T02:24:30.322785+0000","last_active":"2024-09-17T02:24:51.234077+0000","last_peered":"2024-09-17T02:24:51.234077+0000","last_clean":"2024-09-17T02:24:51.234077+0000","last_became_active":"2024-09-17T02:24:30.322509+0000","last_became_peered":"2024-09-17T02:24:30.322509+0000","last_unstale":"2024-09-17T02:24:51.234077+0000","last_undegraded":"2024-09-17T02:24:51.234077+0000","last_fullsized":"2024-09-17T02:24:51.234077+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:06.381434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234190+0000","last_change":"2024-09-17T02:24:30.329944+0000","last_active":"2024-09-17T02:24:51.234190+0000","last_peered":"2024-09-17T02:24:51.234190+0000","last_clean":"2024-09-17T02:24:51.234190+0000","last_became_active":"2024-09-17T02:24:30.329642+0000","last_became_peered":"2024-09-17T02:24:30.329642+0000","last_unstale":"2024-09-17T02:24:51.234190+0000","last_undegraded":"2024-09-17T02:24:51.234190+0000","last_fullsized":"2024-09-17T02:24:51.234190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:39.135831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277004+0000","last_change":"2024-09-17T02:24:30.699239+0000","last_active":"2024-09-17T02:24:52.277004+0000","last_peered":"2024-09-17T02:24:52.277004+0000","last_clean":"2024-09-17T02:24:52.277004+0000","last_became_active":"2024-09-17T02:24:30.697800+0000","last_became_peered":"2024-09-17T02:24:30.697800+0000","last_unstale":"2024-09-17T02:24:52.277004+0000","last_undegraded":"2024-09-17T02:24:52.277004+0000","last_fullsized":"2024-09-17T02:24:52.277004+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:42.056577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":165,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277720+0000","last_change":"2024-09-17T02:24:30.697486+0000","last_active":"2024-09-17T02:24:52.277720+0000","last_peered":"2024-09-17T02:24:52.277720+0000","last_clean":"2024-09-17T02:24:52.277720+0000","last_became_active":"2024-09-17T02:24:30.696079+0000","last_became_peered":"2024-09-17T02:24:30.696079+0000","last_unstale":"2024-09-17T02:24:52.277720+0000","last_undegraded":"2024-09-17T02:24:52.277720+0000","last_fullsized":"2024-09-17T02:24:52.277720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:07.222731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234635+0000","last_change":"2024-09-17T02:24:30.330194+0000","last_active":"2024-09-17T02:24:51.234635+0000","last_peered":"2024-09-17T02:24:51.234635+0000","last_clean":"2024-09-17T02:24:51.234635+0000","last_became_active":"2024-09-17T02:24:30.329676+0000","last_became_peered":"2024-09-17T02:24:30.329676+0000","last_unstale":"2024-09-17T02:24:51.234635+0000","last_undegraded":"2024-09-17T02:24:51.234635+0000","last_fullsized":"2024-09-17T02:24:51.234635+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:50:41.161871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232120+0000","last_change":"2024-09-17T02:24:34.360950+0000","last_active":"2024-09-17T02:24:51.232120+0000","last_peered":"2024-09-17T02:24:51.232120+0000","last_clean":"2024-09-17T02:24:51.232120+0000","last_became_active":"2024-09-17T02:24:34.360020+0000","last_became_peered":"2024-09-17T02:24:34.360020+0000","last_unstale":"2024-09-17T02:24:51.232120+0000","last_undegraded":"2024-09-17T02:24:51.232120+0000","last_fullsized":"2024-09-17T02:24:51.232120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:57.653961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234818+0000","last_change":"2024-09-17T02:24:30.338531+0000","last_active":"2024-09-17T02:24:51.234818+0000","last_peered":"2024-09-17T02:24:51.234818+0000","last_clean":"2024-09-17T02:24:51.234818+0000","last_became_active":"2024-09-17T02:24:30.336902+0000","last_became_peered":"2024-09-17T02:24:30.336902+0000","last_unstale":"2024-09-17T02:24:51.234818+0000","last_undegraded":"2024-09-17T02:24:51.234818+0000","last_fullsized":"2024-09-17T02:24:51.234818+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:49.660896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":101,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604622+0000","last_change":"2024-09-17T02:24:48.579411+0000","last_active":"2024-09-17T02:24:51.604622+0000","last_peered":"2024-09-17T02:24:51.604622+0000","last_clean":"2024-09-17T02:24:51.604622+0000","last_became_active":"2024-09-17T02:24:48.578461+0000","last_became_peered":"2024-09-17T02:24:48.578461+0000","last_unstale":"2024-09-17T02:24:51.604622+0000","last_undegraded":"2024-09-17T02:24:51.604622+0000","last_fullsized":"2024-09-17T02:24:51.604622+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:09:43.054480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.236338+0000","last_change":"2024-09-17T02:24:30.326828+0000","last_active":"2024-09-17T02:24:51.236338+0000","last_peered":"2024-09-17T02:24:51.236338+0000","last_clean":"2024-09-17T02:24:51.236338+0000","last_became_active":"2024-09-17T02:24:30.326227+0000","last_became_peered":"2024-09-17T02:24:30.326227+0000","last_unstale":"2024-09-17T02:24:51.236338+0000","last_undegraded":"2024-09-17T02:24:51.236338+0000","last_fullsized":"2024-09-17T02:24:51.236338+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:53.135460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604435+0000","last_change":"2024-09-17T02:24:48.580927+0000","last_active":"2024-09-17T02:24:51.604435+0000","last_peered":"2024-09-17T02:24:51.604435+0000","last_clean":"2024-09-17T02:24:51.604435+0000","last_became_active":"2024-09-17T02:24:48.578678+0000","last_became_peered":"2024-09-17T02:24:48.578678+0000","last_unstale":"2024-09-17T02:24:51.604435+0000","last_undegraded":"2024-09-17T02:24:51.604435+0000","last_fullsized":"2024-09-17T02:24:51.604435+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:46.131656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277923+0000","last_change":"2024-09-17T02:20:16.583084+0000","last_active":"2024-09-17T02:24:52.277923+0000","last_peered":"2024-09-17T02:24:52.277923+0000","last_clean":"2024-09-17T02:24:52.277923+0000","last_became_active":"2024-09-17T02:20:16.582326+0000","last_became_peered":"2024-09-17T02:20:16.582326+0000","last_unstale":"2024-09-17T02:24:52.277923+0000","last_undegraded":"2024-09-17T02:24:52.277923+0000","last_fullsized":"2024-09-17T02:24:52.277923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:05.049317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":236,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232539+0000","last_change":"2024-09-17T02:24:30.338760+0000","last_active":"2024-09-17T02:24:51.232539+0000","last_peered":"2024-09-17T02:24:51.232539+0000","last_clean":"2024-09-17T02:24:51.232539+0000","last_became_active":"2024-09-17T02:24:30.338214+0000","last_became_peered":"2024-09-17T02:24:30.338214+0000","last_unstale":"2024-09-17T02:24:51.232539+0000","last_undegraded":"2024-09-17T02:24:51.232539+0000","last_fullsized":"2024-09-17T02:24:51.232539+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:03.432050+0000","last_clean_scrub_stamp":"2024-09-17T02:20:03.432050+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:27:29.124652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":60,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233731+0000","last_change":"2024-09-17T02:24:30.325326+0000","last_active":"2024-09-17T02:24:51.233731+0000","last_peered":"2024-09-17T02:24:51.233731+0000","last_clean":"2024-09-17T02:24:51.233731+0000","last_became_active":"2024-09-17T02:24:30.324910+0000","last_became_peered":"2024-09-17T02:24:30.324910+0000","last_unstale":"2024-09-17T02:24:51.233731+0000","last_undegraded":"2024-09-17T02:24:51.233731+0000","last_fullsized":"2024-09-17T02:24:51.233731+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:52:27.682190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276836+0000","last_change":"2024-09-17T02:20:15.560646+0000","last_active":"2024-09-17T02:24:52.276836+0000","last_peered":"2024-09-17T02:24:52.276836+0000","last_clean":"2024-09-17T02:24:52.276836+0000","last_became_active":"2024-09-17T02:20:15.559104+0000","last_became_peered":"2024-09-17T02:20:15.559104+0000","last_unstale":"2024-09-17T02:24:52.276836+0000","last_undegraded":"2024-09-17T02:24:52.276836+0000","last_fullsized":"2024-09-17T02:24:52.276836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:44.299986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235150+0000","last_change":"2024-09-17T02:24:30.339100+0000","last_active":"2024-09-17T02:24:51.235150+0000","last_peered":"2024-09-17T02:24:51.235150+0000","last_clean":"2024-09-17T02:24:51.235150+0000","last_became_active":"2024-09-17T02:24:30.337415+0000","last_became_peered":"2024-09-17T02:24:30.337415+0000","last_unstale":"2024-09-17T02:24:51.235150+0000","last_undegraded":"2024-09-17T02:24:51.235150+0000","last_fullsized":"2024-09-17T02:24:51.235150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:27.682975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233159+0000","last_change":"2024-09-17T02:24:30.338621+0000","last_active":"2024-09-17T02:24:51.233159+0000","last_peered":"2024-09-17T02:24:51.233159+0000","last_clean":"2024-09-17T02:24:51.233159+0000","last_became_active":"2024-09-17T02:24:30.338024+0000","last_became_peered":"2024-09-17T02:24:30.338024+0000","last_unstale":"2024-09-17T02:24:51.233159+0000","last_undegraded":"2024-09-17T02:24:51.233159+0000","last_fullsized":"2024-09-17T02:24:51.233159+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:49.985865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276198+0000","last_change":"2024-09-17T02:24:30.694491+0000","last_active":"2024-09-17T02:24:52.276198+0000","last_peered":"2024-09-17T02:24:52.276198+0000","last_clean":"2024-09-17T02:24:52.276198+0000","last_became_active":"2024-09-17T02:24:30.693653+0000","last_became_peered":"2024-09-17T02:24:30.693653+0000","last_unstale":"2024-09-17T02:24:52.276198+0000","last_undegraded":"2024-09-17T02:24:52.276198+0000","last_fullsized":"2024-09-17T02:24:52.276198+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:12.740030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605591+0000","last_change":"2024-09-17T02:20:16.571568+0000","last_active":"2024-09-17T02:24:51.605591+0000","last_peered":"2024-09-17T02:24:51.605591+0000","last_clean":"2024-09-17T02:24:51.605591+0000","last_became_active":"2024-09-17T02:20:16.570622+0000","last_became_peered":"2024-09-17T02:20:16.570622+0000","last_unstale":"2024-09-17T02:24:51.605591+0000","last_undegraded":"2024-09-17T02:24:51.605591+0000","last_fullsized":"2024-09-17T02:24:51.605591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:57.083446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276496+0000","last_change":"2024-09-17T02:20:12.511823+0000","last_active":"2024-09-17T02:24:52.276496+0000","last_peered":"2024-09-17T02:24:52.276496+0000","last_clean":"2024-09-17T02:24:52.276496+0000","last_became_active":"2024-09-17T02:20:10.497164+0000","last_became_peered":"2024-09-17T02:20:10.497164+0000","last_unstale":"2024-09-17T02:24:52.276496+0000","last_undegraded":"2024-09-17T02:24:52.276496+0000","last_fullsized":"2024-09-17T02:24:52.276496+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:21.242753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081052700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":101,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604499+0000","last_change":"2024-09-17T02:24:48.585305+0000","last_active":"2024-09-17T02:24:51.604499+0000","last_peered":"2024-09-17T02:24:51.604499+0000","last_clean":"2024-09-17T02:24:51.604499+0000","last_became_active":"2024-09-17T02:24:48.582729+0000","last_became_peered":"2024-09-17T02:24:48.582729+0000","last_unstale":"2024-09-17T02:24:51.604499+0000","last_undegraded":"2024-09-17T02:24:51.604499+0000","last_fullsized":"2024-09-17T02:24:51.604499+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:58.012479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277630+0000","last_change":"2024-09-17T02:24:34.730636+0000","last_active":"2024-09-17T02:24:52.277630+0000","last_peered":"2024-09-17T02:24:52.277630+0000","last_clean":"2024-09-17T02:24:52.277630+0000","last_became_active":"2024-09-17T02:24:34.729890+0000","last_became_peered":"2024-09-17T02:24:34.729890+0000","last_unstale":"2024-09-17T02:24:52.277630+0000","last_undegraded":"2024-09-17T02:24:52.277630+0000","last_fullsized":"2024-09-17T02:24:52.277630+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:07.679985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232887+0000","last_change":"2024-09-17T02:24:30.333204+0000","last_active":"2024-09-17T02:24:51.232887+0000","last_peered":"2024-09-17T02:24:51.232887+0000","last_clean":"2024-09-17T02:24:51.232887+0000","last_became_active":"2024-09-17T02:24:30.333005+0000","last_became_peered":"2024-09-17T02:24:30.333005+0000","last_unstale":"2024-09-17T02:24:51.232887+0000","last_undegraded":"2024-09-17T02:24:51.232887+0000","last_fullsized":"2024-09-17T02:24:51.232887+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:17.620422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078085399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234838+0000","last_change":"2024-09-17T02:24:30.329442+0000","last_active":"2024-09-17T02:24:51.234838+0000","last_peered":"2024-09-17T02:24:51.234838+0000","last_clean":"2024-09-17T02:24:51.234838+0000","last_became_active":"2024-09-17T02:24:30.329213+0000","last_became_peered":"2024-09-17T02:24:30.329213+0000","last_unstale":"2024-09-17T02:24:51.234838+0000","last_undegraded":"2024-09-17T02:24:51.234838+0000","last_fullsized":"2024-09-17T02:24:51.234838+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:25.034116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277315+0000","last_change":"2024-09-17T02:20:16.580184+0000","last_active":"2024-09-17T02:24:52.277315+0000","last_peered":"2024-09-17T02:24:52.277315+0000","last_clean":"2024-09-17T02:24:52.277315+0000","last_became_active":"2024-09-17T02:20:16.578343+0000","last_became_peered":"2024-09-17T02:20:16.578343+0000","last_unstale":"2024-09-17T02:24:52.277315+0000","last_undegraded":"2024-09-17T02:24:52.277315+0000","last_fullsized":"2024-09-17T02:24:52.277315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:42.123535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232100+0000","last_change":"2024-09-17T02:24:34.354157+0000","last_active":"2024-09-17T02:24:51.232100+0000","last_peered":"2024-09-17T02:24:51.232100+0000","last_clean":"2024-09-17T02:24:51.232100+0000","last_became_active":"2024-09-17T02:24:34.353619+0000","last_became_peered":"2024-09-17T02:24:34.353619+0000","last_unstale":"2024-09-17T02:24:51.232100+0000","last_undegraded":"2024-09-17T02:24:51.232100+0000","last_fullsized":"2024-09-17T02:24:51.232100+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:53:03.444794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277559+0000","last_change":"2024-09-17T02:20:12.511838+0000","last_active":"2024-09-17T02:24:52.277559+0000","last_peered":"2024-09-17T02:24:52.277559+0000","last_clean":"2024-09-17T02:24:52.277559+0000","last_became_active":"2024-09-17T02:20:10.497049+0000","last_became_peered":"2024-09-17T02:20:10.497049+0000","last_unstale":"2024-09-17T02:24:52.277559+0000","last_undegraded":"2024-09-17T02:24:52.277559+0000","last_fullsized":"2024-09-17T02:24:52.277559+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:54.446484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079701100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604586+0000","last_change":"2024-09-17T02:24:30.698392+0000","last_active":"2024-09-17T02:24:51.604586+0000","last_peered":"2024-09-17T02:24:51.604586+0000","last_clean":"2024-09-17T02:24:51.604586+0000","last_became_active":"2024-09-17T02:24:30.694944+0000","last_became_peered":"2024-09-17T02:24:30.694944+0000","last_unstale":"2024-09-17T02:24:51.604586+0000","last_undegraded":"2024-09-17T02:24:51.604586+0000","last_fullsized":"2024-09-17T02:24:51.604586+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:06.407404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277487+0000","last_change":"2024-09-17T02:20:15.559252+0000","last_active":"2024-09-17T02:24:52.277487+0000","last_peered":"2024-09-17T02:24:52.277487+0000","last_clean":"2024-09-17T02:24:52.277487+0000","last_became_active":"2024-09-17T02:20:15.557667+0000","last_became_peered":"2024-09-17T02:20:15.557667+0000","last_unstale":"2024-09-17T02:24:52.277487+0000","last_undegraded":"2024-09-17T02:24:52.277487+0000","last_fullsized":"2024-09-17T02:24:52.277487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:01.292626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606815+0000","last_change":"2024-09-17T02:20:12.661034+0000","last_active":"2024-09-17T02:24:51.606815+0000","last_peered":"2024-09-17T02:24:51.606815+0000","last_clean":"2024-09-17T02:24:51.606815+0000","last_became_active":"2024-09-17T02:20:10.497829+0000","last_became_peered":"2024-09-17T02:20:10.497829+0000","last_unstale":"2024-09-17T02:24:51.606815+0000","last_undegraded":"2024-09-17T02:24:51.606815+0000","last_fullsized":"2024-09-17T02:24:51.606815+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:46:27.427685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096944700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605391+0000","last_change":"2024-09-17T02:24:48.581467+0000","last_active":"2024-09-17T02:24:51.605391+0000","last_peered":"2024-09-17T02:24:51.605391+0000","last_clean":"2024-09-17T02:24:51.605391+0000","last_became_active":"2024-09-17T02:24:48.580388+0000","last_became_peered":"2024-09-17T02:24:48.580388+0000","last_unstale":"2024-09-17T02:24:51.605391+0000","last_undegraded":"2024-09-17T02:24:51.605391+0000","last_fullsized":"2024-09-17T02:24:51.605391+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:21:11.358704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278338+0000","last_change":"2024-09-17T02:20:15.558961+0000","last_active":"2024-09-17T02:24:52.278338+0000","last_peered":"2024-09-17T02:24:52.278338+0000","last_clean":"2024-09-17T02:24:52.278338+0000","last_became_active":"2024-09-17T02:20:15.558299+0000","last_became_peered":"2024-09-17T02:20:15.558299+0000","last_unstale":"2024-09-17T02:24:52.278338+0000","last_undegraded":"2024-09-17T02:24:52.278338+0000","last_fullsized":"2024-09-17T02:24:52.278338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:39.709524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278295+0000","last_change":"2024-09-17T02:20:12.512481+0000","last_active":"2024-09-17T02:24:52.278295+0000","last_peered":"2024-09-17T02:24:52.278295+0000","last_clean":"2024-09-17T02:24:52.278295+0000","last_became_active":"2024-09-17T02:20:10.497021+0000","last_became_peered":"2024-09-17T02:20:10.497021+0000","last_unstale":"2024-09-17T02:24:52.278295+0000","last_undegraded":"2024-09-17T02:24:52.278295+0000","last_fullsized":"2024-09-17T02:24:52.278295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:41.167283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001400079,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276096+0000","last_change":"2024-09-17T02:24:30.693811+0000","last_active":"2024-09-17T02:24:52.276096+0000","last_peered":"2024-09-17T02:24:52.276096+0000","last_clean":"2024-09-17T02:24:52.276096+0000","last_became_active":"2024-09-17T02:24:30.691331+0000","last_became_peered":"2024-09-17T02:24:30.691331+0000","last_unstale":"2024-09-17T02:24:52.276096+0000","last_undegraded":"2024-09-17T02:24:52.276096+0000","last_fullsized":"2024-09-17T02:24:52.276096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:39.446085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":164,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278098+0000","last_change":"2024-09-17T02:24:30.694492+0000","last_active":"2024-09-17T02:24:52.278098+0000","last_peered":"2024-09-17T02:24:52.278098+0000","last_clean":"2024-09-17T02:24:52.278098+0000","last_became_active":"2024-09-17T02:24:30.691770+0000","last_became_peered":"2024-09-17T02:24:30.691770+0000","last_unstale":"2024-09-17T02:24:52.278098+0000","last_undegraded":"2024-09-17T02:24:52.278098+0000","last_fullsized":"2024-09-17T02:24:52.278098+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:01.597617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235468+0000","last_change":"2024-09-17T02:24:30.336636+0000","last_active":"2024-09-17T02:24:51.235468+0000","last_peered":"2024-09-17T02:24:51.235468+0000","last_clean":"2024-09-17T02:24:51.235468+0000","last_became_active":"2024-09-17T02:24:30.336110+0000","last_became_peered":"2024-09-17T02:24:30.336110+0000","last_unstale":"2024-09-17T02:24:51.235468+0000","last_undegraded":"2024-09-17T02:24:51.235468+0000","last_fullsized":"2024-09-17T02:24:51.235468+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:44.699884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604333+0000","last_change":"2024-09-17T02:24:30.700777+0000","last_active":"2024-09-17T02:24:51.604333+0000","last_peered":"2024-09-17T02:24:51.604333+0000","last_clean":"2024-09-17T02:24:51.604333+0000","last_became_active":"2024-09-17T02:24:30.696731+0000","last_became_peered":"2024-09-17T02:24:30.696731+0000","last_unstale":"2024-09-17T02:24:51.604333+0000","last_undegraded":"2024-09-17T02:24:51.604333+0000","last_fullsized":"2024-09-17T02:24:51.604333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:58.629953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234416+0000","last_change":"2024-09-17T02:24:30.326364+0000","last_active":"2024-09-17T02:24:51.234416+0000","last_peered":"2024-09-17T02:24:51.234416+0000","last_clean":"2024-09-17T02:24:51.234416+0000","last_became_active":"2024-09-17T02:24:30.325752+0000","last_became_peered":"2024-09-17T02:24:30.325752+0000","last_unstale":"2024-09-17T02:24:51.234416+0000","last_undegraded":"2024-09-17T02:24:51.234416+0000","last_fullsized":"2024-09-17T02:24:51.234416+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:33.800584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233479+0000","last_change":"2024-09-17T02:24:30.325924+0000","last_active":"2024-09-17T02:24:51.233479+0000","last_peered":"2024-09-17T02:24:51.233479+0000","last_clean":"2024-09-17T02:24:51.233479+0000","last_became_active":"2024-09-17T02:24:30.325688+0000","last_became_peered":"2024-09-17T02:24:30.325688+0000","last_unstale":"2024-09-17T02:24:51.233479+0000","last_undegraded":"2024-09-17T02:24:51.233479+0000","last_fullsized":"2024-09-17T02:24:51.233479+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:25.290483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276040+0000","last_change":"2024-09-17T02:24:34.731288+0000","last_active":"2024-09-17T02:24:52.276040+0000","last_peered":"2024-09-17T02:24:52.276040+0000","last_clean":"2024-09-17T02:24:52.276040+0000","last_became_active":"2024-09-17T02:24:34.730386+0000","last_became_peered":"2024-09-17T02:24:34.730386+0000","last_unstale":"2024-09-17T02:24:52.276040+0000","last_undegraded":"2024-09-17T02:24:52.276040+0000","last_fullsized":"2024-09-17T02:24:52.276040+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:45.808940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":103,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606673+0000","last_change":"2024-09-17T02:24:48.583147+0000","last_active":"2024-09-17T02:24:51.606673+0000","last_peered":"2024-09-17T02:24:51.606673+0000","last_clean":"2024-09-17T02:24:51.606673+0000","last_became_active":"2024-09-17T02:24:48.581390+0000","last_became_peered":"2024-09-17T02:24:48.581390+0000","last_unstale":"2024-09-17T02:24:51.606673+0000","last_undegraded":"2024-09-17T02:24:51.606673+0000","last_fullsized":"2024-09-17T02:24:51.606673+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:08.312173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235572+0000","last_change":"2024-09-17T02:24:30.325492+0000","last_active":"2024-09-17T02:24:51.235572+0000","last_peered":"2024-09-17T02:24:51.235572+0000","last_clean":"2024-09-17T02:24:51.235572+0000","last_became_active":"2024-09-17T02:24:30.325175+0000","last_became_peered":"2024-09-17T02:24:30.325175+0000","last_unstale":"2024-09-17T02:24:51.235572+0000","last_undegraded":"2024-09-17T02:24:51.235572+0000","last_fullsized":"2024-09-17T02:24:51.235572+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:04.443085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275866+0000","last_change":"2024-09-17T02:24:30.699551+0000","last_active":"2024-09-17T02:24:52.275866+0000","last_peered":"2024-09-17T02:24:52.275866+0000","last_clean":"2024-09-17T02:24:52.275866+0000","last_became_active":"2024-09-17T02:24:30.697986+0000","last_became_peered":"2024-09-17T02:24:30.697986+0000","last_unstale":"2024-09-17T02:24:52.275866+0000","last_undegraded":"2024-09-17T02:24:52.275866+0000","last_fullsized":"2024-09-17T02:24:52.275866+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:44.939985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278191+0000","last_change":"2024-09-17T02:24:30.697249+0000","last_active":"2024-09-17T02:24:52.278191+0000","last_peered":"2024-09-17T02:24:52.278191+0000","last_clean":"2024-09-17T02:24:52.278191+0000","last_became_active":"2024-09-17T02:24:30.696215+0000","last_became_peered":"2024-09-17T02:24:30.696215+0000","last_unstale":"2024-09-17T02:24:52.278191+0000","last_undegraded":"2024-09-17T02:24:52.278191+0000","last_fullsized":"2024-09-17T02:24:52.278191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:07.507822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276041+0000","last_change":"2024-09-17T02:20:16.577803+0000","last_active":"2024-09-17T02:24:52.276041+0000","last_peered":"2024-09-17T02:24:52.276041+0000","last_clean":"2024-09-17T02:24:52.276041+0000","last_became_active":"2024-09-17T02:20:16.576640+0000","last_became_peered":"2024-09-17T02:20:16.576640+0000","last_unstale":"2024-09-17T02:24:52.276041+0000","last_undegraded":"2024-09-17T02:24:52.276041+0000","last_fullsized":"2024-09-17T02:24:52.276041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:07.190169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606196+0000","last_change":"2024-09-17T02:24:30.706739+0000","last_active":"2024-09-17T02:24:51.606196+0000","last_peered":"2024-09-17T02:24:51.606196+0000","last_clean":"2024-09-17T02:24:51.606196+0000","last_became_active":"2024-09-17T02:24:30.706195+0000","last_became_peered":"2024-09-17T02:24:30.706195+0000","last_unstale":"2024-09-17T02:24:51.606196+0000","last_undegraded":"2024-09-17T02:24:51.606196+0000","last_fullsized":"2024-09-17T02:24:51.606196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:38.782264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275411+0000","last_change":"2024-09-17T02:24:34.733762+0000","last_active":"2024-09-17T02:24:52.275411+0000","last_peered":"2024-09-17T02:24:52.275411+0000","last_clean":"2024-09-17T02:24:52.275411+0000","last_became_active":"2024-09-17T02:24:34.731592+0000","last_became_peered":"2024-09-17T02:24:34.731592+0000","last_unstale":"2024-09-17T02:24:52.275411+0000","last_undegraded":"2024-09-17T02:24:52.275411+0000","last_fullsized":"2024-09-17T02:24:52.275411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:41.921908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277777+0000","last_change":"2024-09-17T02:24:30.696267+0000","last_active":"2024-09-17T02:24:52.277777+0000","last_peered":"2024-09-17T02:24:52.277777+0000","last_clean":"2024-09-17T02:24:52.277777+0000","last_became_active":"2024-09-17T02:24:30.694027+0000","last_became_peered":"2024-09-17T02:24:30.694027+0000","last_unstale":"2024-09-17T02:24:52.277777+0000","last_undegraded":"2024-09-17T02:24:52.277777+0000","last_fullsized":"2024-09-17T02:24:52.277777+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:56.160158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276145+0000","last_change":"2024-09-17T02:24:30.697568+0000","last_active":"2024-09-17T02:24:52.276145+0000","last_peered":"2024-09-17T02:24:52.276145+0000","last_clean":"2024-09-17T02:24:52.276145+0000","last_became_active":"2024-09-17T02:24:30.693991+0000","last_became_peered":"2024-09-17T02:24:30.693991+0000","last_unstale":"2024-09-17T02:24:52.276145+0000","last_undegraded":"2024-09-17T02:24:52.276145+0000","last_fullsized":"2024-09-17T02:24:52.276145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:45.636130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606140+0000","last_change":"2024-09-17T02:21:10.505967+0000","last_active":"2024-09-17T02:24:51.606140+0000","last_peered":"2024-09-17T02:24:51.606140+0000","last_clean":"2024-09-17T02:24:51.606140+0000","last_became_active":"2024-09-17T02:21:10.505594+0000","last_became_peered":"2024-09-17T02:21:10.505594+0000","last_unstale":"2024-09-17T02:24:51.606140+0000","last_undegraded":"2024-09-17T02:24:51.606140+0000","last_fullsized":"2024-09-17T02:24:51.606140+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:15.782752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605310+0000","last_change":"2024-09-17T02:24:48.579594+0000","last_active":"2024-09-17T02:24:51.605310+0000","last_peered":"2024-09-17T02:24:51.605310+0000","last_clean":"2024-09-17T02:24:51.605310+0000","last_became_active":"2024-09-17T02:24:48.578539+0000","last_became_peered":"2024-09-17T02:24:48.578539+0000","last_unstale":"2024-09-17T02:24:51.605310+0000","last_undegraded":"2024-09-17T02:24:51.605310+0000","last_fullsized":"2024-09-17T02:24:51.605310+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:11.515508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605322+0000","last_change":"2024-09-17T02:24:48.580567+0000","last_active":"2024-09-17T02:24:51.605322+0000","last_peered":"2024-09-17T02:24:51.605322+0000","last_clean":"2024-09-17T02:24:51.605322+0000","last_became_active":"2024-09-17T02:24:48.579612+0000","last_became_peered":"2024-09-17T02:24:48.579612+0000","last_unstale":"2024-09-17T02:24:51.605322+0000","last_undegraded":"2024-09-17T02:24:51.605322+0000","last_fullsized":"2024-09-17T02:24:51.605322+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:28:53.281135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605697+0000","last_change":"2024-09-17T02:24:30.698237+0000","last_active":"2024-09-17T02:24:51.605697+0000","last_peered":"2024-09-17T02:24:51.605697+0000","last_clean":"2024-09-17T02:24:51.605697+0000","last_became_active":"2024-09-17T02:24:30.697194+0000","last_became_peered":"2024-09-17T02:24:30.697194+0000","last_unstale":"2024-09-17T02:24:51.605697+0000","last_undegraded":"2024-09-17T02:24:51.605697+0000","last_fullsized":"2024-09-17T02:24:51.605697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:36.697224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232314+0000","last_change":"2024-09-17T02:24:34.360811+0000","last_active":"2024-09-17T02:24:51.232314+0000","last_peered":"2024-09-17T02:24:51.232314+0000","last_clean":"2024-09-17T02:24:51.232314+0000","last_became_active":"2024-09-17T02:24:34.359944+0000","last_became_peered":"2024-09-17T02:24:34.359944+0000","last_unstale":"2024-09-17T02:24:51.232314+0000","last_undegraded":"2024-09-17T02:24:51.232314+0000","last_fullsized":"2024-09-17T02:24:51.232314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:07.986774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234185+0000","last_change":"2024-09-17T02:24:30.327080+0000","last_active":"2024-09-17T02:24:51.234185+0000","last_peered":"2024-09-17T02:24:51.234185+0000","last_clean":"2024-09-17T02:24:51.234185+0000","last_became_active":"2024-09-17T02:24:30.326800+0000","last_became_peered":"2024-09-17T02:24:30.326800+0000","last_unstale":"2024-09-17T02:24:51.234185+0000","last_undegraded":"2024-09-17T02:24:51.234185+0000","last_fullsized":"2024-09-17T02:24:51.234185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:06.072812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233254+0000","last_change":"2024-09-17T02:24:30.322448+0000","last_active":"2024-09-17T02:24:51.233254+0000","last_peered":"2024-09-17T02:24:51.233254+0000","last_clean":"2024-09-17T02:24:51.233254+0000","last_became_active":"2024-09-17T02:24:30.322156+0000","last_became_peered":"2024-09-17T02:24:30.322156+0000","last_unstale":"2024-09-17T02:24:51.233254+0000","last_undegraded":"2024-09-17T02:24:51.233254+0000","last_fullsized":"2024-09-17T02:24:51.233254+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:46.435146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":102,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606560+0000","last_change":"2024-09-17T02:24:48.583271+0000","last_active":"2024-09-17T02:24:51.606560+0000","last_peered":"2024-09-17T02:24:51.606560+0000","last_clean":"2024-09-17T02:24:51.606560+0000","last_became_active":"2024-09-17T02:24:48.581355+0000","last_became_peered":"2024-09-17T02:24:48.581355+0000","last_unstale":"2024-09-17T02:24:51.606560+0000","last_undegraded":"2024-09-17T02:24:51.606560+0000","last_fullsized":"2024-09-17T02:24:51.606560+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:01.234040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604953+0000","last_change":"2024-09-17T02:20:16.570456+0000","last_active":"2024-09-17T02:24:51.604953+0000","last_peered":"2024-09-17T02:24:51.604953+0000","last_clean":"2024-09-17T02:24:51.604953+0000","last_became_active":"2024-09-17T02:20:16.568095+0000","last_became_peered":"2024-09-17T02:20:16.568095+0000","last_unstale":"2024-09-17T02:24:51.604953+0000","last_undegraded":"2024-09-17T02:24:51.604953+0000","last_fullsized":"2024-09-17T02:24:51.604953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:58.329169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":157,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278020+0000","last_change":"2024-09-17T02:20:15.560293+0000","last_active":"2024-09-17T02:24:52.278020+0000","last_peered":"2024-09-17T02:24:52.278020+0000","last_clean":"2024-09-17T02:24:52.278020+0000","last_became_active":"2024-09-17T02:20:15.559074+0000","last_became_peered":"2024-09-17T02:20:15.559074+0000","last_unstale":"2024-09-17T02:24:52.278020+0000","last_undegraded":"2024-09-17T02:24:52.278020+0000","last_fullsized":"2024-09-17T02:24:52.278020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:55.639841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233448+0000","last_change":"2024-09-17T02:24:30.319629+0000","last_active":"2024-09-17T02:24:51.233448+0000","last_peered":"2024-09-17T02:24:51.233448+0000","last_clean":"2024-09-17T02:24:51.233448+0000","last_became_active":"2024-09-17T02:24:30.319441+0000","last_became_peered":"2024-09-17T02:24:30.319441+0000","last_unstale":"2024-09-17T02:24:51.233448+0000","last_undegraded":"2024-09-17T02:24:51.233448+0000","last_fullsized":"2024-09-17T02:24:51.233448+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:58.379141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":167,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278026+0000","last_change":"2024-09-17T02:24:30.699964+0000","last_active":"2024-09-17T02:24:52.278026+0000","last_peered":"2024-09-17T02:24:52.278026+0000","last_clean":"2024-09-17T02:24:52.278026+0000","last_became_active":"2024-09-17T02:24:30.699102+0000","last_became_peered":"2024-09-17T02:24:30.699102+0000","last_unstale":"2024-09-17T02:24:52.278026+0000","last_undegraded":"2024-09-17T02:24:52.278026+0000","last_fullsized":"2024-09-17T02:24:52.278026+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:19.193516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5558,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705727,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361248,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":360190,"kb_avail":94010592,"statfs":{"total":96636764160,"available":96266846208,"internally_reserved":0,"allocated":1052672,"data_stored":983227,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":368835013},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":80,"seq":343597383687,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56488,"kb_used_data":1040,"kb_used_omap":6,"kb_used_meta":55417,"kb_avail":94315352,"statfs":{"total":96636764160,"available":96578920448,"internally_reserved":0,"allocated":1064960,"data_stored":983862,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":7153,"internal_metadata":56747023},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738430,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329228,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94042612,"statfs":{"total":96636764160,"available":96299634688,"internally_reserved":0,"allocated":974848,"data_stored":387439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5558,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T02:24:59.510 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.510 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.510 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.510 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.510 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.510 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.510 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.511 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.511 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.511 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.511 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.511 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.511 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.511 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.511 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.511 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.512 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.512 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.512 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.512 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.512 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.512 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.512 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.512 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.512 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.513 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.513 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.513 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.513 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.513 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.513 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.513 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.513 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.513 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.514 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.514 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.514 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.514 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.514 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.514 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.514 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.514 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.514 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.514 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.515 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.515 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.515 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.515 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.515 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.515 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.515 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.515 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.515 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.516 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.516 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.516 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.516 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-17T02:20:03.432050+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=3, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.516 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-17T02:20:09.475290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=9, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.516 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.516 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.516 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-17T02:20:09.475290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=9, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.516 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.517 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.517 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-17T02:20:09.475290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=9, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.517 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.517 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.517 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-17T02:20:09.475290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=9, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.517 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.517 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.517 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.517 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-17T02:20:09.475290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=9, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.518 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.518 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.518 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-17T02:20:09.475290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=9, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.518 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.518 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.518 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-17T02:20:09.475290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=9, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.518 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.518 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.518 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-17T02:20:09.475290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=9, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.519 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.519 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.519 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.519 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.519 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.519 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.519 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.519 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.519 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.520 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.520 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.520 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.520 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.520 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.520 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.520 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.520 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.520 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.521 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.521 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.521 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.521 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.521 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.521 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.521 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:24:59.521 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T02:25:19.522 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:25:19.840 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:25:19.843 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-17T02:25:19.860 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":247,"stamp":"2024-09-17T02:25:19.492581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":214,"ondisk_log_size":214,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":746948,"kb_used_data":3028,"kb_used_omap":10,"kb_used_meta":743861,"kb_avail":282368572,"statfs":{"total":289910292480,"available":289145417728,"internally_reserved":0,"allocated":3100672,"data_stored":2358789,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10343,"internal_metadata":761714585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004265"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":180,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:01.898314+0000","last_change":"2024-09-17T02:25:01.898372+0000","last_active":"2024-09-17T02:25:01.898314+0000","last_peered":"2024-09-17T02:25:01.898314+0000","last_clean":"2024-09-17T02:25:01.898314+0000","last_became_active":"2024-09-17T02:24:34.732728+0000","last_became_peered":"2024-09-17T02:24:34.732728+0000","last_unstale":"2024-09-17T02:25:01.898314+0000","last_undegraded":"2024-09-17T02:25:01.898314+0000","last_fullsized":"2024-09-17T02:25:01.898314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:01.898123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:01.898123+0000","last_clean_scrub_stamp":"2024-09-17T02:25:01.898123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:12.284357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:10.991017+0000","last_change":"2024-09-17T02:25:10.991070+0000","last_active":"2024-09-17T02:25:10.991017+0000","last_peered":"2024-09-17T02:25:10.991017+0000","last_clean":"2024-09-17T02:25:10.991017+0000","last_became_active":"2024-09-17T02:24:48.578274+0000","last_became_peered":"2024-09-17T02:24:48.578274+0000","last_unstale":"2024-09-17T02:25:10.991017+0000","last_undegraded":"2024-09-17T02:25:10.991017+0000","last_fullsized":"2024-09-17T02:25:10.991017+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:10.990818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:10.990818+0000","last_clean_scrub_stamp":"2024-09-17T02:25:10.990818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:34.616605+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:03.311356+0000","last_change":"2024-09-17T02:25:03.311413+0000","last_active":"2024-09-17T02:25:03.311356+0000","last_peered":"2024-09-17T02:25:03.311356+0000","last_clean":"2024-09-17T02:25:03.311356+0000","last_became_active":"2024-09-17T02:24:30.338199+0000","last_became_peered":"2024-09-17T02:24:30.338199+0000","last_unstale":"2024-09-17T02:25:03.311356+0000","last_undegraded":"2024-09-17T02:25:03.311356+0000","last_fullsized":"2024-09-17T02:25:03.311356+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:03.311174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:03.311174+0000","last_clean_scrub_stamp":"2024-09-17T02:25:03.311174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:23.773466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":88,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232574+0000","last_change":"2024-09-17T02:24:34.360587+0000","last_active":"2024-09-17T02:24:51.232574+0000","last_peered":"2024-09-17T02:24:51.232574+0000","last_clean":"2024-09-17T02:24:51.232574+0000","last_became_active":"2024-09-17T02:24:34.359912+0000","last_became_peered":"2024-09-17T02:24:34.359912+0000","last_unstale":"2024-09-17T02:24:51.232574+0000","last_undegraded":"2024-09-17T02:24:51.232574+0000","last_fullsized":"2024-09-17T02:24:51.232574+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":108,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:08.985772+0000","last_change":"2024-09-17T02:25:08.985772+0000","last_active":"2024-09-17T02:25:08.985772+0000","last_peered":"2024-09-17T02:25:08.985772+0000","last_clean":"2024-09-17T02:25:08.985772+0000","last_became_active":"2024-09-17T02:24:48.578841+0000","last_became_peered":"2024-09-17T02:24:48.578841+0000","last_unstale":"2024-09-17T02:25:08.985772+0000","last_undegraded":"2024-09-17T02:25:08.985772+0000","last_fullsized":"2024-09-17T02:25:08.985772+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:08.985442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:08.985442+0000","last_clean_scrub_stamp":"2024-09-17T02:25:08.985442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:05.066126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234106+0000","last_change":"2024-09-17T02:24:30.322619+0000","last_active":"2024-09-17T02:24:51.234106+0000","last_peered":"2024-09-17T02:24:51.234106+0000","last_clean":"2024-09-17T02:24:51.234106+0000","last_became_active":"2024-09-17T02:24:30.322191+0000","last_became_peered":"2024-09-17T02:24:30.322191+0000","last_unstale":"2024-09-17T02:24:51.234106+0000","last_undegraded":"2024-09-17T02:24:51.234106+0000","last_fullsized":"2024-09-17T02:24:51.234106+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:05.261618+0000","last_change":"2024-09-17T02:25:05.261670+0000","last_active":"2024-09-17T02:25:05.261618+0000","last_peered":"2024-09-17T02:25:05.261618+0000","last_clean":"2024-09-17T02:25:05.261618+0000","last_became_active":"2024-09-17T02:24:30.329814+0000","last_became_peered":"2024-09-17T02:24:30.329814+0000","last_unstale":"2024-09-17T02:25:05.261618+0000","last_undegraded":"2024-09-17T02:25:05.261618+0000","last_fullsized":"2024-09-17T02:25:05.261618+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:05.261427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:05.261427+0000","last_clean_scrub_stamp":"2024-09-17T02:25:05.261427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:22.989496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233145+0000","last_change":"2024-09-17T02:24:30.319625+0000","last_active":"2024-09-17T02:24:51.233145+0000","last_peered":"2024-09-17T02:24:51.233145+0000","last_clean":"2024-09-17T02:24:51.233145+0000","last_became_active":"2024-09-17T02:24:30.319316+0000","last_became_peered":"2024-09-17T02:24:30.319316+0000","last_unstale":"2024-09-17T02:24:51.233145+0000","last_undegraded":"2024-09-17T02:24:51.233145+0000","last_fullsized":"2024-09-17T02:24:51.233145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:09.321538+0000","last_change":"2024-09-17T02:25:09.321646+0000","last_active":"2024-09-17T02:25:09.321538+0000","last_peered":"2024-09-17T02:25:09.321538+0000","last_clean":"2024-09-17T02:25:09.321538+0000","last_became_active":"2024-09-17T02:20:16.580797+0000","last_became_peered":"2024-09-17T02:20:16.580797+0000","last_unstale":"2024-09-17T02:25:09.321538+0000","last_undegraded":"2024-09-17T02:25:09.321538+0000","last_fullsized":"2024-09-17T02:25:09.321538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:09.321321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:09.321321+0000","last_clean_scrub_stamp":"2024-09-17T02:25:09.321321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:43.925855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":180,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:03.818851+0000","last_change":"2024-09-17T02:25:03.818851+0000","last_active":"2024-09-17T02:25:03.818851+0000","last_peered":"2024-09-17T02:25:03.818851+0000","last_clean":"2024-09-17T02:25:03.818851+0000","last_became_active":"2024-09-17T02:24:34.732480+0000","last_became_peered":"2024-09-17T02:24:34.732480+0000","last_unstale":"2024-09-17T02:25:03.818851+0000","last_undegraded":"2024-09-17T02:25:03.818851+0000","last_fullsized":"2024-09-17T02:25:03.818851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:03.818604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:03.818604+0000","last_clean_scrub_stamp":"2024-09-17T02:25:03.818604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:49.914513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:12.211145+0000","last_change":"2024-09-17T02:25:12.211198+0000","last_active":"2024-09-17T02:25:12.211145+0000","last_peered":"2024-09-17T02:25:12.211145+0000","last_clean":"2024-09-17T02:25:12.211145+0000","last_became_active":"2024-09-17T02:24:30.328962+0000","last_became_peered":"2024-09-17T02:24:30.328962+0000","last_unstale":"2024-09-17T02:25:12.211145+0000","last_undegraded":"2024-09-17T02:25:12.211145+0000","last_fullsized":"2024-09-17T02:25:12.211145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:12.210949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:12.210949+0000","last_clean_scrub_stamp":"2024-09-17T02:25:12.210949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:13:32.408738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":100,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:58.195812+0000","last_change":"2024-09-17T02:24:48.583870+0000","last_active":"2024-09-17T02:24:58.195812+0000","last_peered":"2024-09-17T02:24:58.195812+0000","last_clean":"2024-09-17T02:24:58.195812+0000","last_became_active":"2024-09-17T02:24:48.581418+0000","last_became_peered":"2024-09-17T02:24:48.581418+0000","last_unstale":"2024-09-17T02:24:58.195812+0000","last_undegraded":"2024-09-17T02:24:58.195812+0000","last_fullsized":"2024-09-17T02:24:58.195812+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:59.896590+0000","last_change":"2024-09-17T02:24:59.896644+0000","last_active":"2024-09-17T02:24:59.896590+0000","last_peered":"2024-09-17T02:24:59.896590+0000","last_clean":"2024-09-17T02:24:59.896590+0000","last_became_active":"2024-09-17T02:24:48.579221+0000","last_became_peered":"2024-09-17T02:24:48.579221+0000","last_unstale":"2024-09-17T02:24:59.896590+0000","last_undegraded":"2024-09-17T02:24:59.896590+0000","last_fullsized":"2024-09-17T02:24:59.896590+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:24:59.896392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:24:59.896392+0000","last_clean_scrub_stamp":"2024-09-17T02:24:59.896392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:24.475715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233778+0000","last_change":"2024-09-17T02:24:30.337132+0000","last_active":"2024-09-17T02:24:51.233778+0000","last_peered":"2024-09-17T02:24:51.233778+0000","last_clean":"2024-09-17T02:24:51.233778+0000","last_became_active":"2024-09-17T02:24:30.335871+0000","last_became_peered":"2024-09-17T02:24:30.335871+0000","last_unstale":"2024-09-17T02:24:51.233778+0000","last_undegraded":"2024-09-17T02:24:51.233778+0000","last_fullsized":"2024-09-17T02:24:51.233778+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:13.247898+0000","last_change":"2024-09-17T02:25:13.247953+0000","last_active":"2024-09-17T02:25:13.247898+0000","last_peered":"2024-09-17T02:25:13.247898+0000","last_clean":"2024-09-17T02:25:13.247898+0000","last_became_active":"2024-09-17T02:24:30.335086+0000","last_became_peered":"2024-09-17T02:24:30.335086+0000","last_unstale":"2024-09-17T02:25:13.247898+0000","last_undegraded":"2024-09-17T02:25:13.247898+0000","last_fullsized":"2024-09-17T02:25:13.247898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:13.247701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:13.247701+0000","last_clean_scrub_stamp":"2024-09-17T02:25:13.247701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:50.391158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233627+0000","last_change":"2024-09-17T02:24:30.325322+0000","last_active":"2024-09-17T02:24:51.233627+0000","last_peered":"2024-09-17T02:24:51.233627+0000","last_clean":"2024-09-17T02:24:51.233627+0000","last_became_active":"2024-09-17T02:24:30.325002+0000","last_became_peered":"2024-09-17T02:24:30.325002+0000","last_unstale":"2024-09-17T02:24:51.233627+0000","last_undegraded":"2024-09-17T02:24:51.233627+0000","last_fullsized":"2024-09-17T02:24:51.233627+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":155,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:57.666156+0000","last_change":"2024-09-17T02:20:16.563482+0000","last_active":"2024-09-17T02:24:57.666156+0000","last_peered":"2024-09-17T02:24:57.666156+0000","last_clean":"2024-09-17T02:24:57.666156+0000","last_became_active":"2024-09-17T02:20:16.562735+0000","last_became_peered":"2024-09-17T02:20:16.562735+0000","last_unstale":"2024-09-17T02:24:57.666156+0000","last_undegraded":"2024-09-17T02:24:57.666156+0000","last_fullsized":"2024-09-17T02:24:57.666156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605903+0000","last_change":"2024-09-17T02:24:48.583997+0000","last_active":"2024-09-17T02:24:51.605903+0000","last_peered":"2024-09-17T02:24:51.605903+0000","last_clean":"2024-09-17T02:24:51.605903+0000","last_became_active":"2024-09-17T02:24:48.580510+0000","last_became_peered":"2024-09-17T02:24:48.580510+0000","last_unstale":"2024-09-17T02:24:51.605903+0000","last_undegraded":"2024-09-17T02:24:51.605903+0000","last_fullsized":"2024-09-17T02:24:51.605903+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:07.258602+0000","last_change":"2024-09-17T02:25:07.258658+0000","last_active":"2024-09-17T02:25:07.258602+0000","last_peered":"2024-09-17T02:25:07.258602+0000","last_clean":"2024-09-17T02:25:07.258602+0000","last_became_active":"2024-09-17T02:20:16.586281+0000","last_became_peered":"2024-09-17T02:20:16.586281+0000","last_unstale":"2024-09-17T02:25:07.258602+0000","last_undegraded":"2024-09-17T02:25:07.258602+0000","last_fullsized":"2024-09-17T02:25:07.258602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:07.258413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:07.258413+0000","last_clean_scrub_stamp":"2024-09-17T02:25:07.258413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:03.281216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:09.215203+0000","last_change":"2024-09-17T02:25:09.215259+0000","last_active":"2024-09-17T02:25:09.215203+0000","last_peered":"2024-09-17T02:25:09.215203+0000","last_clean":"2024-09-17T02:25:09.215203+0000","last_became_active":"2024-09-17T02:24:30.329980+0000","last_became_peered":"2024-09-17T02:24:30.329980+0000","last_unstale":"2024-09-17T02:25:09.215203+0000","last_undegraded":"2024-09-17T02:25:09.215203+0000","last_fullsized":"2024-09-17T02:25:09.215203+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:09.215010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:09.215010+0000","last_clean_scrub_stamp":"2024-09-17T02:25:09.215010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:51.583841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":84,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232177+0000","last_change":"2024-09-17T02:24:34.361003+0000","last_active":"2024-09-17T02:24:51.232177+0000","last_peered":"2024-09-17T02:24:51.232177+0000","last_clean":"2024-09-17T02:24:51.232177+0000","last_became_active":"2024-09-17T02:24:34.360259+0000","last_became_peered":"2024-09-17T02:24:34.360259+0000","last_unstale":"2024-09-17T02:24:51.232177+0000","last_undegraded":"2024-09-17T02:24:51.232177+0000","last_fullsized":"2024-09-17T02:24:51.232177+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:13.968263+0000","last_change":"2024-09-17T02:25:13.968317+0000","last_active":"2024-09-17T02:25:13.968263+0000","last_peered":"2024-09-17T02:25:13.968263+0000","last_clean":"2024-09-17T02:25:13.968263+0000","last_became_active":"2024-09-17T02:24:30.700674+0000","last_became_peered":"2024-09-17T02:24:30.700674+0000","last_unstale":"2024-09-17T02:25:13.968263+0000","last_undegraded":"2024-09-17T02:25:13.968263+0000","last_fullsized":"2024-09-17T02:25:13.968263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:13.968072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:13.968072+0000","last_clean_scrub_stamp":"2024-09-17T02:25:13.968072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:48:08.926819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:59.310417+0000","last_change":"2024-09-17T02:24:59.310470+0000","last_active":"2024-09-17T02:24:59.310417+0000","last_peered":"2024-09-17T02:24:59.310417+0000","last_clean":"2024-09-17T02:24:59.310417+0000","last_became_active":"2024-09-17T02:24:30.698022+0000","last_became_peered":"2024-09-17T02:24:30.698022+0000","last_unstale":"2024-09-17T02:24:59.310417+0000","last_undegraded":"2024-09-17T02:24:59.310417+0000","last_fullsized":"2024-09-17T02:24:59.310417+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:24:59.310215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:24:59.310215+0000","last_clean_scrub_stamp":"2024-09-17T02:24:59.310215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:38.004294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:00.935719+0000","last_change":"2024-09-17T02:25:00.935861+0000","last_active":"2024-09-17T02:25:00.935719+0000","last_peered":"2024-09-17T02:25:00.935719+0000","last_clean":"2024-09-17T02:25:00.935719+0000","last_became_active":"2024-09-17T02:24:48.576615+0000","last_became_peered":"2024-09-17T02:24:48.576615+0000","last_unstale":"2024-09-17T02:25:00.935719+0000","last_undegraded":"2024-09-17T02:25:00.935719+0000","last_fullsized":"2024-09-17T02:25:00.935719+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:00.935454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:00.935454+0000","last_clean_scrub_stamp":"2024-09-17T02:25:00.935454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:50.045066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:09.991986+0000","last_change":"2024-09-17T02:25:09.992041+0000","last_active":"2024-09-17T02:25:09.991986+0000","last_peered":"2024-09-17T02:25:09.991986+0000","last_clean":"2024-09-17T02:25:09.991986+0000","last_became_active":"2024-09-17T02:24:30.703377+0000","last_became_peered":"2024-09-17T02:24:30.703377+0000","last_unstale":"2024-09-17T02:25:09.991986+0000","last_undegraded":"2024-09-17T02:25:09.991986+0000","last_fullsized":"2024-09-17T02:25:09.991986+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:09.991799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:09.991799+0000","last_clean_scrub_stamp":"2024-09-17T02:25:09.991799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:41.342890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:02.305396+0000","last_change":"2024-09-17T02:25:02.305455+0000","last_active":"2024-09-17T02:25:02.305396+0000","last_peered":"2024-09-17T02:25:02.305396+0000","last_clean":"2024-09-17T02:25:02.305396+0000","last_became_active":"2024-09-17T02:24:30.694853+0000","last_became_peered":"2024-09-17T02:24:30.694853+0000","last_unstale":"2024-09-17T02:25:02.305396+0000","last_undegraded":"2024-09-17T02:25:02.305396+0000","last_fullsized":"2024-09-17T02:25:02.305396+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:02.305186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:02.305186+0000","last_clean_scrub_stamp":"2024-09-17T02:25:02.305186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:08.436888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.235390+0000","last_change":"2024-09-17T02:24:30.339430+0000","last_active":"2024-09-17T02:24:51.235390+0000","last_peered":"2024-09-17T02:24:51.235390+0000","last_clean":"2024-09-17T02:24:51.235390+0000","last_became_active":"2024-09-17T02:24:30.338488+0000","last_became_peered":"2024-09-17T02:24:30.338488+0000","last_unstale":"2024-09-17T02:24:51.235390+0000","last_undegraded":"2024-09-17T02:24:51.235390+0000","last_fullsized":"2024-09-17T02:24:51.235390+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":100,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606333+0000","last_change":"2024-09-17T02:24:48.584148+0000","last_active":"2024-09-17T02:24:51.606333+0000","last_peered":"2024-09-17T02:24:51.606333+0000","last_clean":"2024-09-17T02:24:51.606333+0000","last_became_active":"2024-09-17T02:24:48.582959+0000","last_became_peered":"2024-09-17T02:24:48.582959+0000","last_unstale":"2024-09-17T02:24:51.606333+0000","last_undegraded":"2024-09-17T02:24:51.606333+0000","last_fullsized":"2024-09-17T02:24:51.606333+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276848+0000","last_change":"2024-09-17T02:24:34.734388+0000","last_active":"2024-09-17T02:24:52.276848+0000","last_peered":"2024-09-17T02:24:52.276848+0000","last_clean":"2024-09-17T02:24:52.276848+0000","last_became_active":"2024-09-17T02:24:34.733451+0000","last_became_peered":"2024-09-17T02:24:34.733451+0000","last_unstale":"2024-09-17T02:24:52.276848+0000","last_undegraded":"2024-09-17T02:24:52.276848+0000","last_fullsized":"2024-09-17T02:24:52.276848+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:15.902965+0000","last_change":"2024-09-17T02:25:15.903018+0000","last_active":"2024-09-17T02:25:15.902965+0000","last_peered":"2024-09-17T02:25:15.902965+0000","last_clean":"2024-09-17T02:25:15.902965+0000","last_became_active":"2024-09-17T02:24:30.699410+0000","last_became_peered":"2024-09-17T02:24:30.699410+0000","last_unstale":"2024-09-17T02:25:15.902965+0000","last_undegraded":"2024-09-17T02:25:15.902965+0000","last_fullsized":"2024-09-17T02:25:15.902965+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:15.902767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:15.902767+0000","last_clean_scrub_stamp":"2024-09-17T02:25:15.902767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:31:24.622051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275718+0000","last_change":"2024-09-17T02:24:34.727144+0000","last_active":"2024-09-17T02:24:52.275718+0000","last_peered":"2024-09-17T02:24:52.275718+0000","last_clean":"2024-09-17T02:24:52.275718+0000","last_became_active":"2024-09-17T02:24:34.725109+0000","last_became_peered":"2024-09-17T02:24:34.725109+0000","last_unstale":"2024-09-17T02:24:52.275718+0000","last_undegraded":"2024-09-17T02:24:52.275718+0000","last_fullsized":"2024-09-17T02:24:52.275718+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":84,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232256+0000","last_change":"2024-09-17T02:24:34.357265+0000","last_active":"2024-09-17T02:24:51.232256+0000","last_peered":"2024-09-17T02:24:51.232256+0000","last_clean":"2024-09-17T02:24:51.232256+0000","last_became_active":"2024-09-17T02:24:34.356639+0000","last_became_peered":"2024-09-17T02:24:34.356639+0000","last_unstale":"2024-09-17T02:24:51.232256+0000","last_undegraded":"2024-09-17T02:24:51.232256+0000","last_fullsized":"2024-09-17T02:24:51.232256+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":100,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:58.195524+0000","last_change":"2024-09-17T02:24:48.583278+0000","last_active":"2024-09-17T02:24:58.195524+0000","last_peered":"2024-09-17T02:24:58.195524+0000","last_clean":"2024-09-17T02:24:58.195524+0000","last_became_active":"2024-09-17T02:24:48.581121+0000","last_became_peered":"2024-09-17T02:24:48.581121+0000","last_unstale":"2024-09-17T02:24:58.195524+0000","last_undegraded":"2024-09-17T02:24:58.195524+0000","last_fullsized":"2024-09-17T02:24:58.195524+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"90'4","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:10.194097+0000","last_change":"2024-09-17T02:25:10.194165+0000","last_active":"2024-09-17T02:25:10.194097+0000","last_peered":"2024-09-17T02:25:10.194097+0000","last_clean":"2024-09-17T02:25:10.194097+0000","last_became_active":"2024-09-17T02:24:30.328907+0000","last_became_peered":"2024-09-17T02:24:30.328907+0000","last_unstale":"2024-09-17T02:25:10.194097+0000","last_undegraded":"2024-09-17T02:25:10.194097+0000","last_fullsized":"2024-09-17T02:25:10.194097+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'4","last_scrub_stamp":"2024-09-17T02:25:10.193903+0000","last_deep_scrub":"90'4","last_deep_scrub_stamp":"2024-09-17T02:25:10.193903+0000","last_clean_scrub_stamp":"2024-09-17T02:25:10.193903+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:29:40.998156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":180,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:05.877418+0000","last_change":"2024-09-17T02:25:05.877418+0000","last_active":"2024-09-17T02:25:05.877418+0000","last_peered":"2024-09-17T02:25:05.877418+0000","last_clean":"2024-09-17T02:25:05.877418+0000","last_became_active":"2024-09-17T02:24:34.731598+0000","last_became_peered":"2024-09-17T02:24:34.731598+0000","last_unstale":"2024-09-17T02:25:05.877418+0000","last_undegraded":"2024-09-17T02:25:05.877418+0000","last_fullsized":"2024-09-17T02:25:05.877418+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:05.877170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:05.877170+0000","last_clean_scrub_stamp":"2024-09-17T02:25:05.877170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:03.124916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275309+0000","last_change":"2024-09-17T02:24:34.730124+0000","last_active":"2024-09-17T02:24:52.275309+0000","last_peered":"2024-09-17T02:24:52.275309+0000","last_clean":"2024-09-17T02:24:52.275309+0000","last_became_active":"2024-09-17T02:24:34.727345+0000","last_became_peered":"2024-09-17T02:24:34.727345+0000","last_unstale":"2024-09-17T02:24:52.275309+0000","last_undegraded":"2024-09-17T02:24:52.275309+0000","last_fullsized":"2024-09-17T02:24:52.275309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275361+0000","last_change":"2024-09-17T02:24:34.731057+0000","last_active":"2024-09-17T02:24:52.275361+0000","last_peered":"2024-09-17T02:24:52.275361+0000","last_clean":"2024-09-17T02:24:52.275361+0000","last_became_active":"2024-09-17T02:24:34.730285+0000","last_became_peered":"2024-09-17T02:24:34.730285+0000","last_unstale":"2024-09-17T02:24:52.275361+0000","last_undegraded":"2024-09-17T02:24:52.275361+0000","last_fullsized":"2024-09-17T02:24:52.275361+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":172,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:11.946956+0000","last_change":"2024-09-17T02:25:11.947010+0000","last_active":"2024-09-17T02:25:11.946956+0000","last_peered":"2024-09-17T02:25:11.946956+0000","last_clean":"2024-09-17T02:25:11.946956+0000","last_became_active":"2024-09-17T02:24:30.701047+0000","last_became_peered":"2024-09-17T02:24:30.701047+0000","last_unstale":"2024-09-17T02:25:11.946956+0000","last_undegraded":"2024-09-17T02:25:11.946956+0000","last_fullsized":"2024-09-17T02:25:11.946956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:11.946765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:11.946765+0000","last_clean_scrub_stamp":"2024-09-17T02:25:11.946765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:54:32.006823+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:10.314479+0000","last_change":"2024-09-17T02:25:10.314581+0000","last_active":"2024-09-17T02:25:10.314479+0000","last_peered":"2024-09-17T02:25:10.314479+0000","last_clean":"2024-09-17T02:25:10.314479+0000","last_became_active":"2024-09-17T02:24:30.697606+0000","last_became_peered":"2024-09-17T02:24:30.697606+0000","last_unstale":"2024-09-17T02:25:10.314479+0000","last_undegraded":"2024-09-17T02:25:10.314479+0000","last_fullsized":"2024-09-17T02:25:10.314479+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:10.314245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:10.314245+0000","last_clean_scrub_stamp":"2024-09-17T02:25:10.314245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:53.862909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"90'12","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:15.249888+0000","last_change":"2024-09-17T02:25:15.249969+0000","last_active":"2024-09-17T02:25:15.249888+0000","last_peered":"2024-09-17T02:25:15.249888+0000","last_clean":"2024-09-17T02:25:15.249888+0000","last_became_active":"2024-09-17T02:24:30.336326+0000","last_became_peered":"2024-09-17T02:24:30.336326+0000","last_unstale":"2024-09-17T02:25:15.249888+0000","last_undegraded":"2024-09-17T02:25:15.249888+0000","last_fullsized":"2024-09-17T02:25:15.249888+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'12","last_scrub_stamp":"2024-09-17T02:25:15.249685+0000","last_deep_scrub":"90'12","last_deep_scrub_stamp":"2024-09-17T02:25:15.249685+0000","last_clean_scrub_stamp":"2024-09-17T02:25:15.249685+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:49.723714+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.236348+0000","last_change":"2024-09-17T02:24:30.336771+0000","last_active":"2024-09-17T02:24:51.236348+0000","last_peered":"2024-09-17T02:24:51.236348+0000","last_clean":"2024-09-17T02:24:51.236348+0000","last_became_active":"2024-09-17T02:24:30.336494+0000","last_became_peered":"2024-09-17T02:24:30.336494+0000","last_unstale":"2024-09-17T02:24:51.236348+0000","last_undegraded":"2024-09-17T02:24:51.236348+0000","last_fullsized":"2024-09-17T02:24:51.236348+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":100,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604356+0000","last_change":"2024-09-17T02:24:48.583894+0000","last_active":"2024-09-17T02:24:51.604356+0000","last_peered":"2024-09-17T02:24:51.604356+0000","last_clean":"2024-09-17T02:24:51.604356+0000","last_became_active":"2024-09-17T02:24:48.580644+0000","last_became_peered":"2024-09-17T02:24:48.580644+0000","last_unstale":"2024-09-17T02:24:51.604356+0000","last_undegraded":"2024-09-17T02:24:51.604356+0000","last_fullsized":"2024-09-17T02:24:51.604356+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":166,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.606218+0000","last_change":"2024-09-17T02:24:30.697584+0000","last_active":"2024-09-17T02:24:51.606218+0000","last_peered":"2024-09-17T02:24:51.606218+0000","last_clean":"2024-09-17T02:24:51.606218+0000","last_became_active":"2024-09-17T02:24:30.695140+0000","last_became_peered":"2024-09-17T02:24:30.695140+0000","last_unstale":"2024-09-17T02:24:51.606218+0000","last_undegraded":"2024-09-17T02:24:51.606218+0000","last_fullsized":"2024-09-17T02:24:51.606218+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:02.863642+0000","last_change":"2024-09-17T02:25:02.863694+0000","last_active":"2024-09-17T02:25:02.863642+0000","last_peered":"2024-09-17T02:25:02.863642+0000","last_clean":"2024-09-17T02:25:02.863642+0000","last_became_active":"2024-09-17T02:24:48.576802+0000","last_became_peered":"2024-09-17T02:24:48.576802+0000","last_unstale":"2024-09-17T02:25:02.863642+0000","last_undegraded":"2024-09-17T02:25:02.863642+0000","last_fullsized":"2024-09-17T02:25:02.863642+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:02.863442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:02.863442+0000","last_clean_scrub_stamp":"2024-09-17T02:25:02.863442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:56.499968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"90'2","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:00.398272+0000","last_change":"2024-09-17T02:25:00.398374+0000","last_active":"2024-09-17T02:25:00.398272+0000","last_peered":"2024-09-17T02:25:00.398272+0000","last_clean":"2024-09-17T02:25:00.398272+0000","last_became_active":"2024-09-17T02:24:30.337650+0000","last_became_peered":"2024-09-17T02:24:30.337650+0000","last_unstale":"2024-09-17T02:25:00.398272+0000","last_undegraded":"2024-09-17T02:25:00.398272+0000","last_fullsized":"2024-09-17T02:25:00.398272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'2","last_scrub_stamp":"2024-09-17T02:25:00.398087+0000","last_deep_scrub":"90'2","last_deep_scrub_stamp":"2024-09-17T02:25:00.398087+0000","last_clean_scrub_stamp":"2024-09-17T02:25:00.398087+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:21.031278+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.234193+0000","last_change":"2024-09-17T02:24:30.322785+0000","last_active":"2024-09-17T02:24:51.234193+0000","last_peered":"2024-09-17T02:24:51.234193+0000","last_clean":"2024-09-17T02:24:51.234193+0000","last_became_active":"2024-09-17T02:24:30.322509+0000","last_became_peered":"2024-09-17T02:24:30.322509+0000","last_unstale":"2024-09-17T02:24:51.234193+0000","last_undegraded":"2024-09-17T02:24:51.234193+0000","last_fullsized":"2024-09-17T02:24:51.234193+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:06.267648+0000","last_change":"2024-09-17T02:25:06.267700+0000","last_active":"2024-09-17T02:25:06.267648+0000","last_peered":"2024-09-17T02:25:06.267648+0000","last_clean":"2024-09-17T02:25:06.267648+0000","last_became_active":"2024-09-17T02:24:30.329642+0000","last_became_peered":"2024-09-17T02:24:30.329642+0000","last_unstale":"2024-09-17T02:25:06.267648+0000","last_undegraded":"2024-09-17T02:25:06.267648+0000","last_fullsized":"2024-09-17T02:25:06.267648+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:06.267455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:06.267455+0000","last_clean_scrub_stamp":"2024-09-17T02:25:06.267455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:29.921715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:12.297233+0000","last_change":"2024-09-17T02:25:12.297293+0000","last_active":"2024-09-17T02:25:12.297233+0000","last_peered":"2024-09-17T02:25:12.297233+0000","last_clean":"2024-09-17T02:25:12.297233+0000","last_became_active":"2024-09-17T02:24:30.697800+0000","last_became_peered":"2024-09-17T02:24:30.697800+0000","last_unstale":"2024-09-17T02:25:12.297233+0000","last_undegraded":"2024-09-17T02:25:12.297233+0000","last_fullsized":"2024-09-17T02:25:12.297233+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:12.297041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:12.297041+0000","last_clean_scrub_stamp":"2024-09-17T02:25:12.297041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:06.128273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"90'3","reported_seq":175,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:06.281828+0000","last_change":"2024-09-17T02:25:06.281978+0000","last_active":"2024-09-17T02:25:06.281828+0000","last_peered":"2024-09-17T02:25:06.281828+0000","last_clean":"2024-09-17T02:25:06.281828+0000","last_became_active":"2024-09-17T02:24:30.696079+0000","last_became_peered":"2024-09-17T02:24:30.696079+0000","last_unstale":"2024-09-17T02:25:06.281828+0000","last_undegraded":"2024-09-17T02:25:06.281828+0000","last_fullsized":"2024-09-17T02:25:06.281828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'3","last_scrub_stamp":"2024-09-17T02:25:06.281589+0000","last_deep_scrub":"90'3","last_deep_scrub_stamp":"2024-09-17T02:25:06.281589+0000","last_clean_scrub_stamp":"2024-09-17T02:25:06.281589+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:32.019870+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:07.221991+0000","last_change":"2024-09-17T02:25:07.222041+0000","last_active":"2024-09-17T02:25:07.221991+0000","last_peered":"2024-09-17T02:25:07.221991+0000","last_clean":"2024-09-17T02:25:07.221991+0000","last_became_active":"2024-09-17T02:24:30.329676+0000","last_became_peered":"2024-09-17T02:24:30.329676+0000","last_unstale":"2024-09-17T02:25:07.221991+0000","last_undegraded":"2024-09-17T02:25:07.221991+0000","last_fullsized":"2024-09-17T02:25:07.221991+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:07.221798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:07.221798+0000","last_clean_scrub_stamp":"2024-09-17T02:25:07.221798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:14:23.338414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232229+0000","last_change":"2024-09-17T02:24:34.360950+0000","last_active":"2024-09-17T02:24:51.232229+0000","last_peered":"2024-09-17T02:24:51.232229+0000","last_clean":"2024-09-17T02:24:51.232229+0000","last_became_active":"2024-09-17T02:24:34.360020+0000","last_became_peered":"2024-09-17T02:24:34.360020+0000","last_unstale":"2024-09-17T02:24:51.232229+0000","last_undegraded":"2024-09-17T02:24:51.232229+0000","last_fullsized":"2024-09-17T02:24:51.232229+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:04.283675+0000","last_change":"2024-09-17T02:25:04.283726+0000","last_active":"2024-09-17T02:25:04.283675+0000","last_peered":"2024-09-17T02:25:04.283675+0000","last_clean":"2024-09-17T02:25:04.283675+0000","last_became_active":"2024-09-17T02:24:30.336902+0000","last_became_peered":"2024-09-17T02:24:30.336902+0000","last_unstale":"2024-09-17T02:25:04.283675+0000","last_undegraded":"2024-09-17T02:25:04.283675+0000","last_fullsized":"2024-09-17T02:25:04.283675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:04.283494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:04.283494+0000","last_clean_scrub_stamp":"2024-09-17T02:25:04.283494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:00.955796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":110,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:04.847001+0000","last_change":"2024-09-17T02:25:04.847108+0000","last_active":"2024-09-17T02:25:04.847001+0000","last_peered":"2024-09-17T02:25:04.847001+0000","last_clean":"2024-09-17T02:25:04.847001+0000","last_became_active":"2024-09-17T02:24:48.578461+0000","last_became_peered":"2024-09-17T02:24:48.578461+0000","last_unstale":"2024-09-17T02:25:04.847001+0000","last_undegraded":"2024-09-17T02:25:04.847001+0000","last_fullsized":"2024-09-17T02:25:04.847001+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:04.846785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:04.846785+0000","last_clean_scrub_stamp":"2024-09-17T02:25:04.846785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:20.535184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:16.287575+0000","last_change":"2024-09-17T02:25:16.287681+0000","last_active":"2024-09-17T02:25:16.287575+0000","last_peered":"2024-09-17T02:25:16.287575+0000","last_clean":"2024-09-17T02:25:16.287575+0000","last_became_active":"2024-09-17T02:24:30.326227+0000","last_became_peered":"2024-09-17T02:24:30.326227+0000","last_unstale":"2024-09-17T02:25:16.287575+0000","last_undegraded":"2024-09-17T02:25:16.287575+0000","last_fullsized":"2024-09-17T02:25:16.287575+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:16.287353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:16.287353+0000","last_clean_scrub_stamp":"2024-09-17T02:25:16.287353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:53.879613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:14.921637+0000","last_change":"2024-09-17T02:25:14.921700+0000","last_active":"2024-09-17T02:25:14.921637+0000","last_peered":"2024-09-17T02:25:14.921637+0000","last_clean":"2024-09-17T02:25:14.921637+0000","last_became_active":"2024-09-17T02:24:48.578678+0000","last_became_peered":"2024-09-17T02:24:48.578678+0000","last_unstale":"2024-09-17T02:25:14.921637+0000","last_undegraded":"2024-09-17T02:25:14.921637+0000","last_fullsized":"2024-09-17T02:25:14.921637+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:14.921419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:14.921419+0000","last_clean_scrub_stamp":"2024-09-17T02:25:14.921419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:58.989777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:11.282812+0000","last_change":"2024-09-17T02:25:11.282869+0000","last_active":"2024-09-17T02:25:11.282812+0000","last_peered":"2024-09-17T02:25:11.282812+0000","last_clean":"2024-09-17T02:25:11.282812+0000","last_became_active":"2024-09-17T02:20:16.582326+0000","last_became_peered":"2024-09-17T02:20:16.582326+0000","last_unstale":"2024-09-17T02:25:11.282812+0000","last_undegraded":"2024-09-17T02:25:11.282812+0000","last_fullsized":"2024-09-17T02:25:11.282812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:11.282597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:11.282597+0000","last_clean_scrub_stamp":"2024-09-17T02:25:11.282597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:23.345943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"90'159","reported_seq":247,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:01.368517+0000","last_change":"2024-09-17T02:25:01.368592+0000","last_active":"2024-09-17T02:25:01.368517+0000","last_peered":"2024-09-17T02:25:01.368517+0000","last_clean":"2024-09-17T02:25:01.368517+0000","last_became_active":"2024-09-17T02:24:30.338214+0000","last_became_peered":"2024-09-17T02:24:30.338214+0000","last_unstale":"2024-09-17T02:25:01.368517+0000","last_undegraded":"2024-09-17T02:25:01.368517+0000","last_fullsized":"2024-09-17T02:25:01.368517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'159","last_scrub_stamp":"2024-09-17T02:25:01.368320+0000","last_deep_scrub":"90'159","last_deep_scrub_stamp":"2024-09-17T02:25:01.368320+0000","last_clean_scrub_stamp":"2024-09-17T02:25:01.368320+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:05.158992+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233861+0000","last_change":"2024-09-17T02:24:30.325326+0000","last_active":"2024-09-17T02:24:51.233861+0000","last_peered":"2024-09-17T02:24:51.233861+0000","last_clean":"2024-09-17T02:24:51.233861+0000","last_became_active":"2024-09-17T02:24:30.324910+0000","last_became_peered":"2024-09-17T02:24:30.324910+0000","last_unstale":"2024-09-17T02:24:51.233861+0000","last_undegraded":"2024-09-17T02:24:51.233861+0000","last_fullsized":"2024-09-17T02:24:51.233861+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":157,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277003+0000","last_change":"2024-09-17T02:20:15.560646+0000","last_active":"2024-09-17T02:24:52.277003+0000","last_peered":"2024-09-17T02:24:52.277003+0000","last_clean":"2024-09-17T02:24:52.277003+0000","last_became_active":"2024-09-17T02:20:15.559104+0000","last_became_peered":"2024-09-17T02:20:15.559104+0000","last_unstale":"2024-09-17T02:24:52.277003+0000","last_undegraded":"2024-09-17T02:24:52.277003+0000","last_fullsized":"2024-09-17T02:24:52.277003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:59.404645+0000","last_change":"2024-09-17T02:24:59.404701+0000","last_active":"2024-09-17T02:24:59.404645+0000","last_peered":"2024-09-17T02:24:59.404645+0000","last_clean":"2024-09-17T02:24:59.404645+0000","last_became_active":"2024-09-17T02:24:30.337415+0000","last_became_peered":"2024-09-17T02:24:30.337415+0000","last_unstale":"2024-09-17T02:24:59.404645+0000","last_undegraded":"2024-09-17T02:24:59.404645+0000","last_fullsized":"2024-09-17T02:24:59.404645+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:24:59.404458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:24:59.404458+0000","last_clean_scrub_stamp":"2024-09-17T02:24:59.404458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:16.350126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:02.319892+0000","last_change":"2024-09-17T02:25:02.319983+0000","last_active":"2024-09-17T02:25:02.319892+0000","last_peered":"2024-09-17T02:25:02.319892+0000","last_clean":"2024-09-17T02:25:02.319892+0000","last_became_active":"2024-09-17T02:24:30.338024+0000","last_became_peered":"2024-09-17T02:24:30.338024+0000","last_unstale":"2024-09-17T02:25:02.319892+0000","last_undegraded":"2024-09-17T02:25:02.319892+0000","last_fullsized":"2024-09-17T02:25:02.319892+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:02.319658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:02.319658+0000","last_clean_scrub_stamp":"2024-09-17T02:25:02.319658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:39.604266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":172,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:01.327000+0000","last_change":"2024-09-17T02:25:01.327132+0000","last_active":"2024-09-17T02:25:01.327000+0000","last_peered":"2024-09-17T02:25:01.327000+0000","last_clean":"2024-09-17T02:25:01.327000+0000","last_became_active":"2024-09-17T02:24:30.693653+0000","last_became_peered":"2024-09-17T02:24:30.693653+0000","last_unstale":"2024-09-17T02:25:01.327000+0000","last_undegraded":"2024-09-17T02:25:01.327000+0000","last_fullsized":"2024-09-17T02:25:01.327000+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:01.326768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:01.326768+0000","last_clean_scrub_stamp":"2024-09-17T02:25:01.326768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:42.223815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":155,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605881+0000","last_change":"2024-09-17T02:20:16.571568+0000","last_active":"2024-09-17T02:24:51.605881+0000","last_peered":"2024-09-17T02:24:51.605881+0000","last_clean":"2024-09-17T02:24:51.605881+0000","last_became_active":"2024-09-17T02:20:16.570622+0000","last_became_peered":"2024-09-17T02:20:16.570622+0000","last_unstale":"2024-09-17T02:24:51.605881+0000","last_undegraded":"2024-09-17T02:24:51.605881+0000","last_fullsized":"2024-09-17T02:24:51.605881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276606+0000","last_change":"2024-09-17T02:20:12.511823+0000","last_active":"2024-09-17T02:24:52.276606+0000","last_peered":"2024-09-17T02:24:52.276606+0000","last_clean":"2024-09-17T02:24:52.276606+0000","last_became_active":"2024-09-17T02:20:10.497164+0000","last_became_peered":"2024-09-17T02:20:10.497164+0000","last_unstale":"2024-09-17T02:24:52.276606+0000","last_undegraded":"2024-09-17T02:24:52.276606+0000","last_fullsized":"2024-09-17T02:24:52.276606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:09.475290+0000","last_clean_scrub_stamp":"2024-09-17T02:20:09.475290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081052700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":102,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604635+0000","last_change":"2024-09-17T02:24:48.585305+0000","last_active":"2024-09-17T02:24:51.604635+0000","last_peered":"2024-09-17T02:24:51.604635+0000","last_clean":"2024-09-17T02:24:51.604635+0000","last_became_active":"2024-09-17T02:24:48.582729+0000","last_became_peered":"2024-09-17T02:24:48.582729+0000","last_unstale":"2024-09-17T02:24:51.604635+0000","last_undegraded":"2024-09-17T02:24:51.604635+0000","last_fullsized":"2024-09-17T02:24:51.604635+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277752+0000","last_change":"2024-09-17T02:24:34.730636+0000","last_active":"2024-09-17T02:24:52.277752+0000","last_peered":"2024-09-17T02:24:52.277752+0000","last_clean":"2024-09-17T02:24:52.277752+0000","last_became_active":"2024-09-17T02:24:34.729890+0000","last_became_peered":"2024-09-17T02:24:34.729890+0000","last_unstale":"2024-09-17T02:24:52.277752+0000","last_undegraded":"2024-09-17T02:24:52.277752+0000","last_fullsized":"2024-09-17T02:24:52.277752+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"90'3","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:11.216424+0000","last_change":"2024-09-17T02:25:11.216495+0000","last_active":"2024-09-17T02:25:11.216424+0000","last_peered":"2024-09-17T02:25:11.216424+0000","last_clean":"2024-09-17T02:25:11.216424+0000","last_became_active":"2024-09-17T02:24:30.333005+0000","last_became_peered":"2024-09-17T02:24:30.333005+0000","last_unstale":"2024-09-17T02:25:11.216424+0000","last_undegraded":"2024-09-17T02:25:11.216424+0000","last_fullsized":"2024-09-17T02:25:11.216424+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'3","last_scrub_stamp":"2024-09-17T02:25:11.216230+0000","last_deep_scrub":"90'3","last_deep_scrub_stamp":"2024-09-17T02:25:11.216230+0000","last_clean_scrub_stamp":"2024-09-17T02:25:11.216230+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:27.744924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00078085399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:08.184509+0000","last_change":"2024-09-17T02:25:08.184560+0000","last_active":"2024-09-17T02:25:08.184509+0000","last_peered":"2024-09-17T02:25:08.184509+0000","last_clean":"2024-09-17T02:25:08.184509+0000","last_became_active":"2024-09-17T02:24:30.329213+0000","last_became_peered":"2024-09-17T02:24:30.329213+0000","last_unstale":"2024-09-17T02:25:08.184509+0000","last_undegraded":"2024-09-17T02:25:08.184509+0000","last_fullsized":"2024-09-17T02:25:08.184509+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:08.184321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:08.184321+0000","last_clean_scrub_stamp":"2024-09-17T02:25:08.184321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:12.352461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:13.345857+0000","last_change":"2024-09-17T02:25:13.345962+0000","last_active":"2024-09-17T02:25:13.345857+0000","last_peered":"2024-09-17T02:25:13.345857+0000","last_clean":"2024-09-17T02:25:13.345857+0000","last_became_active":"2024-09-17T02:20:16.578343+0000","last_became_peered":"2024-09-17T02:20:16.578343+0000","last_unstale":"2024-09-17T02:25:13.345857+0000","last_undegraded":"2024-09-17T02:25:13.345857+0000","last_fullsized":"2024-09-17T02:25:13.345857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:13.345627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:13.345627+0000","last_clean_scrub_stamp":"2024-09-17T02:25:13.345627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:58.839133+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232217+0000","last_change":"2024-09-17T02:24:34.354157+0000","last_active":"2024-09-17T02:24:51.232217+0000","last_peered":"2024-09-17T02:24:51.232217+0000","last_clean":"2024-09-17T02:24:51.232217+0000","last_became_active":"2024-09-17T02:24:34.353619+0000","last_became_peered":"2024-09-17T02:24:34.353619+0000","last_unstale":"2024-09-17T02:24:51.232217+0000","last_undegraded":"2024-09-17T02:24:51.232217+0000","last_fullsized":"2024-09-17T02:24:51.232217+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":178,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:16.321973+0000","last_change":"2024-09-17T02:25:16.322027+0000","last_active":"2024-09-17T02:25:16.321973+0000","last_peered":"2024-09-17T02:25:16.321973+0000","last_clean":"2024-09-17T02:25:16.321973+0000","last_became_active":"2024-09-17T02:20:10.497049+0000","last_became_peered":"2024-09-17T02:20:10.497049+0000","last_unstale":"2024-09-17T02:25:16.321973+0000","last_undegraded":"2024-09-17T02:25:16.321973+0000","last_fullsized":"2024-09-17T02:25:16.321973+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:16.321782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:16.321782+0000","last_clean_scrub_stamp":"2024-09-17T02:25:16.321782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:31.283536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00079701100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604719+0000","last_change":"2024-09-17T02:24:30.698392+0000","last_active":"2024-09-17T02:24:51.604719+0000","last_peered":"2024-09-17T02:24:51.604719+0000","last_clean":"2024-09-17T02:24:51.604719+0000","last_became_active":"2024-09-17T02:24:30.694944+0000","last_became_peered":"2024-09-17T02:24:30.694944+0000","last_unstale":"2024-09-17T02:24:51.604719+0000","last_undegraded":"2024-09-17T02:24:51.604719+0000","last_fullsized":"2024-09-17T02:24:51.604719+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":157,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.277603+0000","last_change":"2024-09-17T02:20:15.559252+0000","last_active":"2024-09-17T02:24:52.277603+0000","last_peered":"2024-09-17T02:24:52.277603+0000","last_clean":"2024-09-17T02:24:52.277603+0000","last_became_active":"2024-09-17T02:20:15.557667+0000","last_became_peered":"2024-09-17T02:20:15.557667+0000","last_unstale":"2024-09-17T02:24:52.277603+0000","last_undegraded":"2024-09-17T02:24:52.277603+0000","last_fullsized":"2024-09-17T02:24:52.277603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":178,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:16.916554+0000","last_change":"2024-09-17T02:25:16.916608+0000","last_active":"2024-09-17T02:25:16.916554+0000","last_peered":"2024-09-17T02:25:16.916554+0000","last_clean":"2024-09-17T02:25:16.916554+0000","last_became_active":"2024-09-17T02:20:10.497829+0000","last_became_peered":"2024-09-17T02:20:10.497829+0000","last_unstale":"2024-09-17T02:25:16.916554+0000","last_undegraded":"2024-09-17T02:25:16.916554+0000","last_fullsized":"2024-09-17T02:25:16.916554+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:16.916364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:16.916364+0000","last_clean_scrub_stamp":"2024-09-17T02:25:16.916364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:44.325268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00096944700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":100,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.605521+0000","last_change":"2024-09-17T02:24:48.581467+0000","last_active":"2024-09-17T02:24:51.605521+0000","last_peered":"2024-09-17T02:24:51.605521+0000","last_clean":"2024-09-17T02:24:51.605521+0000","last_became_active":"2024-09-17T02:24:48.580388+0000","last_became_peered":"2024-09-17T02:24:48.580388+0000","last_unstale":"2024-09-17T02:24:51.605521+0000","last_undegraded":"2024-09-17T02:24:51.605521+0000","last_fullsized":"2024-09-17T02:24:51.605521+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":159,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278405+0000","last_change":"2024-09-17T02:20:15.558961+0000","last_active":"2024-09-17T02:24:52.278405+0000","last_peered":"2024-09-17T02:24:52.278405+0000","last_clean":"2024-09-17T02:24:52.278405+0000","last_became_active":"2024-09-17T02:20:15.558299+0000","last_became_peered":"2024-09-17T02:20:15.558299+0000","last_unstale":"2024-09-17T02:24:52.278405+0000","last_undegraded":"2024-09-17T02:24:52.278405+0000","last_fullsized":"2024-09-17T02:24:52.278405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":178,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:17.366816+0000","last_change":"2024-09-17T02:25:17.366873+0000","last_active":"2024-09-17T02:25:17.366816+0000","last_peered":"2024-09-17T02:25:17.366816+0000","last_clean":"2024-09-17T02:25:17.366816+0000","last_became_active":"2024-09-17T02:20:10.497021+0000","last_became_peered":"2024-09-17T02:20:10.497021+0000","last_unstale":"2024-09-17T02:25:17.366816+0000","last_undegraded":"2024-09-17T02:25:17.366816+0000","last_fullsized":"2024-09-17T02:25:17.366816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:17.366624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:17.366624+0000","last_clean_scrub_stamp":"2024-09-17T02:25:17.366624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:15:13.680596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001400079,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:05.297242+0000","last_change":"2024-09-17T02:25:05.297294+0000","last_active":"2024-09-17T02:25:05.297242+0000","last_peered":"2024-09-17T02:25:05.297242+0000","last_clean":"2024-09-17T02:25:05.297242+0000","last_became_active":"2024-09-17T02:24:30.691331+0000","last_became_peered":"2024-09-17T02:24:30.691331+0000","last_unstale":"2024-09-17T02:25:05.297242+0000","last_undegraded":"2024-09-17T02:25:05.297242+0000","last_fullsized":"2024-09-17T02:25:05.297242+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:05.297043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:05.297043+0000","last_clean_scrub_stamp":"2024-09-17T02:25:05.297043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:43.402150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"90'2","reported_seq":174,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:03.302542+0000","last_change":"2024-09-17T02:25:03.302610+0000","last_active":"2024-09-17T02:25:03.302542+0000","last_peered":"2024-09-17T02:25:03.302542+0000","last_clean":"2024-09-17T02:25:03.302542+0000","last_became_active":"2024-09-17T02:24:30.691770+0000","last_became_peered":"2024-09-17T02:24:30.691770+0000","last_unstale":"2024-09-17T02:25:03.302542+0000","last_undegraded":"2024-09-17T02:25:03.302542+0000","last_fullsized":"2024-09-17T02:25:03.302542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'2","last_scrub_stamp":"2024-09-17T02:25:03.302331+0000","last_deep_scrub":"90'2","last_deep_scrub_stamp":"2024-09-17T02:25:03.302331+0000","last_clean_scrub_stamp":"2024-09-17T02:25:03.302331+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:38.712721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:17.330401+0000","last_change":"2024-09-17T02:25:17.330456+0000","last_active":"2024-09-17T02:25:17.330401+0000","last_peered":"2024-09-17T02:25:17.330401+0000","last_clean":"2024-09-17T02:25:17.330401+0000","last_became_active":"2024-09-17T02:24:30.336110+0000","last_became_peered":"2024-09-17T02:24:30.336110+0000","last_unstale":"2024-09-17T02:25:17.330401+0000","last_undegraded":"2024-09-17T02:25:17.330401+0000","last_fullsized":"2024-09-17T02:25:17.330401+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:17.330188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:17.330188+0000","last_clean_scrub_stamp":"2024-09-17T02:25:17.330188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:06.083334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.604474+0000","last_change":"2024-09-17T02:24:30.700777+0000","last_active":"2024-09-17T02:24:51.604474+0000","last_peered":"2024-09-17T02:24:51.604474+0000","last_clean":"2024-09-17T02:24:51.604474+0000","last_became_active":"2024-09-17T02:24:30.696731+0000","last_became_peered":"2024-09-17T02:24:30.696731+0000","last_unstale":"2024-09-17T02:24:51.604474+0000","last_undegraded":"2024-09-17T02:24:51.604474+0000","last_fullsized":"2024-09-17T02:24:51.604474+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:18.285054+0000","last_change":"2024-09-17T02:25:18.285108+0000","last_active":"2024-09-17T02:25:18.285054+0000","last_peered":"2024-09-17T02:25:18.285054+0000","last_clean":"2024-09-17T02:25:18.285054+0000","last_became_active":"2024-09-17T02:24:30.325752+0000","last_became_peered":"2024-09-17T02:24:30.325752+0000","last_unstale":"2024-09-17T02:25:18.285054+0000","last_undegraded":"2024-09-17T02:25:18.285054+0000","last_fullsized":"2024-09-17T02:25:18.285054+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:18.284870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:18.284870+0000","last_clean_scrub_stamp":"2024-09-17T02:25:18.284870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:45:27.908952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233608+0000","last_change":"2024-09-17T02:24:30.325924+0000","last_active":"2024-09-17T02:24:51.233608+0000","last_peered":"2024-09-17T02:24:51.233608+0000","last_clean":"2024-09-17T02:24:51.233608+0000","last_became_active":"2024-09-17T02:24:30.325688+0000","last_became_peered":"2024-09-17T02:24:30.325688+0000","last_unstale":"2024-09-17T02:24:51.233608+0000","last_undegraded":"2024-09-17T02:24:51.233608+0000","last_fullsized":"2024-09-17T02:24:51.233608+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.276177+0000","last_change":"2024-09-17T02:24:34.731288+0000","last_active":"2024-09-17T02:24:52.276177+0000","last_peered":"2024-09-17T02:24:52.276177+0000","last_clean":"2024-09-17T02:24:52.276177+0000","last_became_active":"2024-09-17T02:24:34.730386+0000","last_became_peered":"2024-09-17T02:24:34.730386+0000","last_unstale":"2024-09-17T02:24:52.276177+0000","last_undegraded":"2024-09-17T02:24:52.276177+0000","last_fullsized":"2024-09-17T02:24:52.276177+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"90'5","reported_seq":115,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:58.864241+0000","last_change":"2024-09-17T02:24:58.864241+0000","last_active":"2024-09-17T02:24:58.864241+0000","last_peered":"2024-09-17T02:24:58.864241+0000","last_clean":"2024-09-17T02:24:58.864241+0000","last_became_active":"2024-09-17T02:24:48.581390+0000","last_became_peered":"2024-09-17T02:24:48.581390+0000","last_unstale":"2024-09-17T02:24:58.864241+0000","last_undegraded":"2024-09-17T02:24:58.864241+0000","last_fullsized":"2024-09-17T02:24:58.864241+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'5","last_scrub_stamp":"2024-09-17T02:24:58.863821+0000","last_deep_scrub":"90'5","last_deep_scrub_stamp":"2024-09-17T02:24:58.863821+0000","last_clean_scrub_stamp":"2024-09-17T02:24:58.863821+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:57.769885+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.236200+0000","last_change":"2024-09-17T02:24:30.325492+0000","last_active":"2024-09-17T02:24:51.236200+0000","last_peered":"2024-09-17T02:24:51.236200+0000","last_clean":"2024-09-17T02:24:51.236200+0000","last_became_active":"2024-09-17T02:24:30.325175+0000","last_became_peered":"2024-09-17T02:24:30.325175+0000","last_unstale":"2024-09-17T02:24:51.236200+0000","last_undegraded":"2024-09-17T02:24:51.236200+0000","last_fullsized":"2024-09-17T02:24:51.236200+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:14.308882+0000","last_change":"2024-09-17T02:25:14.308954+0000","last_active":"2024-09-17T02:25:14.308882+0000","last_peered":"2024-09-17T02:25:14.308882+0000","last_clean":"2024-09-17T02:25:14.308882+0000","last_became_active":"2024-09-17T02:24:30.697986+0000","last_became_peered":"2024-09-17T02:24:30.697986+0000","last_unstale":"2024-09-17T02:25:14.308882+0000","last_undegraded":"2024-09-17T02:25:14.308882+0000","last_fullsized":"2024-09-17T02:25:14.308882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:14.308683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:14.308683+0000","last_clean_scrub_stamp":"2024-09-17T02:25:14.308683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:31.202271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":172,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:04.253828+0000","last_change":"2024-09-17T02:25:04.253828+0000","last_active":"2024-09-17T02:25:04.253828+0000","last_peered":"2024-09-17T02:25:04.253828+0000","last_clean":"2024-09-17T02:25:04.253828+0000","last_became_active":"2024-09-17T02:24:30.696215+0000","last_became_peered":"2024-09-17T02:24:30.696215+0000","last_unstale":"2024-09-17T02:25:04.253828+0000","last_undegraded":"2024-09-17T02:25:04.253828+0000","last_fullsized":"2024-09-17T02:25:04.253828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:04.253556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:04.253556+0000","last_clean_scrub_stamp":"2024-09-17T02:25:04.253556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:58.288743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:15.282000+0000","last_change":"2024-09-17T02:25:15.282052+0000","last_active":"2024-09-17T02:25:15.282000+0000","last_peered":"2024-09-17T02:25:15.282000+0000","last_clean":"2024-09-17T02:25:15.282000+0000","last_became_active":"2024-09-17T02:20:16.576640+0000","last_became_peered":"2024-09-17T02:20:16.576640+0000","last_unstale":"2024-09-17T02:25:15.282000+0000","last_undegraded":"2024-09-17T02:25:15.282000+0000","last_fullsized":"2024-09-17T02:25:15.282000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:15.281815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:15.281815+0000","last_clean_scrub_stamp":"2024-09-17T02:25:15.281815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:30.107664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:07.935854+0000","last_change":"2024-09-17T02:25:07.935888+0000","last_active":"2024-09-17T02:25:07.935854+0000","last_peered":"2024-09-17T02:25:07.935854+0000","last_clean":"2024-09-17T02:25:07.935854+0000","last_became_active":"2024-09-17T02:24:30.706195+0000","last_became_peered":"2024-09-17T02:24:30.706195+0000","last_unstale":"2024-09-17T02:25:07.935854+0000","last_undegraded":"2024-09-17T02:25:07.935854+0000","last_fullsized":"2024-09-17T02:25:07.935854+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:07.935734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:07.935734+0000","last_clean_scrub_stamp":"2024-09-17T02:25:07.935734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:27.115399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.275548+0000","last_change":"2024-09-17T02:24:34.733762+0000","last_active":"2024-09-17T02:24:52.275548+0000","last_peered":"2024-09-17T02:24:52.275548+0000","last_clean":"2024-09-17T02:24:52.275548+0000","last_became_active":"2024-09-17T02:24:34.731592+0000","last_became_peered":"2024-09-17T02:24:34.731592+0000","last_unstale":"2024-09-17T02:24:52.275548+0000","last_undegraded":"2024-09-17T02:24:52.275548+0000","last_fullsized":"2024-09-17T02:24:52.275548+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:00.283703+0000","last_change":"2024-09-17T02:25:00.283755+0000","last_active":"2024-09-17T02:25:00.283703+0000","last_peered":"2024-09-17T02:25:00.283703+0000","last_clean":"2024-09-17T02:25:00.283703+0000","last_became_active":"2024-09-17T02:24:30.694027+0000","last_became_peered":"2024-09-17T02:24:30.694027+0000","last_unstale":"2024-09-17T02:25:00.283703+0000","last_undegraded":"2024-09-17T02:25:00.283703+0000","last_fullsized":"2024-09-17T02:25:00.283703+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:00.283510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:00.283510+0000","last_clean_scrub_stamp":"2024-09-17T02:25:00.283510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:36.666096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":172,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:08.278528+0000","last_change":"2024-09-17T02:25:08.278629+0000","last_active":"2024-09-17T02:25:08.278528+0000","last_peered":"2024-09-17T02:25:08.278528+0000","last_clean":"2024-09-17T02:25:08.278528+0000","last_became_active":"2024-09-17T02:24:30.693991+0000","last_became_peered":"2024-09-17T02:24:30.693991+0000","last_unstale":"2024-09-17T02:25:08.278528+0000","last_undegraded":"2024-09-17T02:25:08.278528+0000","last_fullsized":"2024-09-17T02:25:08.278528+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:08.278240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:08.278240+0000","last_clean_scrub_stamp":"2024-09-17T02:25:08.278240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:30.581496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:58.195504+0000","last_change":"2024-09-17T02:21:10.505967+0000","last_active":"2024-09-17T02:24:58.195504+0000","last_peered":"2024-09-17T02:24:58.195504+0000","last_clean":"2024-09-17T02:24:58.195504+0000","last_became_active":"2024-09-17T02:21:10.505594+0000","last_became_peered":"2024-09-17T02:21:10.505594+0000","last_unstale":"2024-09-17T02:24:58.195504+0000","last_undegraded":"2024-09-17T02:24:58.195504+0000","last_fullsized":"2024-09-17T02:24:58.195504+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:06.901221+0000","last_change":"2024-09-17T02:25:06.901286+0000","last_active":"2024-09-17T02:25:06.901221+0000","last_peered":"2024-09-17T02:25:06.901221+0000","last_clean":"2024-09-17T02:25:06.901221+0000","last_became_active":"2024-09-17T02:24:48.578539+0000","last_became_peered":"2024-09-17T02:24:48.578539+0000","last_unstale":"2024-09-17T02:25:06.901221+0000","last_undegraded":"2024-09-17T02:25:06.901221+0000","last_fullsized":"2024-09-17T02:25:06.901221+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-17T02:25:06.901016+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-17T02:25:06.901016+0000","last_clean_scrub_stamp":"2024-09-17T02:25:06.901016+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:59.983068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:12.937881+0000","last_change":"2024-09-17T02:25:12.937933+0000","last_active":"2024-09-17T02:25:12.937881+0000","last_peered":"2024-09-17T02:25:12.937881+0000","last_clean":"2024-09-17T02:25:12.937881+0000","last_became_active":"2024-09-17T02:24:48.579612+0000","last_became_peered":"2024-09-17T02:24:48.579612+0000","last_unstale":"2024-09-17T02:25:12.937881+0000","last_undegraded":"2024-09-17T02:25:12.937881+0000","last_fullsized":"2024-09-17T02:25:12.937881+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:12.937681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:12.937681+0000","last_clean_scrub_stamp":"2024-09-17T02:25:12.937681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:38.093962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":165,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:58.195079+0000","last_change":"2024-09-17T02:24:30.698237+0000","last_active":"2024-09-17T02:24:58.195079+0000","last_peered":"2024-09-17T02:24:58.195079+0000","last_clean":"2024-09-17T02:24:58.195079+0000","last_became_active":"2024-09-17T02:24:30.697194+0000","last_became_peered":"2024-09-17T02:24:30.697194+0000","last_unstale":"2024-09-17T02:24:58.195079+0000","last_undegraded":"2024-09-17T02:24:58.195079+0000","last_fullsized":"2024-09-17T02:24:58.195079+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":84,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.232421+0000","last_change":"2024-09-17T02:24:34.360811+0000","last_active":"2024-09-17T02:24:51.232421+0000","last_peered":"2024-09-17T02:24:51.232421+0000","last_clean":"2024-09-17T02:24:51.232421+0000","last_became_active":"2024-09-17T02:24:34.359944+0000","last_became_peered":"2024-09-17T02:24:34.359944+0000","last_unstale":"2024-09-17T02:24:51.232421+0000","last_undegraded":"2024-09-17T02:24:51.232421+0000","last_fullsized":"2024-09-17T02:24:51.232421+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"90'3","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:14.265568+0000","last_change":"2024-09-17T02:25:14.265632+0000","last_active":"2024-09-17T02:25:14.265568+0000","last_peered":"2024-09-17T02:25:14.265568+0000","last_clean":"2024-09-17T02:25:14.265568+0000","last_became_active":"2024-09-17T02:24:30.326800+0000","last_became_peered":"2024-09-17T02:24:30.326800+0000","last_unstale":"2024-09-17T02:25:14.265568+0000","last_undegraded":"2024-09-17T02:25:14.265568+0000","last_fullsized":"2024-09-17T02:25:14.265568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'3","last_scrub_stamp":"2024-09-17T02:25:14.265377+0000","last_deep_scrub":"90'3","last_deep_scrub_stamp":"2024-09-17T02:25:14.265377+0000","last_clean_scrub_stamp":"2024-09-17T02:25:14.265377+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:48.182866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233377+0000","last_change":"2024-09-17T02:24:30.322448+0000","last_active":"2024-09-17T02:24:51.233377+0000","last_peered":"2024-09-17T02:24:51.233377+0000","last_clean":"2024-09-17T02:24:51.233377+0000","last_became_active":"2024-09-17T02:24:30.322156+0000","last_became_peered":"2024-09-17T02:24:30.322156+0000","last_unstale":"2024-09-17T02:24:51.233377+0000","last_undegraded":"2024-09-17T02:24:51.233377+0000","last_fullsized":"2024-09-17T02:24:51.233377+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":104,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:58.195202+0000","last_change":"2024-09-17T02:24:48.583271+0000","last_active":"2024-09-17T02:24:58.195202+0000","last_peered":"2024-09-17T02:24:58.195202+0000","last_clean":"2024-09-17T02:24:58.195202+0000","last_became_active":"2024-09-17T02:24:48.581355+0000","last_became_peered":"2024-09-17T02:24:48.581355+0000","last_unstale":"2024-09-17T02:24:58.195202+0000","last_undegraded":"2024-09-17T02:24:58.195202+0000","last_fullsized":"2024-09-17T02:24:58.195202+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:17.873442+0000","last_change":"2024-09-17T02:25:17.873566+0000","last_active":"2024-09-17T02:25:17.873442+0000","last_peered":"2024-09-17T02:25:17.873442+0000","last_clean":"2024-09-17T02:25:17.873442+0000","last_became_active":"2024-09-17T02:20:16.568095+0000","last_became_peered":"2024-09-17T02:20:16.568095+0000","last_unstale":"2024-09-17T02:25:17.873442+0000","last_undegraded":"2024-09-17T02:25:17.873442+0000","last_fullsized":"2024-09-17T02:25:17.873442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:17.873186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:17.873186+0000","last_clean_scrub_stamp":"2024-09-17T02:25:17.873186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:47.452975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278156+0000","last_change":"2024-09-17T02:20:15.560293+0000","last_active":"2024-09-17T02:24:52.278156+0000","last_peered":"2024-09-17T02:24:52.278156+0000","last_clean":"2024-09-17T02:24:52.278156+0000","last_became_active":"2024-09-17T02:20:15.559074+0000","last_became_peered":"2024-09-17T02:20:15.559074+0000","last_unstale":"2024-09-17T02:24:52.278156+0000","last_undegraded":"2024-09-17T02:24:52.278156+0000","last_fullsized":"2024-09-17T02:24:52.278156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:51.233563+0000","last_change":"2024-09-17T02:24:30.319629+0000","last_active":"2024-09-17T02:24:51.233563+0000","last_peered":"2024-09-17T02:24:51.233563+0000","last_clean":"2024-09-17T02:24:51.233563+0000","last_became_active":"2024-09-17T02:24:30.319441+0000","last_became_peered":"2024-09-17T02:24:30.319441+0000","last_unstale":"2024-09-17T02:24:51.233563+0000","last_undegraded":"2024-09-17T02:24:51.233563+0000","last_fullsized":"2024-09-17T02:24:51.233563+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:15.524398+0000","last_clean_scrub_stamp":"2024-09-17T02:20:15.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:52.278111+0000","last_change":"2024-09-17T02:24:30.699964+0000","last_active":"2024-09-17T02:24:52.278111+0000","last_peered":"2024-09-17T02:24:52.278111+0000","last_clean":"2024-09-17T02:24:52.278111+0000","last_became_active":"2024-09-17T02:24:30.699102+0000","last_became_peered":"2024-09-17T02:24:30.699102+0000","last_unstale":"2024-09-17T02:24:52.278111+0000","last_undegraded":"2024-09-17T02:24:52.278111+0000","last_fullsized":"2024-09-17T02:24:52.278111+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:20:14.516708+0000","last_clean_scrub_stamp":"2024-09-17T02:20:14.516708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5558,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705732,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361236,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":360190,"kb_avail":94010604,"statfs":{"total":96636764160,"available":96266858496,"internally_reserved":0,"allocated":1052672,"data_stored":983227,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":368835013},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":80,"seq":343597383692,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56480,"kb_used_data":1040,"kb_used_omap":6,"kb_used_meta":55417,"kb_avail":94315360,"statfs":{"total":96636764160,"available":96578928640,"internally_reserved":0,"allocated":1064960,"data_stored":983862,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":7153,"internal_metadata":56747023},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738435,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329232,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94042608,"statfs":{"total":96636764160,"available":96299630592,"internally_reserved":0,"allocated":983040,"data_stored":391700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5558,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T02:25:19.864 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.865 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.865 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.865 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.865 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.865 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.865 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.865 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.866 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.866 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.866 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.866 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.866 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.866 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.866 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.866 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.866 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.867 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.867 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.867 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.867 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.867 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.867 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-17T02:20:09.475290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=9, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.867 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.868 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.868 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-17T02:20:09.475290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=9, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.868 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.868 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.868 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.868 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.868 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.868 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.869 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.869 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.869 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.869 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.869 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.869 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.869 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.870 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.870 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.870 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.870 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.870 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.870 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-17T02:20:15.524398+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=15, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.870 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-17T02:20:14.516708+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=56, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:25:19.870 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T02:25:39.872 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:25:40.198 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:25:40.201 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-17T02:25:40.216 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":257,"stamp":"2024-09-17T02:25:39.499966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":746948,"kb_used_data":3028,"kb_used_omap":10,"kb_used_meta":743861,"kb_avail":282368572,"statfs":{"total":289910292480,"available":289145417728,"internally_reserved":0,"allocated":3100672,"data_stored":2358789,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10343,"internal_metadata":761714585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004300"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":180,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:01.898314+0000","last_change":"2024-09-17T02:25:01.898372+0000","last_active":"2024-09-17T02:25:01.898314+0000","last_peered":"2024-09-17T02:25:01.898314+0000","last_clean":"2024-09-17T02:25:01.898314+0000","last_became_active":"2024-09-17T02:24:34.732728+0000","last_became_peered":"2024-09-17T02:24:34.732728+0000","last_unstale":"2024-09-17T02:25:01.898314+0000","last_undegraded":"2024-09-17T02:25:01.898314+0000","last_fullsized":"2024-09-17T02:25:01.898314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:01.898123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:01.898123+0000","last_clean_scrub_stamp":"2024-09-17T02:25:01.898123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:12.284357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:10.991017+0000","last_change":"2024-09-17T02:25:10.991070+0000","last_active":"2024-09-17T02:25:10.991017+0000","last_peered":"2024-09-17T02:25:10.991017+0000","last_clean":"2024-09-17T02:25:10.991017+0000","last_became_active":"2024-09-17T02:24:48.578274+0000","last_became_peered":"2024-09-17T02:24:48.578274+0000","last_unstale":"2024-09-17T02:25:10.991017+0000","last_undegraded":"2024-09-17T02:25:10.991017+0000","last_fullsized":"2024-09-17T02:25:10.991017+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:10.990818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:10.990818+0000","last_clean_scrub_stamp":"2024-09-17T02:25:10.990818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:34.616605+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:03.311356+0000","last_change":"2024-09-17T02:25:03.311413+0000","last_active":"2024-09-17T02:25:03.311356+0000","last_peered":"2024-09-17T02:25:03.311356+0000","last_clean":"2024-09-17T02:25:03.311356+0000","last_became_active":"2024-09-17T02:24:30.338199+0000","last_became_peered":"2024-09-17T02:24:30.338199+0000","last_unstale":"2024-09-17T02:25:03.311356+0000","last_undegraded":"2024-09-17T02:25:03.311356+0000","last_fullsized":"2024-09-17T02:25:03.311356+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:03.311174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:03.311174+0000","last_clean_scrub_stamp":"2024-09-17T02:25:03.311174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:23.773466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:33.203637+0000","last_change":"2024-09-17T02:25:33.203690+0000","last_active":"2024-09-17T02:25:33.203637+0000","last_peered":"2024-09-17T02:25:33.203637+0000","last_clean":"2024-09-17T02:25:33.203637+0000","last_became_active":"2024-09-17T02:24:34.359912+0000","last_became_peered":"2024-09-17T02:24:34.359912+0000","last_unstale":"2024-09-17T02:25:33.203637+0000","last_undegraded":"2024-09-17T02:25:33.203637+0000","last_fullsized":"2024-09-17T02:25:33.203637+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:33.203454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:33.203454+0000","last_clean_scrub_stamp":"2024-09-17T02:25:33.203454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:54:43.398508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":108,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:08.985772+0000","last_change":"2024-09-17T02:25:08.985772+0000","last_active":"2024-09-17T02:25:08.985772+0000","last_peered":"2024-09-17T02:25:08.985772+0000","last_clean":"2024-09-17T02:25:08.985772+0000","last_became_active":"2024-09-17T02:24:48.578841+0000","last_became_peered":"2024-09-17T02:24:48.578841+0000","last_unstale":"2024-09-17T02:25:08.985772+0000","last_undegraded":"2024-09-17T02:25:08.985772+0000","last_fullsized":"2024-09-17T02:25:08.985772+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:08.985442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:08.985442+0000","last_clean_scrub_stamp":"2024-09-17T02:25:08.985442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:05.066126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:24.201745+0000","last_change":"2024-09-17T02:25:24.201796+0000","last_active":"2024-09-17T02:25:24.201745+0000","last_peered":"2024-09-17T02:25:24.201745+0000","last_clean":"2024-09-17T02:25:24.201745+0000","last_became_active":"2024-09-17T02:24:30.322191+0000","last_became_peered":"2024-09-17T02:24:30.322191+0000","last_unstale":"2024-09-17T02:25:24.201745+0000","last_undegraded":"2024-09-17T02:25:24.201745+0000","last_fullsized":"2024-09-17T02:25:24.201745+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:24.201560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:24.201560+0000","last_clean_scrub_stamp":"2024-09-17T02:25:24.201560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:04.938358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:05.261618+0000","last_change":"2024-09-17T02:25:05.261670+0000","last_active":"2024-09-17T02:25:05.261618+0000","last_peered":"2024-09-17T02:25:05.261618+0000","last_clean":"2024-09-17T02:25:05.261618+0000","last_became_active":"2024-09-17T02:24:30.329814+0000","last_became_peered":"2024-09-17T02:24:30.329814+0000","last_unstale":"2024-09-17T02:25:05.261618+0000","last_undegraded":"2024-09-17T02:25:05.261618+0000","last_fullsized":"2024-09-17T02:25:05.261618+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:05.261427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:05.261427+0000","last_clean_scrub_stamp":"2024-09-17T02:25:05.261427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:22.989496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:22.204597+0000","last_change":"2024-09-17T02:25:22.204650+0000","last_active":"2024-09-17T02:25:22.204597+0000","last_peered":"2024-09-17T02:25:22.204597+0000","last_clean":"2024-09-17T02:25:22.204597+0000","last_became_active":"2024-09-17T02:24:30.319316+0000","last_became_peered":"2024-09-17T02:24:30.319316+0000","last_unstale":"2024-09-17T02:25:22.204597+0000","last_undegraded":"2024-09-17T02:25:22.204597+0000","last_fullsized":"2024-09-17T02:25:22.204597+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:22.204370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:22.204370+0000","last_clean_scrub_stamp":"2024-09-17T02:25:22.204370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:59.072376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:09.321538+0000","last_change":"2024-09-17T02:25:09.321646+0000","last_active":"2024-09-17T02:25:09.321538+0000","last_peered":"2024-09-17T02:25:09.321538+0000","last_clean":"2024-09-17T02:25:09.321538+0000","last_became_active":"2024-09-17T02:20:16.580797+0000","last_became_peered":"2024-09-17T02:20:16.580797+0000","last_unstale":"2024-09-17T02:25:09.321538+0000","last_undegraded":"2024-09-17T02:25:09.321538+0000","last_fullsized":"2024-09-17T02:25:09.321538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:09.321321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:09.321321+0000","last_clean_scrub_stamp":"2024-09-17T02:25:09.321321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:43.925855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":180,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:03.818851+0000","last_change":"2024-09-17T02:25:03.818851+0000","last_active":"2024-09-17T02:25:03.818851+0000","last_peered":"2024-09-17T02:25:03.818851+0000","last_clean":"2024-09-17T02:25:03.818851+0000","last_became_active":"2024-09-17T02:24:34.732480+0000","last_became_peered":"2024-09-17T02:24:34.732480+0000","last_unstale":"2024-09-17T02:25:03.818851+0000","last_undegraded":"2024-09-17T02:25:03.818851+0000","last_fullsized":"2024-09-17T02:25:03.818851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:03.818604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:03.818604+0000","last_clean_scrub_stamp":"2024-09-17T02:25:03.818604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:49.914513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:12.211145+0000","last_change":"2024-09-17T02:25:12.211198+0000","last_active":"2024-09-17T02:25:12.211145+0000","last_peered":"2024-09-17T02:25:12.211145+0000","last_clean":"2024-09-17T02:25:12.211145+0000","last_became_active":"2024-09-17T02:24:30.328962+0000","last_became_peered":"2024-09-17T02:24:30.328962+0000","last_unstale":"2024-09-17T02:25:12.211145+0000","last_undegraded":"2024-09-17T02:25:12.211145+0000","last_fullsized":"2024-09-17T02:25:12.211145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:12.210949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:12.210949+0000","last_clean_scrub_stamp":"2024-09-17T02:25:12.210949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:13:32.408738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":108,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:27.756636+0000","last_change":"2024-09-17T02:25:27.756695+0000","last_active":"2024-09-17T02:25:27.756636+0000","last_peered":"2024-09-17T02:25:27.756636+0000","last_clean":"2024-09-17T02:25:27.756636+0000","last_became_active":"2024-09-17T02:24:48.581418+0000","last_became_peered":"2024-09-17T02:24:48.581418+0000","last_unstale":"2024-09-17T02:25:27.756636+0000","last_undegraded":"2024-09-17T02:25:27.756636+0000","last_fullsized":"2024-09-17T02:25:27.756636+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:27.756436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:27.756436+0000","last_clean_scrub_stamp":"2024-09-17T02:25:27.756436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:52.480627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:59.896590+0000","last_change":"2024-09-17T02:24:59.896644+0000","last_active":"2024-09-17T02:24:59.896590+0000","last_peered":"2024-09-17T02:24:59.896590+0000","last_clean":"2024-09-17T02:24:59.896590+0000","last_became_active":"2024-09-17T02:24:48.579221+0000","last_became_peered":"2024-09-17T02:24:48.579221+0000","last_unstale":"2024-09-17T02:24:59.896590+0000","last_undegraded":"2024-09-17T02:24:59.896590+0000","last_fullsized":"2024-09-17T02:24:59.896590+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:24:59.896392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:24:59.896392+0000","last_clean_scrub_stamp":"2024-09-17T02:24:59.896392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:24.475715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:29.149221+0000","last_change":"2024-09-17T02:25:29.149276+0000","last_active":"2024-09-17T02:25:29.149221+0000","last_peered":"2024-09-17T02:25:29.149221+0000","last_clean":"2024-09-17T02:25:29.149221+0000","last_became_active":"2024-09-17T02:24:30.335871+0000","last_became_peered":"2024-09-17T02:24:30.335871+0000","last_unstale":"2024-09-17T02:25:29.149221+0000","last_undegraded":"2024-09-17T02:25:29.149221+0000","last_fullsized":"2024-09-17T02:25:29.149221+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:29.149008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:29.149008+0000","last_clean_scrub_stamp":"2024-09-17T02:25:29.149008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:35:34.698566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:13.247898+0000","last_change":"2024-09-17T02:25:13.247953+0000","last_active":"2024-09-17T02:25:13.247898+0000","last_peered":"2024-09-17T02:25:13.247898+0000","last_clean":"2024-09-17T02:25:13.247898+0000","last_became_active":"2024-09-17T02:24:30.335086+0000","last_became_peered":"2024-09-17T02:24:30.335086+0000","last_unstale":"2024-09-17T02:25:13.247898+0000","last_undegraded":"2024-09-17T02:25:13.247898+0000","last_fullsized":"2024-09-17T02:25:13.247898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:13.247701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:13.247701+0000","last_clean_scrub_stamp":"2024-09-17T02:25:13.247701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:50.391158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:26.171991+0000","last_change":"2024-09-17T02:25:26.172046+0000","last_active":"2024-09-17T02:25:26.171991+0000","last_peered":"2024-09-17T02:25:26.171991+0000","last_clean":"2024-09-17T02:25:26.171991+0000","last_became_active":"2024-09-17T02:24:30.325002+0000","last_became_peered":"2024-09-17T02:24:30.325002+0000","last_unstale":"2024-09-17T02:25:26.171991+0000","last_undegraded":"2024-09-17T02:25:26.171991+0000","last_fullsized":"2024-09-17T02:25:26.171991+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:26.171760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:26.171760+0000","last_clean_scrub_stamp":"2024-09-17T02:25:26.171760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:17:02.311008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:23.312714+0000","last_change":"2024-09-17T02:25:23.312766+0000","last_active":"2024-09-17T02:25:23.312714+0000","last_peered":"2024-09-17T02:25:23.312714+0000","last_clean":"2024-09-17T02:25:23.312714+0000","last_became_active":"2024-09-17T02:20:16.562735+0000","last_became_peered":"2024-09-17T02:20:16.562735+0000","last_unstale":"2024-09-17T02:25:23.312714+0000","last_undegraded":"2024-09-17T02:25:23.312714+0000","last_fullsized":"2024-09-17T02:25:23.312714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:23.312523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:23.312523+0000","last_clean_scrub_stamp":"2024-09-17T02:25:23.312523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:40.397156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:29.710397+0000","last_change":"2024-09-17T02:25:29.710449+0000","last_active":"2024-09-17T02:25:29.710397+0000","last_peered":"2024-09-17T02:25:29.710397+0000","last_clean":"2024-09-17T02:25:29.710397+0000","last_became_active":"2024-09-17T02:24:48.580510+0000","last_became_peered":"2024-09-17T02:24:48.580510+0000","last_unstale":"2024-09-17T02:25:29.710397+0000","last_undegraded":"2024-09-17T02:25:29.710397+0000","last_fullsized":"2024-09-17T02:25:29.710397+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:29.710208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:29.710208+0000","last_clean_scrub_stamp":"2024-09-17T02:25:29.710208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:48.304555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:07.258602+0000","last_change":"2024-09-17T02:25:07.258658+0000","last_active":"2024-09-17T02:25:07.258602+0000","last_peered":"2024-09-17T02:25:07.258602+0000","last_clean":"2024-09-17T02:25:07.258602+0000","last_became_active":"2024-09-17T02:20:16.586281+0000","last_became_peered":"2024-09-17T02:20:16.586281+0000","last_unstale":"2024-09-17T02:25:07.258602+0000","last_undegraded":"2024-09-17T02:25:07.258602+0000","last_fullsized":"2024-09-17T02:25:07.258602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:07.258413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:07.258413+0000","last_clean_scrub_stamp":"2024-09-17T02:25:07.258413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:03.281216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:09.215203+0000","last_change":"2024-09-17T02:25:09.215259+0000","last_active":"2024-09-17T02:25:09.215203+0000","last_peered":"2024-09-17T02:25:09.215203+0000","last_clean":"2024-09-17T02:25:09.215203+0000","last_became_active":"2024-09-17T02:24:30.329980+0000","last_became_peered":"2024-09-17T02:24:30.329980+0000","last_unstale":"2024-09-17T02:25:09.215203+0000","last_undegraded":"2024-09-17T02:25:09.215203+0000","last_fullsized":"2024-09-17T02:25:09.215203+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:09.215010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:09.215010+0000","last_clean_scrub_stamp":"2024-09-17T02:25:09.215010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:51.583841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:36.146246+0000","last_change":"2024-09-17T02:25:36.146296+0000","last_active":"2024-09-17T02:25:36.146246+0000","last_peered":"2024-09-17T02:25:36.146246+0000","last_clean":"2024-09-17T02:25:36.146246+0000","last_became_active":"2024-09-17T02:24:34.360259+0000","last_became_peered":"2024-09-17T02:24:34.360259+0000","last_unstale":"2024-09-17T02:25:36.146246+0000","last_undegraded":"2024-09-17T02:25:36.146246+0000","last_fullsized":"2024-09-17T02:25:36.146246+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:36.146060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:36.146060+0000","last_clean_scrub_stamp":"2024-09-17T02:25:36.146060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:58.458386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:13.968263+0000","last_change":"2024-09-17T02:25:13.968317+0000","last_active":"2024-09-17T02:25:13.968263+0000","last_peered":"2024-09-17T02:25:13.968263+0000","last_clean":"2024-09-17T02:25:13.968263+0000","last_became_active":"2024-09-17T02:24:30.700674+0000","last_became_peered":"2024-09-17T02:24:30.700674+0000","last_unstale":"2024-09-17T02:25:13.968263+0000","last_undegraded":"2024-09-17T02:25:13.968263+0000","last_fullsized":"2024-09-17T02:25:13.968263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:13.968072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:13.968072+0000","last_clean_scrub_stamp":"2024-09-17T02:25:13.968072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:48:08.926819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:59.310417+0000","last_change":"2024-09-17T02:24:59.310470+0000","last_active":"2024-09-17T02:24:59.310417+0000","last_peered":"2024-09-17T02:24:59.310417+0000","last_clean":"2024-09-17T02:24:59.310417+0000","last_became_active":"2024-09-17T02:24:30.698022+0000","last_became_peered":"2024-09-17T02:24:30.698022+0000","last_unstale":"2024-09-17T02:24:59.310417+0000","last_undegraded":"2024-09-17T02:24:59.310417+0000","last_fullsized":"2024-09-17T02:24:59.310417+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:24:59.310215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:24:59.310215+0000","last_clean_scrub_stamp":"2024-09-17T02:24:59.310215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:38.004294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:00.935719+0000","last_change":"2024-09-17T02:25:00.935861+0000","last_active":"2024-09-17T02:25:00.935719+0000","last_peered":"2024-09-17T02:25:00.935719+0000","last_clean":"2024-09-17T02:25:00.935719+0000","last_became_active":"2024-09-17T02:24:48.576615+0000","last_became_peered":"2024-09-17T02:24:48.576615+0000","last_unstale":"2024-09-17T02:25:00.935719+0000","last_undegraded":"2024-09-17T02:25:00.935719+0000","last_fullsized":"2024-09-17T02:25:00.935719+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:00.935454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:00.935454+0000","last_clean_scrub_stamp":"2024-09-17T02:25:00.935454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:50.045066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:09.991986+0000","last_change":"2024-09-17T02:25:09.992041+0000","last_active":"2024-09-17T02:25:09.991986+0000","last_peered":"2024-09-17T02:25:09.991986+0000","last_clean":"2024-09-17T02:25:09.991986+0000","last_became_active":"2024-09-17T02:24:30.703377+0000","last_became_peered":"2024-09-17T02:24:30.703377+0000","last_unstale":"2024-09-17T02:25:09.991986+0000","last_undegraded":"2024-09-17T02:25:09.991986+0000","last_fullsized":"2024-09-17T02:25:09.991986+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:09.991799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:09.991799+0000","last_clean_scrub_stamp":"2024-09-17T02:25:09.991799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:41.342890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:02.305396+0000","last_change":"2024-09-17T02:25:02.305455+0000","last_active":"2024-09-17T02:25:02.305396+0000","last_peered":"2024-09-17T02:25:02.305396+0000","last_clean":"2024-09-17T02:25:02.305396+0000","last_became_active":"2024-09-17T02:24:30.694853+0000","last_became_peered":"2024-09-17T02:24:30.694853+0000","last_unstale":"2024-09-17T02:25:02.305396+0000","last_undegraded":"2024-09-17T02:25:02.305396+0000","last_fullsized":"2024-09-17T02:25:02.305396+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:02.305186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:02.305186+0000","last_clean_scrub_stamp":"2024-09-17T02:25:02.305186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:08.436888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:30.197070+0000","last_change":"2024-09-17T02:25:30.197121+0000","last_active":"2024-09-17T02:25:30.197070+0000","last_peered":"2024-09-17T02:25:30.197070+0000","last_clean":"2024-09-17T02:25:30.197070+0000","last_became_active":"2024-09-17T02:24:30.338488+0000","last_became_peered":"2024-09-17T02:24:30.338488+0000","last_unstale":"2024-09-17T02:25:30.197070+0000","last_undegraded":"2024-09-17T02:25:30.197070+0000","last_fullsized":"2024-09-17T02:25:30.197070+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:30.196865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:30.196865+0000","last_clean_scrub_stamp":"2024-09-17T02:25:30.196865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:15.200206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":108,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:30.667333+0000","last_change":"2024-09-17T02:25:30.667387+0000","last_active":"2024-09-17T02:25:30.667333+0000","last_peered":"2024-09-17T02:25:30.667333+0000","last_clean":"2024-09-17T02:25:30.667333+0000","last_became_active":"2024-09-17T02:24:48.582959+0000","last_became_peered":"2024-09-17T02:24:48.582959+0000","last_unstale":"2024-09-17T02:25:30.667333+0000","last_undegraded":"2024-09-17T02:25:30.667333+0000","last_fullsized":"2024-09-17T02:25:30.667333+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:30.667142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:30.667142+0000","last_clean_scrub_stamp":"2024-09-17T02:25:30.667142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:38.949866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:31.452600+0000","last_change":"2024-09-17T02:25:31.452651+0000","last_active":"2024-09-17T02:25:31.452600+0000","last_peered":"2024-09-17T02:25:31.452600+0000","last_clean":"2024-09-17T02:25:31.452600+0000","last_became_active":"2024-09-17T02:24:34.733451+0000","last_became_peered":"2024-09-17T02:24:34.733451+0000","last_unstale":"2024-09-17T02:25:31.452600+0000","last_undegraded":"2024-09-17T02:25:31.452600+0000","last_fullsized":"2024-09-17T02:25:31.452600+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:31.452414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:31.452414+0000","last_clean_scrub_stamp":"2024-09-17T02:25:31.452414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:11.199569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:15.902965+0000","last_change":"2024-09-17T02:25:15.903018+0000","last_active":"2024-09-17T02:25:15.902965+0000","last_peered":"2024-09-17T02:25:15.902965+0000","last_clean":"2024-09-17T02:25:15.902965+0000","last_became_active":"2024-09-17T02:24:30.699410+0000","last_became_peered":"2024-09-17T02:24:30.699410+0000","last_unstale":"2024-09-17T02:25:15.902965+0000","last_undegraded":"2024-09-17T02:25:15.902965+0000","last_fullsized":"2024-09-17T02:25:15.902965+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:15.902767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:15.902767+0000","last_clean_scrub_stamp":"2024-09-17T02:25:15.902767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:31:24.622051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:25.295086+0000","last_change":"2024-09-17T02:25:25.295138+0000","last_active":"2024-09-17T02:25:25.295086+0000","last_peered":"2024-09-17T02:25:25.295086+0000","last_clean":"2024-09-17T02:25:25.295086+0000","last_became_active":"2024-09-17T02:24:34.725109+0000","last_became_peered":"2024-09-17T02:24:34.725109+0000","last_unstale":"2024-09-17T02:25:25.295086+0000","last_undegraded":"2024-09-17T02:25:25.295086+0000","last_fullsized":"2024-09-17T02:25:25.295086+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:25.294886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:25.294886+0000","last_clean_scrub_stamp":"2024-09-17T02:25:25.294886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:17.785660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:32.194123+0000","last_change":"2024-09-17T02:25:32.194176+0000","last_active":"2024-09-17T02:25:32.194123+0000","last_peered":"2024-09-17T02:25:32.194123+0000","last_clean":"2024-09-17T02:25:32.194123+0000","last_became_active":"2024-09-17T02:24:34.356639+0000","last_became_peered":"2024-09-17T02:24:34.356639+0000","last_unstale":"2024-09-17T02:25:32.194123+0000","last_undegraded":"2024-09-17T02:25:32.194123+0000","last_fullsized":"2024-09-17T02:25:32.194123+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:32.193921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:32.193921+0000","last_clean_scrub_stamp":"2024-09-17T02:25:32.193921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:52.994036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":108,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:26.793663+0000","last_change":"2024-09-17T02:25:26.793719+0000","last_active":"2024-09-17T02:25:26.793663+0000","last_peered":"2024-09-17T02:25:26.793663+0000","last_clean":"2024-09-17T02:25:26.793663+0000","last_became_active":"2024-09-17T02:24:48.581121+0000","last_became_peered":"2024-09-17T02:24:48.581121+0000","last_unstale":"2024-09-17T02:25:26.793663+0000","last_undegraded":"2024-09-17T02:25:26.793663+0000","last_fullsized":"2024-09-17T02:25:26.793663+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:26.793452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:26.793452+0000","last_clean_scrub_stamp":"2024-09-17T02:25:26.793452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:09:55.596379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"90'4","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:10.194097+0000","last_change":"2024-09-17T02:25:10.194165+0000","last_active":"2024-09-17T02:25:10.194097+0000","last_peered":"2024-09-17T02:25:10.194097+0000","last_clean":"2024-09-17T02:25:10.194097+0000","last_became_active":"2024-09-17T02:24:30.328907+0000","last_became_peered":"2024-09-17T02:24:30.328907+0000","last_unstale":"2024-09-17T02:25:10.194097+0000","last_undegraded":"2024-09-17T02:25:10.194097+0000","last_fullsized":"2024-09-17T02:25:10.194097+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'4","last_scrub_stamp":"2024-09-17T02:25:10.193903+0000","last_deep_scrub":"90'4","last_deep_scrub_stamp":"2024-09-17T02:25:10.193903+0000","last_clean_scrub_stamp":"2024-09-17T02:25:10.193903+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:29:40.998156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":180,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:05.877418+0000","last_change":"2024-09-17T02:25:05.877418+0000","last_active":"2024-09-17T02:25:05.877418+0000","last_peered":"2024-09-17T02:25:05.877418+0000","last_clean":"2024-09-17T02:25:05.877418+0000","last_became_active":"2024-09-17T02:24:34.731598+0000","last_became_peered":"2024-09-17T02:24:34.731598+0000","last_unstale":"2024-09-17T02:25:05.877418+0000","last_undegraded":"2024-09-17T02:25:05.877418+0000","last_fullsized":"2024-09-17T02:25:05.877418+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:05.877170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:05.877170+0000","last_clean_scrub_stamp":"2024-09-17T02:25:05.877170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:03.124916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:26.345191+0000","last_change":"2024-09-17T02:25:26.345248+0000","last_active":"2024-09-17T02:25:26.345191+0000","last_peered":"2024-09-17T02:25:26.345191+0000","last_clean":"2024-09-17T02:25:26.345191+0000","last_became_active":"2024-09-17T02:24:34.727345+0000","last_became_peered":"2024-09-17T02:24:34.727345+0000","last_unstale":"2024-09-17T02:25:26.345191+0000","last_undegraded":"2024-09-17T02:25:26.345191+0000","last_fullsized":"2024-09-17T02:25:26.345191+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:26.345008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:26.345008+0000","last_clean_scrub_stamp":"2024-09-17T02:25:26.345008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:24.254739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:28.388046+0000","last_change":"2024-09-17T02:25:28.388098+0000","last_active":"2024-09-17T02:25:28.388046+0000","last_peered":"2024-09-17T02:25:28.388046+0000","last_clean":"2024-09-17T02:25:28.388046+0000","last_became_active":"2024-09-17T02:24:34.730285+0000","last_became_peered":"2024-09-17T02:24:34.730285+0000","last_unstale":"2024-09-17T02:25:28.388046+0000","last_undegraded":"2024-09-17T02:25:28.388046+0000","last_fullsized":"2024-09-17T02:25:28.388046+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:28.387842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:28.387842+0000","last_clean_scrub_stamp":"2024-09-17T02:25:28.387842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:16.647896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":172,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:11.946956+0000","last_change":"2024-09-17T02:25:11.947010+0000","last_active":"2024-09-17T02:25:11.946956+0000","last_peered":"2024-09-17T02:25:11.946956+0000","last_clean":"2024-09-17T02:25:11.946956+0000","last_became_active":"2024-09-17T02:24:30.701047+0000","last_became_peered":"2024-09-17T02:24:30.701047+0000","last_unstale":"2024-09-17T02:25:11.946956+0000","last_undegraded":"2024-09-17T02:25:11.946956+0000","last_fullsized":"2024-09-17T02:25:11.946956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:11.946765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:11.946765+0000","last_clean_scrub_stamp":"2024-09-17T02:25:11.946765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:54:32.006823+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:10.314479+0000","last_change":"2024-09-17T02:25:10.314581+0000","last_active":"2024-09-17T02:25:10.314479+0000","last_peered":"2024-09-17T02:25:10.314479+0000","last_clean":"2024-09-17T02:25:10.314479+0000","last_became_active":"2024-09-17T02:24:30.697606+0000","last_became_peered":"2024-09-17T02:24:30.697606+0000","last_unstale":"2024-09-17T02:25:10.314479+0000","last_undegraded":"2024-09-17T02:25:10.314479+0000","last_fullsized":"2024-09-17T02:25:10.314479+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:10.314245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:10.314245+0000","last_clean_scrub_stamp":"2024-09-17T02:25:10.314245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:53.862909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"90'12","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:15.249888+0000","last_change":"2024-09-17T02:25:15.249969+0000","last_active":"2024-09-17T02:25:15.249888+0000","last_peered":"2024-09-17T02:25:15.249888+0000","last_clean":"2024-09-17T02:25:15.249888+0000","last_became_active":"2024-09-17T02:24:30.336326+0000","last_became_peered":"2024-09-17T02:24:30.336326+0000","last_unstale":"2024-09-17T02:25:15.249888+0000","last_undegraded":"2024-09-17T02:25:15.249888+0000","last_fullsized":"2024-09-17T02:25:15.249888+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'12","last_scrub_stamp":"2024-09-17T02:25:15.249685+0000","last_deep_scrub":"90'12","last_deep_scrub_stamp":"2024-09-17T02:25:15.249685+0000","last_clean_scrub_stamp":"2024-09-17T02:25:15.249685+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:49.723714+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"90'2","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:19.288545+0000","last_change":"2024-09-17T02:25:19.288604+0000","last_active":"2024-09-17T02:25:19.288545+0000","last_peered":"2024-09-17T02:25:19.288545+0000","last_clean":"2024-09-17T02:25:19.288545+0000","last_became_active":"2024-09-17T02:24:30.336494+0000","last_became_peered":"2024-09-17T02:24:30.336494+0000","last_unstale":"2024-09-17T02:25:19.288545+0000","last_undegraded":"2024-09-17T02:25:19.288545+0000","last_fullsized":"2024-09-17T02:25:19.288545+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'2","last_scrub_stamp":"2024-09-17T02:25:19.288359+0000","last_deep_scrub":"90'2","last_deep_scrub_stamp":"2024-09-17T02:25:19.288359+0000","last_clean_scrub_stamp":"2024-09-17T02:25:19.288359+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:09.416748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":108,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:28.757190+0000","last_change":"2024-09-17T02:25:28.757245+0000","last_active":"2024-09-17T02:25:28.757190+0000","last_peered":"2024-09-17T02:25:28.757190+0000","last_clean":"2024-09-17T02:25:28.757190+0000","last_became_active":"2024-09-17T02:24:48.580644+0000","last_became_peered":"2024-09-17T02:24:48.580644+0000","last_unstale":"2024-09-17T02:25:28.757190+0000","last_undegraded":"2024-09-17T02:25:28.757190+0000","last_fullsized":"2024-09-17T02:25:28.757190+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:28.756994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:28.756994+0000","last_clean_scrub_stamp":"2024-09-17T02:25:28.756994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:02.200489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"90'3","reported_seq":175,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:20.883844+0000","last_change":"2024-09-17T02:25:20.883913+0000","last_active":"2024-09-17T02:25:20.883844+0000","last_peered":"2024-09-17T02:25:20.883844+0000","last_clean":"2024-09-17T02:25:20.883844+0000","last_became_active":"2024-09-17T02:24:30.695140+0000","last_became_peered":"2024-09-17T02:24:30.695140+0000","last_unstale":"2024-09-17T02:25:20.883844+0000","last_undegraded":"2024-09-17T02:25:20.883844+0000","last_fullsized":"2024-09-17T02:25:20.883844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'3","last_scrub_stamp":"2024-09-17T02:25:20.883653+0000","last_deep_scrub":"90'3","last_deep_scrub_stamp":"2024-09-17T02:25:20.883653+0000","last_clean_scrub_stamp":"2024-09-17T02:25:20.883653+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:19.970475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:02.863642+0000","last_change":"2024-09-17T02:25:02.863694+0000","last_active":"2024-09-17T02:25:02.863642+0000","last_peered":"2024-09-17T02:25:02.863642+0000","last_clean":"2024-09-17T02:25:02.863642+0000","last_became_active":"2024-09-17T02:24:48.576802+0000","last_became_peered":"2024-09-17T02:24:48.576802+0000","last_unstale":"2024-09-17T02:25:02.863642+0000","last_undegraded":"2024-09-17T02:25:02.863642+0000","last_fullsized":"2024-09-17T02:25:02.863642+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:02.863442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:02.863442+0000","last_clean_scrub_stamp":"2024-09-17T02:25:02.863442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:56.499968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"90'2","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:00.398272+0000","last_change":"2024-09-17T02:25:00.398374+0000","last_active":"2024-09-17T02:25:00.398272+0000","last_peered":"2024-09-17T02:25:00.398272+0000","last_clean":"2024-09-17T02:25:00.398272+0000","last_became_active":"2024-09-17T02:24:30.337650+0000","last_became_peered":"2024-09-17T02:24:30.337650+0000","last_unstale":"2024-09-17T02:25:00.398272+0000","last_undegraded":"2024-09-17T02:25:00.398272+0000","last_fullsized":"2024-09-17T02:25:00.398272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'2","last_scrub_stamp":"2024-09-17T02:25:00.398087+0000","last_deep_scrub":"90'2","last_deep_scrub_stamp":"2024-09-17T02:25:00.398087+0000","last_clean_scrub_stamp":"2024-09-17T02:25:00.398087+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:21.031278+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:25.163244+0000","last_change":"2024-09-17T02:25:25.163293+0000","last_active":"2024-09-17T02:25:25.163244+0000","last_peered":"2024-09-17T02:25:25.163244+0000","last_clean":"2024-09-17T02:25:25.163244+0000","last_became_active":"2024-09-17T02:24:30.322509+0000","last_became_peered":"2024-09-17T02:24:30.322509+0000","last_unstale":"2024-09-17T02:25:25.163244+0000","last_undegraded":"2024-09-17T02:25:25.163244+0000","last_fullsized":"2024-09-17T02:25:25.163244+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:25.163061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:25.163061+0000","last_clean_scrub_stamp":"2024-09-17T02:25:25.163061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:11:21.597949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:06.267648+0000","last_change":"2024-09-17T02:25:06.267700+0000","last_active":"2024-09-17T02:25:06.267648+0000","last_peered":"2024-09-17T02:25:06.267648+0000","last_clean":"2024-09-17T02:25:06.267648+0000","last_became_active":"2024-09-17T02:24:30.329642+0000","last_became_peered":"2024-09-17T02:24:30.329642+0000","last_unstale":"2024-09-17T02:25:06.267648+0000","last_undegraded":"2024-09-17T02:25:06.267648+0000","last_fullsized":"2024-09-17T02:25:06.267648+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:06.267455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:06.267455+0000","last_clean_scrub_stamp":"2024-09-17T02:25:06.267455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:29.921715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:12.297233+0000","last_change":"2024-09-17T02:25:12.297293+0000","last_active":"2024-09-17T02:25:12.297233+0000","last_peered":"2024-09-17T02:25:12.297233+0000","last_clean":"2024-09-17T02:25:12.297233+0000","last_became_active":"2024-09-17T02:24:30.697800+0000","last_became_peered":"2024-09-17T02:24:30.697800+0000","last_unstale":"2024-09-17T02:25:12.297233+0000","last_undegraded":"2024-09-17T02:25:12.297233+0000","last_fullsized":"2024-09-17T02:25:12.297233+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:12.297041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:12.297041+0000","last_clean_scrub_stamp":"2024-09-17T02:25:12.297041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:06.128273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"90'3","reported_seq":175,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:06.281828+0000","last_change":"2024-09-17T02:25:06.281978+0000","last_active":"2024-09-17T02:25:06.281828+0000","last_peered":"2024-09-17T02:25:06.281828+0000","last_clean":"2024-09-17T02:25:06.281828+0000","last_became_active":"2024-09-17T02:24:30.696079+0000","last_became_peered":"2024-09-17T02:24:30.696079+0000","last_unstale":"2024-09-17T02:25:06.281828+0000","last_undegraded":"2024-09-17T02:25:06.281828+0000","last_fullsized":"2024-09-17T02:25:06.281828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'3","last_scrub_stamp":"2024-09-17T02:25:06.281589+0000","last_deep_scrub":"90'3","last_deep_scrub_stamp":"2024-09-17T02:25:06.281589+0000","last_clean_scrub_stamp":"2024-09-17T02:25:06.281589+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:32.019870+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:07.221991+0000","last_change":"2024-09-17T02:25:07.222041+0000","last_active":"2024-09-17T02:25:07.221991+0000","last_peered":"2024-09-17T02:25:07.221991+0000","last_clean":"2024-09-17T02:25:07.221991+0000","last_became_active":"2024-09-17T02:24:30.329676+0000","last_became_peered":"2024-09-17T02:24:30.329676+0000","last_unstale":"2024-09-17T02:25:07.221991+0000","last_undegraded":"2024-09-17T02:25:07.221991+0000","last_fullsized":"2024-09-17T02:25:07.221991+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:07.221798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:07.221798+0000","last_clean_scrub_stamp":"2024-09-17T02:25:07.221798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:14:23.338414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":94,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:35.156773+0000","last_change":"2024-09-17T02:25:35.156823+0000","last_active":"2024-09-17T02:25:35.156773+0000","last_peered":"2024-09-17T02:25:35.156773+0000","last_clean":"2024-09-17T02:25:35.156773+0000","last_became_active":"2024-09-17T02:24:34.360020+0000","last_became_peered":"2024-09-17T02:24:34.360020+0000","last_unstale":"2024-09-17T02:25:35.156773+0000","last_undegraded":"2024-09-17T02:25:35.156773+0000","last_fullsized":"2024-09-17T02:25:35.156773+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:35.156584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:35.156584+0000","last_clean_scrub_stamp":"2024-09-17T02:25:35.156584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:43.099413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:04.283675+0000","last_change":"2024-09-17T02:25:04.283726+0000","last_active":"2024-09-17T02:25:04.283675+0000","last_peered":"2024-09-17T02:25:04.283675+0000","last_clean":"2024-09-17T02:25:04.283675+0000","last_became_active":"2024-09-17T02:24:30.336902+0000","last_became_peered":"2024-09-17T02:24:30.336902+0000","last_unstale":"2024-09-17T02:25:04.283675+0000","last_undegraded":"2024-09-17T02:25:04.283675+0000","last_fullsized":"2024-09-17T02:25:04.283675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:04.283494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:04.283494+0000","last_clean_scrub_stamp":"2024-09-17T02:25:04.283494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:00.955796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":110,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:04.847001+0000","last_change":"2024-09-17T02:25:04.847108+0000","last_active":"2024-09-17T02:25:04.847001+0000","last_peered":"2024-09-17T02:25:04.847001+0000","last_clean":"2024-09-17T02:25:04.847001+0000","last_became_active":"2024-09-17T02:24:48.578461+0000","last_became_peered":"2024-09-17T02:24:48.578461+0000","last_unstale":"2024-09-17T02:25:04.847001+0000","last_undegraded":"2024-09-17T02:25:04.847001+0000","last_fullsized":"2024-09-17T02:25:04.847001+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:04.846785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:04.846785+0000","last_clean_scrub_stamp":"2024-09-17T02:25:04.846785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:20.535184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:16.287575+0000","last_change":"2024-09-17T02:25:16.287681+0000","last_active":"2024-09-17T02:25:16.287575+0000","last_peered":"2024-09-17T02:25:16.287575+0000","last_clean":"2024-09-17T02:25:16.287575+0000","last_became_active":"2024-09-17T02:24:30.326227+0000","last_became_peered":"2024-09-17T02:24:30.326227+0000","last_unstale":"2024-09-17T02:25:16.287575+0000","last_undegraded":"2024-09-17T02:25:16.287575+0000","last_fullsized":"2024-09-17T02:25:16.287575+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:16.287353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:16.287353+0000","last_clean_scrub_stamp":"2024-09-17T02:25:16.287353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:53.879613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:14.921637+0000","last_change":"2024-09-17T02:25:14.921700+0000","last_active":"2024-09-17T02:25:14.921637+0000","last_peered":"2024-09-17T02:25:14.921637+0000","last_clean":"2024-09-17T02:25:14.921637+0000","last_became_active":"2024-09-17T02:24:48.578678+0000","last_became_peered":"2024-09-17T02:24:48.578678+0000","last_unstale":"2024-09-17T02:25:14.921637+0000","last_undegraded":"2024-09-17T02:25:14.921637+0000","last_fullsized":"2024-09-17T02:25:14.921637+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:14.921419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:14.921419+0000","last_clean_scrub_stamp":"2024-09-17T02:25:14.921419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:58.989777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:11.282812+0000","last_change":"2024-09-17T02:25:11.282869+0000","last_active":"2024-09-17T02:25:11.282812+0000","last_peered":"2024-09-17T02:25:11.282812+0000","last_clean":"2024-09-17T02:25:11.282812+0000","last_became_active":"2024-09-17T02:20:16.582326+0000","last_became_peered":"2024-09-17T02:20:16.582326+0000","last_unstale":"2024-09-17T02:25:11.282812+0000","last_undegraded":"2024-09-17T02:25:11.282812+0000","last_fullsized":"2024-09-17T02:25:11.282812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:11.282597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:11.282597+0000","last_clean_scrub_stamp":"2024-09-17T02:25:11.282597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:23.345943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"90'159","reported_seq":247,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:01.368517+0000","last_change":"2024-09-17T02:25:01.368592+0000","last_active":"2024-09-17T02:25:01.368517+0000","last_peered":"2024-09-17T02:25:01.368517+0000","last_clean":"2024-09-17T02:25:01.368517+0000","last_became_active":"2024-09-17T02:24:30.338214+0000","last_became_peered":"2024-09-17T02:24:30.338214+0000","last_unstale":"2024-09-17T02:25:01.368517+0000","last_undegraded":"2024-09-17T02:25:01.368517+0000","last_fullsized":"2024-09-17T02:25:01.368517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'159","last_scrub_stamp":"2024-09-17T02:25:01.368320+0000","last_deep_scrub":"90'159","last_deep_scrub_stamp":"2024-09-17T02:25:01.368320+0000","last_clean_scrub_stamp":"2024-09-17T02:25:01.368320+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:05.158992+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"90'2","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:27.162121+0000","last_change":"2024-09-17T02:25:27.162186+0000","last_active":"2024-09-17T02:25:27.162121+0000","last_peered":"2024-09-17T02:25:27.162121+0000","last_clean":"2024-09-17T02:25:27.162121+0000","last_became_active":"2024-09-17T02:24:30.324910+0000","last_became_peered":"2024-09-17T02:24:30.324910+0000","last_unstale":"2024-09-17T02:25:27.162121+0000","last_undegraded":"2024-09-17T02:25:27.162121+0000","last_fullsized":"2024-09-17T02:25:27.162121+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'2","last_scrub_stamp":"2024-09-17T02:25:27.161928+0000","last_deep_scrub":"90'2","last_deep_scrub_stamp":"2024-09-17T02:25:27.161928+0000","last_clean_scrub_stamp":"2024-09-17T02:25:27.161928+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:41:45.819864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":165,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:22.287455+0000","last_change":"2024-09-17T02:25:22.287561+0000","last_active":"2024-09-17T02:25:22.287455+0000","last_peered":"2024-09-17T02:25:22.287455+0000","last_clean":"2024-09-17T02:25:22.287455+0000","last_became_active":"2024-09-17T02:20:15.559104+0000","last_became_peered":"2024-09-17T02:20:15.559104+0000","last_unstale":"2024-09-17T02:25:22.287455+0000","last_undegraded":"2024-09-17T02:25:22.287455+0000","last_fullsized":"2024-09-17T02:25:22.287455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:22.287223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:22.287223+0000","last_clean_scrub_stamp":"2024-09-17T02:25:22.287223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:59.237424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:59.404645+0000","last_change":"2024-09-17T02:24:59.404701+0000","last_active":"2024-09-17T02:24:59.404645+0000","last_peered":"2024-09-17T02:24:59.404645+0000","last_clean":"2024-09-17T02:24:59.404645+0000","last_became_active":"2024-09-17T02:24:30.337415+0000","last_became_peered":"2024-09-17T02:24:30.337415+0000","last_unstale":"2024-09-17T02:24:59.404645+0000","last_undegraded":"2024-09-17T02:24:59.404645+0000","last_fullsized":"2024-09-17T02:24:59.404645+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:24:59.404458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:24:59.404458+0000","last_clean_scrub_stamp":"2024-09-17T02:24:59.404458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:16.350126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:02.319892+0000","last_change":"2024-09-17T02:25:02.319983+0000","last_active":"2024-09-17T02:25:02.319892+0000","last_peered":"2024-09-17T02:25:02.319892+0000","last_clean":"2024-09-17T02:25:02.319892+0000","last_became_active":"2024-09-17T02:24:30.338024+0000","last_became_peered":"2024-09-17T02:24:30.338024+0000","last_unstale":"2024-09-17T02:25:02.319892+0000","last_undegraded":"2024-09-17T02:25:02.319892+0000","last_fullsized":"2024-09-17T02:25:02.319892+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:02.319658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:02.319658+0000","last_clean_scrub_stamp":"2024-09-17T02:25:02.319658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:39.604266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":172,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:01.327000+0000","last_change":"2024-09-17T02:25:01.327132+0000","last_active":"2024-09-17T02:25:01.327000+0000","last_peered":"2024-09-17T02:25:01.327000+0000","last_clean":"2024-09-17T02:25:01.327000+0000","last_became_active":"2024-09-17T02:24:30.693653+0000","last_became_peered":"2024-09-17T02:24:30.693653+0000","last_unstale":"2024-09-17T02:25:01.327000+0000","last_undegraded":"2024-09-17T02:25:01.327000+0000","last_fullsized":"2024-09-17T02:25:01.327000+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:01.326768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:01.326768+0000","last_clean_scrub_stamp":"2024-09-17T02:25:01.326768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:42.223815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:18.878415+0000","last_change":"2024-09-17T02:25:18.878470+0000","last_active":"2024-09-17T02:25:18.878415+0000","last_peered":"2024-09-17T02:25:18.878415+0000","last_clean":"2024-09-17T02:25:18.878415+0000","last_became_active":"2024-09-17T02:20:16.570622+0000","last_became_peered":"2024-09-17T02:20:16.570622+0000","last_unstale":"2024-09-17T02:25:18.878415+0000","last_undegraded":"2024-09-17T02:25:18.878415+0000","last_fullsized":"2024-09-17T02:25:18.878415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:18.878224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:18.878224+0000","last_clean_scrub_stamp":"2024-09-17T02:25:18.878224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:55.420664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":178,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:18.373815+0000","last_change":"2024-09-17T02:25:18.373869+0000","last_active":"2024-09-17T02:25:18.373815+0000","last_peered":"2024-09-17T02:25:18.373815+0000","last_clean":"2024-09-17T02:25:18.373815+0000","last_became_active":"2024-09-17T02:20:10.497164+0000","last_became_peered":"2024-09-17T02:20:10.497164+0000","last_unstale":"2024-09-17T02:25:18.373815+0000","last_undegraded":"2024-09-17T02:25:18.373815+0000","last_fullsized":"2024-09-17T02:25:18.373815+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:18.373618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:18.373618+0000","last_clean_scrub_stamp":"2024-09-17T02:25:18.373618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:28.125462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00081052700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":110,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:31.629476+0000","last_change":"2024-09-17T02:25:31.629535+0000","last_active":"2024-09-17T02:25:31.629476+0000","last_peered":"2024-09-17T02:25:31.629476+0000","last_clean":"2024-09-17T02:25:31.629476+0000","last_became_active":"2024-09-17T02:24:48.582729+0000","last_became_peered":"2024-09-17T02:24:48.582729+0000","last_unstale":"2024-09-17T02:25:31.629476+0000","last_undegraded":"2024-09-17T02:25:31.629476+0000","last_fullsized":"2024-09-17T02:25:31.629476+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:31.629279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:31.629279+0000","last_clean_scrub_stamp":"2024-09-17T02:25:31.629279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:15.578961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:27.352844+0000","last_change":"2024-09-17T02:25:27.352924+0000","last_active":"2024-09-17T02:25:27.352844+0000","last_peered":"2024-09-17T02:25:27.352844+0000","last_clean":"2024-09-17T02:25:27.352844+0000","last_became_active":"2024-09-17T02:24:34.729890+0000","last_became_peered":"2024-09-17T02:24:34.729890+0000","last_unstale":"2024-09-17T02:25:27.352844+0000","last_undegraded":"2024-09-17T02:25:27.352844+0000","last_fullsized":"2024-09-17T02:25:27.352844+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:27.352652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:27.352652+0000","last_clean_scrub_stamp":"2024-09-17T02:25:27.352652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:59:13.753234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"90'3","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:11.216424+0000","last_change":"2024-09-17T02:25:11.216495+0000","last_active":"2024-09-17T02:25:11.216424+0000","last_peered":"2024-09-17T02:25:11.216424+0000","last_clean":"2024-09-17T02:25:11.216424+0000","last_became_active":"2024-09-17T02:24:30.333005+0000","last_became_peered":"2024-09-17T02:24:30.333005+0000","last_unstale":"2024-09-17T02:25:11.216424+0000","last_undegraded":"2024-09-17T02:25:11.216424+0000","last_fullsized":"2024-09-17T02:25:11.216424+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'3","last_scrub_stamp":"2024-09-17T02:25:11.216230+0000","last_deep_scrub":"90'3","last_deep_scrub_stamp":"2024-09-17T02:25:11.216230+0000","last_clean_scrub_stamp":"2024-09-17T02:25:11.216230+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:27.744924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00078085399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:08.184509+0000","last_change":"2024-09-17T02:25:08.184560+0000","last_active":"2024-09-17T02:25:08.184509+0000","last_peered":"2024-09-17T02:25:08.184509+0000","last_clean":"2024-09-17T02:25:08.184509+0000","last_became_active":"2024-09-17T02:24:30.329213+0000","last_became_peered":"2024-09-17T02:24:30.329213+0000","last_unstale":"2024-09-17T02:25:08.184509+0000","last_undegraded":"2024-09-17T02:25:08.184509+0000","last_fullsized":"2024-09-17T02:25:08.184509+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:08.184321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:08.184321+0000","last_clean_scrub_stamp":"2024-09-17T02:25:08.184321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:12.352461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:13.345857+0000","last_change":"2024-09-17T02:25:13.345962+0000","last_active":"2024-09-17T02:25:13.345857+0000","last_peered":"2024-09-17T02:25:13.345857+0000","last_clean":"2024-09-17T02:25:13.345857+0000","last_became_active":"2024-09-17T02:20:16.578343+0000","last_became_peered":"2024-09-17T02:20:16.578343+0000","last_unstale":"2024-09-17T02:25:13.345857+0000","last_undegraded":"2024-09-17T02:25:13.345857+0000","last_fullsized":"2024-09-17T02:25:13.345857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:13.345627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:13.345627+0000","last_clean_scrub_stamp":"2024-09-17T02:25:13.345627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:58.839133+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":94,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:31.239991+0000","last_change":"2024-09-17T02:25:31.240041+0000","last_active":"2024-09-17T02:25:31.239991+0000","last_peered":"2024-09-17T02:25:31.239991+0000","last_clean":"2024-09-17T02:25:31.239991+0000","last_became_active":"2024-09-17T02:24:34.353619+0000","last_became_peered":"2024-09-17T02:24:34.353619+0000","last_unstale":"2024-09-17T02:25:31.239991+0000","last_undegraded":"2024-09-17T02:25:31.239991+0000","last_fullsized":"2024-09-17T02:25:31.239991+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:31.239796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:31.239796+0000","last_clean_scrub_stamp":"2024-09-17T02:25:31.239796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:18.761588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":178,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:16.321973+0000","last_change":"2024-09-17T02:25:16.322027+0000","last_active":"2024-09-17T02:25:16.321973+0000","last_peered":"2024-09-17T02:25:16.321973+0000","last_clean":"2024-09-17T02:25:16.321973+0000","last_became_active":"2024-09-17T02:20:10.497049+0000","last_became_peered":"2024-09-17T02:20:10.497049+0000","last_unstale":"2024-09-17T02:25:16.321973+0000","last_undegraded":"2024-09-17T02:25:16.321973+0000","last_fullsized":"2024-09-17T02:25:16.321973+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:16.321782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:16.321782+0000","last_clean_scrub_stamp":"2024-09-17T02:25:16.321782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:31.283536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00079701100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:22.843013+0000","last_change":"2024-09-17T02:25:22.843075+0000","last_active":"2024-09-17T02:25:22.843013+0000","last_peered":"2024-09-17T02:25:22.843013+0000","last_clean":"2024-09-17T02:25:22.843013+0000","last_became_active":"2024-09-17T02:24:30.694944+0000","last_became_peered":"2024-09-17T02:24:30.694944+0000","last_unstale":"2024-09-17T02:25:22.843013+0000","last_undegraded":"2024-09-17T02:25:22.843013+0000","last_fullsized":"2024-09-17T02:25:22.843013+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:22.842817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:22.842817+0000","last_clean_scrub_stamp":"2024-09-17T02:25:22.842817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:02.681785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":165,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:20.371078+0000","last_change":"2024-09-17T02:25:20.371130+0000","last_active":"2024-09-17T02:25:20.371078+0000","last_peered":"2024-09-17T02:25:20.371078+0000","last_clean":"2024-09-17T02:25:20.371078+0000","last_became_active":"2024-09-17T02:20:15.557667+0000","last_became_peered":"2024-09-17T02:20:15.557667+0000","last_unstale":"2024-09-17T02:25:20.371078+0000","last_undegraded":"2024-09-17T02:25:20.371078+0000","last_fullsized":"2024-09-17T02:25:20.371078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:20.370884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:20.370884+0000","last_clean_scrub_stamp":"2024-09-17T02:25:20.370884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:47.484750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":178,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:16.916554+0000","last_change":"2024-09-17T02:25:16.916608+0000","last_active":"2024-09-17T02:25:16.916554+0000","last_peered":"2024-09-17T02:25:16.916554+0000","last_clean":"2024-09-17T02:25:16.916554+0000","last_became_active":"2024-09-17T02:20:10.497829+0000","last_became_peered":"2024-09-17T02:20:10.497829+0000","last_unstale":"2024-09-17T02:25:16.916554+0000","last_undegraded":"2024-09-17T02:25:16.916554+0000","last_fullsized":"2024-09-17T02:25:16.916554+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:16.916364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:16.916364+0000","last_clean_scrub_stamp":"2024-09-17T02:25:16.916364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:44.325268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00096944700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":108,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:24.831909+0000","last_change":"2024-09-17T02:25:24.831966+0000","last_active":"2024-09-17T02:25:24.831909+0000","last_peered":"2024-09-17T02:25:24.831909+0000","last_clean":"2024-09-17T02:25:24.831909+0000","last_became_active":"2024-09-17T02:24:48.580388+0000","last_became_peered":"2024-09-17T02:24:48.580388+0000","last_unstale":"2024-09-17T02:25:24.831909+0000","last_undegraded":"2024-09-17T02:25:24.831909+0000","last_fullsized":"2024-09-17T02:25:24.831909+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:24.831701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:24.831701+0000","last_clean_scrub_stamp":"2024-09-17T02:25:24.831701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:52:45.070844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"90'3","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:19.373244+0000","last_change":"2024-09-17T02:25:19.373314+0000","last_active":"2024-09-17T02:25:19.373244+0000","last_peered":"2024-09-17T02:25:19.373244+0000","last_clean":"2024-09-17T02:25:19.373244+0000","last_became_active":"2024-09-17T02:20:15.558299+0000","last_became_peered":"2024-09-17T02:20:15.558299+0000","last_unstale":"2024-09-17T02:25:19.373244+0000","last_undegraded":"2024-09-17T02:25:19.373244+0000","last_fullsized":"2024-09-17T02:25:19.373244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'3","last_scrub_stamp":"2024-09-17T02:25:19.373058+0000","last_deep_scrub":"90'3","last_deep_scrub_stamp":"2024-09-17T02:25:19.373058+0000","last_clean_scrub_stamp":"2024-09-17T02:25:19.373058+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:33:31.147708+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":178,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:17.366816+0000","last_change":"2024-09-17T02:25:17.366873+0000","last_active":"2024-09-17T02:25:17.366816+0000","last_peered":"2024-09-17T02:25:17.366816+0000","last_clean":"2024-09-17T02:25:17.366816+0000","last_became_active":"2024-09-17T02:20:10.497021+0000","last_became_peered":"2024-09-17T02:20:10.497021+0000","last_unstale":"2024-09-17T02:25:17.366816+0000","last_undegraded":"2024-09-17T02:25:17.366816+0000","last_fullsized":"2024-09-17T02:25:17.366816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:17.366624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:17.366624+0000","last_clean_scrub_stamp":"2024-09-17T02:25:17.366624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:15:13.680596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001400079,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:05.297242+0000","last_change":"2024-09-17T02:25:05.297294+0000","last_active":"2024-09-17T02:25:05.297242+0000","last_peered":"2024-09-17T02:25:05.297242+0000","last_clean":"2024-09-17T02:25:05.297242+0000","last_became_active":"2024-09-17T02:24:30.691331+0000","last_became_peered":"2024-09-17T02:24:30.691331+0000","last_unstale":"2024-09-17T02:25:05.297242+0000","last_undegraded":"2024-09-17T02:25:05.297242+0000","last_fullsized":"2024-09-17T02:25:05.297242+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:05.297043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:05.297043+0000","last_clean_scrub_stamp":"2024-09-17T02:25:05.297043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:43.402150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"90'2","reported_seq":174,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:03.302542+0000","last_change":"2024-09-17T02:25:03.302610+0000","last_active":"2024-09-17T02:25:03.302542+0000","last_peered":"2024-09-17T02:25:03.302542+0000","last_clean":"2024-09-17T02:25:03.302542+0000","last_became_active":"2024-09-17T02:24:30.691770+0000","last_became_peered":"2024-09-17T02:24:30.691770+0000","last_unstale":"2024-09-17T02:25:03.302542+0000","last_undegraded":"2024-09-17T02:25:03.302542+0000","last_fullsized":"2024-09-17T02:25:03.302542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'2","last_scrub_stamp":"2024-09-17T02:25:03.302331+0000","last_deep_scrub":"90'2","last_deep_scrub_stamp":"2024-09-17T02:25:03.302331+0000","last_clean_scrub_stamp":"2024-09-17T02:25:03.302331+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:38.712721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:17.330401+0000","last_change":"2024-09-17T02:25:17.330456+0000","last_active":"2024-09-17T02:25:17.330401+0000","last_peered":"2024-09-17T02:25:17.330401+0000","last_clean":"2024-09-17T02:25:17.330401+0000","last_became_active":"2024-09-17T02:24:30.336110+0000","last_became_peered":"2024-09-17T02:24:30.336110+0000","last_unstale":"2024-09-17T02:25:17.330401+0000","last_undegraded":"2024-09-17T02:25:17.330401+0000","last_fullsized":"2024-09-17T02:25:17.330401+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:17.330188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:17.330188+0000","last_clean_scrub_stamp":"2024-09-17T02:25:17.330188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:06.083334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:23.849255+0000","last_change":"2024-09-17T02:25:23.849307+0000","last_active":"2024-09-17T02:25:23.849255+0000","last_peered":"2024-09-17T02:25:23.849255+0000","last_clean":"2024-09-17T02:25:23.849255+0000","last_became_active":"2024-09-17T02:24:30.696731+0000","last_became_peered":"2024-09-17T02:24:30.696731+0000","last_unstale":"2024-09-17T02:25:23.849255+0000","last_undegraded":"2024-09-17T02:25:23.849255+0000","last_fullsized":"2024-09-17T02:25:23.849255+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:23.849059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:23.849059+0000","last_clean_scrub_stamp":"2024-09-17T02:25:23.849059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:27.313834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:18.285054+0000","last_change":"2024-09-17T02:25:18.285108+0000","last_active":"2024-09-17T02:25:18.285054+0000","last_peered":"2024-09-17T02:25:18.285054+0000","last_clean":"2024-09-17T02:25:18.285054+0000","last_became_active":"2024-09-17T02:24:30.325752+0000","last_became_peered":"2024-09-17T02:24:30.325752+0000","last_unstale":"2024-09-17T02:25:18.285054+0000","last_undegraded":"2024-09-17T02:25:18.285054+0000","last_fullsized":"2024-09-17T02:25:18.285054+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:18.284870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:18.284870+0000","last_clean_scrub_stamp":"2024-09-17T02:25:18.284870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:45:27.908952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"90'10","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:20.276592+0000","last_change":"2024-09-17T02:25:20.276664+0000","last_active":"2024-09-17T02:25:20.276592+0000","last_peered":"2024-09-17T02:25:20.276592+0000","last_clean":"2024-09-17T02:25:20.276592+0000","last_became_active":"2024-09-17T02:24:30.325688+0000","last_became_peered":"2024-09-17T02:24:30.325688+0000","last_unstale":"2024-09-17T02:25:20.276592+0000","last_undegraded":"2024-09-17T02:25:20.276592+0000","last_fullsized":"2024-09-17T02:25:20.276592+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'10","last_scrub_stamp":"2024-09-17T02:25:20.276400+0000","last_deep_scrub":"90'10","last_deep_scrub_stamp":"2024-09-17T02:25:20.276400+0000","last_clean_scrub_stamp":"2024-09-17T02:25:20.276400+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:59.197979+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:29.434301+0000","last_change":"2024-09-17T02:25:29.434357+0000","last_active":"2024-09-17T02:25:29.434301+0000","last_peered":"2024-09-17T02:25:29.434301+0000","last_clean":"2024-09-17T02:25:29.434301+0000","last_became_active":"2024-09-17T02:24:34.730386+0000","last_became_peered":"2024-09-17T02:24:34.730386+0000","last_unstale":"2024-09-17T02:25:29.434301+0000","last_undegraded":"2024-09-17T02:25:29.434301+0000","last_fullsized":"2024-09-17T02:25:29.434301+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:29.434103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:29.434103+0000","last_clean_scrub_stamp":"2024-09-17T02:25:29.434103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:39.137818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"90'5","reported_seq":115,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:24:58.864241+0000","last_change":"2024-09-17T02:24:58.864241+0000","last_active":"2024-09-17T02:24:58.864241+0000","last_peered":"2024-09-17T02:24:58.864241+0000","last_clean":"2024-09-17T02:24:58.864241+0000","last_became_active":"2024-09-17T02:24:48.581390+0000","last_became_peered":"2024-09-17T02:24:48.581390+0000","last_unstale":"2024-09-17T02:24:58.864241+0000","last_undegraded":"2024-09-17T02:24:58.864241+0000","last_fullsized":"2024-09-17T02:24:58.864241+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'5","last_scrub_stamp":"2024-09-17T02:24:58.863821+0000","last_deep_scrub":"90'5","last_deep_scrub_stamp":"2024-09-17T02:24:58.863821+0000","last_clean_scrub_stamp":"2024-09-17T02:24:58.863821+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:57.769885+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:28.198662+0000","last_change":"2024-09-17T02:25:28.198718+0000","last_active":"2024-09-17T02:25:28.198662+0000","last_peered":"2024-09-17T02:25:28.198662+0000","last_clean":"2024-09-17T02:25:28.198662+0000","last_became_active":"2024-09-17T02:24:30.325175+0000","last_became_peered":"2024-09-17T02:24:30.325175+0000","last_unstale":"2024-09-17T02:25:28.198662+0000","last_undegraded":"2024-09-17T02:25:28.198662+0000","last_fullsized":"2024-09-17T02:25:28.198662+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:28.198474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:28.198474+0000","last_clean_scrub_stamp":"2024-09-17T02:25:28.198474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:31.198276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:14.308882+0000","last_change":"2024-09-17T02:25:14.308954+0000","last_active":"2024-09-17T02:25:14.308882+0000","last_peered":"2024-09-17T02:25:14.308882+0000","last_clean":"2024-09-17T02:25:14.308882+0000","last_became_active":"2024-09-17T02:24:30.697986+0000","last_became_peered":"2024-09-17T02:24:30.697986+0000","last_unstale":"2024-09-17T02:25:14.308882+0000","last_undegraded":"2024-09-17T02:25:14.308882+0000","last_fullsized":"2024-09-17T02:25:14.308882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:14.308683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:14.308683+0000","last_clean_scrub_stamp":"2024-09-17T02:25:14.308683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:31.202271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":172,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:04.253828+0000","last_change":"2024-09-17T02:25:04.253828+0000","last_active":"2024-09-17T02:25:04.253828+0000","last_peered":"2024-09-17T02:25:04.253828+0000","last_clean":"2024-09-17T02:25:04.253828+0000","last_became_active":"2024-09-17T02:24:30.696215+0000","last_became_peered":"2024-09-17T02:24:30.696215+0000","last_unstale":"2024-09-17T02:25:04.253828+0000","last_undegraded":"2024-09-17T02:25:04.253828+0000","last_fullsized":"2024-09-17T02:25:04.253828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:04.253556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:04.253556+0000","last_clean_scrub_stamp":"2024-09-17T02:25:04.253556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:58.288743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:15.282000+0000","last_change":"2024-09-17T02:25:15.282052+0000","last_active":"2024-09-17T02:25:15.282000+0000","last_peered":"2024-09-17T02:25:15.282000+0000","last_clean":"2024-09-17T02:25:15.282000+0000","last_became_active":"2024-09-17T02:20:16.576640+0000","last_became_peered":"2024-09-17T02:20:16.576640+0000","last_unstale":"2024-09-17T02:25:15.282000+0000","last_undegraded":"2024-09-17T02:25:15.282000+0000","last_fullsized":"2024-09-17T02:25:15.282000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:15.281815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:15.281815+0000","last_clean_scrub_stamp":"2024-09-17T02:25:15.281815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:30.107664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:07.935854+0000","last_change":"2024-09-17T02:25:07.935888+0000","last_active":"2024-09-17T02:25:07.935854+0000","last_peered":"2024-09-17T02:25:07.935854+0000","last_clean":"2024-09-17T02:25:07.935854+0000","last_became_active":"2024-09-17T02:24:30.706195+0000","last_became_peered":"2024-09-17T02:24:30.706195+0000","last_unstale":"2024-09-17T02:25:07.935854+0000","last_undegraded":"2024-09-17T02:25:07.935854+0000","last_fullsized":"2024-09-17T02:25:07.935854+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:07.935734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:07.935734+0000","last_clean_scrub_stamp":"2024-09-17T02:25:07.935734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:27.115399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:30.425994+0000","last_change":"2024-09-17T02:25:30.426052+0000","last_active":"2024-09-17T02:25:30.425994+0000","last_peered":"2024-09-17T02:25:30.425994+0000","last_clean":"2024-09-17T02:25:30.425994+0000","last_became_active":"2024-09-17T02:24:34.731592+0000","last_became_peered":"2024-09-17T02:24:34.731592+0000","last_unstale":"2024-09-17T02:25:30.425994+0000","last_undegraded":"2024-09-17T02:25:30.425994+0000","last_fullsized":"2024-09-17T02:25:30.425994+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:30.425795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:30.425795+0000","last_clean_scrub_stamp":"2024-09-17T02:25:30.425795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:27:30.365708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:00.283703+0000","last_change":"2024-09-17T02:25:00.283755+0000","last_active":"2024-09-17T02:25:00.283703+0000","last_peered":"2024-09-17T02:25:00.283703+0000","last_clean":"2024-09-17T02:25:00.283703+0000","last_became_active":"2024-09-17T02:24:30.694027+0000","last_became_peered":"2024-09-17T02:24:30.694027+0000","last_unstale":"2024-09-17T02:25:00.283703+0000","last_undegraded":"2024-09-17T02:25:00.283703+0000","last_fullsized":"2024-09-17T02:25:00.283703+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:00.283510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:00.283510+0000","last_clean_scrub_stamp":"2024-09-17T02:25:00.283510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:36.666096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":172,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:08.278528+0000","last_change":"2024-09-17T02:25:08.278629+0000","last_active":"2024-09-17T02:25:08.278528+0000","last_peered":"2024-09-17T02:25:08.278528+0000","last_clean":"2024-09-17T02:25:08.278528+0000","last_became_active":"2024-09-17T02:24:30.693991+0000","last_became_peered":"2024-09-17T02:24:30.693991+0000","last_unstale":"2024-09-17T02:25:08.278528+0000","last_undegraded":"2024-09-17T02:25:08.278528+0000","last_fullsized":"2024-09-17T02:25:08.278528+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:08.278240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:08.278240+0000","last_clean_scrub_stamp":"2024-09-17T02:25:08.278240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:30.581496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:19.851090+0000","last_change":"2024-09-17T02:25:19.851147+0000","last_active":"2024-09-17T02:25:19.851090+0000","last_peered":"2024-09-17T02:25:19.851090+0000","last_clean":"2024-09-17T02:25:19.851090+0000","last_became_active":"2024-09-17T02:21:10.505594+0000","last_became_peered":"2024-09-17T02:21:10.505594+0000","last_unstale":"2024-09-17T02:25:19.851090+0000","last_undegraded":"2024-09-17T02:25:19.851090+0000","last_fullsized":"2024-09-17T02:25:19.851090+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:19.850890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:19.850890+0000","last_clean_scrub_stamp":"2024-09-17T02:25:19.850890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:21:39.760477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:06.901221+0000","last_change":"2024-09-17T02:25:06.901286+0000","last_active":"2024-09-17T02:25:06.901221+0000","last_peered":"2024-09-17T02:25:06.901221+0000","last_clean":"2024-09-17T02:25:06.901221+0000","last_became_active":"2024-09-17T02:24:48.578539+0000","last_became_peered":"2024-09-17T02:24:48.578539+0000","last_unstale":"2024-09-17T02:25:06.901221+0000","last_undegraded":"2024-09-17T02:25:06.901221+0000","last_fullsized":"2024-09-17T02:25:06.901221+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-17T02:25:06.901016+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-17T02:25:06.901016+0000","last_clean_scrub_stamp":"2024-09-17T02:25:06.901016+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:59.983068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:12.937881+0000","last_change":"2024-09-17T02:25:12.937933+0000","last_active":"2024-09-17T02:25:12.937881+0000","last_peered":"2024-09-17T02:25:12.937881+0000","last_clean":"2024-09-17T02:25:12.937881+0000","last_became_active":"2024-09-17T02:24:48.579612+0000","last_became_peered":"2024-09-17T02:24:48.579612+0000","last_unstale":"2024-09-17T02:25:12.937881+0000","last_undegraded":"2024-09-17T02:25:12.937881+0000","last_fullsized":"2024-09-17T02:25:12.937881+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:12.937681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:12.937681+0000","last_clean_scrub_stamp":"2024-09-17T02:25:12.937681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:38.093962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":173,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:21.832337+0000","last_change":"2024-09-17T02:25:21.832399+0000","last_active":"2024-09-17T02:25:21.832337+0000","last_peered":"2024-09-17T02:25:21.832337+0000","last_clean":"2024-09-17T02:25:21.832337+0000","last_became_active":"2024-09-17T02:24:30.697194+0000","last_became_peered":"2024-09-17T02:24:30.697194+0000","last_unstale":"2024-09-17T02:25:21.832337+0000","last_undegraded":"2024-09-17T02:25:21.832337+0000","last_fullsized":"2024-09-17T02:25:21.832337+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-17T02:25:21.832138+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-17T02:25:21.832138+0000","last_clean_scrub_stamp":"2024-09-17T02:25:21.832138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:10.950523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:34.165207+0000","last_change":"2024-09-17T02:25:34.165259+0000","last_active":"2024-09-17T02:25:34.165207+0000","last_peered":"2024-09-17T02:25:34.165207+0000","last_clean":"2024-09-17T02:25:34.165207+0000","last_became_active":"2024-09-17T02:24:34.359944+0000","last_became_peered":"2024-09-17T02:24:34.359944+0000","last_unstale":"2024-09-17T02:25:34.165207+0000","last_undegraded":"2024-09-17T02:25:34.165207+0000","last_fullsized":"2024-09-17T02:25:34.165207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:34.164992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:34.164992+0000","last_clean_scrub_stamp":"2024-09-17T02:25:34.164992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:28.722990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"90'3","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:14.265568+0000","last_change":"2024-09-17T02:25:14.265632+0000","last_active":"2024-09-17T02:25:14.265568+0000","last_peered":"2024-09-17T02:25:14.265568+0000","last_clean":"2024-09-17T02:25:14.265568+0000","last_became_active":"2024-09-17T02:24:30.326800+0000","last_became_peered":"2024-09-17T02:24:30.326800+0000","last_unstale":"2024-09-17T02:25:14.265568+0000","last_undegraded":"2024-09-17T02:25:14.265568+0000","last_fullsized":"2024-09-17T02:25:14.265568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'3","last_scrub_stamp":"2024-09-17T02:25:14.265377+0000","last_deep_scrub":"90'3","last_deep_scrub_stamp":"2024-09-17T02:25:14.265377+0000","last_clean_scrub_stamp":"2024-09-17T02:25:14.265377+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:48.182866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:23.234590+0000","last_change":"2024-09-17T02:25:23.234641+0000","last_active":"2024-09-17T02:25:23.234590+0000","last_peered":"2024-09-17T02:25:23.234590+0000","last_clean":"2024-09-17T02:25:23.234590+0000","last_became_active":"2024-09-17T02:24:30.322156+0000","last_became_peered":"2024-09-17T02:24:30.322156+0000","last_unstale":"2024-09-17T02:25:23.234590+0000","last_undegraded":"2024-09-17T02:25:23.234590+0000","last_fullsized":"2024-09-17T02:25:23.234590+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:23.234398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:23.234398+0000","last_clean_scrub_stamp":"2024-09-17T02:25:23.234398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:43.773407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"90'3","reported_seq":113,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:25.818042+0000","last_change":"2024-09-17T02:25:25.818128+0000","last_active":"2024-09-17T02:25:25.818042+0000","last_peered":"2024-09-17T02:25:25.818042+0000","last_clean":"2024-09-17T02:25:25.818042+0000","last_became_active":"2024-09-17T02:24:48.581355+0000","last_became_peered":"2024-09-17T02:24:48.581355+0000","last_unstale":"2024-09-17T02:25:25.818042+0000","last_undegraded":"2024-09-17T02:25:25.818042+0000","last_fullsized":"2024-09-17T02:25:25.818042+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'3","last_scrub_stamp":"2024-09-17T02:25:25.817845+0000","last_deep_scrub":"90'3","last_deep_scrub_stamp":"2024-09-17T02:25:25.817845+0000","last_clean_scrub_stamp":"2024-09-17T02:25:25.817845+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:37.693819+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:17.873442+0000","last_change":"2024-09-17T02:25:17.873566+0000","last_active":"2024-09-17T02:25:17.873442+0000","last_peered":"2024-09-17T02:25:17.873442+0000","last_clean":"2024-09-17T02:25:17.873442+0000","last_became_active":"2024-09-17T02:20:16.568095+0000","last_became_peered":"2024-09-17T02:20:16.568095+0000","last_unstale":"2024-09-17T02:25:17.873442+0000","last_undegraded":"2024-09-17T02:25:17.873442+0000","last_fullsized":"2024-09-17T02:25:17.873442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:17.873186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:17.873186+0000","last_clean_scrub_stamp":"2024-09-17T02:25:17.873186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:47.452975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":166,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:21.326347+0000","last_change":"2024-09-17T02:25:21.326409+0000","last_active":"2024-09-17T02:25:21.326347+0000","last_peered":"2024-09-17T02:25:21.326347+0000","last_clean":"2024-09-17T02:25:21.326347+0000","last_became_active":"2024-09-17T02:20:15.559074+0000","last_became_peered":"2024-09-17T02:20:15.559074+0000","last_unstale":"2024-09-17T02:25:21.326347+0000","last_undegraded":"2024-09-17T02:25:21.326347+0000","last_fullsized":"2024-09-17T02:25:21.326347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-17T02:25:21.326145+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-17T02:25:21.326145+0000","last_clean_scrub_stamp":"2024-09-17T02:25:21.326145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:48:10.743247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:21.237392+0000","last_change":"2024-09-17T02:25:21.237452+0000","last_active":"2024-09-17T02:25:21.237392+0000","last_peered":"2024-09-17T02:25:21.237392+0000","last_clean":"2024-09-17T02:25:21.237392+0000","last_became_active":"2024-09-17T02:24:30.319441+0000","last_became_peered":"2024-09-17T02:24:30.319441+0000","last_unstale":"2024-09-17T02:25:21.237392+0000","last_undegraded":"2024-09-17T02:25:21.237392+0000","last_fullsized":"2024-09-17T02:25:21.237392+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:25:21.237202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:25:21.237202+0000","last_clean_scrub_stamp":"2024-09-17T02:25:21.237202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:33.584015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":178,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T02:25:24.289158+0000","last_change":"2024-09-17T02:25:24.289230+0000","last_active":"2024-09-17T02:25:24.289158+0000","last_peered":"2024-09-17T02:25:24.289158+0000","last_clean":"2024-09-17T02:25:24.289158+0000","last_became_active":"2024-09-17T02:24:30.699102+0000","last_became_peered":"2024-09-17T02:24:30.699102+0000","last_unstale":"2024-09-17T02:25:24.289158+0000","last_undegraded":"2024-09-17T02:25:24.289158+0000","last_fullsized":"2024-09-17T02:25:24.289158+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'6","last_scrub_stamp":"2024-09-17T02:25:24.288963+0000","last_deep_scrub":"90'6","last_deep_scrub_stamp":"2024-09-17T02:25:24.288963+0000","last_clean_scrub_stamp":"2024-09-17T02:25:24.288963+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:43.145819+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5558,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705736,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361236,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":360190,"kb_avail":94010604,"statfs":{"total":96636764160,"available":96266858496,"internally_reserved":0,"allocated":1052672,"data_stored":983227,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":368835013},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":80,"seq":343597383696,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56480,"kb_used_data":1040,"kb_used_omap":6,"kb_used_meta":55417,"kb_avail":94315360,"statfs":{"total":96636764160,"available":96578928640,"internally_reserved":0,"allocated":1064960,"data_stored":983862,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":7153,"internal_metadata":56747023},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738439,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329232,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94042608,"statfs":{"total":96636764160,"available":96299630592,"internally_reserved":0,"allocated":983040,"data_stored":391700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7109,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5558,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T02:25:40.221 DEBUG:teuthology.orchestra.run.smithi001:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-17T02:25:40.592 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T02:25:40.593 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:25:40.916 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:25:40.917 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":6,"btime":"2024-09-17T02:20:19:554662+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:20:15.896969+0000","modified":"2024-09-17T02:20:18.924053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4207":{"gid":4207,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.1:6803/3107361006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3107361006},{"type":"v1","addr":"172.21.15.1:6803","nonce":3107361006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4207,"qdb_cluster":[4207]},"id":1}]} 2024-09-17T02:25:40.917 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 6 2024-09-17T02:25:40.934 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:25:41.245 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:25:41.245 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":6,"btime":"2024-09-17T02:20:19:554662+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:20:15.896969+0000","modified":"2024-09-17T02:20:18.924053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4207":{"gid":4207,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.1:6803/3107361006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3107361006},{"type":"v1","addr":"172.21.15.1:6803","nonce":3107361006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4207,"qdb_cluster":[4207]},"id":1}]} 2024-09-17T02:25:41.245 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 6 2024-09-17T02:25:41.264 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:25:41.551 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-17T02:25:41.552 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":90,"fsid":"37cd4495-4915-41f4-bad2-2394cbe235f3","created":"2024-09-17T02:19:52.516342+0000","modified":"2024-09-17T02:24:51.590364+0000","last_up_change":"2024-09-17T02:24:29.673066+0000","last_in_change":"2024-09-17T02:19:54.329423+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:20:03.416336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T02:20:08.718296+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:20:13.566396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-17T02:20:14.902662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fae746a8-754d-4e52-9819-004ebb0d6886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6801","nonce":2347677104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6803","nonce":2347677104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6807","nonce":2347677104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2347677104},{"type":"v1","addr":"172.21.15.32:6805","nonce":2347677104}]},"public_addr":"172.21.15.32:6801/2347677104","cluster_addr":"172.21.15.32:6803/2347677104","heartbeat_back_addr":"172.21.15.32:6807/2347677104","heartbeat_front_addr":"172.21.15.32:6805/2347677104","state":["exists","up"]},{"osd":1,"uuid":"c9397688-80ca-4c21-b80d-1740194c389d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6801","nonce":1905904204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6803","nonce":1905904204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6807","nonce":1905904204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1905904204},{"type":"v1","addr":"172.21.15.153:6805","nonce":1905904204}]},"public_addr":"172.21.15.153:6801/1905904204","cluster_addr":"172.21.15.153:6803/1905904204","heartbeat_back_addr":"172.21.15.153:6807/1905904204","heartbeat_front_addr":"172.21.15.153:6805/1905904204","state":["exists","up"]},{"osd":2,"uuid":"6d8c01a8-b657-4abc-a624-2b35ef0512ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":50,"up_from":80,"up_thru":83,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2045876213},{"type":"v1","addr":"172.21.15.164:6801","nonce":2045876213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2045876213},{"type":"v1","addr":"172.21.15.164:6803","nonce":2045876213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2045876213},{"type":"v1","addr":"172.21.15.164:6807","nonce":2045876213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2045876213},{"type":"v1","addr":"172.21.15.164:6805","nonce":2045876213}]},"public_addr":"172.21.15.164:6801/2045876213","cluster_addr":"172.21.15.164:6803/2045876213","heartbeat_back_addr":"172.21.15.164:6807/2045876213","heartbeat_front_addr":"172.21.15.164:6805/2045876213","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.476482+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.250903+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:20:00.326430+0000","dead_epoch":50}],"pg_upmap":[{"pgid":"4.1d","osds":[0,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:25:41.569 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T02:25:41.913 INFO:teuthology.orchestra.run.smithi001.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T02:25:41.916 INFO:tasks.ceph.mds.a.smithi001.stderr: -2097> 2024-09-17T02:20:17.653+0000 7f7a6b224640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T02:25:41.933 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T02:25:41.951 INFO:tasks.ceph.mds.a.smithi001.stdout:starting mds.a at 2024-09-17T02:25:42.941 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T02:25:43.927 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' removed 2024-09-17T02:25:43.952 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T02:25:44.929 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' removed 2024-09-17T02:25:44.954 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-17T02:25:44.954 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T02:25:44.954 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:25:44.966 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T02:25:44.966 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-17T02:25:44.967 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-17T02:25:44.967 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:25:45.056 INFO:tasks.ceph.osd.0:Stopped 2024-09-17T02:25:45.056 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-17T02:25:45.056 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:25:45.167 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-09-17T02:25:50.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-17T02:25:50.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-09-17T02:25:51.158 INFO:tasks.ceph.osd.1:Stopped 2024-09-17T02:25:51.158 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-17T02:25:51.158 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:25:51.227 INFO:tasks.ceph.osd.2:Stopped 2024-09-17T02:25:51.228 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-17T02:25:51.228 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-17T02:25:51.228 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:25:51.258 INFO:tasks.ceph.mgr.x:Stopped 2024-09-17T02:25:51.258 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-17T02:25:51.258 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:25:51.326 INFO:tasks.ceph.mgr.y:Stopped 2024-09-17T02:25:51.326 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-17T02:25:51.326 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-17T02:25:51.326 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:25:51.389 INFO:tasks.ceph.mon.a:Stopped 2024-09-17T02:25:51.389 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-17T02:25:51.389 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:25:51.457 INFO:tasks.ceph.mon.b:Stopped 2024-09-17T02:25:51.457 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-17T02:25:51.457 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:25:51.514 INFO:tasks.ceph.mon.c:Stopped 2024-09-17T02:25:51.515 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-17T02:25:51.515 DEBUG:teuthology.orchestra.run.smithi001:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-17T02:25:51.579 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi032.front.sepia.ceph.com 2024-09-17T02:25:51.580 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-17T02:25:51.773 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-17T02:25:51.773 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-17T02:25:51.970 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-17T02:25:51.970 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-17T02:25:52.193 INFO:tasks.ceph:Archiving mon data... 2024-09-17T02:25:52.194 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908093/data/mon.a.tgz 2024-09-17T02:25:52.194 DEBUG:teuthology.orchestra.run.smithi001:> mktemp 2024-09-17T02:25:52.200 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/tmp.TLZMMl3TgV 2024-09-17T02:25:52.200 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.TLZMMl3TgV 2024-09-17T02:25:52.344 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0666 /tmp/tmp.TLZMMl3TgV 2024-09-17T02:25:52.409 DEBUG:teuthology.orchestra.remote:smithi001:/tmp/tmp.TLZMMl3TgV is 408KB 2024-09-17T02:25:52.469 DEBUG:teuthology.orchestra.run.smithi001:> rm -fr /tmp/tmp.TLZMMl3TgV 2024-09-17T02:25:52.474 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908093/data/mon.b.tgz 2024-09-17T02:25:52.474 DEBUG:teuthology.orchestra.run.smithi001:> mktemp 2024-09-17T02:25:52.523 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/tmp.0idrA5lk60 2024-09-17T02:25:52.523 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.0idrA5lk60 2024-09-17T02:25:52.710 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0666 /tmp/tmp.0idrA5lk60 2024-09-17T02:25:52.774 DEBUG:teuthology.orchestra.remote:smithi001:/tmp/tmp.0idrA5lk60 is 569KB 2024-09-17T02:25:52.837 DEBUG:teuthology.orchestra.run.smithi001:> rm -fr /tmp/tmp.0idrA5lk60 2024-09-17T02:25:52.843 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908093/data/mon.c.tgz 2024-09-17T02:25:52.843 DEBUG:teuthology.orchestra.run.smithi001:> mktemp 2024-09-17T02:25:52.891 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/tmp.UNP6KEzP7t 2024-09-17T02:25:52.893 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.UNP6KEzP7t 2024-09-17T02:25:53.078 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0666 /tmp/tmp.UNP6KEzP7t 2024-09-17T02:25:53.147 DEBUG:teuthology.orchestra.remote:smithi001:/tmp/tmp.UNP6KEzP7t is 569KB 2024-09-17T02:25:53.209 DEBUG:teuthology.orchestra.run.smithi001:> rm -fr /tmp/tmp.UNP6KEzP7t 2024-09-17T02:25:53.215 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-17T02:25:53.215 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T02:25:53.260 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T02:25:53.263 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T02:25:53.265 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T02:25:53.524 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T02:25:53.530 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T02:25:53.536 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T02:25:53.559 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T02:25:53.559 INFO:tasks.ceph:Archiving crash dumps... 2024-09-17T02:25:53.560 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908093/remote/smithi001/crash 2024-09-17T02:25:53.561 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T02:25:53.580 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908093/remote/smithi032/crash 2024-09-17T02:25:53.581 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T02:25:53.596 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908093/remote/smithi153/crash 2024-09-17T02:25:53.597 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T02:25:53.611 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908093/remote/smithi164/crash 2024-09-17T02:25:53.612 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T02:25:53.645 INFO:tasks.ceph:Compressing logs... 2024-09-17T02:25:53.645 DEBUG:teuthology.orchestra.run.smithi001:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T02:25:53.648 DEBUG:teuthology.orchestra.run.smithi032:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T02:25:53.651 DEBUG:teuthology.orchestra.run.smithi153:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T02:25:53.658 DEBUG:teuthology.orchestra.run.smithi164:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T02:25:53.665 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22329.log 2024-09-17T02:25:53.666 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23474.log 2024-09-17T02:25:53.667 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22329.log.gz 2024-09-17T02:25:53.667 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27826.log 2024-09-17T02:25:53.667 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23797.log 2024-09-17T02:25:53.667 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23474.log.gz 2024-09-17T02:25:53.669 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27826.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27826.log.gz 2024-09-17T02:25:53.669 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26912.log 2024-09-17T02:25:53.669 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23797.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23797.log.gz 2024-09-17T02:25:53.670 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27068.log 2024-09-17T02:25:53.670 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26222.log 2024-09-17T02:25:53.670 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26912.log: /var/log/ceph/ceph-client.admin.27068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26912.log.gz 2024-09-17T02:25:53.670 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27068.log.gz 2024-09-17T02:25:53.670 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24119.log 2024-09-17T02:25:53.670 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26222.log.gz 2024-09-17T02:25:53.670 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27418.log 2024-09-17T02:25:53.674 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23275.log 2024-09-17T02:25:53.674 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24119.log.gz 2024-09-17T02:25:53.675 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27418.log.gz 2024-09-17T02:25:53.675 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-17T02:25:53.675 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23275.log.gz 2024-09-17T02:25:53.675 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24788.log 2024-09-17T02:25:53.675 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25561.log 2024-09-17T02:25:53.675 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.24788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24788.log.gz 2024-09-17T02:25:53.675 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25249.log 2024-09-17T02:25:53.675 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23357.log 2024-09-17T02:25:53.675 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25561.log.gz 2024-09-17T02:25:53.675 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28088.log 2024-09-17T02:25:53.675 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25249.log.gz 2024-09-17T02:25:53.675 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23793.log 2024-09-17T02:25:53.675 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23357.log.gz 2024-09-17T02:25:53.676 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.28088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27984.log 2024-09-17T02:25:53.676 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28088.log.gz 2024-09-17T02:25:53.676 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27566.log 2024-09-17T02:25:53.676 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23793.log.gz 2024-09-17T02:25:53.676 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26725.log 2024-09-17T02:25:53.676 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27984.log.gz 2024-09-17T02:25:53.676 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27566.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27566.log.gz 2024-09-17T02:25:53.676 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22938.log 2024-09-17T02:25:53.676 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27496.log 2024-09-17T02:25:53.676 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26725.log.gz 2024-09-17T02:25:53.677 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-17T02:25:53.686 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25532.log 2024-09-17T02:25:53.686 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22938.log.gz 2024-09-17T02:25:53.686 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27306.log 2024-09-17T02:25:53.686 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27496.log.gz 2024-09-17T02:25:53.686 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25532.log.gz 2024-09-17T02:25:53.686 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27340.log 2024-09-17T02:25:53.686 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23393.log 2024-09-17T02:25:53.686 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27306.log.gz 2024-09-17T02:25:53.686 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22401.log 2024-09-17T02:25:53.686 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27340.log.gz 2024-09-17T02:25:53.687 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27904.log 2024-09-17T02:25:53.687 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23393.log.gz 2024-09-17T02:25:53.687 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22401.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22401.log.gz 2024-09-17T02:25:53.687 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24596.log 2024-09-17T02:25:53.687 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28159.log 2024-09-17T02:25:53.687 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27904.log.gz 2024-09-17T02:25:53.687 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27495.log 2024-09-17T02:25:53.687 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24596.log.gz 2024-09-17T02:25:53.687 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.28159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28159.log.gz 2024-09-17T02:25:53.687 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26362.log 2024-09-17T02:25:53.687 INFO:teuthology.orchestra.run.smithi001.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-17T02:25:53.687 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22730.log 2024-09-17T02:25:53.687 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27495.log.gz 2024-09-17T02:25:53.688 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22574.log 2024-09-17T02:25:53.688 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26362.log.gz 2024-09-17T02:25:53.688 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22790.log 2024-09-17T02:25:53.688 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22730.log.gz 2024-09-17T02:25:53.688 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24760.log 2024-09-17T02:25:53.688 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22574.log.gz 2024-09-17T02:25:53.688 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22790.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22790.log.gz 2024-09-17T02:25:53.688 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27488.log 2024-09-17T02:25:53.688 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25422.log 2024-09-17T02:25:53.688 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24760.log.gz 2024-09-17T02:25:53.688 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27488.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27488.log.gz 2024-09-17T02:25:53.688 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25975.log 2024-09-17T02:25:53.688 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25422.log.gz 2024-09-17T02:25:53.689 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27124.log 2024-09-17T02:25:53.689 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27150.log 2024-09-17T02:25:53.689 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25975.log.gz 2024-09-17T02:25:53.689 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23042.log 2024-09-17T02:25:53.689 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27124.log.gz 2024-09-17T02:25:53.689 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23172.log 2024-09-17T02:25:53.689 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27150.log.gz 2024-09-17T02:25:53.689 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21864.log 2024-09-17T02:25:53.689 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23042.log.gz 2024-09-17T02:25:53.689 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24819.log 2024-09-17T02:25:53.689 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23172.log.gz 2024-09-17T02:25:53.689 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.21864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21864.log.gz 2024-09-17T02:25:53.689 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22946.log 2024-09-17T02:25:53.690 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27852.log 2024-09-17T02:25:53.690 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24819.log.gz 2024-09-17T02:25:53.690 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22946.log.gz 2024-09-17T02:25:53.690 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25755.log 2024-09-17T02:25:53.690 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27852.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21663.log 2024-09-17T02:25:53.690 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27852.log.gz 2024-09-17T02:25:53.690 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25755.log.gz 2024-09-17T02:25:53.690 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24621.log 2024-09-17T02:25:53.690 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22201.log 2024-09-17T02:25:53.715 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph.tmp-client.admin.21663.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21663.log.gz 2024-09-17T02:25:53.715 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24621.log.gz 2024-09-17T02:25:53.715 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26886.log 2024-09-17T02:25:53.715 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27254.log 2024-09-17T02:25:53.716 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22201.log.gz 2024-09-17T02:25:53.716 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26886.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26886.log.gz 2024-09-17T02:25:53.716 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22375.log 2024-09-17T02:25:53.716 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22789.log 2024-09-17T02:25:53.716 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27254.log.gz 2024-09-17T02:25:53.716 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22375.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22375.log.gz 2024-09-17T02:25:53.716 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28114.log 2024-09-17T02:25:53.716 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23249.log 2024-09-17T02:25:53.716 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22789.log.gz 2024-09-17T02:25:53.716 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.28114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24012.log 2024-09-17T02:25:53.716 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28114.log.gz 2024-09-17T02:25:53.716 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26029.log 2024-09-17T02:25:53.716 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23249.log.gz 2024-09-17T02:25:53.717 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23622.log 2024-09-17T02:25:53.717 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24012.log.gz 2024-09-17T02:25:53.717 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26029.log.gz 2024-09-17T02:25:53.717 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24900.log 2024-09-17T02:25:53.717 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23622.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.23622.log.gz -- 2024-09-17T02:25:53.717 INFO:teuthology.orchestra.run.smithi001.stderr: /var/log/ceph/ceph-client.admin.27878.log 2024-09-17T02:25:53.717 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27696.log 2024-09-17T02:25:53.718 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24900.log.gz 2024-09-17T02:25:53.718 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27878.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27878.log.gz 2024-09-17T02:25:53.718 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-17T02:25:53.718 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27696.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27696.log.gz 2024-09-17T02:25:53.718 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26860.log 2024-09-17T02:25:53.718 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25502.log 2024-09-17T02:25:53.718 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.26860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26860.log.gz 2024-09-17T02:25:53.719 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27228.log 2024-09-17T02:25:53.719 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26337.log 2024-09-17T02:25:53.719 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25502.log.gz 2024-09-17T02:25:53.719 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25103.log 2024-09-17T02:25:53.719 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27228.log.gz 2024-09-17T02:25:53.719 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26198.log 2024-09-17T02:25:53.719 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26337.log.gz 2024-09-17T02:25:53.719 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27202.log 2024-09-17T02:25:53.719 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25103.log.gz 2024-09-17T02:25:53.719 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22429.log 2024-09-17T02:25:53.719 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26198.log.gz 2024-09-17T02:25:53.719 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23327.log 2024-09-17T02:25:53.719 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27202.log.gz 2024-09-17T02:25:53.720 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22429.log.gz 2024-09-17T02:25:53.720 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25696.log 2024-09-17T02:25:53.720 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25393.log 2024-09-17T02:25:53.720 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23327.log.gz 2024-09-17T02:25:53.720 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26556.log 2024-09-17T02:25:53.720 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25696.log.gz 2024-09-17T02:25:53.720 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26808.log 2024-09-17T02:25:53.720 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25393.log.gz 2024-09-17T02:25:53.720 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26777.log 2024-09-17T02:25:53.720 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26556.log.gz 2024-09-17T02:25:53.720 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24876.log 2024-09-17T02:25:53.720 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26808.log.gz 2024-09-17T02:25:53.721 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24008.log 2024-09-17T02:25:53.721 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26777.log.gz 2024-09-17T02:25:53.721 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24990.log 2024-09-17T02:25:53.721 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24876.log.gz 2024-09-17T02:25:53.721 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27093.log 2024-09-17T02:25:53.721 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24008.log.gz 2024-09-17T02:25:53.721 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25865.log 2024-09-17T02:25:53.721 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24990.log.gz 2024-09-17T02:25:53.721 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24176.log 2024-09-17T02:25:53.721 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27093.log.gz 2024-09-17T02:25:53.721 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25047.log 2024-09-17T02:25:53.721 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25865.log.gz 2024-09-17T02:25:53.721 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26502.log 2024-09-17T02:25:53.721 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24176.log.gz 2024-09-17T02:25:53.722 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25047.log.gz 2024-09-17T02:25:53.722 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23870.log 2024-09-17T02:25:53.722 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27042.log 2024-09-17T02:25:53.722 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26502.log.gz 2024-09-17T02:25:53.722 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26282.log 2024-09-17T02:25:53.722 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23870.log.gz 2024-09-17T02:25:53.722 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24845.log 2024-09-17T02:25:53.722 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27042.log.gz 2024-09-17T02:25:53.722 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26990.log 2024-09-17T02:25:53.722 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26282.log.gz 2024-09-17T02:25:53.722 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27592.log 2024-09-17T02:25:53.722 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24845.log.gz 2024-09-17T02:25:53.722 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26586.log 2024-09-17T02:25:53.722 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26990.log.gz 2024-09-17T02:25:53.723 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27592.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.27592.log.gz 2024-09-17T02:25:53.723 INFO:teuthology.orchestra.run.smithi001.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.24351.log 2024-09-17T02:25:53.723 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23844.log 2024-09-17T02:25:53.723 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26586.log.gz 2024-09-17T02:25:53.723 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23896.log 2024-09-17T02:25:53.723 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24351.log.gz 2024-09-17T02:25:53.723 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23396.log 2024-09-17T02:25:53.723 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23844.log.gz 2024-09-17T02:25:53.723 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24679.log 2024-09-17T02:25:53.723 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23896.log.gz 2024-09-17T02:25:53.723 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25810.log 2024-09-17T02:25:53.723 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23396.log.gz 2024-09-17T02:25:53.723 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26004.log 2024-09-17T02:25:53.724 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24679.log.gz 2024-09-17T02:25:53.724 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26059.log 2024-09-17T02:25:53.724 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25810.log.gz 2024-09-17T02:25:53.724 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23094.log 2024-09-17T02:25:53.724 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26004.log.gz 2024-09-17T02:25:53.724 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26695.log 2024-09-17T02:25:53.724 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26059.log.gz 2024-09-17T02:25:53.724 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27618.log 2024-09-17T02:25:53.725 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23094.log.gz 2024-09-17T02:25:53.725 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24937.log 2024-09-17T02:25:53.725 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26695.log.gz 2024-09-17T02:25:53.725 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24207.log 2024-09-17T02:25:53.725 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27618.log.gz 2024-09-17T02:25:53.725 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23729.log 2024-09-17T02:25:53.725 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24937.log.gz 2024-09-17T02:25:53.725 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22081.log 2024-09-17T02:25:53.725 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24207.log.gz 2024-09-17T02:25:53.725 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24347.log 2024-09-17T02:25:53.725 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23729.log.gz 2024-09-17T02:25:53.725 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25835.log 2024-09-17T02:25:53.725 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22081.log.gz 2024-09-17T02:25:53.726 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24347.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.24347.log.gz -5 2024-09-17T02:25:53.726 INFO:teuthology.orchestra.run.smithi001.stderr: --verbose -- /var/log/ceph/ceph-client.admin.22600.log 2024-09-17T02:25:53.726 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25616.log/var/log/ceph/ceph-client.admin.25835.log: 2024-09-17T02:25:53.726 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25835.log.gz 2024-09-17T02:25:53.726 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28010.log 2024-09-17T02:25:53.726 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22600.log.gz 2024-09-17T02:25:53.726 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24507.log 2024-09-17T02:25:53.726 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25616.log.gz 2024-09-17T02:25:53.726 INFO:teuthology.orchestra.run.smithi001.stderr:gzip/var/log/ceph/ceph-client.admin.28010.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.25078.log 2024-09-17T02:25:53.726 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28010.log.gz 2024-09-17T02:25:53.726 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22868.log 2024-09-17T02:25:53.726 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24507.log.gz 2024-09-17T02:25:53.726 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25078.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.24092.log -- replaced with /var/log/ceph/ceph-client.admin.25078.log.gz 2024-09-17T02:25:53.726 INFO:teuthology.orchestra.run.smithi001.stderr: 2024-09-17T02:25:53.727 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22868.log.gz 2024-09-17T02:25:53.727 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27800.log 2024-09-17T02:25:53.727 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24092.log.gz 2024-09-17T02:25:53.727 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28036.log 2024-09-17T02:25:53.727 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24375.log 2024-09-17T02:25:53.727 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27800.log.gz 2024-09-17T02:25:53.727 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.28036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24705.log 2024-09-17T02:25:53.727 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28036.log.gz 2024-09-17T02:25:53.727 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23647.log 2024-09-17T02:25:53.727 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24375.log.gz 2024-09-17T02:25:53.727 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26253.log 2024-09-17T02:25:53.727 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24705.log.gz 2024-09-17T02:25:53.727 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22058.log 2024-09-17T02:25:53.728 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23647.log.gz 2024-09-17T02:25:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27176.log 2024-09-17T02:25:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26253.log.gz 2024-09-17T02:25:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24482.log 2024-09-17T02:25:53.728 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22058.log.gz 2024-09-17T02:25:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27176.log.gz 2024-09-17T02:25:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26447.log 2024-09-17T02:25:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26670.log 2024-09-17T02:25:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24482.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24482.log.gz 2024-09-17T02:25:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26447.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.26447.log.gz --verbose 2024-09-17T02:25:53.728 INFO:teuthology.orchestra.run.smithi001.stderr: -- /var/log/ceph/ceph-client.admin.24288.log 2024-09-17T02:25:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26670.log.gz 2024-09-17T02:25:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-17T02:25:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26114.log 2024-09-17T02:25:53.729 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24288.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24288.log.gz 2024-09-17T02:25:53.729 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24232.log 2024-09-17T02:25:53.732 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22947.log 2024-09-17T02:25:53.732 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-17T02:25:53.732 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.22947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22995.log 2024-09-17T02:25:53.732 INFO:teuthology.orchestra.run.smithi164.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22947.log.gz 2024-09-17T02:25:53.732 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.764.log 2024-09-17T02:25:53.732 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.22995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22995.log.gz 2024-09-17T02:25:53.732 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22971.log 2024-09-17T02:25:53.732 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.764.log: /var/log/ceph/ceph-client.admin.22971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22971.log.gz 2024-09-17T02:25:53.732 INFO:teuthology.orchestra.run.smithi164.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.764.log.gz 2024-09-17T02:25:53.748 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-17T02:25:53.760 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28062.log 2024-09-17T02:25:53.760 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26114.log.gz 2024-09-17T02:25:53.760 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22544.log 2024-09-17T02:25:53.761 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24232.log.gz 2024-09-17T02:25:53.761 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.28062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28062.log.gz 2024-09-17T02:25:53.761 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25477.log 2024-09-17T02:25:53.761 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26531.log/var/log/ceph/ceph-client.admin.22544.log: 2024-09-17T02:25:53.761 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22544.log.gz 2024-09-17T02:25:53.761 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25477.log.gz 2024-09-17T02:25:53.761 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T02:25:53.761 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24321.log 2024-09-17T02:25:53.761 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26531.log.gz 2024-09-17T02:25:53.761 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25587.log 2024-09-17T02:25:53.761 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27280.log 2024-09-17T02:25:53.761 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24321.log.gz 2024-09-17T02:25:53.761 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27722.log 2024-09-17T02:25:53.762 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25587.log.gz 2024-09-17T02:25:53.762 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27280.log.gz 2024-09-17T02:25:53.762 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23705.log 2024-09-17T02:25:53.762 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25166.log 2024-09-17T02:25:53.762 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27722.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27722.log.gz 2024-09-17T02:25:53.762 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23120.log 2024-09-17T02:25:53.762 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23705.log.gz 2024-09-17T02:25:53.762 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25166.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.25166.log.gz --verbose 2024-09-17T02:25:53.762 INFO:teuthology.orchestra.run.smithi001.stderr: -- /var/log/ceph/ceph-client.admin.22945.log 2024-09-17T02:25:53.762 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23531.log 2024-09-17T02:25:53.762 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23120.log.gz 2024-09-17T02:25:53.762 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22945.log: 94.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T02:25:53.762 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26476.log 2024-09-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22945.log.gz 2024-09-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23927.log 2024-09-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23531.log.gz 2024-09-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26476.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26476.log.gz 2024-09-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23146.log 2024-09-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25192.log 2024-09-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23927.log.gz 2024-09-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26751.log 2024-09-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23146.log.gz 2024-09-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25920.log 2024-09-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25192.log.gz 2024-09-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26751.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.26751.log.gz /var/log/ceph/ceph-client.admin.26615.log 2024-09-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi001.stderr: 2024-09-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24565.log 2024-09-17T02:25:53.764 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25920.log.gz 2024-09-17T02:25:53.764 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26615.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.26615.log.gz -- 2024-09-17T02:25:53.764 INFO:teuthology.orchestra.run.smithi001.stderr: /var/log/ceph/ceph-client.admin.24264.log 2024-09-17T02:25:53.764 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24565.log.gz 2024-09-17T02:25:53.764 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25671.log 2024-09-17T02:25:53.764 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24264.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.26964.log 2024-09-17T02:25:53.764 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.24264.log.gz 2024-09-17T02:25:53.764 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25671.log.gz 2024-09-17T02:25:53.764 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-17T02:25:53.764 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27644.log 2024-09-17T02:25:53.764 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26964.log.gz 2024-09-17T02:25:53.764 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23500.log 2024-09-17T02:25:53.764 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27644.log.gz 2024-09-17T02:25:53.765 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.23533.log 2024-09-17T02:25:53.765 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23016.log 2024-09-17T02:25:53.765 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23500.log.gz 2024-09-17T02:25:53.765 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.0.23533.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.23533.log.gz 2024-09-17T02:25:53.765 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27339.log 2024-09-17T02:25:53.765 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27933.log 2024-09-17T02:25:53.765 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23016.log.gz 2024-09-17T02:25:53.765 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27339.log.gz 2024-09-17T02:25:53.765 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26308.log 2024-09-17T02:25:53.765 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25281.log 2024-09-17T02:25:53.765 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27933.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27933.log.gz 2024-09-17T02:25:53.765 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26308.log.gz 2024-09-17T02:25:53.765 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23762.log 2024-09-17T02:25:53.766 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22256.log 2024-09-17T02:25:53.766 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25281.log.gz 2024-09-17T02:25:53.766 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23762.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23762.log.gz 2024-09-17T02:25:53.766 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25781.log 2024-09-17T02:25:53.766 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25338.log 2024-09-17T02:25:53.766 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22256.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22256.log.gz 2024-09-17T02:25:53.766 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25781.log.gz 2024-09-17T02:25:53.766 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22492.log 2024-09-17T02:25:53.766 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27417.log 2024-09-17T02:25:53.766 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25338.log.gz 2024-09-17T02:25:53.766 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22492.log.gz 2024-09-17T02:25:53.766 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23984.log 2024-09-17T02:25:53.766 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26143.log 2024-09-17T02:25:53.766 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27417.log.gz 2024-09-17T02:25:53.767 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23984.log.gz 2024-09-17T02:25:53.767 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28185.log 2024-09-17T02:25:53.767 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26396.log 2024-09-17T02:25:53.767 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26143.log.gz 2024-09-17T02:25:53.767 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.28185.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28185.log.gz 2024-09-17T02:25:53.767 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25135.log 2024-09-17T02:25:53.767 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T02:25:53.767 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26396.log.gz 2024-09-17T02:25:53.767 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25135.log.gz 2024-09-17T02:25:53.767 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24933.log 2024-09-17T02:25:53.767 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22518.log 2024-09-17T02:25:53.767 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.24933.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24933.log.gz 2024-09-17T02:25:53.767 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-17T02:25:53.767 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24150.log 2024-09-17T02:25:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22518.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22518.log.gz 2024-09-17T02:25:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25305.log 2024-09-17T02:25:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23953.log 2024-09-17T02:25:53.768 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24150.log.gz 2024-09-17T02:25:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23301.log 2024-09-17T02:25:53.768 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25305.log.gz 2024-09-17T02:25:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23953.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23953.log.gz 2024-09-17T02:25:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24653.log 2024-09-17T02:25:53.768 INFO:teuthology.orchestra.run.smithi001.stderr: 95.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T02:25:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22866.log 2024-09-17T02:25:53.768 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23301.log.gz 2024-09-17T02:25:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22281.log 2024-09-17T02:25:53.769 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24653.log.gz 2024-09-17T02:25:53.769 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22457.log 2024-09-17T02:25:53.769 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22866.log.gz 2024-09-17T02:25:53.769 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26938.log 2024-09-17T02:25:53.769 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22281.log.gz 2024-09-17T02:25:53.769 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26395.log 2024-09-17T02:25:53.769 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22457.log.gz 2024-09-17T02:25:53.769 INFO:teuthology.orchestra.run.smithi001.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-17T02:25:53.769 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25367.log 2024-09-17T02:25:53.769 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26938.log.gz 2024-09-17T02:25:53.769 INFO:teuthology.orchestra.run.smithi001.stderr:gzip/var/log/ceph/ceph-client.admin.26395.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.27338.log 2024-09-17T02:25:53.769 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26395.log.gz 2024-09-17T02:25:53.769 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22860.log 2024-09-17T02:25:53.770 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25367.log.gz 2024-09-17T02:25:53.770 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27338.log.gz 2024-09-17T02:25:53.770 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27960.log 2024-09-17T02:25:53.770 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22788.log 2024-09-17T02:25:53.770 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22860.log.gz 2024-09-17T02:25:53.770 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27960.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.25949.log 2024-09-17T02:25:53.770 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.27960.log.gz 2024-09-17T02:25:53.770 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22788.log.gz 2024-09-17T02:25:53.770 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25223.log 2024-09-17T02:25:53.770 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22306.log 2024-09-17T02:25:53.770 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25949.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25949.log.gz 2024-09-17T02:25:53.770 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25223.log.gz 2024-09-17T02:25:53.770 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27774.log 2024-09-17T02:25:53.770 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22652.log 2024-09-17T02:25:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22306.log.gz 2024-09-17T02:25:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27774.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.27774.log.gz --verbose 2024-09-17T02:25:53.771 INFO:teuthology.orchestra.run.smithi001.stderr: -- /var/log/ceph/ceph-client.admin.27748.log 2024-09-17T02:25:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22678.log 2024-09-17T02:25:53.771 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22652.log.gz 2024-09-17T02:25:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27748.log.gz 2024-09-17T02:25:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-17T02:25:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24539.log 2024-09-17T02:25:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22678.log.gz 2024-09-17T02:25:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25642.log 2024-09-17T02:25:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25726.log 2024-09-17T02:25:53.771 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24539.log.gz 2024-09-17T02:25:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22704.log 2024-09-17T02:25:53.772 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25642.log.gz 2024-09-17T02:25:53.772 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24430.log 2024-09-17T02:25:53.772 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25726.log.gz 2024-09-17T02:25:53.772 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23591.log 2024-09-17T02:25:53.772 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22704.log.gz 2024-09-17T02:25:53.772 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24430.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23674.log 2024-09-17T02:25:53.772 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.24430.log.gz 2024-09-17T02:25:53.772 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24709.log 2024-09-17T02:25:53.772 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23591.log.gz 2024-09-17T02:25:53.772 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26641.log 2024-09-17T02:25:53.772 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23674.log.gz 2024-09-17T02:25:53.772 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25021.log 2024-09-17T02:25:53.772 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24709.log.gz 2024-09-17T02:25:53.772 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22626.log 2024-09-17T02:25:53.773 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26641.log.gz 2024-09-17T02:25:53.773 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26088.log 2024-09-17T02:25:53.773 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25021.log.gz 2024-09-17T02:25:53.773 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22756.log 2024-09-17T02:25:53.773 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22626.log.gz 2024-09-17T02:25:53.773 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25869.log 2024-09-17T02:25:53.773 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26088.log.gz 2024-09-17T02:25:53.773 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.22756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23198.log 2024-09-17T02:25:53.773 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22756.log.gz 2024-09-17T02:25:53.773 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23068.log 2024-09-17T02:25:53.773 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25869.log.gz 2024-09-17T02:25:53.773 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25448.log 2024-09-17T02:25:53.773 INFO:teuthology.orchestra.run.smithi001.stderr: 48.6% -- replaced with /var/log/ceph/ceph-client.admin.23198.log.gz 2024-09-17T02:25:53.774 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23395.log 2024-09-17T02:25:53.774 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23068.log.gz 2024-09-17T02:25:53.774 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.25448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24456.log 2024-09-17T02:25:53.774 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25448.log.gz 2024-09-17T02:25:53.774 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.23395.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23395.log.gz 2024-09-17T02:25:53.774 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27016.log 2024-09-17T02:25:53.774 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26169.log 2024-09-17T02:25:53.774 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24456.log.gz 2024-09-17T02:25:53.774 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24062.log 2024-09-17T02:25:53.774 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27016.log.gz 2024-09-17T02:25:53.774 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26834.log 2024-09-17T02:25:53.774 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26169.log.gz 2024-09-17T02:25:53.774 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.24062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27670.log 2024-09-17T02:25:53.774 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24062.log.gz 2024-09-17T02:25:53.775 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.26834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27415.log 2024-09-17T02:25:53.775 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26834.log.gz 2024-09-17T02:25:53.775 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27670.log.gz 2024-09-17T02:25:53.775 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27415.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27415.log.gz 2024-09-17T02:25:53.781 INFO:teuthology.orchestra.run.smithi001.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-17T02:25:53.850 INFO:teuthology.orchestra.run.smithi001.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-17T02:25:53.861 INFO:teuthology.orchestra.run.smithi001.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-17T02:25:53.983 INFO:teuthology.orchestra.run.smithi001.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-17T02:25:53.984 INFO:teuthology.orchestra.run.smithi001.stderr: 2024-09-17T02:25:53.984 INFO:teuthology.orchestra.run.smithi001.stderr:real 0m0.334s 2024-09-17T02:25:53.984 INFO:teuthology.orchestra.run.smithi001.stderr:user 0m0.770s 2024-09-17T02:25:53.984 INFO:teuthology.orchestra.run.smithi001.stderr:sys 0m0.085s 2024-09-17T02:25:55.775 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-17T02:26:13.781 INFO:teuthology.orchestra.run.smithi164.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-17T02:26:13.782 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-09-17T02:26:13.782 INFO:teuthology.orchestra.run.smithi164.stderr:real 0m20.088s 2024-09-17T02:26:13.782 INFO:teuthology.orchestra.run.smithi164.stderr:user 0m18.776s 2024-09-17T02:26:13.782 INFO:teuthology.orchestra.run.smithi164.stderr:sys 0m0.871s 2024-09-17T02:26:28.557 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.0.log: 93.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-17T02:26:28.559 INFO:teuthology.orchestra.run.smithi032.stderr: 2024-09-17T02:26:28.559 INFO:teuthology.orchestra.run.smithi032.stderr:real 0m34.906s 2024-09-17T02:26:28.559 INFO:teuthology.orchestra.run.smithi032.stderr:user 0m33.845s 2024-09-17T02:26:28.559 INFO:teuthology.orchestra.run.smithi032.stderr:sys 0m1.059s 2024-09-17T02:26:31.125 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.1.log: 93.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-17T02:26:31.126 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-17T02:26:31.126 INFO:teuthology.orchestra.run.smithi153.stderr:real 0m37.465s 2024-09-17T02:26:31.126 INFO:teuthology.orchestra.run.smithi153.stderr:user 0m36.117s 2024-09-17T02:26:31.126 INFO:teuthology.orchestra.run.smithi153.stderr:sys 0m1.278s 2024-09-17T02:26:31.126 INFO:tasks.ceph:Archiving logs... 2024-09-17T02:26:31.126 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908093/remote/smithi001/log 2024-09-17T02:26:31.128 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T02:26:31.404 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908093/remote/smithi032/log 2024-09-17T02:26:31.405 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T02:26:35.923 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908093/remote/smithi153/log 2024-09-17T02:26:35.924 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T02:26:41.018 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908093/remote/smithi164/log 2024-09-17T02:26:41.019 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T02:26:43.715 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T02:26:43.725 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T02:26:43.725 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T02:26:43.728 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T02:26:43.730 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T02:26:43.732 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T02:26:43.854 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T02:26:43.864 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T02:26:43.864 DEBUG:teuthology.orchestra.run.smithi001:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T02:26:43.867 DEBUG:teuthology.orchestra.run.smithi032:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T02:26:43.870 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T02:26:43.873 DEBUG:teuthology.orchestra.run.smithi164:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T02:26:43.879 INFO:teuthology.orchestra.run.smithi001.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T02:26:43.879 INFO:teuthology.orchestra.run.smithi001.stdout:============================================================================== 2024-09-17T02:26:43.879 INFO:teuthology.orchestra.run.smithi001.stdout:*hv01.front.sepi 67.205.162.81 3 u 36 64 377 0.107 -3.984 1.035 2024-09-17T02:26:43.879 INFO:teuthology.orchestra.run.smithi001.stdout:+hv02.front.sepi 63.231.80.2 3 u 41 64 377 0.096 -0.021 1.424 2024-09-17T02:26:43.879 INFO:teuthology.orchestra.run.smithi001.stdout:+hv03.front.sepi 74.6.168.72 3 u 34 64 377 0.082 +0.848 0.869 2024-09-17T02:26:43.879 INFO:teuthology.orchestra.run.smithi001.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T02:26:43.881 INFO:teuthology.orchestra.run.smithi032.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T02:26:43.881 INFO:teuthology.orchestra.run.smithi032.stdout:============================================================================== 2024-09-17T02:26:43.881 INFO:teuthology.orchestra.run.smithi032.stdout:+hv01.front.sepi 67.205.162.81 3 u 29 64 377 0.094 -5.853 1.551 2024-09-17T02:26:43.881 INFO:teuthology.orchestra.run.smithi032.stdout:+hv02.front.sepi 63.231.80.2 3 u 35 64 377 0.085 +1.281 2.274 2024-09-17T02:26:43.881 INFO:teuthology.orchestra.run.smithi032.stdout:*hv03.front.sepi 74.6.168.72 3 u 37 64 377 0.069 -1.256 1.646 2024-09-17T02:26:43.881 INFO:teuthology.orchestra.run.smithi032.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T02:26:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T02:26:43.883 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================== 2024-09-17T02:26:43.883 INFO:teuthology.orchestra.run.smithi153.stdout:+hv01.front.sepi 67.205.162.81 3 u 40 64 377 0.064 -6.618 1.985 2024-09-17T02:26:43.883 INFO:teuthology.orchestra.run.smithi153.stdout:+hv02.front.sepi 63.231.80.2 3 u 37 64 377 0.063 +0.505 1.054 2024-09-17T02:26:43.883 INFO:teuthology.orchestra.run.smithi153.stdout:*hv03.front.sepi 74.6.168.72 3 u 37 64 377 0.071 -1.840 2.047 2024-09-17T02:26:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T02:26:43.961 INFO:teuthology.orchestra.run.smithi164.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T02:26:43.961 INFO:teuthology.orchestra.run.smithi164.stdout:============================================================================== 2024-09-17T02:26:43.961 INFO:teuthology.orchestra.run.smithi164.stdout: hv01.front.sepi 67.205.162.81 3 u 29 64 7 0.148 +366.95 0.884 2024-09-17T02:26:43.961 INFO:teuthology.orchestra.run.smithi164.stdout: hv02.front.sepi 63.231.80.2 3 u 29 64 7 0.123 +372.15 0.910 2024-09-17T02:26:43.962 INFO:teuthology.orchestra.run.smithi164.stdout: hv03.front.sepi 74.6.168.72 3 u 31 64 7 0.108 +371.87 0.814 2024-09-17T02:26:43.962 INFO:teuthology.orchestra.run.smithi164.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T02:26:43.963 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T02:26:43.972 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T02:26:43.972 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T02:26:43.984 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T02:26:43.997 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T02:26:44.006 INFO:teuthology.task.internal:Duration was 1037.811268 seconds 2024-09-17T02:26:44.007 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T02:26:44.016 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T02:26:44.016 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T02:26:44.019 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T02:26:44.021 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T02:26:44.024 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T02:26:44.078 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T02:26:44.079 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi001.front.sepia.ceph.com 2024-09-17T02:26:44.079 DEBUG:teuthology.orchestra.run.smithi001:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T02:26:44.108 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi032.front.sepia.ceph.com 2024-09-17T02:26:44.108 DEBUG:teuthology.orchestra.run.smithi032:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T02:26:44.119 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2024-09-17T02:26:44.119 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T02:26:44.129 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi164.front.sepia.ceph.com 2024-09-17T02:26:44.129 DEBUG:teuthology.orchestra.run.smithi164:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T02:26:44.139 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T02:26:44.140 DEBUG:teuthology.orchestra.run.smithi001:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T02:26:44.151 DEBUG:teuthology.orchestra.run.smithi032:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T02:26:44.161 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T02:26:44.178 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T02:26:44.237 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T02:26:44.237 DEBUG:teuthology.orchestra.run.smithi001:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T02:26:44.239 DEBUG:teuthology.orchestra.run.smithi032:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T02:26:44.241 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T02:26:44.245 DEBUG:teuthology.orchestra.run.smithi164:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T02:26:44.346 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T02:26:44.356 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T02:26:44.356 DEBUG:teuthology.orchestra.run.smithi001:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T02:26:44.370 DEBUG:teuthology.orchestra.run.smithi032:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T02:26:44.382 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T02:26:44.396 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T02:26:44.410 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T02:26:44.420 DEBUG:teuthology.orchestra.run.smithi001:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T02:26:44.422 DEBUG:teuthology.orchestra.run.smithi032:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T02:26:44.426 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T02:26:44.432 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern = core 2024-09-17T02:26:44.437 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern = core 2024-09-17T02:26:44.443 DEBUG:teuthology.orchestra.run.smithi164:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T02:26:44.453 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2024-09-17T02:26:44.475 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = core 2024-09-17T02:26:44.559 DEBUG:teuthology.orchestra.run.smithi001:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T02:26:44.564 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:26:44.564 DEBUG:teuthology.orchestra.run.smithi032:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T02:26:44.569 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:26:44.569 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T02:26:44.604 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:26:44.604 DEBUG:teuthology.orchestra.run.smithi164:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T02:26:44.609 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:26:44.609 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T02:26:44.620 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T02:26:44.621 DEBUG:teuthology.misc:Transferring archived files from smithi001:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908093/remote/smithi001 2024-09-17T02:26:44.621 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T02:26:44.643 DEBUG:teuthology.misc:Transferring archived files from smithi032:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908093/remote/smithi032 2024-09-17T02:26:44.643 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T02:26:44.666 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908093/remote/smithi153 2024-09-17T02:26:44.666 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T02:26:44.688 DEBUG:teuthology.misc:Transferring archived files from smithi164:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908093/remote/smithi164 2024-09-17T02:26:44.688 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T02:26:44.709 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T02:26:44.709 DEBUG:teuthology.orchestra.run.smithi001:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T02:26:44.712 DEBUG:teuthology.orchestra.run.smithi032:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T02:26:44.714 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T02:26:44.729 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T02:26:44.754 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T02:26:44.766 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T02:26:44.766 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T02:26:44.774 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T02:26:44.775 DEBUG:teuthology.orchestra.run.smithi001:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T02:26:44.777 DEBUG:teuthology.orchestra.run.smithi032:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T02:26:44.779 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T02:26:44.781 INFO:teuthology.orchestra.run.smithi001.stdout: 658465 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 02:26 /home/ubuntu/cephtest 2024-09-17T02:26:44.782 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T02:26:44.783 INFO:teuthology.orchestra.run.smithi032.stdout: 658625 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 02:26 /home/ubuntu/cephtest 2024-09-17T02:26:44.785 INFO:teuthology.orchestra.run.smithi153.stdout: 658637 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 02:26 /home/ubuntu/cephtest 2024-09-17T02:26:44.802 INFO:teuthology.orchestra.run.smithi164.stdout: 658615 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 02:26 /home/ubuntu/cephtest 2024-09-17T02:26:44.803 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T02:26:44.813 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T02:26:44.837 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-distros/ubuntu_latest tasks/admin_socket_objecter_requests thrashosds-health} duration: 1037.8112676143646 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-17T02:26:44.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T02:26:44.922 INFO:teuthology.run:pass